2024-09-18T20:53:12.904 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-18T20:53:12.926 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-18T20:53:13.019 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/ksirivad-2024-09-18_20:45:49-upgrade-squid-release-distro-default-smithi/7911588 branch: squid-release description: upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: null first_in_suite: false job_id: '7911588' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/quincy ' name: ksirivad-2024-09-18_20:45:49-upgrade-squid-release-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid-release ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - osds down - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 06b1b1de896d25f0645e4a306558ab0b4d4fc56f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 06b1b1de896d25f0645e4a306558ab0b4d4fc56f kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-ksirivad-fix-67879 sha1: c27976df948bf97893b1a7826e51bfff94e4f88c owner: scheduled_ksirivad@teuthology priority: 70 repo: https://github.com/ceph/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 9891 sha1: 06b1b1de896d25f0645e4a306558ab0b4d4fc56f sleep_before_teardown: 0 suite: upgrade suite_branch: wip-ksirivad-fix-67879 suite_path: /home/teuthworker/src/github.com_kamoltat_ceph_c27976df948bf97893b1a7826e51bfff94e4f88c/qa suite_relpath: qa suite_repo: https://github.com/kamoltat/ceph.git suite_sha1: c27976df948bf97893b1a7826e51bfff94e4f88c targets: smithi077.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ35JFxHAAEjwoRgMrPXI/AR+hdPjQNAt5nRG5culEWeu9F11Dly1ycEkevPyW/Kxw3Tt111Jy/IC8HH38b5P58= smithi103.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMuCNwK9Nns1G7Th7Ut2n+yXh/5EtVwQ6ENv7e+kkfPIyv7lWiME1fmUkV60R5/vGbADG2lfeSXSzdTZxN/WyVU= tasks: - install: branch: quincy exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: quincy cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:quincy roleless: true - print: '**** done end installing quincy cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - ceph-fuse: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: - /cephfs/home/ksirivad/src/github.com_kamoltat_ceph_wip-ksirivad-fix-67879/qa/suites/upgrade/cephfs/mds_upgrade_sequence/tasks/3-upgrade-mgr-staggered.yaml meta: {} postmerge: [] variables: fail_fs: false teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-18_20:45:49 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs false || true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: ksirivad verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-09-18T20:53:13.019 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_kamoltat_ceph_c27976df948bf97893b1a7826e51bfff94e4f88c/qa; will attempt to use it 2024-09-18T20:53:13.019 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_kamoltat_ceph_c27976df948bf97893b1a7826e51bfff94e4f88c/qa/tasks 2024-09-18T20:53:13.020 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-18T20:53:13.021 INFO:teuthology.task.internal:Checking packages... 2024-09-18T20:53:13.041 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '06b1b1de896d25f0645e4a306558ab0b4d4fc56f' 2024-09-18T20:53:13.041 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-18T20:53:13.041 INFO:teuthology.packaging:ref: None 2024-09-18T20:53:13.041 INFO:teuthology.packaging:tag: None 2024-09-18T20:53:13.041 INFO:teuthology.packaging:branch: squid-release 2024-09-18T20:53:13.041 INFO:teuthology.packaging:sha1: 06b1b1de896d25f0645e4a306558ab0b4d4fc56f 2024-09-18T20:53:13.042 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid-release 2024-09-18T20:53:13.181 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-17.g06b1b1de 2024-09-18T20:53:13.183 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-18T20:53:13.189 INFO:teuthology.task.internal:no buildpackages task found 2024-09-18T20:53:13.189 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-18T20:53:13.207 INFO:teuthology.task.internal:Saving configuration 2024-09-18T20:53:13.225 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-18T20:53:13.232 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-18T20:53:13.257 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi077.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/ksirivad-2024-09-18_20:45:49-upgrade-squid-release-distro-default-smithi/7911588', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-18 20:47:48.510595', 'locked_by': 'scheduled_ksirivad@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ35JFxHAAEjwoRgMrPXI/AR+hdPjQNAt5nRG5culEWeu9F11Dly1ycEkevPyW/Kxw3Tt111Jy/IC8HH38b5P58='} 2024-09-18T20:53:13.280 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi103.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/ksirivad-2024-09-18_20:45:49-upgrade-squid-release-distro-default-smithi/7911588', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-18 20:47:48.509183', 'locked_by': 'scheduled_ksirivad@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMuCNwK9Nns1G7Th7Ut2n+yXh/5EtVwQ6ENv7e+kkfPIyv7lWiME1fmUkV60R5/vGbADG2lfeSXSzdTZxN/WyVU='} 2024-09-18T20:53:13.280 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-18T20:53:13.286 INFO:teuthology.task.internal:roles: ubuntu@smithi077.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-09-18T20:53:13.286 INFO:teuthology.task.internal:roles: ubuntu@smithi103.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-09-18T20:53:13.286 INFO:teuthology.run_tasks:Running task console_log... 2024-09-18T20:53:13.343 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa06d3c3ac0>, signals=[15]) 2024-09-18T20:53:13.343 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-18T20:53:13.349 INFO:teuthology.task.internal:Opening connections... 2024-09-18T20:53:13.349 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi077.front.sepia.ceph.com 2024-09-18T20:53:13.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T20:53:13.425 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi103.front.sepia.ceph.com 2024-09-18T20:53:13.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T20:53:13.500 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-18T20:53:13.506 DEBUG:teuthology.orchestra.run.smithi077:> uname -m 2024-09-18T20:53:13.525 INFO:teuthology.orchestra.run.smithi077.stdout:x86_64 2024-09-18T20:53:13.525 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release 2024-09-18T20:53:13.582 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="CentOS Stream" 2024-09-18T20:53:13.583 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="9" 2024-09-18T20:53:13.583 INFO:teuthology.orchestra.run.smithi077.stdout:ID="centos" 2024-09-18T20:53:13.583 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE="rhel fedora" 2024-09-18T20:53:13.583 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="9" 2024-09-18T20:53:13.583 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM_ID="platform:el9" 2024-09-18T20:53:13.583 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-18T20:53:13.583 INFO:teuthology.orchestra.run.smithi077.stdout:ANSI_COLOR="0;31" 2024-09-18T20:53:13.583 INFO:teuthology.orchestra.run.smithi077.stdout:LOGO="fedora-logo-icon" 2024-09-18T20:53:13.583 INFO:teuthology.orchestra.run.smithi077.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-18T20:53:13.583 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://centos.org/" 2024-09-18T20:53:13.583 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-18T20:53:13.583 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-18T20:53:13.583 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-18T20:53:13.584 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server 2024-09-18T20:53:13.607 DEBUG:teuthology.orchestra.run.smithi103:> uname -m 2024-09-18T20:53:13.625 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64 2024-09-18T20:53:13.626 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2024-09-18T20:53:13.684 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="CentOS Stream" 2024-09-18T20:53:13.684 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="9" 2024-09-18T20:53:13.684 INFO:teuthology.orchestra.run.smithi103.stdout:ID="centos" 2024-09-18T20:53:13.684 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="rhel fedora" 2024-09-18T20:53:13.684 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="9" 2024-09-18T20:53:13.684 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el9" 2024-09-18T20:53:13.684 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-18T20:53:13.684 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2024-09-18T20:53:13.684 INFO:teuthology.orchestra.run.smithi103.stdout:LOGO="fedora-logo-icon" 2024-09-18T20:53:13.685 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-18T20:53:13.685 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://centos.org/" 2024-09-18T20:53:13.685 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-18T20:53:13.685 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-18T20:53:13.685 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-18T20:53:13.685 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2024-09-18T20:53:13.706 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-18T20:53:13.714 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-18T20:53:13.754 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-18T20:53:13.754 DEBUG:teuthology.orchestra.run.smithi077:> test '!' -e /home/ubuntu/cephtest 2024-09-18T20:53:13.757 DEBUG:teuthology.orchestra.run.smithi103:> test '!' -e /home/ubuntu/cephtest 2024-09-18T20:53:13.773 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-18T20:53:13.779 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-18T20:53:13.779 DEBUG:teuthology.orchestra.run.smithi077:> test -z $(ls -A /var/lib/ceph) 2024-09-18T20:53:13.815 DEBUG:teuthology.orchestra.run.smithi103:> test -z $(ls -A /var/lib/ceph) 2024-09-18T20:53:13.928 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-18T20:53:13.981 INFO:teuthology.run_tasks:Running task kernel... 2024-09-18T20:53:13.995 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-18T20:53:13.995 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-18T20:53:13.996 DEBUG:teuthology.orchestra.run.smithi077:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-18T20:53:13.996 DEBUG:teuthology.orchestra.run.smithi103:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-18T20:53:14.013 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T20:53:14.013 DEBUG:teuthology.orchestra.run.smithi077:> uname -r 2024-09-18T20:53:14.014 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T20:53:14.014 DEBUG:teuthology.orchestra.run.smithi103:> uname -r 2024-09-18T20:53:14.071 INFO:teuthology.orchestra.run.smithi077.stdout:5.14.0-503.el9.x86_64 2024-09-18T20:53:14.071 INFO:teuthology.task.kernel:Running kernel on smithi077: 5.14.0-503.el9.x86_64 2024-09-18T20:53:14.071 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum install -y kernel 2024-09-18T20:53:14.072 INFO:teuthology.orchestra.run.smithi103.stdout:5.14.0-503.el9.x86_64 2024-09-18T20:53:14.072 INFO:teuthology.task.kernel:Running kernel on smithi103: 5.14.0-503.el9.x86_64 2024-09-18T20:53:14.072 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum install -y kernel 2024-09-18T20:53:16.974 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - BaseOS 6.9 MB/s | 8.3 MB 00:01 2024-09-18T20:53:18.761 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - BaseOS 2.8 MB/s | 8.3 MB 00:02 2024-09-18T20:53:18.900 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-09-18T20:53:23.143 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-18T20:53:24.543 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - Extras packages 105 kB/s | 19 kB 00:00 2024-09-18T20:53:28.358 INFO:teuthology.orchestra.run.smithi103.stdout:Extra Packages for Enterprise Linux 6.1 MB/s | 23 MB 00:03 2024-09-18T20:53:33.762 INFO:teuthology.orchestra.run.smithi103.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-18T20:53:35.627 INFO:teuthology.orchestra.run.smithi103.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-18T20:53:35.627 INFO:teuthology.orchestra.run.smithi103.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-18T20:53:35.716 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-18T20:53:35.728 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-18T20:53:35.728 INFO:teuthology.orchestra.run.smithi103.stdout: Package Architecture Version Repository Size 2024-09-18T20:53:35.728 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-18T20:53:35.728 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-18T20:53:35.728 INFO:teuthology.orchestra.run.smithi103.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-18T20:53:35.728 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-09-18T20:53:35.728 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-18T20:53:35.728 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-18T20:53:35.728 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-18T20:53:35.729 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T20:53:35.729 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-18T20:53:35.729 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-18T20:53:35.729 INFO:teuthology.orchestra.run.smithi103.stdout:Install 4 Packages 2024-09-18T20:53:35.729 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T20:53:35.729 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 79 M 2024-09-18T20:53:35.730 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 126 M 2024-09-18T20:53:35.730 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-18T20:53:35.963 INFO:teuthology.orchestra.run.smithi103.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 338 kB/s | 36 kB 00:00 2024-09-18T20:53:36.358 INFO:teuthology.orchestra.run.smithi103.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-09-18T20:53:36.741 INFO:teuthology.orchestra.run.smithi103.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 37 MB/s | 29 MB 00:00 2024-09-18T20:53:37.058 INFO:teuthology.orchestra.run.smithi103.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 29 MB/s | 35 MB 00:01 2024-09-18T20:53:37.058 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-18T20:53:37.059 INFO:teuthology.orchestra.run.smithi103.stdout:Total 59 MB/s | 79 MB 00:01 2024-09-18T20:53:37.742 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-18T20:53:38.094 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-18T20:53:38.094 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-18T20:53:39.073 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-18T20:53:39.073 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-18T20:53:39.569 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - AppStream 1.0 MB/s | 20 MB 00:19 2024-09-18T20:53:41.546 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-18T20:53:42.194 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-18T20:53:42.284 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T20:53:43.870 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-18T20:53:45.064 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T20:53:45.194 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T20:53:45.562 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - Extras packages 38 kB/s | 19 kB 00:00 2024-09-18T20:53:50.031 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T20:53:50.080 INFO:teuthology.orchestra.run.smithi077.stdout:Extra Packages for Enterprise Linux 5.1 MB/s | 23 MB 00:04 2024-09-18T20:53:50.128 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-18T20:53:54.976 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T20:53:55.506 INFO:teuthology.orchestra.run.smithi077.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-18T20:53:57.404 INFO:teuthology.orchestra.run.smithi077.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-18T20:53:57.404 INFO:teuthology.orchestra.run.smithi077.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-18T20:53:57.498 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-18T20:53:57.508 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-18T20:53:57.508 INFO:teuthology.orchestra.run.smithi077.stdout: Package Architecture Version Repository Size 2024-09-18T20:53:57.508 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-18T20:53:57.508 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-09-18T20:53:57.508 INFO:teuthology.orchestra.run.smithi077.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-18T20:53:57.509 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-09-18T20:53:57.509 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-18T20:53:57.509 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-18T20:53:57.509 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-18T20:53:57.509 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T20:53:57.509 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-09-18T20:53:57.509 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-18T20:53:57.509 INFO:teuthology.orchestra.run.smithi077.stdout:Install 4 Packages 2024-09-18T20:53:57.509 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T20:53:57.509 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 79 M 2024-09-18T20:53:57.509 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 126 M 2024-09-18T20:53:57.509 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-09-18T20:53:57.908 INFO:teuthology.orchestra.run.smithi077.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 241 kB/s | 36 kB 00:00 2024-09-18T20:53:58.408 INFO:teuthology.orchestra.run.smithi077.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2024-09-18T20:53:59.174 INFO:teuthology.orchestra.run.smithi077.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 24 MB/s | 35 MB 00:01 2024-09-18T20:53:59.425 INFO:teuthology.orchestra.run.smithi077.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 19 MB/s | 29 MB 00:01 2024-09-18T20:53:59.425 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-09-18T20:53:59.425 INFO:teuthology.orchestra.run.smithi077.stdout:Total 41 MB/s | 79 MB 00:01 2024-09-18T20:54:00.107 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-09-18T20:54:00.473 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-09-18T20:54:00.473 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-09-18T20:54:01.430 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-09-18T20:54:01.430 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-09-18T20:54:03.872 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-09-18T20:54:04.568 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-18T20:54:04.643 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T20:54:07.421 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T20:54:07.548 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T20:54:12.409 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T20:54:12.523 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-18T20:54:17.361 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T20:54:33.361 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T20:54:33.405 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-18T20:54:33.820 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-18T20:54:33.820 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-18T20:54:33.820 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T20:54:33.820 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T20:54:34.634 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T20:54:34.634 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T20:54:34.634 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-18T20:54:34.634 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-18T20:54:34.634 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-18T20:54:34.634 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-18T20:54:34.634 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-18T20:54:34.635 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T20:54:34.635 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-18T20:54:34.993 DEBUG:teuthology.orchestra.run.smithi103:> rpm -q kernel | sort -rV | head -n 1 2024-09-18T20:54:35.076 INFO:teuthology.orchestra.run.smithi103.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-18T20:54:35.076 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-18T20:54:35.076 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-18T20:54:35.076 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-18T20:54:35.076 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-18T20:54:35.076 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-09-18T20:54:35.077 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi103.front.sepia.ceph.com, path=None, version=distro) 2024-09-18T20:54:35.077 DEBUG:teuthology.orchestra.run.smithi103:> rpm -q kernel | sort -rV | head -n 1 2024-09-18T20:54:35.135 INFO:teuthology.orchestra.run.smithi103.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-18T20:54:35.135 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-18T20:54:35.135 DEBUG:teuthology.orchestra.run.smithi103:> sudo rpm -qi grub2-tools 2024-09-18T20:54:35.167 INFO:teuthology.orchestra.run.smithi103.stdout:Name : grub2-tools 2024-09-18T20:54:35.167 INFO:teuthology.orchestra.run.smithi103.stdout:Epoch : 1 2024-09-18T20:54:35.168 INFO:teuthology.orchestra.run.smithi103.stdout:Version : 2.06 2024-09-18T20:54:35.168 INFO:teuthology.orchestra.run.smithi103.stdout:Release : 82.el9 2024-09-18T20:54:35.168 INFO:teuthology.orchestra.run.smithi103.stdout:Architecture: x86_64 2024-09-18T20:54:35.168 INFO:teuthology.orchestra.run.smithi103.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-18T20:54:35.168 INFO:teuthology.orchestra.run.smithi103.stdout:Group : Unspecified 2024-09-18T20:54:35.168 INFO:teuthology.orchestra.run.smithi103.stdout:Size : 8274670 2024-09-18T20:54:35.168 INFO:teuthology.orchestra.run.smithi103.stdout:License : GPLv3+ 2024-09-18T20:54:35.168 INFO:teuthology.orchestra.run.smithi103.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-18T20:54:35.168 INFO:teuthology.orchestra.run.smithi103.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-18T20:54:35.168 INFO:teuthology.orchestra.run.smithi103.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-18T20:54:35.168 INFO:teuthology.orchestra.run.smithi103.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-18T20:54:35.168 INFO:teuthology.orchestra.run.smithi103.stdout:Packager : builder@centos.org 2024-09-18T20:54:35.168 INFO:teuthology.orchestra.run.smithi103.stdout:Vendor : CentOS 2024-09-18T20:54:35.168 INFO:teuthology.orchestra.run.smithi103.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-18T20:54:35.169 INFO:teuthology.orchestra.run.smithi103.stdout:Summary : Support tools for GRUB. 2024-09-18T20:54:35.169 INFO:teuthology.orchestra.run.smithi103.stdout:Description : 2024-09-18T20:54:35.169 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T20:54:35.169 INFO:teuthology.orchestra.run.smithi103.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-18T20:54:35.169 INFO:teuthology.orchestra.run.smithi103.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-18T20:54:35.169 INFO:teuthology.orchestra.run.smithi103.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-18T20:54:35.169 INFO:teuthology.orchestra.run.smithi103.stdout:hardware devices. 2024-09-18T20:54:35.169 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T20:54:35.169 INFO:teuthology.orchestra.run.smithi103.stdout:This subpackage provides tools for support of all platforms. 2024-09-18T20:54:35.170 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-18T20:54:35.170 INFO:teuthology.task.kernel:Updating grub on smithi103 to boot 5.14.0-508.el9.x86_64 2024-09-18T20:54:35.170 DEBUG:teuthology.orchestra.run.smithi103:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-18T20:54:35.878 INFO:teuthology.orchestra.run.smithi103.stderr:Generating grub configuration file ... 2024-09-18T20:54:37.209 INFO:teuthology.orchestra.run.smithi103.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-18T20:54:37.236 INFO:teuthology.orchestra.run.smithi103.stderr:done 2024-09-18T20:54:37.238 DEBUG:teuthology.orchestra.run.smithi103:> mktemp 2024-09-18T20:54:37.254 INFO:teuthology.orchestra.run.smithi103.stdout:/tmp/tmp.V9w13NF8vA 2024-09-18T20:54:37.254 DEBUG:teuthology.orchestra.run.smithi103:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.V9w13NF8vA 2024-09-18T20:54:37.321 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0666 /tmp/tmp.V9w13NF8vA 2024-09-18T20:54:37.457 DEBUG:teuthology.orchestra.remote:smithi103:/tmp/tmp.V9w13NF8vA is 6KB 2024-09-18T20:54:37.505 DEBUG:teuthology.orchestra.run.smithi103:> rm -fr /tmp/tmp.V9w13NF8vA 2024-09-18T20:54:37.520 DEBUG:teuthology.orchestra.run.smithi103:> sudo /bin/ls /boot/loader/entries || true 2024-09-18T20:54:37.584 INFO:teuthology.orchestra.run.smithi103.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-18T20:54:37.584 INFO:teuthology.orchestra.run.smithi103.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-18T20:54:37.584 INFO:teuthology.orchestra.run.smithi103.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-18T20:54:37.584 INFO:teuthology.orchestra.run.smithi103.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-18T20:54:37.586 DEBUG:teuthology.orchestra.run.smithi103:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-18T20:54:37.738 DEBUG:teuthology.orchestra.run.smithi103:> sudo shutdown -r now 2024-09-18T20:54:55.676 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T20:54:55.715 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-18T20:54:56.090 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-18T20:54:56.090 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-18T20:54:56.090 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-18T20:54:56.090 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-18T20:54:56.918 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-18T20:54:56.919 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T20:54:56.919 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-09-18T20:54:56.919 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-18T20:54:56.919 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-18T20:54:56.919 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-18T20:54:56.919 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-18T20:54:56.919 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T20:54:56.919 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-18T20:54:57.242 DEBUG:teuthology.orchestra.run.smithi077:> rpm -q kernel | sort -rV | head -n 1 2024-09-18T20:54:57.318 INFO:teuthology.orchestra.run.smithi077.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-18T20:54:57.319 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-18T20:54:57.319 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-18T20:54:57.319 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-18T20:54:57.319 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-18T20:54:57.319 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-09-18T20:54:57.319 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi077.front.sepia.ceph.com, path=None, version=distro) 2024-09-18T20:54:57.319 DEBUG:teuthology.orchestra.run.smithi077:> rpm -q kernel | sort -rV | head -n 1 2024-09-18T20:54:57.378 INFO:teuthology.orchestra.run.smithi077.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-18T20:54:57.378 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-18T20:54:57.378 DEBUG:teuthology.orchestra.run.smithi077:> sudo rpm -qi grub2-tools 2024-09-18T20:54:57.412 INFO:teuthology.orchestra.run.smithi077.stdout:Name : grub2-tools 2024-09-18T20:54:57.412 INFO:teuthology.orchestra.run.smithi077.stdout:Epoch : 1 2024-09-18T20:54:57.412 INFO:teuthology.orchestra.run.smithi077.stdout:Version : 2.06 2024-09-18T20:54:57.412 INFO:teuthology.orchestra.run.smithi077.stdout:Release : 82.el9 2024-09-18T20:54:57.412 INFO:teuthology.orchestra.run.smithi077.stdout:Architecture: x86_64 2024-09-18T20:54:57.412 INFO:teuthology.orchestra.run.smithi077.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-18T20:54:57.412 INFO:teuthology.orchestra.run.smithi077.stdout:Group : Unspecified 2024-09-18T20:54:57.412 INFO:teuthology.orchestra.run.smithi077.stdout:Size : 8274670 2024-09-18T20:54:57.412 INFO:teuthology.orchestra.run.smithi077.stdout:License : GPLv3+ 2024-09-18T20:54:57.413 INFO:teuthology.orchestra.run.smithi077.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-18T20:54:57.413 INFO:teuthology.orchestra.run.smithi077.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-18T20:54:57.413 INFO:teuthology.orchestra.run.smithi077.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-18T20:54:57.413 INFO:teuthology.orchestra.run.smithi077.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-18T20:54:57.413 INFO:teuthology.orchestra.run.smithi077.stdout:Packager : builder@centos.org 2024-09-18T20:54:57.413 INFO:teuthology.orchestra.run.smithi077.stdout:Vendor : CentOS 2024-09-18T20:54:57.413 INFO:teuthology.orchestra.run.smithi077.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-18T20:54:57.413 INFO:teuthology.orchestra.run.smithi077.stdout:Summary : Support tools for GRUB. 2024-09-18T20:54:57.413 INFO:teuthology.orchestra.run.smithi077.stdout:Description : 2024-09-18T20:54:57.413 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T20:54:57.413 INFO:teuthology.orchestra.run.smithi077.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-18T20:54:57.413 INFO:teuthology.orchestra.run.smithi077.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-18T20:54:57.413 INFO:teuthology.orchestra.run.smithi077.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-18T20:54:57.413 INFO:teuthology.orchestra.run.smithi077.stdout:hardware devices. 2024-09-18T20:54:57.414 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T20:54:57.414 INFO:teuthology.orchestra.run.smithi077.stdout:This subpackage provides tools for support of all platforms. 2024-09-18T20:54:57.414 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-18T20:54:57.414 INFO:teuthology.task.kernel:Updating grub on smithi077 to boot 5.14.0-508.el9.x86_64 2024-09-18T20:54:57.415 DEBUG:teuthology.orchestra.run.smithi077:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-18T20:54:58.027 INFO:teuthology.orchestra.run.smithi077.stderr:Generating grub configuration file ... 2024-09-18T20:54:59.355 INFO:teuthology.orchestra.run.smithi077.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-18T20:54:59.398 INFO:teuthology.orchestra.run.smithi077.stderr:done 2024-09-18T20:54:59.400 DEBUG:teuthology.orchestra.run.smithi077:> mktemp 2024-09-18T20:54:59.416 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/tmp.aAav0f9Xyk 2024-09-18T20:54:59.416 DEBUG:teuthology.orchestra.run.smithi077:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.aAav0f9Xyk 2024-09-18T20:54:59.493 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0666 /tmp/tmp.aAav0f9Xyk 2024-09-18T20:54:59.636 DEBUG:teuthology.orchestra.remote:smithi077:/tmp/tmp.aAav0f9Xyk is 6KB 2024-09-18T20:54:59.656 DEBUG:teuthology.orchestra.run.smithi077:> rm -fr /tmp/tmp.aAav0f9Xyk 2024-09-18T20:54:59.670 DEBUG:teuthology.orchestra.run.smithi077:> sudo /bin/ls /boot/loader/entries || true 2024-09-18T20:54:59.732 INFO:teuthology.orchestra.run.smithi077.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-18T20:54:59.732 INFO:teuthology.orchestra.run.smithi077.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-18T20:54:59.732 INFO:teuthology.orchestra.run.smithi077.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-18T20:54:59.732 INFO:teuthology.orchestra.run.smithi077.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-18T20:54:59.733 DEBUG:teuthology.orchestra.run.smithi077:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-18T20:54:59.881 DEBUG:teuthology.orchestra.run.smithi077:> sudo shutdown -r now 2024-09-18T20:55:07.747 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-09-18T20:55:07.747 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-18T20:55:07.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T20:55:26.269 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-09-18T20:55:29.888 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-09-18T20:55:29.889 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-09-18T20:55:29.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T20:55:35.274 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-18T20:55:35.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T20:55:38.333 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-09-18T20:55:50.344 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-18T20:55:50.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T20:55:53.405 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-09-18T20:56:08.413 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-18T20:56:08.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T20:56:29.913 DEBUG:teuthology.orchestra.remote:timed out 2024-09-18T20:56:38.921 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-09-18T20:56:38.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T20:56:39.477 DEBUG:teuthology.orchestra.run.smithi077:> true 2024-09-18T20:56:39.826 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-09-18T20:56:39.826 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-508.el9.x86_64"... 2024-09-18T20:56:39.826 DEBUG:teuthology.orchestra.run.smithi077:> uname -r 2024-09-18T20:56:39.841 INFO:teuthology.orchestra.run.smithi077.stdout:5.14.0-508.el9.x86_64 2024-09-18T20:56:39.841 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-18T20:56:39.841 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-18T20:56:39.841 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-18T20:56:40.246 DEBUG:teuthology.orchestra.run.smithi103:> true 2024-09-18T20:56:40.570 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-18T20:56:40.570 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-508.el9.x86_64"... 2024-09-18T20:56:40.570 DEBUG:teuthology.orchestra.run.smithi103:> uname -r 2024-09-18T20:56:40.585 INFO:teuthology.orchestra.run.smithi103.stdout:5.14.0-508.el9.x86_64 2024-09-18T20:56:40.585 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-18T20:56:40.585 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-18T20:56:40.585 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-18T20:56:40.844 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-09-18T20:56:40.844 DEBUG:teuthology.orchestra.run.smithi077:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-18T20:56:40.930 INFO:teuthology.orchestra.run.smithi077.stdout:ttyS1 2024-09-18T20:56:40.956 DEBUG:teuthology.parallel:result is None 2024-09-18T20:56:41.586 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-09-18T20:56:41.586 DEBUG:teuthology.orchestra.run.smithi103:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-18T20:56:41.664 INFO:teuthology.orchestra.run.smithi103.stdout:ttyS1 2024-09-18T20:56:41.688 DEBUG:teuthology.parallel:result is None 2024-09-18T20:56:41.688 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-18T20:56:41.695 INFO:teuthology.task.internal:Creating test directory... 2024-09-18T20:56:41.695 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-18T20:56:41.698 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-18T20:56:41.716 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-18T20:56:41.723 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-18T20:56:41.731 INFO:teuthology.task.internal:Creating archive directory... 2024-09-18T20:56:41.732 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-18T20:56:41.754 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-18T20:56:41.791 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-18T20:56:41.797 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-18T20:56:41.798 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-18T20:56:41.810 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-18T20:56:41.841 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T20:56:41.851 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T20:56:41.857 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T20:56:41.869 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-18T20:56:41.870 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-18T20:56:41.877 INFO:teuthology.task.internal:Configuring sudo... 2024-09-18T20:56:41.877 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-18T20:56:41.894 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-18T20:56:41.937 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-18T20:56:41.946 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-18T20:56:41.947 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-18T20:56:41.959 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-18T20:56:41.993 DEBUG:teuthology.orchestra.run.smithi077:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-18T20:56:42.052 DEBUG:teuthology.orchestra.run.smithi077:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-18T20:56:42.099 DEBUG:teuthology.orchestra.run.smithi077:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-18T20:56:42.177 DEBUG:teuthology.orchestra.run.smithi077:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-18T20:56:42.219 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-18T20:56:42.219 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-18T20:56:42.284 DEBUG:teuthology.orchestra.run.smithi103:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-18T20:56:42.322 DEBUG:teuthology.orchestra.run.smithi103:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-18T20:56:42.376 DEBUG:teuthology.orchestra.run.smithi103:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-18T20:56:42.455 DEBUG:teuthology.orchestra.run.smithi103:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-18T20:56:42.504 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-18T20:56:42.504 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-18T20:56:42.572 DEBUG:teuthology.orchestra.run.smithi077:> sudo service rsyslog restart 2024-09-18T20:56:42.592 DEBUG:teuthology.orchestra.run.smithi103:> sudo service rsyslog restart 2024-09-18T20:56:42.628 INFO:teuthology.orchestra.run.smithi077.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-18T20:56:42.666 INFO:teuthology.orchestra.run.smithi103.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-18T20:56:43.174 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-18T20:56:43.182 INFO:teuthology.task.internal:Starting timer... 2024-09-18T20:56:43.182 INFO:teuthology.run_tasks:Running task pcp... 2024-09-18T20:56:43.192 INFO:teuthology.run_tasks:Running task selinux... 2024-09-18T20:56:43.199 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-18T20:56:43.200 DEBUG:teuthology.orchestra.run.smithi077:> sudo service auditd rotate 2024-09-18T20:56:43.290 INFO:teuthology.orchestra.run.smithi077.stdout:Rotating logs: 2024-09-18T20:56:43.292 DEBUG:teuthology.orchestra.run.smithi103:> sudo service auditd rotate 2024-09-18T20:56:43.378 INFO:teuthology.orchestra.run.smithi103.stdout:Rotating logs: 2024-09-18T20:56:43.380 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-18T20:56:43.380 DEBUG:teuthology.orchestra.run.smithi077:> /usr/sbin/getenforce 2024-09-18T20:56:43.400 INFO:teuthology.orchestra.run.smithi077.stdout:Permissive 2024-09-18T20:56:43.401 DEBUG:teuthology.orchestra.run.smithi103:> /usr/sbin/getenforce 2024-09-18T20:56:43.441 INFO:teuthology.orchestra.run.smithi103.stdout:Permissive 2024-09-18T20:56:43.441 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi077.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi103.front.sepia.ceph.com': 'permissive'} 2024-09-18T20:56:43.442 DEBUG:teuthology.orchestra.run.smithi077:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-18T20:56:43.465 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T20:56:43.466 DEBUG:teuthology.orchestra.run.smithi103:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-18T20:56:43.509 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T20:56:43.509 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-18T20:56:43.510 DEBUG:teuthology.orchestra.run.smithi077:> sudo /usr/sbin/setenforce permissive 2024-09-18T20:56:43.556 DEBUG:teuthology.orchestra.run.smithi103:> sudo /usr/sbin/setenforce permissive 2024-09-18T20:56:43.591 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-18T20:56:43.601 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-18T20:56:43.604 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-18T20:56:43.729 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-18T20:56:43.739 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-18T20:56:43.740 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi077.front.sepia.ceph.com,smithi103.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-18T21:00:34.652 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi077.front.sepia.ceph.com'), Remote(name='ubuntu@smithi103.front.sepia.ceph.com')] 2024-09-18T21:00:34.653 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-09-18T21:00:34.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T21:00:34.734 DEBUG:teuthology.orchestra.run.smithi077:> true 2024-09-18T21:00:34.811 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-09-18T21:00:34.812 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-18T21:00:34.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-18T21:00:34.888 DEBUG:teuthology.orchestra.run.smithi103:> true 2024-09-18T21:00:34.924 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-18T21:00:34.924 INFO:teuthology.run_tasks:Running task clock... 2024-09-18T21:00:34.935 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-18T21:00:34.935 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-18T21:00:34.936 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T21:00:34.938 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-18T21:00:34.938 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T21:00:34.964 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-18T21:00:34.978 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-18T21:00:34.996 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-18T21:00:35.003 INFO:teuthology.orchestra.run.smithi077.stderr:sudo: ntpd: command not found 2024-09-18T21:00:35.011 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-18T21:00:35.013 INFO:teuthology.orchestra.run.smithi077.stdout:506 Cannot talk to daemon 2024-09-18T21:00:35.027 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-18T21:00:35.036 INFO:teuthology.orchestra.run.smithi103.stderr:sudo: ntpd: command not found 2024-09-18T21:00:35.041 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-18T21:00:35.047 INFO:teuthology.orchestra.run.smithi103.stdout:506 Cannot talk to daemon 2024-09-18T21:00:35.061 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-18T21:00:35.076 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-18T21:00:35.101 INFO:teuthology.orchestra.run.smithi077.stderr:bash: line 1: ntpq: command not found 2024-09-18T21:00:35.104 INFO:teuthology.orchestra.run.smithi077.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-18T21:00:35.105 INFO:teuthology.orchestra.run.smithi077.stdout:=============================================================================== 2024-09-18T21:00:35.105 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T21:00:35.105 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T21:00:35.105 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T21:00:35.105 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T21:00:35.138 INFO:teuthology.orchestra.run.smithi103.stderr:bash: line 1: ntpq: command not found 2024-09-18T21:00:35.141 INFO:teuthology.orchestra.run.smithi103.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-18T21:00:35.141 INFO:teuthology.orchestra.run.smithi103.stdout:=============================================================================== 2024-09-18T21:00:35.141 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T21:00:35.141 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T21:00:35.142 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T21:00:35.142 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T21:00:35.142 INFO:teuthology.run_tasks:Running task install... 2024-09-18T21:00:35.150 DEBUG:teuthology.task.install:project ceph 2024-09-18T21:00:35.151 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '06b1b1de896d25f0645e4a306558ab0b4d4fc56f'}} 2024-09-18T21:00:35.151 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': '06b1b1de896d25f0645e4a306558ab0b4d4fc56f'} 2024-09-18T21:00:35.151 INFO:teuthology.task.install:Using flavor: default 2024-09-18T21:00:35.156 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-18T21:00:35.156 INFO:teuthology.task.install:extra packages: [] 2024-09-18T21:00:35.157 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '06b1b1de896d25f0645e4a306558ab0b4d4fc56f', 'tag': None, 'wait_for_package': False} 2024-09-18T21:00:35.157 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-18T21:00:35.157 INFO:teuthology.packaging:ref: None 2024-09-18T21:00:35.157 INFO:teuthology.packaging:tag: None 2024-09-18T21:00:35.157 INFO:teuthology.packaging:branch: quincy 2024-09-18T21:00:35.157 INFO:teuthology.packaging:sha1: 06b1b1de896d25f0645e4a306558ab0b4d4fc56f 2024-09-18T21:00:35.158 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-18T21:00:35.159 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '06b1b1de896d25f0645e4a306558ab0b4d4fc56f', 'tag': None, 'wait_for_package': False} 2024-09-18T21:00:35.160 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-18T21:00:35.160 INFO:teuthology.packaging:ref: None 2024-09-18T21:00:35.160 INFO:teuthology.packaging:tag: None 2024-09-18T21:00:35.160 INFO:teuthology.packaging:branch: quincy 2024-09-18T21:00:35.160 INFO:teuthology.packaging:sha1: 06b1b1de896d25f0645e4a306558ab0b4d4fc56f 2024-09-18T21:00:35.160 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-18T21:00:35.365 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/quincy/6e06d1e002b6603c076b9260a58131a040dabe75/centos/9/flavors/default/ 2024-09-18T21:00:35.365 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1637.g6e06d1e0 2024-09-18T21:00:35.400 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/quincy/6e06d1e002b6603c076b9260a58131a040dabe75/centos/9/flavors/default/ 2024-09-18T21:00:35.400 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1637.g6e06d1e0 2024-09-18T21:00:35.477 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/quincy/6e06d1e002b6603c076b9260a58131a040dabe75/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/6e06d1e002b6603c076b9260a58131a040dabe75/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/6e06d1e002b6603c076b9260a58131a040dabe75/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-18T21:00:35.477 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-18T21:00:35.478 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-18T21:00:35.504 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-18T21:00:35.505 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-18T21:00:35.505 INFO:teuthology.packaging:ref: None 2024-09-18T21:00:35.505 INFO:teuthology.packaging:tag: None 2024-09-18T21:00:35.505 INFO:teuthology.packaging:branch: quincy 2024-09-18T21:00:35.505 INFO:teuthology.packaging:sha1: 06b1b1de896d25f0645e4a306558ab0b4d4fc56f 2024-09-18T21:00:35.505 DEBUG:teuthology.orchestra.run.smithi077:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-18T21:00:35.507 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/quincy/6e06d1e002b6603c076b9260a58131a040dabe75/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/6e06d1e002b6603c076b9260a58131a040dabe75/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/6e06d1e002b6603c076b9260a58131a040dabe75/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-18T21:00:35.507 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-18T21:00:35.507 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-18T21:00:35.533 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-18T21:00:35.533 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-18T21:00:35.533 INFO:teuthology.packaging:ref: None 2024-09-18T21:00:35.533 INFO:teuthology.packaging:tag: None 2024-09-18T21:00:35.533 INFO:teuthology.packaging:branch: quincy 2024-09-18T21:00:35.533 INFO:teuthology.packaging:sha1: 06b1b1de896d25f0645e4a306558ab0b4d4fc56f 2024-09-18T21:00:35.533 DEBUG:teuthology.orchestra.run.smithi103:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-18T21:00:35.570 DEBUG:teuthology.orchestra.run.smithi077:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-18T21:00:35.599 DEBUG:teuthology.orchestra.run.smithi103:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-18T21:00:35.645 DEBUG:teuthology.orchestra.run.smithi077:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-18T21:00:35.674 DEBUG:teuthology.orchestra.run.smithi103:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-18T21:00:35.710 INFO:teuthology.orchestra.run.smithi077.stdout:check_obsoletes = 1 2024-09-18T21:00:35.711 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum clean all 2024-09-18T21:00:35.738 INFO:teuthology.orchestra.run.smithi103.stdout:check_obsoletes = 1 2024-09-18T21:00:35.739 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum clean all 2024-09-18T21:00:35.941 INFO:teuthology.orchestra.run.smithi077.stdout:45 files removed 2024-09-18T21:00:35.966 INFO:teuthology.orchestra.run.smithi103.stdout:45 files removed 2024-09-18T21:00:35.968 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-radosgw 2024-09-18T21:00:35.993 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-radosgw 2024-09-18T21:00:36.508 INFO:teuthology.orchestra.run.smithi077.stdout:ceph packages for x86_64 298 kB/s | 77 kB 00:00 2024-09-18T21:00:36.546 INFO:teuthology.orchestra.run.smithi103.stdout:ceph packages for x86_64 286 kB/s | 77 kB 00:00 2024-09-18T21:00:36.784 INFO:teuthology.orchestra.run.smithi077.stdout:ceph noarch packages 46 kB/s | 11 kB 00:00 2024-09-18T21:00:36.839 INFO:teuthology.orchestra.run.smithi103.stdout:ceph noarch packages 43 kB/s | 11 kB 00:00 2024-09-18T21:00:37.051 INFO:teuthology.orchestra.run.smithi077.stdout:ceph source packages 7.7 kB/s | 1.8 kB 00:00 2024-09-18T21:00:37.106 INFO:teuthology.orchestra.run.smithi103.stdout:ceph source packages 7.7 kB/s | 1.8 kB 00:00 2024-09-18T21:00:40.190 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - BaseOS 2.7 MB/s | 8.3 MB 00:03 2024-09-18T21:00:41.916 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-18T21:00:42.493 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - BaseOS 1.5 MB/s | 8.3 MB 00:05 2024-09-18T21:00:47.367 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.5 MB 00:01 2024-09-18T21:00:47.461 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - AppStream 5.2 MB/s | 20 MB 00:03 2024-09-18T21:00:49.034 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - Extras packages 47 kB/s | 19 kB 00:00 2024-09-18T21:00:50.347 INFO:teuthology.orchestra.run.smithi103.stdout:Extra Packages for Enterprise Linux 19 MB/s | 23 MB 00:01 2024-09-18T21:00:51.653 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.5 MB 00:00 2024-09-18T21:00:53.129 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - Extras packages 79 kB/s | 19 kB 00:00 2024-09-18T21:00:55.341 INFO:teuthology.orchestra.run.smithi077.stdout:Extra Packages for Enterprise Linux 11 MB/s | 23 MB 00:02 2024-09-18T21:00:55.662 INFO:teuthology.orchestra.run.smithi103.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-18T21:00:57.845 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-18T21:00:57.871 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-18T21:00:57.871 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-09-18T21:00:57.871 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-18T21:00:57.871 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-18T21:00:57.871 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-radosgw x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 14 M 2024-09-18T21:00:57.872 INFO:teuthology.orchestra.run.smithi103.stdout:Upgrading: 2024-09-18T21:00:57.872 INFO:teuthology.orchestra.run.smithi103.stdout: librados2 x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 3.1 M 2024-09-18T21:00:57.872 INFO:teuthology.orchestra.run.smithi103.stdout: librbd1 x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 2.9 M 2024-09-18T21:00:57.872 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-09-18T21:00:57.872 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-base x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 5.0 M 2024-09-18T21:00:57.872 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-common x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 22 M 2024-09-18T21:00:57.872 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-selinux x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 25 k 2024-09-18T21:00:57.872 INFO:teuthology.orchestra.run.smithi103.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-18T21:00:57.872 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs2 x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 636 k 2024-09-18T21:00:57.873 INFO:teuthology.orchestra.run.smithi103.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-18T21:00:57.873 INFO:teuthology.orchestra.run.smithi103.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-18T21:00:57.873 INFO:teuthology.orchestra.run.smithi103.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-18T21:00:57.873 INFO:teuthology.orchestra.run.smithi103.stdout: libradosstriper1 x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 457 k 2024-09-18T21:00:57.873 INFO:teuthology.orchestra.run.smithi103.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-18T21:00:57.873 INFO:teuthology.orchestra.run.smithi103.stdout: librgw2 x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 4.9 M 2024-09-18T21:00:57.874 INFO:teuthology.orchestra.run.smithi103.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-18T21:00:57.874 INFO:teuthology.orchestra.run.smithi103.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-18T21:00:57.874 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-argparse x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 45 k 2024-09-18T21:00:57.874 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-common x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 120 k 2024-09-18T21:00:57.874 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cephfs x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 156 k 2024-09-18T21:00:57.875 INFO:teuthology.orchestra.run.smithi103.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-18T21:00:57.875 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rados x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 320 k 2024-09-18T21:00:57.875 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rbd x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 295 k 2024-09-18T21:00:57.875 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rgw x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 99 k 2024-09-18T21:00:57.875 INFO:teuthology.orchestra.run.smithi103.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-18T21:00:57.875 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:00:57.876 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-18T21:00:57.876 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-18T21:00:57.876 INFO:teuthology.orchestra.run.smithi103.stdout:Install 22 Packages 2024-09-18T21:00:57.876 INFO:teuthology.orchestra.run.smithi103.stdout:Upgrade 2 Packages 2024-09-18T21:00:57.876 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:00:57.877 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 58 M 2024-09-18T21:00:57.878 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-18T21:00:58.689 INFO:teuthology.orchestra.run.smithi103.stdout:(1/24): ceph-base-17.2.7-1637.g6e06d1e0.el9.x86 12 MB/s | 5.0 MB 00:00 2024-09-18T21:00:58.755 INFO:teuthology.orchestra.run.smithi103.stdout:(2/24): ceph-selinux-17.2.7-1637.g6e06d1e0.el9. 378 kB/s | 25 kB 00:00 2024-09-18T21:00:58.839 INFO:teuthology.orchestra.run.smithi103.stdout:(3/24): libcephfs2-17.2.7-1637.g6e06d1e0.el9.x8 7.5 MB/s | 636 kB 00:00 2024-09-18T21:00:58.914 INFO:teuthology.orchestra.run.smithi103.stdout:(4/24): libradosstriper1-17.2.7-1637.g6e06d1e0. 6.0 MB/s | 457 kB 00:00 2024-09-18T21:00:59.198 INFO:teuthology.orchestra.run.smithi103.stdout:(5/24): librgw2-17.2.7-1637.g6e06d1e0.el9.x86_6 17 MB/s | 4.9 MB 00:00 2024-09-18T21:00:59.265 INFO:teuthology.orchestra.run.smithi103.stdout:(6/24): python3-ceph-argparse-17.2.7-1637.g6e06 677 kB/s | 45 kB 00:00 2024-09-18T21:00:59.415 INFO:teuthology.orchestra.run.smithi103.stdout:(7/24): ceph-radosgw-17.2.7-1637.g6e06d1e0.el9. 13 MB/s | 14 MB 00:01 2024-09-18T21:00:59.440 INFO:teuthology.orchestra.run.smithi103.stdout:(8/24): python3-ceph-common-17.2.7-1637.g6e06d1 686 kB/s | 120 kB 00:00 2024-09-18T21:00:59.466 INFO:teuthology.orchestra.run.smithi103.stdout:(9/24): python3-cephfs-17.2.7-1637.g6e06d1e0.el 3.0 MB/s | 156 kB 00:00 2024-09-18T21:00:59.491 INFO:teuthology.orchestra.run.smithi103.stdout:(10/24): python3-rados-17.2.7-1637.g6e06d1e0.el 6.2 MB/s | 320 kB 00:00 2024-09-18T21:00:59.516 INFO:teuthology.orchestra.run.smithi103.stdout:(11/24): python3-rbd-17.2.7-1637.g6e06d1e0.el9. 5.7 MB/s | 295 kB 00:00 2024-09-18T21:00:59.542 INFO:teuthology.orchestra.run.smithi103.stdout:(12/24): python3-rgw-17.2.7-1637.g6e06d1e0.el9. 1.9 MB/s | 99 kB 00:00 2024-09-18T21:00:59.825 INFO:teuthology.orchestra.run.smithi103.stdout:(13/24): ceph-common-17.2.7-1637.g6e06d1e0.el9. 14 MB/s | 22 MB 00:01 2024-09-18T21:01:00.125 INFO:teuthology.orchestra.run.smithi103.stdout:(14/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 77 kB/s | 45 kB 00:00 2024-09-18T21:01:00.284 INFO:teuthology.orchestra.run.smithi103.stdout:(15/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 209 kB/s | 160 kB 00:00 2024-09-18T21:01:00.401 INFO:teuthology.orchestra.run.smithi103.stdout:(16/24): python3-prettytable-0.7.2-27.el9.noarc 362 kB/s | 42 kB 00:00 2024-09-18T21:01:00.451 INFO:teuthology.orchestra.run.smithi103.stdout:(17/24): gperftools-libs-2.9.1-3.el9.x86_64.rpm 6.0 MB/s | 308 kB 00:00 2024-09-18T21:01:00.477 INFO:teuthology.orchestra.run.smithi103.stdout:(18/24): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-18T21:01:00.502 INFO:teuthology.orchestra.run.smithi103.stdout:(19/24): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-18T21:01:00.527 INFO:teuthology.orchestra.run.smithi103.stdout:(20/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 728 kB/s | 292 kB 00:00 2024-09-18T21:01:00.602 INFO:teuthology.orchestra.run.smithi103.stdout:(21/24): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-18T21:01:00.719 INFO:teuthology.orchestra.run.smithi103.stdout:(22/24): librdkafka-1.6.1-102.el9.x86_64.rpm 741 kB/s | 662 kB 00:00 2024-09-18T21:01:00.780 INFO:teuthology.orchestra.run.smithi077.stdout:lab-extras 48 kB/s | 1.7 kB 00:00 2024-09-18T21:01:00.786 INFO:teuthology.orchestra.run.smithi103.stdout:(23/24): librados2-17.2.7-1637.g6e06d1e0.el9.x8 12 MB/s | 3.1 MB 00:00 2024-09-18T21:01:00.903 INFO:teuthology.orchestra.run.smithi103.stdout:(24/24): librbd1-17.2.7-1637.g6e06d1e0.el9.x86_ 9.8 MB/s | 2.9 MB 00:00 2024-09-18T21:01:00.907 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-18T21:01:00.907 INFO:teuthology.orchestra.run.smithi103.stdout:Total 19 MB/s | 58 MB 00:03 2024-09-18T21:01:00.971 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-18T21:01:01.004 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-18T21:01:01.004 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-18T21:01:01.674 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-18T21:01:01.674 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-18T21:01:02.957 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-18T21:01:03.047 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-18T21:01:03.063 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-18T21:01:03.063 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2024-09-18T21:01:03.063 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-18T21:01:03.064 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-09-18T21:01:03.064 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-radosgw x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 14 M 2024-09-18T21:01:03.064 INFO:teuthology.orchestra.run.smithi077.stdout:Upgrading: 2024-09-18T21:01:03.064 INFO:teuthology.orchestra.run.smithi077.stdout: librados2 x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 3.1 M 2024-09-18T21:01:03.064 INFO:teuthology.orchestra.run.smithi077.stdout: librbd1 x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 2.9 M 2024-09-18T21:01:03.064 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-09-18T21:01:03.064 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-base x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 5.0 M 2024-09-18T21:01:03.064 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-common x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 22 M 2024-09-18T21:01:03.064 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-selinux x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 25 k 2024-09-18T21:01:03.064 INFO:teuthology.orchestra.run.smithi077.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-18T21:01:03.064 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs2 x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 636 k 2024-09-18T21:01:03.065 INFO:teuthology.orchestra.run.smithi077.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-18T21:01:03.065 INFO:teuthology.orchestra.run.smithi077.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-18T21:01:03.065 INFO:teuthology.orchestra.run.smithi077.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-18T21:01:03.065 INFO:teuthology.orchestra.run.smithi077.stdout: libradosstriper1 x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 457 k 2024-09-18T21:01:03.065 INFO:teuthology.orchestra.run.smithi077.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-18T21:01:03.065 INFO:teuthology.orchestra.run.smithi077.stdout: librgw2 x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 4.9 M 2024-09-18T21:01:03.065 INFO:teuthology.orchestra.run.smithi077.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-18T21:01:03.065 INFO:teuthology.orchestra.run.smithi077.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-18T21:01:03.065 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-argparse x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 45 k 2024-09-18T21:01:03.065 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-common x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 120 k 2024-09-18T21:01:03.065 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cephfs x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 156 k 2024-09-18T21:01:03.065 INFO:teuthology.orchestra.run.smithi077.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-18T21:01:03.065 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rados x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 320 k 2024-09-18T21:01:03.066 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rbd x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 295 k 2024-09-18T21:01:03.066 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rgw x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 99 k 2024-09-18T21:01:03.066 INFO:teuthology.orchestra.run.smithi077.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-18T21:01:03.066 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:01:03.066 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-09-18T21:01:03.066 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-18T21:01:03.066 INFO:teuthology.orchestra.run.smithi077.stdout:Install 22 Packages 2024-09-18T21:01:03.066 INFO:teuthology.orchestra.run.smithi077.stdout:Upgrade 2 Packages 2024-09-18T21:01:03.066 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:01:03.067 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 58 M 2024-09-18T21:01:03.067 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-09-18T21:01:03.332 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-09-18T21:01:03.389 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : librados2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2/26 2024-09-18T21:01:03.482 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librados2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2/26 2024-09-18T21:01:03.559 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rados-2:17.2.7-1637.g6e06d1e0.el9.x86_64 3/26 2024-09-18T21:01:03.582 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephfs2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 4/26 2024-09-18T21:01:03.671 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libcephfs2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 4/26 2024-09-18T21:01:03.716 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-09-18T21:01:03.746 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-09-18T21:01:03.940 INFO:teuthology.orchestra.run.smithi077.stdout:(1/24): ceph-base-17.2.7-1637.g6e06d1e0.el9.x86 11 MB/s | 5.0 MB 00:00 2024-09-18T21:01:03.999 INFO:teuthology.orchestra.run.smithi077.stdout:(2/24): ceph-selinux-17.2.7-1637.g6e06d1e0.el9. 432 kB/s | 25 kB 00:00 2024-09-18T21:01:04.082 INFO:teuthology.orchestra.run.smithi077.stdout:(3/24): libcephfs2-17.2.7-1637.g6e06d1e0.el9.x8 7.5 MB/s | 636 kB 00:00 2024-09-18T21:01:04.166 INFO:teuthology.orchestra.run.smithi077.stdout:(4/24): libradosstriper1-17.2.7-1637.g6e06d1e0. 5.4 MB/s | 457 kB 00:00 2024-09-18T21:01:04.181 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-09-18T21:01:04.210 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librgw2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 8/26 2024-09-18T21:01:04.257 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librgw2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 8/26 2024-09-18T21:01:04.293 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-09-18T21:01:04.328 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ceph-argparse-2:17.2.7-1637.g6e06d1e0.el9. 10/26 2024-09-18T21:01:04.365 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cephfs-2:17.2.7-1637.g6e06d1e0.el9.x86_64 11/26 2024-09-18T21:01:04.427 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rgw-2:17.2.7-1637.g6e06d1e0.el9.x86_64 12/26 2024-09-18T21:01:04.455 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libradosstriper1-2:17.2.7-1637.g6e06d1e0.el9.x86_6 13/26 2024-09-18T21:01:04.516 INFO:teuthology.orchestra.run.smithi077.stdout:(5/24): ceph-radosgw-17.2.7-1637.g6e06d1e0.el9. 14 MB/s | 14 MB 00:01 2024-09-18T21:01:04.521 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1637.g6e06d1e0.el9.x86_6 13/26 2024-09-18T21:01:04.575 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-09-18T21:01:04.595 INFO:teuthology.orchestra.run.smithi077.stdout:(6/24): librgw2-17.2.7-1637.g6e06d1e0.el9.x86_6 12 MB/s | 4.9 MB 00:00 2024-09-18T21:01:04.606 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/26 2024-09-18T21:01:04.619 INFO:teuthology.orchestra.run.smithi077.stdout:(7/24): python3-ceph-argparse-17.2.7-1637.g6e06 441 kB/s | 45 kB 00:00 2024-09-18T21:01:04.639 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-09-18T21:01:04.645 INFO:teuthology.orchestra.run.smithi077.stdout:(8/24): python3-ceph-common-17.2.7-1637.g6e06d1 2.3 MB/s | 120 kB 00:00 2024-09-18T21:01:04.670 INFO:teuthology.orchestra.run.smithi077.stdout:(9/24): python3-cephfs-17.2.7-1637.g6e06d1e0.el 3.0 MB/s | 156 kB 00:00 2024-09-18T21:01:04.703 INFO:teuthology.orchestra.run.smithi077.stdout:(10/24): python3-rados-17.2.7-1637.g6e06d1e0.el 5.4 MB/s | 320 kB 00:00 2024-09-18T21:01:04.729 INFO:teuthology.orchestra.run.smithi077.stdout:(11/24): python3-rbd-17.2.7-1637.g6e06d1e0.el9. 4.9 MB/s | 295 kB 00:00 2024-09-18T21:01:04.754 INFO:teuthology.orchestra.run.smithi077.stdout:(12/24): python3-rgw-17.2.7-1637.g6e06d1e0.el9. 1.9 MB/s | 99 kB 00:00 2024-09-18T21:01:04.941 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-09-18T21:01:04.984 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : librbd1-2:17.2.7-1637.g6e06d1e0.el9.x86_64 18/26 2024-09-18T21:01:04.988 INFO:teuthology.orchestra.run.smithi077.stdout:(13/24): ceph-common-17.2.7-1637.g6e06d1e0.el9. 15 MB/s | 22 MB 00:01 2024-09-18T21:01:05.063 INFO:teuthology.orchestra.run.smithi077.stdout:(14/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 146 kB/s | 45 kB 00:00 2024-09-18T21:01:05.073 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librbd1-2:17.2.7-1637.g6e06d1e0.el9.x86_64 18/26 2024-09-18T21:01:05.121 INFO:teuthology.orchestra.run.smithi077.stdout:(15/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 408 kB/s | 160 kB 00:00 2024-09-18T21:01:05.148 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rbd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 19/26 2024-09-18T21:01:05.172 INFO:teuthology.orchestra.run.smithi077.stdout:(16/24): python3-prettytable-0.7.2-27.el9.noarc 846 kB/s | 42 kB 00:00 2024-09-18T21:01:05.178 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ceph-common-2:17.2.7-1637.g6e06d1e0.el9.x8 20/26 2024-09-18T21:01:05.197 INFO:teuthology.orchestra.run.smithi077.stdout:(17/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-09-18T21:01:05.247 INFO:teuthology.orchestra.run.smithi077.stdout:(18/24): liboath-2.6.7-2.el9.x86_64.rpm 1.1 MB/s | 49 kB 00:00 2024-09-18T21:01:05.272 INFO:teuthology.orchestra.run.smithi077.stdout:(19/24): librdkafka-1.6.1-102.el9.x86_64.rpm 2.3 MB/s | 662 kB 00:00 2024-09-18T21:01:05.298 INFO:teuthology.orchestra.run.smithi077.stdout:(20/24): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-18T21:01:05.331 INFO:teuthology.orchestra.run.smithi077.stdout:(21/24): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.9 MB/s | 308 kB 00:00 2024-09-18T21:01:05.398 INFO:teuthology.orchestra.run.smithi077.stdout:(22/24): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-18T21:01:05.498 INFO:teuthology.orchestra.run.smithi077.stdout:(23/24): librbd1-17.2.7-1637.g6e06d1e0.el9.x86_ 18 MB/s | 2.9 MB 00:00 2024-09-18T21:01:05.548 INFO:teuthology.orchestra.run.smithi077.stdout:(24/24): librados2-17.2.7-1637.g6e06d1e0.el9.x8 13 MB/s | 3.1 MB 00:00 2024-09-18T21:01:05.554 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-09-18T21:01:05.554 INFO:teuthology.orchestra.run.smithi077.stdout:Total 23 MB/s | 58 MB 00:02 2024-09-18T21:01:05.618 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-09-18T21:01:05.652 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-09-18T21:01:05.652 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-09-18T21:01:06.304 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-09-18T21:01:06.305 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-09-18T21:01:07.509 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-common-2:17.2.7-1637.g6e06d1e0.el9.x86_64 21/26 2024-09-18T21:01:07.550 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-common-2:17.2.7-1637.g6e06d1e0.el9.x86_64 21/26 2024-09-18T21:01:07.578 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-09-18T21:01:07.953 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-09-18T21:01:08.026 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : librados2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2/26 2024-09-18T21:01:08.085 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-common-2:17.2.7-1637.g6e06d1e0.el9.x86_64 21/26 2024-09-18T21:01:08.118 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librados2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2/26 2024-09-18T21:01:08.121 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-base-2:17.2.7-1637.g6e06d1e0.el9.x86_64 22/26 2024-09-18T21:01:08.205 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rados-2:17.2.7-1637.g6e06d1e0.el9.x86_64 3/26 2024-09-18T21:01:08.214 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-base-2:17.2.7-1637.g6e06d1e0.el9.x86_64 22/26 2024-09-18T21:01:08.214 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-18T21:01:08.214 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-18T21:01:08.214 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:01:08.227 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcephfs2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 4/26 2024-09-18T21:01:08.247 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-selinux-2:17.2.7-1637.g6e06d1e0.el9.x86_64 23/26 2024-09-18T21:01:08.316 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libcephfs2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 4/26 2024-09-18T21:01:08.366 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-09-18T21:01:08.407 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-09-18T21:01:08.849 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-09-18T21:01:08.872 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librgw2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 8/26 2024-09-18T21:01:08.934 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librgw2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 8/26 2024-09-18T21:01:08.963 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-09-18T21:01:09.006 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-ceph-argparse-2:17.2.7-1637.g6e06d1e0.el9. 10/26 2024-09-18T21:01:09.043 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cephfs-2:17.2.7-1637.g6e06d1e0.el9.x86_64 11/26 2024-09-18T21:01:09.105 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rgw-2:17.2.7-1637.g6e06d1e0.el9.x86_64 12/26 2024-09-18T21:01:09.133 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libradosstriper1-2:17.2.7-1637.g6e06d1e0.el9.x86_6 13/26 2024-09-18T21:01:09.198 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1637.g6e06d1e0.el9.x86_6 13/26 2024-09-18T21:01:09.262 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-09-18T21:01:09.299 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/26 2024-09-18T21:01:09.333 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-09-18T21:01:09.639 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-09-18T21:01:09.687 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : librbd1-2:17.2.7-1637.g6e06d1e0.el9.x86_64 18/26 2024-09-18T21:01:09.777 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librbd1-2:17.2.7-1637.g6e06d1e0.el9.x86_64 18/26 2024-09-18T21:01:09.850 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rbd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 19/26 2024-09-18T21:01:09.880 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-ceph-common-2:17.2.7-1637.g6e06d1e0.el9.x8 20/26 2024-09-18T21:01:12.286 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-common-2:17.2.7-1637.g6e06d1e0.el9.x86_64 21/26 2024-09-18T21:01:12.318 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-common-2:17.2.7-1637.g6e06d1e0.el9.x86_64 21/26 2024-09-18T21:01:12.860 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-common-2:17.2.7-1637.g6e06d1e0.el9.x86_64 21/26 2024-09-18T21:01:12.896 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-base-2:17.2.7-1637.g6e06d1e0.el9.x86_64 22/26 2024-09-18T21:01:13.001 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-base-2:17.2.7-1637.g6e06d1e0.el9.x86_64 22/26 2024-09-18T21:01:13.001 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-18T21:01:13.001 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-18T21:01:13.001 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:01:13.031 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-selinux-2:17.2.7-1637.g6e06d1e0.el9.x86_64 23/26 2024-09-18T21:01:17.974 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1637.g6e06d1e0.el9.x86_64 23/26 2024-09-18T21:01:17.975 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /sys 2024-09-18T21:01:17.975 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /proc 2024-09-18T21:01:17.975 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /mnt 2024-09-18T21:01:17.975 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /var/tmp 2024-09-18T21:01:17.975 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /home 2024-09-18T21:01:17.975 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /root 2024-09-18T21:01:17.975 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /tmp 2024-09-18T21:01:17.975 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:01:19.314 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-radosgw-2:17.2.7-1637.g6e06d1e0.el9.x86_64 24/26 2024-09-18T21:01:19.384 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1637.g6e06d1e0.el9.x86_64 24/26 2024-09-18T21:01:19.384 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T21:01:19.384 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-18T21:01:19.384 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-18T21:01:19.385 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-18T21:01:19.385 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:01:19.386 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-18T21:01:19.475 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-18T21:01:19.475 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-18T21:01:20.739 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-18T21:01:20.740 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-base-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/26 2024-09-18T21:01:20.740 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-common-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2/26 2024-09-18T21:01:20.740 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-radosgw-2:17.2.7-1637.g6e06d1e0.el9.x86_64 3/26 2024-09-18T21:01:20.740 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-selinux-2:17.2.7-1637.g6e06d1e0.el9.x86_64 4/26 2024-09-18T21:01:20.740 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephfs2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 5/26 2024-09-18T21:01:20.740 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libradosstriper1-2:17.2.7-1637.g6e06d1e0.el9.x86_6 6/26 2024-09-18T21:01:20.740 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librgw2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 7/26 2024-09-18T21:01:20.740 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1637.g6e06d1e0.el9. 8/26 2024-09-18T21:01:20.740 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ceph-common-2:17.2.7-1637.g6e06d1e0.el9.x8 9/26 2024-09-18T21:01:20.740 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cephfs-2:17.2.7-1637.g6e06d1e0.el9.x86_64 10/26 2024-09-18T21:01:20.740 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rados-2:17.2.7-1637.g6e06d1e0.el9.x86_64 11/26 2024-09-18T21:01:20.740 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rbd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 12/26 2024-09-18T21:01:20.741 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rgw-2:17.2.7-1637.g6e06d1e0.el9.x86_64 13/26 2024-09-18T21:01:20.741 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-09-18T21:01:20.741 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-09-18T21:01:20.741 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-09-18T21:01:20.741 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-09-18T21:01:20.741 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-09-18T21:01:20.741 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 19/26 2024-09-18T21:01:20.741 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-09-18T21:01:20.741 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-09-18T21:01:20.741 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-09-18T21:01:20.741 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 23/26 2024-09-18T21:01:20.741 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-09-18T21:01:20.742 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librbd1-2:17.2.7-1637.g6e06d1e0.el9.x86_64 25/26 2024-09-18T21:01:21.498 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-09-18T21:01:21.498 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:01:21.498 INFO:teuthology.orchestra.run.smithi103.stdout:Upgraded: 2024-09-18T21:01:21.499 INFO:teuthology.orchestra.run.smithi103.stdout: librados2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:01:21.499 INFO:teuthology.orchestra.run.smithi103.stdout: librbd1-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:01:21.499 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-18T21:01:21.499 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-base-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:01:21.499 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-common-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:01:21.499 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-radosgw-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:01:21.499 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-selinux-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:01:21.499 INFO:teuthology.orchestra.run.smithi103.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-18T21:01:21.499 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:01:21.499 INFO:teuthology.orchestra.run.smithi103.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-18T21:01:21.499 INFO:teuthology.orchestra.run.smithi103.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-18T21:01:21.499 INFO:teuthology.orchestra.run.smithi103.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-18T21:01:21.499 INFO:teuthology.orchestra.run.smithi103.stdout: libradosstriper1-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:01:21.500 INFO:teuthology.orchestra.run.smithi103.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-18T21:01:21.500 INFO:teuthology.orchestra.run.smithi103.stdout: librgw2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:01:21.500 INFO:teuthology.orchestra.run.smithi103.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-18T21:01:21.500 INFO:teuthology.orchestra.run.smithi103.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-18T21:01:21.500 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-argparse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:01:21.500 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-common-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:01:21.500 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cephfs-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:01:21.500 INFO:teuthology.orchestra.run.smithi103.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-18T21:01:21.500 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rados-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:01:21.500 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rbd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:01:21.500 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rgw-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:01:21.500 INFO:teuthology.orchestra.run.smithi103.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-18T21:01:21.500 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:01:21.501 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-18T21:01:21.890 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-test 2024-09-18T21:01:22.482 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:00:27 ago on Wed 18 Sep 2024 09:00:55 PM UTC. 2024-09-18T21:01:22.620 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-18T21:01:22.620 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-18T21:01:22.620 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-09-18T21:01:22.621 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-18T21:01:22.621 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-18T21:01:22.621 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-test x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 48 M 2024-09-18T21:01:22.621 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-09-18T21:01:22.621 INFO:teuthology.orchestra.run.smithi103.stdout: libcephsqlite x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 163 k 2024-09-18T21:01:22.621 INFO:teuthology.orchestra.run.smithi103.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-18T21:01:22.621 INFO:teuthology.orchestra.run.smithi103.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-18T21:01:22.621 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:01:22.621 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-18T21:01:22.621 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-18T21:01:22.621 INFO:teuthology.orchestra.run.smithi103.stdout:Install 4 Packages 2024-09-18T21:01:22.621 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:01:22.622 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 48 M 2024-09-18T21:01:22.622 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 193 M 2024-09-18T21:01:22.622 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-18T21:01:22.748 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1637.g6e06d1e0.el9.x86_64 23/26 2024-09-18T21:01:22.748 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /sys 2024-09-18T21:01:22.748 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /proc 2024-09-18T21:01:22.748 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /mnt 2024-09-18T21:01:22.748 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /var/tmp 2024-09-18T21:01:22.748 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /home 2024-09-18T21:01:22.748 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /root 2024-09-18T21:01:22.748 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /tmp 2024-09-18T21:01:22.748 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:01:22.798 INFO:teuthology.orchestra.run.smithi103.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 2.4 MB/s | 304 kB 00:00 2024-09-18T21:01:22.840 INFO:teuthology.orchestra.run.smithi103.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-18T21:01:22.899 INFO:teuthology.orchestra.run.smithi103.stdout:(3/4): libcephsqlite-17.2.7-1637.g6e06d1e0.el9. 723 kB/s | 163 kB 00:00 2024-09-18T21:01:24.097 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-radosgw-2:17.2.7-1637.g6e06d1e0.el9.x86_64 24/26 2024-09-18T21:01:24.165 INFO:teuthology.orchestra.run.smithi103.stdout:(4/4): ceph-test-17.2.7-1637.g6e06d1e0.el9.x86_ 32 MB/s | 48 MB 00:01 2024-09-18T21:01:24.167 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-18T21:01:24.168 INFO:teuthology.orchestra.run.smithi103.stdout:Total 31 MB/s | 48 MB 00:01 2024-09-18T21:01:24.175 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1637.g6e06d1e0.el9.x86_64 24/26 2024-09-18T21:01:24.176 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T21:01:24.176 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-18T21:01:24.176 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-18T21:01:24.176 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-18T21:01:24.176 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:01:24.178 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-18T21:01:24.195 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-18T21:01:24.214 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-18T21:01:24.214 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-18T21:01:24.267 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-18T21:01:24.267 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-18T21:01:24.579 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-18T21:01:24.579 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-18T21:01:25.107 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-18T21:01:25.192 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-18T21:01:25.262 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-18T21:01:25.284 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephsqlite-2:17.2.7-1637.g6e06d1e0.el9.x86_64 3/4 2024-09-18T21:01:25.555 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-18T21:01:25.556 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-base-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/26 2024-09-18T21:01:25.556 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-common-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2/26 2024-09-18T21:01:25.556 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-radosgw-2:17.2.7-1637.g6e06d1e0.el9.x86_64 3/26 2024-09-18T21:01:25.556 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-selinux-2:17.2.7-1637.g6e06d1e0.el9.x86_64 4/26 2024-09-18T21:01:25.556 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcephfs2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 5/26 2024-09-18T21:01:25.556 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libradosstriper1-2:17.2.7-1637.g6e06d1e0.el9.x86_6 6/26 2024-09-18T21:01:25.556 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librgw2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 7/26 2024-09-18T21:01:25.556 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1637.g6e06d1e0.el9. 8/26 2024-09-18T21:01:25.556 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-ceph-common-2:17.2.7-1637.g6e06d1e0.el9.x8 9/26 2024-09-18T21:01:25.556 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cephfs-2:17.2.7-1637.g6e06d1e0.el9.x86_64 10/26 2024-09-18T21:01:25.557 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rados-2:17.2.7-1637.g6e06d1e0.el9.x86_64 11/26 2024-09-18T21:01:25.557 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rbd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 12/26 2024-09-18T21:01:25.557 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rgw-2:17.2.7-1637.g6e06d1e0.el9.x86_64 13/26 2024-09-18T21:01:25.557 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-09-18T21:01:25.557 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-09-18T21:01:25.557 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-09-18T21:01:25.557 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-09-18T21:01:25.557 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-09-18T21:01:25.557 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 19/26 2024-09-18T21:01:25.557 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-09-18T21:01:25.557 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-09-18T21:01:25.557 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-09-18T21:01:25.557 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librados2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 23/26 2024-09-18T21:01:25.557 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-09-18T21:01:25.558 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librbd1-2:17.2.7-1637.g6e06d1e0.el9.x86_64 25/26 2024-09-18T21:01:26.364 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-09-18T21:01:26.364 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:01:26.364 INFO:teuthology.orchestra.run.smithi077.stdout:Upgraded: 2024-09-18T21:01:26.364 INFO:teuthology.orchestra.run.smithi077.stdout: librados2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:01:26.364 INFO:teuthology.orchestra.run.smithi077.stdout: librbd1-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:01:26.364 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-09-18T21:01:26.364 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-base-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:01:26.364 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-common-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:01:26.364 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-radosgw-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:01:26.364 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-selinux-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:01:26.365 INFO:teuthology.orchestra.run.smithi077.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-18T21:01:26.365 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:01:26.365 INFO:teuthology.orchestra.run.smithi077.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-18T21:01:26.365 INFO:teuthology.orchestra.run.smithi077.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-18T21:01:26.365 INFO:teuthology.orchestra.run.smithi077.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-18T21:01:26.365 INFO:teuthology.orchestra.run.smithi077.stdout: libradosstriper1-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:01:26.365 INFO:teuthology.orchestra.run.smithi077.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-18T21:01:26.365 INFO:teuthology.orchestra.run.smithi077.stdout: librgw2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:01:26.365 INFO:teuthology.orchestra.run.smithi077.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-18T21:01:26.365 INFO:teuthology.orchestra.run.smithi077.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-18T21:01:26.365 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-argparse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:01:26.365 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-common-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:01:26.365 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cephfs-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:01:26.366 INFO:teuthology.orchestra.run.smithi077.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-18T21:01:26.366 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rados-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:01:26.366 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rbd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:01:26.366 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rgw-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:01:26.366 INFO:teuthology.orchestra.run.smithi077.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-18T21:01:26.366 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:01:26.366 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-18T21:01:26.658 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-test 2024-09-18T21:01:27.234 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:00:27 ago on Wed 18 Sep 2024 09:01:00 PM UTC. 2024-09-18T21:01:27.374 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-18T21:01:27.375 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-18T21:01:27.375 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2024-09-18T21:01:27.375 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-18T21:01:27.375 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-09-18T21:01:27.375 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-test x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 48 M 2024-09-18T21:01:27.376 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-09-18T21:01:27.376 INFO:teuthology.orchestra.run.smithi077.stdout: libcephsqlite x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 163 k 2024-09-18T21:01:27.376 INFO:teuthology.orchestra.run.smithi077.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-18T21:01:27.376 INFO:teuthology.orchestra.run.smithi077.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-18T21:01:27.376 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:01:27.376 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-09-18T21:01:27.377 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-18T21:01:27.377 INFO:teuthology.orchestra.run.smithi077.stdout:Install 4 Packages 2024-09-18T21:01:27.377 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:01:27.377 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 48 M 2024-09-18T21:01:27.377 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 193 M 2024-09-18T21:01:27.377 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-09-18T21:01:27.621 INFO:teuthology.orchestra.run.smithi077.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 2.5 MB/s | 304 kB 00:00 2024-09-18T21:01:27.663 INFO:teuthology.orchestra.run.smithi077.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-18T21:01:27.730 INFO:teuthology.orchestra.run.smithi077.stdout:(3/4): libcephsqlite-17.2.7-1637.g6e06d1e0.el9. 714 kB/s | 163 kB 00:00 2024-09-18T21:01:29.014 INFO:teuthology.orchestra.run.smithi077.stdout:(4/4): ceph-test-17.2.7-1637.g6e06d1e0.el9.x86_ 32 MB/s | 48 MB 00:01 2024-09-18T21:01:29.016 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-09-18T21:01:29.016 INFO:teuthology.orchestra.run.smithi077.stdout:Total 30 MB/s | 48 MB 00:01 2024-09-18T21:01:29.043 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-09-18T21:01:29.062 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-09-18T21:01:29.062 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-09-18T21:01:29.425 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-09-18T21:01:29.426 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-09-18T21:01:29.667 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1637.g6e06d1e0.el9.x86_64 3/4 2024-09-18T21:01:29.740 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-test-2:17.2.7-1637.g6e06d1e0.el9.x86_64 4/4 2024-09-18T21:01:29.957 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-09-18T21:01:30.064 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-18T21:01:30.104 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-18T21:01:30.132 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcephsqlite-2:17.2.7-1637.g6e06d1e0.el9.x86_64 3/4 2024-09-18T21:01:32.064 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-test-2:17.2.7-1637.g6e06d1e0.el9.x86_64 4/4 2024-09-18T21:01:32.064 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-test-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/4 2024-09-18T21:01:32.064 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephsqlite-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2/4 2024-09-18T21:01:32.065 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-18T21:01:32.381 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-18T21:01:32.381 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:01:32.381 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-18T21:01:32.381 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-test-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:01:32.382 INFO:teuthology.orchestra.run.smithi103.stdout: libcephsqlite-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:01:32.382 INFO:teuthology.orchestra.run.smithi103.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-18T21:01:32.382 INFO:teuthology.orchestra.run.smithi103.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-18T21:01:32.382 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:01:32.382 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-18T21:01:32.698 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph 2024-09-18T21:01:33.291 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:00:38 ago on Wed 18 Sep 2024 09:00:55 PM UTC. 2024-09-18T21:01:33.433 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-18T21:01:33.435 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-18T21:01:33.435 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-09-18T21:01:33.435 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-18T21:01:33.435 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-18T21:01:33.435 INFO:teuthology.orchestra.run.smithi103.stdout: ceph x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 6.5 k 2024-09-18T21:01:33.435 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-09-18T21:01:33.435 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mds x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 2.1 M 2024-09-18T21:01:33.435 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 1.4 M 2024-09-18T21:01:33.436 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1637.g6e06d1e0.el9 ceph-noarch 240 k 2024-09-18T21:01:33.436 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mon x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 3.9 M 2024-09-18T21:01:33.436 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-osd x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 15 M 2024-09-18T21:01:33.436 INFO:teuthology.orchestra.run.smithi103.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-18T21:01:33.436 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-18T21:01:33.436 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-18T21:01:33.436 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-18T21:01:33.436 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-18T21:01:33.436 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-18T21:01:33.436 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-18T21:01:33.436 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-collections 2024-09-18T21:01:33.436 INFO:teuthology.orchestra.run.smithi103.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-18T21:01:33.436 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-18T21:01:33.437 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-18T21:01:33.437 INFO:teuthology.orchestra.run.smithi103.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-18T21:01:33.437 INFO:teuthology.orchestra.run.smithi103.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-18T21:01:33.437 INFO:teuthology.orchestra.run.smithi103.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-18T21:01:33.439 INFO:teuthology.orchestra.run.smithi103.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-18T21:01:33.440 INFO:teuthology.orchestra.run.smithi103.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-18T21:01:33.440 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-18T21:01:33.440 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-18T21:01:33.440 INFO:teuthology.orchestra.run.smithi103.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-18T21:01:33.440 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-18T21:01:33.440 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-18T21:01:33.440 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-18T21:01:33.440 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-18T21:01:33.440 INFO:teuthology.orchestra.run.smithi103.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-18T21:01:33.440 INFO:teuthology.orchestra.run.smithi103.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-18T21:01:33.440 INFO:teuthology.orchestra.run.smithi103.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-18T21:01:33.440 INFO:teuthology.orchestra.run.smithi103.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-18T21:01:33.440 INFO:teuthology.orchestra.run.smithi103.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-18T21:01:33.440 INFO:teuthology.orchestra.run.smithi103.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-18T21:01:33.441 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:01:33.441 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-18T21:01:33.441 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-18T21:01:33.441 INFO:teuthology.orchestra.run.smithi103.stdout:Install 34 Packages 2024-09-18T21:01:33.441 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:01:33.441 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 27 M 2024-09-18T21:01:33.442 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 96 M 2024-09-18T21:01:33.442 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-18T21:01:34.417 INFO:teuthology.orchestra.run.smithi103.stdout:(1/34): ceph-17.2.7-1637.g6e06d1e0.el9.x86_64.r 51 kB/s | 6.5 kB 00:00 2024-09-18T21:01:34.546 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1637.g6e06d1e0.el9.x86_64 3/4 2024-09-18T21:01:34.631 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-test-2:17.2.7-1637.g6e06d1e0.el9.x86_64 4/4 2024-09-18T21:01:34.643 INFO:teuthology.orchestra.run.smithi103.stdout:(2/34): ceph-mds-17.2.7-1637.g6e06d1e0.el9.x86_ 5.9 MB/s | 2.1 MB 00:00 2024-09-18T21:01:34.685 INFO:teuthology.orchestra.run.smithi103.stdout:(3/34): ceph-mgr-17.2.7-1637.g6e06d1e0.el9.x86_ 3.6 MB/s | 1.4 MB 00:00 2024-09-18T21:01:34.752 INFO:teuthology.orchestra.run.smithi103.stdout:(4/34): ceph-mon-17.2.7-1637.g6e06d1e0.el9.x86_ 12 MB/s | 3.9 MB 00:00 2024-09-18T21:01:34.777 INFO:teuthology.orchestra.run.smithi103.stdout:(5/34): ceph-mgr-modules-core-17.2.7-1637.g6e06 2.6 MB/s | 240 kB 00:00 2024-09-18T21:01:34.894 INFO:teuthology.orchestra.run.smithi103.stdout:(6/34): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.7 MB/s | 253 kB 00:00 2024-09-18T21:01:34.936 INFO:teuthology.orchestra.run.smithi103.stdout:(7/34): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-18T21:01:34.986 INFO:teuthology.orchestra.run.smithi103.stdout:(8/34): python3-cryptography-36.0.1-4.el9.x86_6 5.9 MB/s | 1.2 MB 00:00 2024-09-18T21:01:35.012 INFO:teuthology.orchestra.run.smithi103.stdout:(9/34): python3-pycparser-2.20-6.el9.noarch.rpm 1.7 MB/s | 135 kB 00:00 2024-09-18T21:01:35.037 INFO:teuthology.orchestra.run.smithi103.stdout:(10/34): python3-requests-2.25.1-8.el9.noarch.r 2.4 MB/s | 125 kB 00:00 2024-09-18T21:01:35.063 INFO:teuthology.orchestra.run.smithi103.stdout:(11/34): python3-urllib3-1.26.5-6.el9.noarch.rp 4.2 MB/s | 215 kB 00:00 2024-09-18T21:01:35.230 INFO:teuthology.orchestra.run.smithi103.stdout:(12/34): ceph-osd-17.2.7-1637.g6e06d1e0.el9.x86 26 MB/s | 15 MB 00:00 2024-09-18T21:01:35.313 INFO:teuthology.orchestra.run.smithi103.stdout:(13/34): python3-markupsafe-1.1.1-12.el9.x86_64 139 kB/s | 35 kB 00:00 2024-09-18T21:01:35.338 INFO:teuthology.orchestra.run.smithi103.stdout:(14/34): python3-mako-1.1.4-6.el9.noarch.rpm 572 kB/s | 172 kB 00:00 2024-09-18T21:01:35.388 INFO:teuthology.orchestra.run.smithi103.stdout:(15/34): python3-toml-0.10.2-6.el9.noarch.rpm 833 kB/s | 42 kB 00:00 2024-09-18T21:01:35.414 INFO:teuthology.orchestra.run.smithi103.stdout:(16/34): python3-packaging-20.9-5.el9.noarch.rp 420 kB/s | 77 kB 00:00 2024-09-18T21:01:35.439 INFO:teuthology.orchestra.run.smithi103.stdout:(17/34): python3-pytz-2021.1-5.el9.noarch.rpm 406 kB/s | 51 kB 00:00 2024-09-18T21:01:35.498 INFO:teuthology.orchestra.run.smithi103.stdout:(18/34): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 399 kB/s | 43 kB 00:00 2024-09-18T21:01:35.523 INFO:teuthology.orchestra.run.smithi103.stdout:(19/34): python3-jaraco-8.2.1-3.el9.noarch.rpm 463 kB/s | 11 kB 00:00 2024-09-18T21:01:35.548 INFO:teuthology.orchestra.run.smithi103.stdout:(20/34): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.5 MB/s | 172 kB 00:00 2024-09-18T21:01:35.565 INFO:teuthology.orchestra.run.smithi103.stdout:(21/34): python3-jaraco-classes-3.2.1-5.el9.noa 422 kB/s | 18 kB 00:00 2024-09-18T21:01:35.582 INFO:teuthology.orchestra.run.smithi103.stdout:(22/34): python3-jaraco-functools-3.5.0-2.el9.n 1.2 MB/s | 19 kB 00:00 2024-09-18T21:01:35.599 INFO:teuthology.orchestra.run.smithi103.stdout:(23/34): python3-jaraco-collections-3.0.0-8.el9 693 kB/s | 23 kB 00:00 2024-09-18T21:01:35.616 INFO:teuthology.orchestra.run.smithi103.stdout:(24/34): python3-jaraco-text-3.2.0-6.el9.noarch 587 kB/s | 20 kB 00:00 2024-09-18T21:01:35.633 INFO:teuthology.orchestra.run.smithi103.stdout:(25/34): python3-logutils-0.3.5-21.el9.noarch.r 1.4 MB/s | 46 kB 00:00 2024-09-18T21:01:35.658 INFO:teuthology.orchestra.run.smithi103.stdout:(26/34): python3-cherrypy-18.6.1-2.el9.noarch.r 1.6 MB/s | 358 kB 00:00 2024-09-18T21:01:35.683 INFO:teuthology.orchestra.run.smithi103.stdout:(27/34): python3-more-itertools-8.12.0-2.el9.no 1.1 MB/s | 79 kB 00:00 2024-09-18T21:01:35.700 INFO:teuthology.orchestra.run.smithi103.stdout:(28/34): python3-portend-3.1.0-2.el9.noarch.rpm 994 kB/s | 16 kB 00:00 2024-09-18T21:01:35.726 INFO:teuthology.orchestra.run.smithi103.stdout:(29/34): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.1 MB/s | 90 kB 00:00 2024-09-18T21:01:35.743 INFO:teuthology.orchestra.run.smithi103.stdout:(30/34): python3-tempora-5.0.0-2.el9.noarch.rpm 851 kB/s | 36 kB 00:00 2024-09-18T21:01:35.768 INFO:teuthology.orchestra.run.smithi103.stdout:(31/34): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-09-18T21:01:35.793 INFO:teuthology.orchestra.run.smithi103.stdout:(32/34): python3-webob-1.8.8-2.el9.noarch.rpm 3.4 MB/s | 230 kB 00:00 2024-09-18T21:01:35.827 INFO:teuthology.orchestra.run.smithi103.stdout:(33/34): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.0 MB/s | 427 kB 00:00 2024-09-18T21:01:35.852 INFO:teuthology.orchestra.run.smithi103.stdout:(34/34): python3-zc-lockfile-2.0-10.el9.noarch. 239 kB/s | 20 kB 00:00 2024-09-18T21:01:35.855 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-18T21:01:35.855 INFO:teuthology.orchestra.run.smithi103.stdout:Total 11 MB/s | 27 MB 00:02 2024-09-18T21:01:35.985 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-18T21:01:36.023 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-18T21:01:36.023 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-18T21:01:36.425 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-18T21:01:36.426 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-18T21:01:36.861 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-test-2:17.2.7-1637.g6e06d1e0.el9.x86_64 4/4 2024-09-18T21:01:36.861 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-test-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/4 2024-09-18T21:01:36.861 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcephsqlite-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2/4 2024-09-18T21:01:36.862 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-18T21:01:37.203 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-18T21:01:37.203 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:01:37.203 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-09-18T21:01:37.203 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-test-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:01:37.204 INFO:teuthology.orchestra.run.smithi077.stdout: libcephsqlite-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:01:37.204 INFO:teuthology.orchestra.run.smithi077.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-18T21:01:37.204 INFO:teuthology.orchestra.run.smithi077.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-18T21:01:37.204 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:01:37.204 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-18T21:01:37.482 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph 2024-09-18T21:01:37.645 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-18T21:01:37.705 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/34 2024-09-18T21:01:37.746 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/34 2024-09-18T21:01:37.779 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/34 2024-09-18T21:01:37.870 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/34 2024-09-18T21:01:37.957 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/34 2024-09-18T21:01:37.998 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/34 2024-09-18T21:01:38.050 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/34 2024-09-18T21:01:38.063 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:00:38 ago on Wed 18 Sep 2024 09:01:00 PM UTC. 2024-09-18T21:01:38.080 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/34 2024-09-18T21:01:38.115 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/34 2024-09-18T21:01:38.148 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/34 2024-09-18T21:01:38.188 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/34 2024-09-18T21:01:38.201 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-18T21:01:38.203 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-18T21:01:38.203 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2024-09-18T21:01:38.204 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-18T21:01:38.204 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-09-18T21:01:38.204 INFO:teuthology.orchestra.run.smithi077.stdout: ceph x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 6.5 k 2024-09-18T21:01:38.204 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-09-18T21:01:38.204 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mds x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 2.1 M 2024-09-18T21:01:38.204 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 1.4 M 2024-09-18T21:01:38.204 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1637.g6e06d1e0.el9 ceph-noarch 240 k 2024-09-18T21:01:38.205 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mon x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 3.9 M 2024-09-18T21:01:38.205 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-osd x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 15 M 2024-09-18T21:01:38.205 INFO:teuthology.orchestra.run.smithi077.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-18T21:01:38.205 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-18T21:01:38.205 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-18T21:01:38.205 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-18T21:01:38.205 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-18T21:01:38.205 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-18T21:01:38.205 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-18T21:01:38.205 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-collections 2024-09-18T21:01:38.205 INFO:teuthology.orchestra.run.smithi077.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-18T21:01:38.205 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-18T21:01:38.206 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-18T21:01:38.206 INFO:teuthology.orchestra.run.smithi077.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-18T21:01:38.206 INFO:teuthology.orchestra.run.smithi077.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-18T21:01:38.206 INFO:teuthology.orchestra.run.smithi077.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-18T21:01:38.206 INFO:teuthology.orchestra.run.smithi077.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-18T21:01:38.206 INFO:teuthology.orchestra.run.smithi077.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-18T21:01:38.206 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-18T21:01:38.206 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-18T21:01:38.206 INFO:teuthology.orchestra.run.smithi077.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-18T21:01:38.206 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-18T21:01:38.207 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-18T21:01:38.207 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-18T21:01:38.207 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-18T21:01:38.207 INFO:teuthology.orchestra.run.smithi077.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-18T21:01:38.207 INFO:teuthology.orchestra.run.smithi077.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-18T21:01:38.207 INFO:teuthology.orchestra.run.smithi077.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-18T21:01:38.207 INFO:teuthology.orchestra.run.smithi077.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-18T21:01:38.207 INFO:teuthology.orchestra.run.smithi077.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-18T21:01:38.207 INFO:teuthology.orchestra.run.smithi077.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-18T21:01:38.207 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:01:38.208 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-09-18T21:01:38.208 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-18T21:01:38.208 INFO:teuthology.orchestra.run.smithi077.stdout:Install 34 Packages 2024-09-18T21:01:38.208 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:01:38.209 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 27 M 2024-09-18T21:01:38.209 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 96 M 2024-09-18T21:01:38.209 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-09-18T21:01:38.223 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/34 2024-09-18T21:01:38.262 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/34 2024-09-18T21:01:38.310 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/34 2024-09-18T21:01:38.343 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-18T21:01:38.415 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 16/34 2024-09-18T21:01:38.562 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 17/34 2024-09-18T21:01:38.643 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 18/34 2024-09-18T21:01:38.697 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 19/34 2024-09-18T21:01:38.734 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 20/34 2024-09-18T21:01:38.783 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ply-3.11-14.el9.noarch 21/34 2024-09-18T21:01:38.840 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 22/34 2024-09-18T21:01:38.955 INFO:teuthology.orchestra.run.smithi077.stdout:(1/34): ceph-17.2.7-1637.g6e06d1e0.el9.x86_64.r 51 kB/s | 6.5 kB 00:00 2024-09-18T21:01:39.043 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 23/34 2024-09-18T21:01:39.106 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 24/34 2024-09-18T21:01:39.130 INFO:teuthology.orchestra.run.smithi077.stdout:(2/34): ceph-mgr-17.2.7-1637.g6e06d1e0.el9.x86_ 4.6 MB/s | 1.4 MB 00:00 2024-09-18T21:01:39.183 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 25/34 2024-09-18T21:01:39.189 INFO:teuthology.orchestra.run.smithi077.stdout:(3/34): ceph-mds-17.2.7-1637.g6e06d1e0.el9.x86_ 5.7 MB/s | 2.1 MB 00:00 2024-09-18T21:01:39.264 INFO:teuthology.orchestra.run.smithi077.stdout:(4/34): ceph-mgr-modules-core-17.2.7-1637.g6e06 3.1 MB/s | 240 kB 00:00 2024-09-18T21:01:39.273 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 26/34 2024-09-18T21:01:39.323 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/34 2024-09-18T21:01:39.437 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 28/34 2024-09-18T21:01:39.456 INFO:teuthology.orchestra.run.smithi077.stdout:(5/34): ceph-mon-17.2.7-1637.g6e06d1e0.el9.x86_ 7.8 MB/s | 3.9 MB 00:00 2024-09-18T21:01:39.473 INFO:teuthology.orchestra.run.smithi077.stdout:(6/34): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.2 MB/s | 253 kB 00:00 2024-09-18T21:01:39.523 INFO:teuthology.orchestra.run.smithi077.stdout:(7/34): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-18T21:01:39.584 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1637.g6e06d1e0.el9. 29/34 2024-09-18T21:01:39.608 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-2:17.2.7-1637.g6e06d1e0.el9.x86_64 30/34 2024-09-18T21:01:39.633 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1637.g6e06d1e0.el9.x86_64 30/34 2024-09-18T21:01:39.633 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T21:01:39.633 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-18T21:01:39.633 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-18T21:01:39.633 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-18T21:01:39.633 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:01:39.699 INFO:teuthology.orchestra.run.smithi077.stdout:(8/34): ceph-osd-17.2.7-1637.g6e06d1e0.el9.x86_ 27 MB/s | 15 MB 00:00 2024-09-18T21:01:39.724 INFO:teuthology.orchestra.run.smithi077.stdout:(9/34): python3-pycparser-2.20-6.el9.noarch.rpm 675 kB/s | 135 kB 00:00 2024-09-18T21:01:39.807 INFO:teuthology.orchestra.run.smithi077.stdout:(10/34): python3-urllib3-1.26.5-6.el9.noarch.rp 2.5 MB/s | 215 kB 00:00 2024-09-18T21:01:39.857 INFO:teuthology.orchestra.run.smithi077.stdout:(11/34): python3-requests-2.25.1-8.el9.noarch.r 787 kB/s | 125 kB 00:00 2024-09-18T21:01:39.933 INFO:teuthology.orchestra.run.smithi077.stdout:(12/34): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-18T21:01:39.958 INFO:teuthology.orchestra.run.smithi077.stdout:(13/34): python3-markupsafe-1.1.1-12.el9.x86_64 346 kB/s | 35 kB 00:00 2024-09-18T21:01:39.991 INFO:teuthology.orchestra.run.smithi077.stdout:(14/34): python3-cryptography-36.0.1-4.el9.x86_ 2.3 MB/s | 1.2 MB 00:00 2024-09-18T21:01:40.017 INFO:teuthology.orchestra.run.smithi077.stdout:(15/34): python3-packaging-20.9-5.el9.noarch.rp 920 kB/s | 77 kB 00:00 2024-09-18T21:01:40.051 INFO:teuthology.orchestra.run.smithi077.stdout:(16/34): python3-pytz-2021.1-5.el9.noarch.rpm 553 kB/s | 51 kB 00:00 2024-09-18T21:01:40.084 INFO:teuthology.orchestra.run.smithi077.stdout:(17/34): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 649 kB/s | 43 kB 00:00 2024-09-18T21:01:40.118 INFO:teuthology.orchestra.run.smithi077.stdout:(18/34): python3-cherrypy-18.6.1-2.el9.noarch.r 11 MB/s | 358 kB 00:00 2024-09-18T21:01:40.143 INFO:teuthology.orchestra.run.smithi077.stdout:(19/34): python3-toml-0.10.2-6.el9.noarch.rpm 276 kB/s | 42 kB 00:00 2024-09-18T21:01:40.168 INFO:teuthology.orchestra.run.smithi077.stdout:(20/34): python3-jaraco-8.2.1-3.el9.noarch.rpm 212 kB/s | 11 kB 00:00 2024-09-18T21:01:40.205 INFO:teuthology.orchestra.run.smithi077.stdout:(21/34): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-18T21:01:40.227 INFO:teuthology.orchestra.run.smithi077.stdout:(22/34): python3-jaraco-collections-3.0.0-8.el9 448 kB/s | 23 kB 00:00 2024-09-18T21:01:40.252 INFO:teuthology.orchestra.run.smithi077.stdout:(23/34): python3-jaraco-classes-3.2.1-5.el9.noa 161 kB/s | 18 kB 00:00 2024-09-18T21:01:40.278 INFO:teuthology.orchestra.run.smithi077.stdout:(24/34): python3-jaraco-functools-3.5.0-2.el9.n 275 kB/s | 19 kB 00:00 2024-09-18T21:01:40.303 INFO:teuthology.orchestra.run.smithi077.stdout:(25/34): python3-jaraco-text-3.2.0-6.el9.noarch 261 kB/s | 20 kB 00:00 2024-09-18T21:01:40.328 INFO:teuthology.orchestra.run.smithi077.stdout:(26/34): python3-logutils-0.3.5-21.el9.noarch.r 924 kB/s | 46 kB 00:00 2024-09-18T21:01:40.354 INFO:teuthology.orchestra.run.smithi077.stdout:(27/34): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-09-18T21:01:40.379 INFO:teuthology.orchestra.run.smithi077.stdout:(28/34): python3-portend-3.1.0-2.el9.noarch.rpm 328 kB/s | 16 kB 00:00 2024-09-18T21:01:40.404 INFO:teuthology.orchestra.run.smithi077.stdout:(29/34): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.8 MB/s | 90 kB 00:00 2024-09-18T21:01:40.429 INFO:teuthology.orchestra.run.smithi077.stdout:(30/34): python3-tempora-5.0.0-2.el9.noarch.rpm 715 kB/s | 36 kB 00:00 2024-09-18T21:01:40.455 INFO:teuthology.orchestra.run.smithi077.stdout:(31/34): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-18T21:01:40.480 INFO:teuthology.orchestra.run.smithi077.stdout:(32/34): python3-zc-lockfile-2.0-10.el9.noarch. 805 kB/s | 20 kB 00:00 2024-09-18T21:01:40.505 INFO:teuthology.orchestra.run.smithi077.stdout:(33/34): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-18T21:01:40.530 INFO:teuthology.orchestra.run.smithi077.stdout:(34/34): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.1 MB/s | 427 kB 00:00 2024-09-18T21:01:40.534 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-09-18T21:01:40.534 INFO:teuthology.orchestra.run.smithi077.stdout:Total 12 MB/s | 27 MB 00:02 2024-09-18T21:01:40.661 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-09-18T21:01:40.698 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-09-18T21:01:40.698 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-09-18T21:01:40.933 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-osd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 31/34 2024-09-18T21:01:40.961 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-osd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 31/34 2024-09-18T21:01:40.961 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T21:01:40.961 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-18T21:01:40.961 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-18T21:01:40.961 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-18T21:01:40.961 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:01:41.104 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-09-18T21:01:41.104 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-09-18T21:01:41.326 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mon-2:17.2.7-1637.g6e06d1e0.el9.x86_64 32/34 2024-09-18T21:01:41.350 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mon-2:17.2.7-1637.g6e06d1e0.el9.x86_64 32/34 2024-09-18T21:01:41.350 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T21:01:41.350 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-18T21:01:41.350 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-18T21:01:41.350 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-18T21:01:41.350 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:01:41.551 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mds-2:17.2.7-1637.g6e06d1e0.el9.x86_64 33/34 2024-09-18T21:01:41.575 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mds-2:17.2.7-1637.g6e06d1e0.el9.x86_64 33/34 2024-09-18T21:01:41.575 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T21:01:41.575 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-18T21:01:41.575 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-18T21:01:41.575 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-18T21:01:41.575 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:01:41.640 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-2:17.2.7-1637.g6e06d1e0.el9.x86_64 34/34 2024-09-18T21:01:42.360 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-09-18T21:01:42.425 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/34 2024-09-18T21:01:42.457 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/34 2024-09-18T21:01:42.498 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/34 2024-09-18T21:01:42.589 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/34 2024-09-18T21:01:42.676 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/34 2024-09-18T21:01:42.717 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/34 2024-09-18T21:01:42.773 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/34 2024-09-18T21:01:42.803 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/34 2024-09-18T21:01:42.837 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/34 2024-09-18T21:01:42.870 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/34 2024-09-18T21:01:42.911 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/34 2024-09-18T21:01:42.945 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/34 2024-09-18T21:01:42.980 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/34 2024-09-18T21:01:43.028 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/34 2024-09-18T21:01:43.069 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-18T21:01:43.140 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 16/34 2024-09-18T21:01:43.281 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 17/34 2024-09-18T21:01:43.331 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-2:17.2.7-1637.g6e06d1e0.el9.x86_64 34/34 2024-09-18T21:01:43.331 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/34 2024-09-18T21:01:43.331 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mds-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2/34 2024-09-18T21:01:43.331 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-2:17.2.7-1637.g6e06d1e0.el9.x86_64 3/34 2024-09-18T21:01:43.331 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mon-2:17.2.7-1637.g6e06d1e0.el9.x86_64 4/34 2024-09-18T21:01:43.331 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-osd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 5/34 2024-09-18T21:01:43.331 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1637.g6e06d1e0.el9. 6/34 2024-09-18T21:01:43.331 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/34 2024-09-18T21:01:43.331 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/34 2024-09-18T21:01:43.331 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/34 2024-09-18T21:01:43.332 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/34 2024-09-18T21:01:43.332 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/34 2024-09-18T21:01:43.332 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/34 2024-09-18T21:01:43.332 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/34 2024-09-18T21:01:43.332 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/34 2024-09-18T21:01:43.332 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-18T21:01:43.332 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/34 2024-09-18T21:01:43.332 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/34 2024-09-18T21:01:43.332 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 18/34 2024-09-18T21:01:43.332 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 19/34 2024-09-18T21:01:43.332 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 20/34 2024-09-18T21:01:43.332 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 21/34 2024-09-18T21:01:43.332 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 22/34 2024-09-18T21:01:43.333 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 23/34 2024-09-18T21:01:43.333 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 24/34 2024-09-18T21:01:43.333 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 25/34 2024-09-18T21:01:43.334 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 26/34 2024-09-18T21:01:43.334 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 27/34 2024-09-18T21:01:43.334 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 28/34 2024-09-18T21:01:43.334 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 29/34 2024-09-18T21:01:43.334 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 30/34 2024-09-18T21:01:43.334 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 31/34 2024-09-18T21:01:43.334 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 32/34 2024-09-18T21:01:43.335 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 33/34 2024-09-18T21:01:43.359 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 18/34 2024-09-18T21:01:43.413 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 19/34 2024-09-18T21:01:43.452 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 20/34 2024-09-18T21:01:43.501 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-ply-3.11-14.el9.noarch 21/34 2024-09-18T21:01:43.555 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 22/34 2024-09-18T21:01:43.741 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 23/34 2024-09-18T21:01:43.797 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 24/34 2024-09-18T21:01:43.867 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 25/34 2024-09-18T21:01:43.955 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 26/34 2024-09-18T21:01:43.997 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/34 2024-09-18T21:01:44.112 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 28/34 2024-09-18T21:01:44.267 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1637.g6e06d1e0.el9. 29/34 2024-09-18T21:01:44.298 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-2:17.2.7-1637.g6e06d1e0.el9.x86_64 30/34 2024-09-18T21:01:44.324 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1637.g6e06d1e0.el9.x86_64 30/34 2024-09-18T21:01:44.324 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T21:01:44.324 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-18T21:01:44.324 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-18T21:01:44.324 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-18T21:01:44.324 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:01:44.340 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 34/34 2024-09-18T21:01:44.341 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:01:44.341 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-18T21:01:44.341 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:01:44.341 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mds-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:01:44.341 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:01:44.341 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-modules-core-2:17.2.7-1637.g6e06d1e0.el9.noarch 2024-09-18T21:01:44.341 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mon-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:01:44.341 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-osd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:01:44.341 INFO:teuthology.orchestra.run.smithi103.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-18T21:01:44.341 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-18T21:01:44.341 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-18T21:01:44.341 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-18T21:01:44.342 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-18T21:01:44.342 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-18T21:01:44.342 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-18T21:01:44.342 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-18T21:01:44.342 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-18T21:01:44.342 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-18T21:01:44.342 INFO:teuthology.orchestra.run.smithi103.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-18T21:01:44.342 INFO:teuthology.orchestra.run.smithi103.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-18T21:01:44.342 INFO:teuthology.orchestra.run.smithi103.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-18T21:01:44.342 INFO:teuthology.orchestra.run.smithi103.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-18T21:01:44.342 INFO:teuthology.orchestra.run.smithi103.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-18T21:01:44.342 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-18T21:01:44.342 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ply-3.11-14.el9.noarch 2024-09-18T21:01:44.343 INFO:teuthology.orchestra.run.smithi103.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-18T21:01:44.343 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-18T21:01:44.343 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-18T21:01:44.343 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-18T21:01:44.343 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-18T21:01:44.343 INFO:teuthology.orchestra.run.smithi103.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-18T21:01:44.343 INFO:teuthology.orchestra.run.smithi103.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-18T21:01:44.343 INFO:teuthology.orchestra.run.smithi103.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-18T21:01:44.343 INFO:teuthology.orchestra.run.smithi103.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-18T21:01:44.343 INFO:teuthology.orchestra.run.smithi103.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-18T21:01:44.343 INFO:teuthology.orchestra.run.smithi103.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-18T21:01:44.343 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:01:44.343 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-18T21:01:44.681 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-base 2024-09-18T21:01:45.265 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:00:50 ago on Wed 18 Sep 2024 09:00:55 PM UTC. 2024-09-18T21:01:45.353 INFO:teuthology.orchestra.run.smithi103.stdout:Package ceph-base-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-18T21:01:45.395 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-18T21:01:45.396 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-09-18T21:01:45.396 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-18T21:01:45.464 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install cephadm 2024-09-18T21:01:45.657 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-osd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 31/34 2024-09-18T21:01:45.685 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-osd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 31/34 2024-09-18T21:01:45.685 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T21:01:45.685 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-18T21:01:45.685 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-18T21:01:45.685 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-18T21:01:45.685 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:01:46.035 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:00:51 ago on Wed 18 Sep 2024 09:00:55 PM UTC. 2024-09-18T21:01:46.059 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mon-2:17.2.7-1637.g6e06d1e0.el9.x86_64 32/34 2024-09-18T21:01:46.084 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mon-2:17.2.7-1637.g6e06d1e0.el9.x86_64 32/34 2024-09-18T21:01:46.084 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T21:01:46.084 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-18T21:01:46.084 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-18T21:01:46.084 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-18T21:01:46.084 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:01:46.165 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-18T21:01:46.165 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-18T21:01:46.165 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-09-18T21:01:46.165 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-18T21:01:46.166 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-18T21:01:46.166 INFO:teuthology.orchestra.run.smithi103.stdout: cephadm noarch 2:17.2.7-1637.g6e06d1e0.el9 ceph-noarch 83 k 2024-09-18T21:01:46.166 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:01:46.166 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-18T21:01:46.166 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-18T21:01:46.166 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-09-18T21:01:46.166 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:01:46.166 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 83 k 2024-09-18T21:01:46.166 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 375 k 2024-09-18T21:01:46.166 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-18T21:01:46.293 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mds-2:17.2.7-1637.g6e06d1e0.el9.x86_64 33/34 2024-09-18T21:01:46.316 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mds-2:17.2.7-1637.g6e06d1e0.el9.x86_64 33/34 2024-09-18T21:01:46.316 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T21:01:46.316 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-18T21:01:46.316 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-18T21:01:46.316 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-18T21:01:46.317 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:01:46.352 INFO:teuthology.orchestra.run.smithi103.stdout:cephadm-17.2.7-1637.g6e06d1e0.el9.noarch.rpm 445 kB/s | 83 kB 00:00 2024-09-18T21:01:46.352 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-18T21:01:46.353 INFO:teuthology.orchestra.run.smithi103.stdout:Total 441 kB/s | 83 kB 00:00 2024-09-18T21:01:46.353 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-18T21:01:46.358 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-18T21:01:46.358 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-18T21:01:46.360 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-18T21:01:46.360 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-18T21:01:46.379 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-2:17.2.7-1637.g6e06d1e0.el9.x86_64 34/34 2024-09-18T21:01:46.429 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-18T21:01:46.876 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 1/1 2024-09-18T21:01:46.964 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 1/1 2024-09-18T21:01:47.310 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 1/1 2024-09-18T21:01:47.565 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 1/1 2024-09-18T21:01:47.565 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:01:47.565 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-18T21:01:47.565 INFO:teuthology.orchestra.run.smithi103.stdout: cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 2024-09-18T21:01:47.565 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:01:47.565 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-18T21:01:47.768 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-immutable-object-cache 2024-09-18T21:01:48.038 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-2:17.2.7-1637.g6e06d1e0.el9.x86_64 34/34 2024-09-18T21:01:48.038 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/34 2024-09-18T21:01:48.038 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mds-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2/34 2024-09-18T21:01:48.039 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-2:17.2.7-1637.g6e06d1e0.el9.x86_64 3/34 2024-09-18T21:01:48.039 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mon-2:17.2.7-1637.g6e06d1e0.el9.x86_64 4/34 2024-09-18T21:01:48.039 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-osd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 5/34 2024-09-18T21:01:48.039 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1637.g6e06d1e0.el9. 6/34 2024-09-18T21:01:48.039 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/34 2024-09-18T21:01:48.039 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/34 2024-09-18T21:01:48.039 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/34 2024-09-18T21:01:48.039 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/34 2024-09-18T21:01:48.039 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/34 2024-09-18T21:01:48.039 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/34 2024-09-18T21:01:48.039 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/34 2024-09-18T21:01:48.039 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/34 2024-09-18T21:01:48.039 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-18T21:01:48.040 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/34 2024-09-18T21:01:48.040 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/34 2024-09-18T21:01:48.040 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 18/34 2024-09-18T21:01:48.040 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 19/34 2024-09-18T21:01:48.040 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 20/34 2024-09-18T21:01:48.040 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 21/34 2024-09-18T21:01:48.040 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 22/34 2024-09-18T21:01:48.040 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 23/34 2024-09-18T21:01:48.040 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 24/34 2024-09-18T21:01:48.040 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 25/34 2024-09-18T21:01:48.040 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 26/34 2024-09-18T21:01:48.040 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 27/34 2024-09-18T21:01:48.041 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 28/34 2024-09-18T21:01:48.041 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 29/34 2024-09-18T21:01:48.041 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 30/34 2024-09-18T21:01:48.041 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 31/34 2024-09-18T21:01:48.041 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 32/34 2024-09-18T21:01:48.041 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 33/34 2024-09-18T21:01:48.359 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:00:53 ago on Wed 18 Sep 2024 09:00:55 PM UTC. 2024-09-18T21:01:48.494 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-18T21:01:48.494 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-18T21:01:48.494 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repo Size 2024-09-18T21:01:48.495 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-18T21:01:48.495 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-18T21:01:48.495 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 137 k 2024-09-18T21:01:48.495 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:01:48.495 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-18T21:01:48.495 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-18T21:01:48.495 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-09-18T21:01:48.495 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:01:48.495 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 137 k 2024-09-18T21:01:48.495 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 379 k 2024-09-18T21:01:48.495 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-18T21:01:48.709 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-immutable-object-cache-17.2.7-1637.g6e06d1 643 kB/s | 137 kB 00:00 2024-09-18T21:01:48.710 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-18T21:01:48.710 INFO:teuthology.orchestra.run.smithi103.stdout:Total 639 kB/s | 137 kB 00:00 2024-09-18T21:01:48.710 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-18T21:01:48.717 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-18T21:01:48.718 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-18T21:01:48.775 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-18T21:01:48.775 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-18T21:01:48.916 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-18T21:01:48.977 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1637.g6e06d1e0. 1/1 2024-09-18T21:01:49.003 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1637.g6e06d1e0. 1/1 2024-09-18T21:01:49.003 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T21:01:49.003 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-18T21:01:49.003 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:01:49.112 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 34/34 2024-09-18T21:01:49.112 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:01:49.112 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-09-18T21:01:49.112 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:01:49.112 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mds-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:01:49.112 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:01:49.112 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-modules-core-2:17.2.7-1637.g6e06d1e0.el9.noarch 2024-09-18T21:01:49.112 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mon-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:01:49.112 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-osd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:01:49.112 INFO:teuthology.orchestra.run.smithi077.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-18T21:01:49.112 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-18T21:01:49.113 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-18T21:01:49.113 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-18T21:01:49.113 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-18T21:01:49.113 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-18T21:01:49.113 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-18T21:01:49.113 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-18T21:01:49.113 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-18T21:01:49.113 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-18T21:01:49.113 INFO:teuthology.orchestra.run.smithi077.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-18T21:01:49.113 INFO:teuthology.orchestra.run.smithi077.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-18T21:01:49.113 INFO:teuthology.orchestra.run.smithi077.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-18T21:01:49.113 INFO:teuthology.orchestra.run.smithi077.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-18T21:01:49.113 INFO:teuthology.orchestra.run.smithi077.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-18T21:01:49.114 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-18T21:01:49.114 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ply-3.11-14.el9.noarch 2024-09-18T21:01:49.114 INFO:teuthology.orchestra.run.smithi077.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-18T21:01:49.114 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-18T21:01:49.114 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-18T21:01:49.114 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-18T21:01:49.114 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-18T21:01:49.114 INFO:teuthology.orchestra.run.smithi077.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-18T21:01:49.114 INFO:teuthology.orchestra.run.smithi077.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-18T21:01:49.114 INFO:teuthology.orchestra.run.smithi077.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-18T21:01:49.114 INFO:teuthology.orchestra.run.smithi077.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-18T21:01:49.114 INFO:teuthology.orchestra.run.smithi077.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-18T21:01:49.114 INFO:teuthology.orchestra.run.smithi077.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-18T21:01:49.115 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:01:49.115 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-18T21:01:49.488 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-base 2024-09-18T21:01:49.914 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1637.g6e06d1e0. 1/1 2024-09-18T21:01:49.914 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:01:49.914 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-18T21:01:49.914 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-immutable-object-cache-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:01:49.915 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:01:49.915 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-18T21:01:50.076 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:00:50 ago on Wed 18 Sep 2024 09:01:00 PM UTC. 2024-09-18T21:01:50.146 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-mgr 2024-09-18T21:01:50.164 INFO:teuthology.orchestra.run.smithi077.stdout:Package ceph-base-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-18T21:01:50.205 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-18T21:01:50.206 INFO:teuthology.orchestra.run.smithi077.stdout:Nothing to do. 2024-09-18T21:01:50.206 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-18T21:01:50.261 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install cephadm 2024-09-18T21:01:50.744 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:00:55 ago on Wed 18 Sep 2024 09:00:55 PM UTC. 2024-09-18T21:01:50.829 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:00:50 ago on Wed 18 Sep 2024 09:01:00 PM UTC. 2024-09-18T21:01:50.832 INFO:teuthology.orchestra.run.smithi103.stdout:Package ceph-mgr-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-18T21:01:50.874 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-18T21:01:50.875 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-09-18T21:01:50.875 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-18T21:01:50.949 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-mgr-dashboard 2024-09-18T21:01:50.958 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-18T21:01:50.958 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-18T21:01:50.958 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2024-09-18T21:01:50.959 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-18T21:01:50.959 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-09-18T21:01:50.959 INFO:teuthology.orchestra.run.smithi077.stdout: cephadm noarch 2:17.2.7-1637.g6e06d1e0.el9 ceph-noarch 83 k 2024-09-18T21:01:50.959 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:01:50.959 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-09-18T21:01:50.959 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-18T21:01:50.959 INFO:teuthology.orchestra.run.smithi077.stdout:Install 1 Package 2024-09-18T21:01:50.959 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:01:50.960 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 83 k 2024-09-18T21:01:50.960 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 375 k 2024-09-18T21:01:50.960 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-09-18T21:01:51.150 INFO:teuthology.orchestra.run.smithi077.stdout:cephadm-17.2.7-1637.g6e06d1e0.el9.noarch.rpm 435 kB/s | 83 kB 00:00 2024-09-18T21:01:51.151 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-09-18T21:01:51.151 INFO:teuthology.orchestra.run.smithi077.stdout:Total 431 kB/s | 83 kB 00:00 2024-09-18T21:01:51.151 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-09-18T21:01:51.156 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-09-18T21:01:51.156 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-09-18T21:01:51.158 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-09-18T21:01:51.158 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-09-18T21:01:51.226 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-09-18T21:01:51.526 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:00:56 ago on Wed 18 Sep 2024 09:00:55 PM UTC. 2024-09-18T21:01:51.649 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 1/1 2024-09-18T21:01:51.656 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-18T21:01:51.657 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-18T21:01:51.657 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-09-18T21:01:51.657 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-18T21:01:51.657 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-18T21:01:51.657 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1637.g6e06d1e0.el9 ceph-noarch 3.4 M 2024-09-18T21:01:51.657 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-09-18T21:01:51.658 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1637.g6e06d1e0.el9 ceph-noarch 24 k 2024-09-18T21:01:51.658 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1637.g6e06d1e0.el9 ceph-noarch 15 k 2024-09-18T21:01:51.658 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-18T21:01:51.658 INFO:teuthology.orchestra.run.smithi103.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-18T21:01:51.658 INFO:teuthology.orchestra.run.smithi103.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-18T21:01:51.658 INFO:teuthology.orchestra.run.smithi103.stdout:Installing weak dependencies: 2024-09-18T21:01:51.658 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-18T21:01:51.658 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:01:51.658 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-18T21:01:51.658 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-18T21:01:51.659 INFO:teuthology.orchestra.run.smithi103.stdout:Install 7 Packages 2024-09-18T21:01:51.659 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:01:51.659 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 3.7 M 2024-09-18T21:01:51.659 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 80 M 2024-09-18T21:01:51.659 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-18T21:01:51.744 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 1/1 2024-09-18T21:01:52.112 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 1/1 2024-09-18T21:01:52.180 INFO:teuthology.orchestra.run.smithi103.stdout:(1/7): ceph-grafana-dashboards-17.2.7-1637.g6e0 161 kB/s | 24 kB 00:00 2024-09-18T21:01:52.197 INFO:teuthology.orchestra.run.smithi103.stdout:(2/7): ceph-prometheus-alerts-17.2.7-1637.g6e06 87 kB/s | 15 kB 00:00 2024-09-18T21:01:52.239 INFO:teuthology.orchestra.run.smithi103.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 155 kB/s | 9.0 kB 00:00 2024-09-18T21:01:52.256 INFO:teuthology.orchestra.run.smithi103.stdout:(4/7): python3-jwt-2.4.0-1.el9.noarch.rpm 698 kB/s | 41 kB 00:00 2024-09-18T21:01:52.273 INFO:teuthology.orchestra.run.smithi103.stdout:(5/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 920 kB/s | 31 kB 00:00 2024-09-18T21:01:52.299 INFO:teuthology.orchestra.run.smithi103.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 4.4 MB/s | 188 kB 00:00 2024-09-18T21:01:52.359 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 1/1 2024-09-18T21:01:52.360 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:01:52.360 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-09-18T21:01:52.360 INFO:teuthology.orchestra.run.smithi077.stdout: cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 2024-09-18T21:01:52.360 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:01:52.360 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-18T21:01:52.432 INFO:teuthology.orchestra.run.smithi103.stdout:(7/7): ceph-mgr-dashboard-17.2.7-1637.g6e06d1e0 8.3 MB/s | 3.4 MB 00:00 2024-09-18T21:01:52.436 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-18T21:01:52.437 INFO:teuthology.orchestra.run.smithi103.stdout:Total 4.7 MB/s | 3.7 MB 00:00 2024-09-18T21:01:52.437 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-18T21:01:52.445 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-18T21:01:52.445 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-18T21:01:52.533 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-18T21:01:52.533 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-18T21:01:52.579 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-immutable-object-cache 2024-09-18T21:01:52.843 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-18T21:01:52.900 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-09-18T21:01:52.934 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-09-18T21:01:52.989 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-09-18T21:01:53.021 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-09-18T21:01:53.058 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1637.g6e06d1e0.el9.n 5/7 2024-09-18T21:01:53.163 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:00:53 ago on Wed 18 Sep 2024 09:01:00 PM UTC. 2024-09-18T21:01:53.298 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-18T21:01:53.299 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-18T21:01:53.299 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repo Size 2024-09-18T21:01:53.299 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-18T21:01:53.299 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-09-18T21:01:53.299 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 137 k 2024-09-18T21:01:53.299 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:01:53.299 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-09-18T21:01:53.299 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-18T21:01:53.300 INFO:teuthology.orchestra.run.smithi077.stdout:Install 1 Package 2024-09-18T21:01:53.300 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:01:53.300 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 137 k 2024-09-18T21:01:53.300 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 379 k 2024-09-18T21:01:53.300 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-09-18T21:01:53.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-immutable-object-cache-17.2.7-1637.g6e06d1 695 kB/s | 137 kB 00:00 2024-09-18T21:01:53.498 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-09-18T21:01:53.498 INFO:teuthology.orchestra.run.smithi077.stdout:Total 690 kB/s | 137 kB 00:00 2024-09-18T21:01:53.498 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-09-18T21:01:53.506 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-09-18T21:01:53.506 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-09-18T21:01:53.562 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-09-18T21:01:53.562 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-09-18T21:01:53.713 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-09-18T21:01:53.765 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1637.g6e06d1e0. 1/1 2024-09-18T21:01:53.791 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1637.g6e06d1e0. 1/1 2024-09-18T21:01:53.791 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T21:01:53.791 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-18T21:01:53.791 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:01:54.056 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1637.g6e06d1e0.el9. 6/7 2024-09-18T21:01:54.096 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1637.g6e06d1e0.el9.noarc 7/7 2024-09-18T21:01:54.716 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1637.g6e06d1e0. 1/1 2024-09-18T21:01:54.716 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:01:54.716 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-09-18T21:01:54.716 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-immutable-object-cache-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:01:54.716 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:01:54.716 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-18T21:01:54.917 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-mgr 2024-09-18T21:01:55.135 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1637.g6e06d1e0.el9.noarc 7/7 2024-09-18T21:01:55.136 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1637.g6e06d1e0.el9. 1/7 2024-09-18T21:01:55.136 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1637.g6e06d1e0.el9.noarc 2/7 2024-09-18T21:01:55.136 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1637.g6e06d1e0.el9.n 3/7 2024-09-18T21:01:55.136 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-09-18T21:01:55.136 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-09-18T21:01:55.136 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-09-18T21:01:55.413 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-09-18T21:01:55.413 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:01:55.413 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-18T21:01:55.413 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-grafana-dashboards-2:17.2.7-1637.g6e06d1e0.el9.noarch 2024-09-18T21:01:55.413 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-dashboard-2:17.2.7-1637.g6e06d1e0.el9.noarch 2024-09-18T21:01:55.414 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-prometheus-alerts-2:17.2.7-1637.g6e06d1e0.el9.noarch 2024-09-18T21:01:55.414 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-18T21:01:55.414 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-18T21:01:55.414 INFO:teuthology.orchestra.run.smithi103.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-18T21:01:55.414 INFO:teuthology.orchestra.run.smithi103.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-18T21:01:55.414 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:01:55.414 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-18T21:01:55.505 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:00:55 ago on Wed 18 Sep 2024 09:01:00 PM UTC. 2024-09-18T21:01:55.596 INFO:teuthology.orchestra.run.smithi077.stdout:Package ceph-mgr-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-18T21:01:55.638 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-18T21:01:55.639 INFO:teuthology.orchestra.run.smithi077.stdout:Nothing to do. 2024-09-18T21:01:55.639 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-18T21:01:55.643 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-18T21:01:55.702 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-mgr-dashboard 2024-09-18T21:01:56.220 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:01:01 ago on Wed 18 Sep 2024 09:00:55 PM UTC. 2024-09-18T21:01:56.277 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:00:56 ago on Wed 18 Sep 2024 09:01:00 PM UTC. 2024-09-18T21:01:56.354 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-18T21:01:56.355 INFO:teuthology.orchestra.run.smithi103.stdout:======================================================================================= 2024-09-18T21:01:56.355 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-09-18T21:01:56.355 INFO:teuthology.orchestra.run.smithi103.stdout:======================================================================================= 2024-09-18T21:01:56.356 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-18T21:01:56.356 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1637.g6e06d1e0.el9 ceph-noarch 7.4 M 2024-09-18T21:01:56.356 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-09-18T21:01:56.356 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-18T21:01:56.356 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-18T21:01:56.356 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-18T21:01:56.356 INFO:teuthology.orchestra.run.smithi103.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-18T21:01:56.357 INFO:teuthology.orchestra.run.smithi103.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-18T21:01:56.357 INFO:teuthology.orchestra.run.smithi103.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-18T21:01:56.357 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-18T21:01:56.357 INFO:teuthology.orchestra.run.smithi103.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-18T21:01:56.357 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-18T21:01:56.357 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-18T21:01:56.357 INFO:teuthology.orchestra.run.smithi103.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-18T21:01:56.358 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:01:56.358 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-18T21:01:56.358 INFO:teuthology.orchestra.run.smithi103.stdout:======================================================================================= 2024-09-18T21:01:56.358 INFO:teuthology.orchestra.run.smithi103.stdout:Install 12 Packages 2024-09-18T21:01:56.358 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:01:56.359 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 38 M 2024-09-18T21:01:56.359 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 212 M 2024-09-18T21:01:56.359 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-18T21:01:56.410 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-18T21:01:56.410 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-18T21:01:56.411 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2024-09-18T21:01:56.411 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-18T21:01:56.411 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-09-18T21:01:56.411 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1637.g6e06d1e0.el9 ceph-noarch 3.4 M 2024-09-18T21:01:56.411 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-09-18T21:01:56.411 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1637.g6e06d1e0.el9 ceph-noarch 24 k 2024-09-18T21:01:56.411 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1637.g6e06d1e0.el9 ceph-noarch 15 k 2024-09-18T21:01:56.411 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-18T21:01:56.412 INFO:teuthology.orchestra.run.smithi077.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-18T21:01:56.412 INFO:teuthology.orchestra.run.smithi077.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-18T21:01:56.412 INFO:teuthology.orchestra.run.smithi077.stdout:Installing weak dependencies: 2024-09-18T21:01:56.412 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-18T21:01:56.412 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:01:56.412 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-09-18T21:01:56.412 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-18T21:01:56.412 INFO:teuthology.orchestra.run.smithi077.stdout:Install 7 Packages 2024-09-18T21:01:56.412 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:01:56.413 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 3.7 M 2024-09-18T21:01:56.413 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 80 M 2024-09-18T21:01:56.413 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-09-18T21:01:56.701 INFO:teuthology.orchestra.run.smithi077.stdout:(1/7): ceph-grafana-dashboards-17.2.7-1637.g6e0 176 kB/s | 24 kB 00:00 2024-09-18T21:01:56.726 INFO:teuthology.orchestra.run.smithi077.stdout:(2/7): ceph-prometheus-alerts-17.2.7-1637.g6e06 89 kB/s | 15 kB 00:00 2024-09-18T21:01:56.768 INFO:teuthology.orchestra.run.smithi077.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 136 kB/s | 9.0 kB 00:00 2024-09-18T21:01:56.793 INFO:teuthology.orchestra.run.smithi077.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 1.3 MB/s | 31 kB 00:00 2024-09-18T21:01:56.818 INFO:teuthology.orchestra.run.smithi077.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 443 kB/s | 41 kB 00:00 2024-09-18T21:01:56.843 INFO:teuthology.orchestra.run.smithi077.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2024-09-18T21:01:56.968 INFO:teuthology.orchestra.run.smithi077.stdout:(7/7): ceph-mgr-dashboard-17.2.7-1637.g6e06d1e0 8.3 MB/s | 3.4 MB 00:00 2024-09-18T21:01:56.972 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-09-18T21:01:56.972 INFO:teuthology.orchestra.run.smithi077.stdout:Total 6.5 MB/s | 3.7 MB 00:00 2024-09-18T21:01:56.972 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-09-18T21:01:56.980 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-09-18T21:01:56.980 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-09-18T21:01:57.065 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-09-18T21:01:57.065 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-09-18T21:01:57.241 INFO:teuthology.orchestra.run.smithi103.stdout:(1/12): ceph-mgr-diskprediction-local-17.2.7-16 13 MB/s | 7.4 MB 00:00 2024-09-18T21:01:57.266 INFO:teuthology.orchestra.run.smithi103.stdout:(2/12): libquadmath-11.5.0-2.el9.x86_64.rpm 330 kB/s | 191 kB 00:00 2024-09-18T21:01:57.359 INFO:teuthology.orchestra.run.smithi103.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 280 kB/s | 33 kB 00:00 2024-09-18T21:01:57.372 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-09-18T21:01:57.409 INFO:teuthology.orchestra.run.smithi103.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 365 kB/s | 18 kB 00:00 2024-09-18T21:01:57.429 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-09-18T21:01:57.463 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-09-18T21:01:57.467 INFO:teuthology.orchestra.run.smithi103.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 660 kB/s | 38 kB 00:00 2024-09-18T21:01:57.517 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-09-18T21:01:57.526 INFO:teuthology.orchestra.run.smithi103.stdout:(6/12): libgfortran-11.5.0-2.el9.x86_64.rpm 956 kB/s | 801 kB 00:00 2024-09-18T21:01:57.549 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-09-18T21:01:57.585 INFO:teuthology.orchestra.run.smithi103.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 9.4 MB/s | 3.0 MB 00:00 2024-09-18T21:01:57.586 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1637.g6e06d1e0.el9.n 5/7 2024-09-18T21:01:57.727 INFO:teuthology.orchestra.run.smithi103.stdout:(8/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 36 MB/s | 5.1 MB 00:00 2024-09-18T21:01:57.819 INFO:teuthology.orchestra.run.smithi103.stdout:(9/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 14 MB/s | 4.9 MB 00:00 2024-09-18T21:01:57.844 INFO:teuthology.orchestra.run.smithi103.stdout:(10/12): python3-devel-3.9.19-8.el9.x86_64.rpm 771 kB/s | 245 kB 00:00 2024-09-18T21:01:57.869 INFO:teuthology.orchestra.run.smithi103.stdout:(11/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 1.7 MB/s | 250 kB 00:00 2024-09-18T21:01:58.128 INFO:teuthology.orchestra.run.smithi103.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 53 MB/s | 16 MB 00:00 2024-09-18T21:01:58.128 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-18T21:01:58.128 INFO:teuthology.orchestra.run.smithi103.stdout:Total 22 MB/s | 38 MB 00:01 2024-09-18T21:01:58.488 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-18T21:01:58.515 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-18T21:01:58.515 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-18T21:01:58.570 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1637.g6e06d1e0.el9. 6/7 2024-09-18T21:01:58.607 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1637.g6e06d1e0.el9.noarc 7/7 2024-09-18T21:01:59.022 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-18T21:01:59.022 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-18T21:01:59.663 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1637.g6e06d1e0.el9.noarc 7/7 2024-09-18T21:01:59.663 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1637.g6e06d1e0.el9. 1/7 2024-09-18T21:01:59.663 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1637.g6e06d1e0.el9.noarc 2/7 2024-09-18T21:01:59.664 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1637.g6e06d1e0.el9.n 3/7 2024-09-18T21:01:59.664 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-09-18T21:01:59.664 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-09-18T21:01:59.664 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-09-18T21:01:59.820 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-18T21:01:59.880 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-18T21:01:59.926 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-18T21:01:59.932 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-09-18T21:01:59.932 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:01:59.932 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-09-18T21:01:59.932 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-grafana-dashboards-2:17.2.7-1637.g6e06d1e0.el9.noarch 2024-09-18T21:01:59.932 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-dashboard-2:17.2.7-1637.g6e06d1e0.el9.noarch 2024-09-18T21:01:59.932 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-prometheus-alerts-2:17.2.7-1637.g6e06d1e0.el9.noarch 2024-09-18T21:01:59.932 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-18T21:01:59.933 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-18T21:01:59.933 INFO:teuthology.orchestra.run.smithi077.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-18T21:01:59.933 INFO:teuthology.orchestra.run.smithi077.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-18T21:01:59.933 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:01:59.933 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-18T21:02:00.026 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-18T21:02:00.077 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-18T21:02:00.161 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-18T21:02:00.262 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-18T21:02:00.293 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-18T21:02:00.375 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-18T21:02:00.734 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:00 ago on Wed 18 Sep 2024 09:01:00 PM UTC. 2024-09-18T21:02:00.867 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-18T21:02:00.869 INFO:teuthology.orchestra.run.smithi077.stdout:======================================================================================= 2024-09-18T21:02:00.869 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2024-09-18T21:02:00.869 INFO:teuthology.orchestra.run.smithi077.stdout:======================================================================================= 2024-09-18T21:02:00.869 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-09-18T21:02:00.869 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1637.g6e06d1e0.el9 ceph-noarch 7.4 M 2024-09-18T21:02:00.869 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-09-18T21:02:00.869 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-18T21:02:00.869 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-18T21:02:00.869 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-18T21:02:00.869 INFO:teuthology.orchestra.run.smithi077.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-18T21:02:00.870 INFO:teuthology.orchestra.run.smithi077.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-18T21:02:00.870 INFO:teuthology.orchestra.run.smithi077.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-18T21:02:00.870 INFO:teuthology.orchestra.run.smithi077.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-18T21:02:00.870 INFO:teuthology.orchestra.run.smithi077.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-18T21:02:00.870 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-18T21:02:00.870 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-18T21:02:00.870 INFO:teuthology.orchestra.run.smithi077.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-18T21:02:00.870 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:02:00.870 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-09-18T21:02:00.870 INFO:teuthology.orchestra.run.smithi077.stdout:======================================================================================= 2024-09-18T21:02:00.870 INFO:teuthology.orchestra.run.smithi077.stdout:Install 12 Packages 2024-09-18T21:02:00.870 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:02:00.871 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 38 M 2024-09-18T21:02:00.871 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 212 M 2024-09-18T21:02:00.871 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-09-18T21:02:01.024 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-18T21:02:01.135 INFO:teuthology.orchestra.run.smithi077.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 868 kB/s | 191 kB 00:00 2024-09-18T21:02:01.156 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-18T21:02:01.210 INFO:teuthology.orchestra.run.smithi077.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 436 kB/s | 33 kB 00:00 2024-09-18T21:02:01.243 INFO:teuthology.orchestra.run.smithi077.stdout:(3/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.4 MB/s | 801 kB 00:00 2024-09-18T21:02:01.310 INFO:teuthology.orchestra.run.smithi077.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 274 kB/s | 18 kB 00:00 2024-09-18T21:02:01.402 INFO:teuthology.orchestra.run.smithi077.stdout:(5/12): ceph-mgr-diskprediction-local-17.2.7-16 15 MB/s | 7.4 MB 00:00 2024-09-18T21:02:01.430 INFO:teuthology.orchestra.run.smithi077.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 323 kB/s | 38 kB 00:00 2024-09-18T21:02:01.552 INFO:teuthology.orchestra.run.smithi077.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 2.0 MB/s | 245 kB 00:00 2024-09-18T21:02:01.922 INFO:teuthology.orchestra.run.smithi077.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 4.2 MB/s | 3.0 MB 00:00 2024-09-18T21:02:02.006 INFO:teuthology.orchestra.run.smithi077.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.9 MB/s | 250 kB 00:00 2024-09-18T21:02:02.391 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-18T21:02:02.631 INFO:teuthology.orchestra.run.smithi077.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 4.0 MB/s | 4.9 MB 00:01 2024-09-18T21:02:02.689 INFO:teuthology.orchestra.run.smithi077.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.5 MB/s | 5.1 MB 00:01 2024-09-18T21:02:03.416 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-18T21:02:03.444 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1637.g6e06d 12/12 2024-09-18T21:02:06.057 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1637.g6e06d 12/12 2024-09-18T21:02:06.057 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1637.g6e06d 1/12 2024-09-18T21:02:06.057 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-18T21:02:06.057 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-18T21:02:06.057 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-18T21:02:06.057 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-18T21:02:06.057 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-18T21:02:06.057 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-18T21:02:06.058 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-18T21:02:06.058 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-18T21:02:06.058 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-18T21:02:06.058 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-18T21:02:06.189 INFO:teuthology.orchestra.run.smithi077.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.9 MB/s | 16 MB 00:04 2024-09-18T21:02:06.191 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-09-18T21:02:06.191 INFO:teuthology.orchestra.run.smithi077.stdout:Total 7.2 MB/s | 38 MB 00:05 2024-09-18T21:02:06.522 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-18T21:02:06.522 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:02:06.522 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-18T21:02:06.522 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1637.g6e06d1e0.el9.noarch 2024-09-18T21:02:06.522 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-18T21:02:06.522 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-18T21:02:06.523 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-18T21:02:06.523 INFO:teuthology.orchestra.run.smithi103.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-18T21:02:06.523 INFO:teuthology.orchestra.run.smithi103.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-18T21:02:06.523 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-18T21:02:06.523 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-18T21:02:06.523 INFO:teuthology.orchestra.run.smithi103.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-18T21:02:06.523 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-18T21:02:06.523 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-18T21:02:06.523 INFO:teuthology.orchestra.run.smithi103.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-18T21:02:06.523 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:02:06.523 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-18T21:02:06.552 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-09-18T21:02:06.578 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-09-18T21:02:06.578 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-09-18T21:02:06.897 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-mgr-rook 2024-09-18T21:02:07.078 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-09-18T21:02:07.078 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-09-18T21:02:07.489 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:01:12 ago on Wed 18 Sep 2024 09:00:55 PM UTC. 2024-09-18T21:02:07.621 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-18T21:02:07.622 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-18T21:02:07.623 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-09-18T21:02:07.623 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-18T21:02:07.623 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-18T21:02:07.623 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-rook noarch 2:17.2.7-1637.g6e06d1e0.el9 ceph-noarch 47 k 2024-09-18T21:02:07.623 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-09-18T21:02:07.623 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-18T21:02:07.623 INFO:teuthology.orchestra.run.smithi103.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-18T21:02:07.623 INFO:teuthology.orchestra.run.smithi103.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-18T21:02:07.623 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-18T21:02:07.623 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-18T21:02:07.623 INFO:teuthology.orchestra.run.smithi103.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-18T21:02:07.623 INFO:teuthology.orchestra.run.smithi103.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-18T21:02:07.624 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-18T21:02:07.624 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-18T21:02:07.624 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-18T21:02:07.624 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-18T21:02:07.624 INFO:teuthology.orchestra.run.smithi103.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-18T21:02:07.624 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:02:07.624 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-18T21:02:07.624 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-18T21:02:07.624 INFO:teuthology.orchestra.run.smithi103.stdout:Install 13 Packages 2024-09-18T21:02:07.624 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:02:07.625 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 2.2 M 2024-09-18T21:02:07.625 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 26 M 2024-09-18T21:02:07.625 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-18T21:02:07.822 INFO:teuthology.orchestra.run.smithi103.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 233 kB/s | 19 kB 00:00 2024-09-18T21:02:07.830 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-09-18T21:02:07.847 INFO:teuthology.orchestra.run.smithi103.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 239 kB/s | 26 kB 00:00 2024-09-18T21:02:07.898 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-18T21:02:07.906 INFO:teuthology.orchestra.run.smithi103.stdout:(3/13): ceph-mgr-rook-17.2.7-1637.g6e06d1e0.el9 286 kB/s | 47 kB 00:00 2024-09-18T21:02:07.931 INFO:teuthology.orchestra.run.smithi103.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.0 MB/s | 222 kB 00:00 2024-09-18T21:02:07.942 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-18T21:02:07.965 INFO:teuthology.orchestra.run.smithi103.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-18T21:02:07.990 INFO:teuthology.orchestra.run.smithi103.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 910 kB/s | 54 kB 00:00 2024-09-18T21:02:08.032 INFO:teuthology.orchestra.run.smithi103.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 481 kB/s | 32 kB 00:00 2024-09-18T21:02:08.040 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-18T21:02:08.058 INFO:teuthology.orchestra.run.smithi103.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 211 kB/s | 14 kB 00:00 2024-09-18T21:02:08.080 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-18T21:02:08.083 INFO:teuthology.orchestra.run.smithi103.stdout:(9/13): python3-google-auth-2.34.0-1.el9.noarch 4.4 MB/s | 220 kB 00:00 2024-09-18T21:02:08.108 INFO:teuthology.orchestra.run.smithi103.stdout:(10/13): python3-pyasn1-modules-0.4.8-6.el9.noa 1.3 MB/s | 279 kB 00:00 2024-09-18T21:02:08.134 INFO:teuthology.orchestra.run.smithi103.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-18T21:02:08.184 INFO:teuthology.orchestra.run.smithi103.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 8.1 MB/s | 1.0 MB 00:00 2024-09-18T21:02:08.209 INFO:teuthology.orchestra.run.smithi103.stdout:(13/13): python3-websocket-client-1.2.3-2.el9.n 892 kB/s | 90 kB 00:00 2024-09-18T21:02:08.211 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-18T21:02:08.211 INFO:teuthology.orchestra.run.smithi103.stdout:Total 3.8 MB/s | 2.2 MB 00:00 2024-09-18T21:02:08.264 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-18T21:02:08.272 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-18T21:02:08.287 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-18T21:02:08.288 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-18T21:02:08.304 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-18T21:02:08.377 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-18T21:02:08.378 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-18T21:02:08.388 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-18T21:02:08.878 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-18T21:02:09.045 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-18T21:02:09.049 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-18T21:02:09.110 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-18T21:02:09.168 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-18T21:02:09.174 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-18T21:02:09.211 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-18T21:02:09.252 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-18T21:02:09.356 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-18T21:02:09.466 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-18T21:02:09.521 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-18T21:02:10.249 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-18T21:02:10.302 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-18T21:02:10.336 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-18T21:02:10.381 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-18T21:02:10.406 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-rook-2:17.2.7-1637.g6e06d1e0.el9.noarch 13/13 2024-09-18T21:02:10.429 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-18T21:02:11.192 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1637.g6e06d1e0.el9.noarch 13/13 2024-09-18T21:02:11.192 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1637.g6e06d1e0.el9.noarch 1/13 2024-09-18T21:02:11.192 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-18T21:02:11.192 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-18T21:02:11.192 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-18T21:02:11.192 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-18T21:02:11.192 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-18T21:02:11.192 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-18T21:02:11.192 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-18T21:02:11.192 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-18T21:02:11.192 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-18T21:02:11.193 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-18T21:02:11.193 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-18T21:02:11.465 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-18T21:02:11.494 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1637.g6e06d 12/12 2024-09-18T21:02:11.520 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-18T21:02:11.520 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:02:11.520 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-18T21:02:11.520 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-rook-2:17.2.7-1637.g6e06d1e0.el9.noarch 2024-09-18T21:02:11.520 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-18T21:02:11.521 INFO:teuthology.orchestra.run.smithi103.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-18T21:02:11.521 INFO:teuthology.orchestra.run.smithi103.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-18T21:02:11.521 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-18T21:02:11.521 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-18T21:02:11.521 INFO:teuthology.orchestra.run.smithi103.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-18T21:02:11.521 INFO:teuthology.orchestra.run.smithi103.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-18T21:02:11.521 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-18T21:02:11.521 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-18T21:02:11.521 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-18T21:02:11.521 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-18T21:02:11.521 INFO:teuthology.orchestra.run.smithi103.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-18T21:02:11.521 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:02:11.522 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-18T21:02:11.775 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-mgr-cephadm 2024-09-18T21:02:12.355 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:01:17 ago on Wed 18 Sep 2024 09:00:55 PM UTC. 2024-09-18T21:02:12.487 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-18T21:02:12.488 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-18T21:02:12.488 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-09-18T21:02:12.488 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-18T21:02:12.488 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-18T21:02:12.488 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1637.g6e06d1e0.el9 ceph-noarch 124 k 2024-09-18T21:02:12.488 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-09-18T21:02:12.489 INFO:teuthology.orchestra.run.smithi103.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-18T21:02:12.489 INFO:teuthology.orchestra.run.smithi103.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-18T21:02:12.489 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-18T21:02:12.489 INFO:teuthology.orchestra.run.smithi103.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-18T21:02:12.489 INFO:teuthology.orchestra.run.smithi103.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-18T21:02:12.489 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:02:12.489 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-18T21:02:12.489 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-18T21:02:12.489 INFO:teuthology.orchestra.run.smithi103.stdout:Install 6 Packages 2024-09-18T21:02:12.489 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:02:12.490 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 7.0 M 2024-09-18T21:02:12.490 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 33 M 2024-09-18T21:02:12.490 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-18T21:02:12.954 INFO:teuthology.orchestra.run.smithi103.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.3 MB/s | 248 kB 00:00 2024-09-18T21:02:12.979 INFO:teuthology.orchestra.run.smithi103.stdout:(2/6): ceph-mgr-cephadm-17.2.7-1637.g6e06d1e0.e 589 kB/s | 124 kB 00:00 2024-09-18T21:02:13.029 INFO:teuthology.orchestra.run.smithi103.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 7.1 MB/s | 548 kB 00:00 2024-09-18T21:02:13.055 INFO:teuthology.orchestra.run.smithi103.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 764 kB/s | 58 kB 00:00 2024-09-18T21:02:13.080 INFO:teuthology.orchestra.run.smithi103.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.4 MB/s | 74 kB 00:00 2024-09-18T21:02:13.180 INFO:teuthology.orchestra.run.smithi103.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-18T21:02:13.183 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-18T21:02:13.183 INFO:teuthology.orchestra.run.smithi103.stdout:Total 10 MB/s | 7.0 MB 00:00 2024-09-18T21:02:13.253 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-18T21:02:13.265 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-18T21:02:13.265 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-18T21:02:13.364 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-18T21:02:13.364 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-18T21:02:13.664 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-18T21:02:13.820 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-18T21:02:13.875 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-18T21:02:14.252 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1637.g6e06d 12/12 2024-09-18T21:02:14.253 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1637.g6e06d 1/12 2024-09-18T21:02:14.253 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-18T21:02:14.253 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-18T21:02:14.253 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-18T21:02:14.253 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-18T21:02:14.253 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-18T21:02:14.253 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-18T21:02:14.253 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-18T21:02:14.253 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-18T21:02:14.253 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-18T21:02:14.253 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-18T21:02:14.399 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-18T21:02:14.488 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-18T21:02:14.557 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-18T21:02:14.587 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 6/6 2024-09-18T21:02:14.693 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-18T21:02:14.693 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:02:14.694 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-09-18T21:02:14.694 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1637.g6e06d1e0.el9.noarch 2024-09-18T21:02:14.694 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-18T21:02:14.694 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-18T21:02:14.694 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-18T21:02:14.694 INFO:teuthology.orchestra.run.smithi077.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-18T21:02:14.694 INFO:teuthology.orchestra.run.smithi077.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-18T21:02:14.694 INFO:teuthology.orchestra.run.smithi077.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-18T21:02:14.694 INFO:teuthology.orchestra.run.smithi077.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-18T21:02:14.694 INFO:teuthology.orchestra.run.smithi077.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-18T21:02:14.694 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-18T21:02:14.694 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-18T21:02:14.695 INFO:teuthology.orchestra.run.smithi077.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-18T21:02:14.695 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:02:14.695 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-18T21:02:15.055 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-mgr-rook 2024-09-18T21:02:15.367 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 6/6 2024-09-18T21:02:15.367 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 1/6 2024-09-18T21:02:15.367 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-18T21:02:15.368 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-18T21:02:15.368 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-18T21:02:15.368 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-18T21:02:15.635 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-18T21:02:15.635 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:02:15.635 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-18T21:02:15.636 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 2024-09-18T21:02:15.636 INFO:teuthology.orchestra.run.smithi103.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-18T21:02:15.636 INFO:teuthology.orchestra.run.smithi103.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-18T21:02:15.636 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-18T21:02:15.636 INFO:teuthology.orchestra.run.smithi103.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-18T21:02:15.636 INFO:teuthology.orchestra.run.smithi103.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-18T21:02:15.636 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:02:15.636 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-18T21:02:15.642 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:15 ago on Wed 18 Sep 2024 09:01:00 PM UTC. 2024-09-18T21:02:15.777 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-18T21:02:15.777 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-18T21:02:15.777 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2024-09-18T21:02:15.777 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-18T21:02:15.778 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-09-18T21:02:15.778 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-rook noarch 2:17.2.7-1637.g6e06d1e0.el9 ceph-noarch 47 k 2024-09-18T21:02:15.778 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-09-18T21:02:15.778 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-18T21:02:15.778 INFO:teuthology.orchestra.run.smithi077.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-18T21:02:15.778 INFO:teuthology.orchestra.run.smithi077.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-18T21:02:15.778 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-18T21:02:15.778 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-18T21:02:15.778 INFO:teuthology.orchestra.run.smithi077.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-18T21:02:15.778 INFO:teuthology.orchestra.run.smithi077.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-18T21:02:15.779 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-18T21:02:15.779 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-18T21:02:15.779 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-18T21:02:15.779 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-18T21:02:15.779 INFO:teuthology.orchestra.run.smithi077.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-18T21:02:15.779 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:02:15.779 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-09-18T21:02:15.779 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-18T21:02:15.779 INFO:teuthology.orchestra.run.smithi077.stdout:Install 13 Packages 2024-09-18T21:02:15.779 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:02:15.779 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 2.2 M 2024-09-18T21:02:15.780 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 26 M 2024-09-18T21:02:15.780 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-09-18T21:02:15.878 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-fuse 2024-09-18T21:02:15.994 INFO:teuthology.orchestra.run.smithi077.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 207 kB/s | 26 kB 00:00 2024-09-18T21:02:16.019 INFO:teuthology.orchestra.run.smithi077.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 128 kB/s | 19 kB 00:00 2024-09-18T21:02:16.044 INFO:teuthology.orchestra.run.smithi077.stdout:(3/13): ceph-mgr-rook-17.2.7-1637.g6e06d1e0.el9 272 kB/s | 47 kB 00:00 2024-09-18T21:02:16.169 INFO:teuthology.orchestra.run.smithi077.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.0 MB/s | 159 kB 00:00 2024-09-18T21:02:16.195 INFO:teuthology.orchestra.run.smithi077.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.2 MB/s | 222 kB 00:00 2024-09-18T21:02:16.228 INFO:teuthology.orchestra.run.smithi077.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 914 kB/s | 54 kB 00:00 2024-09-18T21:02:16.262 INFO:teuthology.orchestra.run.smithi077.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 481 kB/s | 32 kB 00:00 2024-09-18T21:02:16.288 INFO:teuthology.orchestra.run.smithi077.stdout:(8/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.1 MB/s | 279 kB 00:00 2024-09-18T21:02:16.313 INFO:teuthology.orchestra.run.smithi077.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 171 kB/s | 14 kB 00:00 2024-09-18T21:02:16.346 INFO:teuthology.orchestra.run.smithi077.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.6 MB/s | 220 kB 00:00 2024-09-18T21:02:16.372 INFO:teuthology.orchestra.run.smithi077.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-18T21:02:16.389 INFO:teuthology.orchestra.run.smithi077.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 2.2 MB/s | 90 kB 00:00 2024-09-18T21:02:16.449 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:01:21 ago on Wed 18 Sep 2024 09:00:55 PM UTC. 2024-09-18T21:02:16.455 INFO:teuthology.orchestra.run.smithi077.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.1 MB/s | 1.0 MB 00:00 2024-09-18T21:02:16.458 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-09-18T21:02:16.458 INFO:teuthology.orchestra.run.smithi077.stdout:Total 3.2 MB/s | 2.2 MB 00:00 2024-09-18T21:02:16.521 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-09-18T21:02:16.537 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-09-18T21:02:16.537 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-09-18T21:02:16.580 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-18T21:02:16.581 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-18T21:02:16.581 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-09-18T21:02:16.581 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-18T21:02:16.581 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-18T21:02:16.581 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-fuse x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 813 k 2024-09-18T21:02:16.581 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-09-18T21:02:16.581 INFO:teuthology.orchestra.run.smithi103.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-18T21:02:16.581 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:02:16.581 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-18T21:02:16.582 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-18T21:02:16.582 INFO:teuthology.orchestra.run.smithi103.stdout:Install 2 Packages 2024-09-18T21:02:16.582 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:02:16.582 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 893 k 2024-09-18T21:02:16.582 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 2.6 M 2024-09-18T21:02:16.582 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-18T21:02:16.624 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-09-18T21:02:16.625 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-09-18T21:02:16.758 INFO:teuthology.orchestra.run.smithi103.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 633 kB/s | 80 kB 00:00 2024-09-18T21:02:16.917 INFO:teuthology.orchestra.run.smithi103.stdout:(2/2): ceph-fuse-17.2.7-1637.g6e06d1e0.el9.x86_ 2.8 MB/s | 813 kB 00:00 2024-09-18T21:02:16.917 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-18T21:02:16.918 INFO:teuthology.orchestra.run.smithi103.stdout:Total 2.6 MB/s | 893 kB 00:00 2024-09-18T21:02:16.929 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-18T21:02:16.951 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-18T21:02:16.951 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-18T21:02:17.031 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-18T21:02:17.031 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-18T21:02:17.134 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-09-18T21:02:17.216 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-18T21:02:17.301 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-18T21:02:17.345 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-18T21:02:17.356 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-18T21:02:17.415 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-fuse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2/2 2024-09-18T21:02:17.419 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-18T21:02:17.457 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-18T21:02:17.498 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-18T21:02:17.612 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-18T21:02:17.720 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-18T21:02:17.767 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-18T21:02:18.093 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-fuse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2/2 2024-09-18T21:02:18.094 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-fuse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/2 2024-09-18T21:02:18.362 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-18T21:02:18.363 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:02:18.363 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-18T21:02:18.363 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-fuse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-18T21:02:18.363 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:02:18.363 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-18T21:02:18.489 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-18T21:02:18.556 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-18T21:02:18.589 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-18T21:02:18.634 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-18T21:02:18.643 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install librados-devel 2024-09-18T21:02:18.659 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-rook-2:17.2.7-1637.g6e06d1e0.el9.noarch 13/13 2024-09-18T21:02:19.242 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:01:24 ago on Wed 18 Sep 2024 09:00:55 PM UTC. 2024-09-18T21:02:19.377 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-18T21:02:19.377 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-18T21:02:19.377 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repo Size 2024-09-18T21:02:19.378 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-18T21:02:19.378 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-18T21:02:19.378 INFO:teuthology.orchestra.run.smithi103.stdout: librados-devel x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 126 k 2024-09-18T21:02:19.378 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:02:19.378 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-18T21:02:19.378 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-18T21:02:19.378 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-09-18T21:02:19.378 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:02:19.379 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 126 k 2024-09-18T21:02:19.379 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 448 k 2024-09-18T21:02:19.379 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-18T21:02:19.458 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1637.g6e06d1e0.el9.noarch 13/13 2024-09-18T21:02:19.458 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1637.g6e06d1e0.el9.noarch 1/13 2024-09-18T21:02:19.458 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-18T21:02:19.458 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-18T21:02:19.458 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-18T21:02:19.458 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-18T21:02:19.458 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-18T21:02:19.458 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-18T21:02:19.459 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-18T21:02:19.459 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-18T21:02:19.459 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-18T21:02:19.459 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-18T21:02:19.459 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-18T21:02:19.581 INFO:teuthology.orchestra.run.smithi103.stdout:librados-devel-17.2.7-1637.g6e06d1e0.el9.x86_64 626 kB/s | 126 kB 00:00 2024-09-18T21:02:19.582 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-18T21:02:19.582 INFO:teuthology.orchestra.run.smithi103.stdout:Total 621 kB/s | 126 kB 00:00 2024-09-18T21:02:19.582 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-18T21:02:19.587 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-18T21:02:19.587 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-18T21:02:19.650 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-18T21:02:19.651 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-18T21:02:19.780 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-18T21:02:19.780 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:02:19.780 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-09-18T21:02:19.780 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-rook-2:17.2.7-1637.g6e06d1e0.el9.noarch 2024-09-18T21:02:19.780 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-18T21:02:19.780 INFO:teuthology.orchestra.run.smithi077.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-18T21:02:19.780 INFO:teuthology.orchestra.run.smithi077.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-18T21:02:19.780 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-18T21:02:19.781 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-18T21:02:19.781 INFO:teuthology.orchestra.run.smithi077.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-18T21:02:19.781 INFO:teuthology.orchestra.run.smithi077.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-18T21:02:19.781 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-18T21:02:19.781 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-18T21:02:19.781 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-18T21:02:19.781 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-18T21:02:19.781 INFO:teuthology.orchestra.run.smithi077.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-18T21:02:19.781 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:02:19.781 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-18T21:02:19.797 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-18T21:02:19.902 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librados-devel-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-18T21:02:20.036 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-mgr-cephadm 2024-09-18T21:02:20.319 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librados-devel-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-18T21:02:20.542 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados-devel-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-18T21:02:20.542 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:02:20.542 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-18T21:02:20.542 INFO:teuthology.orchestra.run.smithi103.stdout: librados-devel-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:02:20.542 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:02:20.542 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-18T21:02:20.613 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:20 ago on Wed 18 Sep 2024 09:01:00 PM UTC. 2024-09-18T21:02:20.744 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-18T21:02:20.745 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-18T21:02:20.745 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2024-09-18T21:02:20.745 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-18T21:02:20.745 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-09-18T21:02:20.745 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1637.g6e06d1e0.el9 ceph-noarch 124 k 2024-09-18T21:02:20.745 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-09-18T21:02:20.745 INFO:teuthology.orchestra.run.smithi077.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-18T21:02:20.745 INFO:teuthology.orchestra.run.smithi077.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-18T21:02:20.745 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-18T21:02:20.745 INFO:teuthology.orchestra.run.smithi077.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-18T21:02:20.746 INFO:teuthology.orchestra.run.smithi077.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-18T21:02:20.746 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:02:20.746 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-09-18T21:02:20.746 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-18T21:02:20.746 INFO:teuthology.orchestra.run.smithi077.stdout:Install 6 Packages 2024-09-18T21:02:20.746 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:02:20.747 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 7.0 M 2024-09-18T21:02:20.747 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 33 M 2024-09-18T21:02:20.747 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-09-18T21:02:20.775 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install libcephfs2 2024-09-18T21:02:21.148 INFO:teuthology.orchestra.run.smithi077.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.2 MB/s | 248 kB 00:00 2024-09-18T21:02:21.173 INFO:teuthology.orchestra.run.smithi077.stdout:(2/6): ceph-mgr-cephadm-17.2.7-1637.g6e06d1e0.e 554 kB/s | 124 kB 00:00 2024-09-18T21:02:21.232 INFO:teuthology.orchestra.run.smithi077.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 6.4 MB/s | 548 kB 00:00 2024-09-18T21:02:21.249 INFO:teuthology.orchestra.run.smithi077.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 766 kB/s | 58 kB 00:00 2024-09-18T21:02:21.274 INFO:teuthology.orchestra.run.smithi077.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.7 MB/s | 74 kB 00:00 2024-09-18T21:02:21.372 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:01:26 ago on Wed 18 Sep 2024 09:00:55 PM UTC. 2024-09-18T21:02:21.463 INFO:teuthology.orchestra.run.smithi103.stdout:Package libcephfs2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-18T21:02:21.507 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-18T21:02:21.508 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-09-18T21:02:21.508 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-18T21:02:21.577 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install libcephfs-devel 2024-09-18T21:02:22.066 INFO:teuthology.orchestra.run.smithi077.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 5.3 MB/s | 6.0 MB 00:01 2024-09-18T21:02:22.068 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-09-18T21:02:22.068 INFO:teuthology.orchestra.run.smithi077.stdout:Total 5.3 MB/s | 7.0 MB 00:01 2024-09-18T21:02:22.139 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-09-18T21:02:22.153 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-09-18T21:02:22.153 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-09-18T21:02:22.153 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:01:27 ago on Wed 18 Sep 2024 09:00:55 PM UTC. 2024-09-18T21:02:22.249 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-09-18T21:02:22.249 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-09-18T21:02:22.283 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-18T21:02:22.284 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-18T21:02:22.284 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repo Size 2024-09-18T21:02:22.284 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-18T21:02:22.285 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-18T21:02:22.285 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs-devel x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 25 k 2024-09-18T21:02:22.285 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:02:22.285 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-18T21:02:22.285 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-18T21:02:22.285 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-09-18T21:02:22.285 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:02:22.285 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 25 k 2024-09-18T21:02:22.285 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 110 k 2024-09-18T21:02:22.285 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-18T21:02:22.444 INFO:teuthology.orchestra.run.smithi103.stdout:libcephfs-devel-17.2.7-1637.g6e06d1e0.el9.x86_6 157 kB/s | 25 kB 00:00 2024-09-18T21:02:22.445 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-18T21:02:22.445 INFO:teuthology.orchestra.run.smithi103.stdout:Total 156 kB/s | 25 kB 00:00 2024-09-18T21:02:22.445 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-18T21:02:22.448 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-18T21:02:22.448 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-18T21:02:22.449 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-18T21:02:22.450 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-18T21:02:22.535 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-18T21:02:22.561 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-09-18T21:02:22.640 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephfs-devel-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-18T21:02:22.732 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-18T21:02:22.775 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-18T21:02:23.004 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-18T21:02:23.233 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephfs-devel-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-18T21:02:23.233 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:02:23.233 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-18T21:02:23.233 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs-devel-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:02:23.233 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:02:23.233 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-18T21:02:23.292 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-18T21:02:23.386 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-18T21:02:23.399 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install librados2 2024-09-18T21:02:23.451 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-18T21:02:23.488 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 6/6 2024-09-18T21:02:23.974 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:01:28 ago on Wed 18 Sep 2024 09:00:55 PM UTC. 2024-09-18T21:02:24.064 INFO:teuthology.orchestra.run.smithi103.stdout:Package librados2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-18T21:02:24.111 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-18T21:02:24.111 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-09-18T21:02:24.112 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-18T21:02:24.182 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install librbd1 2024-09-18T21:02:24.239 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 6/6 2024-09-18T21:02:24.239 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 1/6 2024-09-18T21:02:24.239 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-18T21:02:24.239 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-18T21:02:24.239 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-18T21:02:24.239 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-18T21:02:24.504 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-18T21:02:24.504 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:02:24.504 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-09-18T21:02:24.504 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 2024-09-18T21:02:24.504 INFO:teuthology.orchestra.run.smithi077.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-18T21:02:24.504 INFO:teuthology.orchestra.run.smithi077.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-18T21:02:24.504 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-18T21:02:24.504 INFO:teuthology.orchestra.run.smithi077.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-18T21:02:24.504 INFO:teuthology.orchestra.run.smithi077.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-18T21:02:24.504 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:02:24.504 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-18T21:02:24.751 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-fuse 2024-09-18T21:02:24.763 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:01:29 ago on Wed 18 Sep 2024 09:00:55 PM UTC. 2024-09-18T21:02:24.852 INFO:teuthology.orchestra.run.smithi103.stdout:Package librbd1-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-18T21:02:24.894 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-18T21:02:24.895 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-09-18T21:02:24.895 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-18T21:02:24.969 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install python3-rados 2024-09-18T21:02:25.327 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:25 ago on Wed 18 Sep 2024 09:01:00 PM UTC. 2024-09-18T21:02:25.459 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-18T21:02:25.460 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-18T21:02:25.460 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2024-09-18T21:02:25.460 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-18T21:02:25.460 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-09-18T21:02:25.460 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-fuse x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 813 k 2024-09-18T21:02:25.460 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-09-18T21:02:25.460 INFO:teuthology.orchestra.run.smithi077.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-18T21:02:25.460 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:02:25.461 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-09-18T21:02:25.461 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-18T21:02:25.461 INFO:teuthology.orchestra.run.smithi077.stdout:Install 2 Packages 2024-09-18T21:02:25.461 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:02:25.461 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 893 k 2024-09-18T21:02:25.461 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 2.6 M 2024-09-18T21:02:25.461 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-09-18T21:02:25.543 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:01:30 ago on Wed 18 Sep 2024 09:00:55 PM UTC. 2024-09-18T21:02:25.609 INFO:teuthology.orchestra.run.smithi077.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 803 kB/s | 80 kB 00:00 2024-09-18T21:02:25.630 INFO:teuthology.orchestra.run.smithi103.stdout:Package python3-rados-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-18T21:02:25.674 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-18T21:02:25.675 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-09-18T21:02:25.675 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-18T21:02:25.742 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install python3-rgw 2024-09-18T21:02:25.800 INFO:teuthology.orchestra.run.smithi077.stdout:(2/2): ceph-fuse-17.2.7-1637.g6e06d1e0.el9.x86_ 2.7 MB/s | 813 kB 00:00 2024-09-18T21:02:25.801 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-09-18T21:02:25.801 INFO:teuthology.orchestra.run.smithi077.stdout:Total 2.6 MB/s | 893 kB 00:00 2024-09-18T21:02:25.813 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-09-18T21:02:25.835 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-09-18T21:02:25.835 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-09-18T21:02:25.915 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-09-18T21:02:25.915 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-09-18T21:02:26.094 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-09-18T21:02:26.229 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-18T21:02:26.308 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-fuse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2/2 2024-09-18T21:02:26.320 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:01:31 ago on Wed 18 Sep 2024 09:00:55 PM UTC. 2024-09-18T21:02:26.409 INFO:teuthology.orchestra.run.smithi103.stdout:Package python3-rgw-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-18T21:02:26.452 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-18T21:02:26.453 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-09-18T21:02:26.453 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-18T21:02:26.523 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install python3-cephfs 2024-09-18T21:02:26.994 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-fuse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2/2 2024-09-18T21:02:26.994 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-fuse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/2 2024-09-18T21:02:27.102 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:01:32 ago on Wed 18 Sep 2024 09:00:55 PM UTC. 2024-09-18T21:02:27.190 INFO:teuthology.orchestra.run.smithi103.stdout:Package python3-cephfs-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-18T21:02:27.232 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-18T21:02:27.233 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-09-18T21:02:27.233 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-18T21:02:27.296 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-18T21:02:27.296 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:02:27.296 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-09-18T21:02:27.296 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-fuse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-18T21:02:27.296 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:02:27.297 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-18T21:02:27.309 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install python3-rbd 2024-09-18T21:02:27.563 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install librados-devel 2024-09-18T21:02:27.886 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:01:32 ago on Wed 18 Sep 2024 09:00:55 PM UTC. 2024-09-18T21:02:27.975 INFO:teuthology.orchestra.run.smithi103.stdout:Package python3-rbd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-18T21:02:28.017 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-18T21:02:28.018 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-09-18T21:02:28.018 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-18T21:02:28.081 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install rbd-fuse 2024-09-18T21:02:28.151 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:28 ago on Wed 18 Sep 2024 09:01:00 PM UTC. 2024-09-18T21:02:28.286 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-18T21:02:28.286 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-18T21:02:28.287 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repo Size 2024-09-18T21:02:28.287 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-18T21:02:28.287 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-09-18T21:02:28.287 INFO:teuthology.orchestra.run.smithi077.stdout: librados-devel x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 126 k 2024-09-18T21:02:28.287 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:02:28.287 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-09-18T21:02:28.287 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-18T21:02:28.287 INFO:teuthology.orchestra.run.smithi077.stdout:Install 1 Package 2024-09-18T21:02:28.287 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:02:28.287 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 126 k 2024-09-18T21:02:28.287 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 448 k 2024-09-18T21:02:28.287 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-09-18T21:02:28.488 INFO:teuthology.orchestra.run.smithi077.stdout:librados-devel-17.2.7-1637.g6e06d1e0.el9.x86_64 631 kB/s | 126 kB 00:00 2024-09-18T21:02:28.488 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-09-18T21:02:28.489 INFO:teuthology.orchestra.run.smithi077.stdout:Total 626 kB/s | 126 kB 00:00 2024-09-18T21:02:28.489 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-09-18T21:02:28.494 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-09-18T21:02:28.494 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-09-18T21:02:28.556 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-09-18T21:02:28.557 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-09-18T21:02:28.657 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:01:33 ago on Wed 18 Sep 2024 09:00:55 PM UTC. 2024-09-18T21:02:28.711 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-09-18T21:02:28.789 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-18T21:02:28.789 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-18T21:02:28.789 INFO:teuthology.orchestra.run.smithi103.stdout: Package Architecture Version Repository Size 2024-09-18T21:02:28.789 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-18T21:02:28.790 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-18T21:02:28.790 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-fuse x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 82 k 2024-09-18T21:02:28.790 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:02:28.790 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-18T21:02:28.790 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-18T21:02:28.790 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-09-18T21:02:28.790 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:02:28.790 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 82 k 2024-09-18T21:02:28.790 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 222 k 2024-09-18T21:02:28.790 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-18T21:02:28.809 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librados-devel-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-18T21:02:28.981 INFO:teuthology.orchestra.run.smithi103.stdout:rbd-fuse-17.2.7-1637.g6e06d1e0.el9.x86_64.rpm 431 kB/s | 82 kB 00:00 2024-09-18T21:02:28.981 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-18T21:02:28.982 INFO:teuthology.orchestra.run.smithi103.stdout:Total 428 kB/s | 82 kB 00:00 2024-09-18T21:02:28.982 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-18T21:02:28.988 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-18T21:02:28.988 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-18T21:02:29.051 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-18T21:02:29.051 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-18T21:02:29.202 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-18T21:02:29.255 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librados-devel-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-18T21:02:29.319 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-fuse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-18T21:02:29.497 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librados-devel-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-18T21:02:29.497 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:02:29.497 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-09-18T21:02:29.497 INFO:teuthology.orchestra.run.smithi077.stdout: librados-devel-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:02:29.497 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:02:29.498 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-18T21:02:29.720 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install libcephfs2 2024-09-18T21:02:29.762 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: rbd-fuse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-18T21:02:30.066 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-fuse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-18T21:02:30.067 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:02:30.067 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-18T21:02:30.067 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-fuse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:02:30.067 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:02:30.067 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-18T21:02:30.292 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install rbd-mirror 2024-09-18T21:02:30.313 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:30 ago on Wed 18 Sep 2024 09:01:00 PM UTC. 2024-09-18T21:02:30.406 INFO:teuthology.orchestra.run.smithi077.stdout:Package libcephfs2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-18T21:02:30.449 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-18T21:02:30.450 INFO:teuthology.orchestra.run.smithi077.stdout:Nothing to do. 2024-09-18T21:02:30.450 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-18T21:02:30.519 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install libcephfs-devel 2024-09-18T21:02:30.883 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:01:35 ago on Wed 18 Sep 2024 09:00:55 PM UTC. 2024-09-18T21:02:31.019 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-18T21:02:31.020 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-18T21:02:31.020 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repo Size 2024-09-18T21:02:31.020 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-18T21:02:31.020 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-18T21:02:31.020 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-mirror x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 2.9 M 2024-09-18T21:02:31.020 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:02:31.020 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-18T21:02:31.020 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-18T21:02:31.020 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-09-18T21:02:31.020 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:02:31.020 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 2.9 M 2024-09-18T21:02:31.021 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 12 M 2024-09-18T21:02:31.021 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-18T21:02:31.099 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:31 ago on Wed 18 Sep 2024 09:01:00 PM UTC. 2024-09-18T21:02:31.230 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-18T21:02:31.231 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-18T21:02:31.231 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repo Size 2024-09-18T21:02:31.231 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-18T21:02:31.231 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-09-18T21:02:31.231 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs-devel x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 25 k 2024-09-18T21:02:31.231 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:02:31.231 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-09-18T21:02:31.231 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-18T21:02:31.231 INFO:teuthology.orchestra.run.smithi077.stdout:Install 1 Package 2024-09-18T21:02:31.231 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:02:31.231 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 25 k 2024-09-18T21:02:31.231 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 110 k 2024-09-18T21:02:31.232 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-09-18T21:02:31.353 INFO:teuthology.orchestra.run.smithi103.stdout:rbd-mirror-17.2.7-1637.g6e06d1e0.el9.x86_64.rpm 8.9 MB/s | 2.9 MB 00:00 2024-09-18T21:02:31.353 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-18T21:02:31.353 INFO:teuthology.orchestra.run.smithi103.stdout:Total 8.8 MB/s | 2.9 MB 00:00 2024-09-18T21:02:31.353 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-18T21:02:31.362 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-18T21:02:31.362 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-18T21:02:31.391 INFO:teuthology.orchestra.run.smithi077.stdout:libcephfs-devel-17.2.7-1637.g6e06d1e0.el9.x86_6 157 kB/s | 25 kB 00:00 2024-09-18T21:02:31.391 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-09-18T21:02:31.391 INFO:teuthology.orchestra.run.smithi077.stdout:Total 155 kB/s | 25 kB 00:00 2024-09-18T21:02:31.392 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-09-18T21:02:31.395 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-09-18T21:02:31.395 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-09-18T21:02:31.397 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-09-18T21:02:31.397 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-09-18T21:02:31.441 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-18T21:02:31.441 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-18T21:02:31.475 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-09-18T21:02:31.588 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcephfs-devel-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-18T21:02:31.858 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-18T21:02:31.911 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-mirror-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-18T21:02:31.936 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-18T21:02:31.936 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T21:02:31.936 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-18T21:02:31.936 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-18T21:02:31.936 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-18T21:02:31.937 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:02:31.952 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-18T21:02:32.177 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcephfs-devel-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-18T21:02:32.177 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:02:32.178 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-09-18T21:02:32.178 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs-devel-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:02:32.178 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:02:32.178 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-18T21:02:32.373 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install librados2 2024-09-18T21:02:32.954 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:32 ago on Wed 18 Sep 2024 09:01:00 PM UTC. 2024-09-18T21:02:33.043 INFO:teuthology.orchestra.run.smithi077.stdout:Package librados2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-18T21:02:33.052 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-mirror-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-18T21:02:33.052 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:02:33.052 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-18T21:02:33.052 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-mirror-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:02:33.052 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:02:33.052 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-18T21:02:33.085 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-18T21:02:33.086 INFO:teuthology.orchestra.run.smithi077.stdout:Nothing to do. 2024-09-18T21:02:33.086 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-18T21:02:33.151 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install librbd1 2024-09-18T21:02:33.344 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install rbd-nbd 2024-09-18T21:02:33.730 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:33 ago on Wed 18 Sep 2024 09:01:00 PM UTC. 2024-09-18T21:02:33.819 INFO:teuthology.orchestra.run.smithi077.stdout:Package librbd1-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-18T21:02:33.861 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-18T21:02:33.862 INFO:teuthology.orchestra.run.smithi077.stdout:Nothing to do. 2024-09-18T21:02:33.862 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-18T21:02:33.925 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install python3-rados 2024-09-18T21:02:33.942 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:01:38 ago on Wed 18 Sep 2024 09:00:55 PM UTC. 2024-09-18T21:02:34.074 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-18T21:02:34.074 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-18T21:02:34.075 INFO:teuthology.orchestra.run.smithi103.stdout: Package Architecture Version Repository Size 2024-09-18T21:02:34.075 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-18T21:02:34.075 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-18T21:02:34.075 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-nbd x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 165 k 2024-09-18T21:02:34.075 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:02:34.075 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-18T21:02:34.075 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-09-18T21:02:34.075 INFO:teuthology.orchestra.run.smithi103.stdout:Install 1 Package 2024-09-18T21:02:34.075 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:02:34.075 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 165 k 2024-09-18T21:02:34.075 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 477 k 2024-09-18T21:02:34.075 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-18T21:02:34.285 INFO:teuthology.orchestra.run.smithi103.stdout:rbd-nbd-17.2.7-1637.g6e06d1e0.el9.x86_64.rpm 787 kB/s | 165 kB 00:00 2024-09-18T21:02:34.286 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-18T21:02:34.286 INFO:teuthology.orchestra.run.smithi103.stdout:Total 782 kB/s | 165 kB 00:00 2024-09-18T21:02:34.286 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-18T21:02:34.293 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-18T21:02:34.294 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-18T21:02:34.360 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-18T21:02:34.360 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-18T21:02:34.504 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:34 ago on Wed 18 Sep 2024 09:01:00 PM UTC. 2024-09-18T21:02:34.508 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-18T21:02:34.593 INFO:teuthology.orchestra.run.smithi077.stdout:Package python3-rados-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-18T21:02:34.637 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-18T21:02:34.638 INFO:teuthology.orchestra.run.smithi077.stdout:Nothing to do. 2024-09-18T21:02:34.639 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-18T21:02:34.662 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-nbd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-18T21:02:34.698 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install python3-rgw 2024-09-18T21:02:35.185 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: rbd-nbd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-18T21:02:35.272 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:35 ago on Wed 18 Sep 2024 09:01:00 PM UTC. 2024-09-18T21:02:35.361 INFO:teuthology.orchestra.run.smithi077.stdout:Package python3-rgw-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-18T21:02:35.403 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-18T21:02:35.404 INFO:teuthology.orchestra.run.smithi077.stdout:Nothing to do. 2024-09-18T21:02:35.404 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-18T21:02:35.464 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install python3-cephfs 2024-09-18T21:02:35.477 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-nbd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-18T21:02:35.477 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:02:35.477 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-18T21:02:35.477 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-nbd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:02:35.477 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:02:35.477 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-18T21:02:35.748 DEBUG:teuthology.parallel:result is None 2024-09-18T21:02:36.039 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:36 ago on Wed 18 Sep 2024 09:01:00 PM UTC. 2024-09-18T21:02:36.128 INFO:teuthology.orchestra.run.smithi077.stdout:Package python3-cephfs-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-18T21:02:36.171 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-18T21:02:36.172 INFO:teuthology.orchestra.run.smithi077.stdout:Nothing to do. 2024-09-18T21:02:36.172 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-18T21:02:36.234 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install python3-rbd 2024-09-18T21:02:36.799 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:36 ago on Wed 18 Sep 2024 09:01:00 PM UTC. 2024-09-18T21:02:36.888 INFO:teuthology.orchestra.run.smithi077.stdout:Package python3-rbd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-18T21:02:36.930 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-18T21:02:36.931 INFO:teuthology.orchestra.run.smithi077.stdout:Nothing to do. 2024-09-18T21:02:36.931 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-18T21:02:36.989 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install rbd-fuse 2024-09-18T21:02:37.569 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:37 ago on Wed 18 Sep 2024 09:01:00 PM UTC. 2024-09-18T21:02:37.700 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-18T21:02:37.701 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-18T21:02:37.701 INFO:teuthology.orchestra.run.smithi077.stdout: Package Architecture Version Repository Size 2024-09-18T21:02:37.701 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-18T21:02:37.701 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-09-18T21:02:37.701 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-fuse x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 82 k 2024-09-18T21:02:37.701 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:02:37.701 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-09-18T21:02:37.701 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-18T21:02:37.701 INFO:teuthology.orchestra.run.smithi077.stdout:Install 1 Package 2024-09-18T21:02:37.701 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:02:37.701 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 82 k 2024-09-18T21:02:37.702 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 222 k 2024-09-18T21:02:37.702 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-09-18T21:02:37.902 INFO:teuthology.orchestra.run.smithi077.stdout:rbd-fuse-17.2.7-1637.g6e06d1e0.el9.x86_64.rpm 409 kB/s | 82 kB 00:00 2024-09-18T21:02:37.903 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-09-18T21:02:37.903 INFO:teuthology.orchestra.run.smithi077.stdout:Total 406 kB/s | 82 kB 00:00 2024-09-18T21:02:37.903 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-09-18T21:02:37.909 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-09-18T21:02:37.910 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-09-18T21:02:37.972 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-09-18T21:02:37.972 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-09-18T21:02:38.126 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-09-18T21:02:38.232 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rbd-fuse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-18T21:02:38.618 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: rbd-fuse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-18T21:02:38.879 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rbd-fuse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-18T21:02:38.879 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:02:38.879 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-09-18T21:02:38.879 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-fuse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:02:38.879 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:02:38.879 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-18T21:02:39.077 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install rbd-mirror 2024-09-18T21:02:39.672 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:39 ago on Wed 18 Sep 2024 09:01:00 PM UTC. 2024-09-18T21:02:39.808 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-18T21:02:39.809 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-18T21:02:39.809 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repo Size 2024-09-18T21:02:39.809 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-18T21:02:39.809 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-09-18T21:02:39.809 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-mirror x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 2.9 M 2024-09-18T21:02:39.809 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:02:39.809 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-09-18T21:02:39.809 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-18T21:02:39.809 INFO:teuthology.orchestra.run.smithi077.stdout:Install 1 Package 2024-09-18T21:02:39.809 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:02:39.809 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 2.9 M 2024-09-18T21:02:39.810 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 12 M 2024-09-18T21:02:39.810 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-09-18T21:02:40.155 INFO:teuthology.orchestra.run.smithi077.stdout:rbd-mirror-17.2.7-1637.g6e06d1e0.el9.x86_64.rpm 8.5 MB/s | 2.9 MB 00:00 2024-09-18T21:02:40.156 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-09-18T21:02:40.156 INFO:teuthology.orchestra.run.smithi077.stdout:Total 8.5 MB/s | 2.9 MB 00:00 2024-09-18T21:02:40.156 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-09-18T21:02:40.165 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-09-18T21:02:40.165 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-09-18T21:02:40.245 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-09-18T21:02:40.245 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-09-18T21:02:40.657 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-09-18T21:02:40.714 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rbd-mirror-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-18T21:02:40.738 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-18T21:02:40.738 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-18T21:02:40.738 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-18T21:02:40.738 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-18T21:02:40.739 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-18T21:02:40.739 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:02:41.776 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rbd-mirror-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-18T21:02:41.776 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:02:41.776 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-09-18T21:02:41.776 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-mirror-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:02:41.776 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:02:41.776 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-18T21:02:42.060 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install rbd-nbd 2024-09-18T21:02:42.659 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:42 ago on Wed 18 Sep 2024 09:01:00 PM UTC. 2024-09-18T21:02:42.791 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-18T21:02:42.792 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-18T21:02:42.792 INFO:teuthology.orchestra.run.smithi077.stdout: Package Architecture Version Repository Size 2024-09-18T21:02:42.792 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-18T21:02:42.793 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-09-18T21:02:42.793 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-nbd x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 165 k 2024-09-18T21:02:42.793 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:02:42.793 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-09-18T21:02:42.793 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-18T21:02:42.793 INFO:teuthology.orchestra.run.smithi077.stdout:Install 1 Package 2024-09-18T21:02:42.793 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:02:42.793 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 165 k 2024-09-18T21:02:42.793 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 477 k 2024-09-18T21:02:42.793 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-09-18T21:02:43.008 INFO:teuthology.orchestra.run.smithi077.stdout:rbd-nbd-17.2.7-1637.g6e06d1e0.el9.x86_64.rpm 768 kB/s | 165 kB 00:00 2024-09-18T21:02:43.009 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-09-18T21:02:43.009 INFO:teuthology.orchestra.run.smithi077.stdout:Total 763 kB/s | 165 kB 00:00 2024-09-18T21:02:43.009 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-09-18T21:02:43.017 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-09-18T21:02:43.017 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-09-18T21:02:43.079 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-09-18T21:02:43.079 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-09-18T21:02:43.230 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-09-18T21:02:43.330 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rbd-nbd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-18T21:02:43.743 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: rbd-nbd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-18T21:02:44.015 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rbd-nbd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-18T21:02:44.015 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:02:44.015 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-09-18T21:02:44.015 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-nbd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-18T21:02:44.016 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:02:44.016 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-18T21:02:44.266 DEBUG:teuthology.parallel:result is None 2024-09-18T21:02:44.267 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-18T21:02:44.267 INFO:teuthology.packaging:ref: None 2024-09-18T21:02:44.267 INFO:teuthology.packaging:tag: None 2024-09-18T21:02:44.267 INFO:teuthology.packaging:branch: quincy 2024-09-18T21:02:44.267 INFO:teuthology.packaging:sha1: 06b1b1de896d25f0645e4a306558ab0b4d4fc56f 2024-09-18T21:02:44.267 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-18T21:02:44.485 DEBUG:teuthology.orchestra.run.smithi077:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-18T21:02:44.507 INFO:teuthology.orchestra.run.smithi077.stdout:17.2.7-1637.g6e06d1e0.el9 2024-09-18T21:02:44.507 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1637.g6e06d1e0.el9 2024-09-18T21:02:44.508 INFO:teuthology.task.install:The correct ceph version 17.2.7-1637.g6e06d1e0 is installed. 2024-09-18T21:02:44.509 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-18T21:02:44.510 INFO:teuthology.packaging:ref: None 2024-09-18T21:02:44.510 INFO:teuthology.packaging:tag: None 2024-09-18T21:02:44.510 INFO:teuthology.packaging:branch: quincy 2024-09-18T21:02:44.510 INFO:teuthology.packaging:sha1: 06b1b1de896d25f0645e4a306558ab0b4d4fc56f 2024-09-18T21:02:44.510 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-18T21:02:44.890 DEBUG:teuthology.orchestra.run.smithi103:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-18T21:02:44.916 INFO:teuthology.orchestra.run.smithi103.stdout:17.2.7-1637.g6e06d1e0.el9 2024-09-18T21:02:44.916 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1637.g6e06d1e0.el9 2024-09-18T21:02:44.916 INFO:teuthology.task.install:The correct ceph version 17.2.7-1637.g6e06d1e0 is installed. 2024-09-18T21:02:44.918 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-18T21:02:44.918 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-18T21:02:44.918 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-18T21:02:44.945 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-18T21:02:44.945 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-18T21:02:44.987 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-18T21:02:44.987 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-18T21:02:44.987 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/daemon-helper 2024-09-18T21:02:45.012 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-18T21:02:45.075 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-18T21:02:45.076 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/daemon-helper 2024-09-18T21:02:45.104 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-18T21:02:45.172 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-18T21:02:45.172 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-18T21:02:45.172 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-18T21:02:45.196 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-18T21:02:45.261 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-18T21:02:45.261 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-18T21:02:45.288 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-18T21:02:45.355 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-18T21:02:45.355 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-18T21:02:45.355 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/stdin-killer 2024-09-18T21:02:45.380 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-18T21:02:45.445 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-18T21:02:45.445 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/stdin-killer 2024-09-18T21:02:45.472 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-18T21:02:45.538 INFO:teuthology.run_tasks:Running task print... 2024-09-18T21:02:45.548 INFO:teuthology.task.print:**** done install task... 2024-09-18T21:02:45.548 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-18T21:02:45.655 INFO:tasks.cephadm:Config: {'cephadm_branch': 'quincy', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}}, 'image': 'quay.ceph.io/ceph-ci/ceph:quincy', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'osds down', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '06b1b1de896d25f0645e4a306558ab0b4d4fc56f'} 2024-09-18T21:02:45.655 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:quincy 2024-09-18T21:02:45.656 INFO:tasks.cephadm:Cluster fsid is 5a76ec16-7601-11ef-bceb-c7b262605968 2024-09-18T21:02:45.656 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-18T21:02:45.656 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-09-18T21:02:45.656 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi077': '172.21.15.77', 'mon.smithi103': '172.21.15.103'} 2024-09-18T21:02:45.656 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-18T21:02:45.657 DEBUG:teuthology.orchestra.run.smithi077:> sudo hostname $(hostname -s) 2024-09-18T21:02:45.682 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname $(hostname -s) 2024-09-18T21:02:45.709 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref quincy)... 2024-09-18T21:02:45.709 DEBUG:teuthology.orchestra.run.smithi077:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-18T21:02:46.032 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r--. 1 ubuntu ubuntu 378585 Sep 18 21:02 /home/ubuntu/cephtest/cephadm 2024-09-18T21:02:46.032 DEBUG:teuthology.orchestra.run.smithi103:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-18T21:02:46.174 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r--. 1 ubuntu ubuntu 378585 Sep 18 21:02 /home/ubuntu/cephtest/cephadm 2024-09-18T21:02:46.174 DEBUG:teuthology.orchestra.run.smithi077:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-18T21:02:46.190 DEBUG:teuthology.orchestra.run.smithi103:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-18T21:02:46.216 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:quincy on all hosts... 2024-09-18T21:02:46.216 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-09-18T21:02:46.233 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-09-18T21:02:47.798 INFO:teuthology.orchestra.run.smithi103.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-18T21:02:47.848 INFO:teuthology.orchestra.run.smithi077.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-18T21:03:34.255 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-18T21:03:34.255 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)", 2024-09-18T21:03:34.255 INFO:teuthology.orchestra.run.smithi103.stdout: "image_id": "f63ad14e4e434a3de1d471d2841f01aa4ae27e9a9e20f9a042bea34292493ec9", 2024-09-18T21:03:34.255 INFO:teuthology.orchestra.run.smithi103.stdout: "repo_digests": [ 2024-09-18T21:03:34.255 INFO:teuthology.orchestra.run.smithi103.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8" 2024-09-18T21:03:34.255 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-18T21:03:34.255 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-18T21:03:37.079 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-18T21:03:37.079 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_version": "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)", 2024-09-18T21:03:37.079 INFO:teuthology.orchestra.run.smithi077.stdout: "image_id": "f63ad14e4e434a3de1d471d2841f01aa4ae27e9a9e20f9a042bea34292493ec9", 2024-09-18T21:03:37.079 INFO:teuthology.orchestra.run.smithi077.stdout: "repo_digests": [ 2024-09-18T21:03:37.079 INFO:teuthology.orchestra.run.smithi077.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8" 2024-09-18T21:03:37.079 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-09-18T21:03:37.079 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-18T21:03:37.098 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /etc/ceph 2024-09-18T21:03:37.140 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /etc/ceph 2024-09-18T21:03:37.173 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 777 /etc/ceph 2024-09-18T21:03:37.204 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 777 /etc/ceph 2024-09-18T21:03:37.240 INFO:tasks.cephadm:Writing seed config... 2024-09-18T21:03:37.242 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-09-18T21:03:37.242 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-09-18T21:03:37.242 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-18T21:03:37.242 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-18T21:03:37.242 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-18T21:03:37.242 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-18T21:03:37.242 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-18T21:03:37.242 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-18T21:03:37.242 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-18T21:03:37.242 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-18T21:03:37.242 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-18T21:03:37.242 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-18T21:03:37.243 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-18T21:03:37.243 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-18T21:03:37.243 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-18T21:03:37.243 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-18T21:03:37.243 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-18T21:03:37.243 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-18T21:03:37.243 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-18T21:03:37.243 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-18T21:03:37.243 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-18T21:03:37.243 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-18T21:03:37.243 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-18T21:03:37.243 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-09-18T21:03:37.243 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-18T21:03:37.243 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-18T21:03:37.244 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-18T21:03:37.244 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-18T21:03:37.244 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-18T21:03:37.244 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-18T21:03:37.244 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-18T21:03:37.244 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-18T21:03:37.244 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-18T21:03:37.244 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-18T21:03:37.244 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-18T21:03:37.244 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-18T21:03:37.244 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-18T21:03:37.244 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-18T21:03:37.244 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-18T21:03:37.244 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-18T21:03:37.245 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-18T21:03:37.245 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-18T21:03:37.245 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-18T21:03:37.245 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-18T21:03:37.245 DEBUG:teuthology.orchestra.run.smithi077:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-18T21:03:37.261 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 5a76ec16-7601-11ef-bceb-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-18T21:03:37.261 DEBUG:teuthology.orchestra.run.smithi077:mon.smithi077> sudo journalctl -f -n 0 -u ceph-5a76ec16-7601-11ef-bceb-c7b262605968@mon.smithi077.service 2024-09-18T21:03:37.303 INFO:tasks.cephadm:Bootstrapping... 2024-09-18T21:03:37.304 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy -v bootstrap --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.77 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-18T21:03:37.500 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-09-18T21:03:37.500 INFO:teuthology.orchestra.run.smithi077.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:quincy', '-v', 'bootstrap', '--fsid', '5a76ec16-7601-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.77', '--skip-admin-label'] 2024-09-18T21:03:37.523 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/podman: stdout 5.2.2 2024-09-18T21:03:37.523 INFO:teuthology.orchestra.run.smithi077.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-18T21:03:37.523 INFO:teuthology.orchestra.run.smithi077.stdout:Verifying podman|docker is present... 2024-09-18T21:03:37.545 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/podman: stdout 5.2.2 2024-09-18T21:03:37.545 INFO:teuthology.orchestra.run.smithi077.stdout:Verifying lvm2 is present... 2024-09-18T21:03:37.545 INFO:teuthology.orchestra.run.smithi077.stdout:Verifying time synchronization is in place... 2024-09-18T21:03:37.554 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-18T21:03:37.554 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-18T21:03:37.560 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-18T21:03:37.560 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout inactive 2024-09-18T21:03:37.567 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout enabled 2024-09-18T21:03:37.574 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout active 2024-09-18T21:03:37.574 INFO:teuthology.orchestra.run.smithi077.stdout:Unit chronyd.service is enabled and running 2024-09-18T21:03:37.574 INFO:teuthology.orchestra.run.smithi077.stdout:Repeating the final host check... 2024-09-18T21:03:37.597 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/podman: stdout 5.2.2 2024-09-18T21:03:37.597 INFO:teuthology.orchestra.run.smithi077.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-18T21:03:37.597 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl is present 2024-09-18T21:03:37.597 INFO:teuthology.orchestra.run.smithi077.stdout:lvcreate is present 2024-09-18T21:03:37.604 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-18T21:03:37.604 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-18T21:03:37.611 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-18T21:03:37.611 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout inactive 2024-09-18T21:03:37.618 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout enabled 2024-09-18T21:03:37.625 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout active 2024-09-18T21:03:37.625 INFO:teuthology.orchestra.run.smithi077.stdout:Unit chronyd.service is enabled and running 2024-09-18T21:03:37.625 INFO:teuthology.orchestra.run.smithi077.stdout:Host looks OK 2024-09-18T21:03:37.625 INFO:teuthology.orchestra.run.smithi077.stdout:Cluster fsid: 5a76ec16-7601-11ef-bceb-c7b262605968 2024-09-18T21:03:37.625 INFO:teuthology.orchestra.run.smithi077.stdout:Acquiring lock 140168614580576 on /run/cephadm/5a76ec16-7601-11ef-bceb-c7b262605968.lock 2024-09-18T21:03:37.625 INFO:teuthology.orchestra.run.smithi077.stdout:Lock 140168614580576 acquired on /run/cephadm/5a76ec16-7601-11ef-bceb-c7b262605968.lock 2024-09-18T21:03:37.625 INFO:teuthology.orchestra.run.smithi077.stdout:Verifying IP 172.21.15.77 port 3300 ... 2024-09-18T21:03:37.626 INFO:teuthology.orchestra.run.smithi077.stdout:Verifying IP 172.21.15.77 port 6789 ... 2024-09-18T21:03:37.626 INFO:teuthology.orchestra.run.smithi077.stdout:Base mon IP(s) is [172.21.15.77:3300, 172.21.15.77:6789], mon addrv is [v2:172.21.15.77:3300,v1:172.21.15.77:6789] 2024-09-18T21:03:37.629 INFO:teuthology.orchestra.run.smithi077.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.77 metric 100 2024-09-18T21:03:37.629 INFO:teuthology.orchestra.run.smithi077.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.77 metric 100 2024-09-18T21:03:37.632 INFO:teuthology.orchestra.run.smithi077.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-18T21:03:37.632 INFO:teuthology.orchestra.run.smithi077.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-18T21:03:37.632 INFO:teuthology.orchestra.run.smithi077.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-18T21:03:37.635 INFO:teuthology.orchestra.run.smithi077.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-18T21:03:37.635 INFO:teuthology.orchestra.run.smithi077.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-18T21:03:37.635 INFO:teuthology.orchestra.run.smithi077.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-18T21:03:37.635 INFO:teuthology.orchestra.run.smithi077.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-18T21:03:37.635 INFO:teuthology.orchestra.run.smithi077.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d3d3/64 scope link noprefixroute 2024-09-18T21:03:37.635 INFO:teuthology.orchestra.run.smithi077.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-18T21:03:37.636 INFO:teuthology.orchestra.run.smithi077.stdout:Mon IP `172.21.15.77` is in CIDR network `172.21.0.0/20` 2024-09-18T21:03:37.636 INFO:teuthology.orchestra.run.smithi077.stdout:Mon IP `172.21.15.77` is in CIDR network `172.21.0.0/20` 2024-09-18T21:03:37.636 INFO:teuthology.orchestra.run.smithi077.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-18T21:03:37.636 INFO:teuthology.orchestra.run.smithi077.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-18T21:03:37.637 INFO:teuthology.orchestra.run.smithi077.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-18T21:03:38.046 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/podman: stdout f63ad14e4e434a3de1d471d2841f01aa4ae27e9a9e20f9a042bea34292493ec9 2024-09-18T21:03:38.046 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-18T21:03:38.046 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/podman: stderr Getting image source signatures 2024-09-18T21:03:38.046 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/podman: stderr Copying blob sha256:a57b58ef5be3c9891294d677a25cda6c34cb1998d8001d986a2725631ea2d32e 2024-09-18T21:03:38.046 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-18T21:03:38.046 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/podman: stderr Copying config sha256:f63ad14e4e434a3de1d471d2841f01aa4ae27e9a9e20f9a042bea34292493ec9 2024-09-18T21:03:38.046 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-18T21:03:39.001 INFO:teuthology.orchestra.run.smithi077.stdout:ceph: stdout ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable) 2024-09-18T21:03:39.001 INFO:teuthology.orchestra.run.smithi077.stdout:Ceph version: ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable) 2024-09-18T21:03:39.001 INFO:teuthology.orchestra.run.smithi077.stdout:Extracting ceph user uid/gid from container image... 2024-09-18T21:03:40.031 INFO:teuthology.orchestra.run.smithi077.stdout:stat: stdout 167 167 2024-09-18T21:03:40.031 INFO:teuthology.orchestra.run.smithi077.stdout:Creating initial keys... 2024-09-18T21:03:40.936 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph-authtool: stdout AQAsQOtmwHwHFRAAQ14m983ueRYjgLY1GMSUAQ== 2024-09-18T21:03:41.992 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph-authtool: stdout AQAtQOtmryGzDxAAFFQyVZ0AwjxvFwLdsfpGOw== 2024-09-18T21:03:42.839 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph-authtool: stdout AQAuQOtmIvm/ExAA3C4dPImkYn76wC+MACXOqg== 2024-09-18T21:03:42.840 INFO:teuthology.orchestra.run.smithi077.stdout:Creating initial monmap... 2024-09-18T21:03:43.712 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-18T21:03:43.712 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2024-09-18T21:03:43.713 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 5a76ec16-7601-11ef-bceb-c7b262605968 2024-09-18T21:03:43.713 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-18T21:03:43.713 INFO:teuthology.orchestra.run.smithi077.stdout:monmaptool for smithi077 [v2:172.21.15.77:3300,v1:172.21.15.77:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-18T21:03:43.713 INFO:teuthology.orchestra.run.smithi077.stdout:setting min_mon_release = octopus 2024-09-18T21:03:43.713 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/monmaptool: set fsid to 5a76ec16-7601-11ef-bceb-c7b262605968 2024-09-18T21:03:43.713 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-18T21:03:43.713 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:03:43.713 INFO:teuthology.orchestra.run.smithi077.stdout:Creating mon... 2024-09-18T21:03:44.651 INFO:teuthology.orchestra.run.smithi077.stdout:create mon.smithi077 on 2024-09-18T21:03:44.852 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-18T21:03:44.992 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-18T21:03:45.133 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-5a76ec16-7601-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-5a76ec16-7601-11ef-bceb-c7b262605968.target. 2024-09-18T21:03:45.133 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-5a76ec16-7601-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-5a76ec16-7601-11ef-bceb-c7b262605968.target. 2024-09-18T21:03:45.299 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-5a76ec16-7601-11ef-bceb-c7b262605968@mon.smithi077 2024-09-18T21:03:45.299 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stderr Failed to reset failed state of unit ceph-5a76ec16-7601-11ef-bceb-c7b262605968@mon.smithi077.service: Unit ceph-5a76ec16-7601-11ef-bceb-c7b262605968@mon.smithi077.service not loaded. 2024-09-18T21:03:45.459 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-5a76ec16-7601-11ef-bceb-c7b262605968.target.wants/ceph-5a76ec16-7601-11ef-bceb-c7b262605968@mon.smithi077.service → /etc/systemd/system/ceph-5a76ec16-7601-11ef-bceb-c7b262605968@.service. 2024-09-18T21:03:45.952 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:45 smithi077 ceph-mon[27316]: mon.smithi077 is new leader, mons smithi077 in quorum (ranks 0) 2024-09-18T21:03:45.966 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-18T21:03:45.966 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout disabled 2024-09-18T21:03:45.973 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-18T21:03:45.973 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout inactive 2024-09-18T21:03:45.973 INFO:teuthology.orchestra.run.smithi077.stdout:firewalld.service is not enabled 2024-09-18T21:03:45.974 INFO:teuthology.orchestra.run.smithi077.stdout:Not possible to enable service . firewalld.service is not available 2024-09-18T21:03:45.974 INFO:teuthology.orchestra.run.smithi077.stdout:Waiting for mon to start... 2024-09-18T21:03:45.974 INFO:teuthology.orchestra.run.smithi077.stdout:Waiting for mon... 2024-09-18T21:03:46.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:45 smithi077 bash[27297]: 7b6cc66bc4978117a1d4adc78d4400d0ec001e2999b314abacc5310b8663045c 2024-09-18T21:03:46.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:45 smithi077 systemd[1]: Started Ceph mon.smithi077 for 5a76ec16-7601-11ef-bceb-c7b262605968. 2024-09-18T21:03:47.009 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout cluster: 2024-09-18T21:03:47.009 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout id: 5a76ec16-7601-11ef-bceb-c7b262605968 2024-09-18T21:03:47.010 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-18T21:03:47.010 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 2024-09-18T21:03:47.010 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout services: 2024-09-18T21:03:47.010 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi077 (age 0.538757s) 2024-09-18T21:03:47.010 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-18T21:03:47.010 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-18T21:03:47.010 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 2024-09-18T21:03:47.010 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout data: 2024-09-18T21:03:47.010 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-18T21:03:47.010 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-18T21:03:47.010 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-18T21:03:47.010 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout pgs: 2024-09-18T21:03:47.010 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 2024-09-18T21:03:47.010 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:46.373+0000 7f986480e640 1 Processor -- start 2024-09-18T21:03:47.011 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:46.373+0000 7f986480e640 1 -- start start 2024-09-18T21:03:47.011 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:46.373+0000 7f986480e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9860076af0 0x7f9860104c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:03:47.011 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:46.373+0000 7f986480e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9860076f00 con 0x7f9860076af0 2024-09-18T21:03:47.011 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:46.374+0000 7f985e59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9860076af0 0x7f9860104c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:03:47.011 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:46.374+0000 7f985e59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9860076af0 0x7f9860104c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41714/0 (socket says 172.21.15.77:41714) 2024-09-18T21:03:47.011 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:46.374+0000 7f985e59c640 1 -- 172.21.15.77:0/710078142 learned_addr learned my addr 172.21.15.77:0/710078142 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:03:47.011 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:46.374+0000 7f985e59c640 1 -- 172.21.15.77:0/710078142 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9860105140 con 0x7f9860076af0 2024-09-18T21:03:47.011 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:46.376+0000 7f985e59c640 1 --2- 172.21.15.77:0/710078142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9860076af0 0x7f9860104c00 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9850009840 tx=0x7f98500091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d4ad9cd6518d641 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:03:47.011 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:46.376+0000 7f985d59a640 1 -- 172.21.15.77:0/710078142 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9850032440 con 0x7f9860076af0 2024-09-18T21:03:47.011 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:46.376+0000 7f985d59a640 1 -- 172.21.15.77:0/710078142 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98500325a0 con 0x7f9860076af0 2024-09-18T21:03:47.011 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:46.376+0000 7f985d59a640 1 -- 172.21.15.77:0/710078142 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9850032890 con 0x7f9860076af0 2024-09-18T21:03:47.011 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:46.377+0000 7f986480e640 1 -- 172.21.15.77:0/710078142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9860076af0 msgr2=0x7f9860104c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:03:47.011 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:46.377+0000 7f986480e640 1 --2- 172.21.15.77:0/710078142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9860076af0 0x7f9860104c00 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9850009840 tx=0x7f98500091d0 comp rx=0 tx=0).stop 2024-09-18T21:03:47.011 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:46.377+0000 7f986480e640 1 -- 172.21.15.77:0/710078142 shutdown_connections 2024-09-18T21:03:47.012 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:46.377+0000 7f986480e640 1 --2- 172.21.15.77:0/710078142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9860076af0 0x7f9860104c00 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:03:47.012 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:46.377+0000 7f986480e640 1 -- 172.21.15.77:0/710078142 >> 172.21.15.77:0/710078142 conn(0x7f98600fc6d0 msgr2=0x7f98600feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:03:47.012 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:46.377+0000 7f986480e640 1 -- 172.21.15.77:0/710078142 shutdown_connections 2024-09-18T21:03:47.012 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:46.377+0000 7f986480e640 1 -- 172.21.15.77:0/710078142 wait complete. 2024-09-18T21:03:47.012 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:46.377+0000 7f986480e640 1 Processor -- start 2024-09-18T21:03:47.012 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:46.377+0000 7f986480e640 1 -- start start 2024-09-18T21:03:47.012 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:46.377+0000 7f986480e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9860076af0 0x7f9860110530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:03:47.012 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:46.378+0000 7f986480e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9860110a70 con 0x7f9860076af0 2024-09-18T21:03:47.012 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:46.378+0000 7f985e59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9860076af0 0x7f9860110530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:03:47.012 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:46.378+0000 7f985e59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9860076af0 0x7f9860110530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41728/0 (socket says 172.21.15.77:41728) 2024-09-18T21:03:47.012 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:46.378+0000 7f985e59c640 1 -- 172.21.15.77:0/3679728988 learned_addr learned my addr 172.21.15.77:0/3679728988 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:03:47.012 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:46.378+0000 7f985e59c640 1 -- 172.21.15.77:0/3679728988 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9850009450 con 0x7f9860076af0 2024-09-18T21:03:47.012 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:46.378+0000 7f985e59c640 1 --2- 172.21.15.77:0/3679728988 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9860076af0 0x7f9860110530 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f985002a790 tx=0x7f9850032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:03:47.013 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:46.378+0000 7f984effd640 1 -- 172.21.15.77:0/3679728988 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9850031be0 con 0x7f9860076af0 2024-09-18T21:03:47.013 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:46.378+0000 7f984effd640 1 -- 172.21.15.77:0/3679728988 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9850031d40 con 0x7f9860076af0 2024-09-18T21:03:47.013 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:46.378+0000 7f986480e640 1 -- 172.21.15.77:0/3679728988 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9860110c70 con 0x7f9860076af0 2024-09-18T21:03:47.013 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:46.378+0000 7f984effd640 1 -- 172.21.15.77:0/3679728988 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f985003b5a0 con 0x7f9860076af0 2024-09-18T21:03:47.013 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:46.378+0000 7f986480e640 1 -- 172.21.15.77:0/3679728988 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9860111800 con 0x7f9860076af0 2024-09-18T21:03:47.013 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:46.379+0000 7f984effd640 1 -- 172.21.15.77:0/3679728988 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f9850039040 con 0x7f9860076af0 2024-09-18T21:03:47.013 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:46.379+0000 7f984effd640 1 -- 172.21.15.77:0/3679728988 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f9850041070 con 0x7f9860076af0 2024-09-18T21:03:47.013 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:46.379+0000 7f986480e640 1 -- 172.21.15.77:0/3679728988 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98601002f0 con 0x7f9860076af0 2024-09-18T21:03:47.013 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:46.382+0000 7f984effd640 1 -- 172.21.15.77:0/3679728988 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f985002ae60 con 0x7f9860076af0 2024-09-18T21:03:47.013 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:46.441+0000 7f986480e640 1 -- 172.21.15.77:0/3679728988 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f9860112230 con 0x7f9860076af0 2024-09-18T21:03:47.013 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:46.442+0000 7f984effd640 1 -- 172.21.15.77:0/3679728988 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f9850037070 con 0x7f9860076af0 2024-09-18T21:03:47.013 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:46.443+0000 7f986480e640 1 -- 172.21.15.77:0/3679728988 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9860076af0 msgr2=0x7f9860110530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:03:47.013 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:46.443+0000 7f986480e640 1 --2- 172.21.15.77:0/3679728988 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9860076af0 0x7f9860110530 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f985002a790 tx=0x7f9850032000 comp rx=0 tx=0).stop 2024-09-18T21:03:47.014 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:46.443+0000 7f986480e640 1 -- 172.21.15.77:0/3679728988 shutdown_connections 2024-09-18T21:03:47.014 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:46.443+0000 7f986480e640 1 --2- 172.21.15.77:0/3679728988 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9860076af0 0x7f9860110530 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:03:47.014 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:46.443+0000 7f986480e640 1 -- 172.21.15.77:0/3679728988 >> 172.21.15.77:0/3679728988 conn(0x7f98600fc6d0 msgr2=0x7f98600fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:03:47.014 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:46.443+0000 7f986480e640 1 -- 172.21.15.77:0/3679728988 shutdown_connections 2024-09-18T21:03:47.014 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:46.443+0000 7f986480e640 1 -- 172.21.15.77:0/3679728988 wait complete. 2024-09-18T21:03:47.014 INFO:teuthology.orchestra.run.smithi077.stdout:mon is available 2024-09-18T21:03:47.014 INFO:teuthology.orchestra.run.smithi077.stdout:Assimilating anything we can from ceph.conf... 2024-09-18T21:03:47.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:46 smithi077 ceph-mon[27316]: mon.smithi077 is new leader, mons smithi077 in quorum (ranks 0) 2024-09-18T21:03:47.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:46 smithi077 ceph-mon[27316]: monmap e1: 1 mons at {smithi077=[v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-18T21:03:47.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:46 smithi077 ceph-mon[27316]: fsmap 2024-09-18T21:03:47.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:46 smithi077 ceph-mon[27316]: osdmap e1: 0 total, 0 up, 0 in 2024-09-18T21:03:47.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:46 smithi077 ceph-mon[27316]: mgrmap e1: no daemons active 2024-09-18T21:03:47.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:46 smithi077 ceph-mon[27316]: from='client.? 172.21.15.77:0/3679728988' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-18T21:03:48.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:47 smithi077 ceph-mon[27316]: from='client.? 172.21.15.77:0/1274330904' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-18T21:03:48.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:47 smithi077 ceph-mon[27316]: from='client.? 172.21.15.77:0/1274330904' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-18T21:03:52.044 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 2024-09-18T21:03:52.045 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout [global] 2024-09-18T21:03:52.045 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout fsid = 5a76ec16-7601-11ef-bceb-c7b262605968 2024-09-18T21:03:52.045 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-18T21:03:52.045 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.77:3300,v1:172.21.15.77:6789] 2024-09-18T21:03:52.045 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-18T21:03:52.045 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-18T21:03:52.045 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-18T21:03:52.045 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-18T21:03:52.045 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 2024-09-18T21:03:52.045 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-18T21:03:52.045 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-18T21:03:52.045 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 2024-09-18T21:03:52.045 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout [osd] 2024-09-18T21:03:52.046 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-18T21:03:52.046 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-18T21:03:52.046 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-18T21:03:52.046 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-18T21:03:52.046 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-18T21:03:52.046 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:47.419+0000 7fea8862d640 1 Processor -- start 2024-09-18T21:03:52.046 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:47.419+0000 7fea8862d640 1 -- start start 2024-09-18T21:03:52.046 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:47.419+0000 7fea8862d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea80076b10 0x7fea80104be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:03:52.046 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:47.419+0000 7fea8862d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea80076f20 con 0x7fea80076b10 2024-09-18T21:03:52.046 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:47.420+0000 7fea863c9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea80076b10 0x7fea80104be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:03:52.046 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:47.420+0000 7fea863c9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea80076b10 0x7fea80104be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41730/0 (socket says 172.21.15.77:41730) 2024-09-18T21:03:52.046 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:47.420+0000 7fea863c9640 1 -- 172.21.15.77:0/2394065043 learned_addr learned my addr 172.21.15.77:0/2394065043 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:03:52.046 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:47.420+0000 7fea863c9640 1 -- 172.21.15.77:0/2394065043 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea80105120 con 0x7fea80076b10 2024-09-18T21:03:52.047 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:47.421+0000 7fea863c9640 1 --2- 172.21.15.77:0/2394065043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea80076b10 0x7fea80104be0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fea7c009840 tx=0x7fea7c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea849c5da65f5ec server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:03:52.047 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:47.421+0000 7fea853c7640 1 -- 172.21.15.77:0/2394065043 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fea7c032440 con 0x7fea80076b10 2024-09-18T21:03:52.047 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:47.421+0000 7fea853c7640 1 -- 172.21.15.77:0/2394065043 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea7c0325a0 con 0x7fea80076b10 2024-09-18T21:03:52.047 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:47.421+0000 7fea853c7640 1 -- 172.21.15.77:0/2394065043 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fea7c032890 con 0x7fea80076b10 2024-09-18T21:03:52.047 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:47.421+0000 7fea8862d640 1 -- 172.21.15.77:0/2394065043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea80076b10 msgr2=0x7fea80104be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:03:52.047 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:47.421+0000 7fea8862d640 1 --2- 172.21.15.77:0/2394065043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea80076b10 0x7fea80104be0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fea7c009840 tx=0x7fea7c0091d0 comp rx=0 tx=0).stop 2024-09-18T21:03:52.047 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:47.421+0000 7fea8862d640 1 -- 172.21.15.77:0/2394065043 shutdown_connections 2024-09-18T21:03:52.047 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:47.421+0000 7fea8862d640 1 --2- 172.21.15.77:0/2394065043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea80076b10 0x7fea80104be0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:03:52.047 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:47.421+0000 7fea8862d640 1 -- 172.21.15.77:0/2394065043 >> 172.21.15.77:0/2394065043 conn(0x7fea800fc6d0 msgr2=0x7fea800feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:03:52.047 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:47.421+0000 7fea8862d640 1 -- 172.21.15.77:0/2394065043 shutdown_connections 2024-09-18T21:03:52.047 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:47.421+0000 7fea8862d640 1 -- 172.21.15.77:0/2394065043 wait complete. 2024-09-18T21:03:52.047 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:47.422+0000 7fea8862d640 1 Processor -- start 2024-09-18T21:03:52.048 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:47.422+0000 7fea8862d640 1 -- start start 2024-09-18T21:03:52.048 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:47.422+0000 7fea8862d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea80076b10 0x7fea801105a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:03:52.048 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:47.422+0000 7fea8862d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea80110ae0 con 0x7fea80076b10 2024-09-18T21:03:52.048 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:47.422+0000 7fea863c9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea80076b10 0x7fea801105a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:03:52.048 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:47.422+0000 7fea863c9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea80076b10 0x7fea801105a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41734/0 (socket says 172.21.15.77:41734) 2024-09-18T21:03:52.048 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:47.422+0000 7fea863c9640 1 -- 172.21.15.77:0/1274330904 learned_addr learned my addr 172.21.15.77:0/1274330904 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:03:52.048 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:47.422+0000 7fea863c9640 1 -- 172.21.15.77:0/1274330904 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea7c009450 con 0x7fea80076b10 2024-09-18T21:03:52.048 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:47.423+0000 7fea863c9640 1 --2- 172.21.15.77:0/1274330904 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea80076b10 0x7fea801105a0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fea7c02a790 tx=0x7fea7c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:03:52.048 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:47.423+0000 7fea76ffd640 1 -- 172.21.15.77:0/1274330904 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fea7c031be0 con 0x7fea80076b10 2024-09-18T21:03:52.048 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:47.423+0000 7fea76ffd640 1 -- 172.21.15.77:0/1274330904 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea7c031d40 con 0x7fea80076b10 2024-09-18T21:03:52.048 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:47.423+0000 7fea8862d640 1 -- 172.21.15.77:0/1274330904 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea80110ce0 con 0x7fea80076b10 2024-09-18T21:03:52.048 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:47.423+0000 7fea76ffd640 1 -- 172.21.15.77:0/1274330904 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fea7c03b5a0 con 0x7fea80076b10 2024-09-18T21:03:52.048 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:47.423+0000 7fea8862d640 1 -- 172.21.15.77:0/1274330904 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea801110f0 con 0x7fea80076b10 2024-09-18T21:03:52.049 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:47.423+0000 7fea76ffd640 1 -- 172.21.15.77:0/1274330904 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fea7c039040 con 0x7fea80076b10 2024-09-18T21:03:52.049 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:47.423+0000 7fea76ffd640 1 -- 172.21.15.77:0/1274330904 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fea7c041030 con 0x7fea80076b10 2024-09-18T21:03:52.049 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:47.424+0000 7fea8862d640 1 -- 172.21.15.77:0/1274330904 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea8004b720 con 0x7fea80076b10 2024-09-18T21:03:52.049 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:47.426+0000 7fea76ffd640 1 -- 172.21.15.77:0/1274330904 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fea7c02ae60 con 0x7fea80076b10 2024-09-18T21:03:52.049 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:47.480+0000 7fea8862d640 1 -- 172.21.15.77:0/1274330904 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fea80109d20 con 0x7fea80076b10 2024-09-18T21:03:52.049 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:47.484+0000 7fea76ffd640 1 -- 172.21.15.77:0/1274330904 <== mon.0 v2:172.21.15.77:3300/0 7 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fea7c046cd0 con 0x7fea80076b10 2024-09-18T21:03:52.049 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:47.484+0000 7fea76ffd640 1 -- 172.21.15.77:0/1274330904 <== mon.0 v2:172.21.15.77:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+465 (secure 0 0 0) 0x7fea7c037070 con 0x7fea80076b10 2024-09-18T21:03:52.049 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:47.485+0000 7fea8862d640 1 -- 172.21.15.77:0/1274330904 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea80076b10 msgr2=0x7fea801105a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:03:52.049 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:47.485+0000 7fea8862d640 1 --2- 172.21.15.77:0/1274330904 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea80076b10 0x7fea801105a0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fea7c02a790 tx=0x7fea7c032000 comp rx=0 tx=0).stop 2024-09-18T21:03:52.049 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:47.485+0000 7fea8862d640 1 -- 172.21.15.77:0/1274330904 shutdown_connections 2024-09-18T21:03:52.049 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:47.485+0000 7fea8862d640 1 --2- 172.21.15.77:0/1274330904 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea80076b10 0x7fea801105a0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:03:52.049 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:47.485+0000 7fea8862d640 1 -- 172.21.15.77:0/1274330904 >> 172.21.15.77:0/1274330904 conn(0x7fea800fc6d0 msgr2=0x7fea800fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:03:52.049 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:47.485+0000 7fea8862d640 1 -- 172.21.15.77:0/1274330904 shutdown_connections 2024-09-18T21:03:52.050 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:47.485+0000 7fea8862d640 1 -- 172.21.15.77:0/1274330904 wait complete. 2024-09-18T21:03:52.050 INFO:teuthology.orchestra.run.smithi077.stdout:Generating new minimal ceph.conf... 2024-09-18T21:03:55.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:55 smithi077 ceph-mon[27316]: from='client.? 172.21.15.77:0/4043308862' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:03:58.007 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:54.956+0000 7fa1737b3640 1 Processor -- start 2024-09-18T21:03:58.007 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:54.957+0000 7fa1737b3640 1 -- start start 2024-09-18T21:03:58.007 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:54.957+0000 7fa1737b3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa16c1035c0 0x7fa16c1039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:03:58.007 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:54.957+0000 7fa1737b3640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa16c070e30 con 0x7fa16c1035c0 2024-09-18T21:03:58.007 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:54.957+0000 7fa17154f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa16c1035c0 0x7fa16c1039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:03:58.007 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:54.957+0000 7fa17154f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa16c1035c0 0x7fa16c1039d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40448/0 (socket says 172.21.15.77:40448) 2024-09-18T21:03:58.007 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:54.957+0000 7fa17154f640 1 -- 172.21.15.77:0/572307412 learned_addr learned my addr 172.21.15.77:0/572307412 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:03:58.007 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:54.957+0000 7fa17154f640 1 -- 172.21.15.77:0/572307412 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa16c103f10 con 0x7fa16c1035c0 2024-09-18T21:03:58.007 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:54.958+0000 7fa17154f640 1 --2- 172.21.15.77:0/572307412 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa16c1035c0 0x7fa16c1039d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa168009840 tx=0x7fa1680091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2de1d569d3b274a server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:03:58.007 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:54.958+0000 7fa163fff640 1 -- 172.21.15.77:0/572307412 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa168032440 con 0x7fa16c1035c0 2024-09-18T21:03:58.007 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:54.958+0000 7fa163fff640 1 -- 172.21.15.77:0/572307412 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fa168032a00 con 0x7fa16c1035c0 2024-09-18T21:03:58.008 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:54.958+0000 7fa163fff640 1 -- 172.21.15.77:0/572307412 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa1680319e0 con 0x7fa16c1035c0 2024-09-18T21:03:58.008 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:54.959+0000 7fa1737b3640 1 -- 172.21.15.77:0/572307412 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa16c1035c0 msgr2=0x7fa16c1039d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:03:58.008 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:54.959+0000 7fa1737b3640 1 --2- 172.21.15.77:0/572307412 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa16c1035c0 0x7fa16c1039d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa168009840 tx=0x7fa1680091d0 comp rx=0 tx=0).stop 2024-09-18T21:03:58.008 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:54.959+0000 7fa1737b3640 1 -- 172.21.15.77:0/572307412 shutdown_connections 2024-09-18T21:03:58.008 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:54.959+0000 7fa1737b3640 1 --2- 172.21.15.77:0/572307412 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa16c1035c0 0x7fa16c1039d0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:03:58.008 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:54.959+0000 7fa1737b3640 1 -- 172.21.15.77:0/572307412 >> 172.21.15.77:0/572307412 conn(0x7fa16c0fbdc0 msgr2=0x7fa16c0fe1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:03:58.008 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:54.959+0000 7fa1737b3640 1 -- 172.21.15.77:0/572307412 shutdown_connections 2024-09-18T21:03:58.008 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:54.959+0000 7fa1737b3640 1 -- 172.21.15.77:0/572307412 wait complete. 2024-09-18T21:03:58.008 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:54.960+0000 7fa1737b3640 1 Processor -- start 2024-09-18T21:03:58.008 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:54.960+0000 7fa1737b3640 1 -- start start 2024-09-18T21:03:58.008 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:54.960+0000 7fa1737b3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa16c1035c0 0x7fa16c110e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:03:58.008 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:54.960+0000 7fa1737b3640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa16c111340 con 0x7fa16c1035c0 2024-09-18T21:03:58.008 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:54.960+0000 7fa17154f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa16c1035c0 0x7fa16c110e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:03:58.008 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:54.960+0000 7fa17154f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa16c1035c0 0x7fa16c110e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40464/0 (socket says 172.21.15.77:40464) 2024-09-18T21:03:58.009 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:54.960+0000 7fa17154f640 1 -- 172.21.15.77:0/4043308862 learned_addr learned my addr 172.21.15.77:0/4043308862 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:03:58.009 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:54.960+0000 7fa17154f640 1 -- 172.21.15.77:0/4043308862 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa168009450 con 0x7fa16c1035c0 2024-09-18T21:03:58.009 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:54.960+0000 7fa17154f640 1 --2- 172.21.15.77:0/4043308862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa16c1035c0 0x7fa16c110e00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa1680098a0 tx=0x7fa168008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:03:58.009 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:54.961+0000 7fa161ffb640 1 -- 172.21.15.77:0/4043308862 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa168032880 con 0x7fa16c1035c0 2024-09-18T21:03:58.009 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:54.961+0000 7fa1737b3640 1 -- 172.21.15.77:0/4043308862 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa16c111540 con 0x7fa16c1035c0 2024-09-18T21:03:58.009 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:54.961+0000 7fa161ffb640 1 -- 172.21.15.77:0/4043308862 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fa16803d8b0 con 0x7fa16c1035c0 2024-09-18T21:03:58.009 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:54.961+0000 7fa161ffb640 1 -- 172.21.15.77:0/4043308862 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa16803b910 con 0x7fa16c1035c0 2024-09-18T21:03:58.009 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:54.961+0000 7fa1737b3640 1 -- 172.21.15.77:0/4043308862 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa16c111f90 con 0x7fa16c1035c0 2024-09-18T21:03:58.009 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:54.961+0000 7fa161ffb640 1 -- 172.21.15.77:0/4043308862 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fa168039070 con 0x7fa16c1035c0 2024-09-18T21:03:58.009 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:54.961+0000 7fa161ffb640 1 -- 172.21.15.77:0/4043308862 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fa168046710 con 0x7fa16c1035c0 2024-09-18T21:03:58.009 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:54.962+0000 7fa1737b3640 1 -- 172.21.15.77:0/4043308862 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa16c0ffa60 con 0x7fa16c1035c0 2024-09-18T21:03:58.009 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:54.964+0000 7fa161ffb640 1 -- 172.21.15.77:0/4043308862 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fa1680657a0 con 0x7fa16c1035c0 2024-09-18T21:03:58.009 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:55.020+0000 7fa1737b3640 1 -- 172.21.15.77:0/4043308862 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fa16c100a20 con 0x7fa16c1035c0 2024-09-18T21:03:58.010 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:55.021+0000 7fa161ffb640 1 -- 172.21.15.77:0/4043308862 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7fa168054020 con 0x7fa16c1035c0 2024-09-18T21:03:58.010 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:55.021+0000 7fa1737b3640 1 -- 172.21.15.77:0/4043308862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa16c1035c0 msgr2=0x7fa16c110e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:03:58.010 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:55.022+0000 7fa1737b3640 1 --2- 172.21.15.77:0/4043308862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa16c1035c0 0x7fa16c110e00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa1680098a0 tx=0x7fa168008040 comp rx=0 tx=0).stop 2024-09-18T21:03:58.010 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:55.022+0000 7fa1737b3640 1 -- 172.21.15.77:0/4043308862 shutdown_connections 2024-09-18T21:03:58.010 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:55.022+0000 7fa1737b3640 1 --2- 172.21.15.77:0/4043308862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa16c1035c0 0x7fa16c110e00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:03:58.010 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:55.022+0000 7fa1737b3640 1 -- 172.21.15.77:0/4043308862 >> 172.21.15.77:0/4043308862 conn(0x7fa16c0fbdc0 msgr2=0x7fa16c0fc940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:03:58.010 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:55.022+0000 7fa1737b3640 1 -- 172.21.15.77:0/4043308862 shutdown_connections 2024-09-18T21:03:58.010 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:55.022+0000 7fa1737b3640 1 -- 172.21.15.77:0/4043308862 wait complete. 2024-09-18T21:03:58.010 INFO:teuthology.orchestra.run.smithi077.stdout:Restarting the monitor... 2024-09-18T21:03:58.277 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:58 smithi077 systemd[1]: Stopping Ceph mon.smithi077 for 5a76ec16-7601-11ef-bceb-c7b262605968... 2024-09-18T21:03:58.593 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:58 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-mon-smithi077[27312]: 2024-09-18T21:03:58.276+0000 7f662306f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi077 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T21:03:58.593 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:58 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-mon-smithi077[27312]: 2024-09-18T21:03:58.276+0000 7f662306f640 -1 mon.smithi077@0(leader) e1 *** Got Signal Terminated *** 2024-09-18T21:03:58.593 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:58 smithi077 podman[27569]: 2024-09-18 21:03:58.30739861 +0000 UTC m=+0.135072146 container died 7b6cc66bc4978117a1d4adc78d4400d0ec001e2999b314abacc5310b8663045c (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-mon-smithi077, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=quincy-6e06d1e, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-18T21:03:58.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:58 smithi077 podman[27569]: 2024-09-18 21:03:58.651030162 +0000 UTC m=+0.478703687 container cleanup 7b6cc66bc4978117a1d4adc78d4400d0ec001e2999b314abacc5310b8663045c (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-mon-smithi077, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=quincy-6e06d1e, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T21:03:58.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:58 smithi077 bash[27569]: ceph-5a76ec16-7601-11ef-bceb-c7b262605968-mon-smithi077 2024-09-18T21:03:58.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:58 smithi077 podman[27581]: 2024-09-18 21:03:58.818672963 +0000 UTC m=+0.512162137 container remove 7b6cc66bc4978117a1d4adc78d4400d0ec001e2999b314abacc5310b8663045c (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-mon-smithi077, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=quincy-6e06d1e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-18T21:03:59.408 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 systemd[1]: ceph-5a76ec16-7601-11ef-bceb-c7b262605968@mon.smithi077.service: Deactivated successfully. 2024-09-18T21:03:59.408 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 systemd[1]: Stopped Ceph mon.smithi077 for 5a76ec16-7601-11ef-bceb-c7b262605968. 2024-09-18T21:03:59.408 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 systemd[1]: Starting Ceph mon.smithi077 for 5a76ec16-7601-11ef-bceb-c7b262605968... 2024-09-18T21:03:59.408 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 podman[27670]: 2024-09-18 21:03:59.183954628 +0000 UTC m=+0.015369699 image pull f63ad14e4e434a3de1d471d2841f01aa4ae27e9a9e20f9a042bea34292493ec9 quay.ceph.io/ceph-ci/ceph:quincy 2024-09-18T21:03:59.408 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 podman[27670]: 2024-09-18 21:03:59.302798519 +0000 UTC m=+0.134213582 container create bcbf289fe027866c14b0abccecb439ed698b6c6e0495f5acce4c3a5a4b0c7e50 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-mon-smithi077, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=quincy-6e06d1e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-18T21:03:59.559 INFO:teuthology.orchestra.run.smithi077.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-18T21:03:59.770 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 podman[27670]: 2024-09-18 21:03:59.496991852 +0000 UTC m=+0.328406927 container init bcbf289fe027866c14b0abccecb439ed698b6c6e0495f5acce4c3a5a4b0c7e50 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-mon-smithi077, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=quincy-6e06d1e, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-18T21:03:59.771 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 podman[27670]: 2024-09-18 21:03:59.500089482 +0000 UTC m=+0.331504545 container start bcbf289fe027866c14b0abccecb439ed698b6c6e0495f5acce4c3a5a4b0c7e50 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-mon-smithi077, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, RELEASE=quincy-6e06d1e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-18T21:03:59.771 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: set uid:gid to 167:167 (ceph:ceph) 2024-09-18T21:03:59.771 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable), process ceph-mon, pid 2 2024-09-18T21:03:59.771 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: pidfile_write: ignore empty --pid-file 2024-09-18T21:03:59.771 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: load: jerasure load: lrc 2024-09-18T21:03:59.771 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: RocksDB version: 6.15.5 2024-09-18T21:03:59.771 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-09-18T21:03:59.771 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Compile date Sep 18 2024 2024-09-18T21:03:59.771 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: DB SUMMARY 2024-09-18T21:03:59.772 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: DB Session ID: E5PEQIHGIPAXN2W8EX87 2024-09-18T21:03:59.772 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: CURRENT file: CURRENT 2024-09-18T21:03:59.772 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: IDENTITY file: IDENTITY 2024-09-18T21:03:59.772 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2024-09-18T21:03:59.772 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi077/store.db dir, Total Num: 1, files: 000008.sst 2024-09-18T21:03:59.772 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi077/store.db: 000010.log size: 98122 ; 2024-09-18T21:03:59.772 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.error_if_exists: 0 2024-09-18T21:03:59.772 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.create_if_missing: 0 2024-09-18T21:03:59.772 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.paranoid_checks: 1 2024-09-18T21:03:59.772 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-18T21:03:59.772 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.env: 0x564920515440 2024-09-18T21:03:59.773 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.fs: Posix File System 2024-09-18T21:03:59.773 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.info_log: 0x5649226e30c0 2024-09-18T21:03:59.773 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.max_file_opening_threads: 16 2024-09-18T21:03:59.773 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.statistics: (nil) 2024-09-18T21:03:59.773 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.use_fsync: 0 2024-09-18T21:03:59.773 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.max_log_file_size: 0 2024-09-18T21:03:59.773 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-18T21:03:59.773 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-18T21:03:59.773 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.keep_log_file_num: 1000 2024-09-18T21:03:59.773 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.recycle_log_file_num: 0 2024-09-18T21:03:59.773 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.allow_fallocate: 1 2024-09-18T21:03:59.773 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.allow_mmap_reads: 0 2024-09-18T21:03:59.773 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.allow_mmap_writes: 0 2024-09-18T21:03:59.774 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.use_direct_reads: 0 2024-09-18T21:03:59.774 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-18T21:03:59.774 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.create_missing_column_families: 0 2024-09-18T21:03:59.774 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.db_log_dir: 2024-09-18T21:03:59.774 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi077/store.db 2024-09-18T21:03:59.774 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-18T21:03:59.774 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-18T21:03:59.774 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-18T21:03:59.774 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-18T21:03:59.774 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-18T21:03:59.774 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-18T21:03:59.774 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.advise_random_on_open: 1 2024-09-18T21:03:59.774 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.db_write_buffer_size: 0 2024-09-18T21:03:59.774 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.write_buffer_manager: 0x5649227a0870 2024-09-18T21:03:59.774 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-18T21:03:59.775 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-09-18T21:03:59.775 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-18T21:03:59.775 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-18T21:03:59.775 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.rate_limiter: (nil) 2024-09-18T21:03:59.775 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-18T21:03:59.775 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.wal_recovery_mode: 2 2024-09-18T21:03:59.775 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.enable_thread_tracking: 0 2024-09-18T21:03:59.775 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.enable_pipelined_write: 0 2024-09-18T21:03:59.775 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.unordered_write: 0 2024-09-18T21:03:59.775 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-18T21:03:59.775 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-18T21:03:59.775 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-18T21:03:59.775 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-18T21:03:59.775 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.row_cache: None 2024-09-18T21:03:59.776 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.wal_filter: None 2024-09-18T21:03:59.776 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-18T21:03:59.776 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.allow_ingest_behind: 0 2024-09-18T21:03:59.777 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.preserve_deletes: 0 2024-09-18T21:03:59.777 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.two_write_queues: 0 2024-09-18T21:03:59.777 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.manual_wal_flush: 0 2024-09-18T21:03:59.777 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.atomic_flush: 0 2024-09-18T21:03:59.777 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-18T21:03:59.777 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-18T21:03:59.777 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-18T21:03:59.777 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.log_readahead_size: 0 2024-09-18T21:03:59.777 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-18T21:03:59.777 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.best_efforts_recovery: 0 2024-09-18T21:03:59.778 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-18T21:03:59.778 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-18T21:03:59.778 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.allow_data_in_errors: 0 2024-09-18T21:03:59.778 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.db_host_id: __hostname__ 2024-09-18T21:03:59.778 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.max_background_jobs: 2 2024-09-18T21:03:59.778 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.max_background_compactions: -1 2024-09-18T21:03:59.778 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.max_subcompactions: 1 2024-09-18T21:03:59.778 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-18T21:03:59.778 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-18T21:03:59.778 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-18T21:03:59.778 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.max_total_wal_size: 0 2024-09-18T21:03:59.778 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-18T21:03:59.778 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-18T21:03:59.779 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-18T21:03:59.779 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-18T21:03:59.779 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.max_open_files: -1 2024-09-18T21:03:59.779 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.bytes_per_sync: 0 2024-09-18T21:03:59.779 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-18T21:03:59.779 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-18T21:03:59.779 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.compaction_readahead_size: 0 2024-09-18T21:03:59.779 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.max_background_flushes: -1 2024-09-18T21:03:59.779 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Compression algorithms supported: 2024-09-18T21:03:59.779 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: kZSTD supported: 0 2024-09-18T21:03:59.779 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: kXpressCompression supported: 0 2024-09-18T21:03:59.779 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: kBZip2Compression supported: 0 2024-09-18T21:03:59.779 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-18T21:03:59.779 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: kLZ4Compression supported: 1 2024-09-18T21:03:59.780 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: kZlibCompression supported: 1 2024-09-18T21:03:59.780 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: kLZ4HCCompression supported: 1 2024-09-18T21:03:59.780 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: kSnappyCompression supported: 1 2024-09-18T21:03:59.780 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-18T21:03:59.780 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi077/store.db/MANIFEST-000009 2024-09-18T21:03:59.780 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-09-18T21:03:59.780 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-18T21:03:59.780 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.merge_operator: 2024-09-18T21:03:59.780 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.compaction_filter: None 2024-09-18T21:03:59.780 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.compaction_filter_factory: None 2024-09-18T21:03:59.780 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.sst_partitioner_factory: None 2024-09-18T21:03:59.780 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-18T21:03:59.780 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-18T21:03:59.780 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x564922689a38) 2024-09-18T21:03:59.781 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: cache_index_and_filter_blocks: 1 2024-09-18T21:03:59.781 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-18T21:03:59.781 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-18T21:03:59.781 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: pin_top_level_index_and_filter: 1 2024-09-18T21:03:59.781 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: index_type: 0 2024-09-18T21:03:59.781 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: data_block_index_type: 0 2024-09-18T21:03:59.781 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: index_shortening: 1 2024-09-18T21:03:59.781 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-18T21:03:59.781 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: hash_index_allow_collision: 1 2024-09-18T21:03:59.781 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: checksum: 1 2024-09-18T21:03:59.781 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: no_block_cache: 0 2024-09-18T21:03:59.781 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: block_cache: 0x5649226bf1f0 2024-09-18T21:03:59.781 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: block_cache_name: BinnedLRUCache 2024-09-18T21:03:59.782 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: block_cache_options: 2024-09-18T21:03:59.782 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: capacity : 536870912 2024-09-18T21:03:59.782 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: num_shard_bits : 4 2024-09-18T21:03:59.782 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: strict_capacity_limit : 0 2024-09-18T21:03:59.782 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: high_pri_pool_ratio: 0.000 2024-09-18T21:03:59.782 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: block_cache_compressed: (nil) 2024-09-18T21:03:59.782 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: persistent_cache: (nil) 2024-09-18T21:03:59.782 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: block_size: 4096 2024-09-18T21:03:59.782 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: block_size_deviation: 10 2024-09-18T21:03:59.782 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: block_restart_interval: 16 2024-09-18T21:03:59.782 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: index_block_restart_interval: 1 2024-09-18T21:03:59.782 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: metadata_block_size: 4096 2024-09-18T21:03:59.782 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: partition_filters: 0 2024-09-18T21:03:59.782 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: use_delta_encoding: 1 2024-09-18T21:03:59.783 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-09-18T21:03:59.783 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: whole_key_filtering: 1 2024-09-18T21:03:59.783 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: verify_compression: 0 2024-09-18T21:03:59.783 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: read_amp_bytes_per_bit: 0 2024-09-18T21:03:59.783 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: format_version: 4 2024-09-18T21:03:59.783 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: enable_index_compression: 1 2024-09-18T21:03:59.783 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: block_align: 0 2024-09-18T21:03:59.783 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.write_buffer_size: 33554432 2024-09-18T21:03:59.783 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.max_write_buffer_number: 2 2024-09-18T21:03:59.783 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.compression: NoCompression 2024-09-18T21:03:59.783 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.bottommost_compression: Disabled 2024-09-18T21:03:59.783 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.prefix_extractor: nullptr 2024-09-18T21:03:59.783 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-18T21:03:59.783 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.num_levels: 7 2024-09-18T21:03:59.784 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-18T21:03:59.784 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-18T21:03:59.784 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-18T21:03:59.784 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-18T21:03:59.784 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-18T21:03:59.784 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-18T21:03:59.784 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-18T21:03:59.784 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-18T21:03:59.784 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-18T21:03:59.784 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-18T21:03:59.784 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-18T21:03:59.784 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.compression_opts.level: 32767 2024-09-18T21:03:59.784 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.compression_opts.strategy: 0 2024-09-18T21:03:59.784 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-18T21:03:59.785 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-18T21:03:59.785 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-18T21:03:59.785 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.compression_opts.enabled: false 2024-09-18T21:03:59.785 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-18T21:03:59.785 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-18T21:03:59.785 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-18T21:03:59.785 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.target_file_size_base: 67108864 2024-09-18T21:03:59.785 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-18T21:03:59.785 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-18T21:03:59.785 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-18T21:03:59.785 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-18T21:03:59.785 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-18T21:03:59.785 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-18T21:03:59.785 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-18T21:03:59.786 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-18T21:03:59.786 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-18T21:03:59.786 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-18T21:03:59.786 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-18T21:03:59.786 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-18T21:03:59.786 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-18T21:03:59.786 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.arena_block_size: 4194304 2024-09-18T21:03:59.786 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-18T21:03:59.786 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-18T21:03:59.786 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-09-18T21:03:59.786 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.disable_auto_compactions: 0 2024-09-18T21:03:59.786 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-18T21:03:59.786 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-18T21:03:59.786 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-18T21:03:59.787 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-18T21:03:59.787 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-18T21:03:59.787 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-18T21:03:59.787 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-18T21:03:59.787 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-18T21:03:59.787 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-18T21:03:59.787 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-18T21:03:59.787 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-18T21:03:59.787 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.inplace_update_support: 0 2024-09-18T21:03:59.787 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-18T21:03:59.787 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-18T21:03:59.787 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-18T21:03:59.787 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-18T21:03:59.787 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.bloom_locality: 0 2024-09-18T21:03:59.787 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.max_successive_merges: 0 2024-09-18T21:03:59.788 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-18T21:03:59.788 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.paranoid_file_checks: 0 2024-09-18T21:03:59.788 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.force_consistency_checks: 1 2024-09-18T21:03:59.788 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.report_bg_io_stats: 0 2024-09-18T21:03:59.788 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.ttl: 2592000 2024-09-18T21:03:59.788 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-18T21:03:59.788 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.enable_blob_files: false 2024-09-18T21:03:59.788 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.min_blob_size: 0 2024-09-18T21:03:59.788 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.blob_file_size: 268435456 2024-09-18T21:03:59.788 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-18T21:03:59.788 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-18T21:03:59.789 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-18T21:03:59.789 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi077/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-18T21:03:59.789 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2024-09-18T21:03:59.789 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2024-09-18T21:03:59.789 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726693439523691, "job": 1, "event": "recovery_started", "wal_files": [10]} 2024-09-18T21:03:59.789 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2024-09-18T21:03:59.789 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-09-18T21:03:59.789 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726693439524567, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 93354, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 91434, "index_size": 254, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13564, "raw_average_key_size": 49, "raw_value_size": 84016, "raw_average_value_size": 307, "num_data_blocks": 11, "num_entries": 273, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1726693439, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "c20a2af3-da49-484f-b107-bf22ed632360", "db_session_id": "E5PEQIHGIPAXN2W8EX87"}} 2024-09-18T21:03:59.789 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2024-09-18T21:03:59.789 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726693439524904, "job": 1, "event": "recovery_finished"} 2024-09-18T21:03:59.789 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi077/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-18T21:03:59.789 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x5649226f2700 2024-09-18T21:03:59.789 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: DB pointer 0x5649226c2000 2024-09-18T21:03:59.790 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-09-18T21:03:59.790 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-09-18T21:03:59.790 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: ** DB Stats ** 2024-09-18T21:03:59.790 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-18T21:03:59.790 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-18T21:03:59.790 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-18T21:03:59.790 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-18T21:03:59.790 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-18T21:03:59.790 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-09-18T21:03:59.790 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-18T21:03:59.790 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: 2024-09-18T21:03:59.790 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: ** Compaction Stats [default] ** 2024-09-18T21:03:59.791 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-18T21:03:59.791 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-18T21:03:59.791 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: L0 2/0 92.99 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 147.6 0.00 0.00 1 0.001 0 0 2024-09-18T21:03:59.791 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Sum 2/0 92.99 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 147.6 0.00 0.00 1 0.001 0 0 2024-09-18T21:03:59.791 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 147.6 0.00 0.00 1 0.001 0 0 2024-09-18T21:03:59.791 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: 2024-09-18T21:03:59.791 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: ** Compaction Stats [default] ** 2024-09-18T21:03:59.791 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-18T21:03:59.791 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-18T21:03:59.791 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 147.6 0.00 0.00 1 0.001 0 0 2024-09-18T21:03:59.791 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-18T21:03:59.791 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-18T21:03:59.791 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-18T21:03:59.791 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-18T21:03:59.792 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-18T21:03:59.792 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-18T21:03:59.792 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Cumulative compaction: 0.00 GB write, 28.30 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-18T21:03:59.792 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Interval compaction: 0.00 GB write, 28.30 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-18T21:03:59.792 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-18T21:03:59.792 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: 2024-09-18T21:03:59.792 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-18T21:03:59.792 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: 2024-09-18T21:03:59.792 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: ** Compaction Stats [default] ** 2024-09-18T21:03:59.792 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-18T21:03:59.792 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-18T21:03:59.792 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: L0 2/0 92.99 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 147.6 0.00 0.00 1 0.001 0 0 2024-09-18T21:03:59.792 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Sum 2/0 92.99 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 147.6 0.00 0.00 1 0.001 0 0 2024-09-18T21:03:59.792 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-09-18T21:03:59.792 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: 2024-09-18T21:03:59.793 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: ** Compaction Stats [default] ** 2024-09-18T21:03:59.793 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-18T21:03:59.793 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-18T21:03:59.793 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 147.6 0.00 0.00 1 0.001 0 0 2024-09-18T21:03:59.793 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-18T21:03:59.793 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-18T21:03:59.793 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-18T21:03:59.793 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-18T21:03:59.793 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-18T21:03:59.793 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-18T21:03:59.793 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Cumulative compaction: 0.00 GB write, 28.01 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-18T21:03:59.793 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-18T21:03:59.793 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-18T21:03:59.794 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: 2024-09-18T21:03:59.794 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-18T21:03:59.794 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: starting mon.smithi077 rank 0 at public addrs [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] at bind addrs [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi077 fsid 5a76ec16-7601-11ef-bceb-c7b262605968 2024-09-18T21:03:59.794 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: mon.smithi077@-1(???) e1 preinit fsid 5a76ec16-7601-11ef-bceb-c7b262605968 2024-09-18T21:03:59.794 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: mon.smithi077@-1(???).mds e1 new map 2024-09-18T21:03:59.794 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: mon.smithi077@-1(???).mds e1 print_map 2024-09-18T21:03:59.794 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: e1 2024-09-18T21:03:59.794 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T21:03:59.794 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T21:03:59.794 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: legacy client fscid: -1 2024-09-18T21:03:59.794 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: 2024-09-18T21:03:59.794 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: No filesystems configured 2024-09-18T21:03:59.794 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: mon.smithi077@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-18T21:03:59.795 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: mon.smithi077@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-18T21:03:59.795 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: mon.smithi077@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-18T21:03:59.795 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: mon.smithi077@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-18T21:03:59.795 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: mon.smithi077@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-18T21:03:59.795 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 bash[27670]: bcbf289fe027866c14b0abccecb439ed698b6c6e0495f5acce4c3a5a4b0c7e50 2024-09-18T21:03:59.795 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 systemd[1]: Started Ceph mon.smithi077 for 5a76ec16-7601-11ef-bceb-c7b262605968. 2024-09-18T21:03:59.795 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: mon.smithi077 is new leader, mons smithi077 in quorum (ranks 0) 2024-09-18T21:03:59.795 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: monmap e1: 1 mons at {smithi077=[v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-18T21:03:59.795 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: fsmap 2024-09-18T21:03:59.795 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: osdmap e1: 0 total, 0 up, 0 in 2024-09-18T21:03:59.795 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:03:59 smithi077 ceph-mon[27689]: mgrmap e1: no daemons active 2024-09-18T21:04:00.644 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:59.975+0000 7f48a2d35640 1 Processor -- start 2024-09-18T21:04:00.644 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:59.975+0000 7f48a2d35640 1 -- start start 2024-09-18T21:04:00.644 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:59.976+0000 7f48a2d35640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f489c101f80 0x7f489c102390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:00.644 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:59.976+0000 7f48a2d35640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489c1028d0 con 0x7f489c101f80 2024-09-18T21:04:00.644 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:59.976+0000 7f48a0ad1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f489c101f80 0x7f489c102390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:00.644 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:59.976+0000 7f48a0ad1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f489c101f80 0x7f489c102390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34248/0 (socket says 172.21.15.77:34248) 2024-09-18T21:04:00.644 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:59.976+0000 7f48a0ad1640 1 -- 172.21.15.77:0/2719022049 learned_addr learned my addr 172.21.15.77:0/2719022049 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:00.644 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:59.976+0000 7f48a0ad1640 1 -- 172.21.15.77:0/2719022049 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f489c102a10 con 0x7f489c101f80 2024-09-18T21:04:00.644 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:59.978+0000 7f48a0ad1640 1 --2- 172.21.15.77:0/2719022049 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f489c101f80 0x7f489c102390 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f488c009840 tx=0x7f488c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc81703bf9e75d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:00.644 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:59.978+0000 7f489b7fe640 1 -- 172.21.15.77:0/2719022049 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f488c032440 con 0x7f489c101f80 2024-09-18T21:04:00.645 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:59.978+0000 7f489b7fe640 1 -- 172.21.15.77:0/2719022049 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f488c032a00 con 0x7f489c101f80 2024-09-18T21:04:00.645 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:59.978+0000 7f489b7fe640 1 -- 172.21.15.77:0/2719022049 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f488c0319e0 con 0x7f489c101f80 2024-09-18T21:04:00.645 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:59.979+0000 7f48a2d35640 1 -- 172.21.15.77:0/2719022049 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f489c101f80 msgr2=0x7f489c102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:00.645 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:59.979+0000 7f48a2d35640 1 --2- 172.21.15.77:0/2719022049 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f489c101f80 0x7f489c102390 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f488c009840 tx=0x7f488c0091d0 comp rx=0 tx=0).stop 2024-09-18T21:04:00.645 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:59.979+0000 7f48a2d35640 1 -- 172.21.15.77:0/2719022049 shutdown_connections 2024-09-18T21:04:00.645 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:59.979+0000 7f48a2d35640 1 --2- 172.21.15.77:0/2719022049 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f489c101f80 0x7f489c102390 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:00.645 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:59.979+0000 7f48a2d35640 1 -- 172.21.15.77:0/2719022049 >> 172.21.15.77:0/2719022049 conn(0x7f489c0fd7a0 msgr2=0x7f489c0ffbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:00.645 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:59.979+0000 7f48a2d35640 1 -- 172.21.15.77:0/2719022049 shutdown_connections 2024-09-18T21:04:00.645 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:59.979+0000 7f48a2d35640 1 -- 172.21.15.77:0/2719022049 wait complete. 2024-09-18T21:04:00.645 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:59.980+0000 7f48a2d35640 1 Processor -- start 2024-09-18T21:04:00.645 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:59.980+0000 7f48a2d35640 1 -- start start 2024-09-18T21:04:00.645 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:59.980+0000 7f48a2d35640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f489c101f80 0x7f489c110e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:00.646 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:59.980+0000 7f48a2d35640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489c111370 con 0x7f489c101f80 2024-09-18T21:04:00.646 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:59.980+0000 7f48a0ad1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f489c101f80 0x7f489c110e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:00.646 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:59.980+0000 7f48a0ad1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f489c101f80 0x7f489c110e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34258/0 (socket says 172.21.15.77:34258) 2024-09-18T21:04:00.646 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:59.980+0000 7f48a0ad1640 1 -- 172.21.15.77:0/951273717 learned_addr learned my addr 172.21.15.77:0/951273717 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:00.646 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:59.980+0000 7f48a0ad1640 1 -- 172.21.15.77:0/951273717 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f488c009450 con 0x7f489c101f80 2024-09-18T21:04:00.646 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:59.980+0000 7f48a0ad1640 1 --2- 172.21.15.77:0/951273717 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f489c101f80 0x7f489c110e30 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f488c0098a0 tx=0x7f488c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:00.646 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:59.981+0000 7f48997fa640 1 -- 172.21.15.77:0/951273717 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f488c032880 con 0x7f489c101f80 2024-09-18T21:04:00.646 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:59.981+0000 7f48997fa640 1 -- 172.21.15.77:0/951273717 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f488c03d8b0 con 0x7f489c101f80 2024-09-18T21:04:00.646 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:59.981+0000 7f48a2d35640 1 -- 172.21.15.77:0/951273717 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f489c111570 con 0x7f489c101f80 2024-09-18T21:04:00.646 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:59.981+0000 7f48997fa640 1 -- 172.21.15.77:0/951273717 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f488c03b8a0 con 0x7f489c101f80 2024-09-18T21:04:00.646 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:59.981+0000 7f48a2d35640 1 -- 172.21.15.77:0/951273717 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f489c112050 con 0x7f489c101f80 2024-09-18T21:04:00.646 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:59.981+0000 7f48997fa640 1 -- 172.21.15.77:0/951273717 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f488c039070 con 0x7f489c101f80 2024-09-18T21:04:00.646 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:59.981+0000 7f48997fa640 1 -- 172.21.15.77:0/951273717 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f488c046670 con 0x7f489c101f80 2024-09-18T21:04:00.647 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:59.982+0000 7f48a2d35640 1 -- 172.21.15.77:0/951273717 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f489c1013e0 con 0x7f489c101f80 2024-09-18T21:04:00.647 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:03:59.984+0000 7f48997fa640 1 -- 172.21.15.77:0/951273717 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f488c0657a0 con 0x7f489c101f80 2024-09-18T21:04:00.647 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:00.038+0000 7f48a2d35640 1 -- 172.21.15.77:0/951273717 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f489c04b720 con 0x7f489c101f80 2024-09-18T21:04:00.647 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:00.041+0000 7f48997fa640 1 -- 172.21.15.77:0/951273717 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f488c054020 con 0x7f489c101f80 2024-09-18T21:04:00.647 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:00.042+0000 7f48a2d35640 1 -- 172.21.15.77:0/951273717 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f489c101f80 msgr2=0x7f489c110e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:00.647 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:00.042+0000 7f48a2d35640 1 --2- 172.21.15.77:0/951273717 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f489c101f80 0x7f489c110e30 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f488c0098a0 tx=0x7f488c008040 comp rx=0 tx=0).stop 2024-09-18T21:04:00.647 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:00.042+0000 7f48a2d35640 1 -- 172.21.15.77:0/951273717 shutdown_connections 2024-09-18T21:04:00.647 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:00.042+0000 7f48a2d35640 1 --2- 172.21.15.77:0/951273717 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f489c101f80 0x7f489c110e30 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:00.647 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:00.042+0000 7f48a2d35640 1 -- 172.21.15.77:0/951273717 >> 172.21.15.77:0/951273717 conn(0x7f489c0fd7a0 msgr2=0x7f489c0fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:00.648 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:00.042+0000 7f48a2d35640 1 -- 172.21.15.77:0/951273717 shutdown_connections 2024-09-18T21:04:00.648 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:00.042+0000 7f48a2d35640 1 -- 172.21.15.77:0/951273717 wait complete. 2024-09-18T21:04:00.648 INFO:teuthology.orchestra.run.smithi077.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-18T21:04:00.648 INFO:teuthology.orchestra.run.smithi077.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-18T21:04:00.648 INFO:teuthology.orchestra.run.smithi077.stdout:Creating mgr... 2024-09-18T21:04:00.648 INFO:teuthology.orchestra.run.smithi077.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-18T21:04:00.648 INFO:teuthology.orchestra.run.smithi077.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-18T21:04:00.648 INFO:teuthology.orchestra.run.smithi077.stdout:Verifying port 0.0.0.0:8443 ... 2024-09-18T21:04:00.809 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-5a76ec16-7601-11ef-bceb-c7b262605968@mgr.smithi077.utkpjg 2024-09-18T21:04:00.809 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stderr Failed to reset failed state of unit ceph-5a76ec16-7601-11ef-bceb-c7b262605968@mgr.smithi077.utkpjg.service: Unit ceph-5a76ec16-7601-11ef-bceb-c7b262605968@mgr.smithi077.utkpjg.service not loaded. 2024-09-18T21:04:00.956 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-5a76ec16-7601-11ef-bceb-c7b262605968.target.wants/ceph-5a76ec16-7601-11ef-bceb-c7b262605968@mgr.smithi077.utkpjg.service → /etc/systemd/system/ceph-5a76ec16-7601-11ef-bceb-c7b262605968@.service. 2024-09-18T21:04:01.281 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:01 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/951273717' entity='client.admin' 2024-09-18T21:04:01.504 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-18T21:04:01.504 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout disabled 2024-09-18T21:04:01.512 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-18T21:04:01.512 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout inactive 2024-09-18T21:04:01.512 INFO:teuthology.orchestra.run.smithi077.stdout:firewalld.service is not enabled 2024-09-18T21:04:01.512 INFO:teuthology.orchestra.run.smithi077.stdout:Not possible to enable service . firewalld.service is not available 2024-09-18T21:04:01.521 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-18T21:04:01.521 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout disabled 2024-09-18T21:04:01.530 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-18T21:04:01.530 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout inactive 2024-09-18T21:04:01.530 INFO:teuthology.orchestra.run.smithi077.stdout:firewalld.service is not enabled 2024-09-18T21:04:01.530 INFO:teuthology.orchestra.run.smithi077.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-09-18T21:04:01.530 INFO:teuthology.orchestra.run.smithi077.stdout:Waiting for mgr to start... 2024-09-18T21:04:01.530 INFO:teuthology.orchestra.run.smithi077.stdout:Waiting for mgr... 2024-09-18T21:04:02.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:02 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/3833128551' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-18T21:04:03.309 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 2024-09-18T21:04:03.311 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout { 2024-09-18T21:04:03.311 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "fsid": "5a76ec16-7601-11ef-bceb-c7b262605968", 2024-09-18T21:04:03.311 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "health": { 2024-09-18T21:04:03.311 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-18T21:04:03.311 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-18T21:04:03.311 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-18T21:04:03.311 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-09-18T21:04:03.311 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-18T21:04:03.312 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-18T21:04:03.312 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 0 2024-09-18T21:04:03.312 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout ], 2024-09-18T21:04:03.312 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-18T21:04:03.312 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "smithi077" 2024-09-18T21:04:03.312 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout ], 2024-09-18T21:04:03.312 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-18T21:04:03.312 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-18T21:04:03.312 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-18T21:04:03.312 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-09-18T21:04:03.312 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-18T21:04:03.312 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-09-18T21:04:03.312 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-18T21:04:03.312 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-18T21:04:03.313 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-18T21:04:03.313 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-18T21:04:03.313 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-18T21:04:03.319 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-18T21:04:03.320 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-18T21:04:03.320 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-18T21:04:03.320 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-09-18T21:04:03.320 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-18T21:04:03.320 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-18T21:04:03.320 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-18T21:04:03.320 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-18T21:04:03.320 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-18T21:04:03.320 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-18T21:04:03.320 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-18T21:04:03.320 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-18T21:04:03.320 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-18T21:04:03.320 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-09-18T21:04:03.320 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-18T21:04:03.321 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-18T21:04:03.321 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-18T21:04:03.321 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-18T21:04:03.321 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-09-18T21:04:03.321 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-18T21:04:03.321 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-18T21:04:03.321 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-18T21:04:03.321 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-18T21:04:03.321 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-18T21:04:03.321 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-18T21:04:03.321 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "restful" 2024-09-18T21:04:03.321 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout ], 2024-09-18T21:04:03.321 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-18T21:04:03.321 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-09-18T21:04:03.322 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-18T21:04:03.322 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-18T21:04:03.322 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "modified": "2024-09-18T21:03:45.905231+0000", 2024-09-18T21:04:03.322 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-18T21:04:03.322 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-09-18T21:04:03.322 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-18T21:04:03.322 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout } 2024-09-18T21:04:03.322 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:01.933+0000 7ff0578aa640 1 Processor -- start 2024-09-18T21:04:03.322 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:01.933+0000 7ff0578aa640 1 -- start start 2024-09-18T21:04:03.322 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:01.933+0000 7ff0578aa640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff050076b70 0x7ff050104b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:03.322 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:01.934+0000 7ff0578aa640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0501050c0 con 0x7ff050076b70 2024-09-18T21:04:03.322 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:01.934+0000 7ff055646640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff050076b70 0x7ff050104b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:03.322 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:01.934+0000 7ff055646640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff050076b70 0x7ff050104b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34304/0 (socket says 172.21.15.77:34304) 2024-09-18T21:04:03.322 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:01.934+0000 7ff055646640 1 -- 172.21.15.77:0/4074744512 learned_addr learned my addr 172.21.15.77:0/4074744512 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:03.322 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:01.934+0000 7ff055646640 1 -- 172.21.15.77:0/4074744512 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff050105200 con 0x7ff050076b70 2024-09-18T21:04:03.323 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:01.935+0000 7ff055646640 1 --2- 172.21.15.77:0/4074744512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff050076b70 0x7ff050104b80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff040009840 tx=0x7ff0400091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=799bf7c176df676b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:03.323 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:01.935+0000 7ff047fff640 1 -- 172.21.15.77:0/4074744512 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff040032440 con 0x7ff050076b70 2024-09-18T21:04:03.323 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:01.935+0000 7ff047fff640 1 -- 172.21.15.77:0/4074744512 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7ff040032a00 con 0x7ff050076b70 2024-09-18T21:04:03.323 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:01.935+0000 7ff047fff640 1 -- 172.21.15.77:0/4074744512 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff040031a10 con 0x7ff050076b70 2024-09-18T21:04:03.323 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:01.936+0000 7ff0578aa640 1 -- 172.21.15.77:0/4074744512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff050076b70 msgr2=0x7ff050104b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:03.323 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:01.936+0000 7ff0578aa640 1 --2- 172.21.15.77:0/4074744512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff050076b70 0x7ff050104b80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff040009840 tx=0x7ff0400091d0 comp rx=0 tx=0).stop 2024-09-18T21:04:03.323 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:01.936+0000 7ff0578aa640 1 -- 172.21.15.77:0/4074744512 shutdown_connections 2024-09-18T21:04:03.323 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:01.936+0000 7ff0578aa640 1 --2- 172.21.15.77:0/4074744512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff050076b70 0x7ff050104b80 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:03.323 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:01.936+0000 7ff0578aa640 1 -- 172.21.15.77:0/4074744512 >> 172.21.15.77:0/4074744512 conn(0x7ff0500fc6d0 msgr2=0x7ff0500feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:03.323 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:01.936+0000 7ff0578aa640 1 -- 172.21.15.77:0/4074744512 shutdown_connections 2024-09-18T21:04:03.323 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:01.936+0000 7ff0578aa640 1 -- 172.21.15.77:0/4074744512 wait complete. 2024-09-18T21:04:03.323 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:01.937+0000 7ff0578aa640 1 Processor -- start 2024-09-18T21:04:03.323 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:01.937+0000 7ff0578aa640 1 -- start start 2024-09-18T21:04:03.323 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:01.937+0000 7ff0578aa640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff050076b70 0x7ff050110e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:03.324 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:01.937+0000 7ff0578aa640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff050111340 con 0x7ff050076b70 2024-09-18T21:04:03.324 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:01.937+0000 7ff055646640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff050076b70 0x7ff050110e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:03.324 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:01.937+0000 7ff055646640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff050076b70 0x7ff050110e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34308/0 (socket says 172.21.15.77:34308) 2024-09-18T21:04:03.324 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:01.937+0000 7ff055646640 1 -- 172.21.15.77:0/3833128551 learned_addr learned my addr 172.21.15.77:0/3833128551 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:03.324 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:01.937+0000 7ff055646640 1 -- 172.21.15.77:0/3833128551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff040009450 con 0x7ff050076b70 2024-09-18T21:04:03.324 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:01.937+0000 7ff055646640 1 --2- 172.21.15.77:0/3833128551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff050076b70 0x7ff050110e00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff040006a70 tx=0x7ff04002c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:03.324 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:01.937+0000 7ff045ffb640 1 -- 172.21.15.77:0/3833128551 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff040031d10 con 0x7ff050076b70 2024-09-18T21:04:03.324 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:01.938+0000 7ff045ffb640 1 -- 172.21.15.77:0/3833128551 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7ff040031e70 con 0x7ff050076b70 2024-09-18T21:04:03.324 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:01.938+0000 7ff045ffb640 1 -- 172.21.15.77:0/3833128551 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff04003b6f0 con 0x7ff050076b70 2024-09-18T21:04:03.324 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:01.938+0000 7ff0578aa640 1 -- 172.21.15.77:0/3833128551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff050111540 con 0x7ff050076b70 2024-09-18T21:04:03.324 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:01.938+0000 7ff0578aa640 1 -- 172.21.15.77:0/3833128551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff050111f90 con 0x7ff050076b70 2024-09-18T21:04:03.324 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:01.938+0000 7ff045ffb640 1 -- 172.21.15.77:0/3833128551 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7ff040039070 con 0x7ff050076b70 2024-09-18T21:04:03.325 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:01.938+0000 7ff045ffb640 1 -- 172.21.15.77:0/3833128551 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7ff040047800 con 0x7ff050076b70 2024-09-18T21:04:03.325 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:01.939+0000 7ff0578aa640 1 -- 172.21.15.77:0/3833128551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0501002f0 con 0x7ff050076b70 2024-09-18T21:04:03.325 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:01.941+0000 7ff045ffb640 1 -- 172.21.15.77:0/3833128551 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7ff040037070 con 0x7ff050076b70 2024-09-18T21:04:03.325 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:01.999+0000 7ff0578aa640 1 -- 172.21.15.77:0/3833128551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7ff050105ec0 con 0x7ff050076b70 2024-09-18T21:04:03.325 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:02.000+0000 7ff045ffb640 1 -- 172.21.15.77:0/3833128551 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7ff04003bd80 con 0x7ff050076b70 2024-09-18T21:04:03.325 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:02.001+0000 7ff0578aa640 1 -- 172.21.15.77:0/3833128551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff050076b70 msgr2=0x7ff050110e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:03.325 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:02.001+0000 7ff0578aa640 1 --2- 172.21.15.77:0/3833128551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff050076b70 0x7ff050110e00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff040006a70 tx=0x7ff04002c040 comp rx=0 tx=0).stop 2024-09-18T21:04:03.325 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:02.001+0000 7ff0578aa640 1 -- 172.21.15.77:0/3833128551 shutdown_connections 2024-09-18T21:04:03.325 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:02.001+0000 7ff0578aa640 1 --2- 172.21.15.77:0/3833128551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff050076b70 0x7ff050110e00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:03.325 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:02.001+0000 7ff0578aa640 1 -- 172.21.15.77:0/3833128551 >> 172.21.15.77:0/3833128551 conn(0x7ff0500fc6d0 msgr2=0x7ff0500fd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:03.325 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:02.001+0000 7ff0578aa640 1 -- 172.21.15.77:0/3833128551 shutdown_connections 2024-09-18T21:04:03.325 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:02.001+0000 7ff0578aa640 1 -- 172.21.15.77:0/3833128551 wait complete. 2024-09-18T21:04:03.325 INFO:teuthology.orchestra.run.smithi077.stdout:mgr not available, waiting (1/15)... 2024-09-18T21:04:05.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:05 smithi077 ceph-mon[27689]: Activating manager daemon smithi077.utkpjg 2024-09-18T21:04:05.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:05 smithi077 ceph-mon[27689]: mgrmap e2: smithi077.utkpjg(active, starting, since 0.00294821s) 2024-09-18T21:04:05.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:05 smithi077 ceph-mon[27689]: from='mgr.14100 172.21.15.77:0/2374009506' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-18T21:04:05.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:05 smithi077 ceph-mon[27689]: from='mgr.14100 172.21.15.77:0/2374009506' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-18T21:04:05.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:05 smithi077 ceph-mon[27689]: from='mgr.14100 172.21.15.77:0/2374009506' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-18T21:04:05.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:05 smithi077 ceph-mon[27689]: from='mgr.14100 172.21.15.77:0/2374009506' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mon metadata", "id": "smithi077"}]: dispatch 2024-09-18T21:04:05.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:05 smithi077 ceph-mon[27689]: from='mgr.14100 172.21.15.77:0/2374009506' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mgr metadata", "who": "smithi077.utkpjg", "id": "smithi077.utkpjg"}]: dispatch 2024-09-18T21:04:05.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:05 smithi077 ceph-mon[27689]: Manager daemon smithi077.utkpjg is now available 2024-09-18T21:04:05.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:05 smithi077 ceph-mon[27689]: from='mgr.14100 172.21.15.77:0/2374009506' entity='mgr.smithi077.utkpjg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi077.utkpjg/mirror_snapshot_schedule"}]: dispatch 2024-09-18T21:04:05.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:05 smithi077 ceph-mon[27689]: from='mgr.14100 172.21.15.77:0/2374009506' entity='mgr.smithi077.utkpjg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi077.utkpjg/trash_purge_schedule"}]: dispatch 2024-09-18T21:04:05.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:05 smithi077 ceph-mon[27689]: from='mgr.14100 172.21.15.77:0/2374009506' entity='mgr.smithi077.utkpjg' 2024-09-18T21:04:05.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:05 smithi077 ceph-mon[27689]: from='mgr.14100 172.21.15.77:0/2374009506' entity='mgr.smithi077.utkpjg' 2024-09-18T21:04:05.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:05 smithi077 ceph-mon[27689]: from='mgr.14100 172.21.15.77:0/2374009506' entity='mgr.smithi077.utkpjg' 2024-09-18T21:04:05.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:05 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/1972688158' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-18T21:04:06.296 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 2024-09-18T21:04:06.296 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout { 2024-09-18T21:04:06.296 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "fsid": "5a76ec16-7601-11ef-bceb-c7b262605968", 2024-09-18T21:04:06.296 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "health": { 2024-09-18T21:04:06.296 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-18T21:04:06.296 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-18T21:04:06.296 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-18T21:04:06.297 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-09-18T21:04:06.297 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-18T21:04:06.297 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-18T21:04:06.297 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 0 2024-09-18T21:04:06.297 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout ], 2024-09-18T21:04:06.297 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-18T21:04:06.297 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "smithi077" 2024-09-18T21:04:06.297 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout ], 2024-09-18T21:04:06.297 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-18T21:04:06.297 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-18T21:04:06.297 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-18T21:04:06.297 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-09-18T21:04:06.297 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-18T21:04:06.297 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-09-18T21:04:06.298 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-18T21:04:06.298 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-18T21:04:06.298 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-18T21:04:06.298 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-18T21:04:06.298 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-18T21:04:06.305 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-18T21:04:06.306 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-18T21:04:06.306 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-18T21:04:06.306 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-09-18T21:04:06.306 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-18T21:04:06.306 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-18T21:04:06.306 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-18T21:04:06.306 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-18T21:04:06.306 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-18T21:04:06.306 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-18T21:04:06.306 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-18T21:04:06.306 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-18T21:04:06.306 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-18T21:04:06.306 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-09-18T21:04:06.307 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-18T21:04:06.307 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-18T21:04:06.307 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-18T21:04:06.307 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-18T21:04:06.307 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-09-18T21:04:06.307 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-18T21:04:06.307 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-18T21:04:06.307 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-18T21:04:06.307 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-18T21:04:06.307 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-18T21:04:06.307 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-18T21:04:06.307 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "restful" 2024-09-18T21:04:06.308 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout ], 2024-09-18T21:04:06.308 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-18T21:04:06.308 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-09-18T21:04:06.308 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-18T21:04:06.308 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-18T21:04:06.308 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "modified": "2024-09-18T21:03:45.905231+0000", 2024-09-18T21:04:06.308 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-18T21:04:06.308 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-09-18T21:04:06.308 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-18T21:04:06.308 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout } 2024-09-18T21:04:06.308 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:05.703+0000 7fce6aa38640 1 Processor -- start 2024-09-18T21:04:06.308 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:05.703+0000 7fce6aa38640 1 -- start start 2024-09-18T21:04:06.308 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:05.703+0000 7fce6aa38640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce64076ab0 0x7fce64104c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:06.309 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:05.703+0000 7fce6aa38640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce64076ec0 con 0x7fce64076ab0 2024-09-18T21:04:06.309 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:05.703+0000 7fce63fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce64076ab0 0x7fce64104c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:06.309 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:05.703+0000 7fce63fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce64076ab0 0x7fce64104c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34312/0 (socket says 172.21.15.77:34312) 2024-09-18T21:04:06.309 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:05.703+0000 7fce63fff640 1 -- 172.21.15.77:0/500866703 learned_addr learned my addr 172.21.15.77:0/500866703 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:06.309 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:05.704+0000 7fce63fff640 1 -- 172.21.15.77:0/500866703 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce64105180 con 0x7fce64076ab0 2024-09-18T21:04:06.309 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:05.705+0000 7fce63fff640 1 --2- 172.21.15.77:0/500866703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce64076ab0 0x7fce64104c40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fce54009840 tx=0x7fce540091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cafaf76419270f9a server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:06.309 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:05.705+0000 7fce637fe640 1 -- 172.21.15.77:0/500866703 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fce54032440 con 0x7fce64076ab0 2024-09-18T21:04:06.309 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:05.705+0000 7fce637fe640 1 -- 172.21.15.77:0/500866703 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fce54032a00 con 0x7fce64076ab0 2024-09-18T21:04:06.309 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:05.705+0000 7fce637fe640 1 -- 172.21.15.77:0/500866703 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fce54031a10 con 0x7fce64076ab0 2024-09-18T21:04:06.309 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:05.706+0000 7fce6aa38640 1 -- 172.21.15.77:0/500866703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce64076ab0 msgr2=0x7fce64104c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:06.309 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:05.706+0000 7fce6aa38640 1 --2- 172.21.15.77:0/500866703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce64076ab0 0x7fce64104c40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fce54009840 tx=0x7fce540091d0 comp rx=0 tx=0).stop 2024-09-18T21:04:06.309 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:05.706+0000 7fce6aa38640 1 -- 172.21.15.77:0/500866703 shutdown_connections 2024-09-18T21:04:06.310 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:05.706+0000 7fce6aa38640 1 --2- 172.21.15.77:0/500866703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce64076ab0 0x7fce64104c40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:06.310 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:05.706+0000 7fce6aa38640 1 -- 172.21.15.77:0/500866703 >> 172.21.15.77:0/500866703 conn(0x7fce640fc6d0 msgr2=0x7fce640feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:06.310 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:05.706+0000 7fce6aa38640 1 -- 172.21.15.77:0/500866703 shutdown_connections 2024-09-18T21:04:06.310 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:05.706+0000 7fce6aa38640 1 -- 172.21.15.77:0/500866703 wait complete. 2024-09-18T21:04:06.310 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:05.706+0000 7fce6aa38640 1 Processor -- start 2024-09-18T21:04:06.310 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:05.706+0000 7fce6aa38640 1 -- start start 2024-09-18T21:04:06.310 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:05.707+0000 7fce6aa38640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce64076ab0 0x7fce64110e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:06.310 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:05.707+0000 7fce6aa38640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce64111340 con 0x7fce64076ab0 2024-09-18T21:04:06.310 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:05.707+0000 7fce63fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce64076ab0 0x7fce64110e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:06.310 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:05.707+0000 7fce63fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce64076ab0 0x7fce64110e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34322/0 (socket says 172.21.15.77:34322) 2024-09-18T21:04:06.310 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:05.707+0000 7fce63fff640 1 -- 172.21.15.77:0/1972688158 learned_addr learned my addr 172.21.15.77:0/1972688158 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:06.310 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:05.707+0000 7fce63fff640 1 -- 172.21.15.77:0/1972688158 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce54009450 con 0x7fce64076ab0 2024-09-18T21:04:06.310 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:05.707+0000 7fce63fff640 1 --2- 172.21.15.77:0/1972688158 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce64076ab0 0x7fce64110e00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fce540098a0 tx=0x7fce5402c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:06.310 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:05.707+0000 7fce617fa640 1 -- 172.21.15.77:0/1972688158 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fce540327b0 con 0x7fce64076ab0 2024-09-18T21:04:06.311 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:05.707+0000 7fce617fa640 1 -- 172.21.15.77:0/1972688158 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fce5403b870 con 0x7fce64076ab0 2024-09-18T21:04:06.311 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:05.707+0000 7fce6aa38640 1 -- 172.21.15.77:0/1972688158 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce64111540 con 0x7fce64076ab0 2024-09-18T21:04:06.311 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:05.707+0000 7fce617fa640 1 -- 172.21.15.77:0/1972688158 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fce5403a550 con 0x7fce64076ab0 2024-09-18T21:04:06.311 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:05.708+0000 7fce6aa38640 1 -- 172.21.15.77:0/1972688158 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce64111f90 con 0x7fce64076ab0 2024-09-18T21:04:06.311 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:05.708+0000 7fce617fa640 1 -- 172.21.15.77:0/1972688158 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fce54039040 con 0x7fce64076ab0 2024-09-18T21:04:06.311 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:05.708+0000 7fce617fa640 1 -- 172.21.15.77:0/1972688158 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fce540447e0 con 0x7fce64076ab0 2024-09-18T21:04:06.311 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:05.708+0000 7fce6aa38640 1 -- 172.21.15.77:0/1972688158 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce641002f0 con 0x7fce64076ab0 2024-09-18T21:04:06.311 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:05.711+0000 7fce617fa640 1 -- 172.21.15.77:0/1972688158 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fce54049060 con 0x7fce64076ab0 2024-09-18T21:04:06.311 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:05.737+0000 7fce617fa640 1 -- 172.21.15.77:0/1972688158 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mgrmap(e 2) v1 ==== 45263+0+0 (secure 0 0 0) 0x7fce5403b9e0 con 0x7fce64076ab0 2024-09-18T21:04:06.311 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:05.775+0000 7fce6aa38640 1 -- 172.21.15.77:0/1972688158 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fce6404b720 con 0x7fce64076ab0 2024-09-18T21:04:06.311 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:05.776+0000 7fce617fa640 1 -- 172.21.15.77:0/1972688158 <== mon.0 v2:172.21.15.77:3300/0 8 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fce5403f090 con 0x7fce64076ab0 2024-09-18T21:04:06.311 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:05.776+0000 7fce6aa38640 1 -- 172.21.15.77:0/1972688158 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce64076ab0 msgr2=0x7fce64110e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:06.311 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:05.776+0000 7fce6aa38640 1 --2- 172.21.15.77:0/1972688158 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce64076ab0 0x7fce64110e00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fce540098a0 tx=0x7fce5402c040 comp rx=0 tx=0).stop 2024-09-18T21:04:06.312 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:05.776+0000 7fce6aa38640 1 -- 172.21.15.77:0/1972688158 shutdown_connections 2024-09-18T21:04:06.312 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:05.776+0000 7fce6aa38640 1 --2- 172.21.15.77:0/1972688158 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce64076ab0 0x7fce64110e00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:06.312 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:05.776+0000 7fce6aa38640 1 -- 172.21.15.77:0/1972688158 >> 172.21.15.77:0/1972688158 conn(0x7fce640fc6d0 msgr2=0x7fce640fd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:06.312 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:05.777+0000 7fce6aa38640 1 -- 172.21.15.77:0/1972688158 shutdown_connections 2024-09-18T21:04:06.312 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:05.777+0000 7fce6aa38640 1 -- 172.21.15.77:0/1972688158 wait complete. 2024-09-18T21:04:06.312 INFO:teuthology.orchestra.run.smithi077.stdout:mgr not available, waiting (2/15)... 2024-09-18T21:04:08.180 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:07 smithi077 ceph-mon[27689]: mgrmap e3: smithi077.utkpjg(active, since 1.00689s) 2024-09-18T21:04:09.188 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:08 smithi077 ceph-mon[27689]: mgrmap e4: smithi077.utkpjg(active, since 2s) 2024-09-18T21:04:09.475 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 2024-09-18T21:04:09.477 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout { 2024-09-18T21:04:09.477 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "fsid": "5a76ec16-7601-11ef-bceb-c7b262605968", 2024-09-18T21:04:09.477 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "health": { 2024-09-18T21:04:09.478 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-18T21:04:09.478 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-18T21:04:09.478 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-18T21:04:09.478 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-09-18T21:04:09.478 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-18T21:04:09.478 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-18T21:04:09.478 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 0 2024-09-18T21:04:09.478 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout ], 2024-09-18T21:04:09.478 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-18T21:04:09.478 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "smithi077" 2024-09-18T21:04:09.478 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout ], 2024-09-18T21:04:09.478 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-18T21:04:09.478 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-18T21:04:09.478 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-18T21:04:09.479 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-09-18T21:04:09.479 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-18T21:04:09.479 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-09-18T21:04:09.479 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-18T21:04:09.479 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-18T21:04:09.479 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-18T21:04:09.479 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-18T21:04:09.479 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-18T21:04:09.487 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-18T21:04:09.487 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-18T21:04:09.487 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-18T21:04:09.487 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-09-18T21:04:09.487 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-18T21:04:09.488 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-18T21:04:09.488 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-18T21:04:09.488 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-18T21:04:09.488 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-18T21:04:09.488 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-18T21:04:09.488 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-18T21:04:09.488 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-18T21:04:09.488 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-18T21:04:09.488 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-09-18T21:04:09.488 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-18T21:04:09.488 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-18T21:04:09.488 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-18T21:04:09.488 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-18T21:04:09.489 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-09-18T21:04:09.489 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-18T21:04:09.489 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-18T21:04:09.489 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-18T21:04:09.489 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-18T21:04:09.489 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-18T21:04:09.489 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-18T21:04:09.489 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "restful" 2024-09-18T21:04:09.489 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout ], 2024-09-18T21:04:09.489 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-18T21:04:09.489 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-09-18T21:04:09.489 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-18T21:04:09.489 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-18T21:04:09.490 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "modified": "2024-09-18T21:03:45.905231+0000", 2024-09-18T21:04:09.490 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-18T21:04:09.490 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-09-18T21:04:09.490 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-18T21:04:09.490 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout } 2024-09-18T21:04:09.490 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.665+0000 7faac9c6f640 1 Processor -- start 2024-09-18T21:04:09.490 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.665+0000 7faac9c6f640 1 -- start start 2024-09-18T21:04:09.490 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.666+0000 7faac9c6f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faac4076b30 0x7faac4104bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:09.490 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.666+0000 7faac9c6f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac4076f40 con 0x7faac4076b30 2024-09-18T21:04:09.490 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.666+0000 7faac37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faac4076b30 0x7faac4104bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:09.490 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.666+0000 7faac37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faac4076b30 0x7faac4104bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34394/0 (socket says 172.21.15.77:34394) 2024-09-18T21:04:09.490 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.666+0000 7faac37fe640 1 -- 172.21.15.77:0/3293652433 learned_addr learned my addr 172.21.15.77:0/3293652433 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:09.490 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.666+0000 7faac37fe640 1 -- 172.21.15.77:0/3293652433 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac4105100 con 0x7faac4076b30 2024-09-18T21:04:09.490 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.667+0000 7faac37fe640 1 --2- 172.21.15.77:0/3293652433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faac4076b30 0x7faac4104bc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7faab4009840 tx=0x7faab40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a11fcc4858bc9746 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:09.491 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.667+0000 7faac27fc640 1 -- 172.21.15.77:0/3293652433 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faab4032440 con 0x7faac4076b30 2024-09-18T21:04:09.491 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.667+0000 7faac27fc640 1 -- 172.21.15.77:0/3293652433 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7faab4032a00 con 0x7faac4076b30 2024-09-18T21:04:09.491 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.667+0000 7faac27fc640 1 -- 172.21.15.77:0/3293652433 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faab4031a10 con 0x7faac4076b30 2024-09-18T21:04:09.491 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.668+0000 7faac9c6f640 1 -- 172.21.15.77:0/3293652433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faac4076b30 msgr2=0x7faac4104bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:09.491 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.668+0000 7faac9c6f640 1 --2- 172.21.15.77:0/3293652433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faac4076b30 0x7faac4104bc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7faab4009840 tx=0x7faab40091d0 comp rx=0 tx=0).stop 2024-09-18T21:04:09.491 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.668+0000 7faac9c6f640 1 -- 172.21.15.77:0/3293652433 shutdown_connections 2024-09-18T21:04:09.491 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.668+0000 7faac9c6f640 1 --2- 172.21.15.77:0/3293652433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faac4076b30 0x7faac4104bc0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:09.491 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.668+0000 7faac9c6f640 1 -- 172.21.15.77:0/3293652433 >> 172.21.15.77:0/3293652433 conn(0x7faac40fc6d0 msgr2=0x7faac40feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:09.491 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.668+0000 7faac9c6f640 1 -- 172.21.15.77:0/3293652433 shutdown_connections 2024-09-18T21:04:09.491 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.668+0000 7faac9c6f640 1 -- 172.21.15.77:0/3293652433 wait complete. 2024-09-18T21:04:09.491 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.668+0000 7faac9c6f640 1 Processor -- start 2024-09-18T21:04:09.491 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.669+0000 7faac9c6f640 1 -- start start 2024-09-18T21:04:09.491 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.669+0000 7faac9c6f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faac4076b30 0x7faac4110e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:09.492 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.669+0000 7faac9c6f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac4111340 con 0x7faac4076b30 2024-09-18T21:04:09.492 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.669+0000 7faac37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faac4076b30 0x7faac4110e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:09.492 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.669+0000 7faac37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faac4076b30 0x7faac4110e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34408/0 (socket says 172.21.15.77:34408) 2024-09-18T21:04:09.492 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.669+0000 7faac37fe640 1 -- 172.21.15.77:0/1172918718 learned_addr learned my addr 172.21.15.77:0/1172918718 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:09.492 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.669+0000 7faac37fe640 1 -- 172.21.15.77:0/1172918718 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab4009450 con 0x7faac4076b30 2024-09-18T21:04:09.492 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.669+0000 7faac37fe640 1 --2- 172.21.15.77:0/1172918718 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faac4076b30 0x7faac4110e00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7faab40098a0 tx=0x7faab402c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:09.492 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.669+0000 7faaabfff640 1 -- 172.21.15.77:0/1172918718 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faab40327b0 con 0x7faac4076b30 2024-09-18T21:04:09.492 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.669+0000 7faac9c6f640 1 -- 172.21.15.77:0/1172918718 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faac4111540 con 0x7faac4076b30 2024-09-18T21:04:09.492 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.670+0000 7faaabfff640 1 -- 172.21.15.77:0/1172918718 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7faab403b870 con 0x7faac4076b30 2024-09-18T21:04:09.492 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.670+0000 7faaabfff640 1 -- 172.21.15.77:0/1172918718 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faab403a550 con 0x7faac4076b30 2024-09-18T21:04:09.492 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.670+0000 7faac9c6f640 1 -- 172.21.15.77:0/1172918718 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faac4111f90 con 0x7faac4076b30 2024-09-18T21:04:09.492 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.670+0000 7faaabfff640 1 -- 172.21.15.77:0/1172918718 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 4) v1 ==== 45496+0+0 (secure 0 0 0) 0x7faab4039040 con 0x7faac4076b30 2024-09-18T21:04:09.492 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.671+0000 7faac9c6f640 1 -- 172.21.15.77:0/1172918718 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faac41002f0 con 0x7faac4076b30 2024-09-18T21:04:09.493 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.671+0000 7faaabfff640 1 --2- 172.21.15.77:0/1172918718 >> [v2:172.21.15.77:6800/3162219942,v1:172.21.15.77:6801/3162219942] conn(0x7faaac039450 0x7faaac03b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:09.493 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.671+0000 7faaabfff640 1 -- 172.21.15.77:0/1172918718 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7faab406c880 con 0x7faac4076b30 2024-09-18T21:04:09.493 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.671+0000 7faac2ffd640 1 --2- 172.21.15.77:0/1172918718 >> [v2:172.21.15.77:6800/3162219942,v1:172.21.15.77:6801/3162219942] conn(0x7faaac039450 0x7faaac03b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:09.493 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.671+0000 7faac2ffd640 1 --2- 172.21.15.77:0/1172918718 >> [v2:172.21.15.77:6800/3162219942,v1:172.21.15.77:6801/3162219942] conn(0x7faaac039450 0x7faaac03b900 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7faab8006fd0 tx=0x7faab8006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:09.493 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.675+0000 7faaabfff640 1 -- 172.21.15.77:0/1172918718 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7faab403a810 con 0x7faac4076b30 2024-09-18T21:04:09.493 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.897+0000 7faac9c6f640 1 -- 172.21.15.77:0/1172918718 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7faac404b720 con 0x7faac4076b30 2024-09-18T21:04:09.493 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.898+0000 7faaabfff640 1 -- 172.21.15.77:0/1172918718 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1247 (secure 0 0 0) 0x7faab403f070 con 0x7faac4076b30 2024-09-18T21:04:09.493 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.900+0000 7faac9c6f640 1 -- 172.21.15.77:0/1172918718 >> [v2:172.21.15.77:6800/3162219942,v1:172.21.15.77:6801/3162219942] conn(0x7faaac039450 msgr2=0x7faaac03b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:09.493 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.900+0000 7faac9c6f640 1 --2- 172.21.15.77:0/1172918718 >> [v2:172.21.15.77:6800/3162219942,v1:172.21.15.77:6801/3162219942] conn(0x7faaac039450 0x7faaac03b900 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7faab8006fd0 tx=0x7faab8006db0 comp rx=0 tx=0).stop 2024-09-18T21:04:09.493 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.900+0000 7faac9c6f640 1 -- 172.21.15.77:0/1172918718 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faac4076b30 msgr2=0x7faac4110e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:09.493 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.900+0000 7faac9c6f640 1 --2- 172.21.15.77:0/1172918718 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faac4076b30 0x7faac4110e00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7faab40098a0 tx=0x7faab402c040 comp rx=0 tx=0).stop 2024-09-18T21:04:09.493 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.900+0000 7faac9c6f640 1 -- 172.21.15.77:0/1172918718 shutdown_connections 2024-09-18T21:04:09.493 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.900+0000 7faac9c6f640 1 --2- 172.21.15.77:0/1172918718 >> [v2:172.21.15.77:6800/3162219942,v1:172.21.15.77:6801/3162219942] conn(0x7faaac039450 0x7faaac03b900 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:09.494 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.900+0000 7faac9c6f640 1 --2- 172.21.15.77:0/1172918718 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faac4076b30 0x7faac4110e00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:09.494 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.900+0000 7faac9c6f640 1 -- 172.21.15.77:0/1172918718 >> 172.21.15.77:0/1172918718 conn(0x7faac40fc6d0 msgr2=0x7faac40fd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:09.494 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.900+0000 7faac9c6f640 1 -- 172.21.15.77:0/1172918718 shutdown_connections 2024-09-18T21:04:09.494 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:08.900+0000 7faac9c6f640 1 -- 172.21.15.77:0/1172918718 wait complete. 2024-09-18T21:04:09.494 INFO:teuthology.orchestra.run.smithi077.stdout:mgr is available 2024-09-18T21:04:10.009 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:09 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/1172918718' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-18T21:04:10.854 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:10 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/808184819' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-18T21:04:10.862 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 2024-09-18T21:04:10.862 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout [global] 2024-09-18T21:04:10.863 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout fsid = 5a76ec16-7601-11ef-bceb-c7b262605968 2024-09-18T21:04:10.863 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-18T21:04:10.863 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-18T21:04:10.863 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-18T21:04:10.863 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-18T21:04:10.863 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-18T21:04:10.863 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 2024-09-18T21:04:10.863 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-18T21:04:10.863 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-18T21:04:10.863 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 2024-09-18T21:04:10.863 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout [osd] 2024-09-18T21:04:10.864 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-18T21:04:10.864 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-18T21:04:10.864 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-18T21:04:10.864 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-18T21:04:10.864 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-18T21:04:10.864 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.090+0000 7f90a572a640 1 Processor -- start 2024-09-18T21:04:10.864 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.090+0000 7f90a572a640 1 -- start start 2024-09-18T21:04:10.864 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.091+0000 7f90a572a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90a0100e90 0x7f90a01012a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:10.864 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.091+0000 7f90a572a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a01017e0 con 0x7f90a0100e90 2024-09-18T21:04:10.864 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.091+0000 7f909effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90a0100e90 0x7f90a01012a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:10.864 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.091+0000 7f909effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90a0100e90 0x7f90a01012a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45850/0 (socket says 172.21.15.77:45850) 2024-09-18T21:04:10.864 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.091+0000 7f909effd640 1 -- 172.21.15.77:0/381854174 learned_addr learned my addr 172.21.15.77:0/381854174 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:10.865 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.091+0000 7f909effd640 1 -- 172.21.15.77:0/381854174 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a0101920 con 0x7f90a0100e90 2024-09-18T21:04:10.865 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.092+0000 7f909effd640 1 --2- 172.21.15.77:0/381854174 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90a0100e90 0x7f90a01012a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9090009840 tx=0x7f90900091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f84a677658775c93 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:10.865 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.092+0000 7f909e7fc640 1 -- 172.21.15.77:0/381854174 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9090032440 con 0x7f90a0100e90 2024-09-18T21:04:10.865 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.092+0000 7f909e7fc640 1 -- 172.21.15.77:0/381854174 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f9090032a00 con 0x7f90a0100e90 2024-09-18T21:04:10.865 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.092+0000 7f909e7fc640 1 -- 172.21.15.77:0/381854174 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9090031a10 con 0x7f90a0100e90 2024-09-18T21:04:10.865 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.093+0000 7f90a572a640 1 -- 172.21.15.77:0/381854174 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90a0100e90 msgr2=0x7f90a01012a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:10.865 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.093+0000 7f90a572a640 1 --2- 172.21.15.77:0/381854174 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90a0100e90 0x7f90a01012a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9090009840 tx=0x7f90900091d0 comp rx=0 tx=0).stop 2024-09-18T21:04:10.865 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.093+0000 7f90a572a640 1 -- 172.21.15.77:0/381854174 shutdown_connections 2024-09-18T21:04:10.865 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.093+0000 7f90a572a640 1 --2- 172.21.15.77:0/381854174 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90a0100e90 0x7f90a01012a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:10.865 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.093+0000 7f90a572a640 1 -- 172.21.15.77:0/381854174 >> 172.21.15.77:0/381854174 conn(0x7f90a00fc6d0 msgr2=0x7f90a00feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:10.865 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.093+0000 7f90a572a640 1 -- 172.21.15.77:0/381854174 shutdown_connections 2024-09-18T21:04:10.865 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.093+0000 7f90a572a640 1 -- 172.21.15.77:0/381854174 wait complete. 2024-09-18T21:04:10.866 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.093+0000 7f90a572a640 1 Processor -- start 2024-09-18T21:04:10.866 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.093+0000 7f90a572a640 1 -- start start 2024-09-18T21:04:10.866 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.094+0000 7f90a572a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90a0100e90 0x7f90a0076ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:10.866 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.094+0000 7f90a572a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a0113a80 con 0x7f90a0100e90 2024-09-18T21:04:10.866 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.094+0000 7f909effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90a0100e90 0x7f90a0076ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:10.866 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.094+0000 7f909effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90a0100e90 0x7f90a0076ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45866/0 (socket says 172.21.15.77:45866) 2024-09-18T21:04:10.866 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.094+0000 7f909effd640 1 -- 172.21.15.77:0/808184819 learned_addr learned my addr 172.21.15.77:0/808184819 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:10.866 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.094+0000 7f909effd640 1 -- 172.21.15.77:0/808184819 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9090009450 con 0x7f90a0100e90 2024-09-18T21:04:10.866 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.094+0000 7f909effd640 1 --2- 172.21.15.77:0/808184819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90a0100e90 0x7f90a0076ae0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9090006a70 tx=0x7f909002c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:10.866 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.094+0000 7f90977fe640 1 -- 172.21.15.77:0/808184819 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9090031d10 con 0x7f90a0100e90 2024-09-18T21:04:10.866 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.094+0000 7f90977fe640 1 -- 172.21.15.77:0/808184819 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f9090031e70 con 0x7f90a0100e90 2024-09-18T21:04:10.866 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.094+0000 7f90a572a640 1 -- 172.21.15.77:0/808184819 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90a0113bc0 con 0x7f90a0100e90 2024-09-18T21:04:10.866 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.094+0000 7f90977fe640 1 -- 172.21.15.77:0/808184819 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f909003b6f0 con 0x7f90a0100e90 2024-09-18T21:04:10.867 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.094+0000 7f90a572a640 1 -- 172.21.15.77:0/808184819 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a0113fd0 con 0x7f90a0100e90 2024-09-18T21:04:10.867 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.095+0000 7f90977fe640 1 -- 172.21.15.77:0/808184819 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 4) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f9090039070 con 0x7f90a0100e90 2024-09-18T21:04:10.867 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.095+0000 7f90977fe640 1 --2- 172.21.15.77:0/808184819 >> [v2:172.21.15.77:6800/3162219942,v1:172.21.15.77:6801/3162219942] conn(0x7f908c039450 0x7f908c03b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:10.867 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.095+0000 7f90a572a640 1 -- 172.21.15.77:0/808184819 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90a004b720 con 0x7f90a0100e90 2024-09-18T21:04:10.867 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.096+0000 7f90977fe640 1 -- 172.21.15.77:0/808184819 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f909006cbb0 con 0x7f90a0100e90 2024-09-18T21:04:10.867 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.096+0000 7f9097fff640 1 --2- 172.21.15.77:0/808184819 >> [v2:172.21.15.77:6800/3162219942,v1:172.21.15.77:6801/3162219942] conn(0x7f908c039450 0x7f908c03b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:10.867 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.096+0000 7f9097fff640 1 --2- 172.21.15.77:0/808184819 >> [v2:172.21.15.77:6800/3162219942,v1:172.21.15.77:6801/3162219942] conn(0x7f908c039450 0x7f908c03b900 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9088006fd0 tx=0x7f9088006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:10.867 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.100+0000 7f90977fe640 1 -- 172.21.15.77:0/808184819 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f909006ee60 con 0x7f90a0100e90 2024-09-18T21:04:10.867 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.258+0000 7f90a572a640 1 -- 172.21.15.77:0/808184819 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f90a0102b10 con 0x7f90a0100e90 2024-09-18T21:04:10.867 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.259+0000 7f90977fe640 1 -- 172.21.15.77:0/808184819 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+409 (secure 0 0 0) 0x7f9090037020 con 0x7f90a0100e90 2024-09-18T21:04:10.867 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.261+0000 7f90a572a640 1 -- 172.21.15.77:0/808184819 >> [v2:172.21.15.77:6800/3162219942,v1:172.21.15.77:6801/3162219942] conn(0x7f908c039450 msgr2=0x7f908c03b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:10.867 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.261+0000 7f90a572a640 1 --2- 172.21.15.77:0/808184819 >> [v2:172.21.15.77:6800/3162219942,v1:172.21.15.77:6801/3162219942] conn(0x7f908c039450 0x7f908c03b900 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9088006fd0 tx=0x7f9088006db0 comp rx=0 tx=0).stop 2024-09-18T21:04:10.867 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.261+0000 7f90a572a640 1 -- 172.21.15.77:0/808184819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90a0100e90 msgr2=0x7f90a0076ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:10.868 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.261+0000 7f90a572a640 1 --2- 172.21.15.77:0/808184819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90a0100e90 0x7f90a0076ae0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9090006a70 tx=0x7f909002c040 comp rx=0 tx=0).stop 2024-09-18T21:04:10.868 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.261+0000 7f90a572a640 1 -- 172.21.15.77:0/808184819 shutdown_connections 2024-09-18T21:04:10.868 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.261+0000 7f90a572a640 1 --2- 172.21.15.77:0/808184819 >> [v2:172.21.15.77:6800/3162219942,v1:172.21.15.77:6801/3162219942] conn(0x7f908c039450 0x7f908c03b900 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:10.868 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.261+0000 7f90a572a640 1 --2- 172.21.15.77:0/808184819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90a0100e90 0x7f90a0076ae0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:10.868 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.261+0000 7f90a572a640 1 -- 172.21.15.77:0/808184819 >> 172.21.15.77:0/808184819 conn(0x7f90a00fc6d0 msgr2=0x7f90a00fd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:10.868 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.261+0000 7f90a572a640 1 -- 172.21.15.77:0/808184819 shutdown_connections 2024-09-18T21:04:10.868 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:10.261+0000 7f90a572a640 1 -- 172.21.15.77:0/808184819 wait complete. 2024-09-18T21:04:10.868 INFO:teuthology.orchestra.run.smithi077.stdout:Enabling cephadm module... 2024-09-18T21:04:11.997 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:11 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/2316295424' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-18T21:04:12.351 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.222+0000 7f8cb1075640 1 Processor -- start 2024-09-18T21:04:12.351 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.222+0000 7f8cb1075640 1 -- start start 2024-09-18T21:04:12.351 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.222+0000 7f8cb1075640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cac101f00 0x7f8cac102310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:12.351 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.222+0000 7f8cb1075640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac102850 con 0x7f8cac101f00 2024-09-18T21:04:12.352 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.222+0000 7f8caad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cac101f00 0x7f8cac102310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:12.352 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.222+0000 7f8caad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cac101f00 0x7f8cac102310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45882/0 (socket says 172.21.15.77:45882) 2024-09-18T21:04:12.352 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.222+0000 7f8caad9d640 1 -- 172.21.15.77:0/440284929 learned_addr learned my addr 172.21.15.77:0/440284929 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:12.352 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.222+0000 7f8caad9d640 1 -- 172.21.15.77:0/440284929 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cac102990 con 0x7f8cac101f00 2024-09-18T21:04:12.352 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.223+0000 7f8caad9d640 1 --2- 172.21.15.77:0/440284929 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cac101f00 0x7f8cac102310 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c009840 tx=0x7f8c9c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5841ac151e42bf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:12.352 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.223+0000 7f8ca9d9b640 1 -- 172.21.15.77:0/440284929 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8c9c032440 con 0x7f8cac101f00 2024-09-18T21:04:12.352 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.223+0000 7f8ca9d9b640 1 -- 172.21.15.77:0/440284929 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f8c9c032a00 con 0x7f8cac101f00 2024-09-18T21:04:12.352 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.223+0000 7f8ca9d9b640 1 -- 172.21.15.77:0/440284929 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8c9c0319e0 con 0x7f8cac101f00 2024-09-18T21:04:12.352 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.224+0000 7f8cb1075640 1 -- 172.21.15.77:0/440284929 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cac101f00 msgr2=0x7f8cac102310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:12.352 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.224+0000 7f8cb1075640 1 --2- 172.21.15.77:0/440284929 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cac101f00 0x7f8cac102310 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c009840 tx=0x7f8c9c0091d0 comp rx=0 tx=0).stop 2024-09-18T21:04:12.352 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.224+0000 7f8cb1075640 1 -- 172.21.15.77:0/440284929 shutdown_connections 2024-09-18T21:04:12.352 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.224+0000 7f8cb1075640 1 --2- 172.21.15.77:0/440284929 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cac101f00 0x7f8cac102310 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:12.352 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.224+0000 7f8cb1075640 1 -- 172.21.15.77:0/440284929 >> 172.21.15.77:0/440284929 conn(0x7f8cac0fd6e0 msgr2=0x7f8cac0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:12.353 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.224+0000 7f8cb1075640 1 -- 172.21.15.77:0/440284929 shutdown_connections 2024-09-18T21:04:12.353 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.224+0000 7f8cb1075640 1 -- 172.21.15.77:0/440284929 wait complete. 2024-09-18T21:04:12.353 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.224+0000 7f8cb1075640 1 Processor -- start 2024-09-18T21:04:12.353 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.224+0000 7f8cb1075640 1 -- start start 2024-09-18T21:04:12.353 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.224+0000 7f8cb1075640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cac101f00 0x7f8cac110d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:12.353 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.224+0000 7f8cb1075640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac111240 con 0x7f8cac101f00 2024-09-18T21:04:12.353 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.225+0000 7f8caad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cac101f00 0x7f8cac110d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:12.353 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.225+0000 7f8caad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cac101f00 0x7f8cac110d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45884/0 (socket says 172.21.15.77:45884) 2024-09-18T21:04:12.353 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.225+0000 7f8caad9d640 1 -- 172.21.15.77:0/2316295424 learned_addr learned my addr 172.21.15.77:0/2316295424 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:12.353 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.225+0000 7f8caad9d640 1 -- 172.21.15.77:0/2316295424 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c9c009450 con 0x7f8cac101f00 2024-09-18T21:04:12.353 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.225+0000 7f8caad9d640 1 --2- 172.21.15.77:0/2316295424 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cac101f00 0x7f8cac110d00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c0098a0 tx=0x7f8c9c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:12.353 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.225+0000 7f8c937fe640 1 -- 172.21.15.77:0/2316295424 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8c9c032880 con 0x7f8cac101f00 2024-09-18T21:04:12.353 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.225+0000 7f8c937fe640 1 -- 172.21.15.77:0/2316295424 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f8c9c03d8b0 con 0x7f8cac101f00 2024-09-18T21:04:12.353 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.225+0000 7f8cb1075640 1 -- 172.21.15.77:0/2316295424 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cac111440 con 0x7f8cac101f00 2024-09-18T21:04:12.354 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.225+0000 7f8c937fe640 1 -- 172.21.15.77:0/2316295424 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8c9c03b910 con 0x7f8cac101f00 2024-09-18T21:04:12.354 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.225+0000 7f8cb1075640 1 -- 172.21.15.77:0/2316295424 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cac1118b0 con 0x7f8cac101f00 2024-09-18T21:04:12.354 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.226+0000 7f8c937fe640 1 -- 172.21.15.77:0/2316295424 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 4) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f8c9c039070 con 0x7f8cac101f00 2024-09-18T21:04:12.354 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.226+0000 7f8cb1075640 1 -- 172.21.15.77:0/2316295424 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cac04b720 con 0x7f8cac101f00 2024-09-18T21:04:12.354 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.226+0000 7f8c937fe640 1 --2- 172.21.15.77:0/2316295424 >> [v2:172.21.15.77:6800/3162219942,v1:172.21.15.77:6801/3162219942] conn(0x7f8c94039450 0x7f8c9403b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:12.354 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.226+0000 7f8c937fe640 1 -- 172.21.15.77:0/2316295424 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f8c9c06cd90 con 0x7f8cac101f00 2024-09-18T21:04:12.354 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.226+0000 7f8caa59c640 1 --2- 172.21.15.77:0/2316295424 >> [v2:172.21.15.77:6800/3162219942,v1:172.21.15.77:6801/3162219942] conn(0x7f8c94039450 0x7f8c9403b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:12.354 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.227+0000 7f8caa59c640 1 --2- 172.21.15.77:0/2316295424 >> [v2:172.21.15.77:6800/3162219942,v1:172.21.15.77:6801/3162219942] conn(0x7f8c94039450 0x7f8c9403b900 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8ca0006fd0 tx=0x7f8ca0006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:12.354 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.231+0000 7f8c937fe640 1 -- 172.21.15.77:0/2316295424 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8c9c04ed70 con 0x7f8cac101f00 2024-09-18T21:04:12.354 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.425+0000 7f8cb1075640 1 -- 172.21.15.77:0/2316295424 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f8cac103cb0 con 0x7f8cac101f00 2024-09-18T21:04:12.354 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.748+0000 7f8c937fe640 1 -- 172.21.15.77:0/2316295424 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mgrmap(e 5) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f8c9c04e9a0 con 0x7f8cac101f00 2024-09-18T21:04:12.354 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.749+0000 7f8c937fe640 1 -- 172.21.15.77:0/2316295424 <== mon.0 v2:172.21.15.77:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f8c9c039320 con 0x7f8cac101f00 2024-09-18T21:04:12.354 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.751+0000 7f8cb1075640 1 -- 172.21.15.77:0/2316295424 >> [v2:172.21.15.77:6800/3162219942,v1:172.21.15.77:6801/3162219942] conn(0x7f8c94039450 msgr2=0x7f8c9403b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:12.354 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.751+0000 7f8cb1075640 1 --2- 172.21.15.77:0/2316295424 >> [v2:172.21.15.77:6800/3162219942,v1:172.21.15.77:6801/3162219942] conn(0x7f8c94039450 0x7f8c9403b900 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8ca0006fd0 tx=0x7f8ca0006db0 comp rx=0 tx=0).stop 2024-09-18T21:04:12.355 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.751+0000 7f8cb1075640 1 -- 172.21.15.77:0/2316295424 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cac101f00 msgr2=0x7f8cac110d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:12.355 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.751+0000 7f8cb1075640 1 --2- 172.21.15.77:0/2316295424 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cac101f00 0x7f8cac110d00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c0098a0 tx=0x7f8c9c008040 comp rx=0 tx=0).stop 2024-09-18T21:04:12.355 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.751+0000 7f8cb1075640 1 -- 172.21.15.77:0/2316295424 shutdown_connections 2024-09-18T21:04:12.355 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.751+0000 7f8cb1075640 1 --2- 172.21.15.77:0/2316295424 >> [v2:172.21.15.77:6800/3162219942,v1:172.21.15.77:6801/3162219942] conn(0x7f8c94039450 0x7f8c9403b900 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:12.355 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.751+0000 7f8cb1075640 1 --2- 172.21.15.77:0/2316295424 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8cac101f00 0x7f8cac110d00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:12.355 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.751+0000 7f8cb1075640 1 -- 172.21.15.77:0/2316295424 >> 172.21.15.77:0/2316295424 conn(0x7f8cac0fd6e0 msgr2=0x7f8cac0fe280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:12.355 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.751+0000 7f8cb1075640 1 -- 172.21.15.77:0/2316295424 shutdown_connections 2024-09-18T21:04:12.355 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:11.751+0000 7f8cb1075640 1 -- 172.21.15.77:0/2316295424 wait complete. 2024-09-18T21:04:12.911 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:12 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/2316295424' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-18T21:04:12.912 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:12 smithi077 ceph-mon[27689]: mgrmap e5: smithi077.utkpjg(active, since 6s) 2024-09-18T21:04:13.524 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout { 2024-09-18T21:04:13.524 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-18T21:04:13.524 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-18T21:04:13.524 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "active_name": "smithi077.utkpjg", 2024-09-18T21:04:13.525 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-18T21:04:13.525 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout } 2024-09-18T21:04:13.525 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.702+0000 7ff1ca1b7640 1 Processor -- start 2024-09-18T21:04:13.525 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.702+0000 7ff1ca1b7640 1 -- start start 2024-09-18T21:04:13.525 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.702+0000 7ff1ca1b7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1c4076b70 0x7ff1c4104b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:13.525 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.702+0000 7ff1ca1b7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c41050c0 con 0x7ff1c4076b70 2024-09-18T21:04:13.525 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.703+0000 7ff1c37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1c4076b70 0x7ff1c4104b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:13.525 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.703+0000 7ff1c37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1c4076b70 0x7ff1c4104b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45906/0 (socket says 172.21.15.77:45906) 2024-09-18T21:04:13.525 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.703+0000 7ff1c37fe640 1 -- 172.21.15.77:0/1827593988 learned_addr learned my addr 172.21.15.77:0/1827593988 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:13.525 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.703+0000 7ff1c37fe640 1 -- 172.21.15.77:0/1827593988 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c4105200 con 0x7ff1c4076b70 2024-09-18T21:04:13.525 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.704+0000 7ff1c37fe640 1 --2- 172.21.15.77:0/1827593988 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1c4076b70 0x7ff1c4104b80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4009840 tx=0x7ff1b40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9ae7887d41ee8e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:13.525 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.704+0000 7ff1c2ffd640 1 -- 172.21.15.77:0/1827593988 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff1b4032440 con 0x7ff1c4076b70 2024-09-18T21:04:13.525 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.704+0000 7ff1c2ffd640 1 -- 172.21.15.77:0/1827593988 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7ff1b4032a00 con 0x7ff1c4076b70 2024-09-18T21:04:13.525 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.704+0000 7ff1c2ffd640 1 -- 172.21.15.77:0/1827593988 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff1b4031a10 con 0x7ff1c4076b70 2024-09-18T21:04:13.526 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.705+0000 7ff1ca1b7640 1 -- 172.21.15.77:0/1827593988 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1c4076b70 msgr2=0x7ff1c4104b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:13.526 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.705+0000 7ff1ca1b7640 1 --2- 172.21.15.77:0/1827593988 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1c4076b70 0x7ff1c4104b80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4009840 tx=0x7ff1b40091d0 comp rx=0 tx=0).stop 2024-09-18T21:04:13.526 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.705+0000 7ff1ca1b7640 1 -- 172.21.15.77:0/1827593988 shutdown_connections 2024-09-18T21:04:13.526 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.705+0000 7ff1ca1b7640 1 --2- 172.21.15.77:0/1827593988 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1c4076b70 0x7ff1c4104b80 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:13.526 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.705+0000 7ff1ca1b7640 1 -- 172.21.15.77:0/1827593988 >> 172.21.15.77:0/1827593988 conn(0x7ff1c40fc6d0 msgr2=0x7ff1c40feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:13.526 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.705+0000 7ff1ca1b7640 1 -- 172.21.15.77:0/1827593988 shutdown_connections 2024-09-18T21:04:13.526 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.705+0000 7ff1ca1b7640 1 -- 172.21.15.77:0/1827593988 wait complete. 2024-09-18T21:04:13.526 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.705+0000 7ff1ca1b7640 1 Processor -- start 2024-09-18T21:04:13.526 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.705+0000 7ff1ca1b7640 1 -- start start 2024-09-18T21:04:13.526 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.705+0000 7ff1ca1b7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1c4076b70 0x7ff1c4112f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:13.526 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.705+0000 7ff1ca1b7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c41134b0 con 0x7ff1c4076b70 2024-09-18T21:04:13.526 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.706+0000 7ff1c37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1c4076b70 0x7ff1c4112f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:13.526 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.706+0000 7ff1c37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1c4076b70 0x7ff1c4112f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45914/0 (socket says 172.21.15.77:45914) 2024-09-18T21:04:13.526 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.706+0000 7ff1c37fe640 1 -- 172.21.15.77:0/1311712562 learned_addr learned my addr 172.21.15.77:0/1311712562 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:13.527 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.706+0000 7ff1c37fe640 1 -- 172.21.15.77:0/1311712562 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b4009450 con 0x7ff1c4076b70 2024-09-18T21:04:13.527 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.706+0000 7ff1c37fe640 1 --2- 172.21.15.77:0/1311712562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1c4076b70 0x7ff1c4112f70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4006a70 tx=0x7ff1b402c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:13.527 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.706+0000 7ff1c0ff9640 1 -- 172.21.15.77:0/1311712562 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff1b4031d10 con 0x7ff1c4076b70 2024-09-18T21:04:13.527 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.706+0000 7ff1c0ff9640 1 -- 172.21.15.77:0/1311712562 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7ff1b4031e70 con 0x7ff1c4076b70 2024-09-18T21:04:13.527 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.706+0000 7ff1ca1b7640 1 -- 172.21.15.77:0/1311712562 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1c41136b0 con 0x7ff1c4076b70 2024-09-18T21:04:13.527 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.706+0000 7ff1c0ff9640 1 -- 172.21.15.77:0/1311712562 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff1b403b6f0 con 0x7ff1c4076b70 2024-09-18T21:04:13.527 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.706+0000 7ff1ca1b7640 1 -- 172.21.15.77:0/1311712562 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1c4113b20 con 0x7ff1c4076b70 2024-09-18T21:04:13.527 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.707+0000 7ff1ca1b7640 1 -- 172.21.15.77:0/1311712562 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1c404b720 con 0x7ff1c4076b70 2024-09-18T21:04:13.527 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.707+0000 7ff1c0ff9640 1 -- 172.21.15.77:0/1311712562 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 45507+0+0 (secure 0 0 0) 0x7ff1b4039070 con 0x7ff1c4076b70 2024-09-18T21:04:13.527 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.707+0000 7ff1c0ff9640 1 --2- 172.21.15.77:0/1311712562 >> [v2:172.21.15.77:6800/3162219942,v1:172.21.15.77:6801/3162219942] conn(0x7ff1b00394e0 0x7ff1b003b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:13.527 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.708+0000 7ff1c0ff9640 1 -- 172.21.15.77:0/1311712562 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7ff1b406cab0 con 0x7ff1c4076b70 2024-09-18T21:04:13.527 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.708+0000 7ff1bbfff640 1 -- 172.21.15.77:0/1311712562 >> [v2:172.21.15.77:6800/3162219942,v1:172.21.15.77:6801/3162219942] conn(0x7ff1b00394e0 msgr2=0x7ff1b003b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/3162219942 2024-09-18T21:04:13.527 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.708+0000 7ff1bbfff640 1 --2- 172.21.15.77:0/1311712562 >> [v2:172.21.15.77:6800/3162219942,v1:172.21.15.77:6801/3162219942] conn(0x7ff1b00394e0 0x7ff1b003b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-18T21:04:13.528 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.712+0000 7ff1c0ff9640 1 -- 172.21.15.77:0/1311712562 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff1b403ab20 con 0x7ff1c4076b70 2024-09-18T21:04:13.528 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.909+0000 7ff1bbfff640 1 -- 172.21.15.77:0/1311712562 >> [v2:172.21.15.77:6800/3162219942,v1:172.21.15.77:6801/3162219942] conn(0x7ff1b00394e0 msgr2=0x7ff1b003b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/3162219942 2024-09-18T21:04:13.528 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.909+0000 7ff1bbfff640 1 --2- 172.21.15.77:0/1311712562 >> [v2:172.21.15.77:6800/3162219942,v1:172.21.15.77:6801/3162219942] conn(0x7ff1b00394e0 0x7ff1b003b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-18T21:04:13.528 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.913+0000 7ff1ca1b7640 1 -- 172.21.15.77:0/1311712562 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7ff1c4113b20 con 0x7ff1c4076b70 2024-09-18T21:04:13.528 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.914+0000 7ff1c0ff9640 1 -- 172.21.15.77:0/1311712562 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7ff1b4037030 con 0x7ff1c4076b70 2024-09-18T21:04:13.528 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.916+0000 7ff1ca1b7640 1 -- 172.21.15.77:0/1311712562 >> [v2:172.21.15.77:6800/3162219942,v1:172.21.15.77:6801/3162219942] conn(0x7ff1b00394e0 msgr2=0x7ff1b003b990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-18T21:04:13.528 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.916+0000 7ff1ca1b7640 1 --2- 172.21.15.77:0/1311712562 >> [v2:172.21.15.77:6800/3162219942,v1:172.21.15.77:6801/3162219942] conn(0x7ff1b00394e0 0x7ff1b003b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:13.528 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.916+0000 7ff1ca1b7640 1 -- 172.21.15.77:0/1311712562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1c4076b70 msgr2=0x7ff1c4112f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:13.528 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.916+0000 7ff1ca1b7640 1 --2- 172.21.15.77:0/1311712562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1c4076b70 0x7ff1c4112f70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4006a70 tx=0x7ff1b402c040 comp rx=0 tx=0).stop 2024-09-18T21:04:13.528 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.916+0000 7ff1ca1b7640 1 -- 172.21.15.77:0/1311712562 shutdown_connections 2024-09-18T21:04:13.528 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.916+0000 7ff1ca1b7640 1 --2- 172.21.15.77:0/1311712562 >> [v2:172.21.15.77:6800/3162219942,v1:172.21.15.77:6801/3162219942] conn(0x7ff1b00394e0 0x7ff1b003b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:13.528 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.916+0000 7ff1ca1b7640 1 --2- 172.21.15.77:0/1311712562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1c4076b70 0x7ff1c4112f70 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:13.528 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.916+0000 7ff1ca1b7640 1 -- 172.21.15.77:0/1311712562 >> 172.21.15.77:0/1311712562 conn(0x7ff1c40fc6d0 msgr2=0x7ff1c4102480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:13.529 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.916+0000 7ff1ca1b7640 1 -- 172.21.15.77:0/1311712562 shutdown_connections 2024-09-18T21:04:13.529 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:12.916+0000 7ff1ca1b7640 1 -- 172.21.15.77:0/1311712562 wait complete. 2024-09-18T21:04:13.529 INFO:teuthology.orchestra.run.smithi077.stdout:Waiting for the mgr to restart... 2024-09-18T21:04:13.529 INFO:teuthology.orchestra.run.smithi077.stdout:Waiting for mgr epoch 5... 2024-09-18T21:04:13.811 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:13 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/1311712562' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-18T21:04:16.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:16 smithi077 ceph-mon[27689]: Active manager daemon smithi077.utkpjg restarted 2024-09-18T21:04:16.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:16 smithi077 ceph-mon[27689]: Activating manager daemon smithi077.utkpjg 2024-09-18T21:04:16.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:16 smithi077 ceph-mon[27689]: osdmap e2: 0 total, 0 up, 0 in 2024-09-18T21:04:16.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:16 smithi077 ceph-mon[27689]: mgrmap e6: smithi077.utkpjg(active, starting, since 0.00401334s) 2024-09-18T21:04:16.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:16 smithi077 ceph-mon[27689]: from='mgr.14118 172.21.15.77:0/107867287' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mon metadata", "id": "smithi077"}]: dispatch 2024-09-18T21:04:16.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:16 smithi077 ceph-mon[27689]: from='mgr.14118 172.21.15.77:0/107867287' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mgr metadata", "who": "smithi077.utkpjg", "id": "smithi077.utkpjg"}]: dispatch 2024-09-18T21:04:16.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:16 smithi077 ceph-mon[27689]: from='mgr.14118 172.21.15.77:0/107867287' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-18T21:04:16.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:16 smithi077 ceph-mon[27689]: from='mgr.14118 172.21.15.77:0/107867287' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-18T21:04:16.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:16 smithi077 ceph-mon[27689]: from='mgr.14118 172.21.15.77:0/107867287' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-18T21:04:16.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:16 smithi077 ceph-mon[27689]: Manager daemon smithi077.utkpjg is now available 2024-09-18T21:04:16.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:16 smithi077 ceph-mon[27689]: from='mgr.14118 172.21.15.77:0/107867287' entity='mgr.smithi077.utkpjg' 2024-09-18T21:04:16.464 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:16 smithi077 ceph-mon[27689]: from='mgr.14118 172.21.15.77:0/107867287' entity='mgr.smithi077.utkpjg' 2024-09-18T21:04:16.464 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:16 smithi077 ceph-mon[27689]: from='mgr.14118 172.21.15.77:0/107867287' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:04:16.464 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:16 smithi077 ceph-mon[27689]: from='mgr.14118 172.21.15.77:0/107867287' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:04:16.464 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:16 smithi077 ceph-mon[27689]: from='mgr.14118 172.21.15.77:0/107867287' entity='mgr.smithi077.utkpjg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi077.utkpjg/mirror_snapshot_schedule"}]: dispatch 2024-09-18T21:04:16.464 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:16 smithi077 ceph-mon[27689]: from='mgr.14118 172.21.15.77:0/107867287' entity='mgr.smithi077.utkpjg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi077.utkpjg/trash_purge_schedule"}]: dispatch 2024-09-18T21:04:17.391 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:17 smithi077 ceph-mon[27689]: Found migration_current of "None". Setting to last migration. 2024-09-18T21:04:17.391 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:17 smithi077 ceph-mon[27689]: mgrmap e7: smithi077.utkpjg(active, since 1.00542s) 2024-09-18T21:04:17.607 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout { 2024-09-18T21:04:17.607 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-18T21:04:17.607 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-18T21:04:17.607 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout } 2024-09-18T21:04:17.607 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:13.976+0000 7feb38b36640 1 Processor -- start 2024-09-18T21:04:17.607 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:13.977+0000 7feb38b36640 1 -- start start 2024-09-18T21:04:17.607 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:13.977+0000 7feb38b36640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb34101f80 0x7feb34102390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:17.607 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:13.977+0000 7feb38b36640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb341028d0 con 0x7feb34101f80 2024-09-18T21:04:17.607 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:13.977+0000 7feb3259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb34101f80 0x7feb34102390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:17.607 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:13.977+0000 7feb3259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb34101f80 0x7feb34102390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45928/0 (socket says 172.21.15.77:45928) 2024-09-18T21:04:17.607 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:13.977+0000 7feb3259c640 1 -- 172.21.15.77:0/530210018 learned_addr learned my addr 172.21.15.77:0/530210018 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:17.608 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:13.977+0000 7feb3259c640 1 -- 172.21.15.77:0/530210018 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb34102a10 con 0x7feb34101f80 2024-09-18T21:04:17.608 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:13.978+0000 7feb3259c640 1 --2- 172.21.15.77:0/530210018 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb34101f80 0x7feb34102390 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7feb24009840 tx=0x7feb240091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a21f3157d346bd47 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:17.608 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:13.978+0000 7feb3159a640 1 -- 172.21.15.77:0/530210018 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feb24032440 con 0x7feb34101f80 2024-09-18T21:04:17.608 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:13.978+0000 7feb3159a640 1 -- 172.21.15.77:0/530210018 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7feb24032a00 con 0x7feb34101f80 2024-09-18T21:04:17.608 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:13.978+0000 7feb3159a640 1 -- 172.21.15.77:0/530210018 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feb240319e0 con 0x7feb34101f80 2024-09-18T21:04:17.608 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:13.979+0000 7feb38b36640 1 -- 172.21.15.77:0/530210018 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb34101f80 msgr2=0x7feb34102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:17.608 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:13.979+0000 7feb38b36640 1 --2- 172.21.15.77:0/530210018 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb34101f80 0x7feb34102390 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7feb24009840 tx=0x7feb240091d0 comp rx=0 tx=0).stop 2024-09-18T21:04:17.608 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:13.979+0000 7feb38b36640 1 -- 172.21.15.77:0/530210018 shutdown_connections 2024-09-18T21:04:17.608 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:13.979+0000 7feb38b36640 1 --2- 172.21.15.77:0/530210018 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb34101f80 0x7feb34102390 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:17.608 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:13.979+0000 7feb38b36640 1 -- 172.21.15.77:0/530210018 >> 172.21.15.77:0/530210018 conn(0x7feb340fd7a0 msgr2=0x7feb340ffbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:17.608 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:13.979+0000 7feb38b36640 1 -- 172.21.15.77:0/530210018 shutdown_connections 2024-09-18T21:04:17.608 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:13.979+0000 7feb38b36640 1 -- 172.21.15.77:0/530210018 wait complete. 2024-09-18T21:04:17.609 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:13.980+0000 7feb38b36640 1 Processor -- start 2024-09-18T21:04:17.609 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:13.980+0000 7feb38b36640 1 -- start start 2024-09-18T21:04:17.609 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:13.980+0000 7feb38b36640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb34101f80 0x7feb34110e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:17.609 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:13.980+0000 7feb38b36640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb34111390 con 0x7feb34101f80 2024-09-18T21:04:17.609 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:13.980+0000 7feb3259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb34101f80 0x7feb34110e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:17.609 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:13.980+0000 7feb3259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb34101f80 0x7feb34110e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45942/0 (socket says 172.21.15.77:45942) 2024-09-18T21:04:17.609 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:13.980+0000 7feb3259c640 1 -- 172.21.15.77:0/1511608930 learned_addr learned my addr 172.21.15.77:0/1511608930 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:17.609 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:13.980+0000 7feb3259c640 1 -- 172.21.15.77:0/1511608930 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb24009450 con 0x7feb34101f80 2024-09-18T21:04:17.609 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:13.980+0000 7feb3259c640 1 --2- 172.21.15.77:0/1511608930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb34101f80 0x7feb34110e50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7feb24000c00 tx=0x7feb24008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:17.609 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:13.980+0000 7feb22ffd640 1 -- 172.21.15.77:0/1511608930 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feb2403d450 con 0x7feb34101f80 2024-09-18T21:04:17.609 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:13.981+0000 7feb22ffd640 1 -- 172.21.15.77:0/1511608930 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7feb2403da10 con 0x7feb34101f80 2024-09-18T21:04:17.609 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:13.981+0000 7feb38b36640 1 -- 172.21.15.77:0/1511608930 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb34111590 con 0x7feb34101f80 2024-09-18T21:04:17.609 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:13.981+0000 7feb22ffd640 1 -- 172.21.15.77:0/1511608930 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feb2403b880 con 0x7feb34101f80 2024-09-18T21:04:17.609 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:13.981+0000 7feb38b36640 1 -- 172.21.15.77:0/1511608930 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb34111fe0 con 0x7feb34101f80 2024-09-18T21:04:17.610 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:13.981+0000 7feb22ffd640 1 -- 172.21.15.77:0/1511608930 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 45507+0+0 (secure 0 0 0) 0x7feb24039070 con 0x7feb34101f80 2024-09-18T21:04:17.610 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:13.982+0000 7feb22ffd640 1 --2- 172.21.15.77:0/1511608930 >> [v2:172.21.15.77:6800/3162219942,v1:172.21.15.77:6801/3162219942] conn(0x7feb1c0394e0 0x7feb1c03b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:17.610 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:13.982+0000 7feb22ffd640 1 -- 172.21.15.77:0/1511608930 --> [v2:172.21.15.77:6800/3162219942,v1:172.21.15.77:6801/3162219942] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7feb1c03c0a0 con 0x7feb1c0394e0 2024-09-18T21:04:17.610 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:13.982+0000 7feb31d9b640 1 -- 172.21.15.77:0/1511608930 >> [v2:172.21.15.77:6800/3162219942,v1:172.21.15.77:6801/3162219942] conn(0x7feb1c0394e0 msgr2=0x7feb1c03b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/3162219942 2024-09-18T21:04:17.610 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:13.982+0000 7feb22ffd640 1 -- 172.21.15.77:0/1511608930 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7feb2406d080 con 0x7feb34101f80 2024-09-18T21:04:17.610 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:13.982+0000 7feb31d9b640 1 --2- 172.21.15.77:0/1511608930 >> [v2:172.21.15.77:6800/3162219942,v1:172.21.15.77:6801/3162219942] conn(0x7feb1c0394e0 0x7feb1c03b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-18T21:04:17.610 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:14.183+0000 7feb31d9b640 1 -- 172.21.15.77:0/1511608930 >> [v2:172.21.15.77:6800/3162219942,v1:172.21.15.77:6801/3162219942] conn(0x7feb1c0394e0 msgr2=0x7feb1c03b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/3162219942 2024-09-18T21:04:17.610 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:14.183+0000 7feb31d9b640 1 --2- 172.21.15.77:0/1511608930 >> [v2:172.21.15.77:6800/3162219942,v1:172.21.15.77:6801/3162219942] conn(0x7feb1c0394e0 0x7feb1c03b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-18T21:04:17.610 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:14.584+0000 7feb31d9b640 1 -- 172.21.15.77:0/1511608930 >> [v2:172.21.15.77:6800/3162219942,v1:172.21.15.77:6801/3162219942] conn(0x7feb1c0394e0 msgr2=0x7feb1c03b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/3162219942 2024-09-18T21:04:17.610 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:14.584+0000 7feb31d9b640 1 --2- 172.21.15.77:0/1511608930 >> [v2:172.21.15.77:6800/3162219942,v1:172.21.15.77:6801/3162219942] conn(0x7feb1c0394e0 0x7feb1c03b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-18T21:04:17.610 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:15.385+0000 7feb31d9b640 1 -- 172.21.15.77:0/1511608930 >> [v2:172.21.15.77:6800/3162219942,v1:172.21.15.77:6801/3162219942] conn(0x7feb1c0394e0 msgr2=0x7feb1c03b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/3162219942 2024-09-18T21:04:17.610 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:15.385+0000 7feb31d9b640 1 --2- 172.21.15.77:0/1511608930 >> [v2:172.21.15.77:6800/3162219942,v1:172.21.15.77:6801/3162219942] conn(0x7feb1c0394e0 0x7feb1c03b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-18T21:04:17.610 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:16.082+0000 7feb22ffd640 1 -- 172.21.15.77:0/1511608930 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mgrmap(e 6) v1 ==== 45274+0+0 (secure 0 0 0) 0x7feb2406c580 con 0x7feb34101f80 2024-09-18T21:04:17.610 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:16.082+0000 7feb22ffd640 1 -- 172.21.15.77:0/1511608930 >> [v2:172.21.15.77:6800/3162219942,v1:172.21.15.77:6801/3162219942] conn(0x7feb1c0394e0 msgr2=0x7feb1c03b990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-18T21:04:17.611 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:16.082+0000 7feb22ffd640 1 --2- 172.21.15.77:0/1511608930 >> [v2:172.21.15.77:6800/3162219942,v1:172.21.15.77:6801/3162219942] conn(0x7feb1c0394e0 0x7feb1c03b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:17.611 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.082+0000 7feb22ffd640 1 -- 172.21.15.77:0/1511608930 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mgrmap(e 7) v1 ==== 45401+0+0 (secure 0 0 0) 0x7feb24049d40 con 0x7feb34101f80 2024-09-18T21:04:17.611 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.082+0000 7feb22ffd640 1 --2- 172.21.15.77:0/1511608930 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7feb1c03cdf0 0x7feb1c03f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:17.611 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.082+0000 7feb22ffd640 1 -- 172.21.15.77:0/1511608930 --> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7feb1c03c0a0 con 0x7feb1c03cdf0 2024-09-18T21:04:17.611 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.083+0000 7feb31d9b640 1 --2- 172.21.15.77:0/1511608930 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7feb1c03cdf0 0x7feb1c03f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:17.611 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.083+0000 7feb31d9b640 1 --2- 172.21.15.77:0/1511608930 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7feb1c03cdf0 0x7feb1c03f1d0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7feb28003940 tx=0x7feb28009350 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:17.611 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.084+0000 7feb22ffd640 1 -- 172.21.15.77:0/1511608930 <== mgr.14118 v2:172.21.15.77:6800/2654225509 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7feb1c03c0a0 con 0x7feb1c03cdf0 2024-09-18T21:04:17.611 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.089+0000 7feb38b36640 1 -- 172.21.15.77:0/1511608930 --> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7feb341013e0 con 0x7feb1c03cdf0 2024-09-18T21:04:17.611 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.089+0000 7feb22ffd640 1 -- 172.21.15.77:0/1511608930 <== mgr.14118 v2:172.21.15.77:6800/2654225509 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7feb341013e0 con 0x7feb1c03cdf0 2024-09-18T21:04:17.611 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.089+0000 7feb38b36640 1 -- 172.21.15.77:0/1511608930 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7feb1c03cdf0 msgr2=0x7feb1c03f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:17.611 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.089+0000 7feb38b36640 1 --2- 172.21.15.77:0/1511608930 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7feb1c03cdf0 0x7feb1c03f1d0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7feb28003940 tx=0x7feb28009350 comp rx=0 tx=0).stop 2024-09-18T21:04:17.611 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.089+0000 7feb38b36640 1 -- 172.21.15.77:0/1511608930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb34101f80 msgr2=0x7feb34110e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:17.611 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.089+0000 7feb38b36640 1 --2- 172.21.15.77:0/1511608930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb34101f80 0x7feb34110e50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7feb24000c00 tx=0x7feb24008040 comp rx=0 tx=0).stop 2024-09-18T21:04:17.611 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.089+0000 7feb38b36640 1 -- 172.21.15.77:0/1511608930 shutdown_connections 2024-09-18T21:04:17.612 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.089+0000 7feb38b36640 1 --2- 172.21.15.77:0/1511608930 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7feb1c03cdf0 0x7feb1c03f1d0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:17.612 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.089+0000 7feb38b36640 1 --2- 172.21.15.77:0/1511608930 >> [v2:172.21.15.77:6800/3162219942,v1:172.21.15.77:6801/3162219942] conn(0x7feb1c0394e0 0x7feb1c03b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:17.612 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.089+0000 7feb38b36640 1 --2- 172.21.15.77:0/1511608930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb34101f80 0x7feb34110e50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:17.612 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.089+0000 7feb38b36640 1 -- 172.21.15.77:0/1511608930 >> 172.21.15.77:0/1511608930 conn(0x7feb340fd7a0 msgr2=0x7feb340fe3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:17.612 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.089+0000 7feb38b36640 1 -- 172.21.15.77:0/1511608930 shutdown_connections 2024-09-18T21:04:17.612 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.089+0000 7feb38b36640 1 -- 172.21.15.77:0/1511608930 wait complete. 2024-09-18T21:04:17.612 INFO:teuthology.orchestra.run.smithi077.stdout:mgr epoch 5 is available 2024-09-18T21:04:17.612 INFO:teuthology.orchestra.run.smithi077.stdout:Setting orchestrator backend to cephadm... 2024-09-18T21:04:18.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:18 smithi077 ceph-mon[27689]: [18/Sep/2024:21:04:17] ENGINE Bus STARTING 2024-09-18T21:04:18.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:18 smithi077 ceph-mon[27689]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-18T21:04:18.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:18 smithi077 ceph-mon[27689]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-18T21:04:18.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:18 smithi077 ceph-mon[27689]: [18/Sep/2024:21:04:17] ENGINE Serving on https://172.21.15.77:7150 2024-09-18T21:04:18.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:18 smithi077 ceph-mon[27689]: [18/Sep/2024:21:04:17] ENGINE Bus STARTED 2024-09-18T21:04:18.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:18 smithi077 ceph-mon[27689]: [18/Sep/2024:21:04:17] ENGINE Error in HTTPServer.serve 2024-09-18T21:04:18.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Traceback (most recent call last): 2024-09-18T21:04:18.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-18T21:04:18.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: self._connections.run(self.expiration_interval) 2024-09-18T21:04:18.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-18T21:04:18.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: self._run(expiration_interval) 2024-09-18T21:04:18.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-18T21:04:18.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-18T21:04:18.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-18T21:04:18.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-18T21:04:18.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-18T21:04:18.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: s = self.context.wrap_socket( 2024-09-18T21:04:18.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-18T21:04:18.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: return self.sslsocket_class._create( 2024-09-18T21:04:18.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-18T21:04:18.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: self.do_handshake() 2024-09-18T21:04:18.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-18T21:04:18.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: self._sslobj.do_handshake() 2024-09-18T21:04:18.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-18T21:04:18.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:18 smithi077 ceph-mon[27689]: from='mgr.14118 172.21.15.77:0/107867287' entity='mgr.smithi077.utkpjg' 2024-09-18T21:04:18.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:18 smithi077 ceph-mon[27689]: from='mgr.14118 172.21.15.77:0/107867287' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:04:18.215 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:18 smithi077 ceph-mon[27689]: from='mgr.14118 172.21.15.77:0/107867287' entity='mgr.smithi077.utkpjg' 2024-09-18T21:04:18.215 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:18 smithi077 ceph-mon[27689]: from='mgr.14118 172.21.15.77:0/107867287' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:04:18.677 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.955+0000 7f831c27c640 1 Processor -- start 2024-09-18T21:04:18.678 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.956+0000 7f831c27c640 1 -- start start 2024-09-18T21:04:18.678 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.956+0000 7f831c27c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8314101f80 0x7f8314102390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:18.678 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.956+0000 7f831c27c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83141028d0 con 0x7f8314101f80 2024-09-18T21:04:18.678 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.956+0000 7f831a018640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8314101f80 0x7f8314102390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:18.678 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.956+0000 7f831a018640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8314101f80 0x7f8314102390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45998/0 (socket says 172.21.15.77:45998) 2024-09-18T21:04:18.678 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.956+0000 7f831a018640 1 -- 172.21.15.77:0/1649204618 learned_addr learned my addr 172.21.15.77:0/1649204618 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:18.678 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.956+0000 7f831a018640 1 -- 172.21.15.77:0/1649204618 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8314102a10 con 0x7f8314101f80 2024-09-18T21:04:18.678 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.957+0000 7f831a018640 1 --2- 172.21.15.77:0/1649204618 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8314101f80 0x7f8314102390 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8310009840 tx=0x7f83100091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52488df7e9a04cb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:18.678 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.957+0000 7f8319016640 1 -- 172.21.15.77:0/1649204618 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8310032440 con 0x7f8314101f80 2024-09-18T21:04:18.678 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.957+0000 7f8319016640 1 -- 172.21.15.77:0/1649204618 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f8310032a00 con 0x7f8314101f80 2024-09-18T21:04:18.678 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.957+0000 7f8319016640 1 -- 172.21.15.77:0/1649204618 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f83100319e0 con 0x7f8314101f80 2024-09-18T21:04:18.678 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.958+0000 7f831c27c640 1 -- 172.21.15.77:0/1649204618 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8314101f80 msgr2=0x7f8314102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:18.679 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.958+0000 7f831c27c640 1 --2- 172.21.15.77:0/1649204618 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8314101f80 0x7f8314102390 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8310009840 tx=0x7f83100091d0 comp rx=0 tx=0).stop 2024-09-18T21:04:18.679 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.958+0000 7f831c27c640 1 -- 172.21.15.77:0/1649204618 shutdown_connections 2024-09-18T21:04:18.679 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.958+0000 7f831c27c640 1 --2- 172.21.15.77:0/1649204618 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8314101f80 0x7f8314102390 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:18.679 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.958+0000 7f831c27c640 1 -- 172.21.15.77:0/1649204618 >> 172.21.15.77:0/1649204618 conn(0x7f83140fd7a0 msgr2=0x7f83140ffbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:18.679 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.958+0000 7f831c27c640 1 -- 172.21.15.77:0/1649204618 shutdown_connections 2024-09-18T21:04:18.679 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.958+0000 7f831c27c640 1 -- 172.21.15.77:0/1649204618 wait complete. 2024-09-18T21:04:18.679 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.958+0000 7f831c27c640 1 Processor -- start 2024-09-18T21:04:18.679 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.959+0000 7f831c27c640 1 -- start start 2024-09-18T21:04:18.679 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.959+0000 7f831c27c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8314101f80 0x7f8314110e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:18.679 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.959+0000 7f831c27c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8314111370 con 0x7f8314101f80 2024-09-18T21:04:18.679 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.959+0000 7f831a018640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8314101f80 0x7f8314110e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:18.679 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.959+0000 7f831a018640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8314101f80 0x7f8314110e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46000/0 (socket says 172.21.15.77:46000) 2024-09-18T21:04:18.679 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.959+0000 7f831a018640 1 -- 172.21.15.77:0/3183882305 learned_addr learned my addr 172.21.15.77:0/3183882305 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:18.679 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.959+0000 7f831a018640 1 -- 172.21.15.77:0/3183882305 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8310009450 con 0x7f8314101f80 2024-09-18T21:04:18.680 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.959+0000 7f831a018640 1 --2- 172.21.15.77:0/3183882305 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8314101f80 0x7f8314110e30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8310000c00 tx=0x7f8310008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:18.680 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.959+0000 7f830affd640 1 -- 172.21.15.77:0/3183882305 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f831003d450 con 0x7f8314101f80 2024-09-18T21:04:18.680 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.959+0000 7f830affd640 1 -- 172.21.15.77:0/3183882305 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f831003da10 con 0x7f8314101f80 2024-09-18T21:04:18.680 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.959+0000 7f830affd640 1 -- 172.21.15.77:0/3183882305 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f831003b840 con 0x7f8314101f80 2024-09-18T21:04:18.680 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.959+0000 7f831c27c640 1 -- 172.21.15.77:0/3183882305 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8314111570 con 0x7f8314101f80 2024-09-18T21:04:18.680 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.959+0000 7f831c27c640 1 -- 172.21.15.77:0/3183882305 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8314112050 con 0x7f8314101f80 2024-09-18T21:04:18.680 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.960+0000 7f830affd640 1 -- 172.21.15.77:0/3183882305 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 7) v1 ==== 45401+0+0 (secure 0 0 0) 0x7f8310039070 con 0x7f8314101f80 2024-09-18T21:04:18.680 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.960+0000 7f831c27c640 1 -- 172.21.15.77:0/3183882305 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83141013e0 con 0x7f8314101f80 2024-09-18T21:04:18.680 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.961+0000 7f830affd640 1 --2- 172.21.15.77:0/3183882305 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f8300039380 0x7f830003b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:18.680 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.961+0000 7f830affd640 1 -- 172.21.15.77:0/3183882305 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f831006d120 con 0x7f8314101f80 2024-09-18T21:04:18.680 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.961+0000 7f8319817640 1 --2- 172.21.15.77:0/3183882305 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f8300039380 0x7f830003b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:18.680 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.961+0000 7f8319817640 1 --2- 172.21.15.77:0/3183882305 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f8300039380 0x7f830003b830 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8304006fd0 tx=0x7f8304006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:18.681 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:17.965+0000 7f830affd640 1 -- 172.21.15.77:0/3183882305 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f831003cb60 con 0x7f8314101f80 2024-09-18T21:04:18.681 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:18.130+0000 7f831c27c640 1 -- 172.21.15.77:0/3183882305 --> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f83140fec00 con 0x7f8300039380 2024-09-18T21:04:18.681 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:18.139+0000 7f830affd640 1 -- 172.21.15.77:0/3183882305 <== mgr.14118 v2:172.21.15.77:6800/2654225509 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f83140fec00 con 0x7f8300039380 2024-09-18T21:04:18.681 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:18.141+0000 7f831c27c640 1 -- 172.21.15.77:0/3183882305 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f8300039380 msgr2=0x7f830003b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:18.681 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:18.141+0000 7f831c27c640 1 --2- 172.21.15.77:0/3183882305 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f8300039380 0x7f830003b830 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8304006fd0 tx=0x7f8304006db0 comp rx=0 tx=0).stop 2024-09-18T21:04:18.681 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:18.141+0000 7f831c27c640 1 -- 172.21.15.77:0/3183882305 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8314101f80 msgr2=0x7f8314110e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:18.681 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:18.141+0000 7f831c27c640 1 --2- 172.21.15.77:0/3183882305 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8314101f80 0x7f8314110e30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8310000c00 tx=0x7f8310008040 comp rx=0 tx=0).stop 2024-09-18T21:04:18.681 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:18.141+0000 7f831c27c640 1 -- 172.21.15.77:0/3183882305 shutdown_connections 2024-09-18T21:04:18.681 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:18.141+0000 7f831c27c640 1 --2- 172.21.15.77:0/3183882305 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f8300039380 0x7f830003b830 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:18.681 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:18.141+0000 7f831c27c640 1 --2- 172.21.15.77:0/3183882305 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8314101f80 0x7f8314110e30 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:18.681 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:18.141+0000 7f831c27c640 1 -- 172.21.15.77:0/3183882305 >> 172.21.15.77:0/3183882305 conn(0x7f83140fd7a0 msgr2=0x7f83140fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:18.681 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:18.141+0000 7f831c27c640 1 -- 172.21.15.77:0/3183882305 shutdown_connections 2024-09-18T21:04:18.681 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:18.141+0000 7f831c27c640 1 -- 172.21.15.77:0/3183882305 wait complete. 2024-09-18T21:04:19.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:19 smithi077 ceph-mon[27689]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:04:19.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:19 smithi077 ceph-mon[27689]: mgrmap e8: smithi077.utkpjg(active, since 2s) 2024-09-18T21:04:19.868 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-18T21:04:19.868 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.072+0000 7f0d60a3f640 1 Processor -- start 2024-09-18T21:04:19.868 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.072+0000 7f0d60a3f640 1 -- start start 2024-09-18T21:04:19.868 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.072+0000 7f0d60a3f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d5c076b10 0x7f0d5c104be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:19.868 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.072+0000 7f0d60a3f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c076f20 con 0x7f0d5c076b10 2024-09-18T21:04:19.869 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.072+0000 7f0d5a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d5c076b10 0x7f0d5c104be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:19.869 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.072+0000 7f0d5a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d5c076b10 0x7f0d5c104be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46012/0 (socket says 172.21.15.77:46012) 2024-09-18T21:04:19.869 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.072+0000 7f0d5a59c640 1 -- 172.21.15.77:0/2161207629 learned_addr learned my addr 172.21.15.77:0/2161207629 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:19.869 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.072+0000 7f0d5a59c640 1 -- 172.21.15.77:0/2161207629 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d5c105120 con 0x7f0d5c076b10 2024-09-18T21:04:19.869 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.073+0000 7f0d5a59c640 1 --2- 172.21.15.77:0/2161207629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d5c076b10 0x7f0d5c104be0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c009840 tx=0x7f0d4c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8aaa87b958fa6fe server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:19.869 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.073+0000 7f0d5959a640 1 -- 172.21.15.77:0/2161207629 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0d4c032440 con 0x7f0d5c076b10 2024-09-18T21:04:19.869 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.073+0000 7f0d5959a640 1 -- 172.21.15.77:0/2161207629 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f0d4c032a00 con 0x7f0d5c076b10 2024-09-18T21:04:19.869 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.073+0000 7f0d5959a640 1 -- 172.21.15.77:0/2161207629 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0d4c031a10 con 0x7f0d5c076b10 2024-09-18T21:04:19.869 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.073+0000 7f0d60a3f640 1 -- 172.21.15.77:0/2161207629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d5c076b10 msgr2=0x7f0d5c104be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:19.869 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.073+0000 7f0d60a3f640 1 --2- 172.21.15.77:0/2161207629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d5c076b10 0x7f0d5c104be0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c009840 tx=0x7f0d4c0091d0 comp rx=0 tx=0).stop 2024-09-18T21:04:19.869 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.073+0000 7f0d60a3f640 1 -- 172.21.15.77:0/2161207629 shutdown_connections 2024-09-18T21:04:19.869 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.073+0000 7f0d60a3f640 1 --2- 172.21.15.77:0/2161207629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d5c076b10 0x7f0d5c104be0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:19.869 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.073+0000 7f0d60a3f640 1 -- 172.21.15.77:0/2161207629 >> 172.21.15.77:0/2161207629 conn(0x7f0d5c0fc6d0 msgr2=0x7f0d5c0feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:19.870 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.073+0000 7f0d60a3f640 1 -- 172.21.15.77:0/2161207629 shutdown_connections 2024-09-18T21:04:19.870 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.074+0000 7f0d60a3f640 1 -- 172.21.15.77:0/2161207629 wait complete. 2024-09-18T21:04:19.870 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.074+0000 7f0d60a3f640 1 Processor -- start 2024-09-18T21:04:19.870 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.074+0000 7f0d60a3f640 1 -- start start 2024-09-18T21:04:19.870 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.074+0000 7f0d60a3f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d5c076b10 0x7f0d5c110df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:19.870 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.074+0000 7f0d60a3f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c111330 con 0x7f0d5c076b10 2024-09-18T21:04:19.870 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.074+0000 7f0d5a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d5c076b10 0x7f0d5c110df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:19.870 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.074+0000 7f0d5a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d5c076b10 0x7f0d5c110df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46028/0 (socket says 172.21.15.77:46028) 2024-09-18T21:04:19.870 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.074+0000 7f0d5a59c640 1 -- 172.21.15.77:0/659872132 learned_addr learned my addr 172.21.15.77:0/659872132 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:19.870 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.074+0000 7f0d5a59c640 1 -- 172.21.15.77:0/659872132 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d4c009450 con 0x7f0d5c076b10 2024-09-18T21:04:19.870 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.075+0000 7f0d5a59c640 1 --2- 172.21.15.77:0/659872132 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d5c076b10 0x7f0d5c110df0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c0098a0 tx=0x7f0d4c02c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:19.870 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.075+0000 7f0d52ffd640 1 -- 172.21.15.77:0/659872132 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0d4c0327b0 con 0x7f0d5c076b10 2024-09-18T21:04:19.870 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.075+0000 7f0d52ffd640 1 -- 172.21.15.77:0/659872132 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f0d4c03b870 con 0x7f0d5c076b10 2024-09-18T21:04:19.871 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.075+0000 7f0d60a3f640 1 -- 172.21.15.77:0/659872132 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d5c111530 con 0x7f0d5c076b10 2024-09-18T21:04:19.871 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.075+0000 7f0d52ffd640 1 -- 172.21.15.77:0/659872132 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0d4c03a550 con 0x7f0d5c076b10 2024-09-18T21:04:19.871 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.075+0000 7f0d60a3f640 1 -- 172.21.15.77:0/659872132 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d5c111f80 con 0x7f0d5c076b10 2024-09-18T21:04:19.871 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.075+0000 7f0d52ffd640 1 -- 172.21.15.77:0/659872132 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f0d4c039040 con 0x7f0d5c076b10 2024-09-18T21:04:19.871 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.076+0000 7f0d52ffd640 1 --2- 172.21.15.77:0/659872132 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f0d48039490 0x7f0d4803b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:19.871 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.076+0000 7f0d52ffd640 1 -- 172.21.15.77:0/659872132 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f0d4c03bd70 con 0x7f0d5c076b10 2024-09-18T21:04:19.871 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.076+0000 7f0d59d9b640 1 --2- 172.21.15.77:0/659872132 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f0d48039490 0x7f0d4803b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:19.871 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.076+0000 7f0d60a3f640 1 -- 172.21.15.77:0/659872132 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d5c1002f0 con 0x7f0d5c076b10 2024-09-18T21:04:19.871 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.076+0000 7f0d59d9b640 1 --2- 172.21.15.77:0/659872132 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f0d48039490 0x7f0d4803b940 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0d44006fd0 tx=0x7f0d44006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:19.871 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.080+0000 7f0d52ffd640 1 -- 172.21.15.77:0/659872132 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0d4c03f080 con 0x7f0d5c076b10 2024-09-18T21:04:19.871 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.239+0000 7f0d60a3f640 1 -- 172.21.15.77:0/659872132 --> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f0d5c0fdbe0 con 0x7f0d48039490 2024-09-18T21:04:19.871 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.239+0000 7f0d52ffd640 1 -- 172.21.15.77:0/659872132 <== mgr.14118 v2:172.21.15.77:6800/2654225509 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f0d5c0fdbe0 con 0x7f0d48039490 2024-09-18T21:04:19.872 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.241+0000 7f0d60a3f640 1 -- 172.21.15.77:0/659872132 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f0d48039490 msgr2=0x7f0d4803b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:19.872 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.241+0000 7f0d60a3f640 1 --2- 172.21.15.77:0/659872132 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f0d48039490 0x7f0d4803b940 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0d44006fd0 tx=0x7f0d44006db0 comp rx=0 tx=0).stop 2024-09-18T21:04:19.872 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.241+0000 7f0d60a3f640 1 -- 172.21.15.77:0/659872132 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d5c076b10 msgr2=0x7f0d5c110df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:19.872 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.241+0000 7f0d60a3f640 1 --2- 172.21.15.77:0/659872132 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d5c076b10 0x7f0d5c110df0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c0098a0 tx=0x7f0d4c02c040 comp rx=0 tx=0).stop 2024-09-18T21:04:19.872 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.241+0000 7f0d60a3f640 1 -- 172.21.15.77:0/659872132 shutdown_connections 2024-09-18T21:04:19.872 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.241+0000 7f0d60a3f640 1 --2- 172.21.15.77:0/659872132 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f0d48039490 0x7f0d4803b940 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:19.872 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.241+0000 7f0d60a3f640 1 --2- 172.21.15.77:0/659872132 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d5c076b10 0x7f0d5c110df0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:19.872 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.241+0000 7f0d60a3f640 1 -- 172.21.15.77:0/659872132 >> 172.21.15.77:0/659872132 conn(0x7f0d5c0fc6d0 msgr2=0x7f0d5c0fd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:19.872 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.241+0000 7f0d60a3f640 1 -- 172.21.15.77:0/659872132 shutdown_connections 2024-09-18T21:04:19.872 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:19.241+0000 7f0d60a3f640 1 -- 172.21.15.77:0/659872132 wait complete. 2024-09-18T21:04:19.872 INFO:teuthology.orchestra.run.smithi077.stdout:Generating ssh key... 2024-09-18T21:04:20.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:20 smithi077 ceph-mon[27689]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:04:21.392 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:21 smithi077 ceph-mon[27689]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:04:21.392 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:21 smithi077 ceph-mon[27689]: Generating ssh key... 2024-09-18T21:04:21.392 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:21 smithi077 ceph-mon[27689]: from='mgr.14118 172.21.15.77:0/107867287' entity='mgr.smithi077.utkpjg' 2024-09-18T21:04:21.392 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:21 smithi077 ceph-mon[27689]: from='mgr.14118 172.21.15.77:0/107867287' entity='mgr.smithi077.utkpjg' 2024-09-18T21:04:21.400 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.260+0000 7f4e62d5f640 1 Processor -- start 2024-09-18T21:04:21.400 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.260+0000 7f4e62d5f640 1 -- start start 2024-09-18T21:04:21.400 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.261+0000 7f4e62d5f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e5c076b10 0x7f4e5c104be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:21.400 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.261+0000 7f4e62d5f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c076f20 con 0x7f4e5c076b10 2024-09-18T21:04:21.400 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.261+0000 7f4e60afb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e5c076b10 0x7f4e5c104be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:21.400 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.261+0000 7f4e60afb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e5c076b10 0x7f4e5c104be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47492/0 (socket says 172.21.15.77:47492) 2024-09-18T21:04:21.401 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.261+0000 7f4e60afb640 1 -- 172.21.15.77:0/1783398151 learned_addr learned my addr 172.21.15.77:0/1783398151 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:21.401 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.261+0000 7f4e60afb640 1 -- 172.21.15.77:0/1783398151 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e5c105120 con 0x7f4e5c076b10 2024-09-18T21:04:21.401 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.262+0000 7f4e60afb640 1 --2- 172.21.15.77:0/1783398151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e5c076b10 0x7f4e5c104be0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4e50009840 tx=0x7f4e500091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cf07ca86d50aebb server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:21.401 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.262+0000 7f4e5b7fe640 1 -- 172.21.15.77:0/1783398151 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4e50032440 con 0x7f4e5c076b10 2024-09-18T21:04:21.401 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.262+0000 7f4e5b7fe640 1 -- 172.21.15.77:0/1783398151 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f4e50032a00 con 0x7f4e5c076b10 2024-09-18T21:04:21.401 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.262+0000 7f4e5b7fe640 1 -- 172.21.15.77:0/1783398151 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4e50031a10 con 0x7f4e5c076b10 2024-09-18T21:04:21.401 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.262+0000 7f4e62d5f640 1 -- 172.21.15.77:0/1783398151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e5c076b10 msgr2=0x7f4e5c104be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:21.401 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.262+0000 7f4e62d5f640 1 --2- 172.21.15.77:0/1783398151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e5c076b10 0x7f4e5c104be0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4e50009840 tx=0x7f4e500091d0 comp rx=0 tx=0).stop 2024-09-18T21:04:21.401 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.262+0000 7f4e62d5f640 1 -- 172.21.15.77:0/1783398151 shutdown_connections 2024-09-18T21:04:21.401 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.262+0000 7f4e62d5f640 1 --2- 172.21.15.77:0/1783398151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e5c076b10 0x7f4e5c104be0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:21.401 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.262+0000 7f4e62d5f640 1 -- 172.21.15.77:0/1783398151 >> 172.21.15.77:0/1783398151 conn(0x7f4e5c0fc6d0 msgr2=0x7f4e5c0feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:21.401 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.262+0000 7f4e62d5f640 1 -- 172.21.15.77:0/1783398151 shutdown_connections 2024-09-18T21:04:21.401 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.262+0000 7f4e62d5f640 1 -- 172.21.15.77:0/1783398151 wait complete. 2024-09-18T21:04:21.402 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.263+0000 7f4e62d5f640 1 Processor -- start 2024-09-18T21:04:21.402 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.263+0000 7f4e62d5f640 1 -- start start 2024-09-18T21:04:21.402 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.263+0000 7f4e62d5f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e5c076b10 0x7f4e5c110df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:21.402 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.263+0000 7f4e62d5f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c111330 con 0x7f4e5c076b10 2024-09-18T21:04:21.402 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.263+0000 7f4e60afb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e5c076b10 0x7f4e5c110df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:21.402 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.263+0000 7f4e60afb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e5c076b10 0x7f4e5c110df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47500/0 (socket says 172.21.15.77:47500) 2024-09-18T21:04:21.402 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.263+0000 7f4e60afb640 1 -- 172.21.15.77:0/4101494083 learned_addr learned my addr 172.21.15.77:0/4101494083 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:21.402 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.264+0000 7f4e60afb640 1 -- 172.21.15.77:0/4101494083 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e50009450 con 0x7f4e5c076b10 2024-09-18T21:04:21.402 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.264+0000 7f4e60afb640 1 --2- 172.21.15.77:0/4101494083 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e5c076b10 0x7f4e5c110df0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4e500098a0 tx=0x7f4e5002c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:21.402 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.264+0000 7f4e597fa640 1 -- 172.21.15.77:0/4101494083 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4e500327b0 con 0x7f4e5c076b10 2024-09-18T21:04:21.402 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.264+0000 7f4e597fa640 1 -- 172.21.15.77:0/4101494083 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f4e5003b870 con 0x7f4e5c076b10 2024-09-18T21:04:21.402 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.264+0000 7f4e62d5f640 1 -- 172.21.15.77:0/4101494083 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e5c111530 con 0x7f4e5c076b10 2024-09-18T21:04:21.403 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.264+0000 7f4e597fa640 1 -- 172.21.15.77:0/4101494083 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4e5003a550 con 0x7f4e5c076b10 2024-09-18T21:04:21.403 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.264+0000 7f4e62d5f640 1 -- 172.21.15.77:0/4101494083 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e5c111f80 con 0x7f4e5c076b10 2024-09-18T21:04:21.403 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.265+0000 7f4e597fa640 1 -- 172.21.15.77:0/4101494083 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f4e50039040 con 0x7f4e5c076b10 2024-09-18T21:04:21.403 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.265+0000 7f4e597fa640 1 --2- 172.21.15.77:0/4101494083 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f4e4c039490 0x7f4e4c03b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:21.403 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.265+0000 7f4e597fa640 1 -- 172.21.15.77:0/4101494083 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f4e5006d7a0 con 0x7f4e5c076b10 2024-09-18T21:04:21.403 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.265+0000 7f4e5bfff640 1 --2- 172.21.15.77:0/4101494083 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f4e4c039490 0x7f4e4c03b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:21.403 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.265+0000 7f4e62d5f640 1 -- 172.21.15.77:0/4101494083 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e5c1002f0 con 0x7f4e5c076b10 2024-09-18T21:04:21.403 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.266+0000 7f4e5bfff640 1 --2- 172.21.15.77:0/4101494083 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f4e4c039490 0x7f4e4c03b940 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4e48006fd0 tx=0x7f4e48006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:21.403 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.270+0000 7f4e597fa640 1 -- 172.21.15.77:0/4101494083 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4e5003f080 con 0x7f4e5c076b10 2024-09-18T21:04:21.403 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.426+0000 7f4e62d5f640 1 -- 172.21.15.77:0/4101494083 --> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f4e5c0fdbe0 con 0x7f4e4c039490 2024-09-18T21:04:21.403 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.804+0000 7f4e597fa640 1 -- 172.21.15.77:0/4101494083 <== mgr.14118 v2:172.21.15.77:6800/2654225509 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f4e5c0fdbe0 con 0x7f4e4c039490 2024-09-18T21:04:21.403 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.806+0000 7f4e62d5f640 1 -- 172.21.15.77:0/4101494083 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f4e4c039490 msgr2=0x7f4e4c03b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:21.403 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.806+0000 7f4e62d5f640 1 --2- 172.21.15.77:0/4101494083 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f4e4c039490 0x7f4e4c03b940 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4e48006fd0 tx=0x7f4e48006db0 comp rx=0 tx=0).stop 2024-09-18T21:04:21.404 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.806+0000 7f4e62d5f640 1 -- 172.21.15.77:0/4101494083 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e5c076b10 msgr2=0x7f4e5c110df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:21.404 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.806+0000 7f4e62d5f640 1 --2- 172.21.15.77:0/4101494083 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e5c076b10 0x7f4e5c110df0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4e500098a0 tx=0x7f4e5002c040 comp rx=0 tx=0).stop 2024-09-18T21:04:21.404 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.806+0000 7f4e62d5f640 1 -- 172.21.15.77:0/4101494083 shutdown_connections 2024-09-18T21:04:21.404 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.806+0000 7f4e62d5f640 1 --2- 172.21.15.77:0/4101494083 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f4e4c039490 0x7f4e4c03b940 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:21.404 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.806+0000 7f4e62d5f640 1 --2- 172.21.15.77:0/4101494083 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e5c076b10 0x7f4e5c110df0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:21.404 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.806+0000 7f4e62d5f640 1 -- 172.21.15.77:0/4101494083 >> 172.21.15.77:0/4101494083 conn(0x7f4e5c0fc6d0 msgr2=0x7f4e5c0fd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:21.404 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.806+0000 7f4e62d5f640 1 -- 172.21.15.77:0/4101494083 shutdown_connections 2024-09-18T21:04:21.404 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:20.806+0000 7f4e62d5f640 1 -- 172.21.15.77:0/4101494083 wait complete. 2024-09-18T21:04:22.472 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCNplkfB8eduPPmZvn4q4VCSWfr2hUlxJcutxkUwh2xXw3f4+fhV166vZA0BxPkpjGKKBAr99gKWKw2yB1T1vYQWH99XkN96FFUMEKRl6tyQ97F6eg+9oZM+pJNLPl+lLaL2Y59ee7HPRJmvR/9436er9PMWwLVE+mmDjDZL8YEbVvMcynDtW+0voAvw4k17az0l42DQpb5dQFplF6ViuqVOCwXoDXS0JHD+peNJ4UVssEfgMIvT/fOc7gVXaDWbYA60diC5GzpmEAJMt7qoIlXJrvuyxqJhdCyelYlCOy5Eppwuk4FZVklYBd7UEk947UZKoj8sqEvWDk8L+9/W9CmeahrB+Tsg6ZU+tAI1oPXXq/FIZYYbekBJt16+1Y0nAHGxBBIq42+xnXFu4duu+IE3D5quRJiwHfUbTF4vEh/wKIBzAkLzBdsmjizZHIbeg36o0StWP9oUBDXVuW9os38D1xF1UUmX7zYTuANkIp+punA+sgEHtTnurcxpHDkOxk= ceph-5a76ec16-7601-11ef-bceb-c7b262605968 2024-09-18T21:04:22.472 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.766+0000 7ff46e4ab640 1 Processor -- start 2024-09-18T21:04:22.472 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.766+0000 7ff46e4ab640 1 -- start start 2024-09-18T21:04:22.472 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.766+0000 7ff46e4ab640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff468078ad0 0x7ff468077230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:22.472 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.766+0000 7ff46e4ab640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff468078f70 con 0x7ff468078ad0 2024-09-18T21:04:22.472 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.766+0000 7ff467fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff468078ad0 0x7ff468077230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:22.472 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.766+0000 7ff467fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff468078ad0 0x7ff468077230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47506/0 (socket says 172.21.15.77:47506) 2024-09-18T21:04:22.472 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.766+0000 7ff467fff640 1 -- 172.21.15.77:0/3015340562 learned_addr learned my addr 172.21.15.77:0/3015340562 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:22.473 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.766+0000 7ff467fff640 1 -- 172.21.15.77:0/3015340562 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4680790b0 con 0x7ff468078ad0 2024-09-18T21:04:22.473 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.767+0000 7ff467fff640 1 --2- 172.21.15.77:0/3015340562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff468078ad0 0x7ff468077230 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff458009840 tx=0x7ff4580091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3f75c9b99e823d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:22.473 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.767+0000 7ff466ffd640 1 -- 172.21.15.77:0/3015340562 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff458032440 con 0x7ff468078ad0 2024-09-18T21:04:22.473 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.767+0000 7ff466ffd640 1 -- 172.21.15.77:0/3015340562 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7ff458032a00 con 0x7ff468078ad0 2024-09-18T21:04:22.473 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.767+0000 7ff466ffd640 1 -- 172.21.15.77:0/3015340562 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff4580319e0 con 0x7ff468078ad0 2024-09-18T21:04:22.473 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.768+0000 7ff46e4ab640 1 -- 172.21.15.77:0/3015340562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff468078ad0 msgr2=0x7ff468077230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:22.473 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.768+0000 7ff46e4ab640 1 --2- 172.21.15.77:0/3015340562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff468078ad0 0x7ff468077230 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff458009840 tx=0x7ff4580091d0 comp rx=0 tx=0).stop 2024-09-18T21:04:22.473 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.768+0000 7ff46e4ab640 1 -- 172.21.15.77:0/3015340562 shutdown_connections 2024-09-18T21:04:22.473 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.768+0000 7ff46e4ab640 1 --2- 172.21.15.77:0/3015340562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff468078ad0 0x7ff468077230 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:22.473 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.768+0000 7ff46e4ab640 1 -- 172.21.15.77:0/3015340562 >> 172.21.15.77:0/3015340562 conn(0x7ff4680fd8b0 msgr2=0x7ff4680ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:22.473 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.768+0000 7ff46e4ab640 1 -- 172.21.15.77:0/3015340562 shutdown_connections 2024-09-18T21:04:22.473 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.768+0000 7ff46e4ab640 1 -- 172.21.15.77:0/3015340562 wait complete. 2024-09-18T21:04:22.473 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.768+0000 7ff46e4ab640 1 Processor -- start 2024-09-18T21:04:22.473 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.769+0000 7ff46e4ab640 1 -- start start 2024-09-18T21:04:22.474 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.769+0000 7ff46e4ab640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff468078ad0 0x7ff468112f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:22.474 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.769+0000 7ff46e4ab640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4681134c0 con 0x7ff468078ad0 2024-09-18T21:04:22.474 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.769+0000 7ff467fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff468078ad0 0x7ff468112f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:22.474 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.769+0000 7ff467fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff468078ad0 0x7ff468112f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47516/0 (socket says 172.21.15.77:47516) 2024-09-18T21:04:22.474 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.769+0000 7ff467fff640 1 -- 172.21.15.77:0/1788682066 learned_addr learned my addr 172.21.15.77:0/1788682066 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:22.474 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.769+0000 7ff467fff640 1 -- 172.21.15.77:0/1788682066 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff458009450 con 0x7ff468078ad0 2024-09-18T21:04:22.474 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.769+0000 7ff467fff640 1 --2- 172.21.15.77:0/1788682066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff468078ad0 0x7ff468112f80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff458006f00 tx=0x7ff458008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:22.474 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.770+0000 7ff464ff9640 1 -- 172.21.15.77:0/1788682066 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff45803b470 con 0x7ff468078ad0 2024-09-18T21:04:22.474 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.770+0000 7ff464ff9640 1 -- 172.21.15.77:0/1788682066 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7ff45803ba30 con 0x7ff468078ad0 2024-09-18T21:04:22.474 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.770+0000 7ff46e4ab640 1 -- 172.21.15.77:0/1788682066 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4681136c0 con 0x7ff468078ad0 2024-09-18T21:04:22.474 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.770+0000 7ff464ff9640 1 -- 172.21.15.77:0/1788682066 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff45803a820 con 0x7ff468078ad0 2024-09-18T21:04:22.474 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.770+0000 7ff46e4ab640 1 -- 172.21.15.77:0/1788682066 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff468113b30 con 0x7ff468078ad0 2024-09-18T21:04:22.474 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.770+0000 7ff464ff9640 1 -- 172.21.15.77:0/1788682066 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7ff45803aa50 con 0x7ff468078ad0 2024-09-18T21:04:22.475 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.771+0000 7ff464ff9640 1 --2- 172.21.15.77:0/1788682066 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7ff4500394e0 0x7ff45003b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:22.475 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.771+0000 7ff464ff9640 1 -- 172.21.15.77:0/1788682066 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7ff45806cb00 con 0x7ff468078ad0 2024-09-18T21:04:22.475 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.771+0000 7ff4677fe640 1 --2- 172.21.15.77:0/1788682066 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7ff4500394e0 0x7ff45003b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:22.475 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.771+0000 7ff46e4ab640 1 -- 172.21.15.77:0/1788682066 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff468101570 con 0x7ff468078ad0 2024-09-18T21:04:22.475 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.771+0000 7ff4677fe640 1 --2- 172.21.15.77:0/1788682066 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7ff4500394e0 0x7ff45003b990 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff45c006fd0 tx=0x7ff45c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:22.475 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.775+0000 7ff464ff9640 1 -- 172.21.15.77:0/1788682066 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff458037030 con 0x7ff468078ad0 2024-09-18T21:04:22.475 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.932+0000 7ff46e4ab640 1 -- 172.21.15.77:0/1788682066 --> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4680fec40 con 0x7ff4500394e0 2024-09-18T21:04:22.475 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.933+0000 7ff464ff9640 1 -- 172.21.15.77:0/1788682066 <== mgr.14118 v2:172.21.15.77:6800/2654225509 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7ff4680fec40 con 0x7ff4500394e0 2024-09-18T21:04:22.475 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.935+0000 7ff46e4ab640 1 -- 172.21.15.77:0/1788682066 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7ff4500394e0 msgr2=0x7ff45003b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:22.475 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.935+0000 7ff46e4ab640 1 --2- 172.21.15.77:0/1788682066 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7ff4500394e0 0x7ff45003b990 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff45c006fd0 tx=0x7ff45c006db0 comp rx=0 tx=0).stop 2024-09-18T21:04:22.475 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.935+0000 7ff46e4ab640 1 -- 172.21.15.77:0/1788682066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff468078ad0 msgr2=0x7ff468112f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:22.475 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.935+0000 7ff46e4ab640 1 --2- 172.21.15.77:0/1788682066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff468078ad0 0x7ff468112f80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff458006f00 tx=0x7ff458008040 comp rx=0 tx=0).stop 2024-09-18T21:04:22.475 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.935+0000 7ff46e4ab640 1 -- 172.21.15.77:0/1788682066 shutdown_connections 2024-09-18T21:04:22.475 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.935+0000 7ff46e4ab640 1 --2- 172.21.15.77:0/1788682066 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7ff4500394e0 0x7ff45003b990 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:22.476 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.935+0000 7ff46e4ab640 1 --2- 172.21.15.77:0/1788682066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff468078ad0 0x7ff468112f80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:22.476 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.935+0000 7ff46e4ab640 1 -- 172.21.15.77:0/1788682066 >> 172.21.15.77:0/1788682066 conn(0x7ff4680fd8b0 msgr2=0x7ff4680fe470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:22.476 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.935+0000 7ff46e4ab640 1 -- 172.21.15.77:0/1788682066 shutdown_connections 2024-09-18T21:04:22.476 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:21.935+0000 7ff46e4ab640 1 -- 172.21.15.77:0/1788682066 wait complete. 2024-09-18T21:04:22.476 INFO:teuthology.orchestra.run.smithi077.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-18T21:04:22.476 INFO:teuthology.orchestra.run.smithi077.stdout:Adding key to root@localhost authorized_keys... 2024-09-18T21:04:22.480 INFO:teuthology.orchestra.run.smithi077.stdout:Adding host smithi077... 2024-09-18T21:04:23.150 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:22 smithi077 ceph-mon[27689]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:04:24.063 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:23 smithi077 ceph-mon[27689]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi077", "addr": "172.21.15.77", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:04:25.189 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:24 smithi077 ceph-mon[27689]: Deploying cephadm binary to smithi077 2024-09-18T21:04:26.289 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout Added host 'smithi077' with addr '172.21.15.77' 2024-09-18T21:04:26.289 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:22.867+0000 7f7067849640 1 Processor -- start 2024-09-18T21:04:26.289 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:22.867+0000 7f7067849640 1 -- start start 2024-09-18T21:04:26.289 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:22.867+0000 7f7067849640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7060076b30 0x7f7060104bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:26.289 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:22.867+0000 7f7067849640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7060076f40 con 0x7f7060076b30 2024-09-18T21:04:26.289 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:22.868+0000 7f70655e5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7060076b30 0x7f7060104bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:26.289 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:22.868+0000 7f70655e5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7060076b30 0x7f7060104bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47518/0 (socket says 172.21.15.77:47518) 2024-09-18T21:04:26.289 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:22.868+0000 7f70655e5640 1 -- 172.21.15.77:0/1377343783 learned_addr learned my addr 172.21.15.77:0/1377343783 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:26.289 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:22.868+0000 7f70655e5640 1 -- 172.21.15.77:0/1377343783 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7060105100 con 0x7f7060076b30 2024-09-18T21:04:26.289 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:22.869+0000 7f70655e5640 1 --2- 172.21.15.77:0/1377343783 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7060076b30 0x7f7060104bc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f705c009840 tx=0x7f705c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b010cf8b7f13645 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:26.289 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:22.869+0000 7f7057fff640 1 -- 172.21.15.77:0/1377343783 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f705c032440 con 0x7f7060076b30 2024-09-18T21:04:26.290 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:22.869+0000 7f7057fff640 1 -- 172.21.15.77:0/1377343783 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f705c032a00 con 0x7f7060076b30 2024-09-18T21:04:26.290 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:22.869+0000 7f7057fff640 1 -- 172.21.15.77:0/1377343783 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f705c031a10 con 0x7f7060076b30 2024-09-18T21:04:26.290 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:22.869+0000 7f7067849640 1 -- 172.21.15.77:0/1377343783 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7060076b30 msgr2=0x7f7060104bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:26.290 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:22.869+0000 7f7067849640 1 --2- 172.21.15.77:0/1377343783 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7060076b30 0x7f7060104bc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f705c009840 tx=0x7f705c0091d0 comp rx=0 tx=0).stop 2024-09-18T21:04:26.290 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:22.869+0000 7f7067849640 1 -- 172.21.15.77:0/1377343783 shutdown_connections 2024-09-18T21:04:26.290 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:22.869+0000 7f7067849640 1 --2- 172.21.15.77:0/1377343783 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7060076b30 0x7f7060104bc0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:26.290 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:22.869+0000 7f7067849640 1 -- 172.21.15.77:0/1377343783 >> 172.21.15.77:0/1377343783 conn(0x7f70600fc6d0 msgr2=0x7f70600feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:26.290 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:22.870+0000 7f7067849640 1 -- 172.21.15.77:0/1377343783 shutdown_connections 2024-09-18T21:04:26.290 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:22.870+0000 7f7067849640 1 -- 172.21.15.77:0/1377343783 wait complete. 2024-09-18T21:04:26.290 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:22.870+0000 7f7067849640 1 Processor -- start 2024-09-18T21:04:26.290 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:22.870+0000 7f7067849640 1 -- start start 2024-09-18T21:04:26.290 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:22.870+0000 7f7067849640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7060076b30 0x7f706010eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:26.290 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:22.870+0000 7f7067849640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706010f090 con 0x7f7060076b30 2024-09-18T21:04:26.290 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:22.870+0000 7f70655e5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7060076b30 0x7f706010eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:26.291 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:22.870+0000 7f70655e5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7060076b30 0x7f706010eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47522/0 (socket says 172.21.15.77:47522) 2024-09-18T21:04:26.291 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:22.870+0000 7f70655e5640 1 -- 172.21.15.77:0/1273374262 learned_addr learned my addr 172.21.15.77:0/1273374262 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:26.291 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:22.871+0000 7f70655e5640 1 -- 172.21.15.77:0/1273374262 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f705c009450 con 0x7f7060076b30 2024-09-18T21:04:26.291 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:22.871+0000 7f70655e5640 1 --2- 172.21.15.77:0/1273374262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7060076b30 0x7f706010eb50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f705c0098a0 tx=0x7f705c02c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:26.291 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:22.871+0000 7f7055ffb640 1 -- 172.21.15.77:0/1273374262 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f705c0327b0 con 0x7f7060076b30 2024-09-18T21:04:26.291 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:22.871+0000 7f7055ffb640 1 -- 172.21.15.77:0/1273374262 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f705c03b870 con 0x7f7060076b30 2024-09-18T21:04:26.291 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:22.871+0000 7f7067849640 1 -- 172.21.15.77:0/1273374262 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f706010f290 con 0x7f7060076b30 2024-09-18T21:04:26.291 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:22.871+0000 7f7055ffb640 1 -- 172.21.15.77:0/1273374262 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f705c03a550 con 0x7f7060076b30 2024-09-18T21:04:26.291 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:22.871+0000 7f7067849640 1 -- 172.21.15.77:0/1273374262 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f706010f700 con 0x7f7060076b30 2024-09-18T21:04:26.291 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:22.872+0000 7f7055ffb640 1 -- 172.21.15.77:0/1273374262 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f705c039040 con 0x7f7060076b30 2024-09-18T21:04:26.291 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:22.872+0000 7f7055ffb640 1 --2- 172.21.15.77:0/1273374262 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f704c03d8e0 0x7f704c03fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:26.291 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:22.872+0000 7f7055ffb640 1 -- 172.21.15.77:0/1273374262 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f705c06c730 con 0x7f7060076b30 2024-09-18T21:04:26.291 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:22.872+0000 7f7067849640 1 -- 172.21.15.77:0/1273374262 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70601002f0 con 0x7f7060076b30 2024-09-18T21:04:26.291 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:22.872+0000 7f7064de4640 1 --2- 172.21.15.77:0/1273374262 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f704c03d8e0 0x7f704c03fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:26.292 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:22.873+0000 7f7064de4640 1 --2- 172.21.15.77:0/1273374262 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f704c03d8e0 0x7f704c03fd90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7050006fd0 tx=0x7f7050006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:26.292 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:22.877+0000 7f7055ffb640 1 -- 172.21.15.77:0/1273374262 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f705c03f020 con 0x7f7060076b30 2024-09-18T21:04:26.292 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:23.036+0000 7f7067849640 1 -- 172.21.15.77:0/1273374262 --> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi077", "addr": "172.21.15.77", "target": ["mon-mgr", ""]}) v1 -- 0x7f70601085f0 con 0x7f704c03d8e0 2024-09-18T21:04:26.292 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:25.756+0000 7f7055ffb640 1 -- 172.21.15.77:0/1273374262 <== mgr.14118 v2:172.21.15.77:6800/2654225509 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f70601085f0 con 0x7f704c03d8e0 2024-09-18T21:04:26.292 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:25.759+0000 7f7067849640 1 -- 172.21.15.77:0/1273374262 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f704c03d8e0 msgr2=0x7f704c03fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:26.292 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:25.759+0000 7f7067849640 1 --2- 172.21.15.77:0/1273374262 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f704c03d8e0 0x7f704c03fd90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7050006fd0 tx=0x7f7050006db0 comp rx=0 tx=0).stop 2024-09-18T21:04:26.292 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:25.759+0000 7f7067849640 1 -- 172.21.15.77:0/1273374262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7060076b30 msgr2=0x7f706010eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:26.292 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:25.759+0000 7f7067849640 1 --2- 172.21.15.77:0/1273374262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7060076b30 0x7f706010eb50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f705c0098a0 tx=0x7f705c02c040 comp rx=0 tx=0).stop 2024-09-18T21:04:26.292 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:25.759+0000 7f7067849640 1 -- 172.21.15.77:0/1273374262 shutdown_connections 2024-09-18T21:04:26.292 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:25.759+0000 7f7067849640 1 --2- 172.21.15.77:0/1273374262 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f704c03d8e0 0x7f704c03fd90 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:26.292 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:25.759+0000 7f7067849640 1 --2- 172.21.15.77:0/1273374262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7060076b30 0x7f706010eb50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:26.292 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:25.759+0000 7f7067849640 1 -- 172.21.15.77:0/1273374262 >> 172.21.15.77:0/1273374262 conn(0x7f70600fc6d0 msgr2=0x7f70601024e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:26.293 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:25.759+0000 7f7067849640 1 -- 172.21.15.77:0/1273374262 shutdown_connections 2024-09-18T21:04:26.293 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:25.759+0000 7f7067849640 1 -- 172.21.15.77:0/1273374262 wait complete. 2024-09-18T21:04:26.293 INFO:teuthology.orchestra.run.smithi077.stdout:Deploying mon service with default placement... 2024-09-18T21:04:26.946 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:26 smithi077 ceph-mon[27689]: from='mgr.14118 172.21.15.77:0/107867287' entity='mgr.smithi077.utkpjg' 2024-09-18T21:04:26.946 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:26 smithi077 ceph-mon[27689]: Added host smithi077 2024-09-18T21:04:26.947 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:26 smithi077 ceph-mon[27689]: from='mgr.14118 172.21.15.77:0/107867287' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:04:27.683 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-18T21:04:27.684 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.690+0000 7f7b7c32f640 1 Processor -- start 2024-09-18T21:04:27.684 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.690+0000 7f7b7c32f640 1 -- start start 2024-09-18T21:04:27.684 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.691+0000 7f7b7c32f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b74101f40 0x7f7b74102350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:27.684 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.691+0000 7f7b7c32f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b74102890 con 0x7f7b74101f40 2024-09-18T21:04:27.684 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.691+0000 7f7b7a0cb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b74101f40 0x7f7b74102350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:27.684 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.691+0000 7f7b7a0cb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b74101f40 0x7f7b74102350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47526/0 (socket says 172.21.15.77:47526) 2024-09-18T21:04:27.684 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.691+0000 7f7b7a0cb640 1 -- 172.21.15.77:0/2298851427 learned_addr learned my addr 172.21.15.77:0/2298851427 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:27.684 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.691+0000 7f7b7a0cb640 1 -- 172.21.15.77:0/2298851427 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b741029d0 con 0x7f7b74101f40 2024-09-18T21:04:27.684 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.692+0000 7f7b7a0cb640 1 --2- 172.21.15.77:0/2298851427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b74101f40 0x7f7b74102350 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7b70009840 tx=0x7f7b700091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28b4dab7d033cc98 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:27.684 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.692+0000 7f7b790c9640 1 -- 172.21.15.77:0/2298851427 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7b70032440 con 0x7f7b74101f40 2024-09-18T21:04:27.684 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.692+0000 7f7b790c9640 1 -- 172.21.15.77:0/2298851427 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f7b70032a00 con 0x7f7b74101f40 2024-09-18T21:04:27.684 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.692+0000 7f7b790c9640 1 -- 172.21.15.77:0/2298851427 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7b700319e0 con 0x7f7b74101f40 2024-09-18T21:04:27.685 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.693+0000 7f7b7c32f640 1 -- 172.21.15.77:0/2298851427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b74101f40 msgr2=0x7f7b74102350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:27.685 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.693+0000 7f7b7c32f640 1 --2- 172.21.15.77:0/2298851427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b74101f40 0x7f7b74102350 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7b70009840 tx=0x7f7b700091d0 comp rx=0 tx=0).stop 2024-09-18T21:04:27.685 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.693+0000 7f7b7c32f640 1 -- 172.21.15.77:0/2298851427 shutdown_connections 2024-09-18T21:04:27.685 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.693+0000 7f7b7c32f640 1 --2- 172.21.15.77:0/2298851427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b74101f40 0x7f7b74102350 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:27.685 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.693+0000 7f7b7c32f640 1 -- 172.21.15.77:0/2298851427 >> 172.21.15.77:0/2298851427 conn(0x7f7b740fd680 msgr2=0x7f7b740ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:27.685 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.693+0000 7f7b7c32f640 1 -- 172.21.15.77:0/2298851427 shutdown_connections 2024-09-18T21:04:27.685 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.693+0000 7f7b7c32f640 1 -- 172.21.15.77:0/2298851427 wait complete. 2024-09-18T21:04:27.685 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.693+0000 7f7b7c32f640 1 Processor -- start 2024-09-18T21:04:27.685 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.693+0000 7f7b7c32f640 1 -- start start 2024-09-18T21:04:27.685 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.694+0000 7f7b7c32f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b74101f40 0x7f7b74078c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:27.685 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.694+0000 7f7b7c32f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b74079140 con 0x7f7b74101f40 2024-09-18T21:04:27.685 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.694+0000 7f7b7a0cb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b74101f40 0x7f7b74078c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:27.685 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.694+0000 7f7b7a0cb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b74101f40 0x7f7b74078c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47528/0 (socket says 172.21.15.77:47528) 2024-09-18T21:04:27.686 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.694+0000 7f7b7a0cb640 1 -- 172.21.15.77:0/4101760225 learned_addr learned my addr 172.21.15.77:0/4101760225 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:27.686 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.694+0000 7f7b7a0cb640 1 -- 172.21.15.77:0/4101760225 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b70009450 con 0x7f7b74101f40 2024-09-18T21:04:27.686 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.694+0000 7f7b7a0cb640 1 --2- 172.21.15.77:0/4101760225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b74101f40 0x7f7b74078c00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7b70000c00 tx=0x7f7b70008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:27.686 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.694+0000 7f7b6affd640 1 -- 172.21.15.77:0/4101760225 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7b7003d450 con 0x7f7b74101f40 2024-09-18T21:04:27.686 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.694+0000 7f7b6affd640 1 -- 172.21.15.77:0/4101760225 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f7b7003da10 con 0x7f7b74101f40 2024-09-18T21:04:27.686 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.694+0000 7f7b7c32f640 1 -- 172.21.15.77:0/4101760225 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b740771d0 con 0x7f7b74101f40 2024-09-18T21:04:27.686 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.694+0000 7f7b6affd640 1 -- 172.21.15.77:0/4101760225 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7b7003b8e0 con 0x7f7b74101f40 2024-09-18T21:04:27.686 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.694+0000 7f7b7c32f640 1 -- 172.21.15.77:0/4101760225 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b74077640 con 0x7f7b74101f40 2024-09-18T21:04:27.686 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.695+0000 7f7b6affd640 1 -- 172.21.15.77:0/4101760225 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f7b70039070 con 0x7f7b74101f40 2024-09-18T21:04:27.686 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.695+0000 7f7b7c32f640 1 -- 172.21.15.77:0/4101760225 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b7404b720 con 0x7f7b74101f40 2024-09-18T21:04:27.686 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.695+0000 7f7b6affd640 1 --2- 172.21.15.77:0/4101760225 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f7b60039490 0x7f7b6003b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:27.686 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.695+0000 7f7b6affd640 1 -- 172.21.15.77:0/4101760225 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f7b7006d530 con 0x7f7b74101f40 2024-09-18T21:04:27.686 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.695+0000 7f7b798ca640 1 --2- 172.21.15.77:0/4101760225 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f7b60039490 0x7f7b6003b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:27.686 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.696+0000 7f7b798ca640 1 --2- 172.21.15.77:0/4101760225 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f7b60039490 0x7f7b6003b940 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7b64006fd0 tx=0x7f7b64006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:27.686 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.700+0000 7f7b6affd640 1 -- 172.21.15.77:0/4101760225 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f7b70039320 con 0x7f7b74101f40 2024-09-18T21:04:27.687 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.867+0000 7f7b7c32f640 1 -- 172.21.15.77:0/4101760225 --> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b74077cc0 con 0x7f7b60039490 2024-09-18T21:04:27.687 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.872+0000 7f7b6affd640 1 -- 172.21.15.77:0/4101760225 <== mgr.14118 v2:172.21.15.77:6800/2654225509 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f7b74077cc0 con 0x7f7b60039490 2024-09-18T21:04:27.687 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.874+0000 7f7b7c32f640 1 -- 172.21.15.77:0/4101760225 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f7b60039490 msgr2=0x7f7b6003b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:27.687 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.874+0000 7f7b7c32f640 1 --2- 172.21.15.77:0/4101760225 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f7b60039490 0x7f7b6003b940 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7b64006fd0 tx=0x7f7b64006db0 comp rx=0 tx=0).stop 2024-09-18T21:04:27.687 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.874+0000 7f7b7c32f640 1 -- 172.21.15.77:0/4101760225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b74101f40 msgr2=0x7f7b74078c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:27.687 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.874+0000 7f7b7c32f640 1 --2- 172.21.15.77:0/4101760225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b74101f40 0x7f7b74078c00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7b70000c00 tx=0x7f7b70008040 comp rx=0 tx=0).stop 2024-09-18T21:04:27.687 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.874+0000 7f7b7c32f640 1 -- 172.21.15.77:0/4101760225 shutdown_connections 2024-09-18T21:04:27.687 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.874+0000 7f7b7c32f640 1 --2- 172.21.15.77:0/4101760225 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f7b60039490 0x7f7b6003b940 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:27.687 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.874+0000 7f7b7c32f640 1 --2- 172.21.15.77:0/4101760225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b74101f40 0x7f7b74078c00 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:27.687 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.874+0000 7f7b7c32f640 1 -- 172.21.15.77:0/4101760225 >> 172.21.15.77:0/4101760225 conn(0x7f7b740fd680 msgr2=0x7f7b740fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:27.687 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.875+0000 7f7b7c32f640 1 -- 172.21.15.77:0/4101760225 shutdown_connections 2024-09-18T21:04:27.687 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:26.875+0000 7f7b7c32f640 1 -- 172.21.15.77:0/4101760225 wait complete. 2024-09-18T21:04:27.687 INFO:teuthology.orchestra.run.smithi077.stdout:Deploying mgr service with default placement... 2024-09-18T21:04:27.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:27 smithi077 ceph-mon[27689]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:04:27.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:27 smithi077 ceph-mon[27689]: Saving service mon spec with placement count:5 2024-09-18T21:04:27.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:27 smithi077 ceph-mon[27689]: from='mgr.14118 172.21.15.77:0/107867287' entity='mgr.smithi077.utkpjg' 2024-09-18T21:04:29.519 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:29 smithi077 ceph-mon[27689]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:04:29.519 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:29 smithi077 ceph-mon[27689]: Saving service mgr spec with placement count:2 2024-09-18T21:04:29.519 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:29 smithi077 ceph-mon[27689]: from='mgr.14118 172.21.15.77:0/107867287' entity='mgr.smithi077.utkpjg' 2024-09-18T21:04:29.519 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:29 smithi077 ceph-mon[27689]: from='mgr.14118 172.21.15.77:0/107867287' entity='mgr.smithi077.utkpjg' 2024-09-18T21:04:29.520 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:29 smithi077 ceph-mon[27689]: from='mgr.14118 172.21.15.77:0/107867287' entity='mgr.smithi077.utkpjg' 2024-09-18T21:04:29.526 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-18T21:04:29.526 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.068+0000 7fde21849640 1 Processor -- start 2024-09-18T21:04:29.526 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.068+0000 7fde21849640 1 -- start start 2024-09-18T21:04:29.526 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.069+0000 7fde21849640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde1c1035d0 0x7fde1c1039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:29.527 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.069+0000 7fde21849640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde1c070e30 con 0x7fde1c1035d0 2024-09-18T21:04:29.527 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.069+0000 7fde1affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde1c1035d0 0x7fde1c1039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:29.527 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.069+0000 7fde1affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde1c1035d0 0x7fde1c1039e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47530/0 (socket says 172.21.15.77:47530) 2024-09-18T21:04:29.527 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.069+0000 7fde1affd640 1 -- 172.21.15.77:0/2144183638 learned_addr learned my addr 172.21.15.77:0/2144183638 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:29.527 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.069+0000 7fde1affd640 1 -- 172.21.15.77:0/2144183638 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde1c103f20 con 0x7fde1c1035d0 2024-09-18T21:04:29.527 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.070+0000 7fde1affd640 1 --2- 172.21.15.77:0/2144183638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde1c1035d0 0x7fde1c1039e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fde0c009840 tx=0x7fde0c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ba0878101c0890e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:29.527 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.070+0000 7fde19ffb640 1 -- 172.21.15.77:0/2144183638 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fde0c032440 con 0x7fde1c1035d0 2024-09-18T21:04:29.527 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.070+0000 7fde19ffb640 1 -- 172.21.15.77:0/2144183638 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fde0c032a00 con 0x7fde1c1035d0 2024-09-18T21:04:29.527 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.070+0000 7fde19ffb640 1 -- 172.21.15.77:0/2144183638 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fde0c0319e0 con 0x7fde1c1035d0 2024-09-18T21:04:29.527 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.070+0000 7fde21849640 1 -- 172.21.15.77:0/2144183638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde1c1035d0 msgr2=0x7fde1c1039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:29.527 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.070+0000 7fde21849640 1 --2- 172.21.15.77:0/2144183638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde1c1035d0 0x7fde1c1039e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fde0c009840 tx=0x7fde0c0091d0 comp rx=0 tx=0).stop 2024-09-18T21:04:29.527 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.070+0000 7fde21849640 1 -- 172.21.15.77:0/2144183638 shutdown_connections 2024-09-18T21:04:29.527 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.070+0000 7fde21849640 1 --2- 172.21.15.77:0/2144183638 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde1c1035d0 0x7fde1c1039e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:29.527 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.070+0000 7fde21849640 1 -- 172.21.15.77:0/2144183638 >> 172.21.15.77:0/2144183638 conn(0x7fde1c0fbdd0 msgr2=0x7fde1c0fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:29.528 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.071+0000 7fde21849640 1 -- 172.21.15.77:0/2144183638 shutdown_connections 2024-09-18T21:04:29.528 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.071+0000 7fde21849640 1 -- 172.21.15.77:0/2144183638 wait complete. 2024-09-18T21:04:29.528 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.071+0000 7fde21849640 1 Processor -- start 2024-09-18T21:04:29.528 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.071+0000 7fde21849640 1 -- start start 2024-09-18T21:04:29.528 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.071+0000 7fde21849640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde1c1035d0 0x7fde1c110dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:29.528 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.071+0000 7fde21849640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde1c111310 con 0x7fde1c1035d0 2024-09-18T21:04:29.528 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.071+0000 7fde1affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde1c1035d0 0x7fde1c110dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:29.528 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.071+0000 7fde1affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde1c1035d0 0x7fde1c110dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47534/0 (socket says 172.21.15.77:47534) 2024-09-18T21:04:29.528 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.071+0000 7fde1affd640 1 -- 172.21.15.77:0/2367979890 learned_addr learned my addr 172.21.15.77:0/2367979890 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:29.528 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.072+0000 7fde1affd640 1 -- 172.21.15.77:0/2367979890 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde0c009450 con 0x7fde1c1035d0 2024-09-18T21:04:29.528 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.072+0000 7fde1affd640 1 --2- 172.21.15.77:0/2367979890 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde1c1035d0 0x7fde1c110dd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fde0c0098a0 tx=0x7fde0c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:29.528 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.072+0000 7fde037fe640 1 -- 172.21.15.77:0/2367979890 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fde0c032880 con 0x7fde1c1035d0 2024-09-18T21:04:29.528 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.072+0000 7fde21849640 1 -- 172.21.15.77:0/2367979890 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde1c111510 con 0x7fde1c1035d0 2024-09-18T21:04:29.528 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.072+0000 7fde037fe640 1 -- 172.21.15.77:0/2367979890 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fde0c03d8b0 con 0x7fde1c1035d0 2024-09-18T21:04:29.529 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.072+0000 7fde037fe640 1 -- 172.21.15.77:0/2367979890 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fde0c03b910 con 0x7fde1c1035d0 2024-09-18T21:04:29.529 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.072+0000 7fde21849640 1 -- 172.21.15.77:0/2367979890 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde1c111f60 con 0x7fde1c1035d0 2024-09-18T21:04:29.529 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.073+0000 7fde037fe640 1 -- 172.21.15.77:0/2367979890 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fde0c039070 con 0x7fde1c1035d0 2024-09-18T21:04:29.529 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.073+0000 7fde21849640 1 -- 172.21.15.77:0/2367979890 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde1c0ffa70 con 0x7fde1c1035d0 2024-09-18T21:04:29.529 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.073+0000 7fde037fe640 1 --2- 172.21.15.77:0/2367979890 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7fde04039490 0x7fde0403b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:29.529 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.073+0000 7fde037fe640 1 -- 172.21.15.77:0/2367979890 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fde0c06d380 con 0x7fde1c1035d0 2024-09-18T21:04:29.529 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.073+0000 7fde1a7fc640 1 --2- 172.21.15.77:0/2367979890 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7fde04039490 0x7fde0403b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:29.529 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.074+0000 7fde1a7fc640 1 --2- 172.21.15.77:0/2367979890 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7fde04039490 0x7fde0403b940 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fde10006fd0 tx=0x7fde10006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:29.529 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.078+0000 7fde037fe640 1 -- 172.21.15.77:0/2367979890 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fde0c039550 con 0x7fde1c1035d0 2024-09-18T21:04:29.529 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.242+0000 7fde21849640 1 -- 172.21.15.77:0/2367979890 --> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7fde1c0fcfe0 con 0x7fde04039490 2024-09-18T21:04:29.529 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.247+0000 7fde037fe640 1 -- 172.21.15.77:0/2367979890 <== mgr.14118 v2:172.21.15.77:6800/2654225509 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fde1c0fcfe0 con 0x7fde04039490 2024-09-18T21:04:29.529 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.249+0000 7fde21849640 1 -- 172.21.15.77:0/2367979890 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7fde04039490 msgr2=0x7fde0403b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:29.529 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.249+0000 7fde21849640 1 --2- 172.21.15.77:0/2367979890 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7fde04039490 0x7fde0403b940 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fde10006fd0 tx=0x7fde10006db0 comp rx=0 tx=0).stop 2024-09-18T21:04:29.530 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.249+0000 7fde21849640 1 -- 172.21.15.77:0/2367979890 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde1c1035d0 msgr2=0x7fde1c110dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:29.530 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.249+0000 7fde21849640 1 --2- 172.21.15.77:0/2367979890 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde1c1035d0 0x7fde1c110dd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fde0c0098a0 tx=0x7fde0c008040 comp rx=0 tx=0).stop 2024-09-18T21:04:29.530 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.249+0000 7fde21849640 1 -- 172.21.15.77:0/2367979890 shutdown_connections 2024-09-18T21:04:29.530 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.249+0000 7fde21849640 1 --2- 172.21.15.77:0/2367979890 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7fde04039490 0x7fde0403b940 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:29.530 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.249+0000 7fde21849640 1 --2- 172.21.15.77:0/2367979890 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde1c1035d0 0x7fde1c110dd0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:29.530 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.249+0000 7fde21849640 1 -- 172.21.15.77:0/2367979890 >> 172.21.15.77:0/2367979890 conn(0x7fde1c0fbdd0 msgr2=0x7fde1c0fc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:29.530 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.250+0000 7fde21849640 1 -- 172.21.15.77:0/2367979890 shutdown_connections 2024-09-18T21:04:29.530 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:28.250+0000 7fde21849640 1 -- 172.21.15.77:0/2367979890 wait complete. 2024-09-18T21:04:29.530 INFO:teuthology.orchestra.run.smithi077.stdout:Deploying crash service with default placement... 2024-09-18T21:04:31.122 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-09-18T21:04:31.122 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:29.870+0000 7f82bc510640 1 Processor -- start 2024-09-18T21:04:31.122 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:29.870+0000 7f82bc510640 1 -- start start 2024-09-18T21:04:31.122 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:29.870+0000 7f82bc510640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82b4076b30 0x7f82b4104c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:31.122 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:29.870+0000 7f82bc510640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b4076f40 con 0x7f82b4076b30 2024-09-18T21:04:31.122 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:29.870+0000 7f82ba2ac640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82b4076b30 0x7f82b4104c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:31.122 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:29.870+0000 7f82ba2ac640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82b4076b30 0x7f82b4104c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38086/0 (socket says 172.21.15.77:38086) 2024-09-18T21:04:31.122 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:29.870+0000 7f82ba2ac640 1 -- 172.21.15.77:0/3427476586 learned_addr learned my addr 172.21.15.77:0/3427476586 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:31.122 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:29.870+0000 7f82ba2ac640 1 -- 172.21.15.77:0/3427476586 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b4105180 con 0x7f82b4076b30 2024-09-18T21:04:31.122 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:29.871+0000 7f82ba2ac640 1 --2- 172.21.15.77:0/3427476586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82b4076b30 0x7f82b4104c40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f82a4009840 tx=0x7f82a40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e13e9847a4085459 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:31.122 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:29.871+0000 7f82b92aa640 1 -- 172.21.15.77:0/3427476586 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f82a4032440 con 0x7f82b4076b30 2024-09-18T21:04:31.123 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:29.871+0000 7f82b92aa640 1 -- 172.21.15.77:0/3427476586 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f82a4032a40 con 0x7f82b4076b30 2024-09-18T21:04:31.123 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:29.871+0000 7f82b92aa640 1 -- 172.21.15.77:0/3427476586 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f82a4031a70 con 0x7f82b4076b30 2024-09-18T21:04:31.123 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:29.872+0000 7f82bc510640 1 -- 172.21.15.77:0/3427476586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82b4076b30 msgr2=0x7f82b4104c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:31.123 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:29.872+0000 7f82bc510640 1 --2- 172.21.15.77:0/3427476586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82b4076b30 0x7f82b4104c40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f82a4009840 tx=0x7f82a40091d0 comp rx=0 tx=0).stop 2024-09-18T21:04:31.123 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:29.872+0000 7f82bc510640 1 -- 172.21.15.77:0/3427476586 shutdown_connections 2024-09-18T21:04:31.123 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:29.872+0000 7f82bc510640 1 --2- 172.21.15.77:0/3427476586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82b4076b30 0x7f82b4104c40 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:31.123 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:29.872+0000 7f82bc510640 1 -- 172.21.15.77:0/3427476586 >> 172.21.15.77:0/3427476586 conn(0x7f82b40fc710 msgr2=0x7f82b40feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:31.123 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:29.872+0000 7f82bc510640 1 -- 172.21.15.77:0/3427476586 shutdown_connections 2024-09-18T21:04:31.123 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:29.872+0000 7f82bc510640 1 -- 172.21.15.77:0/3427476586 wait complete. 2024-09-18T21:04:31.123 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:29.872+0000 7f82bc510640 1 Processor -- start 2024-09-18T21:04:31.123 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:29.872+0000 7f82bc510640 1 -- start start 2024-09-18T21:04:31.123 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:29.873+0000 7f82bc510640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82b4076b30 0x7f82b4110e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:31.123 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:29.873+0000 7f82bc510640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b4111390 con 0x7f82b4076b30 2024-09-18T21:04:31.123 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:29.873+0000 7f82ba2ac640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82b4076b30 0x7f82b4110e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:31.124 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:29.873+0000 7f82ba2ac640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82b4076b30 0x7f82b4110e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38102/0 (socket says 172.21.15.77:38102) 2024-09-18T21:04:31.124 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:29.873+0000 7f82ba2ac640 1 -- 172.21.15.77:0/1174309734 learned_addr learned my addr 172.21.15.77:0/1174309734 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:31.124 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:29.873+0000 7f82ba2ac640 1 -- 172.21.15.77:0/1174309734 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a4009450 con 0x7f82b4076b30 2024-09-18T21:04:31.124 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:29.873+0000 7f82ba2ac640 1 --2- 172.21.15.77:0/1174309734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82b4076b30 0x7f82b4110e50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f82a4031750 tx=0x7f82a40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:31.124 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:29.873+0000 7f82aaffd640 1 -- 172.21.15.77:0/1174309734 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f82a403c400 con 0x7f82b4076b30 2024-09-18T21:04:31.124 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:29.873+0000 7f82bc510640 1 -- 172.21.15.77:0/1174309734 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82b4111590 con 0x7f82b4076b30 2024-09-18T21:04:31.124 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:29.873+0000 7f82aaffd640 1 -- 172.21.15.77:0/1174309734 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f82a403ca00 con 0x7f82b4076b30 2024-09-18T21:04:31.124 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:29.873+0000 7f82aaffd640 1 -- 172.21.15.77:0/1174309734 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f82a403a880 con 0x7f82b4076b30 2024-09-18T21:04:31.124 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:29.873+0000 7f82bc510640 1 -- 172.21.15.77:0/1174309734 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82b4111fe0 con 0x7f82b4076b30 2024-09-18T21:04:31.124 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:29.874+0000 7f82aaffd640 1 -- 172.21.15.77:0/1174309734 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f82a403aaf0 con 0x7f82b4076b30 2024-09-18T21:04:31.124 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:29.874+0000 7f82bc510640 1 -- 172.21.15.77:0/1174309734 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82b4100350 con 0x7f82b4076b30 2024-09-18T21:04:31.124 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:29.874+0000 7f82aaffd640 1 --2- 172.21.15.77:0/1174309734 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f82a0039490 0x7f82a003b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:31.124 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:29.874+0000 7f82aaffd640 1 -- 172.21.15.77:0/1174309734 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f82a406d110 con 0x7f82b4076b30 2024-09-18T21:04:31.125 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:29.874+0000 7f82b9aab640 1 --2- 172.21.15.77:0/1174309734 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f82a0039490 0x7f82a003b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:31.125 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:29.875+0000 7f82b9aab640 1 --2- 172.21.15.77:0/1174309734 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f82a0039490 0x7f82a003b940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f82b0006fd0 tx=0x7f82b0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:31.125 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:29.879+0000 7f82aaffd640 1 -- 172.21.15.77:0/1174309734 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f82a4039780 con 0x7f82b4076b30 2024-09-18T21:04:31.125 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:30.073+0000 7f82bc510640 1 -- 172.21.15.77:0/1174309734 --> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7f82b40fdad0 con 0x7f82a0039490 2024-09-18T21:04:31.125 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:30.078+0000 7f82aaffd640 1 -- 172.21.15.77:0/1174309734 <== mgr.14118 v2:172.21.15.77:6800/2654225509 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f82b40fdad0 con 0x7f82a0039490 2024-09-18T21:04:31.125 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:30.080+0000 7f82bc510640 1 -- 172.21.15.77:0/1174309734 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f82a0039490 msgr2=0x7f82a003b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:31.125 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:30.080+0000 7f82bc510640 1 --2- 172.21.15.77:0/1174309734 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f82a0039490 0x7f82a003b940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f82b0006fd0 tx=0x7f82b0006db0 comp rx=0 tx=0).stop 2024-09-18T21:04:31.125 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:30.080+0000 7f82bc510640 1 -- 172.21.15.77:0/1174309734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82b4076b30 msgr2=0x7f82b4110e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:31.125 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:30.080+0000 7f82bc510640 1 --2- 172.21.15.77:0/1174309734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82b4076b30 0x7f82b4110e50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f82a4031750 tx=0x7f82a40091d0 comp rx=0 tx=0).stop 2024-09-18T21:04:31.125 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:30.080+0000 7f82bc510640 1 -- 172.21.15.77:0/1174309734 shutdown_connections 2024-09-18T21:04:31.125 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:30.080+0000 7f82bc510640 1 --2- 172.21.15.77:0/1174309734 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f82a0039490 0x7f82a003b940 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:31.125 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:30.080+0000 7f82bc510640 1 --2- 172.21.15.77:0/1174309734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f82b4076b30 0x7f82b4110e50 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:31.125 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:30.080+0000 7f82bc510640 1 -- 172.21.15.77:0/1174309734 >> 172.21.15.77:0/1174309734 conn(0x7f82b40fc710 msgr2=0x7f82b40fd300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:31.126 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:30.080+0000 7f82bc510640 1 -- 172.21.15.77:0/1174309734 shutdown_connections 2024-09-18T21:04:31.126 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:30.080+0000 7f82bc510640 1 -- 172.21.15.77:0/1174309734 wait complete. 2024-09-18T21:04:31.126 INFO:teuthology.orchestra.run.smithi077.stdout:Deploying prometheus service with default placement... 2024-09-18T21:04:31.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:31 smithi077 ceph-mon[27689]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:04:31.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:31 smithi077 ceph-mon[27689]: Saving service crash spec with placement * 2024-09-18T21:04:31.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:31 smithi077 ceph-mon[27689]: from='mgr.14118 172.21.15.77:0/107867287' entity='mgr.smithi077.utkpjg' 2024-09-18T21:04:31.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:31 smithi077 ceph-mon[27689]: from='mgr.14118 172.21.15.77:0/107867287' entity='mgr.smithi077.utkpjg' 2024-09-18T21:04:32.275 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-09-18T21:04:32.275 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.502+0000 7f2a71d2c640 1 Processor -- start 2024-09-18T21:04:32.275 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.502+0000 7f2a71d2c640 1 -- start start 2024-09-18T21:04:32.275 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.502+0000 7f2a71d2c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a6c076b30 0x7f2a6c104bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:32.275 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.502+0000 7f2a71d2c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6c076f40 con 0x7f2a6c076b30 2024-09-18T21:04:32.276 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.502+0000 7f2a6b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a6c076b30 0x7f2a6c104bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:32.276 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.503+0000 7f2a6b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a6c076b30 0x7f2a6c104bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38110/0 (socket says 172.21.15.77:38110) 2024-09-18T21:04:32.276 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.503+0000 7f2a6b7fe640 1 -- 172.21.15.77:0/2347578772 learned_addr learned my addr 172.21.15.77:0/2347578772 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:32.276 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.503+0000 7f2a6b7fe640 1 -- 172.21.15.77:0/2347578772 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a6c105100 con 0x7f2a6c076b30 2024-09-18T21:04:32.276 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.503+0000 7f2a6b7fe640 1 --2- 172.21.15.77:0/2347578772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a6c076b30 0x7f2a6c104bc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c009840 tx=0x7f2a5c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d300ceb66829b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:32.276 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.504+0000 7f2a6a7fc640 1 -- 172.21.15.77:0/2347578772 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2a5c032440 con 0x7f2a6c076b30 2024-09-18T21:04:32.276 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.504+0000 7f2a6a7fc640 1 -- 172.21.15.77:0/2347578772 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2a5c032a40 con 0x7f2a6c076b30 2024-09-18T21:04:32.276 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.504+0000 7f2a6a7fc640 1 -- 172.21.15.77:0/2347578772 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2a5c031aa0 con 0x7f2a6c076b30 2024-09-18T21:04:32.276 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.504+0000 7f2a71d2c640 1 -- 172.21.15.77:0/2347578772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a6c076b30 msgr2=0x7f2a6c104bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:32.276 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.504+0000 7f2a71d2c640 1 --2- 172.21.15.77:0/2347578772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a6c076b30 0x7f2a6c104bc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c009840 tx=0x7f2a5c0091d0 comp rx=0 tx=0).stop 2024-09-18T21:04:32.276 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.504+0000 7f2a71d2c640 1 -- 172.21.15.77:0/2347578772 shutdown_connections 2024-09-18T21:04:32.276 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.504+0000 7f2a71d2c640 1 --2- 172.21.15.77:0/2347578772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a6c076b30 0x7f2a6c104bc0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:32.276 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.504+0000 7f2a71d2c640 1 -- 172.21.15.77:0/2347578772 >> 172.21.15.77:0/2347578772 conn(0x7f2a6c0fc6d0 msgr2=0x7f2a6c0feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:32.276 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.504+0000 7f2a71d2c640 1 -- 172.21.15.77:0/2347578772 shutdown_connections 2024-09-18T21:04:32.277 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.504+0000 7f2a71d2c640 1 -- 172.21.15.77:0/2347578772 wait complete. 2024-09-18T21:04:32.277 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.505+0000 7f2a71d2c640 1 Processor -- start 2024-09-18T21:04:32.277 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.505+0000 7f2a71d2c640 1 -- start start 2024-09-18T21:04:32.277 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.506+0000 7f2a71d2c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a6c076b30 0x7f2a6c1024f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:32.277 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.506+0000 7f2a71d2c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6c102a30 con 0x7f2a6c076b30 2024-09-18T21:04:32.277 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.506+0000 7f2a6b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a6c076b30 0x7f2a6c1024f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:32.277 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.506+0000 7f2a6b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a6c076b30 0x7f2a6c1024f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38120/0 (socket says 172.21.15.77:38120) 2024-09-18T21:04:32.277 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.506+0000 7f2a6b7fe640 1 -- 172.21.15.77:0/2423359026 learned_addr learned my addr 172.21.15.77:0/2423359026 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:32.277 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.506+0000 7f2a6b7fe640 1 -- 172.21.15.77:0/2423359026 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a5c009450 con 0x7f2a6c076b30 2024-09-18T21:04:32.277 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.506+0000 7f2a6b7fe640 1 --2- 172.21.15.77:0/2423359026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a6c076b30 0x7f2a6c1024f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c009810 tx=0x7f2a5c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:32.277 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.507+0000 7f2a53fff640 1 -- 172.21.15.77:0/2423359026 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2a5c0327b0 con 0x7f2a6c076b30 2024-09-18T21:04:32.277 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.507+0000 7f2a53fff640 1 -- 172.21.15.77:0/2423359026 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2a5c03b8d0 con 0x7f2a6c076b30 2024-09-18T21:04:32.277 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.507+0000 7f2a71d2c640 1 -- 172.21.15.77:0/2423359026 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a6c100ac0 con 0x7f2a6c076b30 2024-09-18T21:04:32.278 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.507+0000 7f2a53fff640 1 -- 172.21.15.77:0/2423359026 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2a5c03a6f0 con 0x7f2a6c076b30 2024-09-18T21:04:32.278 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.507+0000 7f2a71d2c640 1 -- 172.21.15.77:0/2423359026 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a6c100f30 con 0x7f2a6c076b30 2024-09-18T21:04:32.278 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.508+0000 7f2a53fff640 1 -- 172.21.15.77:0/2423359026 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f2a5c039040 con 0x7f2a6c076b30 2024-09-18T21:04:32.278 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.508+0000 7f2a71d2c640 1 -- 172.21.15.77:0/2423359026 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a6c04b720 con 0x7f2a6c076b30 2024-09-18T21:04:32.278 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.508+0000 7f2a53fff640 1 --2- 172.21.15.77:0/2423359026 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f2a54039490 0x7f2a5403b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:32.278 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.508+0000 7f2a53fff640 1 -- 172.21.15.77:0/2423359026 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f2a5c06cb40 con 0x7f2a6c076b30 2024-09-18T21:04:32.278 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.508+0000 7f2a6affd640 1 --2- 172.21.15.77:0/2423359026 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f2a54039490 0x7f2a5403b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:32.278 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.509+0000 7f2a6affd640 1 --2- 172.21.15.77:0/2423359026 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f2a54039490 0x7f2a5403b940 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2a60006fd0 tx=0x7f2a60006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:32.278 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.513+0000 7f2a53fff640 1 -- 172.21.15.77:0/2423359026 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f2a5c03b430 con 0x7f2a6c076b30 2024-09-18T21:04:32.278 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.685+0000 7f2a71d2c640 1 -- 172.21.15.77:0/2423359026 --> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f2a6c1015b0 con 0x7f2a54039490 2024-09-18T21:04:32.278 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.689+0000 7f2a53fff640 1 -- 172.21.15.77:0/2423359026 <== mgr.14118 v2:172.21.15.77:6800/2654225509 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f2a6c1015b0 con 0x7f2a54039490 2024-09-18T21:04:32.278 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.691+0000 7f2a71d2c640 1 -- 172.21.15.77:0/2423359026 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f2a54039490 msgr2=0x7f2a5403b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:32.278 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.691+0000 7f2a71d2c640 1 --2- 172.21.15.77:0/2423359026 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f2a54039490 0x7f2a5403b940 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2a60006fd0 tx=0x7f2a60006db0 comp rx=0 tx=0).stop 2024-09-18T21:04:32.278 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.691+0000 7f2a71d2c640 1 -- 172.21.15.77:0/2423359026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a6c076b30 msgr2=0x7f2a6c1024f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:32.278 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.691+0000 7f2a71d2c640 1 --2- 172.21.15.77:0/2423359026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a6c076b30 0x7f2a6c1024f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c009810 tx=0x7f2a5c0091d0 comp rx=0 tx=0).stop 2024-09-18T21:04:32.279 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.691+0000 7f2a71d2c640 1 -- 172.21.15.77:0/2423359026 shutdown_connections 2024-09-18T21:04:32.279 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.691+0000 7f2a71d2c640 1 --2- 172.21.15.77:0/2423359026 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f2a54039490 0x7f2a5403b940 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:32.279 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.691+0000 7f2a71d2c640 1 --2- 172.21.15.77:0/2423359026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a6c076b30 0x7f2a6c1024f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:32.279 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.691+0000 7f2a71d2c640 1 -- 172.21.15.77:0/2423359026 >> 172.21.15.77:0/2423359026 conn(0x7f2a6c0fc6d0 msgr2=0x7f2a6c0fd360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:32.279 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.692+0000 7f2a71d2c640 1 -- 172.21.15.77:0/2423359026 shutdown_connections 2024-09-18T21:04:32.279 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:31.692+0000 7f2a71d2c640 1 -- 172.21.15.77:0/2423359026 wait complete. 2024-09-18T21:04:32.279 INFO:teuthology.orchestra.run.smithi077.stdout:Deploying grafana service with default placement... 2024-09-18T21:04:32.881 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:32 smithi077 ceph-mon[27689]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:04:32.882 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:32 smithi077 ceph-mon[27689]: Saving service prometheus spec with placement count:1 2024-09-18T21:04:32.882 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:32 smithi077 ceph-mon[27689]: from='mgr.14118 172.21.15.77:0/107867287' entity='mgr.smithi077.utkpjg' 2024-09-18T21:04:32.882 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:32 smithi077 ceph-mon[27689]: from='mgr.14118 172.21.15.77:0/107867287' entity='mgr.smithi077.utkpjg' 2024-09-18T21:04:33.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:33 smithi077 ceph-mon[27689]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:04:33.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:33 smithi077 ceph-mon[27689]: Saving service grafana spec with placement count:1 2024-09-18T21:04:33.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:33 smithi077 ceph-mon[27689]: from='mgr.14118 172.21.15.77:0/107867287' entity='mgr.smithi077.utkpjg' 2024-09-18T21:04:34.409 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-09-18T21:04:34.410 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.670+0000 7f5d9e143640 1 Processor -- start 2024-09-18T21:04:34.410 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.670+0000 7f5d9e143640 1 -- start start 2024-09-18T21:04:34.410 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.670+0000 7f5d9e143640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d98100ef0 0x7f5d98101300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:34.410 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.670+0000 7f5d9e143640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d98101840 con 0x7f5d98100ef0 2024-09-18T21:04:34.410 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.670+0000 7f5d977fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d98100ef0 0x7f5d98101300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:34.410 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.670+0000 7f5d977fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d98100ef0 0x7f5d98101300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38130/0 (socket says 172.21.15.77:38130) 2024-09-18T21:04:34.410 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.670+0000 7f5d977fe640 1 -- 172.21.15.77:0/1650370893 learned_addr learned my addr 172.21.15.77:0/1650370893 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:34.410 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.671+0000 7f5d977fe640 1 -- 172.21.15.77:0/1650370893 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d98101980 con 0x7f5d98100ef0 2024-09-18T21:04:34.410 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.671+0000 7f5d977fe640 1 --2- 172.21.15.77:0/1650370893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d98100ef0 0x7f5d98101300 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5d88009840 tx=0x7f5d880091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f666cad15383a3f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:34.410 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.672+0000 7f5d967fc640 1 -- 172.21.15.77:0/1650370893 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5d88032440 con 0x7f5d98100ef0 2024-09-18T21:04:34.411 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.672+0000 7f5d967fc640 1 -- 172.21.15.77:0/1650370893 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5d88032a40 con 0x7f5d98100ef0 2024-09-18T21:04:34.411 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.672+0000 7f5d967fc640 1 -- 172.21.15.77:0/1650370893 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5d88031a70 con 0x7f5d98100ef0 2024-09-18T21:04:34.411 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.672+0000 7f5d9e143640 1 -- 172.21.15.77:0/1650370893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d98100ef0 msgr2=0x7f5d98101300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:34.411 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.672+0000 7f5d9e143640 1 --2- 172.21.15.77:0/1650370893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d98100ef0 0x7f5d98101300 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5d88009840 tx=0x7f5d880091d0 comp rx=0 tx=0).stop 2024-09-18T21:04:34.411 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.672+0000 7f5d9e143640 1 -- 172.21.15.77:0/1650370893 shutdown_connections 2024-09-18T21:04:34.411 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.672+0000 7f5d9e143640 1 --2- 172.21.15.77:0/1650370893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d98100ef0 0x7f5d98101300 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:34.411 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.672+0000 7f5d9e143640 1 -- 172.21.15.77:0/1650370893 >> 172.21.15.77:0/1650370893 conn(0x7f5d980fc710 msgr2=0x7f5d980feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:34.411 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.672+0000 7f5d9e143640 1 -- 172.21.15.77:0/1650370893 shutdown_connections 2024-09-18T21:04:34.412 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.672+0000 7f5d9e143640 1 -- 172.21.15.77:0/1650370893 wait complete. 2024-09-18T21:04:34.412 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.673+0000 7f5d9e143640 1 Processor -- start 2024-09-18T21:04:34.412 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.673+0000 7f5d9e143640 1 -- start start 2024-09-18T21:04:34.412 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.673+0000 7f5d9e143640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d98100ef0 0x7f5d9810fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:34.412 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.673+0000 7f5d9e143640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d981101f0 con 0x7f5d98100ef0 2024-09-18T21:04:34.412 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.673+0000 7f5d977fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d98100ef0 0x7f5d9810fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:34.412 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.673+0000 7f5d977fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d98100ef0 0x7f5d9810fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38132/0 (socket says 172.21.15.77:38132) 2024-09-18T21:04:34.412 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.673+0000 7f5d977fe640 1 -- 172.21.15.77:0/3416570007 learned_addr learned my addr 172.21.15.77:0/3416570007 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:34.412 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.673+0000 7f5d977fe640 1 -- 172.21.15.77:0/3416570007 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d88009450 con 0x7f5d98100ef0 2024-09-18T21:04:34.412 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.674+0000 7f5d977fe640 1 --2- 172.21.15.77:0/3416570007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d98100ef0 0x7f5d9810fcb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5d88031750 tx=0x7f5d880091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:34.412 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.674+0000 7f5d7ffff640 1 -- 172.21.15.77:0/3416570007 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5d8803c400 con 0x7f5d98100ef0 2024-09-18T21:04:34.413 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.674+0000 7f5d7ffff640 1 -- 172.21.15.77:0/3416570007 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5d8803ca00 con 0x7f5d98100ef0 2024-09-18T21:04:34.413 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.674+0000 7f5d9e143640 1 -- 172.21.15.77:0/3416570007 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d981103f0 con 0x7f5d98100ef0 2024-09-18T21:04:34.413 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.674+0000 7f5d7ffff640 1 -- 172.21.15.77:0/3416570007 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5d8803a880 con 0x7f5d98100ef0 2024-09-18T21:04:34.413 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.674+0000 7f5d9e143640 1 -- 172.21.15.77:0/3416570007 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d98110800 con 0x7f5d98100ef0 2024-09-18T21:04:34.413 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.675+0000 7f5d7ffff640 1 -- 172.21.15.77:0/3416570007 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f5d8803a9e0 con 0x7f5d98100ef0 2024-09-18T21:04:34.413 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.675+0000 7f5d9e143640 1 -- 172.21.15.77:0/3416570007 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d9804b720 con 0x7f5d98100ef0 2024-09-18T21:04:34.413 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.675+0000 7f5d7ffff640 1 --2- 172.21.15.77:0/3416570007 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f5d800394e0 0x7f5d8003b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:34.413 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.675+0000 7f5d7ffff640 1 -- 172.21.15.77:0/3416570007 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f5d8806ce50 con 0x7f5d98100ef0 2024-09-18T21:04:34.413 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.675+0000 7f5d96ffd640 1 --2- 172.21.15.77:0/3416570007 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f5d800394e0 0x7f5d8003b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:34.413 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.675+0000 7f5d96ffd640 1 --2- 172.21.15.77:0/3416570007 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f5d800394e0 0x7f5d8003b990 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c006fd0 tx=0x7f5d8c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:34.413 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.679+0000 7f5d7ffff640 1 -- 172.21.15.77:0/3416570007 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5d88030570 con 0x7f5d98100ef0 2024-09-18T21:04:34.413 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.880+0000 7f5d9e143640 1 -- 172.21.15.77:0/3416570007 --> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7f5d980fda80 con 0x7f5d800394e0 2024-09-18T21:04:34.414 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.887+0000 7f5d7ffff640 1 -- 172.21.15.77:0/3416570007 <== mgr.14118 v2:172.21.15.77:6800/2654225509 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f5d980fda80 con 0x7f5d800394e0 2024-09-18T21:04:34.414 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.889+0000 7f5d9e143640 1 -- 172.21.15.77:0/3416570007 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f5d800394e0 msgr2=0x7f5d8003b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:34.414 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.889+0000 7f5d9e143640 1 --2- 172.21.15.77:0/3416570007 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f5d800394e0 0x7f5d8003b990 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c006fd0 tx=0x7f5d8c006db0 comp rx=0 tx=0).stop 2024-09-18T21:04:34.414 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.889+0000 7f5d9e143640 1 -- 172.21.15.77:0/3416570007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d98100ef0 msgr2=0x7f5d9810fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:34.414 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.889+0000 7f5d9e143640 1 --2- 172.21.15.77:0/3416570007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d98100ef0 0x7f5d9810fcb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5d88031750 tx=0x7f5d880091d0 comp rx=0 tx=0).stop 2024-09-18T21:04:34.414 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.889+0000 7f5d9e143640 1 -- 172.21.15.77:0/3416570007 shutdown_connections 2024-09-18T21:04:34.415 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.889+0000 7f5d9e143640 1 --2- 172.21.15.77:0/3416570007 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f5d800394e0 0x7f5d8003b990 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:34.415 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.889+0000 7f5d9e143640 1 --2- 172.21.15.77:0/3416570007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5d98100ef0 0x7f5d9810fcb0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:34.415 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.889+0000 7f5d9e143640 1 -- 172.21.15.77:0/3416570007 >> 172.21.15.77:0/3416570007 conn(0x7f5d980fc710 msgr2=0x7f5d980fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:34.415 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.889+0000 7f5d9e143640 1 -- 172.21.15.77:0/3416570007 shutdown_connections 2024-09-18T21:04:34.415 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:32.889+0000 7f5d9e143640 1 -- 172.21.15.77:0/3416570007 wait complete. 2024-09-18T21:04:34.415 INFO:teuthology.orchestra.run.smithi077.stdout:Deploying node-exporter service with default placement... 2024-09-18T21:04:35.632 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-09-18T21:04:35.632 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:34.832+0000 7f0ffc733640 1 Processor -- start 2024-09-18T21:04:35.632 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:34.833+0000 7f0ffc733640 1 -- start start 2024-09-18T21:04:35.632 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:34.833+0000 7f0ffc733640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ff4101f90 0x7f0ff41023a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:35.632 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:34.833+0000 7f0ffc733640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff41028e0 con 0x7f0ff4101f90 2024-09-18T21:04:35.633 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:34.833+0000 7f0ffa4cf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ff4101f90 0x7f0ff41023a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:35.633 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:34.833+0000 7f0ffa4cf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ff4101f90 0x7f0ff41023a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38134/0 (socket says 172.21.15.77:38134) 2024-09-18T21:04:35.633 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:34.833+0000 7f0ffa4cf640 1 -- 172.21.15.77:0/3407107989 learned_addr learned my addr 172.21.15.77:0/3407107989 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:35.633 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:34.833+0000 7f0ffa4cf640 1 -- 172.21.15.77:0/3407107989 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff4102a20 con 0x7f0ff4101f90 2024-09-18T21:04:35.633 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:34.834+0000 7f0ffa4cf640 1 --2- 172.21.15.77:0/3407107989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ff4101f90 0x7f0ff41023a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0009840 tx=0x7f0ff00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66764d45a7be97ef server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:35.633 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:34.834+0000 7f0ff94cd640 1 -- 172.21.15.77:0/3407107989 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0ff0032440 con 0x7f0ff4101f90 2024-09-18T21:04:35.633 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:34.834+0000 7f0ff94cd640 1 -- 172.21.15.77:0/3407107989 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0ff0032a40 con 0x7f0ff4101f90 2024-09-18T21:04:35.633 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:34.834+0000 7f0ff94cd640 1 -- 172.21.15.77:0/3407107989 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0ff0031a70 con 0x7f0ff4101f90 2024-09-18T21:04:35.633 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:34.835+0000 7f0ffc733640 1 -- 172.21.15.77:0/3407107989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ff4101f90 msgr2=0x7f0ff41023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:35.633 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:34.835+0000 7f0ffc733640 1 --2- 172.21.15.77:0/3407107989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ff4101f90 0x7f0ff41023a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0009840 tx=0x7f0ff00091d0 comp rx=0 tx=0).stop 2024-09-18T21:04:35.633 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:34.835+0000 7f0ffc733640 1 -- 172.21.15.77:0/3407107989 shutdown_connections 2024-09-18T21:04:35.633 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:34.835+0000 7f0ffc733640 1 --2- 172.21.15.77:0/3407107989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ff4101f90 0x7f0ff41023a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:35.633 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:34.835+0000 7f0ffc733640 1 -- 172.21.15.77:0/3407107989 >> 172.21.15.77:0/3407107989 conn(0x7f0ff40fd710 msgr2=0x7f0ff40ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:35.634 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:34.835+0000 7f0ffc733640 1 -- 172.21.15.77:0/3407107989 shutdown_connections 2024-09-18T21:04:35.634 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:34.835+0000 7f0ffc733640 1 -- 172.21.15.77:0/3407107989 wait complete. 2024-09-18T21:04:35.634 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:34.836+0000 7f0ffc733640 1 Processor -- start 2024-09-18T21:04:35.634 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:34.836+0000 7f0ffc733640 1 -- start start 2024-09-18T21:04:35.634 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:34.836+0000 7f0ffc733640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ff4101f90 0x7f0ff4110d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:35.634 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:34.836+0000 7f0ffc733640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff4111260 con 0x7f0ff4101f90 2024-09-18T21:04:35.634 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:34.836+0000 7f0ffa4cf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ff4101f90 0x7f0ff4110d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:35.634 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:34.836+0000 7f0ffa4cf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ff4101f90 0x7f0ff4110d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38140/0 (socket says 172.21.15.77:38140) 2024-09-18T21:04:35.634 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:34.836+0000 7f0ffa4cf640 1 -- 172.21.15.77:0/1485911733 learned_addr learned my addr 172.21.15.77:0/1485911733 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:35.634 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:34.836+0000 7f0ffa4cf640 1 -- 172.21.15.77:0/1485911733 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff0009450 con 0x7f0ff4101f90 2024-09-18T21:04:35.634 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:34.837+0000 7f0ffa4cf640 1 --2- 172.21.15.77:0/1485911733 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ff4101f90 0x7f0ff4110d20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0009810 tx=0x7f0ff00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:35.634 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:34.837+0000 7f0feaffd640 1 -- 172.21.15.77:0/1485911733 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0ff003c400 con 0x7f0ff4101f90 2024-09-18T21:04:35.635 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:34.837+0000 7f0feaffd640 1 -- 172.21.15.77:0/1485911733 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0ff003ca00 con 0x7f0ff4101f90 2024-09-18T21:04:35.635 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:34.837+0000 7f0ffc733640 1 -- 172.21.15.77:0/1485911733 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff4111460 con 0x7f0ff4101f90 2024-09-18T21:04:35.635 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:34.837+0000 7f0feaffd640 1 -- 172.21.15.77:0/1485911733 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0ff003a870 con 0x7f0ff4101f90 2024-09-18T21:04:35.635 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:34.837+0000 7f0ffc733640 1 -- 172.21.15.77:0/1485911733 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff41118d0 con 0x7f0ff4101f90 2024-09-18T21:04:35.635 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:34.838+0000 7f0feaffd640 1 -- 172.21.15.77:0/1485911733 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f0ff003aae0 con 0x7f0ff4101f90 2024-09-18T21:04:35.635 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:34.838+0000 7f0feaffd640 1 --2- 172.21.15.77:0/1485911733 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f0fe00394e0 0x7f0fe003b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:35.635 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:34.838+0000 7f0ffc733640 1 -- 172.21.15.77:0/1485911733 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ff404b720 con 0x7f0ff4101f90 2024-09-18T21:04:35.635 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:34.838+0000 7f0feaffd640 1 -- 172.21.15.77:0/1485911733 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f0ff006ce40 con 0x7f0ff4101f90 2024-09-18T21:04:35.635 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:34.838+0000 7f0ff9cce640 1 --2- 172.21.15.77:0/1485911733 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f0fe00394e0 0x7f0fe003b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:35.635 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:34.838+0000 7f0ff9cce640 1 --2- 172.21.15.77:0/1485911733 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f0fe00394e0 0x7f0fe003b990 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0fe4006fd0 tx=0x7f0fe4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:35.635 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:34.842+0000 7f0feaffd640 1 -- 172.21.15.77:0/1485911733 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0ff0046460 con 0x7f0ff4101f90 2024-09-18T21:04:35.635 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:35.006+0000 7f0ffc733640 1 -- 172.21.15.77:0/1485911733 --> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ff41118d0 con 0x7f0fe00394e0 2024-09-18T21:04:35.635 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:35.010+0000 7f0feaffd640 1 -- 172.21.15.77:0/1485911733 <== mgr.14118 v2:172.21.15.77:6800/2654225509 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f0ff41118d0 con 0x7f0fe00394e0 2024-09-18T21:04:35.636 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:35.012+0000 7f0ffc733640 1 -- 172.21.15.77:0/1485911733 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f0fe00394e0 msgr2=0x7f0fe003b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:35.636 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:35.012+0000 7f0ffc733640 1 --2- 172.21.15.77:0/1485911733 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f0fe00394e0 0x7f0fe003b990 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0fe4006fd0 tx=0x7f0fe4006db0 comp rx=0 tx=0).stop 2024-09-18T21:04:35.636 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:35.012+0000 7f0ffc733640 1 -- 172.21.15.77:0/1485911733 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ff4101f90 msgr2=0x7f0ff4110d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:35.636 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:35.012+0000 7f0ffc733640 1 --2- 172.21.15.77:0/1485911733 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ff4101f90 0x7f0ff4110d20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0009810 tx=0x7f0ff00091d0 comp rx=0 tx=0).stop 2024-09-18T21:04:35.636 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:35.012+0000 7f0ffc733640 1 -- 172.21.15.77:0/1485911733 shutdown_connections 2024-09-18T21:04:35.636 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:35.012+0000 7f0ffc733640 1 --2- 172.21.15.77:0/1485911733 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f0fe00394e0 0x7f0fe003b990 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:35.636 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:35.012+0000 7f0ffc733640 1 --2- 172.21.15.77:0/1485911733 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ff4101f90 0x7f0ff4110d20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:35.636 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:35.012+0000 7f0ffc733640 1 -- 172.21.15.77:0/1485911733 >> 172.21.15.77:0/1485911733 conn(0x7f0ff40fd710 msgr2=0x7f0ff40fe260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:35.636 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:35.012+0000 7f0ffc733640 1 -- 172.21.15.77:0/1485911733 shutdown_connections 2024-09-18T21:04:35.636 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:35.012+0000 7f0ffc733640 1 -- 172.21.15.77:0/1485911733 wait complete. 2024-09-18T21:04:35.637 INFO:teuthology.orchestra.run.smithi077.stdout:Deploying alertmanager service with default placement... 2024-09-18T21:04:36.171 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:36 smithi077 ceph-mon[27689]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:04:36.171 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:36 smithi077 ceph-mon[27689]: Saving service node-exporter spec with placement * 2024-09-18T21:04:36.171 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:36 smithi077 ceph-mon[27689]: from='mgr.14118 172.21.15.77:0/107867287' entity='mgr.smithi077.utkpjg' 2024-09-18T21:04:36.730 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-09-18T21:04:36.730 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:35.996+0000 7faac0460640 1 Processor -- start 2024-09-18T21:04:36.730 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:35.996+0000 7faac0460640 1 -- start start 2024-09-18T21:04:36.730 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:35.996+0000 7faac0460640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faab8076cc0 0x7faab8106ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:36.731 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:35.996+0000 7faac0460640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab8102940 con 0x7faab8076cc0 2024-09-18T21:04:36.731 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:35.997+0000 7faabe1fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faab8076cc0 0x7faab8106ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:36.731 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:35.997+0000 7faabe1fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faab8076cc0 0x7faab8106ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38156/0 (socket says 172.21.15.77:38156) 2024-09-18T21:04:36.731 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:35.997+0000 7faabe1fc640 1 -- 172.21.15.77:0/75725798 learned_addr learned my addr 172.21.15.77:0/75725798 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:36.731 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:35.997+0000 7faabe1fc640 1 -- 172.21.15.77:0/75725798 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab8107400 con 0x7faab8076cc0 2024-09-18T21:04:36.731 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:35.998+0000 7faabe1fc640 1 --2- 172.21.15.77:0/75725798 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faab8076cc0 0x7faab8106ec0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faab4009e50 tx=0x7faab4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=155ac742a034f847 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:36.731 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:35.998+0000 7faabd1fa640 1 -- 172.21.15.77:0/75725798 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faab4031560 con 0x7faab8076cc0 2024-09-18T21:04:36.731 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:35.998+0000 7faabd1fa640 1 -- 172.21.15.77:0/75725798 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7faab402d050 con 0x7faab8076cc0 2024-09-18T21:04:36.731 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:35.998+0000 7faabd1fa640 1 -- 172.21.15.77:0/75725798 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faab4007a60 con 0x7faab8076cc0 2024-09-18T21:04:36.731 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:35.998+0000 7faac0460640 1 -- 172.21.15.77:0/75725798 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faab8076cc0 msgr2=0x7faab8106ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:36.731 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:35.998+0000 7faac0460640 1 --2- 172.21.15.77:0/75725798 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faab8076cc0 0x7faab8106ec0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faab4009e50 tx=0x7faab4009840 comp rx=0 tx=0).stop 2024-09-18T21:04:36.731 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:35.999+0000 7faac0460640 1 -- 172.21.15.77:0/75725798 shutdown_connections 2024-09-18T21:04:36.731 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:35.999+0000 7faac0460640 1 --2- 172.21.15.77:0/75725798 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faab8076cc0 0x7faab8106ec0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:36.731 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:35.999+0000 7faac0460640 1 -- 172.21.15.77:0/75725798 >> 172.21.15.77:0/75725798 conn(0x7faab80fc590 msgr2=0x7faab80fea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:36.732 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:35.999+0000 7faac0460640 1 -- 172.21.15.77:0/75725798 shutdown_connections 2024-09-18T21:04:36.732 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:35.999+0000 7faac0460640 1 -- 172.21.15.77:0/75725798 wait complete. 2024-09-18T21:04:36.732 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:35.999+0000 7faac0460640 1 Processor -- start 2024-09-18T21:04:36.732 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:35.999+0000 7faac0460640 1 -- start start 2024-09-18T21:04:36.732 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:35.999+0000 7faac0460640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faab8076cc0 0x7faab8112f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:36.732 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:35.999+0000 7faac0460640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab81134c0 con 0x7faab8076cc0 2024-09-18T21:04:36.732 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:35.999+0000 7faabe1fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faab8076cc0 0x7faab8112f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:36.732 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:35.999+0000 7faabe1fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faab8076cc0 0x7faab8112f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38166/0 (socket says 172.21.15.77:38166) 2024-09-18T21:04:36.732 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:35.999+0000 7faabe1fc640 1 -- 172.21.15.77:0/420516180 learned_addr learned my addr 172.21.15.77:0/420516180 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:36.732 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:36.000+0000 7faabe1fc640 1 -- 172.21.15.77:0/420516180 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab4009ae0 con 0x7faab8076cc0 2024-09-18T21:04:36.732 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:36.000+0000 7faabe1fc640 1 --2- 172.21.15.77:0/420516180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faab8076cc0 0x7faab8112f80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faab402abe0 tx=0x7faab4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:36.732 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:36.000+0000 7faaaeffd640 1 -- 172.21.15.77:0/420516180 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faab4031bc0 con 0x7faab8076cc0 2024-09-18T21:04:36.732 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:36.000+0000 7faaaeffd640 1 -- 172.21.15.77:0/420516180 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7faab4031d20 con 0x7faab8076cc0 2024-09-18T21:04:36.732 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:36.000+0000 7faaaeffd640 1 -- 172.21.15.77:0/420516180 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faab4045570 con 0x7faab8076cc0 2024-09-18T21:04:36.733 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:36.000+0000 7faac0460640 1 -- 172.21.15.77:0/420516180 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faab81136c0 con 0x7faab8076cc0 2024-09-18T21:04:36.733 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:36.000+0000 7faac0460640 1 -- 172.21.15.77:0/420516180 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faab8113b30 con 0x7faab8076cc0 2024-09-18T21:04:36.733 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:36.001+0000 7faaaeffd640 1 -- 172.21.15.77:0/420516180 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7faab4038050 con 0x7faab8076cc0 2024-09-18T21:04:36.733 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:36.001+0000 7faac0460640 1 -- 172.21.15.77:0/420516180 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faab804b720 con 0x7faab8076cc0 2024-09-18T21:04:36.733 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:36.001+0000 7faaaeffd640 1 --2- 172.21.15.77:0/420516180 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7faaa40394e0 0x7faaa403b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:36.733 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:36.001+0000 7faaaeffd640 1 -- 172.21.15.77:0/420516180 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7faab406cb30 con 0x7faab8076cc0 2024-09-18T21:04:36.733 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:36.001+0000 7faabd9fb640 1 --2- 172.21.15.77:0/420516180 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7faaa40394e0 0x7faaa403b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:36.733 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:36.002+0000 7faabd9fb640 1 --2- 172.21.15.77:0/420516180 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7faaa40394e0 0x7faaa403b990 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7faaa8006fd0 tx=0x7faaa8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:36.733 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:36.006+0000 7faaaeffd640 1 -- 172.21.15.77:0/420516180 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7faab404d900 con 0x7faab8076cc0 2024-09-18T21:04:36.733 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:36.170+0000 7faac0460640 1 -- 172.21.15.77:0/420516180 --> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7faab8113b30 con 0x7faaa40394e0 2024-09-18T21:04:36.733 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:36.175+0000 7faaaeffd640 1 -- 172.21.15.77:0/420516180 <== mgr.14118 v2:172.21.15.77:6800/2654225509 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7faab8113b30 con 0x7faaa40394e0 2024-09-18T21:04:36.733 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:36.177+0000 7faac0460640 1 -- 172.21.15.77:0/420516180 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7faaa40394e0 msgr2=0x7faaa403b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:36.734 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:36.177+0000 7faac0460640 1 --2- 172.21.15.77:0/420516180 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7faaa40394e0 0x7faaa403b990 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7faaa8006fd0 tx=0x7faaa8006db0 comp rx=0 tx=0).stop 2024-09-18T21:04:36.734 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:36.177+0000 7faac0460640 1 -- 172.21.15.77:0/420516180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faab8076cc0 msgr2=0x7faab8112f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:36.734 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:36.177+0000 7faac0460640 1 --2- 172.21.15.77:0/420516180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faab8076cc0 0x7faab8112f80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faab402abe0 tx=0x7faab4009840 comp rx=0 tx=0).stop 2024-09-18T21:04:36.734 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:36.177+0000 7faac0460640 1 -- 172.21.15.77:0/420516180 shutdown_connections 2024-09-18T21:04:36.734 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:36.178+0000 7faac0460640 1 --2- 172.21.15.77:0/420516180 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7faaa40394e0 0x7faaa403b990 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:36.734 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:36.178+0000 7faac0460640 1 --2- 172.21.15.77:0/420516180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faab8076cc0 0x7faab8112f80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:36.734 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:36.178+0000 7faac0460640 1 -- 172.21.15.77:0/420516180 >> 172.21.15.77:0/420516180 conn(0x7faab80fc590 msgr2=0x7faab80fd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:36.734 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:36.178+0000 7faac0460640 1 -- 172.21.15.77:0/420516180 shutdown_connections 2024-09-18T21:04:36.734 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:36.178+0000 7faac0460640 1 -- 172.21.15.77:0/420516180 wait complete. 2024-09-18T21:04:37.309 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:37 smithi077 ceph-mon[27689]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:04:37.309 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:37 smithi077 ceph-mon[27689]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:04:37.309 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:37 smithi077 ceph-mon[27689]: Saving service alertmanager spec with placement count:1 2024-09-18T21:04:37.309 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:37 smithi077 ceph-mon[27689]: from='mgr.14118 172.21.15.77:0/107867287' entity='mgr.smithi077.utkpjg' 2024-09-18T21:04:37.912 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.127+0000 7fd12bde6640 1 Processor -- start 2024-09-18T21:04:37.912 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.127+0000 7fd12bde6640 1 -- start start 2024-09-18T21:04:37.912 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.128+0000 7fd12bde6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd124076b70 0x7fd124104b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:37.912 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.128+0000 7fd12bde6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1241050c0 con 0x7fd124076b70 2024-09-18T21:04:37.912 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.128+0000 7fd129b82640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd124076b70 0x7fd124104b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:37.912 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.128+0000 7fd129b82640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd124076b70 0x7fd124104b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38174/0 (socket says 172.21.15.77:38174) 2024-09-18T21:04:37.912 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.128+0000 7fd129b82640 1 -- 172.21.15.77:0/255721490 learned_addr learned my addr 172.21.15.77:0/255721490 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:37.912 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.128+0000 7fd129b82640 1 -- 172.21.15.77:0/255721490 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd124105200 con 0x7fd124076b70 2024-09-18T21:04:37.912 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.129+0000 7fd129b82640 1 --2- 172.21.15.77:0/255721490 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd124076b70 0x7fd124104b80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd120009840 tx=0x7fd1200091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50e78476dbb688fc server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:37.913 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.129+0000 7fd128b80640 1 -- 172.21.15.77:0/255721490 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd120032440 con 0x7fd124076b70 2024-09-18T21:04:37.913 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.129+0000 7fd128b80640 1 -- 172.21.15.77:0/255721490 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd120032a40 con 0x7fd124076b70 2024-09-18T21:04:37.913 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.129+0000 7fd128b80640 1 -- 172.21.15.77:0/255721490 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd120031aa0 con 0x7fd124076b70 2024-09-18T21:04:37.913 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.129+0000 7fd12bde6640 1 -- 172.21.15.77:0/255721490 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd124076b70 msgr2=0x7fd124104b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:37.913 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.129+0000 7fd12bde6640 1 --2- 172.21.15.77:0/255721490 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd124076b70 0x7fd124104b80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd120009840 tx=0x7fd1200091d0 comp rx=0 tx=0).stop 2024-09-18T21:04:37.913 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.130+0000 7fd12bde6640 1 -- 172.21.15.77:0/255721490 shutdown_connections 2024-09-18T21:04:37.913 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.130+0000 7fd12bde6640 1 --2- 172.21.15.77:0/255721490 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd124076b70 0x7fd124104b80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:37.913 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.130+0000 7fd12bde6640 1 -- 172.21.15.77:0/255721490 >> 172.21.15.77:0/255721490 conn(0x7fd1240fc6d0 msgr2=0x7fd1240feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:37.913 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.130+0000 7fd12bde6640 1 -- 172.21.15.77:0/255721490 shutdown_connections 2024-09-18T21:04:37.913 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.130+0000 7fd12bde6640 1 -- 172.21.15.77:0/255721490 wait complete. 2024-09-18T21:04:37.913 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.130+0000 7fd12bde6640 1 Processor -- start 2024-09-18T21:04:37.913 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.130+0000 7fd12bde6640 1 -- start start 2024-09-18T21:04:37.913 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.130+0000 7fd12bde6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd124076b70 0x7fd124110e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:37.914 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.130+0000 7fd12bde6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd124111370 con 0x7fd124076b70 2024-09-18T21:04:37.914 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.131+0000 7fd129b82640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd124076b70 0x7fd124110e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:37.914 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.131+0000 7fd129b82640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd124076b70 0x7fd124110e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38182/0 (socket says 172.21.15.77:38182) 2024-09-18T21:04:37.914 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.131+0000 7fd129b82640 1 -- 172.21.15.77:0/2861378782 learned_addr learned my addr 172.21.15.77:0/2861378782 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:37.914 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.131+0000 7fd129b82640 1 -- 172.21.15.77:0/2861378782 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd120009450 con 0x7fd124076b70 2024-09-18T21:04:37.914 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.131+0000 7fd129b82640 1 --2- 172.21.15.77:0/2861378782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd124076b70 0x7fd124110e30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd120009810 tx=0x7fd1200091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:37.914 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.131+0000 7fd11a7fc640 1 -- 172.21.15.77:0/2861378782 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd1200327b0 con 0x7fd124076b70 2024-09-18T21:04:37.914 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.131+0000 7fd11a7fc640 1 -- 172.21.15.77:0/2861378782 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd12003b8d0 con 0x7fd124076b70 2024-09-18T21:04:37.914 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.131+0000 7fd12bde6640 1 -- 172.21.15.77:0/2861378782 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd124111570 con 0x7fd124076b70 2024-09-18T21:04:37.914 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.131+0000 7fd11a7fc640 1 -- 172.21.15.77:0/2861378782 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd12003a6f0 con 0x7fd124076b70 2024-09-18T21:04:37.914 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.131+0000 7fd12bde6640 1 -- 172.21.15.77:0/2861378782 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd124111fc0 con 0x7fd124076b70 2024-09-18T21:04:37.914 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.132+0000 7fd11a7fc640 1 -- 172.21.15.77:0/2861378782 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fd120039040 con 0x7fd124076b70 2024-09-18T21:04:37.914 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.132+0000 7fd12bde6640 1 -- 172.21.15.77:0/2861378782 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1241002f0 con 0x7fd124076b70 2024-09-18T21:04:37.914 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.132+0000 7fd11a7fc640 1 --2- 172.21.15.77:0/2861378782 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7fd110039490 0x7fd11003b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:37.915 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.132+0000 7fd11a7fc640 1 -- 172.21.15.77:0/2861378782 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fd12006cb40 con 0x7fd124076b70 2024-09-18T21:04:37.915 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.132+0000 7fd129381640 1 --2- 172.21.15.77:0/2861378782 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7fd110039490 0x7fd11003b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:37.915 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.133+0000 7fd129381640 1 --2- 172.21.15.77:0/2861378782 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7fd110039490 0x7fd11003b940 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd114006fd0 tx=0x7fd114006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:37.915 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.137+0000 7fd11a7fc640 1 -- 172.21.15.77:0/2861378782 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd12003b430 con 0x7fd124076b70 2024-09-18T21:04:37.915 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.292+0000 7fd12bde6640 1 -- 172.21.15.77:0/2861378782 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fd12404b720 con 0x7fd124076b70 2024-09-18T21:04:37.915 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.296+0000 7fd11a7fc640 1 -- 172.21.15.77:0/2861378782 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fd1200370d0 con 0x7fd124076b70 2024-09-18T21:04:37.915 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.298+0000 7fd12bde6640 1 -- 172.21.15.77:0/2861378782 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7fd110039490 msgr2=0x7fd11003b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:37.915 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.298+0000 7fd12bde6640 1 --2- 172.21.15.77:0/2861378782 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7fd110039490 0x7fd11003b940 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd114006fd0 tx=0x7fd114006db0 comp rx=0 tx=0).stop 2024-09-18T21:04:37.915 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.298+0000 7fd12bde6640 1 -- 172.21.15.77:0/2861378782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd124076b70 msgr2=0x7fd124110e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:37.915 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.298+0000 7fd12bde6640 1 --2- 172.21.15.77:0/2861378782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd124076b70 0x7fd124110e30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd120009810 tx=0x7fd1200091d0 comp rx=0 tx=0).stop 2024-09-18T21:04:37.915 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.298+0000 7fd12bde6640 1 -- 172.21.15.77:0/2861378782 shutdown_connections 2024-09-18T21:04:37.915 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.298+0000 7fd12bde6640 1 --2- 172.21.15.77:0/2861378782 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7fd110039490 0x7fd11003b940 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:37.915 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.298+0000 7fd12bde6640 1 --2- 172.21.15.77:0/2861378782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd124076b70 0x7fd124110e30 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:37.916 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.298+0000 7fd12bde6640 1 -- 172.21.15.77:0/2861378782 >> 172.21.15.77:0/2861378782 conn(0x7fd1240fc6d0 msgr2=0x7fd1240fd360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:37.916 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.298+0000 7fd12bde6640 1 -- 172.21.15.77:0/2861378782 shutdown_connections 2024-09-18T21:04:37.916 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:37.298+0000 7fd12bde6640 1 -- 172.21.15.77:0/2861378782 wait complete. 2024-09-18T21:04:38.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:38 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/2861378782' entity='client.admin' 2024-09-18T21:04:39.093 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.284+0000 7f3b9d538640 1 Processor -- start 2024-09-18T21:04:39.094 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.284+0000 7f3b9d538640 1 -- start start 2024-09-18T21:04:39.094 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.284+0000 7f3b9d538640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b98076be0 0x7f3b98106f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:39.094 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.284+0000 7f3b9d538640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b98102950 con 0x7f3b98076be0 2024-09-18T21:04:39.094 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.285+0000 7f3b96ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b98076be0 0x7f3b98106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:39.094 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.285+0000 7f3b96ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b98076be0 0x7f3b98106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38188/0 (socket says 172.21.15.77:38188) 2024-09-18T21:04:39.094 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.285+0000 7f3b96ffd640 1 -- 172.21.15.77:0/2661345118 learned_addr learned my addr 172.21.15.77:0/2661345118 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:39.094 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.285+0000 7f3b96ffd640 1 -- 172.21.15.77:0/2661345118 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b981074a0 con 0x7f3b98076be0 2024-09-18T21:04:39.094 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.286+0000 7f3b96ffd640 1 --2- 172.21.15.77:0/2661345118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b98076be0 0x7f3b98106f60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3b88009840 tx=0x7f3b880091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5faf1f0645b7d69 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:39.094 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.286+0000 7f3b95ffb640 1 -- 172.21.15.77:0/2661345118 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3b88032440 con 0x7f3b98076be0 2024-09-18T21:04:39.094 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.286+0000 7f3b95ffb640 1 -- 172.21.15.77:0/2661345118 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3b88032a40 con 0x7f3b98076be0 2024-09-18T21:04:39.094 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.286+0000 7f3b95ffb640 1 -- 172.21.15.77:0/2661345118 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3b88031a70 con 0x7f3b98076be0 2024-09-18T21:04:39.094 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.287+0000 7f3b9d538640 1 -- 172.21.15.77:0/2661345118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b98076be0 msgr2=0x7f3b98106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:39.094 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.287+0000 7f3b9d538640 1 --2- 172.21.15.77:0/2661345118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b98076be0 0x7f3b98106f60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3b88009840 tx=0x7f3b880091d0 comp rx=0 tx=0).stop 2024-09-18T21:04:39.095 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.287+0000 7f3b9d538640 1 -- 172.21.15.77:0/2661345118 shutdown_connections 2024-09-18T21:04:39.095 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.287+0000 7f3b9d538640 1 --2- 172.21.15.77:0/2661345118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b98076be0 0x7f3b98106f60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:39.095 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.287+0000 7f3b9d538640 1 -- 172.21.15.77:0/2661345118 >> 172.21.15.77:0/2661345118 conn(0x7f3b980fc5f0 msgr2=0x7f3b980fea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:39.095 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.287+0000 7f3b9d538640 1 -- 172.21.15.77:0/2661345118 shutdown_connections 2024-09-18T21:04:39.095 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.287+0000 7f3b9d538640 1 -- 172.21.15.77:0/2661345118 wait complete. 2024-09-18T21:04:39.095 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.288+0000 7f3b9d538640 1 Processor -- start 2024-09-18T21:04:39.095 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.288+0000 7f3b9d538640 1 -- start start 2024-09-18T21:04:39.095 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.288+0000 7f3b9d538640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b98076be0 0x7f3b98112f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:39.095 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.288+0000 7f3b9d538640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b981134b0 con 0x7f3b98076be0 2024-09-18T21:04:39.095 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.288+0000 7f3b96ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b98076be0 0x7f3b98112f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:39.095 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.288+0000 7f3b96ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b98076be0 0x7f3b98112f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38202/0 (socket says 172.21.15.77:38202) 2024-09-18T21:04:39.095 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.288+0000 7f3b96ffd640 1 -- 172.21.15.77:0/980935955 learned_addr learned my addr 172.21.15.77:0/980935955 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:39.095 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.288+0000 7f3b96ffd640 1 -- 172.21.15.77:0/980935955 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b88009450 con 0x7f3b98076be0 2024-09-18T21:04:39.095 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.289+0000 7f3b96ffd640 1 --2- 172.21.15.77:0/980935955 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b98076be0 0x7f3b98112f70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3b88031750 tx=0x7f3b880091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:39.095 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.289+0000 7f3b7f7fe640 1 -- 172.21.15.77:0/980935955 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3b8803c400 con 0x7f3b98076be0 2024-09-18T21:04:39.096 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.289+0000 7f3b7f7fe640 1 -- 172.21.15.77:0/980935955 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3b8803ca00 con 0x7f3b98076be0 2024-09-18T21:04:39.096 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.289+0000 7f3b9d538640 1 -- 172.21.15.77:0/980935955 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b981136b0 con 0x7f3b98076be0 2024-09-18T21:04:39.096 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.289+0000 7f3b7f7fe640 1 -- 172.21.15.77:0/980935955 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3b8803a7f0 con 0x7f3b98076be0 2024-09-18T21:04:39.096 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.289+0000 7f3b9d538640 1 -- 172.21.15.77:0/980935955 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b98113b20 con 0x7f3b98076be0 2024-09-18T21:04:39.096 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.290+0000 7f3b7f7fe640 1 -- 172.21.15.77:0/980935955 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f3b8803aa60 con 0x7f3b98076be0 2024-09-18T21:04:39.096 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.290+0000 7f3b7f7fe640 1 --2- 172.21.15.77:0/980935955 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f3b80039490 0x7f3b8003b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:39.096 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.290+0000 7f3b7f7fe640 1 -- 172.21.15.77:0/980935955 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f3b8806cd10 con 0x7f3b98076be0 2024-09-18T21:04:39.096 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.290+0000 7f3b967fc640 1 --2- 172.21.15.77:0/980935955 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f3b80039490 0x7f3b8003b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:39.096 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.290+0000 7f3b9d538640 1 -- 172.21.15.77:0/980935955 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b98100230 con 0x7f3b98076be0 2024-09-18T21:04:39.096 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.290+0000 7f3b967fc640 1 --2- 172.21.15.77:0/980935955 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f3b80039490 0x7f3b8003b940 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c006fd0 tx=0x7f3b8c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:39.096 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.294+0000 7f3b7f7fe640 1 -- 172.21.15.77:0/980935955 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f3b88037070 con 0x7f3b98076be0 2024-09-18T21:04:39.096 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.526+0000 7f3b9d538640 1 -- 172.21.15.77:0/980935955 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f3b9804b720 con 0x7f3b98076be0 2024-09-18T21:04:39.097 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.529+0000 7f3b7f7fe640 1 -- 172.21.15.77:0/980935955 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f3b8806b0c0 con 0x7f3b98076be0 2024-09-18T21:04:39.097 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.531+0000 7f3b9d538640 1 -- 172.21.15.77:0/980935955 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f3b80039490 msgr2=0x7f3b8003b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:39.097 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.531+0000 7f3b9d538640 1 --2- 172.21.15.77:0/980935955 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f3b80039490 0x7f3b8003b940 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c006fd0 tx=0x7f3b8c006db0 comp rx=0 tx=0).stop 2024-09-18T21:04:39.097 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.531+0000 7f3b9d538640 1 -- 172.21.15.77:0/980935955 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b98076be0 msgr2=0x7f3b98112f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:39.097 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.531+0000 7f3b9d538640 1 --2- 172.21.15.77:0/980935955 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b98076be0 0x7f3b98112f70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3b88031750 tx=0x7f3b880091d0 comp rx=0 tx=0).stop 2024-09-18T21:04:39.097 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.531+0000 7f3b9d538640 1 -- 172.21.15.77:0/980935955 shutdown_connections 2024-09-18T21:04:39.097 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.531+0000 7f3b9d538640 1 --2- 172.21.15.77:0/980935955 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f3b80039490 0x7f3b8003b940 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:39.097 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.531+0000 7f3b9d538640 1 --2- 172.21.15.77:0/980935955 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b98076be0 0x7f3b98112f70 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:39.097 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.531+0000 7f3b9d538640 1 -- 172.21.15.77:0/980935955 >> 172.21.15.77:0/980935955 conn(0x7f3b980fc5f0 msgr2=0x7f3b980fd190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:39.097 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.532+0000 7f3b9d538640 1 -- 172.21.15.77:0/980935955 shutdown_connections 2024-09-18T21:04:39.097 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:38.532+0000 7f3b9d538640 1 -- 172.21.15.77:0/980935955 wait complete. 2024-09-18T21:04:39.097 INFO:teuthology.orchestra.run.smithi077.stdout:Enabling the dashboard module... 2024-09-18T21:04:39.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:39 smithi077 ceph-mon[27689]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:04:39.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:39 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/980935955' entity='client.admin' 2024-09-18T21:04:40.797 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:40 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/58742273' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-18T21:04:41.150 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:39.447+0000 7f1939c04640 1 Processor -- start 2024-09-18T21:04:41.151 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:39.447+0000 7f1939c04640 1 -- start start 2024-09-18T21:04:41.151 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:39.447+0000 7f1939c04640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19340769e0 0x7f1934107010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:41.151 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:39.447+0000 7f1939c04640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1934076df0 con 0x7f19340769e0 2024-09-18T21:04:41.151 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:39.448+0000 7f19337fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19340769e0 0x7f1934107010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:41.151 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:39.448+0000 7f19337fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19340769e0 0x7f1934107010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51240/0 (socket says 172.21.15.77:51240) 2024-09-18T21:04:41.151 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:39.448+0000 7f19337fe640 1 -- 172.21.15.77:0/967803551 learned_addr learned my addr 172.21.15.77:0/967803551 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:41.151 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:39.448+0000 7f19337fe640 1 -- 172.21.15.77:0/967803551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1934107550 con 0x7f19340769e0 2024-09-18T21:04:41.151 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:39.449+0000 7f19337fe640 1 --2- 172.21.15.77:0/967803551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19340769e0 0x7f1934107010 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1924009840 tx=0x7f19240091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1e43d6277668dc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:41.151 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:39.449+0000 7f19327fc640 1 -- 172.21.15.77:0/967803551 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1924032440 con 0x7f19340769e0 2024-09-18T21:04:41.151 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:39.449+0000 7f19327fc640 1 -- 172.21.15.77:0/967803551 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1924032a40 con 0x7f19340769e0 2024-09-18T21:04:41.152 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:39.449+0000 7f19327fc640 1 -- 172.21.15.77:0/967803551 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1924031aa0 con 0x7f19340769e0 2024-09-18T21:04:41.152 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:39.449+0000 7f1939c04640 1 -- 172.21.15.77:0/967803551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19340769e0 msgr2=0x7f1934107010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:41.152 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:39.449+0000 7f1939c04640 1 --2- 172.21.15.77:0/967803551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19340769e0 0x7f1934107010 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1924009840 tx=0x7f19240091d0 comp rx=0 tx=0).stop 2024-09-18T21:04:41.152 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:39.449+0000 7f1939c04640 1 -- 172.21.15.77:0/967803551 shutdown_connections 2024-09-18T21:04:41.152 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:39.449+0000 7f1939c04640 1 --2- 172.21.15.77:0/967803551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19340769e0 0x7f1934107010 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:41.152 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:39.449+0000 7f1939c04640 1 -- 172.21.15.77:0/967803551 >> 172.21.15.77:0/967803551 conn(0x7f19340fc700 msgr2=0x7f19340feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:41.152 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:39.450+0000 7f1939c04640 1 -- 172.21.15.77:0/967803551 shutdown_connections 2024-09-18T21:04:41.152 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:39.450+0000 7f1939c04640 1 -- 172.21.15.77:0/967803551 wait complete. 2024-09-18T21:04:41.152 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:39.450+0000 7f1939c04640 1 Processor -- start 2024-09-18T21:04:41.152 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:39.450+0000 7f1939c04640 1 -- start start 2024-09-18T21:04:41.152 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:39.450+0000 7f1939c04640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19340769e0 0x7f1934112ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:41.152 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:39.450+0000 7f1939c04640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1934113530 con 0x7f19340769e0 2024-09-18T21:04:41.153 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:39.451+0000 7f19337fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19340769e0 0x7f1934112ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:41.153 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:39.451+0000 7f19337fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19340769e0 0x7f1934112ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51242/0 (socket says 172.21.15.77:51242) 2024-09-18T21:04:41.153 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:39.451+0000 7f19337fe640 1 -- 172.21.15.77:0/58742273 learned_addr learned my addr 172.21.15.77:0/58742273 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:41.153 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:39.451+0000 7f19337fe640 1 -- 172.21.15.77:0/58742273 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1924009450 con 0x7f19340769e0 2024-09-18T21:04:41.153 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:39.451+0000 7f19337fe640 1 --2- 172.21.15.77:0/58742273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19340769e0 0x7f1934112ff0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f19240316a0 tx=0x7f19240091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:41.153 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:39.451+0000 7f191bfff640 1 -- 172.21.15.77:0/58742273 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f19240327b0 con 0x7f19340769e0 2024-09-18T21:04:41.153 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:39.451+0000 7f1939c04640 1 -- 172.21.15.77:0/58742273 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1934113730 con 0x7f19340769e0 2024-09-18T21:04:41.153 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:39.451+0000 7f191bfff640 1 -- 172.21.15.77:0/58742273 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f192403b8d0 con 0x7f19340769e0 2024-09-18T21:04:41.153 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:39.451+0000 7f191bfff640 1 -- 172.21.15.77:0/58742273 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f192403a780 con 0x7f19340769e0 2024-09-18T21:04:41.153 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:39.451+0000 7f1939c04640 1 -- 172.21.15.77:0/58742273 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1934113ba0 con 0x7f19340769e0 2024-09-18T21:04:41.153 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:39.452+0000 7f191bfff640 1 -- 172.21.15.77:0/58742273 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f1924039040 con 0x7f19340769e0 2024-09-18T21:04:41.153 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:39.452+0000 7f191bfff640 1 --2- 172.21.15.77:0/58742273 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f191c039490 0x7f191c03b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:41.153 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:39.452+0000 7f1939c04640 1 -- 172.21.15.77:0/58742273 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f193404b720 con 0x7f19340769e0 2024-09-18T21:04:41.154 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:39.452+0000 7f191bfff640 1 -- 172.21.15.77:0/58742273 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f192406cb00 con 0x7f19340769e0 2024-09-18T21:04:41.154 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:39.452+0000 7f1932ffd640 1 --2- 172.21.15.77:0/58742273 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f191c039490 0x7f191c03b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:41.154 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:39.453+0000 7f1932ffd640 1 --2- 172.21.15.77:0/58742273 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f191c039490 0x7f191c03b940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1928006fd0 tx=0x7f1928006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:41.154 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:39.457+0000 7f191bfff640 1 -- 172.21.15.77:0/58742273 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f192403f030 con 0x7f19340769e0 2024-09-18T21:04:41.154 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:39.653+0000 7f1939c04640 1 -- 172.21.15.77:0/58742273 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f1934108160 con 0x7f19340769e0 2024-09-18T21:04:41.154 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:40.534+0000 7f191bfff640 1 -- 172.21.15.77:0/58742273 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mgrmap(e 9) v1 ==== 45520+0+0 (secure 0 0 0) 0x7f192404bd10 con 0x7f19340769e0 2024-09-18T21:04:41.154 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:40.535+0000 7f191bfff640 1 -- 172.21.15.77:0/58742273 <== mon.0 v2:172.21.15.77:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f192404bae0 con 0x7f19340769e0 2024-09-18T21:04:41.154 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:40.538+0000 7f1939c04640 1 -- 172.21.15.77:0/58742273 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f191c039490 msgr2=0x7f191c03b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:41.154 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:40.538+0000 7f1939c04640 1 --2- 172.21.15.77:0/58742273 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f191c039490 0x7f191c03b940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1928006fd0 tx=0x7f1928006db0 comp rx=0 tx=0).stop 2024-09-18T21:04:41.154 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:40.538+0000 7f1939c04640 1 -- 172.21.15.77:0/58742273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19340769e0 msgr2=0x7f1934112ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:41.154 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:40.538+0000 7f1939c04640 1 --2- 172.21.15.77:0/58742273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19340769e0 0x7f1934112ff0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f19240316a0 tx=0x7f19240091d0 comp rx=0 tx=0).stop 2024-09-18T21:04:41.154 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:40.538+0000 7f1939c04640 1 -- 172.21.15.77:0/58742273 shutdown_connections 2024-09-18T21:04:41.154 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:40.538+0000 7f1939c04640 1 --2- 172.21.15.77:0/58742273 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f191c039490 0x7f191c03b940 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:41.154 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:40.538+0000 7f1939c04640 1 --2- 172.21.15.77:0/58742273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19340769e0 0x7f1934112ff0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:41.155 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:40.538+0000 7f1939c04640 1 -- 172.21.15.77:0/58742273 >> 172.21.15.77:0/58742273 conn(0x7f19340fc700 msgr2=0x7f19340fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:41.155 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:40.538+0000 7f1939c04640 1 -- 172.21.15.77:0/58742273 shutdown_connections 2024-09-18T21:04:41.155 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:40.538+0000 7f1939c04640 1 -- 172.21.15.77:0/58742273 wait complete. 2024-09-18T21:04:41.694 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:41 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/58742273' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-18T21:04:41.694 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:41 smithi077 ceph-mon[27689]: mgrmap e9: smithi077.utkpjg(active, since 24s) 2024-09-18T21:04:42.209 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout { 2024-09-18T21:04:42.209 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-18T21:04:42.209 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-18T21:04:42.209 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "active_name": "smithi077.utkpjg", 2024-09-18T21:04:42.209 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-18T21:04:42.209 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout } 2024-09-18T21:04:42.210 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.487+0000 7ffb586ce640 1 Processor -- start 2024-09-18T21:04:42.210 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.487+0000 7ffb586ce640 1 -- start start 2024-09-18T21:04:42.210 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.487+0000 7ffb586ce640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb50100e90 0x7ffb501012a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:42.210 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.488+0000 7ffb586ce640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb501017e0 con 0x7ffb50100e90 2024-09-18T21:04:42.210 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.488+0000 7ffb5646a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb50100e90 0x7ffb501012a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:42.210 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.488+0000 7ffb5646a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb50100e90 0x7ffb501012a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51268/0 (socket says 172.21.15.77:51268) 2024-09-18T21:04:42.210 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.488+0000 7ffb5646a640 1 -- 172.21.15.77:0/85793976 learned_addr learned my addr 172.21.15.77:0/85793976 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:42.210 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.488+0000 7ffb5646a640 1 -- 172.21.15.77:0/85793976 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb50101920 con 0x7ffb50100e90 2024-09-18T21:04:42.210 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.489+0000 7ffb5646a640 1 --2- 172.21.15.77:0/85793976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb50100e90 0x7ffb501012a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c009840 tx=0x7ffb4c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b3eef1e1490251b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:42.210 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.489+0000 7ffb55468640 1 -- 172.21.15.77:0/85793976 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb4c032440 con 0x7ffb50100e90 2024-09-18T21:04:42.211 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.489+0000 7ffb55468640 1 -- 172.21.15.77:0/85793976 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ffb4c032a40 con 0x7ffb50100e90 2024-09-18T21:04:42.211 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.489+0000 7ffb55468640 1 -- 172.21.15.77:0/85793976 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb4c031aa0 con 0x7ffb50100e90 2024-09-18T21:04:42.211 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.489+0000 7ffb586ce640 1 -- 172.21.15.77:0/85793976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb50100e90 msgr2=0x7ffb501012a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:42.211 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.489+0000 7ffb586ce640 1 --2- 172.21.15.77:0/85793976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb50100e90 0x7ffb501012a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c009840 tx=0x7ffb4c0091d0 comp rx=0 tx=0).stop 2024-09-18T21:04:42.211 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.490+0000 7ffb586ce640 1 -- 172.21.15.77:0/85793976 shutdown_connections 2024-09-18T21:04:42.211 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.490+0000 7ffb586ce640 1 --2- 172.21.15.77:0/85793976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb50100e90 0x7ffb501012a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:42.211 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.490+0000 7ffb586ce640 1 -- 172.21.15.77:0/85793976 >> 172.21.15.77:0/85793976 conn(0x7ffb500fc6d0 msgr2=0x7ffb500feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:42.211 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.490+0000 7ffb586ce640 1 -- 172.21.15.77:0/85793976 shutdown_connections 2024-09-18T21:04:42.211 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.490+0000 7ffb586ce640 1 -- 172.21.15.77:0/85793976 wait complete. 2024-09-18T21:04:42.212 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.490+0000 7ffb586ce640 1 Processor -- start 2024-09-18T21:04:42.212 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.490+0000 7ffb586ce640 1 -- start start 2024-09-18T21:04:42.212 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.490+0000 7ffb586ce640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb50100e90 0x7ffb50112f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:42.212 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.490+0000 7ffb586ce640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb501134b0 con 0x7ffb50100e90 2024-09-18T21:04:42.212 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.491+0000 7ffb5646a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb50100e90 0x7ffb50112f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:42.212 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.491+0000 7ffb5646a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb50100e90 0x7ffb50112f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51276/0 (socket says 172.21.15.77:51276) 2024-09-18T21:04:42.212 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.491+0000 7ffb5646a640 1 -- 172.21.15.77:0/2886735607 learned_addr learned my addr 172.21.15.77:0/2886735607 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:42.212 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.491+0000 7ffb5646a640 1 -- 172.21.15.77:0/2886735607 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb4c009450 con 0x7ffb50100e90 2024-09-18T21:04:42.212 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.491+0000 7ffb5646a640 1 --2- 172.21.15.77:0/2886735607 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb50100e90 0x7ffb50112f70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c006a70 tx=0x7ffb4c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:42.212 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.491+0000 7ffb42ffd640 1 -- 172.21.15.77:0/2886735607 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb4c031d20 con 0x7ffb50100e90 2024-09-18T21:04:42.212 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.491+0000 7ffb42ffd640 1 -- 172.21.15.77:0/2886735607 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ffb4c031e80 con 0x7ffb50100e90 2024-09-18T21:04:42.213 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.491+0000 7ffb586ce640 1 -- 172.21.15.77:0/2886735607 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb501136b0 con 0x7ffb50100e90 2024-09-18T21:04:42.213 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.491+0000 7ffb42ffd640 1 -- 172.21.15.77:0/2886735607 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb4c03a750 con 0x7ffb50100e90 2024-09-18T21:04:42.213 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.491+0000 7ffb586ce640 1 -- 172.21.15.77:0/2886735607 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb50113b20 con 0x7ffb50100e90 2024-09-18T21:04:42.213 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.492+0000 7ffb42ffd640 1 -- 172.21.15.77:0/2886735607 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 9) v1 ==== 45520+0+0 (secure 0 0 0) 0x7ffb4c039040 con 0x7ffb50100e90 2024-09-18T21:04:42.213 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.492+0000 7ffb42ffd640 1 --2- 172.21.15.77:0/2886735607 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7ffb3c039530 0x7ffb3c03b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:42.213 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.492+0000 7ffb586ce640 1 -- 172.21.15.77:0/2886735607 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb5004b720 con 0x7ffb50100e90 2024-09-18T21:04:42.213 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.492+0000 7ffb42ffd640 1 -- 172.21.15.77:0/2886735607 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7ffb4c03bc80 con 0x7ffb50100e90 2024-09-18T21:04:42.213 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.492+0000 7ffb55c69640 1 -- 172.21.15.77:0/2886735607 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7ffb3c039530 msgr2=0x7ffb3c03b9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/2654225509 2024-09-18T21:04:42.213 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.492+0000 7ffb55c69640 1 --2- 172.21.15.77:0/2886735607 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7ffb3c039530 0x7ffb3c03b9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-18T21:04:42.213 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.497+0000 7ffb42ffd640 1 -- 172.21.15.77:0/2886735607 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ffb4c03f070 con 0x7ffb50100e90 2024-09-18T21:04:42.214 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.693+0000 7ffb55c69640 1 -- 172.21.15.77:0/2886735607 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7ffb3c039530 msgr2=0x7ffb3c03b9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/2654225509 2024-09-18T21:04:42.214 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.693+0000 7ffb55c69640 1 --2- 172.21.15.77:0/2886735607 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7ffb3c039530 0x7ffb3c03b9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-18T21:04:42.214 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.695+0000 7ffb586ce640 1 -- 172.21.15.77:0/2886735607 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7ffb50114420 con 0x7ffb50100e90 2024-09-18T21:04:42.214 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.696+0000 7ffb42ffd640 1 -- 172.21.15.77:0/2886735607 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7ffb4c037030 con 0x7ffb50100e90 2024-09-18T21:04:42.214 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.698+0000 7ffb586ce640 1 -- 172.21.15.77:0/2886735607 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7ffb3c039530 msgr2=0x7ffb3c03b9e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-18T21:04:42.214 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.698+0000 7ffb586ce640 1 --2- 172.21.15.77:0/2886735607 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7ffb3c039530 0x7ffb3c03b9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:42.214 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.698+0000 7ffb586ce640 1 -- 172.21.15.77:0/2886735607 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb50100e90 msgr2=0x7ffb50112f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:42.214 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.698+0000 7ffb586ce640 1 --2- 172.21.15.77:0/2886735607 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb50100e90 0x7ffb50112f70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c006a70 tx=0x7ffb4c0091d0 comp rx=0 tx=0).stop 2024-09-18T21:04:42.214 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.698+0000 7ffb586ce640 1 -- 172.21.15.77:0/2886735607 shutdown_connections 2024-09-18T21:04:42.214 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.698+0000 7ffb586ce640 1 --2- 172.21.15.77:0/2886735607 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7ffb3c039530 0x7ffb3c03b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:42.214 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.698+0000 7ffb586ce640 1 --2- 172.21.15.77:0/2886735607 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb50100e90 0x7ffb50112f70 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:42.214 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.698+0000 7ffb586ce640 1 -- 172.21.15.77:0/2886735607 >> 172.21.15.77:0/2886735607 conn(0x7ffb500fc6d0 msgr2=0x7ffb500fd270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:42.215 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.698+0000 7ffb586ce640 1 -- 172.21.15.77:0/2886735607 shutdown_connections 2024-09-18T21:04:42.215 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:41.698+0000 7ffb586ce640 1 -- 172.21.15.77:0/2886735607 wait complete. 2024-09-18T21:04:42.215 INFO:teuthology.orchestra.run.smithi077.stdout:Waiting for the mgr to restart... 2024-09-18T21:04:42.215 INFO:teuthology.orchestra.run.smithi077.stdout:Waiting for mgr epoch 9... 2024-09-18T21:04:42.586 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:42 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/2886735607' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-18T21:04:45.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:44 smithi077 ceph-mon[27689]: Active manager daemon smithi077.utkpjg restarted 2024-09-18T21:04:45.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:44 smithi077 ceph-mon[27689]: Activating manager daemon smithi077.utkpjg 2024-09-18T21:04:45.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:44 smithi077 ceph-mon[27689]: osdmap e3: 0 total, 0 up, 0 in 2024-09-18T21:04:45.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:44 smithi077 ceph-mon[27689]: mgrmap e10: smithi077.utkpjg(active, starting, since 0.00341611s) 2024-09-18T21:04:45.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:44 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mon metadata", "id": "smithi077"}]: dispatch 2024-09-18T21:04:45.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:44 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mgr metadata", "who": "smithi077.utkpjg", "id": "smithi077.utkpjg"}]: dispatch 2024-09-18T21:04:45.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:44 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-18T21:04:45.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:44 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-18T21:04:45.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:44 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-18T21:04:45.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:44 smithi077 ceph-mon[27689]: Manager daemon smithi077.utkpjg is now available 2024-09-18T21:04:45.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:44 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:04:45.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:44 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi077.utkpjg/mirror_snapshot_schedule"}]: dispatch 2024-09-18T21:04:45.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:44 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi077.utkpjg/trash_purge_schedule"}]: dispatch 2024-09-18T21:04:46.761 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout { 2024-09-18T21:04:46.761 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-18T21:04:46.761 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-18T21:04:46.761 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout } 2024-09-18T21:04:46.761 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:42.569+0000 7f4d1a0d8640 1 Processor -- start 2024-09-18T21:04:46.761 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:42.569+0000 7f4d1a0d8640 1 -- start start 2024-09-18T21:04:46.761 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:42.569+0000 7f4d1a0d8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d14101fa0 0x7f4d141023b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:46.761 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:42.569+0000 7f4d1a0d8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d141028f0 con 0x7f4d14101fa0 2024-09-18T21:04:46.761 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:42.569+0000 7f4d137fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d14101fa0 0x7f4d141023b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:46.761 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:42.569+0000 7f4d137fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d14101fa0 0x7f4d141023b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51284/0 (socket says 172.21.15.77:51284) 2024-09-18T21:04:46.761 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:42.569+0000 7f4d137fe640 1 -- 172.21.15.77:0/3306311120 learned_addr learned my addr 172.21.15.77:0/3306311120 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:46.762 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:42.570+0000 7f4d137fe640 1 -- 172.21.15.77:0/3306311120 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d14102a30 con 0x7f4d14101fa0 2024-09-18T21:04:46.762 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:42.570+0000 7f4d137fe640 1 --2- 172.21.15.77:0/3306311120 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d14101fa0 0x7f4d141023b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4d04009840 tx=0x7f4d040091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7187997334f196b server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:46.762 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:42.571+0000 7f4d127fc640 1 -- 172.21.15.77:0/3306311120 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4d04032440 con 0x7f4d14101fa0 2024-09-18T21:04:46.762 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:42.571+0000 7f4d127fc640 1 -- 172.21.15.77:0/3306311120 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4d04032a40 con 0x7f4d14101fa0 2024-09-18T21:04:46.762 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:42.571+0000 7f4d127fc640 1 -- 172.21.15.77:0/3306311120 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4d04031a70 con 0x7f4d14101fa0 2024-09-18T21:04:46.762 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:42.571+0000 7f4d1a0d8640 1 -- 172.21.15.77:0/3306311120 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d14101fa0 msgr2=0x7f4d141023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:46.762 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:42.571+0000 7f4d1a0d8640 1 --2- 172.21.15.77:0/3306311120 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d14101fa0 0x7f4d141023b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4d04009840 tx=0x7f4d040091d0 comp rx=0 tx=0).stop 2024-09-18T21:04:46.762 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:42.571+0000 7f4d1a0d8640 1 -- 172.21.15.77:0/3306311120 shutdown_connections 2024-09-18T21:04:46.762 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:42.571+0000 7f4d1a0d8640 1 --2- 172.21.15.77:0/3306311120 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d14101fa0 0x7f4d141023b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:46.762 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:42.571+0000 7f4d1a0d8640 1 -- 172.21.15.77:0/3306311120 >> 172.21.15.77:0/3306311120 conn(0x7f4d140fd740 msgr2=0x7f4d140ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:46.762 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:42.571+0000 7f4d1a0d8640 1 -- 172.21.15.77:0/3306311120 shutdown_connections 2024-09-18T21:04:46.762 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:42.571+0000 7f4d1a0d8640 1 -- 172.21.15.77:0/3306311120 wait complete. 2024-09-18T21:04:46.762 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:42.572+0000 7f4d1a0d8640 1 Processor -- start 2024-09-18T21:04:46.762 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:42.572+0000 7f4d1a0d8640 1 -- start start 2024-09-18T21:04:46.763 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:42.572+0000 7f4d1a0d8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d14101fa0 0x7f4d14110e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:46.763 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:42.572+0000 7f4d1a0d8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d14111360 con 0x7f4d14101fa0 2024-09-18T21:04:46.763 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:42.572+0000 7f4d137fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d14101fa0 0x7f4d14110e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:46.763 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:42.573+0000 7f4d137fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d14101fa0 0x7f4d14110e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51290/0 (socket says 172.21.15.77:51290) 2024-09-18T21:04:46.763 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:42.573+0000 7f4d137fe640 1 -- 172.21.15.77:0/3946656627 learned_addr learned my addr 172.21.15.77:0/3946656627 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:46.763 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:42.573+0000 7f4d137fe640 1 -- 172.21.15.77:0/3946656627 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d04009450 con 0x7f4d14101fa0 2024-09-18T21:04:46.763 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:42.573+0000 7f4d137fe640 1 --2- 172.21.15.77:0/3946656627 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d14101fa0 0x7f4d14110e20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4d04006a70 tx=0x7f4d040091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:46.763 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:42.573+0000 7f4d0bfff640 1 -- 172.21.15.77:0/3946656627 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4d0403c400 con 0x7f4d14101fa0 2024-09-18T21:04:46.763 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:42.573+0000 7f4d0bfff640 1 -- 172.21.15.77:0/3946656627 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4d0403ca00 con 0x7f4d14101fa0 2024-09-18T21:04:46.763 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:42.573+0000 7f4d1a0d8640 1 -- 172.21.15.77:0/3946656627 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d14111560 con 0x7f4d14101fa0 2024-09-18T21:04:46.763 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:42.573+0000 7f4d0bfff640 1 -- 172.21.15.77:0/3946656627 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4d0403a9a0 con 0x7f4d14101fa0 2024-09-18T21:04:46.763 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:42.573+0000 7f4d1a0d8640 1 -- 172.21.15.77:0/3946656627 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d14111fb0 con 0x7f4d14101fa0 2024-09-18T21:04:46.763 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:42.574+0000 7f4d0bfff640 1 -- 172.21.15.77:0/3946656627 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 9) v1 ==== 45520+0+0 (secure 0 0 0) 0x7f4d0403abd0 con 0x7f4d14101fa0 2024-09-18T21:04:46.763 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:42.574+0000 7f4d0bfff640 1 --2- 172.21.15.77:0/3946656627 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f4d00039530 0x7f4d0003b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:46.764 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:42.574+0000 7f4d0bfff640 1 -- 172.21.15.77:0/3946656627 --> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4d0003c0f0 con 0x7f4d00039530 2024-09-18T21:04:46.764 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:42.574+0000 7f4d12ffd640 1 -- 172.21.15.77:0/3946656627 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f4d00039530 msgr2=0x7f4d0003b9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/2654225509 2024-09-18T21:04:46.764 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:42.574+0000 7f4d0bfff640 1 -- 172.21.15.77:0/3946656627 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f4d0406cdd0 con 0x7f4d14101fa0 2024-09-18T21:04:46.764 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:42.574+0000 7f4d12ffd640 1 --2- 172.21.15.77:0/3946656627 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f4d00039530 0x7f4d0003b9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-18T21:04:46.764 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:42.775+0000 7f4d12ffd640 1 -- 172.21.15.77:0/3946656627 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f4d00039530 msgr2=0x7f4d0003b9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/2654225509 2024-09-18T21:04:46.764 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:42.775+0000 7f4d12ffd640 1 --2- 172.21.15.77:0/3946656627 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f4d00039530 0x7f4d0003b9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-18T21:04:46.764 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:43.176+0000 7f4d12ffd640 1 -- 172.21.15.77:0/3946656627 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f4d00039530 msgr2=0x7f4d0003b9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/2654225509 2024-09-18T21:04:46.764 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:43.176+0000 7f4d12ffd640 1 --2- 172.21.15.77:0/3946656627 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f4d00039530 0x7f4d0003b9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-18T21:04:46.764 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:43.977+0000 7f4d12ffd640 1 -- 172.21.15.77:0/3946656627 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f4d00039530 msgr2=0x7f4d0003b9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/2654225509 2024-09-18T21:04:46.764 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:43.977+0000 7f4d12ffd640 1 --2- 172.21.15.77:0/3946656627 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f4d00039530 0x7f4d0003b9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-18T21:04:46.764 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:44.918+0000 7f4d0bfff640 1 -- 172.21.15.77:0/3946656627 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mgrmap(e 10) v1 ==== 45287+0+0 (secure 0 0 0) 0x7f4d04030d50 con 0x7f4d14101fa0 2024-09-18T21:04:46.764 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:44.918+0000 7f4d0bfff640 1 -- 172.21.15.77:0/3946656627 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f4d00039530 msgr2=0x7f4d0003b9e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-18T21:04:46.764 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:44.918+0000 7f4d0bfff640 1 --2- 172.21.15.77:0/3946656627 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f4d00039530 0x7f4d0003b9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:46.765 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:45.919+0000 7f4d0bfff640 1 -- 172.21.15.77:0/3946656627 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mgrmap(e 11) v1 ==== 45414+0+0 (secure 0 0 0) 0x7f4d04046460 con 0x7f4d14101fa0 2024-09-18T21:04:46.765 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:45.919+0000 7f4d0bfff640 1 --2- 172.21.15.77:0/3946656627 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f4d0003cfd0 0x7f4d0003f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:46.765 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:45.919+0000 7f4d0bfff640 1 -- 172.21.15.77:0/3946656627 --> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4d0003c0f0 con 0x7f4d0003cfd0 2024-09-18T21:04:46.765 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:45.920+0000 7f4d12ffd640 1 --2- 172.21.15.77:0/3946656627 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f4d0003cfd0 0x7f4d0003f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:46.765 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:45.920+0000 7f4d12ffd640 1 --2- 172.21.15.77:0/3946656627 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f4d0003cfd0 0x7f4d0003f3b0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc003940 tx=0x7f4cfc009350 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:46.765 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:45.921+0000 7f4d0bfff640 1 -- 172.21.15.77:0/3946656627 <== mgr.14160 v2:172.21.15.77:6800/517401638 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f4d0003c0f0 con 0x7f4d0003cfd0 2024-09-18T21:04:46.765 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:45.926+0000 7f4d1a0d8640 1 -- 172.21.15.77:0/3946656627 --> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f4d14101400 con 0x7f4d0003cfd0 2024-09-18T21:04:46.765 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:45.926+0000 7f4d0bfff640 1 -- 172.21.15.77:0/3946656627 <== mgr.14160 v2:172.21.15.77:6800/517401638 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f4d14101400 con 0x7f4d0003cfd0 2024-09-18T21:04:46.765 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:45.926+0000 7f4d1a0d8640 1 -- 172.21.15.77:0/3946656627 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f4d0003cfd0 msgr2=0x7f4d0003f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:46.765 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:45.926+0000 7f4d1a0d8640 1 --2- 172.21.15.77:0/3946656627 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f4d0003cfd0 0x7f4d0003f3b0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc003940 tx=0x7f4cfc009350 comp rx=0 tx=0).stop 2024-09-18T21:04:46.765 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:45.926+0000 7f4d1a0d8640 1 -- 172.21.15.77:0/3946656627 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d14101fa0 msgr2=0x7f4d14110e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:46.765 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:45.926+0000 7f4d1a0d8640 1 --2- 172.21.15.77:0/3946656627 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d14101fa0 0x7f4d14110e20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4d04006a70 tx=0x7f4d040091d0 comp rx=0 tx=0).stop 2024-09-18T21:04:46.765 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:45.926+0000 7f4d1a0d8640 1 -- 172.21.15.77:0/3946656627 shutdown_connections 2024-09-18T21:04:46.765 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:45.926+0000 7f4d1a0d8640 1 --2- 172.21.15.77:0/3946656627 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f4d0003cfd0 0x7f4d0003f3b0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:46.765 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:45.926+0000 7f4d1a0d8640 1 --2- 172.21.15.77:0/3946656627 >> [v2:172.21.15.77:6800/2654225509,v1:172.21.15.77:6801/2654225509] conn(0x7f4d00039530 0x7f4d0003b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:46.766 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:45.926+0000 7f4d1a0d8640 1 --2- 172.21.15.77:0/3946656627 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d14101fa0 0x7f4d14110e20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:46.766 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:45.926+0000 7f4d1a0d8640 1 -- 172.21.15.77:0/3946656627 >> 172.21.15.77:0/3946656627 conn(0x7f4d140fd740 msgr2=0x7f4d140fe2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:46.766 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:45.927+0000 7f4d1a0d8640 1 -- 172.21.15.77:0/3946656627 shutdown_connections 2024-09-18T21:04:46.766 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:45.927+0000 7f4d1a0d8640 1 -- 172.21.15.77:0/3946656627 wait complete. 2024-09-18T21:04:46.766 INFO:teuthology.orchestra.run.smithi077.stdout:mgr epoch 9 is available 2024-09-18T21:04:46.766 INFO:teuthology.orchestra.run.smithi077.stdout:Generating a dashboard self-signed certificate... 2024-09-18T21:04:47.138 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:46 smithi077 ceph-mon[27689]: [18/Sep/2024:21:04:45] ENGINE Bus STARTING 2024-09-18T21:04:47.138 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:46 smithi077 ceph-mon[27689]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-18T21:04:47.138 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:46 smithi077 ceph-mon[27689]: mgrmap e11: smithi077.utkpjg(active, since 1.00528s) 2024-09-18T21:04:47.138 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:46 smithi077 ceph-mon[27689]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-18T21:04:47.138 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:46 smithi077 ceph-mon[27689]: [18/Sep/2024:21:04:45] ENGINE Serving on https://172.21.15.77:7150 2024-09-18T21:04:47.139 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:46 smithi077 ceph-mon[27689]: [18/Sep/2024:21:04:45] ENGINE Bus STARTED 2024-09-18T21:04:47.139 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:46 smithi077 ceph-mon[27689]: [18/Sep/2024:21:04:45] ENGINE Error in HTTPServer.serve 2024-09-18T21:04:47.139 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Traceback (most recent call last): 2024-09-18T21:04:47.139 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-18T21:04:47.139 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: self._connections.run(self.expiration_interval) 2024-09-18T21:04:47.139 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-18T21:04:47.139 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: self._run(expiration_interval) 2024-09-18T21:04:47.139 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-18T21:04:47.139 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-18T21:04:47.139 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-18T21:04:47.139 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-18T21:04:47.139 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-18T21:04:47.139 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: s = self.context.wrap_socket( 2024-09-18T21:04:47.139 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-18T21:04:47.139 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: return self.sslsocket_class._create( 2024-09-18T21:04:47.140 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-18T21:04:47.140 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: self.do_handshake() 2024-09-18T21:04:47.140 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-18T21:04:47.140 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: self._sslobj.do_handshake() 2024-09-18T21:04:47.140 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-18T21:04:47.140 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:46 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' 2024-09-18T21:04:47.140 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:46 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' 2024-09-18T21:04:47.908 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-18T21:04:47.908 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.140+0000 7f19f3f50640 1 Processor -- start 2024-09-18T21:04:47.908 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.140+0000 7f19f3f50640 1 -- start start 2024-09-18T21:04:47.908 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.140+0000 7f19f3f50640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19ec078be0 0x7f19ec077250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:47.908 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.140+0000 7f19f3f50640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ec078ff0 con 0x7f19ec078be0 2024-09-18T21:04:47.908 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.141+0000 7f19f1cec640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19ec078be0 0x7f19ec077250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:47.908 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.141+0000 7f19f1cec640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19ec078be0 0x7f19ec077250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51340/0 (socket says 172.21.15.77:51340) 2024-09-18T21:04:47.909 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.141+0000 7f19f1cec640 1 -- 172.21.15.77:0/664445887 learned_addr learned my addr 172.21.15.77:0/664445887 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:47.909 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.141+0000 7f19f1cec640 1 -- 172.21.15.77:0/664445887 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19ec079130 con 0x7f19ec078be0 2024-09-18T21:04:47.909 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.142+0000 7f19f1cec640 1 --2- 172.21.15.77:0/664445887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19ec078be0 0x7f19ec077250 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f19e8009840 tx=0x7f19e80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61bd06a5fb0c8a7c server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:47.909 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.142+0000 7f19f0cea640 1 -- 172.21.15.77:0/664445887 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f19e8032440 con 0x7f19ec078be0 2024-09-18T21:04:47.909 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.142+0000 7f19f0cea640 1 -- 172.21.15.77:0/664445887 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f19e8032a40 con 0x7f19ec078be0 2024-09-18T21:04:47.909 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.142+0000 7f19f0cea640 1 -- 172.21.15.77:0/664445887 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f19e8031a70 con 0x7f19ec078be0 2024-09-18T21:04:47.909 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.143+0000 7f19f3f50640 1 -- 172.21.15.77:0/664445887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19ec078be0 msgr2=0x7f19ec077250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:47.909 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.143+0000 7f19f3f50640 1 --2- 172.21.15.77:0/664445887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19ec078be0 0x7f19ec077250 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f19e8009840 tx=0x7f19e80091d0 comp rx=0 tx=0).stop 2024-09-18T21:04:47.909 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.143+0000 7f19f3f50640 1 -- 172.21.15.77:0/664445887 shutdown_connections 2024-09-18T21:04:47.909 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.143+0000 7f19f3f50640 1 --2- 172.21.15.77:0/664445887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19ec078be0 0x7f19ec077250 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:47.909 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.143+0000 7f19f3f50640 1 -- 172.21.15.77:0/664445887 >> 172.21.15.77:0/664445887 conn(0x7f19ec0fd7f0 msgr2=0x7f19ec0ffc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:47.909 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.143+0000 7f19f3f50640 1 -- 172.21.15.77:0/664445887 shutdown_connections 2024-09-18T21:04:47.909 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.143+0000 7f19f3f50640 1 -- 172.21.15.77:0/664445887 wait complete. 2024-09-18T21:04:47.910 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.143+0000 7f19f3f50640 1 Processor -- start 2024-09-18T21:04:47.910 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.143+0000 7f19f3f50640 1 -- start start 2024-09-18T21:04:47.910 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.144+0000 7f19f3f50640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19ec078be0 0x7f19ec113010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:47.910 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.144+0000 7f19f3f50640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ec113550 con 0x7f19ec078be0 2024-09-18T21:04:47.910 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.144+0000 7f19f1cec640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19ec078be0 0x7f19ec113010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:47.910 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.144+0000 7f19f1cec640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19ec078be0 0x7f19ec113010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51350/0 (socket says 172.21.15.77:51350) 2024-09-18T21:04:47.910 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.144+0000 7f19f1cec640 1 -- 172.21.15.77:0/3805758331 learned_addr learned my addr 172.21.15.77:0/3805758331 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:47.910 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.144+0000 7f19f1cec640 1 -- 172.21.15.77:0/3805758331 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e8009450 con 0x7f19ec078be0 2024-09-18T21:04:47.910 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.144+0000 7f19f1cec640 1 --2- 172.21.15.77:0/3805758331 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19ec078be0 0x7f19ec113010 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f19e8031670 tx=0x7f19e80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:47.910 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.144+0000 7f19e27fc640 1 -- 172.21.15.77:0/3805758331 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f19e8031e90 con 0x7f19ec078be0 2024-09-18T21:04:47.910 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.144+0000 7f19f3f50640 1 -- 172.21.15.77:0/3805758331 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19ec113750 con 0x7f19ec078be0 2024-09-18T21:04:47.910 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.144+0000 7f19e27fc640 1 -- 172.21.15.77:0/3805758331 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f19e803c8a0 con 0x7f19ec078be0 2024-09-18T21:04:47.910 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.144+0000 7f19e27fc640 1 -- 172.21.15.77:0/3805758331 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f19e803a890 con 0x7f19ec078be0 2024-09-18T21:04:47.911 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.144+0000 7f19f3f50640 1 -- 172.21.15.77:0/3805758331 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19ec113bc0 con 0x7f19ec078be0 2024-09-18T21:04:47.911 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.145+0000 7f19e27fc640 1 -- 172.21.15.77:0/3805758331 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) v1 ==== 45414+0+0 (secure 0 0 0) 0x7f19e803ab00 con 0x7f19ec078be0 2024-09-18T21:04:47.911 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.145+0000 7f19e27fc640 1 --2- 172.21.15.77:0/3805758331 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f19d80393d0 0x7f19d803b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:47.911 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.145+0000 7f19f3f50640 1 -- 172.21.15.77:0/3805758331 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19ec04b720 con 0x7f19ec078be0 2024-09-18T21:04:47.911 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.145+0000 7f19e27fc640 1 -- 172.21.15.77:0/3805758331 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f19e806cbd0 con 0x7f19ec078be0 2024-09-18T21:04:47.911 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.146+0000 7f19f14eb640 1 --2- 172.21.15.77:0/3805758331 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f19d80393d0 0x7f19d803b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:47.911 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.146+0000 7f19f14eb640 1 --2- 172.21.15.77:0/3805758331 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f19d80393d0 0x7f19d803b880 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f19dc006fd0 tx=0x7f19dc006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:47.911 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.150+0000 7f19e27fc640 1 -- 172.21.15.77:0/3805758331 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f19e8037030 con 0x7f19ec078be0 2024-09-18T21:04:47.911 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.322+0000 7f19f3f50640 1 -- 172.21.15.77:0/3805758331 --> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f19ec0fec90 con 0x7f19d80393d0 2024-09-18T21:04:47.911 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.374+0000 7f19e27fc640 1 -- 172.21.15.77:0/3805758331 <== mgr.14160 v2:172.21.15.77:6800/517401638 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f19ec0fec90 con 0x7f19d80393d0 2024-09-18T21:04:47.911 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.376+0000 7f19f3f50640 1 -- 172.21.15.77:0/3805758331 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f19d80393d0 msgr2=0x7f19d803b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:47.911 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.376+0000 7f19f3f50640 1 --2- 172.21.15.77:0/3805758331 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f19d80393d0 0x7f19d803b880 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f19dc006fd0 tx=0x7f19dc006db0 comp rx=0 tx=0).stop 2024-09-18T21:04:47.911 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.376+0000 7f19f3f50640 1 -- 172.21.15.77:0/3805758331 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19ec078be0 msgr2=0x7f19ec113010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:47.912 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.376+0000 7f19f3f50640 1 --2- 172.21.15.77:0/3805758331 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19ec078be0 0x7f19ec113010 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f19e8031670 tx=0x7f19e80091d0 comp rx=0 tx=0).stop 2024-09-18T21:04:47.912 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.376+0000 7f19f3f50640 1 -- 172.21.15.77:0/3805758331 shutdown_connections 2024-09-18T21:04:47.912 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.376+0000 7f19f3f50640 1 --2- 172.21.15.77:0/3805758331 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f19d80393d0 0x7f19d803b880 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:47.912 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.376+0000 7f19f3f50640 1 --2- 172.21.15.77:0/3805758331 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19ec078be0 0x7f19ec113010 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:47.912 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.376+0000 7f19f3f50640 1 -- 172.21.15.77:0/3805758331 >> 172.21.15.77:0/3805758331 conn(0x7f19ec0fd7f0 msgr2=0x7f19ec0fe4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:47.912 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.376+0000 7f19f3f50640 1 -- 172.21.15.77:0/3805758331 shutdown_connections 2024-09-18T21:04:47.912 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:47.376+0000 7f19f3f50640 1 -- 172.21.15.77:0/3805758331 wait complete. 2024-09-18T21:04:47.912 INFO:teuthology.orchestra.run.smithi077.stdout:Creating initial admin user... 2024-09-18T21:04:48.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:48 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' 2024-09-18T21:04:48.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:48 smithi077 ceph-mon[27689]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:04:48.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:48 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' 2024-09-18T21:04:48.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:48 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' 2024-09-18T21:04:48.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:48 smithi077 ceph-mon[27689]: mgrmap e12: smithi077.utkpjg(active, since 2s) 2024-09-18T21:04:49.429 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:49 smithi077 ceph-mon[27689]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:04:49.429 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:49 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' 2024-09-18T21:04:50.082 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$tsWRfnwdPzHF4.MK30xq0.M3gBkdzC7XGRRsfWlF0h1pGBui8XSES", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726693488, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-18T21:04:50.082 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.363+0000 7ff907f4b640 1 Processor -- start 2024-09-18T21:04:50.082 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.363+0000 7ff907f4b640 1 -- start start 2024-09-18T21:04:50.082 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.364+0000 7ff907f4b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9001035c0 0x7ff9001039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:50.082 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.364+0000 7ff907f4b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff900070e30 con 0x7ff9001035c0 2024-09-18T21:04:50.082 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.364+0000 7ff905ce7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9001035c0 0x7ff9001039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:50.082 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.364+0000 7ff905ce7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9001035c0 0x7ff9001039d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51362/0 (socket says 172.21.15.77:51362) 2024-09-18T21:04:50.082 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.364+0000 7ff905ce7640 1 -- 172.21.15.77:0/3320554477 learned_addr learned my addr 172.21.15.77:0/3320554477 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:50.082 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.364+0000 7ff905ce7640 1 -- 172.21.15.77:0/3320554477 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff900103f10 con 0x7ff9001035c0 2024-09-18T21:04:50.082 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.365+0000 7ff905ce7640 1 --2- 172.21.15.77:0/3320554477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9001035c0 0x7ff9001039d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc009840 tx=0x7ff8fc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b43f32447116aad server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:50.083 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.365+0000 7ff904ce5640 1 -- 172.21.15.77:0/3320554477 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff8fc032440 con 0x7ff9001035c0 2024-09-18T21:04:50.083 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.365+0000 7ff904ce5640 1 -- 172.21.15.77:0/3320554477 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff8fc032a40 con 0x7ff9001035c0 2024-09-18T21:04:50.083 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.365+0000 7ff904ce5640 1 -- 172.21.15.77:0/3320554477 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff8fc031a70 con 0x7ff9001035c0 2024-09-18T21:04:50.083 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.365+0000 7ff907f4b640 1 -- 172.21.15.77:0/3320554477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9001035c0 msgr2=0x7ff9001039d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:50.083 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.365+0000 7ff907f4b640 1 --2- 172.21.15.77:0/3320554477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9001035c0 0x7ff9001039d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc009840 tx=0x7ff8fc0091d0 comp rx=0 tx=0).stop 2024-09-18T21:04:50.083 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.365+0000 7ff907f4b640 1 -- 172.21.15.77:0/3320554477 shutdown_connections 2024-09-18T21:04:50.083 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.365+0000 7ff907f4b640 1 --2- 172.21.15.77:0/3320554477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9001035c0 0x7ff9001039d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:50.083 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.365+0000 7ff907f4b640 1 -- 172.21.15.77:0/3320554477 >> 172.21.15.77:0/3320554477 conn(0x7ff9000fbdc0 msgr2=0x7ff9000fe1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:50.083 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.366+0000 7ff907f4b640 1 -- 172.21.15.77:0/3320554477 shutdown_connections 2024-09-18T21:04:50.083 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.366+0000 7ff907f4b640 1 -- 172.21.15.77:0/3320554477 wait complete. 2024-09-18T21:04:50.083 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.366+0000 7ff907f4b640 1 Processor -- start 2024-09-18T21:04:50.083 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.366+0000 7ff907f4b640 1 -- start start 2024-09-18T21:04:50.084 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.366+0000 7ff907f4b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9001035c0 0x7ff900110e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:50.084 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.366+0000 7ff907f4b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff900111370 con 0x7ff9001035c0 2024-09-18T21:04:50.084 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.366+0000 7ff905ce7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9001035c0 0x7ff900110e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:50.084 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.366+0000 7ff905ce7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9001035c0 0x7ff900110e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51370/0 (socket says 172.21.15.77:51370) 2024-09-18T21:04:50.084 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.366+0000 7ff905ce7640 1 -- 172.21.15.77:0/2417347648 learned_addr learned my addr 172.21.15.77:0/2417347648 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:50.084 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.367+0000 7ff905ce7640 1 -- 172.21.15.77:0/2417347648 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8fc009450 con 0x7ff9001035c0 2024-09-18T21:04:50.084 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.367+0000 7ff905ce7640 1 --2- 172.21.15.77:0/2417347648 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9001035c0 0x7ff900110e30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc006a70 tx=0x7ff8fc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:50.084 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.367+0000 7ff8f67fc640 1 -- 172.21.15.77:0/2417347648 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff8fc03c400 con 0x7ff9001035c0 2024-09-18T21:04:50.084 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.367+0000 7ff8f67fc640 1 -- 172.21.15.77:0/2417347648 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff8fc03ca00 con 0x7ff9001035c0 2024-09-18T21:04:50.085 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.367+0000 7ff8f67fc640 1 -- 172.21.15.77:0/2417347648 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff8fc03a9a0 con 0x7ff9001035c0 2024-09-18T21:04:50.085 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.367+0000 7ff907f4b640 1 -- 172.21.15.77:0/2417347648 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff900111570 con 0x7ff9001035c0 2024-09-18T21:04:50.085 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.367+0000 7ff907f4b640 1 -- 172.21.15.77:0/2417347648 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff900111fc0 con 0x7ff9001035c0 2024-09-18T21:04:50.085 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.368+0000 7ff8f67fc640 1 -- 172.21.15.77:0/2417347648 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 12) v1 ==== 45520+0+0 (secure 0 0 0) 0x7ff8fc03ab90 con 0x7ff9001035c0 2024-09-18T21:04:50.085 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.368+0000 7ff8f67fc640 1 --2- 172.21.15.77:0/2417347648 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7ff8ec039530 0x7ff8ec03b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:50.085 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.368+0000 7ff8f67fc640 1 -- 172.21.15.77:0/2417347648 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff8fc06cf00 con 0x7ff9001035c0 2024-09-18T21:04:50.085 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.368+0000 7ff907f4b640 1 -- 172.21.15.77:0/2417347648 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9000ffa60 con 0x7ff9001035c0 2024-09-18T21:04:50.085 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.368+0000 7ff9054e6640 1 --2- 172.21.15.77:0/2417347648 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7ff8ec039530 0x7ff8ec03b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:50.085 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.368+0000 7ff9054e6640 1 --2- 172.21.15.77:0/2417347648 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7ff8ec039530 0x7ff8ec03b9e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0006fd0 tx=0x7ff8f0006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:50.086 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.373+0000 7ff8f67fc640 1 -- 172.21.15.77:0/2417347648 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff8fc037030 con 0x7ff9001035c0 2024-09-18T21:04:50.086 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.572+0000 7ff907f4b640 1 -- 172.21.15.77:0/2417347648 --> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7ff90005eb60 con 0x7ff8ec039530 2024-09-18T21:04:50.086 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.800+0000 7ff8f67fc640 1 -- 172.21.15.77:0/2417347648 <== mgr.14160 v2:172.21.15.77:6800/517401638 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7ff90005eb60 con 0x7ff8ec039530 2024-09-18T21:04:50.086 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.803+0000 7ff907f4b640 1 -- 172.21.15.77:0/2417347648 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7ff8ec039530 msgr2=0x7ff8ec03b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:50.086 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.803+0000 7ff907f4b640 1 --2- 172.21.15.77:0/2417347648 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7ff8ec039530 0x7ff8ec03b9e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0006fd0 tx=0x7ff8f0006db0 comp rx=0 tx=0).stop 2024-09-18T21:04:50.086 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.803+0000 7ff907f4b640 1 -- 172.21.15.77:0/2417347648 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9001035c0 msgr2=0x7ff900110e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:50.086 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.803+0000 7ff907f4b640 1 --2- 172.21.15.77:0/2417347648 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9001035c0 0x7ff900110e30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc006a70 tx=0x7ff8fc0091d0 comp rx=0 tx=0).stop 2024-09-18T21:04:50.086 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.803+0000 7ff907f4b640 1 -- 172.21.15.77:0/2417347648 shutdown_connections 2024-09-18T21:04:50.086 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.803+0000 7ff907f4b640 1 --2- 172.21.15.77:0/2417347648 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7ff8ec039530 0x7ff8ec03b9e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:50.086 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.803+0000 7ff907f4b640 1 --2- 172.21.15.77:0/2417347648 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9001035c0 0x7ff900110e30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:50.086 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.803+0000 7ff907f4b640 1 -- 172.21.15.77:0/2417347648 >> 172.21.15.77:0/2417347648 conn(0x7ff9000fbdc0 msgr2=0x7ff9000fc990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:50.087 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.803+0000 7ff907f4b640 1 -- 172.21.15.77:0/2417347648 shutdown_connections 2024-09-18T21:04:50.087 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:48.803+0000 7ff907f4b640 1 -- 172.21.15.77:0/2417347648 wait complete. 2024-09-18T21:04:50.087 INFO:teuthology.orchestra.run.smithi077.stdout:Fetching dashboard port number... 2024-09-18T21:04:50.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:50 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/1410040764' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-18T21:04:51.163 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 8443 2024-09-18T21:04:51.163 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.449+0000 7fa3f5aa8640 1 Processor -- start 2024-09-18T21:04:51.163 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.450+0000 7fa3f5aa8640 1 -- start start 2024-09-18T21:04:51.163 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.450+0000 7fa3f5aa8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3f0076a90 0x7fa3f0104c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:51.163 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.450+0000 7fa3f5aa8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f0076ea0 con 0x7fa3f0076a90 2024-09-18T21:04:51.163 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.450+0000 7fa3ef7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3f0076a90 0x7fa3f0104c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:51.163 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.450+0000 7fa3ef7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3f0076a90 0x7fa3f0104c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33134/0 (socket says 172.21.15.77:33134) 2024-09-18T21:04:51.163 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.450+0000 7fa3ef7fe640 1 -- 172.21.15.77:0/3862328327 learned_addr learned my addr 172.21.15.77:0/3862328327 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:51.164 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.450+0000 7fa3ef7fe640 1 -- 172.21.15.77:0/3862328327 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f01051b0 con 0x7fa3f0076a90 2024-09-18T21:04:51.164 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.451+0000 7fa3ef7fe640 1 --2- 172.21.15.77:0/3862328327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3f0076a90 0x7fa3f0104c70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0009840 tx=0x7fa3e00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c51debc14a536b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:51.164 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.452+0000 7fa3eeffd640 1 -- 172.21.15.77:0/3862328327 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa3e0032440 con 0x7fa3f0076a90 2024-09-18T21:04:51.164 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.452+0000 7fa3eeffd640 1 -- 172.21.15.77:0/3862328327 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa3e0032a40 con 0x7fa3f0076a90 2024-09-18T21:04:51.164 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.452+0000 7fa3eeffd640 1 -- 172.21.15.77:0/3862328327 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa3e0031aa0 con 0x7fa3f0076a90 2024-09-18T21:04:51.164 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.452+0000 7fa3f5aa8640 1 -- 172.21.15.77:0/3862328327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3f0076a90 msgr2=0x7fa3f0104c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:51.164 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.452+0000 7fa3f5aa8640 1 --2- 172.21.15.77:0/3862328327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3f0076a90 0x7fa3f0104c70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0009840 tx=0x7fa3e00091d0 comp rx=0 tx=0).stop 2024-09-18T21:04:51.164 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.452+0000 7fa3f5aa8640 1 -- 172.21.15.77:0/3862328327 shutdown_connections 2024-09-18T21:04:51.164 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.452+0000 7fa3f5aa8640 1 --2- 172.21.15.77:0/3862328327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3f0076a90 0x7fa3f0104c70 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:51.164 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.452+0000 7fa3f5aa8640 1 -- 172.21.15.77:0/3862328327 >> 172.21.15.77:0/3862328327 conn(0x7fa3f00fc700 msgr2=0x7fa3f00feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:51.164 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.452+0000 7fa3f5aa8640 1 -- 172.21.15.77:0/3862328327 shutdown_connections 2024-09-18T21:04:51.165 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.452+0000 7fa3f5aa8640 1 -- 172.21.15.77:0/3862328327 wait complete. 2024-09-18T21:04:51.165 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.453+0000 7fa3f5aa8640 1 Processor -- start 2024-09-18T21:04:51.165 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.453+0000 7fa3f5aa8640 1 -- start start 2024-09-18T21:04:51.165 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.453+0000 7fa3f5aa8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3f0076a90 0x7fa3f0110e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:51.165 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.453+0000 7fa3f5aa8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f01113d0 con 0x7fa3f0076a90 2024-09-18T21:04:51.165 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.453+0000 7fa3ef7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3f0076a90 0x7fa3f0110e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:51.165 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.453+0000 7fa3ef7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3f0076a90 0x7fa3f0110e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33140/0 (socket says 172.21.15.77:33140) 2024-09-18T21:04:51.165 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.453+0000 7fa3ef7fe640 1 -- 172.21.15.77:0/1410040764 learned_addr learned my addr 172.21.15.77:0/1410040764 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:51.165 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.453+0000 7fa3ef7fe640 1 -- 172.21.15.77:0/1410040764 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e0009450 con 0x7fa3f0076a90 2024-09-18T21:04:51.165 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.453+0000 7fa3ef7fe640 1 --2- 172.21.15.77:0/1410040764 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3f0076a90 0x7fa3f0110e90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa3e00316a0 tx=0x7fa3e00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:51.166 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.454+0000 7fa3ecff9640 1 -- 172.21.15.77:0/1410040764 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa3e00327b0 con 0x7fa3f0076a90 2024-09-18T21:04:51.166 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.454+0000 7fa3ecff9640 1 -- 172.21.15.77:0/1410040764 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa3e003b8d0 con 0x7fa3f0076a90 2024-09-18T21:04:51.166 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.454+0000 7fa3f5aa8640 1 -- 172.21.15.77:0/1410040764 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3f0111630 con 0x7fa3f0076a90 2024-09-18T21:04:51.166 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.454+0000 7fa3ecff9640 1 -- 172.21.15.77:0/1410040764 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa3e003a780 con 0x7fa3f0076a90 2024-09-18T21:04:51.166 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.454+0000 7fa3f5aa8640 1 -- 172.21.15.77:0/1410040764 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3f0111fd0 con 0x7fa3f0076a90 2024-09-18T21:04:51.166 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.454+0000 7fa3ecff9640 1 -- 172.21.15.77:0/1410040764 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 12) v1 ==== 45520+0+0 (secure 0 0 0) 0x7fa3e0039040 con 0x7fa3f0076a90 2024-09-18T21:04:51.166 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.455+0000 7fa3ecff9640 1 --2- 172.21.15.77:0/1410040764 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7fa3dc0394e0 0x7fa3dc03b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:51.166 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.455+0000 7fa3f5aa8640 1 -- 172.21.15.77:0/1410040764 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3f0100300 con 0x7fa3f0076a90 2024-09-18T21:04:51.166 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.455+0000 7fa3ecff9640 1 -- 172.21.15.77:0/1410040764 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fa3e006cd60 con 0x7fa3f0076a90 2024-09-18T21:04:51.166 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.455+0000 7fa3e7fff640 1 --2- 172.21.15.77:0/1410040764 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7fa3dc0394e0 0x7fa3dc03b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:51.166 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.455+0000 7fa3e7fff640 1 --2- 172.21.15.77:0/1410040764 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7fa3dc0394e0 0x7fa3dc03b990 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8006fd0 tx=0x7fa3d8006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:51.167 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.459+0000 7fa3ecff9640 1 -- 172.21.15.77:0/1410040764 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa3e004b300 con 0x7fa3f0076a90 2024-09-18T21:04:51.167 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.615+0000 7fa3f5aa8640 1 -- 172.21.15.77:0/1410040764 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7fa3f004b720 con 0x7fa3f0076a90 2024-09-18T21:04:51.167 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.615+0000 7fa3ecff9640 1 -- 172.21.15.77:0/1410040764 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7fa3e003f020 con 0x7fa3f0076a90 2024-09-18T21:04:51.167 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.617+0000 7fa3f5aa8640 1 -- 172.21.15.77:0/1410040764 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7fa3dc0394e0 msgr2=0x7fa3dc03b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:51.167 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.617+0000 7fa3f5aa8640 1 --2- 172.21.15.77:0/1410040764 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7fa3dc0394e0 0x7fa3dc03b990 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8006fd0 tx=0x7fa3d8006db0 comp rx=0 tx=0).stop 2024-09-18T21:04:51.167 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.617+0000 7fa3f5aa8640 1 -- 172.21.15.77:0/1410040764 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3f0076a90 msgr2=0x7fa3f0110e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:51.167 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.617+0000 7fa3f5aa8640 1 --2- 172.21.15.77:0/1410040764 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3f0076a90 0x7fa3f0110e90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa3e00316a0 tx=0x7fa3e00091d0 comp rx=0 tx=0).stop 2024-09-18T21:04:51.167 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.617+0000 7fa3f5aa8640 1 -- 172.21.15.77:0/1410040764 shutdown_connections 2024-09-18T21:04:51.167 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.617+0000 7fa3f5aa8640 1 --2- 172.21.15.77:0/1410040764 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7fa3dc0394e0 0x7fa3dc03b990 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:51.167 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.617+0000 7fa3f5aa8640 1 --2- 172.21.15.77:0/1410040764 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3f0076a90 0x7fa3f0110e90 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:51.167 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.617+0000 7fa3f5aa8640 1 -- 172.21.15.77:0/1410040764 >> 172.21.15.77:0/1410040764 conn(0x7fa3f00fc700 msgr2=0x7fa3f00fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:51.168 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.617+0000 7fa3f5aa8640 1 -- 172.21.15.77:0/1410040764 shutdown_connections 2024-09-18T21:04:51.168 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:50.618+0000 7fa3f5aa8640 1 -- 172.21.15.77:0/1410040764 wait complete. 2024-09-18T21:04:51.169 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-18T21:04:51.169 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout disabled 2024-09-18T21:04:51.177 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-18T21:04:51.177 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout inactive 2024-09-18T21:04:51.177 INFO:teuthology.orchestra.run.smithi077.stdout:firewalld.service is not enabled 2024-09-18T21:04:51.177 INFO:teuthology.orchestra.run.smithi077.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-18T21:04:51.179 INFO:teuthology.orchestra.run.smithi077.stdout:Ceph Dashboard is now available at: 2024-09-18T21:04:51.179 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:04:51.179 INFO:teuthology.orchestra.run.smithi077.stdout: URL: https://smithi077.front.sepia.ceph.com:8443/ 2024-09-18T21:04:51.179 INFO:teuthology.orchestra.run.smithi077.stdout: User: admin 2024-09-18T21:04:51.179 INFO:teuthology.orchestra.run.smithi077.stdout: Password: 39z5jbaemy 2024-09-18T21:04:51.179 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:04:51.179 INFO:teuthology.orchestra.run.smithi077.stdout:Saving cluster configuration to /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/config directory 2024-09-18T21:04:51.180 INFO:teuthology.orchestra.run.smithi077.stdout:Enabling autotune for osd_memory_target 2024-09-18T21:04:52.253 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.567+0000 7f5c67d57640 1 Processor -- start 2024-09-18T21:04:52.253 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.567+0000 7f5c67d57640 1 -- start start 2024-09-18T21:04:52.253 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.567+0000 7f5c67d57640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c60103630 0x7f5c60103a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:52.253 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.567+0000 7f5c67d57640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c60103f80 con 0x7f5c60103630 2024-09-18T21:04:52.253 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.567+0000 7f5c65af3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c60103630 0x7f5c60103a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:52.253 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.567+0000 7f5c65af3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c60103630 0x7f5c60103a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33156/0 (socket says 172.21.15.77:33156) 2024-09-18T21:04:52.253 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.567+0000 7f5c65af3640 1 -- 172.21.15.77:0/3796121224 learned_addr learned my addr 172.21.15.77:0/3796121224 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:52.253 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.568+0000 7f5c65af3640 1 -- 172.21.15.77:0/3796121224 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c601040c0 con 0x7f5c60103630 2024-09-18T21:04:52.253 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.568+0000 7f5c65af3640 1 --2- 172.21.15.77:0/3796121224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c60103630 0x7f5c60103a40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c009840 tx=0x7f5c5c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c5993f1c8c427e server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:52.253 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.568+0000 7f5c64af1640 1 -- 172.21.15.77:0/3796121224 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c5c032440 con 0x7f5c60103630 2024-09-18T21:04:52.253 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.568+0000 7f5c64af1640 1 -- 172.21.15.77:0/3796121224 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5c5c032a40 con 0x7f5c60103630 2024-09-18T21:04:52.254 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.568+0000 7f5c64af1640 1 -- 172.21.15.77:0/3796121224 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c5c031a70 con 0x7f5c60103630 2024-09-18T21:04:52.254 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.569+0000 7f5c67d57640 1 -- 172.21.15.77:0/3796121224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c60103630 msgr2=0x7f5c60103a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:52.254 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.569+0000 7f5c67d57640 1 --2- 172.21.15.77:0/3796121224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c60103630 0x7f5c60103a40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c009840 tx=0x7f5c5c0091d0 comp rx=0 tx=0).stop 2024-09-18T21:04:52.254 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.569+0000 7f5c67d57640 1 -- 172.21.15.77:0/3796121224 shutdown_connections 2024-09-18T21:04:52.254 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.569+0000 7f5c67d57640 1 --2- 172.21.15.77:0/3796121224 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c60103630 0x7f5c60103a40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:52.254 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.569+0000 7f5c67d57640 1 -- 172.21.15.77:0/3796121224 >> 172.21.15.77:0/3796121224 conn(0x7f5c600fbd90 msgr2=0x7f5c600fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:52.254 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.569+0000 7f5c67d57640 1 -- 172.21.15.77:0/3796121224 shutdown_connections 2024-09-18T21:04:52.254 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.569+0000 7f5c67d57640 1 -- 172.21.15.77:0/3796121224 wait complete. 2024-09-18T21:04:52.254 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.569+0000 7f5c67d57640 1 Processor -- start 2024-09-18T21:04:52.254 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.570+0000 7f5c67d57640 1 -- start start 2024-09-18T21:04:52.254 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.570+0000 7f5c67d57640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c60103630 0x7f5c60110e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:52.254 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.570+0000 7f5c67d57640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c601113a0 con 0x7f5c60103630 2024-09-18T21:04:52.254 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.570+0000 7f5c65af3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c60103630 0x7f5c60110e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:52.254 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.570+0000 7f5c65af3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c60103630 0x7f5c60110e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33160/0 (socket says 172.21.15.77:33160) 2024-09-18T21:04:52.255 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.570+0000 7f5c65af3640 1 -- 172.21.15.77:0/1141908980 learned_addr learned my addr 172.21.15.77:0/1141908980 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:52.255 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.570+0000 7f5c65af3640 1 -- 172.21.15.77:0/1141908980 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c5c009450 con 0x7f5c60103630 2024-09-18T21:04:52.255 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.570+0000 7f5c65af3640 1 --2- 172.21.15.77:0/1141908980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c60103630 0x7f5c60110e60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c009420 tx=0x7f5c5c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:52.255 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.570+0000 7f5c567fc640 1 -- 172.21.15.77:0/1141908980 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c5c03c400 con 0x7f5c60103630 2024-09-18T21:04:52.255 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.570+0000 7f5c567fc640 1 -- 172.21.15.77:0/1141908980 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5c5c03ca00 con 0x7f5c60103630 2024-09-18T21:04:52.255 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.570+0000 7f5c567fc640 1 -- 172.21.15.77:0/1141908980 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c5c03a920 con 0x7f5c60103630 2024-09-18T21:04:52.255 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.570+0000 7f5c67d57640 1 -- 172.21.15.77:0/1141908980 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c601115a0 con 0x7f5c60103630 2024-09-18T21:04:52.255 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.570+0000 7f5c67d57640 1 -- 172.21.15.77:0/1141908980 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c60112080 con 0x7f5c60103630 2024-09-18T21:04:52.255 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.571+0000 7f5c567fc640 1 -- 172.21.15.77:0/1141908980 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 12) v1 ==== 45520+0+0 (secure 0 0 0) 0x7f5c5c03cb70 con 0x7f5c60103630 2024-09-18T21:04:52.255 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.571+0000 7f5c567fc640 1 --2- 172.21.15.77:0/1141908980 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f5c4c0394e0 0x7f5c4c03b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:52.255 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.571+0000 7f5c567fc640 1 -- 172.21.15.77:0/1141908980 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f5c5c06cf30 con 0x7f5c60103630 2024-09-18T21:04:52.255 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.571+0000 7f5c67d57640 1 -- 172.21.15.77:0/1141908980 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c600ffa10 con 0x7f5c60103630 2024-09-18T21:04:52.256 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.572+0000 7f5c652f2640 1 --2- 172.21.15.77:0/1141908980 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f5c4c0394e0 0x7f5c4c03b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:52.256 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.572+0000 7f5c652f2640 1 --2- 172.21.15.77:0/1141908980 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f5c4c0394e0 0x7f5c4c03b990 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5c50006fd0 tx=0x7f5c50006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:52.256 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.576+0000 7f5c567fc640 1 -- 172.21.15.77:0/1141908980 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5c5c037030 con 0x7f5c60103630 2024-09-18T21:04:52.256 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.669+0000 7f5c567fc640 1 -- 172.21.15.77:0/1141908980 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f5c5c03c560 con 0x7f5c60103630 2024-09-18T21:04:52.256 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.735+0000 7f5c67d57640 1 -- 172.21.15.77:0/1141908980 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f5c6004b720 con 0x7f5c60103630 2024-09-18T21:04:52.256 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.735+0000 7f5c567fc640 1 -- 172.21.15.77:0/1141908980 <== mon.0 v2:172.21.15.77:3300/0 8 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f5c5c046460 con 0x7f5c60103630 2024-09-18T21:04:52.256 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.737+0000 7f5c67d57640 1 -- 172.21.15.77:0/1141908980 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f5c4c0394e0 msgr2=0x7f5c4c03b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:52.256 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.737+0000 7f5c67d57640 1 --2- 172.21.15.77:0/1141908980 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f5c4c0394e0 0x7f5c4c03b990 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5c50006fd0 tx=0x7f5c50006db0 comp rx=0 tx=0).stop 2024-09-18T21:04:52.256 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.737+0000 7f5c67d57640 1 -- 172.21.15.77:0/1141908980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c60103630 msgr2=0x7f5c60110e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:52.256 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.737+0000 7f5c67d57640 1 --2- 172.21.15.77:0/1141908980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c60103630 0x7f5c60110e60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c009420 tx=0x7f5c5c0091d0 comp rx=0 tx=0).stop 2024-09-18T21:04:52.256 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.737+0000 7f5c67d57640 1 -- 172.21.15.77:0/1141908980 shutdown_connections 2024-09-18T21:04:52.256 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.737+0000 7f5c67d57640 1 --2- 172.21.15.77:0/1141908980 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f5c4c0394e0 0x7f5c4c03b990 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:52.257 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.737+0000 7f5c67d57640 1 --2- 172.21.15.77:0/1141908980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c60103630 0x7f5c60110e60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:52.257 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.737+0000 7f5c67d57640 1 -- 172.21.15.77:0/1141908980 >> 172.21.15.77:0/1141908980 conn(0x7f5c600fbd90 msgr2=0x7f5c600fc910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:52.257 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.737+0000 7f5c67d57640 1 -- 172.21.15.77:0/1141908980 shutdown_connections 2024-09-18T21:04:52.257 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:51.737+0000 7f5c67d57640 1 -- 172.21.15.77:0/1141908980 wait complete. 2024-09-18T21:04:52.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:52 smithi077 ceph-mon[27689]: mgrmap e13: smithi077.utkpjg(active, since 6s) 2024-09-18T21:04:53.426 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.622+0000 7f5173430640 1 Processor -- start 2024-09-18T21:04:53.427 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.622+0000 7f5173430640 1 -- start start 2024-09-18T21:04:53.427 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.623+0000 7f5173430640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f516c101f80 0x7f516c102390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:53.427 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.623+0000 7f5173430640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f516c1028d0 con 0x7f516c101f80 2024-09-18T21:04:53.427 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.623+0000 7f51711cc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f516c101f80 0x7f516c102390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:53.427 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.623+0000 7f51711cc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f516c101f80 0x7f516c102390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33174/0 (socket says 172.21.15.77:33174) 2024-09-18T21:04:53.427 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.623+0000 7f51711cc640 1 -- 172.21.15.77:0/3129234656 learned_addr learned my addr 172.21.15.77:0/3129234656 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:53.427 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.623+0000 7f51711cc640 1 -- 172.21.15.77:0/3129234656 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f516c102a10 con 0x7f516c101f80 2024-09-18T21:04:53.427 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.624+0000 7f51711cc640 1 --2- 172.21.15.77:0/3129234656 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f516c101f80 0x7f516c102390 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5168009840 tx=0x7f51680091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=111d15705461173a server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:53.427 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.624+0000 7f5163fff640 1 -- 172.21.15.77:0/3129234656 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5168032440 con 0x7f516c101f80 2024-09-18T21:04:53.427 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.624+0000 7f5163fff640 1 -- 172.21.15.77:0/3129234656 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5168032a40 con 0x7f516c101f80 2024-09-18T21:04:53.427 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.624+0000 7f5163fff640 1 -- 172.21.15.77:0/3129234656 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5168031a70 con 0x7f516c101f80 2024-09-18T21:04:53.427 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.624+0000 7f5173430640 1 -- 172.21.15.77:0/3129234656 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f516c101f80 msgr2=0x7f516c102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:53.428 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.624+0000 7f5173430640 1 --2- 172.21.15.77:0/3129234656 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f516c101f80 0x7f516c102390 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5168009840 tx=0x7f51680091d0 comp rx=0 tx=0).stop 2024-09-18T21:04:53.428 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.624+0000 7f5173430640 1 -- 172.21.15.77:0/3129234656 shutdown_connections 2024-09-18T21:04:53.428 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.624+0000 7f5173430640 1 --2- 172.21.15.77:0/3129234656 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f516c101f80 0x7f516c102390 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:53.428 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.624+0000 7f5173430640 1 -- 172.21.15.77:0/3129234656 >> 172.21.15.77:0/3129234656 conn(0x7f516c0fd7a0 msgr2=0x7f516c0ffbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:53.428 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.625+0000 7f5173430640 1 -- 172.21.15.77:0/3129234656 shutdown_connections 2024-09-18T21:04:53.428 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.625+0000 7f5173430640 1 -- 172.21.15.77:0/3129234656 wait complete. 2024-09-18T21:04:53.428 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.625+0000 7f5173430640 1 Processor -- start 2024-09-18T21:04:53.428 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.625+0000 7f5173430640 1 -- start start 2024-09-18T21:04:53.428 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.625+0000 7f5173430640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f516c101f80 0x7f516c110e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:53.428 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.625+0000 7f5173430640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f516c111360 con 0x7f516c101f80 2024-09-18T21:04:53.428 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.625+0000 7f51711cc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f516c101f80 0x7f516c110e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:53.428 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.625+0000 7f51711cc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f516c101f80 0x7f516c110e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33182/0 (socket says 172.21.15.77:33182) 2024-09-18T21:04:53.429 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.625+0000 7f51711cc640 1 -- 172.21.15.77:0/788693187 learned_addr learned my addr 172.21.15.77:0/788693187 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:53.429 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.626+0000 7f51711cc640 1 -- 172.21.15.77:0/788693187 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5168009450 con 0x7f516c101f80 2024-09-18T21:04:53.429 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.626+0000 7f51711cc640 1 --2- 172.21.15.77:0/788693187 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f516c101f80 0x7f516c110e20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5168009420 tx=0x7f51680091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:53.429 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.626+0000 7f5161ffb640 1 -- 172.21.15.77:0/788693187 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f516803c400 con 0x7f516c101f80 2024-09-18T21:04:53.429 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.626+0000 7f5161ffb640 1 -- 172.21.15.77:0/788693187 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f516803ca00 con 0x7f516c101f80 2024-09-18T21:04:53.429 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.626+0000 7f5173430640 1 -- 172.21.15.77:0/788693187 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f516c111560 con 0x7f516c101f80 2024-09-18T21:04:53.429 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.626+0000 7f5161ffb640 1 -- 172.21.15.77:0/788693187 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f516803a850 con 0x7f516c101f80 2024-09-18T21:04:53.429 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.626+0000 7f5173430640 1 -- 172.21.15.77:0/788693187 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f516c112040 con 0x7f516c101f80 2024-09-18T21:04:53.429 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.627+0000 7f5161ffb640 1 -- 172.21.15.77:0/788693187 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f516803ab10 con 0x7f516c101f80 2024-09-18T21:04:53.429 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.627+0000 7f5173430640 1 -- 172.21.15.77:0/788693187 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f516c1013e0 con 0x7f516c101f80 2024-09-18T21:04:53.429 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.627+0000 7f5161ffb640 1 --2- 172.21.15.77:0/788693187 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f5158039580 0x7f515803ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:53.429 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.627+0000 7f5161ffb640 1 -- 172.21.15.77:0/788693187 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f516806d0d0 con 0x7f516c101f80 2024-09-18T21:04:53.429 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.627+0000 7f51709cb640 1 --2- 172.21.15.77:0/788693187 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f5158039580 0x7f515803ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:53.429 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.628+0000 7f51709cb640 1 --2- 172.21.15.77:0/788693187 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f5158039580 0x7f515803ba30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f515c006fd0 tx=0x7f515c006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:53.429 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.632+0000 7f5161ffb640 1 -- 172.21.15.77:0/788693187 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5168030570 con 0x7f516c101f80 2024-09-18T21:04:53.430 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.869+0000 7f5173430640 1 -- 172.21.15.77:0/788693187 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f516c04b720 con 0x7f516c101f80 2024-09-18T21:04:53.430 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.871+0000 7f5161ffb640 1 -- 172.21.15.77:0/788693187 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v33)=0 set mgr/dashboard/cluster/status v33) v1 ==== 153+0+0 (secure 0 0 0) 0x7f5168037020 con 0x7f516c101f80 2024-09-18T21:04:53.430 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-18T21:04:53.430 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.873+0000 7f5173430640 1 -- 172.21.15.77:0/788693187 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f5158039580 msgr2=0x7f515803ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:53.430 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.873+0000 7f5173430640 1 --2- 172.21.15.77:0/788693187 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f5158039580 0x7f515803ba30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f515c006fd0 tx=0x7f515c006db0 comp rx=0 tx=0).stop 2024-09-18T21:04:53.430 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.873+0000 7f5173430640 1 -- 172.21.15.77:0/788693187 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f516c101f80 msgr2=0x7f516c110e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:53.430 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.873+0000 7f5173430640 1 --2- 172.21.15.77:0/788693187 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f516c101f80 0x7f516c110e20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5168009420 tx=0x7f51680091d0 comp rx=0 tx=0).stop 2024-09-18T21:04:53.430 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.873+0000 7f5173430640 1 -- 172.21.15.77:0/788693187 shutdown_connections 2024-09-18T21:04:53.430 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.873+0000 7f5173430640 1 --2- 172.21.15.77:0/788693187 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f5158039580 0x7f515803ba30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:53.430 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.873+0000 7f5173430640 1 --2- 172.21.15.77:0/788693187 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f516c101f80 0x7f516c110e20 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:53.430 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.873+0000 7f5173430640 1 -- 172.21.15.77:0/788693187 >> 172.21.15.77:0/788693187 conn(0x7f516c0fd7a0 msgr2=0x7f516c0fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:53.430 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.873+0000 7f5173430640 1 -- 172.21.15.77:0/788693187 shutdown_connections 2024-09-18T21:04:53.430 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-18T21:04:52.874+0000 7f5173430640 1 -- 172.21.15.77:0/788693187 wait complete. 2024-09-18T21:04:53.430 INFO:teuthology.orchestra.run.smithi077.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-18T21:04:53.430 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:04:53.430 INFO:teuthology.orchestra.run.smithi077.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-18T21:04:53.431 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:04:53.431 INFO:teuthology.orchestra.run.smithi077.stdout:Or, if you are only running a single cluster on this host: 2024-09-18T21:04:53.431 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:04:53.431 INFO:teuthology.orchestra.run.smithi077.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-18T21:04:53.431 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:04:53.431 INFO:teuthology.orchestra.run.smithi077.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-18T21:04:53.431 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:04:53.431 INFO:teuthology.orchestra.run.smithi077.stdout: ceph telemetry on 2024-09-18T21:04:53.431 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:04:53.431 INFO:teuthology.orchestra.run.smithi077.stdout:For more information see: 2024-09-18T21:04:53.431 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:04:53.431 INFO:teuthology.orchestra.run.smithi077.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2024-09-18T21:04:53.431 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:04:53.431 INFO:teuthology.orchestra.run.smithi077.stdout:Bootstrap complete. 2024-09-18T21:04:53.461 INFO:tasks.cephadm:Fetching config... 2024-09-18T21:04:53.462 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-18T21:04:53.462 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-18T21:04:53.478 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-18T21:04:53.478 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-18T21:04:53.478 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-18T21:04:53.533 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-18T21:04:53.533 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-18T21:04:53.533 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/keyring of=/dev/stdout 2024-09-18T21:04:53.598 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-18T21:04:53.599 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-18T21:04:53.599 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-18T21:04:53.655 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-18T21:04:53.655 DEBUG:teuthology.orchestra.run.smithi077:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCNplkfB8eduPPmZvn4q4VCSWfr2hUlxJcutxkUwh2xXw3f4+fhV166vZA0BxPkpjGKKBAr99gKWKw2yB1T1vYQWH99XkN96FFUMEKRl6tyQ97F6eg+9oZM+pJNLPl+lLaL2Y59ee7HPRJmvR/9436er9PMWwLVE+mmDjDZL8YEbVvMcynDtW+0voAvw4k17az0l42DQpb5dQFplF6ViuqVOCwXoDXS0JHD+peNJ4UVssEfgMIvT/fOc7gVXaDWbYA60diC5GzpmEAJMt7qoIlXJrvuyxqJhdCyelYlCOy5Eppwuk4FZVklYBd7UEk947UZKoj8sqEvWDk8L+9/W9CmeahrB+Tsg6ZU+tAI1oPXXq/FIZYYbekBJt16+1Y0nAHGxBBIq42+xnXFu4duu+IE3D5quRJiwHfUbTF4vEh/wKIBzAkLzBdsmjizZHIbeg36o0StWP9oUBDXVuW9os38D1xF1UUmX7zYTuANkIp+punA+sgEHtTnurcxpHDkOxk= ceph-5a76ec16-7601-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-18T21:04:53.731 INFO:teuthology.orchestra.run.smithi077.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCNplkfB8eduPPmZvn4q4VCSWfr2hUlxJcutxkUwh2xXw3f4+fhV166vZA0BxPkpjGKKBAr99gKWKw2yB1T1vYQWH99XkN96FFUMEKRl6tyQ97F6eg+9oZM+pJNLPl+lLaL2Y59ee7HPRJmvR/9436er9PMWwLVE+mmDjDZL8YEbVvMcynDtW+0voAvw4k17az0l42DQpb5dQFplF6ViuqVOCwXoDXS0JHD+peNJ4UVssEfgMIvT/fOc7gVXaDWbYA60diC5GzpmEAJMt7qoIlXJrvuyxqJhdCyelYlCOy5Eppwuk4FZVklYBd7UEk947UZKoj8sqEvWDk8L+9/W9CmeahrB+Tsg6ZU+tAI1oPXXq/FIZYYbekBJt16+1Y0nAHGxBBIq42+xnXFu4duu+IE3D5quRJiwHfUbTF4vEh/wKIBzAkLzBdsmjizZHIbeg36o0StWP9oUBDXVuW9os38D1xF1UUmX7zYTuANkIp+punA+sgEHtTnurcxpHDkOxk= ceph-5a76ec16-7601-11ef-bceb-c7b262605968 2024-09-18T21:04:53.754 DEBUG:teuthology.orchestra.run.smithi103:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCNplkfB8eduPPmZvn4q4VCSWfr2hUlxJcutxkUwh2xXw3f4+fhV166vZA0BxPkpjGKKBAr99gKWKw2yB1T1vYQWH99XkN96FFUMEKRl6tyQ97F6eg+9oZM+pJNLPl+lLaL2Y59ee7HPRJmvR/9436er9PMWwLVE+mmDjDZL8YEbVvMcynDtW+0voAvw4k17az0l42DQpb5dQFplF6ViuqVOCwXoDXS0JHD+peNJ4UVssEfgMIvT/fOc7gVXaDWbYA60diC5GzpmEAJMt7qoIlXJrvuyxqJhdCyelYlCOy5Eppwuk4FZVklYBd7UEk947UZKoj8sqEvWDk8L+9/W9CmeahrB+Tsg6ZU+tAI1oPXXq/FIZYYbekBJt16+1Y0nAHGxBBIq42+xnXFu4duu+IE3D5quRJiwHfUbTF4vEh/wKIBzAkLzBdsmjizZHIbeg36o0StWP9oUBDXVuW9os38D1xF1UUmX7zYTuANkIp+punA+sgEHtTnurcxpHDkOxk= ceph-5a76ec16-7601-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-18T21:04:53.800 INFO:teuthology.orchestra.run.smithi103.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCNplkfB8eduPPmZvn4q4VCSWfr2hUlxJcutxkUwh2xXw3f4+fhV166vZA0BxPkpjGKKBAr99gKWKw2yB1T1vYQWH99XkN96FFUMEKRl6tyQ97F6eg+9oZM+pJNLPl+lLaL2Y59ee7HPRJmvR/9436er9PMWwLVE+mmDjDZL8YEbVvMcynDtW+0voAvw4k17az0l42DQpb5dQFplF6ViuqVOCwXoDXS0JHD+peNJ4UVssEfgMIvT/fOc7gVXaDWbYA60diC5GzpmEAJMt7qoIlXJrvuyxqJhdCyelYlCOy5Eppwuk4FZVklYBd7UEk947UZKoj8sqEvWDk8L+9/W9CmeahrB+Tsg6ZU+tAI1oPXXq/FIZYYbekBJt16+1Y0nAHGxBBIq42+xnXFu4duu+IE3D5quRJiwHfUbTF4vEh/wKIBzAkLzBdsmjizZHIbeg36o0StWP9oUBDXVuW9os38D1xF1UUmX7zYTuANkIp+punA+sgEHtTnurcxpHDkOxk= ceph-5a76ec16-7601-11ef-bceb-c7b262605968 2024-09-18T21:04:53.812 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-18T21:04:54.054 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:04:54.175 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:53 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/788693187' entity='client.admin' 2024-09-18T21:04:56.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:56.223+0000 7ffbe949f640 1 -- 172.21.15.77:0/1177059080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffbe40fb6c0 msgr2=0x7ffbe40fbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:56.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:56.223+0000 7ffbe949f640 1 --2- 172.21.15.77:0/1177059080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffbe40fb6c0 0x7ffbe40fbad0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4004850 tx=0x7ffbd4009da0 comp rx=0 tx=0).stop 2024-09-18T21:04:56.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:56.223+0000 7ffbe949f640 1 -- 172.21.15.77:0/1177059080 shutdown_connections 2024-09-18T21:04:56.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:56.223+0000 7ffbe949f640 1 --2- 172.21.15.77:0/1177059080 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffbe40fb6c0 0x7ffbe40fbad0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:56.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:56.223+0000 7ffbe949f640 1 -- 172.21.15.77:0/1177059080 >> 172.21.15.77:0/1177059080 conn(0x7ffbe40f6010 msgr2=0x7ffbe40f8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:56.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:56.223+0000 7ffbe949f640 1 -- 172.21.15.77:0/1177059080 shutdown_connections 2024-09-18T21:04:56.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:56.223+0000 7ffbe949f640 1 -- 172.21.15.77:0/1177059080 wait complete. 2024-09-18T21:04:56.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:56.223+0000 7ffbe949f640 1 Processor -- start 2024-09-18T21:04:56.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:56.223+0000 7ffbe949f640 1 -- start start 2024-09-18T21:04:56.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:56.223+0000 7ffbe949f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffbe40fb6c0 0x7ffbe410b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:56.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:56.223+0000 7ffbe949f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe410bbe0 con 0x7ffbe40fb6c0 2024-09-18T21:04:56.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:56.224+0000 7ffbe2ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffbe40fb6c0 0x7ffbe410b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:56.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:56.224+0000 7ffbe2ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffbe40fb6c0 0x7ffbe410b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33202/0 (socket says 172.21.15.77:33202) 2024-09-18T21:04:56.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:56.224+0000 7ffbe2ffd640 1 -- 172.21.15.77:0/3356775083 learned_addr learned my addr 172.21.15.77:0/3356775083 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:56.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:56.224+0000 7ffbe2ffd640 1 -- 172.21.15.77:0/3356775083 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd4005040 con 0x7ffbe40fb6c0 2024-09-18T21:04:56.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:56.224+0000 7ffbe2ffd640 1 --2- 172.21.15.77:0/3356775083 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffbe40fb6c0 0x7ffbe410b6a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4009920 tx=0x7ffbd4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:56.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:56.224+0000 7ffbcb7fe640 1 -- 172.21.15.77:0/3356775083 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffbd4033630 con 0x7ffbe40fb6c0 2024-09-18T21:04:56.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:56.224+0000 7ffbcb7fe640 1 -- 172.21.15.77:0/3356775083 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ffbd4033c30 con 0x7ffbe40fb6c0 2024-09-18T21:04:56.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:56.224+0000 7ffbe949f640 1 -- 172.21.15.77:0/3356775083 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbe410bde0 con 0x7ffbe40fb6c0 2024-09-18T21:04:56.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:56.224+0000 7ffbcb7fe640 1 -- 172.21.15.77:0/3356775083 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffbd403dbc0 con 0x7ffbe40fb6c0 2024-09-18T21:04:56.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:56.224+0000 7ffbe949f640 1 -- 172.21.15.77:0/3356775083 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbe410c250 con 0x7ffbe40fb6c0 2024-09-18T21:04:56.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:56.225+0000 7ffbcb7fe640 1 -- 172.21.15.77:0/3356775083 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7ffbd4030020 con 0x7ffbe40fb6c0 2024-09-18T21:04:56.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:56.225+0000 7ffbe949f640 1 -- 172.21.15.77:0/3356775083 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbe405ed70 con 0x7ffbe40fb6c0 2024-09-18T21:04:56.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:56.225+0000 7ffbcb7fe640 1 --2- 172.21.15.77:0/3356775083 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7ffbcc0395d0 0x7ffbcc03ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:56.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:56.225+0000 7ffbcb7fe640 1 -- 172.21.15.77:0/3356775083 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ffbd406c770 con 0x7ffbe40fb6c0 2024-09-18T21:04:56.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:56.225+0000 7ffbe27fc640 1 --2- 172.21.15.77:0/3356775083 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7ffbcc0395d0 0x7ffbcc03ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:56.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:56.226+0000 7ffbe27fc640 1 --2- 172.21.15.77:0/3356775083 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7ffbcc0395d0 0x7ffbcc03ba80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ffbd8006fd0 tx=0x7ffbd8006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:56.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:56.230+0000 7ffbcb7fe640 1 -- 172.21.15.77:0/3356775083 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ffbd403b5a0 con 0x7ffbe40fb6c0 2024-09-18T21:04:56.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:56.390+0000 7ffbe949f640 1 -- 172.21.15.77:0/3356775083 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7ffbe410c250 con 0x7ffbe40fb6c0 2024-09-18T21:04:56.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:56.393+0000 7ffbcb7fe640 1 -- 172.21.15.77:0/3356775083 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7ffbd4045bd0 con 0x7ffbe40fb6c0 2024-09-18T21:04:56.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:56.395+0000 7ffbe949f640 1 -- 172.21.15.77:0/3356775083 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7ffbcc0395d0 msgr2=0x7ffbcc03ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:56.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:56.395+0000 7ffbe949f640 1 --2- 172.21.15.77:0/3356775083 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7ffbcc0395d0 0x7ffbcc03ba80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ffbd8006fd0 tx=0x7ffbd8006db0 comp rx=0 tx=0).stop 2024-09-18T21:04:56.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:56.395+0000 7ffbe949f640 1 -- 172.21.15.77:0/3356775083 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffbe40fb6c0 msgr2=0x7ffbe410b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:56.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:56.395+0000 7ffbe949f640 1 --2- 172.21.15.77:0/3356775083 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffbe40fb6c0 0x7ffbe410b6a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4009920 tx=0x7ffbd4009da0 comp rx=0 tx=0).stop 2024-09-18T21:04:56.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:56.395+0000 7ffbe949f640 1 -- 172.21.15.77:0/3356775083 shutdown_connections 2024-09-18T21:04:56.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:56.395+0000 7ffbe949f640 1 --2- 172.21.15.77:0/3356775083 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7ffbcc0395d0 0x7ffbcc03ba80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:56.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:56.395+0000 7ffbe949f640 1 --2- 172.21.15.77:0/3356775083 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffbe40fb6c0 0x7ffbe410b6a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:56.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:56.395+0000 7ffbe949f640 1 -- 172.21.15.77:0/3356775083 >> 172.21.15.77:0/3356775083 conn(0x7ffbe40f6010 msgr2=0x7ffbe40f68f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:56.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:56.395+0000 7ffbe949f640 1 -- 172.21.15.77:0/3356775083 shutdown_connections 2024-09-18T21:04:56.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:56.395+0000 7ffbe949f640 1 -- 172.21.15.77:0/3356775083 wait complete. 2024-09-18T21:04:57.043 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-18T21:04:57.043 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-18T21:04:57.337 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:04:57.596 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:57 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/3356775083' entity='client.admin' 2024-09-18T21:04:58.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:58.749+0000 7ffb37d90640 1 -- 172.21.15.77:0/3332819937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb300fd7f0 msgr2=0x7ffb300fdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:58.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:58.749+0000 7ffb37d90640 1 --2- 172.21.15.77:0/3332819937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb300fd7f0 0x7ffb300fdc00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c009bd0 tx=0x7ffb2c004d10 comp rx=0 tx=0).stop 2024-09-18T21:04:58.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:58.749+0000 7ffb37d90640 1 -- 172.21.15.77:0/3332819937 shutdown_connections 2024-09-18T21:04:58.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:58.749+0000 7ffb37d90640 1 --2- 172.21.15.77:0/3332819937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb300fd7f0 0x7ffb300fdc00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:58.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:58.749+0000 7ffb37d90640 1 -- 172.21.15.77:0/3332819937 >> 172.21.15.77:0/3332819937 conn(0x7ffb300f6010 msgr2=0x7ffb300f8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:58.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:58.750+0000 7ffb37d90640 1 -- 172.21.15.77:0/3332819937 shutdown_connections 2024-09-18T21:04:58.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:58.750+0000 7ffb37d90640 1 -- 172.21.15.77:0/3332819937 wait complete. 2024-09-18T21:04:58.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:58.750+0000 7ffb37d90640 1 Processor -- start 2024-09-18T21:04:58.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:58.750+0000 7ffb37d90640 1 -- start start 2024-09-18T21:04:58.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:58.750+0000 7ffb37d90640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb300fd7f0 0x7ffb3010c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:58.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:58.750+0000 7ffb37d90640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3010cc70 con 0x7ffb300fd7f0 2024-09-18T21:04:58.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:58.750+0000 7ffb35b2c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb300fd7f0 0x7ffb3010c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:58.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:58.750+0000 7ffb35b2c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb300fd7f0 0x7ffb3010c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33208/0 (socket says 172.21.15.77:33208) 2024-09-18T21:04:58.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:58.750+0000 7ffb35b2c640 1 -- 172.21.15.77:0/1725942698 learned_addr learned my addr 172.21.15.77:0/1725942698 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:04:58.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:58.751+0000 7ffb35b2c640 1 -- 172.21.15.77:0/1725942698 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb2c0098b0 con 0x7ffb300fd7f0 2024-09-18T21:04:58.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:58.751+0000 7ffb35b2c640 1 --2- 172.21.15.77:0/1725942698 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb300fd7f0 0x7ffb3010c730 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c003400 tx=0x7ffb2c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:58.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:58.751+0000 7ffb267fc640 1 -- 172.21.15.77:0/1725942698 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb2c032910 con 0x7ffb300fd7f0 2024-09-18T21:04:58.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:58.751+0000 7ffb267fc640 1 -- 172.21.15.77:0/1725942698 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ffb2c03d420 con 0x7ffb300fd7f0 2024-09-18T21:04:58.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:58.751+0000 7ffb37d90640 1 -- 172.21.15.77:0/1725942698 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb3010ce70 con 0x7ffb300fd7f0 2024-09-18T21:04:58.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:58.751+0000 7ffb267fc640 1 -- 172.21.15.77:0/1725942698 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb2c031590 con 0x7ffb300fd7f0 2024-09-18T21:04:58.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:58.751+0000 7ffb37d90640 1 -- 172.21.15.77:0/1725942698 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb3010da00 con 0x7ffb300fd7f0 2024-09-18T21:04:58.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:58.752+0000 7ffb267fc640 1 -- 172.21.15.77:0/1725942698 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7ffb2c02f030 con 0x7ffb300fd7f0 2024-09-18T21:04:58.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:58.752+0000 7ffb37d90640 1 -- 172.21.15.77:0/1725942698 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb301025d0 con 0x7ffb300fd7f0 2024-09-18T21:04:58.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:58.752+0000 7ffb267fc640 1 --2- 172.21.15.77:0/1725942698 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7ffb1c0395d0 0x7ffb1c03ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:04:58.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:58.752+0000 7ffb267fc640 1 -- 172.21.15.77:0/1725942698 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ffb2c06d860 con 0x7ffb300fd7f0 2024-09-18T21:04:58.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:58.752+0000 7ffb3532b640 1 --2- 172.21.15.77:0/1725942698 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7ffb1c0395d0 0x7ffb1c03ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:04:58.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:58.752+0000 7ffb3532b640 1 --2- 172.21.15.77:0/1725942698 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7ffb1c0395d0 0x7ffb1c03ba80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ffb20006fd0 tx=0x7ffb20006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:04:58.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:58.756+0000 7ffb267fc640 1 -- 172.21.15.77:0/1725942698 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ffb2c032c50 con 0x7ffb300fd7f0 2024-09-18T21:04:58.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:58.915+0000 7ffb37d90640 1 -- 172.21.15.77:0/1725942698 --> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb3010db90 con 0x7ffb1c0395d0 2024-09-18T21:04:58.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:58.920+0000 7ffb267fc640 1 -- 172.21.15.77:0/1725942698 <== mgr.14160 v2:172.21.15.77:6800/517401638 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7ffb3010db90 con 0x7ffb1c0395d0 2024-09-18T21:04:58.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:58.921+0000 7ffb37d90640 1 -- 172.21.15.77:0/1725942698 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7ffb1c0395d0 msgr2=0x7ffb1c03ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:58.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:58.921+0000 7ffb37d90640 1 --2- 172.21.15.77:0/1725942698 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7ffb1c0395d0 0x7ffb1c03ba80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ffb20006fd0 tx=0x7ffb20006db0 comp rx=0 tx=0).stop 2024-09-18T21:04:58.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:58.921+0000 7ffb37d90640 1 -- 172.21.15.77:0/1725942698 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb300fd7f0 msgr2=0x7ffb3010c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:04:58.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:58.921+0000 7ffb37d90640 1 --2- 172.21.15.77:0/1725942698 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb300fd7f0 0x7ffb3010c730 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c003400 tx=0x7ffb2c004d10 comp rx=0 tx=0).stop 2024-09-18T21:04:58.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:58.922+0000 7ffb37d90640 1 -- 172.21.15.77:0/1725942698 shutdown_connections 2024-09-18T21:04:58.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:58.922+0000 7ffb37d90640 1 --2- 172.21.15.77:0/1725942698 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7ffb1c0395d0 0x7ffb1c03ba80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:58.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:58.922+0000 7ffb37d90640 1 --2- 172.21.15.77:0/1725942698 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb300fd7f0 0x7ffb3010c730 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:04:58.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:58.922+0000 7ffb37d90640 1 -- 172.21.15.77:0/1725942698 >> 172.21.15.77:0/1725942698 conn(0x7ffb300f6010 msgr2=0x7ffb300f6880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:04:58.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:58.922+0000 7ffb37d90640 1 -- 172.21.15.77:0/1725942698 shutdown_connections 2024-09-18T21:04:58.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:04:58.922+0000 7ffb37d90640 1 -- 172.21.15.77:0/1725942698 wait complete. 2024-09-18T21:04:59.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:59 smithi077 ceph-mon[27689]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:04:59.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:59 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' 2024-09-18T21:04:59.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:59 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' 2024-09-18T21:04:59.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:59 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' 2024-09-18T21:04:59.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:59 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "who": "osd/host:smithi077", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:04:59.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:59 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:04:59.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:59 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:04:59.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:59 smithi077 ceph-mon[27689]: Updating smithi077:/etc/ceph/ceph.conf 2024-09-18T21:04:59.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:04:59 smithi077 ceph-mon[27689]: Updating smithi077:/var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T21:05:00.024 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi103 2024-09-18T21:05:00.024 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-18T21:05:00.024 DEBUG:teuthology.orchestra.run.smithi103:> dd of=/etc/ceph/ceph.conf 2024-09-18T21:05:00.045 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-18T21:05:00.045 DEBUG:teuthology.orchestra.run.smithi103:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-18T21:05:00.103 INFO:tasks.cephadm:Adding host smithi103 to orchestrator... 2024-09-18T21:05:00.103 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph orch host add smithi103 2024-09-18T21:05:00.351 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:05:01.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:01 smithi077 ceph-mon[27689]: Updating smithi077:/etc/ceph/ceph.client.admin.keyring 2024-09-18T21:05:01.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:01 smithi077 ceph-mon[27689]: Updating smithi077:/var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T21:05:01.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:01 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:01.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:01 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:01.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:01 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:01.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:01 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi077", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-18T21:05:01.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:01 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi077", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-18T21:05:01.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:01 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:05:01.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:01 smithi077 ceph-mon[27689]: Deploying daemon crash.smithi077 on smithi077 2024-09-18T21:05:02.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:02.860+0000 7f20d959e640 1 -- 172.21.15.77:0/4185391062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20d41010d0 msgr2=0x7f20d41014a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:05:02.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:02.860+0000 7f20d959e640 1 --2- 172.21.15.77:0/4185391062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20d41010d0 0x7f20d41014a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f20c4004850 tx=0x7f20c4009da0 comp rx=0 tx=0).stop 2024-09-18T21:05:02.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:02.860+0000 7f20d959e640 1 -- 172.21.15.77:0/4185391062 shutdown_connections 2024-09-18T21:05:02.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:02.860+0000 7f20d959e640 1 --2- 172.21.15.77:0/4185391062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20d41010d0 0x7f20d41014a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:05:02.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:02.860+0000 7f20d959e640 1 -- 172.21.15.77:0/4185391062 >> 172.21.15.77:0/4185391062 conn(0x7f20d40f6ca0 msgr2=0x7f20d40f90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:05:02.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:02.860+0000 7f20d959e640 1 -- 172.21.15.77:0/4185391062 shutdown_connections 2024-09-18T21:05:02.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:02.860+0000 7f20d959e640 1 -- 172.21.15.77:0/4185391062 wait complete. 2024-09-18T21:05:02.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:02.861+0000 7f20d959e640 1 Processor -- start 2024-09-18T21:05:02.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:02.861+0000 7f20d959e640 1 -- start start 2024-09-18T21:05:02.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:02.861+0000 7f20d959e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20d41010d0 0x7f20d4112770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:05:02.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:02.861+0000 7f20d959e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d4112cb0 con 0x7f20d41010d0 2024-09-18T21:05:02.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:02.861+0000 7f20d2ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20d41010d0 0x7f20d4112770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:05:02.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:02.861+0000 7f20d2ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20d41010d0 0x7f20d4112770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49610/0 (socket says 172.21.15.77:49610) 2024-09-18T21:05:02.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:02.861+0000 7f20d2ffd640 1 -- 172.21.15.77:0/1391368244 learned_addr learned my addr 172.21.15.77:0/1391368244 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:05:02.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:02.862+0000 7f20d2ffd640 1 -- 172.21.15.77:0/1391368244 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c4005040 con 0x7f20d41010d0 2024-09-18T21:05:02.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:02.862+0000 7f20d2ffd640 1 --2- 172.21.15.77:0/1391368244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20d41010d0 0x7f20d4112770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f20c4004820 tx=0x7f20c4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:05:02.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:02.862+0000 7f20bb7fe640 1 -- 172.21.15.77:0/1391368244 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f20c4033630 con 0x7f20d41010d0 2024-09-18T21:05:02.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:02.862+0000 7f20bb7fe640 1 -- 172.21.15.77:0/1391368244 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f20c4033c30 con 0x7f20d41010d0 2024-09-18T21:05:02.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:02.862+0000 7f20d959e640 1 -- 172.21.15.77:0/1391368244 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20d4112eb0 con 0x7f20d41010d0 2024-09-18T21:05:02.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:02.862+0000 7f20bb7fe640 1 -- 172.21.15.77:0/1391368244 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f20c403dcc0 con 0x7f20d41010d0 2024-09-18T21:05:02.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:02.862+0000 7f20d959e640 1 -- 172.21.15.77:0/1391368244 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20d4113320 con 0x7f20d41010d0 2024-09-18T21:05:02.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:02.863+0000 7f20bb7fe640 1 -- 172.21.15.77:0/1391368244 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f20c4030020 con 0x7f20d41010d0 2024-09-18T21:05:02.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:02.863+0000 7f20bb7fe640 1 --2- 172.21.15.77:0/1391368244 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f20bc039580 0x7f20bc03ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:05:02.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:02.863+0000 7f20d959e640 1 -- 172.21.15.77:0/1391368244 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20d40fc840 con 0x7f20d41010d0 2024-09-18T21:05:02.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:02.863+0000 7f20bb7fe640 1 -- 172.21.15.77:0/1391368244 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f20c406c8d0 con 0x7f20d41010d0 2024-09-18T21:05:02.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:02.863+0000 7f20d27fc640 1 --2- 172.21.15.77:0/1391368244 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f20bc039580 0x7f20bc03ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:05:02.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:02.863+0000 7f20d27fc640 1 --2- 172.21.15.77:0/1391368244 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f20bc039580 0x7f20bc03ba30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f20c8006fd0 tx=0x7f20c8006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:05:02.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:02.868+0000 7f20bb7fe640 1 -- 172.21.15.77:0/1391368244 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f20c403bd80 con 0x7f20d41010d0 2024-09-18T21:05:03.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:03.046+0000 7f20d959e640 1 -- 172.21.15.77:0/1391368244 --> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi103", "target": ["mon-mgr", ""]}) v1 -- 0x7f20d404b720 con 0x7f20bc039580 2024-09-18T21:05:04.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:04 smithi077 ceph-mon[27689]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi103", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:05:04.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:04 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:04.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:04 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:04.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:04 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:04.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:04 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:04.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:04 smithi077 ceph-mon[27689]: Deploying daemon node-exporter.smithi077 on smithi077 2024-09-18T21:05:05.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:05 smithi077 ceph-mon[27689]: Deploying cephadm binary to smithi103 2024-09-18T21:05:05.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:05 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:05.858 INFO:teuthology.orchestra.run.smithi077.stdout:Added host 'smithi103' with addr '172.21.15.103' 2024-09-18T21:05:05.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:05.855+0000 7f20bb7fe640 1 -- 172.21.15.77:0/1391368244 <== mgr.14160 v2:172.21.15.77:6800/517401638 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f20d404b720 con 0x7f20bc039580 2024-09-18T21:05:05.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:05.857+0000 7f20d959e640 1 -- 172.21.15.77:0/1391368244 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f20bc039580 msgr2=0x7f20bc03ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:05:05.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:05.857+0000 7f20d959e640 1 --2- 172.21.15.77:0/1391368244 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f20bc039580 0x7f20bc03ba30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f20c8006fd0 tx=0x7f20c8006db0 comp rx=0 tx=0).stop 2024-09-18T21:05:05.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:05.857+0000 7f20d959e640 1 -- 172.21.15.77:0/1391368244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20d41010d0 msgr2=0x7f20d4112770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:05:05.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:05.857+0000 7f20d959e640 1 --2- 172.21.15.77:0/1391368244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20d41010d0 0x7f20d4112770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f20c4004820 tx=0x7f20c4009da0 comp rx=0 tx=0).stop 2024-09-18T21:05:05.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:05.857+0000 7f20d959e640 1 -- 172.21.15.77:0/1391368244 shutdown_connections 2024-09-18T21:05:05.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:05.857+0000 7f20d959e640 1 --2- 172.21.15.77:0/1391368244 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f20bc039580 0x7f20bc03ba30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:05:05.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:05.857+0000 7f20d959e640 1 --2- 172.21.15.77:0/1391368244 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20d41010d0 0x7f20d4112770 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:05:05.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:05.857+0000 7f20d959e640 1 -- 172.21.15.77:0/1391368244 >> 172.21.15.77:0/1391368244 conn(0x7f20d40f6ca0 msgr2=0x7f20d4065800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:05:05.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:05.857+0000 7f20d959e640 1 -- 172.21.15.77:0/1391368244 shutdown_connections 2024-09-18T21:05:05.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:05.857+0000 7f20d959e640 1 -- 172.21.15.77:0/1391368244 wait complete. 2024-09-18T21:05:06.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:06 smithi077 ceph-mon[27689]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:05:06.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:06 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:07.007 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-18T21:05:07.454 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:05:07.578 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:07 smithi077 ceph-mon[27689]: Added host smithi103 2024-09-18T21:05:07.578 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:07 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:08.594 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:08 smithi077 ceph-mon[27689]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:05:08.594 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:08 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:08.594 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:08 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:08.594 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:08 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:08.594 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:08 smithi077 ceph-mon[27689]: Deploying daemon alertmanager.smithi077 on smithi077 2024-09-18T21:05:08.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:08.782+0000 7f73ee8bf640 1 -- 172.21.15.77:0/1553548331 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73e8101100 msgr2=0x7f73e81014d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:05:08.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:08.782+0000 7f73ee8bf640 1 --2- 172.21.15.77:0/1553548331 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73e8101100 0x7f73e81014d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f73d8004850 tx=0x7f73d8009da0 comp rx=0 tx=0).stop 2024-09-18T21:05:08.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:08.782+0000 7f73ee8bf640 1 -- 172.21.15.77:0/1553548331 shutdown_connections 2024-09-18T21:05:08.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:08.782+0000 7f73ee8bf640 1 --2- 172.21.15.77:0/1553548331 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73e8101100 0x7f73e81014d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:05:08.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:08.782+0000 7f73ee8bf640 1 -- 172.21.15.77:0/1553548331 >> 172.21.15.77:0/1553548331 conn(0x7f73e80f6cd0 msgr2=0x7f73e80f90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:05:08.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:08.782+0000 7f73ee8bf640 1 -- 172.21.15.77:0/1553548331 shutdown_connections 2024-09-18T21:05:08.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:08.782+0000 7f73ee8bf640 1 -- 172.21.15.77:0/1553548331 wait complete. 2024-09-18T21:05:08.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:08.783+0000 7f73ee8bf640 1 Processor -- start 2024-09-18T21:05:08.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:08.783+0000 7f73ee8bf640 1 -- start start 2024-09-18T21:05:08.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:08.783+0000 7f73ee8bf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73e8101100 0x7f73e8112790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:05:08.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:08.783+0000 7f73ee8bf640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e8112cd0 con 0x7f73e8101100 2024-09-18T21:05:08.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:08.783+0000 7f73e7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73e8101100 0x7f73e8112790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:05:08.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:08.783+0000 7f73e7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73e8101100 0x7f73e8112790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49634/0 (socket says 172.21.15.77:49634) 2024-09-18T21:05:08.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:08.783+0000 7f73e7fff640 1 -- 172.21.15.77:0/1363132221 learned_addr learned my addr 172.21.15.77:0/1363132221 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:05:08.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:08.783+0000 7f73e7fff640 1 -- 172.21.15.77:0/1363132221 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d8005040 con 0x7f73e8101100 2024-09-18T21:05:08.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:08.784+0000 7f73e7fff640 1 --2- 172.21.15.77:0/1363132221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73e8101100 0x7f73e8112790 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f73d802a6d0 tx=0x7f73d8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:05:08.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:08.784+0000 7f73e4ff9640 1 -- 172.21.15.77:0/1363132221 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f73d802cf10 con 0x7f73e8101100 2024-09-18T21:05:08.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:08.784+0000 7f73e4ff9640 1 -- 172.21.15.77:0/1363132221 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f73d8033ad0 con 0x7f73e8101100 2024-09-18T21:05:08.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:08.784+0000 7f73e4ff9640 1 -- 172.21.15.77:0/1363132221 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f73d803ebb0 con 0x7f73e8101100 2024-09-18T21:05:08.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:08.784+0000 7f73ee8bf640 1 -- 172.21.15.77:0/1363132221 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73e8112ed0 con 0x7f73e8101100 2024-09-18T21:05:08.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:08.784+0000 7f73ee8bf640 1 -- 172.21.15.77:0/1363132221 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73e81133a0 con 0x7f73e8101100 2024-09-18T21:05:08.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:08.785+0000 7f73e4ff9640 1 -- 172.21.15.77:0/1363132221 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f73d8030020 con 0x7f73e8101100 2024-09-18T21:05:08.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:08.785+0000 7f73ee8bf640 1 -- 172.21.15.77:0/1363132221 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73e80fc870 con 0x7f73e8101100 2024-09-18T21:05:08.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:08.785+0000 7f73e4ff9640 1 --2- 172.21.15.77:0/1363132221 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f73d0039580 0x7f73d003ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:05:08.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:08.785+0000 7f73e4ff9640 1 -- 172.21.15.77:0/1363132221 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f73d806c350 con 0x7f73e8101100 2024-09-18T21:05:08.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:08.785+0000 7f73e77fe640 1 --2- 172.21.15.77:0/1363132221 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f73d0039580 0x7f73d003ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:05:08.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:08.785+0000 7f73e77fe640 1 --2- 172.21.15.77:0/1363132221 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f73d0039580 0x7f73d003ba30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f73dc006fd0 tx=0x7f73dc006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:05:08.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:08.789+0000 7f73e4ff9640 1 -- 172.21.15.77:0/1363132221 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f73d803c930 con 0x7f73e8101100 2024-09-18T21:05:08.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:08.951+0000 7f73ee8bf640 1 -- 172.21.15.77:0/1363132221 --> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f73e81133a0 con 0x7f73d0039580 2024-09-18T21:05:08.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:08.952+0000 7f73e4ff9640 1 -- 172.21.15.77:0/1363132221 <== mgr.14160 v2:172.21.15.77:6800/517401638 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7f73e81133a0 con 0x7f73d0039580 2024-09-18T21:05:08.952 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:05:08.952 INFO:teuthology.orchestra.run.smithi077.stdout:[{"addr": "172.21.15.77", "hostname": "smithi077", "labels": [], "status": ""}, {"addr": "172.21.15.103", "hostname": "smithi103", "labels": [], "status": ""}] 2024-09-18T21:05:08.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:08.953+0000 7f73ee8bf640 1 -- 172.21.15.77:0/1363132221 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f73d0039580 msgr2=0x7f73d003ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:05:08.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:08.953+0000 7f73ee8bf640 1 --2- 172.21.15.77:0/1363132221 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f73d0039580 0x7f73d003ba30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f73dc006fd0 tx=0x7f73dc006db0 comp rx=0 tx=0).stop 2024-09-18T21:05:08.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:08.953+0000 7f73ee8bf640 1 -- 172.21.15.77:0/1363132221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73e8101100 msgr2=0x7f73e8112790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:05:08.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:08.953+0000 7f73ee8bf640 1 --2- 172.21.15.77:0/1363132221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73e8101100 0x7f73e8112790 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f73d802a6d0 tx=0x7f73d8009da0 comp rx=0 tx=0).stop 2024-09-18T21:05:08.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:08.953+0000 7f73ee8bf640 1 -- 172.21.15.77:0/1363132221 shutdown_connections 2024-09-18T21:05:08.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:08.953+0000 7f73ee8bf640 1 --2- 172.21.15.77:0/1363132221 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f73d0039580 0x7f73d003ba30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:05:08.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:08.953+0000 7f73ee8bf640 1 --2- 172.21.15.77:0/1363132221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73e8101100 0x7f73e8112790 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:05:08.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:08.954+0000 7f73ee8bf640 1 -- 172.21.15.77:0/1363132221 >> 172.21.15.77:0/1363132221 conn(0x7f73e80f6cd0 msgr2=0x7f73e80657c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:05:08.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:08.954+0000 7f73ee8bf640 1 -- 172.21.15.77:0/1363132221 shutdown_connections 2024-09-18T21:05:08.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:08.954+0000 7f73ee8bf640 1 -- 172.21.15.77:0/1363132221 wait complete. 2024-09-18T21:05:09.767 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-18T21:05:09.767 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-18T21:05:10.008 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:05:10.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:10 smithi077 ceph-mon[27689]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:05:10.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:10 smithi077 ceph-mon[27689]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-18T21:05:10.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:10 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:12.620 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:12 smithi077 ceph-mon[27689]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:05:12.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:12.696+0000 7f033d3f9640 1 -- 172.21.15.77:0/270563239 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03381021e0 msgr2=0x7f03381025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:05:12.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:12.696+0000 7f033d3f9640 1 --2- 172.21.15.77:0/270563239 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03381021e0 0x7f03381025b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0328004850 tx=0x7f0328009da0 comp rx=0 tx=0).stop 2024-09-18T21:05:12.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:12.696+0000 7f033d3f9640 1 -- 172.21.15.77:0/270563239 shutdown_connections 2024-09-18T21:05:12.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:12.696+0000 7f033d3f9640 1 --2- 172.21.15.77:0/270563239 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03381021e0 0x7f03381025b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:05:12.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:12.696+0000 7f033d3f9640 1 -- 172.21.15.77:0/270563239 >> 172.21.15.77:0/270563239 conn(0x7f03380f7d90 msgr2=0x7f03380fa1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:05:12.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:12.696+0000 7f033d3f9640 1 -- 172.21.15.77:0/270563239 shutdown_connections 2024-09-18T21:05:12.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:12.696+0000 7f033d3f9640 1 -- 172.21.15.77:0/270563239 wait complete. 2024-09-18T21:05:12.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:12.697+0000 7f033d3f9640 1 Processor -- start 2024-09-18T21:05:12.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:12.697+0000 7f033d3f9640 1 -- start start 2024-09-18T21:05:12.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:12.697+0000 7f033d3f9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03381021e0 0x7f0338112780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:05:12.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:12.697+0000 7f033d3f9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0338112cc0 con 0x7f03381021e0 2024-09-18T21:05:12.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:12.697+0000 7f0336ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03381021e0 0x7f0338112780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:05:12.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:12.697+0000 7f0336ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03381021e0 0x7f0338112780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41358/0 (socket says 172.21.15.77:41358) 2024-09-18T21:05:12.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:12.697+0000 7f0336ffd640 1 -- 172.21.15.77:0/1766678018 learned_addr learned my addr 172.21.15.77:0/1766678018 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:05:12.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:12.698+0000 7f0336ffd640 1 -- 172.21.15.77:0/1766678018 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0328005040 con 0x7f03381021e0 2024-09-18T21:05:12.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:12.698+0000 7f0336ffd640 1 --2- 172.21.15.77:0/1766678018 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03381021e0 0x7f0338112780 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f032802a6d0 tx=0x7f0328009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:05:12.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:12.698+0000 7f032ffff640 1 -- 172.21.15.77:0/1766678018 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f032802cf10 con 0x7f03381021e0 2024-09-18T21:05:12.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:12.698+0000 7f032ffff640 1 -- 172.21.15.77:0/1766678018 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0328033ad0 con 0x7f03381021e0 2024-09-18T21:05:12.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:12.698+0000 7f033d3f9640 1 -- 172.21.15.77:0/1766678018 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0338112ec0 con 0x7f03381021e0 2024-09-18T21:05:12.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:12.698+0000 7f032ffff640 1 -- 172.21.15.77:0/1766678018 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f032803ebb0 con 0x7f03381021e0 2024-09-18T21:05:12.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:12.698+0000 7f033d3f9640 1 -- 172.21.15.77:0/1766678018 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0338113390 con 0x7f03381021e0 2024-09-18T21:05:12.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:12.699+0000 7f032ffff640 1 -- 172.21.15.77:0/1766678018 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f0328030020 con 0x7f03381021e0 2024-09-18T21:05:12.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:12.699+0000 7f033d3f9640 1 -- 172.21.15.77:0/1766678018 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03380fd950 con 0x7f03381021e0 2024-09-18T21:05:12.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:12.699+0000 7f032ffff640 1 --2- 172.21.15.77:0/1766678018 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f03240395d0 0x7f032403ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:05:12.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:12.699+0000 7f032ffff640 1 -- 172.21.15.77:0/1766678018 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f032806c320 con 0x7f03381021e0 2024-09-18T21:05:12.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:12.699+0000 7f032e7fc640 1 --2- 172.21.15.77:0/1766678018 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f03240395d0 0x7f032403ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:05:12.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:12.700+0000 7f032e7fc640 1 --2- 172.21.15.77:0/1766678018 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f03240395d0 0x7f032403ba80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0320006fd0 tx=0x7f0320006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:05:12.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:12.703+0000 7f032ffff640 1 -- 172.21.15.77:0/1766678018 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0328033630 con 0x7f03381021e0 2024-09-18T21:05:12.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:12.865+0000 7f033d3f9640 1 -- 172.21.15.77:0/1766678018 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f0338113390 con 0x7f03381021e0 2024-09-18T21:05:13.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:13.457+0000 7f032ffff640 1 -- 172.21.15.77:0/1766678018 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f0338113390 con 0x7f03381021e0 2024-09-18T21:05:13.458 INFO:teuthology.orchestra.run.smithi077.stderr:adjusted tunables profile to default 2024-09-18T21:05:13.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:13.460+0000 7f033d3f9640 1 -- 172.21.15.77:0/1766678018 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f03240395d0 msgr2=0x7f032403ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:05:13.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:13.460+0000 7f033d3f9640 1 --2- 172.21.15.77:0/1766678018 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f03240395d0 0x7f032403ba80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0320006fd0 tx=0x7f0320006db0 comp rx=0 tx=0).stop 2024-09-18T21:05:13.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:13.460+0000 7f033d3f9640 1 -- 172.21.15.77:0/1766678018 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03381021e0 msgr2=0x7f0338112780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:05:13.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:13.460+0000 7f033d3f9640 1 --2- 172.21.15.77:0/1766678018 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03381021e0 0x7f0338112780 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f032802a6d0 tx=0x7f0328009da0 comp rx=0 tx=0).stop 2024-09-18T21:05:13.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:13.460+0000 7f033d3f9640 1 -- 172.21.15.77:0/1766678018 shutdown_connections 2024-09-18T21:05:13.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:13.460+0000 7f033d3f9640 1 --2- 172.21.15.77:0/1766678018 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f03240395d0 0x7f032403ba80 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:05:13.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:13.460+0000 7f033d3f9640 1 --2- 172.21.15.77:0/1766678018 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03381021e0 0x7f0338112780 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:05:13.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:13.460+0000 7f033d3f9640 1 -- 172.21.15.77:0/1766678018 >> 172.21.15.77:0/1766678018 conn(0x7f03380f7d90 msgr2=0x7f03380f95a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:05:13.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:13.460+0000 7f033d3f9640 1 -- 172.21.15.77:0/1766678018 shutdown_connections 2024-09-18T21:05:13.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:05:13.460+0000 7f033d3f9640 1 -- 172.21.15.77:0/1766678018 wait complete. 2024-09-18T21:05:13.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:13 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/1766678018' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-18T21:05:14.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:14 smithi077 ceph-mon[27689]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:05:14.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:14 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/1766678018' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-18T21:05:14.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:14 smithi077 ceph-mon[27689]: osdmap e4: 0 total, 0 up, 0 in 2024-09-18T21:05:15.659 INFO:tasks.cephadm:Adding mon.smithi077 on smithi077 2024-09-18T21:05:15.660 INFO:tasks.cephadm:Adding mon.smithi103 on smithi103 2024-09-18T21:05:15.660 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph orch apply mon '2;smithi077:172.21.15.77=smithi077;smithi103:172.21.15.103=smithi103' 2024-09-18T21:05:15.903 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T21:05:15.946 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T21:05:16.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:16 smithi077 ceph-mon[27689]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:05:17.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:17.473+0000 7ff6f788b640 1 -- 172.21.15.103:0/3468072553 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6f00fd820 msgr2=0x7ff6f00fdc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:05:17.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:17.473+0000 7ff6f788b640 1 --2- 172.21.15.103:0/3468072553 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6f00fd820 0x7ff6f00fdc30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec004850 tx=0x7ff6ec009da0 comp rx=0 tx=0).stop 2024-09-18T21:05:17.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:17.473+0000 7ff6f788b640 1 -- 172.21.15.103:0/3468072553 shutdown_connections 2024-09-18T21:05:17.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:17.473+0000 7ff6f788b640 1 --2- 172.21.15.103:0/3468072553 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6f00fd820 0x7ff6f00fdc30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:05:17.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:17.473+0000 7ff6f788b640 1 -- 172.21.15.103:0/3468072553 >> 172.21.15.103:0/3468072553 conn(0x7ff6f00f6040 msgr2=0x7ff6f00f8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:05:17.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:17.473+0000 7ff6f788b640 1 -- 172.21.15.103:0/3468072553 shutdown_connections 2024-09-18T21:05:17.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:17.473+0000 7ff6f788b640 1 -- 172.21.15.103:0/3468072553 wait complete. 2024-09-18T21:05:17.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:17.474+0000 7ff6f788b640 1 Processor -- start 2024-09-18T21:05:17.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:17.474+0000 7ff6f788b640 1 -- start start 2024-09-18T21:05:17.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:17.474+0000 7ff6f788b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6f00fd820 0x7ff6f010c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:05:17.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:17.474+0000 7ff6f788b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f010cc20 con 0x7ff6f00fd820 2024-09-18T21:05:17.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:17.474+0000 7ff6f5627640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6f00fd820 0x7ff6f010c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:05:17.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:17.474+0000 7ff6f5627640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6f00fd820 0x7ff6f010c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.103:43970/0 (socket says 172.21.15.103:43970) 2024-09-18T21:05:17.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:17.474+0000 7ff6f5627640 1 -- 172.21.15.103:0/583438054 learned_addr learned my addr 172.21.15.103:0/583438054 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-18T21:05:17.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:17.474+0000 7ff6f5627640 1 -- 172.21.15.103:0/583438054 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ec005040 con 0x7ff6f00fd820 2024-09-18T21:05:17.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:17.475+0000 7ff6f5627640 1 --2- 172.21.15.103:0/583438054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6f00fd820 0x7ff6f010c6e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec009920 tx=0x7ff6ec009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:05:17.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:17.475+0000 7ff6e1ffb640 1 -- 172.21.15.103:0/583438054 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff6ec033630 con 0x7ff6f00fd820 2024-09-18T21:05:17.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:17.475+0000 7ff6f788b640 1 -- 172.21.15.103:0/583438054 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6f010ce20 con 0x7ff6f00fd820 2024-09-18T21:05:17.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:17.475+0000 7ff6e1ffb640 1 -- 172.21.15.103:0/583438054 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff6ec033c30 con 0x7ff6f00fd820 2024-09-18T21:05:17.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:17.475+0000 7ff6e1ffb640 1 -- 172.21.15.103:0/583438054 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff6ec03dc40 con 0x7ff6f00fd820 2024-09-18T21:05:17.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:17.475+0000 7ff6f788b640 1 -- 172.21.15.103:0/583438054 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6f010d290 con 0x7ff6f00fd820 2024-09-18T21:05:17.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:17.476+0000 7ff6e1ffb640 1 -- 172.21.15.103:0/583438054 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7ff6ec030020 con 0x7ff6f00fd820 2024-09-18T21:05:17.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:17.476+0000 7ff6f788b640 1 -- 172.21.15.103:0/583438054 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6f005ed70 con 0x7ff6f00fd820 2024-09-18T21:05:17.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:17.476+0000 7ff6e1ffb640 1 --2- 172.21.15.103:0/583438054 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7ff6dc039580 0x7ff6dc03ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:05:17.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:17.476+0000 7ff6e1ffb640 1 -- 172.21.15.103:0/583438054 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff6ec06c8e0 con 0x7ff6f00fd820 2024-09-18T21:05:17.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:17.476+0000 7ff6f4e26640 1 --2- 172.21.15.103:0/583438054 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7ff6dc039580 0x7ff6dc03ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:05:17.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:17.477+0000 7ff6f4e26640 1 --2- 172.21.15.103:0/583438054 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7ff6dc039580 0x7ff6dc03ba30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4006fd0 tx=0x7ff6e4006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:05:17.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:17.481+0000 7ff6e1ffb640 1 -- 172.21.15.103:0/583438054 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff6ec045800 con 0x7ff6f00fd820 2024-09-18T21:05:17.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:17.642+0000 7ff6f788b640 1 -- 172.21.15.103:0/583438054 --> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi077:172.21.15.77=smithi077;smithi103:172.21.15.103=smithi103", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6f010e3a0 con 0x7ff6dc039580 2024-09-18T21:05:17.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:17.649+0000 7ff6e1ffb640 1 -- 172.21.15.103:0/583438054 <== mgr.14160 v2:172.21.15.77:6800/517401638 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7ff6f010e3a0 con 0x7ff6dc039580 2024-09-18T21:05:17.649 INFO:teuthology.orchestra.run.smithi103.stdout:Scheduled mon update... 2024-09-18T21:05:17.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:17.650+0000 7ff6f788b640 1 -- 172.21.15.103:0/583438054 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7ff6dc039580 msgr2=0x7ff6dc03ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:05:17.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:17.650+0000 7ff6f788b640 1 --2- 172.21.15.103:0/583438054 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7ff6dc039580 0x7ff6dc03ba30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4006fd0 tx=0x7ff6e4006db0 comp rx=0 tx=0).stop 2024-09-18T21:05:17.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:17.650+0000 7ff6f788b640 1 -- 172.21.15.103:0/583438054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6f00fd820 msgr2=0x7ff6f010c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:05:17.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:17.651+0000 7ff6f788b640 1 --2- 172.21.15.103:0/583438054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6f00fd820 0x7ff6f010c6e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec009920 tx=0x7ff6ec009da0 comp rx=0 tx=0).stop 2024-09-18T21:05:17.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:17.651+0000 7ff6f788b640 1 -- 172.21.15.103:0/583438054 shutdown_connections 2024-09-18T21:05:17.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:17.651+0000 7ff6f788b640 1 --2- 172.21.15.103:0/583438054 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7ff6dc039580 0x7ff6dc03ba30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:05:17.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:17.651+0000 7ff6f788b640 1 --2- 172.21.15.103:0/583438054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6f00fd820 0x7ff6f010c6e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:05:17.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:17.651+0000 7ff6f788b640 1 -- 172.21.15.103:0/583438054 >> 172.21.15.103:0/583438054 conn(0x7ff6f00f6040 msgr2=0x7ff6f00f6850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:05:17.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:17.651+0000 7ff6f788b640 1 -- 172.21.15.103:0/583438054 shutdown_connections 2024-09-18T21:05:17.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:17.651+0000 7ff6f788b640 1 -- 172.21.15.103:0/583438054 wait complete. 2024-09-18T21:05:18.267 DEBUG:teuthology.orchestra.run.smithi103:mon.smithi103> sudo journalctl -f -n 0 -u ceph-5a76ec16-7601-11ef-bceb-c7b262605968@mon.smithi103.service 2024-09-18T21:05:18.269 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T21:05:18.270 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T21:05:18.537 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T21:05:18.582 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T21:05:18.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:18 smithi077 ceph-mon[27689]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:05:18.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:18 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:18.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:18 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:18.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:18 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:18.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:18 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:18.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:18 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:18.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:18 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:18.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:18 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-18T21:05:18.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:18 smithi077 ceph-mon[27689]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-18T21:05:18.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:18 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:18.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:18 smithi077 ceph-mon[27689]: Deploying daemon grafana.smithi077 on smithi077 2024-09-18T21:05:18.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:18 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:19.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:19 smithi077 ceph-mon[27689]: from='client.14192 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi077:172.21.15.77=smithi077;smithi103:172.21.15.103=smithi103", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:05:19.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:19 smithi077 ceph-mon[27689]: Saving service mon spec with placement smithi077:172.21.15.77=smithi077;smithi103:172.21.15.103=smithi103;count:2 2024-09-18T21:05:19.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:19.790+0000 7f5ad594e640 1 -- 172.21.15.103:0/393256624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ad00fb0c0 msgr2=0x7f5ad00fb4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:05:19.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:19.790+0000 7f5ad594e640 1 --2- 172.21.15.103:0/393256624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ad00fb0c0 0x7f5ad00fb4d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0004850 tx=0x7f5ac0009da0 comp rx=0 tx=0).stop 2024-09-18T21:05:19.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:19.790+0000 7f5ad594e640 1 -- 172.21.15.103:0/393256624 shutdown_connections 2024-09-18T21:05:19.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:19.790+0000 7f5ad594e640 1 --2- 172.21.15.103:0/393256624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ad00fb0c0 0x7f5ad00fb4d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:05:19.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:19.790+0000 7f5ad594e640 1 -- 172.21.15.103:0/393256624 >> 172.21.15.103:0/393256624 conn(0x7f5ad00f6880 msgr2=0x7f5ad00f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:05:19.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:19.790+0000 7f5ad594e640 1 -- 172.21.15.103:0/393256624 shutdown_connections 2024-09-18T21:05:19.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:19.790+0000 7f5ad594e640 1 -- 172.21.15.103:0/393256624 wait complete. 2024-09-18T21:05:19.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:19.791+0000 7f5ad594e640 1 Processor -- start 2024-09-18T21:05:19.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:19.791+0000 7f5ad594e640 1 -- start start 2024-09-18T21:05:19.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:19.791+0000 7f5ad594e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ad00fb0c0 0x7f5ad0066040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:05:19.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:19.791+0000 7f5ad594e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad010f410 con 0x7f5ad00fb0c0 2024-09-18T21:05:19.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:19.791+0000 7f5aceffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ad00fb0c0 0x7f5ad0066040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:05:19.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:19.791+0000 7f5aceffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ad00fb0c0 0x7f5ad0066040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.103:43984/0 (socket says 172.21.15.103:43984) 2024-09-18T21:05:19.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:19.791+0000 7f5aceffd640 1 -- 172.21.15.103:0/558306773 learned_addr learned my addr 172.21.15.103:0/558306773 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-18T21:05:19.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:19.791+0000 7f5aceffd640 1 -- 172.21.15.103:0/558306773 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac0005040 con 0x7f5ad00fb0c0 2024-09-18T21:05:19.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:19.792+0000 7f5aceffd640 1 --2- 172.21.15.103:0/558306773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ad00fb0c0 0x7f5ad0066040 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0009920 tx=0x7f5ac0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:05:19.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:19.792+0000 7f5ab77fe640 1 -- 172.21.15.103:0/558306773 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5ac0033630 con 0x7f5ad00fb0c0 2024-09-18T21:05:19.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:19.792+0000 7f5ab77fe640 1 -- 172.21.15.103:0/558306773 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5ac0033c30 con 0x7f5ad00fb0c0 2024-09-18T21:05:19.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:19.792+0000 7f5ad594e640 1 -- 172.21.15.103:0/558306773 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ad010f550 con 0x7f5ad00fb0c0 2024-09-18T21:05:19.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:19.792+0000 7f5ab77fe640 1 -- 172.21.15.103:0/558306773 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5ac003dc40 con 0x7f5ad00fb0c0 2024-09-18T21:05:19.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:19.792+0000 7f5ad594e640 1 -- 172.21.15.103:0/558306773 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ad010f960 con 0x7f5ad00fb0c0 2024-09-18T21:05:19.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:19.793+0000 7f5ab77fe640 1 -- 172.21.15.103:0/558306773 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f5ac0030020 con 0x7f5ad00fb0c0 2024-09-18T21:05:19.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:19.793+0000 7f5ad594e640 1 -- 172.21.15.103:0/558306773 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ad005ed70 con 0x7f5ad00fb0c0 2024-09-18T21:05:19.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:19.793+0000 7f5ab77fe640 1 --2- 172.21.15.103:0/558306773 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f5ab80395d0 0x7f5ab803ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:05:19.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:19.793+0000 7f5ab77fe640 1 -- 172.21.15.103:0/558306773 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f5ac006cb60 con 0x7f5ad00fb0c0 2024-09-18T21:05:19.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:19.793+0000 7f5ace7fc640 1 --2- 172.21.15.103:0/558306773 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f5ab80395d0 0x7f5ab803ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:05:19.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:19.793+0000 7f5ace7fc640 1 --2- 172.21.15.103:0/558306773 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f5ab80395d0 0x7f5ab803ba80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4006fd0 tx=0x7f5ac4006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:05:19.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:19.798+0000 7f5ab77fe640 1 -- 172.21.15.103:0/558306773 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5ac0047440 con 0x7f5ad00fb0c0 2024-09-18T21:05:20.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:20.010+0000 7f5ad594e640 1 -- 172.21.15.103:0/558306773 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f5ad004b720 con 0x7f5ad00fb0c0 2024-09-18T21:05:20.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:20.011+0000 7f5ab77fe640 1 -- 172.21.15.103:0/558306773 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f5ac003b7e0 con 0x7f5ad00fb0c0 2024-09-18T21:05:20.012 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:05:20.012 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":1,"fsid":"5a76ec16-7601-11ef-bceb-c7b262605968","modified":"2024-09-18T21:03:43.159838Z","created":"2024-09-18T21:03:43.159838Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi077","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:3300","nonce":0},{"type":"v1","addr":"172.21.15.77:6789","nonce":0}]},"addr":"172.21.15.77:6789/0","public_addr":"172.21.15.77:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T21:05:20.012 INFO:teuthology.orchestra.run.smithi103.stderr:dumped monmap epoch 1 2024-09-18T21:05:20.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:20.012+0000 7f5ad594e640 1 -- 172.21.15.103:0/558306773 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f5ab80395d0 msgr2=0x7f5ab803ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:05:20.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:20.012+0000 7f5ad594e640 1 --2- 172.21.15.103:0/558306773 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f5ab80395d0 0x7f5ab803ba80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4006fd0 tx=0x7f5ac4006db0 comp rx=0 tx=0).stop 2024-09-18T21:05:20.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:20.012+0000 7f5ad594e640 1 -- 172.21.15.103:0/558306773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ad00fb0c0 msgr2=0x7f5ad0066040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:05:20.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:20.012+0000 7f5ad594e640 1 --2- 172.21.15.103:0/558306773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ad00fb0c0 0x7f5ad0066040 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0009920 tx=0x7f5ac0009da0 comp rx=0 tx=0).stop 2024-09-18T21:05:20.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:20.013+0000 7f5ad594e640 1 -- 172.21.15.103:0/558306773 shutdown_connections 2024-09-18T21:05:20.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:20.013+0000 7f5ad594e640 1 --2- 172.21.15.103:0/558306773 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f5ab80395d0 0x7f5ab803ba80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:05:20.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:20.013+0000 7f5ad594e640 1 --2- 172.21.15.103:0/558306773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ad00fb0c0 0x7f5ad0066040 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:05:20.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:20.013+0000 7f5ad594e640 1 -- 172.21.15.103:0/558306773 >> 172.21.15.103:0/558306773 conn(0x7f5ad00f6880 msgr2=0x7f5ad00f70e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:05:20.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:20.013+0000 7f5ad594e640 1 -- 172.21.15.103:0/558306773 shutdown_connections 2024-09-18T21:05:20.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:20.013+0000 7f5ad594e640 1 -- 172.21.15.103:0/558306773 wait complete. 2024-09-18T21:05:20.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:20 smithi077 ceph-mon[27689]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:05:20.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:20 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:20.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:20 smithi077 ceph-mon[27689]: from='client.? 172.21.15.103:0/558306773' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T21:05:21.552 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T21:05:21.553 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T21:05:21.806 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T21:05:21.867 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T21:05:22.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:22 smithi077 ceph-mon[27689]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:05:23.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:23.284+0000 7f75a37ca640 1 -- 172.21.15.103:0/3422101471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f759c0fc1b0 msgr2=0x7f759c0fc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:05:23.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:23.284+0000 7f75a37ca640 1 --2- 172.21.15.103:0/3422101471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f759c0fc1b0 0x7f759c0fc5c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7594004850 tx=0x7f7594009da0 comp rx=0 tx=0).stop 2024-09-18T21:05:23.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:23.284+0000 7f75a37ca640 1 -- 172.21.15.103:0/3422101471 shutdown_connections 2024-09-18T21:05:23.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:23.284+0000 7f75a37ca640 1 --2- 172.21.15.103:0/3422101471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f759c0fc1b0 0x7f759c0fc5c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:05:23.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:23.284+0000 7f75a37ca640 1 -- 172.21.15.103:0/3422101471 >> 172.21.15.103:0/3422101471 conn(0x7f759c0f7990 msgr2=0x7f759c0f9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:05:23.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:23.284+0000 7f75a37ca640 1 -- 172.21.15.103:0/3422101471 shutdown_connections 2024-09-18T21:05:23.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:23.284+0000 7f75a37ca640 1 -- 172.21.15.103:0/3422101471 wait complete. 2024-09-18T21:05:23.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:23.285+0000 7f75a37ca640 1 Processor -- start 2024-09-18T21:05:23.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:23.285+0000 7f75a37ca640 1 -- start start 2024-09-18T21:05:23.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:23.285+0000 7f75a37ca640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f759c0fc1b0 0x7f759c10c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:05:23.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:23.285+0000 7f75a37ca640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f759c10cc30 con 0x7f759c0fc1b0 2024-09-18T21:05:23.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:23.285+0000 7f75a1566640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f759c0fc1b0 0x7f759c10c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:05:23.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:23.285+0000 7f75a1566640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f759c0fc1b0 0x7f759c10c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.103:44006/0 (socket says 172.21.15.103:44006) 2024-09-18T21:05:23.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:23.285+0000 7f75a1566640 1 -- 172.21.15.103:0/3125842149 learned_addr learned my addr 172.21.15.103:0/3125842149 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-18T21:05:23.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:23.286+0000 7f75a1566640 1 -- 172.21.15.103:0/3125842149 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7594005040 con 0x7f759c0fc1b0 2024-09-18T21:05:23.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:23.286+0000 7f75a1566640 1 --2- 172.21.15.103:0/3125842149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f759c0fc1b0 0x7f759c10c6f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f759402a6d0 tx=0x7f7594009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:05:23.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:23.286+0000 7f7599ffb640 1 -- 172.21.15.103:0/3125842149 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7594033630 con 0x7f759c0fc1b0 2024-09-18T21:05:23.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:23.286+0000 7f75a37ca640 1 -- 172.21.15.103:0/3125842149 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f759c10ce30 con 0x7f759c0fc1b0 2024-09-18T21:05:23.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:23.286+0000 7f7599ffb640 1 -- 172.21.15.103:0/3125842149 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7594033c30 con 0x7f759c0fc1b0 2024-09-18T21:05:23.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:23.286+0000 7f7599ffb640 1 -- 172.21.15.103:0/3125842149 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f759403dc00 con 0x7f759c0fc1b0 2024-09-18T21:05:23.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:23.286+0000 7f75a37ca640 1 -- 172.21.15.103:0/3125842149 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f759c10d2a0 con 0x7f759c0fc1b0 2024-09-18T21:05:23.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:23.287+0000 7f7599ffb640 1 -- 172.21.15.103:0/3125842149 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f7594030020 con 0x7f759c0fc1b0 2024-09-18T21:05:23.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:23.287+0000 7f75a37ca640 1 -- 172.21.15.103:0/3125842149 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f759c05ed70 con 0x7f759c0fc1b0 2024-09-18T21:05:23.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:23.287+0000 7f7599ffb640 1 --2- 172.21.15.103:0/3125842149 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f7584039580 0x7f758403ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:05:23.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:23.287+0000 7f7599ffb640 1 -- 172.21.15.103:0/3125842149 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f759406c940 con 0x7f759c0fc1b0 2024-09-18T21:05:23.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:23.287+0000 7f75a0d65640 1 --2- 172.21.15.103:0/3125842149 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f7584039580 0x7f758403ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:05:23.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:23.288+0000 7f75a0d65640 1 --2- 172.21.15.103:0/3125842149 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f7584039580 0x7f758403ba30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7590006fd0 tx=0x7f7590006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:05:23.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:23.292+0000 7f7599ffb640 1 -- 172.21.15.103:0/3125842149 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f7594033790 con 0x7f759c0fc1b0 2024-09-18T21:05:23.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:23.506+0000 7f75a37ca640 1 -- 172.21.15.103:0/3125842149 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f759c04b720 con 0x7f759c0fc1b0 2024-09-18T21:05:23.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:23.507+0000 7f7599ffb640 1 -- 172.21.15.103:0/3125842149 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f7594042210 con 0x7f759c0fc1b0 2024-09-18T21:05:23.508 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:05:23.508 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":1,"fsid":"5a76ec16-7601-11ef-bceb-c7b262605968","modified":"2024-09-18T21:03:43.159838Z","created":"2024-09-18T21:03:43.159838Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi077","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:3300","nonce":0},{"type":"v1","addr":"172.21.15.77:6789","nonce":0}]},"addr":"172.21.15.77:6789/0","public_addr":"172.21.15.77:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T21:05:23.508 INFO:teuthology.orchestra.run.smithi103.stderr:dumped monmap epoch 1 2024-09-18T21:05:23.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:23.509+0000 7f75a37ca640 1 -- 172.21.15.103:0/3125842149 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f7584039580 msgr2=0x7f758403ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:05:23.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:23.509+0000 7f75a37ca640 1 --2- 172.21.15.103:0/3125842149 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f7584039580 0x7f758403ba30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7590006fd0 tx=0x7f7590006db0 comp rx=0 tx=0).stop 2024-09-18T21:05:23.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:23.509+0000 7f75a37ca640 1 -- 172.21.15.103:0/3125842149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f759c0fc1b0 msgr2=0x7f759c10c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:05:23.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:23.509+0000 7f75a37ca640 1 --2- 172.21.15.103:0/3125842149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f759c0fc1b0 0x7f759c10c6f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f759402a6d0 tx=0x7f7594009da0 comp rx=0 tx=0).stop 2024-09-18T21:05:23.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:23.509+0000 7f75a37ca640 1 -- 172.21.15.103:0/3125842149 shutdown_connections 2024-09-18T21:05:23.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:23.509+0000 7f75a37ca640 1 --2- 172.21.15.103:0/3125842149 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f7584039580 0x7f758403ba30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:05:23.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:23.509+0000 7f75a37ca640 1 --2- 172.21.15.103:0/3125842149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f759c0fc1b0 0x7f759c10c6f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:05:23.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:23.509+0000 7f75a37ca640 1 -- 172.21.15.103:0/3125842149 >> 172.21.15.103:0/3125842149 conn(0x7f759c0f7990 msgr2=0x7f759c0f8220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:05:23.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:23.509+0000 7f75a37ca640 1 -- 172.21.15.103:0/3125842149 shutdown_connections 2024-09-18T21:05:23.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:23.509+0000 7f75a37ca640 1 -- 172.21.15.103:0/3125842149 wait complete. 2024-09-18T21:05:24.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:24 smithi077 ceph-mon[27689]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:05:24.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:24 smithi077 ceph-mon[27689]: from='client.? 172.21.15.103:0/3125842149' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T21:05:25.090 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T21:05:25.090 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T21:05:25.340 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T21:05:25.386 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T21:05:26.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:26 smithi077 ceph-mon[27689]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:05:26.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:26.725+0000 7f20de78e640 1 -- 172.21.15.103:0/659168466 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20d80fc1b0 msgr2=0x7f20d80fc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:05:26.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:26.725+0000 7f20de78e640 1 --2- 172.21.15.103:0/659168466 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20d80fc1b0 0x7f20d80fc5c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f20c8004850 tx=0x7f20c8009da0 comp rx=0 tx=0).stop 2024-09-18T21:05:26.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:26.725+0000 7f20de78e640 1 -- 172.21.15.103:0/659168466 shutdown_connections 2024-09-18T21:05:26.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:26.725+0000 7f20de78e640 1 --2- 172.21.15.103:0/659168466 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20d80fc1b0 0x7f20d80fc5c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:05:26.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:26.725+0000 7f20de78e640 1 -- 172.21.15.103:0/659168466 >> 172.21.15.103:0/659168466 conn(0x7f20d80f7990 msgr2=0x7f20d80f9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:05:26.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:26.726+0000 7f20de78e640 1 -- 172.21.15.103:0/659168466 shutdown_connections 2024-09-18T21:05:26.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:26.726+0000 7f20de78e640 1 -- 172.21.15.103:0/659168466 wait complete. 2024-09-18T21:05:26.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:26.726+0000 7f20de78e640 1 Processor -- start 2024-09-18T21:05:26.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:26.726+0000 7f20de78e640 1 -- start start 2024-09-18T21:05:26.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:26.726+0000 7f20de78e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20d80fc1b0 0x7f20d8071490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:05:26.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:26.726+0000 7f20de78e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d80719d0 con 0x7f20d80fc1b0 2024-09-18T21:05:26.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:26.727+0000 7f20d7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20d80fc1b0 0x7f20d8071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:05:26.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:26.727+0000 7f20d7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20d80fc1b0 0x7f20d8071490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.103:35642/0 (socket says 172.21.15.103:35642) 2024-09-18T21:05:26.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:26.727+0000 7f20d7fff640 1 -- 172.21.15.103:0/3337750725 learned_addr learned my addr 172.21.15.103:0/3337750725 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-18T21:05:26.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:26.727+0000 7f20d7fff640 1 -- 172.21.15.103:0/3337750725 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c8005040 con 0x7f20d80fc1b0 2024-09-18T21:05:26.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:26.727+0000 7f20d7fff640 1 --2- 172.21.15.103:0/3337750725 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20d80fc1b0 0x7f20d8071490 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f20c802a6d0 tx=0x7f20c8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:05:26.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:26.727+0000 7f20d57fa640 1 -- 172.21.15.103:0/3337750725 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f20c8033630 con 0x7f20d80fc1b0 2024-09-18T21:05:26.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:26.727+0000 7f20de78e640 1 -- 172.21.15.103:0/3337750725 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20d806fa60 con 0x7f20d80fc1b0 2024-09-18T21:05:26.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:26.727+0000 7f20d57fa640 1 -- 172.21.15.103:0/3337750725 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f20c8033c30 con 0x7f20d80fc1b0 2024-09-18T21:05:26.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:26.727+0000 7f20d57fa640 1 -- 172.21.15.103:0/3337750725 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f20c803dc00 con 0x7f20d80fc1b0 2024-09-18T21:05:26.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:26.727+0000 7f20de78e640 1 -- 172.21.15.103:0/3337750725 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20d806fed0 con 0x7f20d80fc1b0 2024-09-18T21:05:26.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:26.728+0000 7f20de78e640 1 -- 172.21.15.103:0/3337750725 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20d81025d0 con 0x7f20d80fc1b0 2024-09-18T21:05:26.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:26.728+0000 7f20d57fa640 1 -- 172.21.15.103:0/3337750725 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f20c8030020 con 0x7f20d80fc1b0 2024-09-18T21:05:26.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:26.729+0000 7f20d57fa640 1 --2- 172.21.15.103:0/3337750725 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f20c4039580 0x7f20c403ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:05:26.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:26.729+0000 7f20d57fa640 1 -- 172.21.15.103:0/3337750725 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f20c806cab0 con 0x7f20d80fc1b0 2024-09-18T21:05:26.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:26.729+0000 7f20cffff640 1 --2- 172.21.15.103:0/3337750725 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f20c4039580 0x7f20c403ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:05:26.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:26.729+0000 7f20cffff640 1 --2- 172.21.15.103:0/3337750725 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f20c4039580 0x7f20c403ba30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f20c0006fd0 tx=0x7f20c0006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:05:26.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:26.733+0000 7f20d57fa640 1 -- 172.21.15.103:0/3337750725 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f20c8045800 con 0x7f20d80fc1b0 2024-09-18T21:05:26.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:26.948+0000 7f20de78e640 1 -- 172.21.15.103:0/3337750725 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f20d805ed70 con 0x7f20d80fc1b0 2024-09-18T21:05:26.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:26.949+0000 7f20d57fa640 1 -- 172.21.15.103:0/3337750725 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f20c806c3a0 con 0x7f20d80fc1b0 2024-09-18T21:05:26.950 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:05:26.950 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":1,"fsid":"5a76ec16-7601-11ef-bceb-c7b262605968","modified":"2024-09-18T21:03:43.159838Z","created":"2024-09-18T21:03:43.159838Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi077","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:3300","nonce":0},{"type":"v1","addr":"172.21.15.77:6789","nonce":0}]},"addr":"172.21.15.77:6789/0","public_addr":"172.21.15.77:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T21:05:26.950 INFO:teuthology.orchestra.run.smithi103.stderr:dumped monmap epoch 1 2024-09-18T21:05:26.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:26.951+0000 7f20de78e640 1 -- 172.21.15.103:0/3337750725 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f20c4039580 msgr2=0x7f20c403ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:05:26.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:26.951+0000 7f20de78e640 1 --2- 172.21.15.103:0/3337750725 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f20c4039580 0x7f20c403ba30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f20c0006fd0 tx=0x7f20c0006db0 comp rx=0 tx=0).stop 2024-09-18T21:05:26.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:26.951+0000 7f20de78e640 1 -- 172.21.15.103:0/3337750725 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20d80fc1b0 msgr2=0x7f20d8071490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:05:26.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:26.951+0000 7f20de78e640 1 --2- 172.21.15.103:0/3337750725 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20d80fc1b0 0x7f20d8071490 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f20c802a6d0 tx=0x7f20c8009da0 comp rx=0 tx=0).stop 2024-09-18T21:05:26.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:26.951+0000 7f20de78e640 1 -- 172.21.15.103:0/3337750725 shutdown_connections 2024-09-18T21:05:26.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:26.951+0000 7f20de78e640 1 --2- 172.21.15.103:0/3337750725 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f20c4039580 0x7f20c403ba30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:05:26.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:26.951+0000 7f20de78e640 1 --2- 172.21.15.103:0/3337750725 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20d80fc1b0 0x7f20d8071490 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:05:26.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:26.951+0000 7f20de78e640 1 -- 172.21.15.103:0/3337750725 >> 172.21.15.103:0/3337750725 conn(0x7f20d80f7990 msgr2=0x7f20d80f8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:05:26.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:26.951+0000 7f20de78e640 1 -- 172.21.15.103:0/3337750725 shutdown_connections 2024-09-18T21:05:26.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:26.951+0000 7f20de78e640 1 -- 172.21.15.103:0/3337750725 wait complete. 2024-09-18T21:05:27.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:27 smithi077 ceph-mon[27689]: from='client.? 172.21.15.103:0/3337750725' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T21:05:28.516 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:28 smithi077 ceph-mon[27689]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:05:28.528 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T21:05:28.528 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T21:05:28.770 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T21:05:28.814 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T21:05:29.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:29 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:29.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:29 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:29.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:29 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:29.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:29 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:29.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:29 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:29.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:29 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:29.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:29 smithi077 ceph-mon[27689]: Deploying daemon prometheus.smithi077 on smithi077 2024-09-18T21:05:29.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:29 smithi077 ceph-mon[27689]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:05:30.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:30.134+0000 7f29ed91f640 1 -- 172.21.15.103:0/2214567976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29e8065650 msgr2=0x7f29e80feff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:05:30.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:30.134+0000 7f29ed91f640 1 --2- 172.21.15.103:0/2214567976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29e8065650 0x7f29e80feff0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f29d8009bd0 tx=0x7f29d8004d10 comp rx=0 tx=0).stop 2024-09-18T21:05:30.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:30.135+0000 7f29ed91f640 1 -- 172.21.15.103:0/2214567976 shutdown_connections 2024-09-18T21:05:30.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:30.135+0000 7f29ed91f640 1 --2- 172.21.15.103:0/2214567976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29e8065650 0x7f29e80feff0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:05:30.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:30.135+0000 7f29ed91f640 1 -- 172.21.15.103:0/2214567976 >> 172.21.15.103:0/2214567976 conn(0x7f29e80f6ac0 msgr2=0x7f29e80f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:05:30.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:30.135+0000 7f29ed91f640 1 -- 172.21.15.103:0/2214567976 shutdown_connections 2024-09-18T21:05:30.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:30.135+0000 7f29ed91f640 1 -- 172.21.15.103:0/2214567976 wait complete. 2024-09-18T21:05:30.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:30.135+0000 7f29ed91f640 1 Processor -- start 2024-09-18T21:05:30.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:30.135+0000 7f29ed91f640 1 -- start start 2024-09-18T21:05:30.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:30.135+0000 7f29ed91f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29e8065650 0x7f29e810c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:05:30.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:30.135+0000 7f29ed91f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e810ce80 con 0x7f29e8065650 2024-09-18T21:05:30.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:30.136+0000 7f29e6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29e8065650 0x7f29e810c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:05:30.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:30.136+0000 7f29e6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29e8065650 0x7f29e810c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.103:35660/0 (socket says 172.21.15.103:35660) 2024-09-18T21:05:30.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:30.136+0000 7f29e6ffd640 1 -- 172.21.15.103:0/1587087819 learned_addr learned my addr 172.21.15.103:0/1587087819 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-18T21:05:30.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:30.136+0000 7f29e6ffd640 1 -- 172.21.15.103:0/1587087819 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d80098b0 con 0x7f29e8065650 2024-09-18T21:05:30.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:30.136+0000 7f29e6ffd640 1 --2- 172.21.15.103:0/1587087819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29e8065650 0x7f29e810c940 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f29d8004a30 tx=0x7f29d8004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:05:30.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:30.136+0000 7f29df7fe640 1 -- 172.21.15.103:0/1587087819 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f29d8032910 con 0x7f29e8065650 2024-09-18T21:05:30.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:30.136+0000 7f29ed91f640 1 -- 172.21.15.103:0/1587087819 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29e810d080 con 0x7f29e8065650 2024-09-18T21:05:30.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:30.136+0000 7f29df7fe640 1 -- 172.21.15.103:0/1587087819 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f29d803d420 con 0x7f29e8065650 2024-09-18T21:05:30.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:30.136+0000 7f29df7fe640 1 -- 172.21.15.103:0/1587087819 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f29d8031590 con 0x7f29e8065650 2024-09-18T21:05:30.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:30.136+0000 7f29ed91f640 1 -- 172.21.15.103:0/1587087819 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29e810dc10 con 0x7f29e8065650 2024-09-18T21:05:30.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:30.137+0000 7f29ed91f640 1 -- 172.21.15.103:0/1587087819 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29e8102800 con 0x7f29e8065650 2024-09-18T21:05:30.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:30.137+0000 7f29df7fe640 1 -- 172.21.15.103:0/1587087819 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f29d802f030 con 0x7f29e8065650 2024-09-18T21:05:30.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:30.137+0000 7f29df7fe640 1 --2- 172.21.15.103:0/1587087819 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f29d4039580 0x7f29d403ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:05:30.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:30.138+0000 7f29df7fe640 1 -- 172.21.15.103:0/1587087819 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f29d806d250 con 0x7f29e8065650 2024-09-18T21:05:30.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:30.138+0000 7f29e67fc640 1 --2- 172.21.15.103:0/1587087819 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f29d4039580 0x7f29d403ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:05:30.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:30.138+0000 7f29e67fc640 1 --2- 172.21.15.103:0/1587087819 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f29d4039580 0x7f29d403ba30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f29d0006fd0 tx=0x7f29d0006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:05:30.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:30.143+0000 7f29df7fe640 1 -- 172.21.15.103:0/1587087819 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f29d8044b20 con 0x7f29e8065650 2024-09-18T21:05:30.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:30.358+0000 7f29ed91f640 1 -- 172.21.15.103:0/1587087819 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f29e80008d0 con 0x7f29e8065650 2024-09-18T21:05:30.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:30.358+0000 7f29df7fe640 1 -- 172.21.15.103:0/1587087819 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f29d8041070 con 0x7f29e8065650 2024-09-18T21:05:30.359 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:05:30.359 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":1,"fsid":"5a76ec16-7601-11ef-bceb-c7b262605968","modified":"2024-09-18T21:03:43.159838Z","created":"2024-09-18T21:03:43.159838Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi077","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:3300","nonce":0},{"type":"v1","addr":"172.21.15.77:6789","nonce":0}]},"addr":"172.21.15.77:6789/0","public_addr":"172.21.15.77:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T21:05:30.360 INFO:teuthology.orchestra.run.smithi103.stderr:dumped monmap epoch 1 2024-09-18T21:05:30.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:30.361+0000 7f29ed91f640 1 -- 172.21.15.103:0/1587087819 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f29d4039580 msgr2=0x7f29d403ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:05:30.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:30.361+0000 7f29ed91f640 1 --2- 172.21.15.103:0/1587087819 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f29d4039580 0x7f29d403ba30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f29d0006fd0 tx=0x7f29d0006db0 comp rx=0 tx=0).stop 2024-09-18T21:05:30.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:30.361+0000 7f29ed91f640 1 -- 172.21.15.103:0/1587087819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29e8065650 msgr2=0x7f29e810c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:05:30.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:30.361+0000 7f29ed91f640 1 --2- 172.21.15.103:0/1587087819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29e8065650 0x7f29e810c940 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f29d8004a30 tx=0x7f29d8004d10 comp rx=0 tx=0).stop 2024-09-18T21:05:30.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:30.361+0000 7f29ed91f640 1 -- 172.21.15.103:0/1587087819 shutdown_connections 2024-09-18T21:05:30.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:30.361+0000 7f29ed91f640 1 --2- 172.21.15.103:0/1587087819 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f29d4039580 0x7f29d403ba30 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:05:30.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:30.361+0000 7f29ed91f640 1 --2- 172.21.15.103:0/1587087819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29e8065650 0x7f29e810c940 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:05:30.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:30.361+0000 7f29ed91f640 1 -- 172.21.15.103:0/1587087819 >> 172.21.15.103:0/1587087819 conn(0x7f29e80f6ac0 msgr2=0x7f29e80f7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:05:30.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:30.361+0000 7f29ed91f640 1 -- 172.21.15.103:0/1587087819 shutdown_connections 2024-09-18T21:05:30.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:30.361+0000 7f29ed91f640 1 -- 172.21.15.103:0/1587087819 wait complete. 2024-09-18T21:05:31.193 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:30 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:31.194 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:30 smithi077 ceph-mon[27689]: from='client.? 172.21.15.103:0/1587087819' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T21:05:31.980 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T21:05:31.980 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T21:05:32.229 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T21:05:32.273 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T21:05:32.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:31 smithi077 ceph-mon[27689]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:05:33.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:33.631+0000 7f6482eae640 1 -- 172.21.15.103:0/1006915773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f647c065650 msgr2=0x7f647c0feff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:05:33.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:33.631+0000 7f6482eae640 1 --2- 172.21.15.103:0/1006915773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f647c065650 0x7f647c0feff0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6474004850 tx=0x7f6474009da0 comp rx=0 tx=0).stop 2024-09-18T21:05:33.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:33.631+0000 7f6482eae640 1 -- 172.21.15.103:0/1006915773 shutdown_connections 2024-09-18T21:05:33.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:33.631+0000 7f6482eae640 1 --2- 172.21.15.103:0/1006915773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f647c065650 0x7f647c0feff0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:05:33.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:33.631+0000 7f6482eae640 1 -- 172.21.15.103:0/1006915773 >> 172.21.15.103:0/1006915773 conn(0x7f647c0f6ac0 msgr2=0x7f647c0f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:05:33.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:33.631+0000 7f6482eae640 1 -- 172.21.15.103:0/1006915773 shutdown_connections 2024-09-18T21:05:33.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:33.631+0000 7f6482eae640 1 -- 172.21.15.103:0/1006915773 wait complete. 2024-09-18T21:05:33.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:33.631+0000 7f6482eae640 1 Processor -- start 2024-09-18T21:05:33.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:33.632+0000 7f6482eae640 1 -- start start 2024-09-18T21:05:33.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:33.632+0000 7f6482eae640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f647c065650 0x7f647c10c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:05:33.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:33.632+0000 7f6482eae640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647c10ce80 con 0x7f647c065650 2024-09-18T21:05:33.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:33.632+0000 7f6480c4a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f647c065650 0x7f647c10c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:05:33.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:33.632+0000 7f6480c4a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f647c065650 0x7f647c10c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.103:35682/0 (socket says 172.21.15.103:35682) 2024-09-18T21:05:33.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:33.632+0000 7f6480c4a640 1 -- 172.21.15.103:0/2701656304 learned_addr learned my addr 172.21.15.103:0/2701656304 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-18T21:05:33.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:33.632+0000 7f6480c4a640 1 -- 172.21.15.103:0/2701656304 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6474005040 con 0x7f647c065650 2024-09-18T21:05:33.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:33.632+0000 7f6480c4a640 1 --2- 172.21.15.103:0/2701656304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f647c065650 0x7f647c10c940 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f647402a6d0 tx=0x7f6474009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:05:33.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:33.633+0000 7f64797fa640 1 -- 172.21.15.103:0/2701656304 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6474033630 con 0x7f647c065650 2024-09-18T21:05:33.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:33.633+0000 7f64797fa640 1 -- 172.21.15.103:0/2701656304 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6474033c30 con 0x7f647c065650 2024-09-18T21:05:33.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:33.633+0000 7f6482eae640 1 -- 172.21.15.103:0/2701656304 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f647c10d080 con 0x7f647c065650 2024-09-18T21:05:33.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:33.633+0000 7f64797fa640 1 -- 172.21.15.103:0/2701656304 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f647403dc30 con 0x7f647c065650 2024-09-18T21:05:33.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:33.633+0000 7f6482eae640 1 -- 172.21.15.103:0/2701656304 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f647c10d4f0 con 0x7f647c065650 2024-09-18T21:05:33.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:33.634+0000 7f64797fa640 1 -- 172.21.15.103:0/2701656304 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f6474030020 con 0x7f647c065650 2024-09-18T21:05:33.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:33.634+0000 7f6482eae640 1 -- 172.21.15.103:0/2701656304 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f647c05ed70 con 0x7f647c065650 2024-09-18T21:05:33.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:33.634+0000 7f64797fa640 1 --2- 172.21.15.103:0/2701656304 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f64680395d0 0x7f646803ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:05:33.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:33.634+0000 7f64797fa640 1 -- 172.21.15.103:0/2701656304 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f647406c7b0 con 0x7f647c065650 2024-09-18T21:05:33.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:33.634+0000 7f647bfff640 1 --2- 172.21.15.103:0/2701656304 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f64680395d0 0x7f646803ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:05:33.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:33.635+0000 7f647bfff640 1 --2- 172.21.15.103:0/2701656304 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f64680395d0 0x7f646803ba80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f646c00ad90 tx=0x7f646c009410 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:05:33.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:33.639+0000 7f64797fa640 1 -- 172.21.15.103:0/2701656304 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f6474045db0 con 0x7f647c065650 2024-09-18T21:05:33.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:33.851+0000 7f6482eae640 1 -- 172.21.15.103:0/2701656304 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f647c04b720 con 0x7f647c065650 2024-09-18T21:05:33.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:33.851+0000 7f64797fa640 1 -- 172.21.15.103:0/2701656304 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f647403ba00 con 0x7f647c065650 2024-09-18T21:05:33.852 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:05:33.852 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":1,"fsid":"5a76ec16-7601-11ef-bceb-c7b262605968","modified":"2024-09-18T21:03:43.159838Z","created":"2024-09-18T21:03:43.159838Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi077","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:3300","nonce":0},{"type":"v1","addr":"172.21.15.77:6789","nonce":0}]},"addr":"172.21.15.77:6789/0","public_addr":"172.21.15.77:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T21:05:33.852 INFO:teuthology.orchestra.run.smithi103.stderr:dumped monmap epoch 1 2024-09-18T21:05:33.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:33.853+0000 7f6482eae640 1 -- 172.21.15.103:0/2701656304 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f64680395d0 msgr2=0x7f646803ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:05:33.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:33.853+0000 7f6482eae640 1 --2- 172.21.15.103:0/2701656304 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f64680395d0 0x7f646803ba80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f646c00ad90 tx=0x7f646c009410 comp rx=0 tx=0).stop 2024-09-18T21:05:33.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:33.853+0000 7f6482eae640 1 -- 172.21.15.103:0/2701656304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f647c065650 msgr2=0x7f647c10c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:05:33.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:33.853+0000 7f6482eae640 1 --2- 172.21.15.103:0/2701656304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f647c065650 0x7f647c10c940 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f647402a6d0 tx=0x7f6474009da0 comp rx=0 tx=0).stop 2024-09-18T21:05:33.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:33.853+0000 7f6482eae640 1 -- 172.21.15.103:0/2701656304 shutdown_connections 2024-09-18T21:05:33.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:33.853+0000 7f6482eae640 1 --2- 172.21.15.103:0/2701656304 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f64680395d0 0x7f646803ba80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:05:33.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:33.853+0000 7f6482eae640 1 --2- 172.21.15.103:0/2701656304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f647c065650 0x7f647c10c940 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:05:33.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:33.853+0000 7f6482eae640 1 -- 172.21.15.103:0/2701656304 >> 172.21.15.103:0/2701656304 conn(0x7f647c0f6ac0 msgr2=0x7f647c0f7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:05:33.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:33.853+0000 7f6482eae640 1 -- 172.21.15.103:0/2701656304 shutdown_connections 2024-09-18T21:05:33.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:33.853+0000 7f6482eae640 1 -- 172.21.15.103:0/2701656304 wait complete. 2024-09-18T21:05:34.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:33 smithi077 ceph-mon[27689]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:05:34.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:33 smithi077 ceph-mon[27689]: from='client.? 172.21.15.103:0/2701656304' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T21:05:35.376 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T21:05:35.376 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T21:05:35.617 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T21:05:35.662 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T21:05:36.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:35 smithi077 ceph-mon[27689]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:05:37.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:37.026+0000 7f55950ec640 1 -- 172.21.15.103:0/2610743786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55900fb2e0 msgr2=0x7f55900fb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:05:37.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:37.026+0000 7f55950ec640 1 --2- 172.21.15.103:0/2610743786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55900fb2e0 0x7f55900fb6f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5580004850 tx=0x7f5580009da0 comp rx=0 tx=0).stop 2024-09-18T21:05:37.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:37.026+0000 7f55950ec640 1 -- 172.21.15.103:0/2610743786 shutdown_connections 2024-09-18T21:05:37.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:37.026+0000 7f55950ec640 1 --2- 172.21.15.103:0/2610743786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55900fb2e0 0x7f55900fb6f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:05:37.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:37.026+0000 7f55950ec640 1 -- 172.21.15.103:0/2610743786 >> 172.21.15.103:0/2610743786 conn(0x7f55900f6ac0 msgr2=0x7f55900f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:05:37.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:37.026+0000 7f55950ec640 1 -- 172.21.15.103:0/2610743786 shutdown_connections 2024-09-18T21:05:37.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:37.026+0000 7f55950ec640 1 -- 172.21.15.103:0/2610743786 wait complete. 2024-09-18T21:05:37.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:37.026+0000 7f55950ec640 1 Processor -- start 2024-09-18T21:05:37.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:37.026+0000 7f55950ec640 1 -- start start 2024-09-18T21:05:37.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:37.026+0000 7f55950ec640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55900fb2e0 0x7f559010c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:05:37.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:37.026+0000 7f55950ec640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559010ce40 con 0x7f55900fb2e0 2024-09-18T21:05:37.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:37.027+0000 7f558ed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55900fb2e0 0x7f559010c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:05:37.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:37.027+0000 7f558ed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55900fb2e0 0x7f559010c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.103:52404/0 (socket says 172.21.15.103:52404) 2024-09-18T21:05:37.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:37.027+0000 7f558ed9d640 1 -- 172.21.15.103:0/2695373409 learned_addr learned my addr 172.21.15.103:0/2695373409 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-18T21:05:37.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:37.027+0000 7f558ed9d640 1 -- 172.21.15.103:0/2695373409 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5580005040 con 0x7f55900fb2e0 2024-09-18T21:05:37.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:37.027+0000 7f558ed9d640 1 --2- 172.21.15.103:0/2695373409 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55900fb2e0 0x7f559010c900 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f558002a6d0 tx=0x7f5580009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:05:37.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:37.027+0000 7f5587fff640 1 -- 172.21.15.103:0/2695373409 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5580033630 con 0x7f55900fb2e0 2024-09-18T21:05:37.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:37.027+0000 7f5587fff640 1 -- 172.21.15.103:0/2695373409 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5580033c30 con 0x7f55900fb2e0 2024-09-18T21:05:37.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:37.028+0000 7f55950ec640 1 -- 172.21.15.103:0/2695373409 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f559010d040 con 0x7f55900fb2e0 2024-09-18T21:05:37.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:37.028+0000 7f5587fff640 1 -- 172.21.15.103:0/2695373409 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f558003dc00 con 0x7f55900fb2e0 2024-09-18T21:05:37.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:37.028+0000 7f55950ec640 1 -- 172.21.15.103:0/2695373409 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f559010d4b0 con 0x7f55900fb2e0 2024-09-18T21:05:37.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:37.028+0000 7f55950ec640 1 -- 172.21.15.103:0/2695373409 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f559005ed70 con 0x7f55900fb2e0 2024-09-18T21:05:37.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:37.029+0000 7f5587fff640 1 -- 172.21.15.103:0/2695373409 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f5580030020 con 0x7f55900fb2e0 2024-09-18T21:05:37.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:37.029+0000 7f5587fff640 1 --2- 172.21.15.103:0/2695373409 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f557c039580 0x7f557c03ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:05:37.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:37.029+0000 7f5587fff640 1 -- 172.21.15.103:0/2695373409 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f558006c950 con 0x7f55900fb2e0 2024-09-18T21:05:37.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:37.029+0000 7f558659c640 1 --2- 172.21.15.103:0/2695373409 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f557c039580 0x7f557c03ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:05:37.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:37.029+0000 7f558659c640 1 --2- 172.21.15.103:0/2695373409 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f557c039580 0x7f557c03ba30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5578006fd0 tx=0x7f5578006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:05:37.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:37.033+0000 7f5587fff640 1 -- 172.21.15.103:0/2695373409 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5580033790 con 0x7f55900fb2e0 2024-09-18T21:05:37.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:37.248+0000 7f55950ec640 1 -- 172.21.15.103:0/2695373409 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f559004b720 con 0x7f55900fb2e0 2024-09-18T21:05:37.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:37.249+0000 7f5587fff640 1 -- 172.21.15.103:0/2695373409 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f5580045800 con 0x7f55900fb2e0 2024-09-18T21:05:37.249 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:05:37.249 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":1,"fsid":"5a76ec16-7601-11ef-bceb-c7b262605968","modified":"2024-09-18T21:03:43.159838Z","created":"2024-09-18T21:03:43.159838Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi077","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:3300","nonce":0},{"type":"v1","addr":"172.21.15.77:6789","nonce":0}]},"addr":"172.21.15.77:6789/0","public_addr":"172.21.15.77:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T21:05:37.250 INFO:teuthology.orchestra.run.smithi103.stderr:dumped monmap epoch 1 2024-09-18T21:05:37.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:37.250+0000 7f55950ec640 1 -- 172.21.15.103:0/2695373409 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f557c039580 msgr2=0x7f557c03ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:05:37.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:37.250+0000 7f55950ec640 1 --2- 172.21.15.103:0/2695373409 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f557c039580 0x7f557c03ba30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5578006fd0 tx=0x7f5578006db0 comp rx=0 tx=0).stop 2024-09-18T21:05:37.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:37.250+0000 7f55950ec640 1 -- 172.21.15.103:0/2695373409 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55900fb2e0 msgr2=0x7f559010c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:05:37.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:37.250+0000 7f55950ec640 1 --2- 172.21.15.103:0/2695373409 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55900fb2e0 0x7f559010c900 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f558002a6d0 tx=0x7f5580009da0 comp rx=0 tx=0).stop 2024-09-18T21:05:37.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:37.250+0000 7f55950ec640 1 -- 172.21.15.103:0/2695373409 shutdown_connections 2024-09-18T21:05:37.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:37.250+0000 7f55950ec640 1 --2- 172.21.15.103:0/2695373409 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f557c039580 0x7f557c03ba30 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:05:37.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:37.250+0000 7f55950ec640 1 --2- 172.21.15.103:0/2695373409 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55900fb2e0 0x7f559010c900 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:05:37.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:37.250+0000 7f55950ec640 1 -- 172.21.15.103:0/2695373409 >> 172.21.15.103:0/2695373409 conn(0x7f55900f6ac0 msgr2=0x7f5590064990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:05:37.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:37.250+0000 7f55950ec640 1 -- 172.21.15.103:0/2695373409 shutdown_connections 2024-09-18T21:05:37.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:37.250+0000 7f55950ec640 1 -- 172.21.15.103:0/2695373409 wait complete. 2024-09-18T21:05:38.375 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:37 smithi077 ceph-mon[27689]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:05:38.375 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:37 smithi077 ceph-mon[27689]: from='client.? 172.21.15.103:0/2695373409' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T21:05:38.829 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T21:05:38.829 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T21:05:39.072 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T21:05:39.117 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T21:05:39.961 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:39 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:39.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:39 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:39.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:39 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:39.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:39 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-18T21:05:39.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:39 smithi077 ceph-mon[27689]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:05:40.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:40.563+0000 7f75b36c4640 1 -- 172.21.15.103:0/1995575717 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75ac0fc740 msgr2=0x7f75ac0fcb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:05:40.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:40.563+0000 7f75b36c4640 1 --2- 172.21.15.103:0/1995575717 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75ac0fc740 0x7f75ac0fcb50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f75a8004850 tx=0x7f75a8009da0 comp rx=0 tx=0).stop 2024-09-18T21:05:40.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:40.563+0000 7f75b36c4640 1 -- 172.21.15.103:0/1995575717 shutdown_connections 2024-09-18T21:05:40.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:40.563+0000 7f75b36c4640 1 --2- 172.21.15.103:0/1995575717 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75ac0fc740 0x7f75ac0fcb50 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:05:40.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:40.563+0000 7f75b36c4640 1 -- 172.21.15.103:0/1995575717 >> 172.21.15.103:0/1995575717 conn(0x7f75ac0f6010 msgr2=0x7f75ac0f8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:05:40.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:40.563+0000 7f75b36c4640 1 -- 172.21.15.103:0/1995575717 shutdown_connections 2024-09-18T21:05:40.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:40.563+0000 7f75b36c4640 1 -- 172.21.15.103:0/1995575717 wait complete. 2024-09-18T21:05:40.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:40.563+0000 7f75b36c4640 1 Processor -- start 2024-09-18T21:05:40.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:40.563+0000 7f75b36c4640 1 -- start start 2024-09-18T21:05:40.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:40.564+0000 7f75b36c4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75ac0fc740 0x7f75ac10e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:05:40.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:40.564+0000 7f75b36c4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac10eee0 con 0x7f75ac0fc740 2024-09-18T21:05:40.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:40.564+0000 7f75b1460640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75ac0fc740 0x7f75ac10e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:05:40.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:40.564+0000 7f75b1460640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75ac0fc740 0x7f75ac10e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.103:52418/0 (socket says 172.21.15.103:52418) 2024-09-18T21:05:40.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:40.564+0000 7f75b1460640 1 -- 172.21.15.103:0/2259831886 learned_addr learned my addr 172.21.15.103:0/2259831886 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-18T21:05:40.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:40.564+0000 7f75b1460640 1 -- 172.21.15.103:0/2259831886 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a8005040 con 0x7f75ac0fc740 2024-09-18T21:05:40.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:40.564+0000 7f75b1460640 1 --2- 172.21.15.103:0/2259831886 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75ac0fc740 0x7f75ac10e9a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f75a802a6d0 tx=0x7f75a8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:05:40.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:40.564+0000 7f75a1ffb640 1 -- 172.21.15.103:0/2259831886 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f75a8033630 con 0x7f75ac0fc740 2024-09-18T21:05:40.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:40.564+0000 7f75b36c4640 1 -- 172.21.15.103:0/2259831886 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75ac10f0e0 con 0x7f75ac0fc740 2024-09-18T21:05:40.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:40.564+0000 7f75a1ffb640 1 -- 172.21.15.103:0/2259831886 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f75a8033c30 con 0x7f75ac0fc740 2024-09-18T21:05:40.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:40.564+0000 7f75a1ffb640 1 -- 172.21.15.103:0/2259831886 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f75a803dc30 con 0x7f75ac0fc740 2024-09-18T21:05:40.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:40.565+0000 7f75b36c4640 1 -- 172.21.15.103:0/2259831886 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75ac10f550 con 0x7f75ac0fc740 2024-09-18T21:05:40.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:40.566+0000 7f75a1ffb640 1 -- 172.21.15.103:0/2259831886 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 14) v1 ==== 45577+0+0 (secure 0 0 0) 0x7f75a8030020 con 0x7f75ac0fc740 2024-09-18T21:05:40.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:40.566+0000 7f75b36c4640 1 -- 172.21.15.103:0/2259831886 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75ac05ed70 con 0x7f75ac0fc740 2024-09-18T21:05:40.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:40.566+0000 7f75a1ffb640 1 --2- 172.21.15.103:0/2259831886 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f75980395d0 0x7f759803ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:05:40.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:40.566+0000 7f75a1ffb640 1 -- 172.21.15.103:0/2259831886 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f75a806c860 con 0x7f75ac0fc740 2024-09-18T21:05:40.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:40.566+0000 7f75b0c5f640 1 -- 172.21.15.103:0/2259831886 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f75980395d0 msgr2=0x7f759803ba80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/517401638 2024-09-18T21:05:40.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:40.566+0000 7f75b0c5f640 1 --2- 172.21.15.103:0/2259831886 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f75980395d0 0x7f759803ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-18T21:05:40.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:40.575+0000 7f75a1ffb640 1 -- 172.21.15.103:0/2259831886 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f75a8033790 con 0x7f75ac0fc740 2024-09-18T21:05:40.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:40.767+0000 7f75b0c5f640 1 -- 172.21.15.103:0/2259831886 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f75980395d0 msgr2=0x7f759803ba80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/517401638 2024-09-18T21:05:40.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:40.767+0000 7f75b0c5f640 1 --2- 172.21.15.103:0/2259831886 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f75980395d0 0x7f759803ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-18T21:05:40.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:40.787+0000 7f75b36c4640 1 -- 172.21.15.103:0/2259831886 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f75ac04b720 con 0x7f75ac0fc740 2024-09-18T21:05:40.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:40.788+0000 7f75a1ffb640 1 -- 172.21.15.103:0/2259831886 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f75a8042210 con 0x7f75ac0fc740 2024-09-18T21:05:40.789 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:05:40.789 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":1,"fsid":"5a76ec16-7601-11ef-bceb-c7b262605968","modified":"2024-09-18T21:03:43.159838Z","created":"2024-09-18T21:03:43.159838Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi077","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:3300","nonce":0},{"type":"v1","addr":"172.21.15.77:6789","nonce":0}]},"addr":"172.21.15.77:6789/0","public_addr":"172.21.15.77:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T21:05:40.789 INFO:teuthology.orchestra.run.smithi103.stderr:dumped monmap epoch 1 2024-09-18T21:05:40.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:40.790+0000 7f75b36c4640 1 -- 172.21.15.103:0/2259831886 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f75980395d0 msgr2=0x7f759803ba80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-18T21:05:40.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:40.790+0000 7f75b36c4640 1 --2- 172.21.15.103:0/2259831886 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f75980395d0 0x7f759803ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:05:40.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:40.790+0000 7f75b36c4640 1 -- 172.21.15.103:0/2259831886 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75ac0fc740 msgr2=0x7f75ac10e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:05:40.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:40.790+0000 7f75b36c4640 1 --2- 172.21.15.103:0/2259831886 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75ac0fc740 0x7f75ac10e9a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f75a802a6d0 tx=0x7f75a8009da0 comp rx=0 tx=0).stop 2024-09-18T21:05:40.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:40.790+0000 7f75b36c4640 1 -- 172.21.15.103:0/2259831886 shutdown_connections 2024-09-18T21:05:40.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:40.790+0000 7f75b36c4640 1 --2- 172.21.15.103:0/2259831886 >> [v2:172.21.15.77:6800/517401638,v1:172.21.15.77:6801/517401638] conn(0x7f75980395d0 0x7f759803ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:05:40.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:40.790+0000 7f75b36c4640 1 --2- 172.21.15.103:0/2259831886 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75ac0fc740 0x7f75ac10e9a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:05:40.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:40.790+0000 7f75b36c4640 1 -- 172.21.15.103:0/2259831886 >> 172.21.15.103:0/2259831886 conn(0x7f75ac0f6010 msgr2=0x7f75ac0f6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:05:40.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:40.790+0000 7f75b36c4640 1 -- 172.21.15.103:0/2259831886 shutdown_connections 2024-09-18T21:05:40.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:40.790+0000 7f75b36c4640 1 -- 172.21.15.103:0/2259831886 wait complete. 2024-09-18T21:05:40.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:40 smithi077 ceph-mon[27689]: from='mgr.14160 172.21.15.77:0/2456396997' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-18T21:05:40.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:40 smithi077 ceph-mon[27689]: mgrmap e14: smithi077.utkpjg(active, since 54s) 2024-09-18T21:05:41.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:41 smithi077 ceph-mon[27689]: from='client.? 172.21.15.103:0/2259831886' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T21:05:42.409 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T21:05:42.409 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T21:05:42.653 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T21:05:42.697 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T21:05:44.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:44.121+0000 7f4ce7d4e640 1 -- 172.21.15.103:0/1675500863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ce0071570 msgr2=0x7f4ce006faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:05:44.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:44.121+0000 7f4ce7d4e640 1 --2- 172.21.15.103:0/1675500863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ce0071570 0x7f4ce006faa0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4cd0009bd0 tx=0x7f4cd0004d10 comp rx=0 tx=0).stop 2024-09-18T21:05:44.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:44.121+0000 7f4ce7d4e640 1 -- 172.21.15.103:0/1675500863 shutdown_connections 2024-09-18T21:05:44.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:44.121+0000 7f4ce7d4e640 1 --2- 172.21.15.103:0/1675500863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ce0071570 0x7f4ce006faa0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:05:44.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:44.121+0000 7f4ce7d4e640 1 -- 172.21.15.103:0/1675500863 >> 172.21.15.103:0/1675500863 conn(0x7f4ce00f7990 msgr2=0x7f4ce00f9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:05:44.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:44.121+0000 7f4ce7d4e640 1 -- 172.21.15.103:0/1675500863 shutdown_connections 2024-09-18T21:05:44.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:44.121+0000 7f4ce7d4e640 1 -- 172.21.15.103:0/1675500863 wait complete. 2024-09-18T21:05:44.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:44.122+0000 7f4ce7d4e640 1 Processor -- start 2024-09-18T21:05:44.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:44.122+0000 7f4ce7d4e640 1 -- start start 2024-09-18T21:05:44.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:44.122+0000 7f4ce7d4e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ce0071570 0x7f4ce010e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:05:44.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:44.122+0000 7f4ce7d4e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce010ee80 con 0x7f4ce0071570 2024-09-18T21:05:44.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:44.122+0000 7f4ce5aea640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ce0071570 0x7f4ce010e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:05:44.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:44.122+0000 7f4ce5aea640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ce0071570 0x7f4ce010e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.103:38048/0 (socket says 172.21.15.103:38048) 2024-09-18T21:05:44.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:44.122+0000 7f4ce5aea640 1 -- 172.21.15.103:0/195617288 learned_addr learned my addr 172.21.15.103:0/195617288 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-18T21:05:44.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:44.123+0000 7f4ce5aea640 1 -- 172.21.15.103:0/195617288 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd00098b0 con 0x7f4ce0071570 2024-09-18T21:05:44.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:44.123+0000 7f4ce5aea640 1 --2- 172.21.15.103:0/195617288 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ce0071570 0x7f4ce010e940 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4cd0004a30 tx=0x7f4cd0004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:05:44.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:44.123+0000 7f4cde7fc640 1 -- 172.21.15.103:0/195617288 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4cd0032910 con 0x7f4ce0071570 2024-09-18T21:05:44.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:44.123+0000 7f4cde7fc640 1 -- 172.21.15.103:0/195617288 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4cd003d420 con 0x7f4ce0071570 2024-09-18T21:05:44.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:44.123+0000 7f4ce7d4e640 1 -- 172.21.15.103:0/195617288 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ce010f080 con 0x7f4ce0071570 2024-09-18T21:05:44.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:44.123+0000 7f4cde7fc640 1 -- 172.21.15.103:0/195617288 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4cd0031590 con 0x7f4ce0071570 2024-09-18T21:05:44.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:44.123+0000 7f4ce7d4e640 1 -- 172.21.15.103:0/195617288 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ce010fc10 con 0x7f4ce0071570 2024-09-18T21:05:44.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:44.124+0000 7f4cde7fc640 1 -- 172.21.15.103:0/195617288 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 15) v1 ==== 45301+0+0 (secure 0 0 0) 0x7f4cd002f030 con 0x7f4ce0071570 2024-09-18T21:05:44.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:44.124+0000 7f4ce7d4e640 1 -- 172.21.15.103:0/195617288 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ce01047d0 con 0x7f4ce0071570 2024-09-18T21:05:44.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:44.124+0000 7f4cde7fc640 1 -- 172.21.15.103:0/195617288 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f4cd006cf80 con 0x7f4ce0071570 2024-09-18T21:05:44.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:44.133+0000 7f4cde7fc640 1 -- 172.21.15.103:0/195617288 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4cd0044d90 con 0x7f4ce0071570 2024-09-18T21:05:44.272 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:44 smithi077 ceph-mon[27689]: Active manager daemon smithi077.utkpjg restarted 2024-09-18T21:05:44.272 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:44 smithi077 ceph-mon[27689]: Activating manager daemon smithi077.utkpjg 2024-09-18T21:05:44.273 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:44 smithi077 ceph-mon[27689]: osdmap e5: 0 total, 0 up, 0 in 2024-09-18T21:05:44.273 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:44 smithi077 ceph-mon[27689]: mgrmap e15: smithi077.utkpjg(active, starting, since 0.00317941s) 2024-09-18T21:05:44.273 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:44 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mon metadata", "id": "smithi077"}]: dispatch 2024-09-18T21:05:44.273 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:44 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mgr metadata", "who": "smithi077.utkpjg", "id": "smithi077.utkpjg"}]: dispatch 2024-09-18T21:05:44.273 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:44 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-18T21:05:44.273 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:44 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-18T21:05:44.273 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:44 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-18T21:05:44.273 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:44 smithi077 ceph-mon[27689]: Manager daemon smithi077.utkpjg is now available 2024-09-18T21:05:44.273 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:44 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:05:44.273 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:44 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:44.273 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:44 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:05:44.273 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:44 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi077.utkpjg/mirror_snapshot_schedule"}]: dispatch 2024-09-18T21:05:44.273 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:44 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi077.utkpjg/trash_purge_schedule"}]: dispatch 2024-09-18T21:05:44.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:44.356+0000 7f4ce7d4e640 1 -- 172.21.15.103:0/195617288 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4ce0110610 con 0x7f4ce0071570 2024-09-18T21:05:44.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:44.357+0000 7f4cde7fc640 1 -- 172.21.15.103:0/195617288 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f4cd00447d0 con 0x7f4ce0071570 2024-09-18T21:05:44.359 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:05:44.360 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":1,"fsid":"5a76ec16-7601-11ef-bceb-c7b262605968","modified":"2024-09-18T21:03:43.159838Z","created":"2024-09-18T21:03:43.159838Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi077","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:3300","nonce":0},{"type":"v1","addr":"172.21.15.77:6789","nonce":0}]},"addr":"172.21.15.77:6789/0","public_addr":"172.21.15.77:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T21:05:44.360 INFO:teuthology.orchestra.run.smithi103.stderr:dumped monmap epoch 1 2024-09-18T21:05:44.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:44.359+0000 7f4ce7d4e640 1 -- 172.21.15.103:0/195617288 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ce0071570 msgr2=0x7f4ce010e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:05:44.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:44.359+0000 7f4ce7d4e640 1 --2- 172.21.15.103:0/195617288 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ce0071570 0x7f4ce010e940 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4cd0004a30 tx=0x7f4cd0004d10 comp rx=0 tx=0).stop 2024-09-18T21:05:44.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:44.359+0000 7f4ce7d4e640 1 -- 172.21.15.103:0/195617288 shutdown_connections 2024-09-18T21:05:44.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:44.359+0000 7f4ce7d4e640 1 --2- 172.21.15.103:0/195617288 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ce0071570 0x7f4ce010e940 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:05:44.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:44.359+0000 7f4ce7d4e640 1 -- 172.21.15.103:0/195617288 >> 172.21.15.103:0/195617288 conn(0x7f4ce00f7990 msgr2=0x7f4ce00f8220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:05:44.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:44.359+0000 7f4ce7d4e640 1 -- 172.21.15.103:0/195617288 shutdown_connections 2024-09-18T21:05:44.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:44.359+0000 7f4ce7d4e640 1 -- 172.21.15.103:0/195617288 wait complete. 2024-09-18T21:05:45.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:45 smithi077 ceph-mon[27689]: from='client.? 172.21.15.103:0/195617288' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T21:05:45.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:45 smithi077 ceph-mon[27689]: mgrmap e16: smithi077.utkpjg(active, since 1.0055s) 2024-09-18T21:05:45.986 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T21:05:45.986 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T21:05:46.223 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T21:05:46.345 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:46 smithi077 ceph-mon[27689]: [18/Sep/2024:21:05:44] ENGINE Bus STARTING 2024-09-18T21:05:46.345 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:46 smithi077 ceph-mon[27689]: [18/Sep/2024:21:05:45] ENGINE Serving on https://172.21.15.77:7150 2024-09-18T21:05:46.345 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:46 smithi077 ceph-mon[27689]: [18/Sep/2024:21:05:45] ENGINE Bus STARTED 2024-09-18T21:05:46.345 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:46 smithi077 ceph-mon[27689]: [18/Sep/2024:21:05:45] ENGINE Error in HTTPServer.serve 2024-09-18T21:05:46.345 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Traceback (most recent call last): 2024-09-18T21:05:46.345 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-18T21:05:46.346 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: self._connections.run(self.expiration_interval) 2024-09-18T21:05:46.346 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-18T21:05:46.346 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: self._run(expiration_interval) 2024-09-18T21:05:46.346 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-18T21:05:46.346 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-18T21:05:46.346 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-18T21:05:46.346 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-18T21:05:46.346 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-18T21:05:46.346 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: s = self.context.wrap_socket( 2024-09-18T21:05:46.346 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-18T21:05:46.346 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: return self.sslsocket_class._create( 2024-09-18T21:05:46.346 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-18T21:05:46.346 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: self.do_handshake() 2024-09-18T21:05:46.346 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-18T21:05:46.346 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: self._sslobj.do_handshake() 2024-09-18T21:05:46.347 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-18T21:05:46.347 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:46 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:46.347 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:46 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:46.347 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:46 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:46.347 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:46 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:46.783 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-18T21:05:48.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:47 smithi077 ceph-mon[27689]: mgrmap e17: smithi077.utkpjg(active, since 2s) 2024-09-18T21:05:49.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:49.131+0000 7f24b2415640 1 -- 172.21.15.103:0/820008269 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24ac0fd820 msgr2=0x7f24ac0fdc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:05:49.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:49.131+0000 7f24b2415640 1 --2- 172.21.15.103:0/820008269 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24ac0fd820 0x7f24ac0fdc30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f249c004850 tx=0x7f249c009da0 comp rx=0 tx=0).stop 2024-09-18T21:05:49.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:49.131+0000 7f24b2415640 1 -- 172.21.15.103:0/820008269 shutdown_connections 2024-09-18T21:05:49.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:49.131+0000 7f24b2415640 1 --2- 172.21.15.103:0/820008269 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24ac0fd820 0x7f24ac0fdc30 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:05:49.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:49.131+0000 7f24b2415640 1 -- 172.21.15.103:0/820008269 >> 172.21.15.103:0/820008269 conn(0x7f24ac0f6040 msgr2=0x7f24ac0f8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:05:49.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:49.131+0000 7f24b2415640 1 -- 172.21.15.103:0/820008269 shutdown_connections 2024-09-18T21:05:49.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:49.131+0000 7f24b2415640 1 -- 172.21.15.103:0/820008269 wait complete. 2024-09-18T21:05:49.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:49.132+0000 7f24b2415640 1 Processor -- start 2024-09-18T21:05:49.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:49.132+0000 7f24b2415640 1 -- start start 2024-09-18T21:05:49.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:49.132+0000 7f24b2415640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24ac0fd820 0x7f24ac0fcf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:05:49.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:49.132+0000 7f24b2415640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac0fd470 con 0x7f24ac0fd820 2024-09-18T21:05:49.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:49.132+0000 7f24abfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24ac0fd820 0x7f24ac0fcf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:05:49.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:49.132+0000 7f24abfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24ac0fd820 0x7f24ac0fcf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.103:38060/0 (socket says 172.21.15.103:38060) 2024-09-18T21:05:49.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:49.132+0000 7f24abfff640 1 -- 172.21.15.103:0/3317284909 learned_addr learned my addr 172.21.15.103:0/3317284909 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-18T21:05:49.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:49.132+0000 7f24abfff640 1 -- 172.21.15.103:0/3317284909 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f249c005040 con 0x7f24ac0fd820 2024-09-18T21:05:49.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:49.133+0000 7f24abfff640 1 --2- 172.21.15.103:0/3317284909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24ac0fd820 0x7f24ac0fcf30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f249c02a6d0 tx=0x7f249c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:05:49.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:49.133+0000 7f24a8ff9640 1 -- 172.21.15.103:0/3317284909 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f249c033630 con 0x7f24ac0fd820 2024-09-18T21:05:49.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:49.133+0000 7f24b2415640 1 -- 172.21.15.103:0/3317284909 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24ac0fb500 con 0x7f24ac0fd820 2024-09-18T21:05:49.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:49.133+0000 7f24a8ff9640 1 -- 172.21.15.103:0/3317284909 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f249c033c30 con 0x7f24ac0fd820 2024-09-18T21:05:49.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:49.133+0000 7f24a8ff9640 1 -- 172.21.15.103:0/3317284909 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f249c03dc00 con 0x7f24ac0fd820 2024-09-18T21:05:49.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:49.133+0000 7f24b2415640 1 -- 172.21.15.103:0/3317284909 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24ac0fb970 con 0x7f24ac0fd820 2024-09-18T21:05:49.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:49.134+0000 7f24a8ff9640 1 -- 172.21.15.103:0/3317284909 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) v1 ==== 45620+0+0 (secure 0 0 0) 0x7f249c030020 con 0x7f24ac0fd820 2024-09-18T21:05:49.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:49.134+0000 7f24b2415640 1 -- 172.21.15.103:0/3317284909 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24ac102600 con 0x7f24ac0fd820 2024-09-18T21:05:49.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:49.134+0000 7f24a8ff9640 1 --2- 172.21.15.103:0/3317284909 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f2494039670 0x7f249403bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:05:49.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:49.134+0000 7f24a8ff9640 1 -- 172.21.15.103:0/3317284909 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f249c06ce70 con 0x7f24ac0fd820 2024-09-18T21:05:49.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:49.134+0000 7f24ab7fe640 1 --2- 172.21.15.103:0/3317284909 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f2494039670 0x7f249403bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:05:49.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:49.134+0000 7f24ab7fe640 1 --2- 172.21.15.103:0/3317284909 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f2494039670 0x7f249403bb20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f24a0006fd0 tx=0x7f24a0006db0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:05:49.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:49.138+0000 7f24a8ff9640 1 -- 172.21.15.103:0/3317284909 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f249c03bb80 con 0x7f24ac0fd820 2024-09-18T21:05:49.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:49.359+0000 7f24b2415640 1 -- 172.21.15.103:0/3317284909 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f24ac05ed70 con 0x7f24ac0fd820 2024-09-18T21:05:49.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:49.360+0000 7f24a8ff9640 1 -- 172.21.15.103:0/3317284909 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f249c03b7e0 con 0x7f24ac0fd820 2024-09-18T21:05:49.364 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:05:49.364 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":1,"fsid":"5a76ec16-7601-11ef-bceb-c7b262605968","modified":"2024-09-18T21:03:43.159838Z","created":"2024-09-18T21:03:43.159838Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi077","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:3300","nonce":0},{"type":"v1","addr":"172.21.15.77:6789","nonce":0}]},"addr":"172.21.15.77:6789/0","public_addr":"172.21.15.77:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T21:05:49.365 INFO:teuthology.orchestra.run.smithi103.stderr:dumped monmap epoch 1 2024-09-18T21:05:49.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:49.362+0000 7f24b2415640 1 -- 172.21.15.103:0/3317284909 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f2494039670 msgr2=0x7f249403bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:05:49.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:49.362+0000 7f24b2415640 1 --2- 172.21.15.103:0/3317284909 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f2494039670 0x7f249403bb20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f24a0006fd0 tx=0x7f24a0006db0 comp rx=0 tx=0).stop 2024-09-18T21:05:49.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:49.362+0000 7f24b2415640 1 -- 172.21.15.103:0/3317284909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24ac0fd820 msgr2=0x7f24ac0fcf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:05:49.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:49.362+0000 7f24b2415640 1 --2- 172.21.15.103:0/3317284909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24ac0fd820 0x7f24ac0fcf30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f249c02a6d0 tx=0x7f249c009da0 comp rx=0 tx=0).stop 2024-09-18T21:05:49.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:49.362+0000 7f24b2415640 1 -- 172.21.15.103:0/3317284909 shutdown_connections 2024-09-18T21:05:49.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:49.362+0000 7f24b2415640 1 --2- 172.21.15.103:0/3317284909 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f2494039670 0x7f249403bb20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:05:49.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:49.362+0000 7f24b2415640 1 --2- 172.21.15.103:0/3317284909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24ac0fd820 0x7f24ac0fcf30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:05:49.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:49.362+0000 7f24b2415640 1 -- 172.21.15.103:0/3317284909 >> 172.21.15.103:0/3317284909 conn(0x7f24ac0f6040 msgr2=0x7f24ac0f6850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:05:49.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:49.362+0000 7f24b2415640 1 -- 172.21.15.103:0/3317284909 shutdown_connections 2024-09-18T21:05:49.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:49.362+0000 7f24b2415640 1 -- 172.21.15.103:0/3317284909 wait complete. 2024-09-18T21:05:49.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:49 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:49.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:49 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:49.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:49 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:49.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:49 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:49.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:49 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "who": "osd/host:smithi077", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:05:50.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:50 smithi077 ceph-mon[27689]: from='client.? 172.21.15.103:0/3317284909' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T21:05:50.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:50 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:50.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:50 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:50.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:50 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:50.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:50 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:50.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:50 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "who": "osd/host:smithi103", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:05:50.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:50 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:05:50.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:50 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:05:50.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:50 smithi077 ceph-mon[27689]: Updating smithi077:/etc/ceph/ceph.conf 2024-09-18T21:05:50.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:50 smithi077 ceph-mon[27689]: Updating smithi103:/etc/ceph/ceph.conf 2024-09-18T21:05:51.300 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T21:05:51.300 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T21:05:51.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:51 smithi077 ceph-mon[27689]: Updating smithi103:/var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T21:05:51.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:51 smithi077 ceph-mon[27689]: Updating smithi077:/var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T21:05:51.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:51 smithi077 ceph-mon[27689]: Updating smithi103:/etc/ceph/ceph.client.admin.keyring 2024-09-18T21:05:51.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:51 smithi077 ceph-mon[27689]: Updating smithi077:/etc/ceph/ceph.client.admin.keyring 2024-09-18T21:05:51.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:51 smithi077 ceph-mon[27689]: Updating smithi077:/var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T21:05:51.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:51 smithi077 ceph-mon[27689]: Updating smithi103:/var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T21:05:51.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:51 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:51.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:51 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:51.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:51 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:51.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:51 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:51.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:51 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:51.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:51 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi103", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-18T21:05:51.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:51 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi103", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-18T21:05:51.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:51 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:05:51.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:51 smithi077 ceph-mon[27689]: Deploying daemon crash.smithi103 on smithi103 2024-09-18T21:05:51.975 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T21:05:53.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:53.658+0000 7f4ed7aef640 1 -- 172.21.15.103:0/2654962177 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ed0102200 msgr2=0x7f4ed01025d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:05:53.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:53.658+0000 7f4ed7aef640 1 --2- 172.21.15.103:0/2654962177 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ed0102200 0x7f4ed01025d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc004850 tx=0x7f4ecc009da0 comp rx=0 tx=0).stop 2024-09-18T21:05:53.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:53.658+0000 7f4ed7aef640 1 -- 172.21.15.103:0/2654962177 shutdown_connections 2024-09-18T21:05:53.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:53.658+0000 7f4ed7aef640 1 --2- 172.21.15.103:0/2654962177 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ed0102200 0x7f4ed01025d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:05:53.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:53.658+0000 7f4ed7aef640 1 -- 172.21.15.103:0/2654962177 >> 172.21.15.103:0/2654962177 conn(0x7f4ed00f7dd0 msgr2=0x7f4ed00fa1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:05:53.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:53.658+0000 7f4ed7aef640 1 -- 172.21.15.103:0/2654962177 shutdown_connections 2024-09-18T21:05:53.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:53.658+0000 7f4ed7aef640 1 -- 172.21.15.103:0/2654962177 wait complete. 2024-09-18T21:05:53.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:53.659+0000 7f4ed7aef640 1 Processor -- start 2024-09-18T21:05:53.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:53.659+0000 7f4ed7aef640 1 -- start start 2024-09-18T21:05:53.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:53.659+0000 7f4ed7aef640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ed0102200 0x7f4ed0112780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:05:53.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:53.659+0000 7f4ed7aef640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed0112cc0 con 0x7f4ed0102200 2024-09-18T21:05:53.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:53.659+0000 7f4ed588b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ed0102200 0x7f4ed0112780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:05:53.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:53.659+0000 7f4ed588b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ed0102200 0x7f4ed0112780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.103:38074/0 (socket says 172.21.15.103:38074) 2024-09-18T21:05:53.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:53.659+0000 7f4ed588b640 1 -- 172.21.15.103:0/1409825586 learned_addr learned my addr 172.21.15.103:0/1409825586 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-18T21:05:53.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:53.660+0000 7f4ed588b640 1 -- 172.21.15.103:0/1409825586 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ecc005040 con 0x7f4ed0102200 2024-09-18T21:05:53.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:53.660+0000 7f4ed588b640 1 --2- 172.21.15.103:0/1409825586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ed0102200 0x7f4ed0112780 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc02a6d0 tx=0x7f4ecc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:05:53.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:53.660+0000 7f4ec67fc640 1 -- 172.21.15.103:0/1409825586 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4ecc02cf10 con 0x7f4ed0102200 2024-09-18T21:05:53.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:53.660+0000 7f4ec67fc640 1 -- 172.21.15.103:0/1409825586 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4ecc033ad0 con 0x7f4ed0102200 2024-09-18T21:05:53.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:53.660+0000 7f4ec67fc640 1 -- 172.21.15.103:0/1409825586 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4ecc03ebb0 con 0x7f4ed0102200 2024-09-18T21:05:53.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:53.660+0000 7f4ed7aef640 1 -- 172.21.15.103:0/1409825586 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed0112ec0 con 0x7f4ed0102200 2024-09-18T21:05:53.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:53.660+0000 7f4ed7aef640 1 -- 172.21.15.103:0/1409825586 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed0113390 con 0x7f4ed0102200 2024-09-18T21:05:53.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:53.661+0000 7f4ec67fc640 1 -- 172.21.15.103:0/1409825586 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) v1 ==== 45620+0+0 (secure 0 0 0) 0x7f4ecc030020 con 0x7f4ed0102200 2024-09-18T21:05:53.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:53.661+0000 7f4ed7aef640 1 -- 172.21.15.103:0/1409825586 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ed00fd970 con 0x7f4ed0102200 2024-09-18T21:05:53.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:53.662+0000 7f4ec67fc640 1 --2- 172.21.15.103:0/1409825586 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f4ebc039670 0x7f4ebc03bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:05:53.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:53.662+0000 7f4ec67fc640 1 -- 172.21.15.103:0/1409825586 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f4ecc06c550 con 0x7f4ed0102200 2024-09-18T21:05:53.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:53.662+0000 7f4ed508a640 1 --2- 172.21.15.103:0/1409825586 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f4ebc039670 0x7f4ebc03bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:05:53.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:53.662+0000 7f4ed508a640 1 --2- 172.21.15.103:0/1409825586 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f4ebc039670 0x7f4ebc03bb20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4ec0006fd0 tx=0x7f4ec0006db0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:05:53.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:53.667+0000 7f4ec67fc640 1 -- 172.21.15.103:0/1409825586 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4ecc043210 con 0x7f4ed0102200 2024-09-18T21:05:53.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:53.893+0000 7f4ed7aef640 1 -- 172.21.15.103:0/1409825586 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4ed0113390 con 0x7f4ed0102200 2024-09-18T21:05:53.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:53.893+0000 7f4ec67fc640 1 -- 172.21.15.103:0/1409825586 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f4ed0113390 con 0x7f4ed0102200 2024-09-18T21:05:53.895 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:05:53.895 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":1,"fsid":"5a76ec16-7601-11ef-bceb-c7b262605968","modified":"2024-09-18T21:03:43.159838Z","created":"2024-09-18T21:03:43.159838Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi077","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:3300","nonce":0},{"type":"v1","addr":"172.21.15.77:6789","nonce":0}]},"addr":"172.21.15.77:6789/0","public_addr":"172.21.15.77:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T21:05:53.896 INFO:teuthology.orchestra.run.smithi103.stderr:dumped monmap epoch 1 2024-09-18T21:05:53.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:53.895+0000 7f4ed7aef640 1 -- 172.21.15.103:0/1409825586 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f4ebc039670 msgr2=0x7f4ebc03bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:05:53.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:53.895+0000 7f4ed7aef640 1 --2- 172.21.15.103:0/1409825586 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f4ebc039670 0x7f4ebc03bb20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4ec0006fd0 tx=0x7f4ec0006db0 comp rx=0 tx=0).stop 2024-09-18T21:05:53.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:53.895+0000 7f4ed7aef640 1 -- 172.21.15.103:0/1409825586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ed0102200 msgr2=0x7f4ed0112780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:05:53.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:53.895+0000 7f4ed7aef640 1 --2- 172.21.15.103:0/1409825586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ed0102200 0x7f4ed0112780 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc02a6d0 tx=0x7f4ecc009da0 comp rx=0 tx=0).stop 2024-09-18T21:05:53.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:53.895+0000 7f4ed7aef640 1 -- 172.21.15.103:0/1409825586 shutdown_connections 2024-09-18T21:05:53.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:53.895+0000 7f4ed7aef640 1 --2- 172.21.15.103:0/1409825586 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f4ebc039670 0x7f4ebc03bb20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:05:53.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:53.895+0000 7f4ed7aef640 1 --2- 172.21.15.103:0/1409825586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ed0102200 0x7f4ed0112780 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:05:53.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:53.895+0000 7f4ed7aef640 1 -- 172.21.15.103:0/1409825586 >> 172.21.15.103:0/1409825586 conn(0x7f4ed00f7dd0 msgr2=0x7f4ed00f95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:05:53.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:53.895+0000 7f4ed7aef640 1 -- 172.21.15.103:0/1409825586 shutdown_connections 2024-09-18T21:05:53.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:53.896+0000 7f4ed7aef640 1 -- 172.21.15.103:0/1409825586 wait complete. 2024-09-18T21:05:54.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:53 smithi077 ceph-mon[27689]: from='client.? 172.21.15.103:0/1409825586' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T21:05:55.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:55 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:55.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:55 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:55.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:55 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:55.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:55 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:05:55.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:55 smithi077 ceph-mon[27689]: Deploying daemon node-exporter.smithi103 on smithi103 2024-09-18T21:05:55.772 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T21:05:55.772 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T21:05:56.021 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T21:05:58.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:58.602+0000 7fe856972640 1 -- 172.21.15.103:0/1594289554 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe850102200 msgr2=0x7fe8501025d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:05:58.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:58.602+0000 7fe856972640 1 --2- 172.21.15.103:0/1594289554 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe850102200 0x7fe8501025d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe840004850 tx=0x7fe840009da0 comp rx=0 tx=0).stop 2024-09-18T21:05:58.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:58.603+0000 7fe856972640 1 -- 172.21.15.103:0/1594289554 shutdown_connections 2024-09-18T21:05:58.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:58.603+0000 7fe856972640 1 --2- 172.21.15.103:0/1594289554 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe850102200 0x7fe8501025d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:05:58.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:58.603+0000 7fe856972640 1 -- 172.21.15.103:0/1594289554 >> 172.21.15.103:0/1594289554 conn(0x7fe8500f7dd0 msgr2=0x7fe8500fa1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:05:58.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:58.603+0000 7fe856972640 1 -- 172.21.15.103:0/1594289554 shutdown_connections 2024-09-18T21:05:58.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:58.603+0000 7fe856972640 1 -- 172.21.15.103:0/1594289554 wait complete. 2024-09-18T21:05:58.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:58.603+0000 7fe856972640 1 Processor -- start 2024-09-18T21:05:58.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:58.603+0000 7fe856972640 1 -- start start 2024-09-18T21:05:58.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:58.603+0000 7fe856972640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe850102200 0x7fe850112780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:05:58.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:58.604+0000 7fe856972640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe850112cc0 con 0x7fe850102200 2024-09-18T21:05:58.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:58.604+0000 7fe84ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe850102200 0x7fe850112780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:05:58.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:58.604+0000 7fe84ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe850102200 0x7fe850112780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.103:39274/0 (socket says 172.21.15.103:39274) 2024-09-18T21:05:58.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:58.604+0000 7fe84ffff640 1 -- 172.21.15.103:0/3459886459 learned_addr learned my addr 172.21.15.103:0/3459886459 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-18T21:05:58.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:58.604+0000 7fe84ffff640 1 -- 172.21.15.103:0/3459886459 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe840005040 con 0x7fe850102200 2024-09-18T21:05:58.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:58.604+0000 7fe84ffff640 1 --2- 172.21.15.103:0/3459886459 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe850102200 0x7fe850112780 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe84002a6d0 tx=0x7fe840009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:05:58.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:58.604+0000 7fe84cff9640 1 -- 172.21.15.103:0/3459886459 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe84002cf10 con 0x7fe850102200 2024-09-18T21:05:58.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:58.604+0000 7fe84cff9640 1 -- 172.21.15.103:0/3459886459 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe840033ad0 con 0x7fe850102200 2024-09-18T21:05:58.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:58.604+0000 7fe856972640 1 -- 172.21.15.103:0/3459886459 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe850112ec0 con 0x7fe850102200 2024-09-18T21:05:58.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:58.604+0000 7fe84cff9640 1 -- 172.21.15.103:0/3459886459 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe84003ebb0 con 0x7fe850102200 2024-09-18T21:05:58.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:58.604+0000 7fe856972640 1 -- 172.21.15.103:0/3459886459 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe850113390 con 0x7fe850102200 2024-09-18T21:05:58.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:58.605+0000 7fe856972640 1 -- 172.21.15.103:0/3459886459 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8500fd970 con 0x7fe850102200 2024-09-18T21:05:58.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:58.605+0000 7fe84cff9640 1 -- 172.21.15.103:0/3459886459 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) v1 ==== 45620+0+0 (secure 0 0 0) 0x7fe840030020 con 0x7fe850102200 2024-09-18T21:05:58.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:58.606+0000 7fe84cff9640 1 --2- 172.21.15.103:0/3459886459 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fe838039670 0x7fe83803bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:05:58.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:58.606+0000 7fe84cff9640 1 -- 172.21.15.103:0/3459886459 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fe84006c500 con 0x7fe850102200 2024-09-18T21:05:58.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:58.606+0000 7fe84f7fe640 1 --2- 172.21.15.103:0/3459886459 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fe838039670 0x7fe83803bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:05:58.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:58.606+0000 7fe84f7fe640 1 --2- 172.21.15.103:0/3459886459 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fe838039670 0x7fe83803bb20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe844006fd0 tx=0x7fe844006db0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:05:58.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:58.611+0000 7fe84cff9640 1 -- 172.21.15.103:0/3459886459 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe84003c930 con 0x7fe850102200 2024-09-18T21:05:58.856 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:05:58.856 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":1,"fsid":"5a76ec16-7601-11ef-bceb-c7b262605968","modified":"2024-09-18T21:03:43.159838Z","created":"2024-09-18T21:03:43.159838Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi077","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:3300","nonce":0},{"type":"v1","addr":"172.21.15.77:6789","nonce":0}]},"addr":"172.21.15.77:6789/0","public_addr":"172.21.15.77:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T21:05:58.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:58.836+0000 7fe856972640 1 -- 172.21.15.103:0/3459886459 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe850113390 con 0x7fe850102200 2024-09-18T21:05:58.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:58.836+0000 7fe84cff9640 1 -- 172.21.15.103:0/3459886459 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fe850113390 con 0x7fe850102200 2024-09-18T21:05:58.857 INFO:teuthology.orchestra.run.smithi103.stderr:dumped monmap epoch 1 2024-09-18T21:05:58.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:58.838+0000 7fe856972640 1 -- 172.21.15.103:0/3459886459 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fe838039670 msgr2=0x7fe83803bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:05:58.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:58.839+0000 7fe856972640 1 --2- 172.21.15.103:0/3459886459 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fe838039670 0x7fe83803bb20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe844006fd0 tx=0x7fe844006db0 comp rx=0 tx=0).stop 2024-09-18T21:05:58.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:58.839+0000 7fe856972640 1 -- 172.21.15.103:0/3459886459 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe850102200 msgr2=0x7fe850112780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:05:58.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:58.839+0000 7fe856972640 1 --2- 172.21.15.103:0/3459886459 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe850102200 0x7fe850112780 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe84002a6d0 tx=0x7fe840009da0 comp rx=0 tx=0).stop 2024-09-18T21:05:58.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:58.839+0000 7fe856972640 1 -- 172.21.15.103:0/3459886459 shutdown_connections 2024-09-18T21:05:58.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:58.839+0000 7fe856972640 1 --2- 172.21.15.103:0/3459886459 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fe838039670 0x7fe83803bb20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:05:58.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:58.839+0000 7fe856972640 1 --2- 172.21.15.103:0/3459886459 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe850102200 0x7fe850112780 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:05:58.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:58.839+0000 7fe856972640 1 -- 172.21.15.103:0/3459886459 >> 172.21.15.103:0/3459886459 conn(0x7fe8500f7dd0 msgr2=0x7fe8500f95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:05:58.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:58.839+0000 7fe856972640 1 -- 172.21.15.103:0/3459886459 shutdown_connections 2024-09-18T21:05:58.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:05:58.839+0000 7fe856972640 1 -- 172.21.15.103:0/3459886459 wait complete. 2024-09-18T21:06:00.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:59 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:00.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:59 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:00.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:59 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:00.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:59 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:00.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:59 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi103.zjztqc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T21:06:00.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:59 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi103.zjztqc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-18T21:06:00.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:59 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T21:06:00.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:59 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:06:00.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:59 smithi077 ceph-mon[27689]: Deploying daemon mgr.smithi103.zjztqc on smithi103 2024-09-18T21:06:00.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:59 smithi077 ceph-mon[27689]: from='client.? 172.21.15.103:0/3459886459' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T21:06:00.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:59 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:00.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:05:59 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:06:00.414 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T21:06:00.415 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T21:06:00.678 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T21:06:02.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:02.225+0000 7f0c1726d640 1 -- 172.21.15.103:0/3469052045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c10102200 msgr2=0x7f0c101025d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:06:02.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:02.225+0000 7f0c1726d640 1 --2- 172.21.15.103:0/3469052045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c10102200 0x7f0c101025d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0c00004850 tx=0x7f0c00009da0 comp rx=0 tx=0).stop 2024-09-18T21:06:02.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:02.225+0000 7f0c1726d640 1 -- 172.21.15.103:0/3469052045 shutdown_connections 2024-09-18T21:06:02.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:02.225+0000 7f0c1726d640 1 --2- 172.21.15.103:0/3469052045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c10102200 0x7f0c101025d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:06:02.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:02.225+0000 7f0c1726d640 1 -- 172.21.15.103:0/3469052045 >> 172.21.15.103:0/3469052045 conn(0x7f0c100f7dd0 msgr2=0x7f0c100fa1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:06:02.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:02.225+0000 7f0c1726d640 1 -- 172.21.15.103:0/3469052045 shutdown_connections 2024-09-18T21:06:02.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:02.225+0000 7f0c1726d640 1 -- 172.21.15.103:0/3469052045 wait complete. 2024-09-18T21:06:02.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:02.226+0000 7f0c1726d640 1 Processor -- start 2024-09-18T21:06:02.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:02.226+0000 7f0c1726d640 1 -- start start 2024-09-18T21:06:02.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:02.226+0000 7f0c1726d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c10102200 0x7f0c10112780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:06:02.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:02.226+0000 7f0c1726d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c10112cc0 con 0x7f0c10102200 2024-09-18T21:06:02.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:02.227+0000 7f0c15009640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c10102200 0x7f0c10112780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:06:02.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:02.227+0000 7f0c15009640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c10102200 0x7f0c10112780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.103:39292/0 (socket says 172.21.15.103:39292) 2024-09-18T21:06:02.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:02.227+0000 7f0c15009640 1 -- 172.21.15.103:0/3569876459 learned_addr learned my addr 172.21.15.103:0/3569876459 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-18T21:06:02.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:02.227+0000 7f0c15009640 1 -- 172.21.15.103:0/3569876459 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c00005040 con 0x7f0c10102200 2024-09-18T21:06:02.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:02.227+0000 7f0c15009640 1 --2- 172.21.15.103:0/3569876459 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c10102200 0x7f0c10112780 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0c0002a6d0 tx=0x7f0c00009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:06:02.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:02.227+0000 7f0c05ffb640 1 -- 172.21.15.103:0/3569876459 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0c0002cf10 con 0x7f0c10102200 2024-09-18T21:06:02.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:02.227+0000 7f0c05ffb640 1 -- 172.21.15.103:0/3569876459 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0c00033ad0 con 0x7f0c10102200 2024-09-18T21:06:02.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:02.227+0000 7f0c1726d640 1 -- 172.21.15.103:0/3569876459 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c10112ec0 con 0x7f0c10102200 2024-09-18T21:06:02.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:02.227+0000 7f0c05ffb640 1 -- 172.21.15.103:0/3569876459 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0c0003ebb0 con 0x7f0c10102200 2024-09-18T21:06:02.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:02.228+0000 7f0c1726d640 1 -- 172.21.15.103:0/3569876459 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c10113390 con 0x7f0c10102200 2024-09-18T21:06:02.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:02.228+0000 7f0c1726d640 1 -- 172.21.15.103:0/3569876459 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c100fd970 con 0x7f0c10102200 2024-09-18T21:06:02.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:02.228+0000 7f0c05ffb640 1 -- 172.21.15.103:0/3569876459 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) v1 ==== 45620+0+0 (secure 0 0 0) 0x7f0c00030020 con 0x7f0c10102200 2024-09-18T21:06:02.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:02.229+0000 7f0c05ffb640 1 --2- 172.21.15.103:0/3569876459 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f0bfc039670 0x7f0bfc03bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:06:02.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:02.229+0000 7f0c05ffb640 1 -- 172.21.15.103:0/3569876459 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f0c0006c5f0 con 0x7f0c10102200 2024-09-18T21:06:02.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:02.229+0000 7f0c14808640 1 --2- 172.21.15.103:0/3569876459 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f0bfc039670 0x7f0bfc03bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:06:02.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:02.229+0000 7f0c14808640 1 --2- 172.21.15.103:0/3569876459 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f0bfc039670 0x7f0bfc03bb20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c006fd0 tx=0x7f0c0c006db0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:06:02.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:02.234+0000 7f0c05ffb640 1 -- 172.21.15.103:0/3569876459 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0c0003c930 con 0x7f0c10102200 2024-09-18T21:06:02.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:02.460+0000 7f0c1726d640 1 -- 172.21.15.103:0/3569876459 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f0c10113390 con 0x7f0c10102200 2024-09-18T21:06:02.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:02.461+0000 7f0c05ffb640 1 -- 172.21.15.103:0/3569876459 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f0c10113390 con 0x7f0c10102200 2024-09-18T21:06:02.463 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:06:02.463 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":1,"fsid":"5a76ec16-7601-11ef-bceb-c7b262605968","modified":"2024-09-18T21:03:43.159838Z","created":"2024-09-18T21:03:43.159838Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi077","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:3300","nonce":0},{"type":"v1","addr":"172.21.15.77:6789","nonce":0}]},"addr":"172.21.15.77:6789/0","public_addr":"172.21.15.77:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-18T21:06:02.463 INFO:teuthology.orchestra.run.smithi103.stderr:dumped monmap epoch 1 2024-09-18T21:06:02.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:02.463+0000 7f0c1726d640 1 -- 172.21.15.103:0/3569876459 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f0bfc039670 msgr2=0x7f0bfc03bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:06:02.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:02.463+0000 7f0c1726d640 1 --2- 172.21.15.103:0/3569876459 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f0bfc039670 0x7f0bfc03bb20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c006fd0 tx=0x7f0c0c006db0 comp rx=0 tx=0).stop 2024-09-18T21:06:02.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:02.463+0000 7f0c1726d640 1 -- 172.21.15.103:0/3569876459 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c10102200 msgr2=0x7f0c10112780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:06:02.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:02.463+0000 7f0c1726d640 1 --2- 172.21.15.103:0/3569876459 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c10102200 0x7f0c10112780 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0c0002a6d0 tx=0x7f0c00009da0 comp rx=0 tx=0).stop 2024-09-18T21:06:02.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:02.463+0000 7f0c1726d640 1 -- 172.21.15.103:0/3569876459 shutdown_connections 2024-09-18T21:06:02.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:02.463+0000 7f0c1726d640 1 --2- 172.21.15.103:0/3569876459 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f0bfc039670 0x7f0bfc03bb20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:06:02.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:02.463+0000 7f0c1726d640 1 --2- 172.21.15.103:0/3569876459 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0c10102200 0x7f0c10112780 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:06:02.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:02.463+0000 7f0c1726d640 1 -- 172.21.15.103:0/3569876459 >> 172.21.15.103:0/3569876459 conn(0x7f0c100f7dd0 msgr2=0x7f0c100f95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:06:02.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:02.463+0000 7f0c1726d640 1 -- 172.21.15.103:0/3569876459 shutdown_connections 2024-09-18T21:06:02.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:02.463+0000 7f0c1726d640 1 -- 172.21.15.103:0/3569876459 wait complete. 2024-09-18T21:06:02.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:02 smithi077 ceph-mon[27689]: from='client.? 172.21.15.103:0/3569876459' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T21:06:04.037 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-18T21:06:04.037 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-18T21:06:04.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:04 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:04.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:04 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:04.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:04 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:04.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:04 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:04.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:04 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-18T21:06:04.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:04 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:06:04.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:04 smithi077 ceph-mon[27689]: Deploying daemon mon.smithi103 on smithi103 2024-09-18T21:06:04.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:04 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:05.464 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-18T21:06:05.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:05 smithi077 ceph-mon[27689]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:06:07.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:07.263+0000 7fccf8ad2640 1 -- 172.21.15.103:0/1492378786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccf41011f0 msgr2=0x7fccf41015c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:06:07.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:07.263+0000 7fccf8ad2640 1 --2- 172.21.15.103:0/1492378786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccf41011f0 0x7fccf41015c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcce4004850 tx=0x7fcce4009da0 comp rx=0 tx=0).stop 2024-09-18T21:06:07.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:07.263+0000 7fccf8ad2640 1 -- 172.21.15.103:0/1492378786 shutdown_connections 2024-09-18T21:06:07.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:07.263+0000 7fccf8ad2640 1 --2- 172.21.15.103:0/1492378786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccf41011f0 0x7fccf41015c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:06:07.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:07.263+0000 7fccf8ad2640 1 -- 172.21.15.103:0/1492378786 >> 172.21.15.103:0/1492378786 conn(0x7fccf40711c0 msgr2=0x7fccf40715c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:06:07.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:07.263+0000 7fccf8ad2640 1 -- 172.21.15.103:0/1492378786 shutdown_connections 2024-09-18T21:06:07.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:07.263+0000 7fccf8ad2640 1 -- 172.21.15.103:0/1492378786 wait complete. 2024-09-18T21:06:07.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:07.264+0000 7fccf8ad2640 1 Processor -- start 2024-09-18T21:06:07.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:07.264+0000 7fccf8ad2640 1 -- start start 2024-09-18T21:06:07.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:07.264+0000 7fccf8ad2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccf41011f0 0x7fccf410b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:06:07.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:07.264+0000 7fccf8ad2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf4065e60 con 0x7fccf41011f0 2024-09-18T21:06:07.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:07.264+0000 7fccf259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccf41011f0 0x7fccf410b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:06:07.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:07.264+0000 7fccf259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccf41011f0 0x7fccf410b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.103:55858/0 (socket says 172.21.15.103:55858) 2024-09-18T21:06:07.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:07.264+0000 7fccf259c640 1 -- 172.21.15.103:0/4132214688 learned_addr learned my addr 172.21.15.103:0/4132214688 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-18T21:06:07.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:07.264+0000 7fccf259c640 1 -- 172.21.15.103:0/4132214688 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce4005040 con 0x7fccf41011f0 2024-09-18T21:06:07.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:07.265+0000 7fccf259c640 1 --2- 172.21.15.103:0/4132214688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccf41011f0 0x7fccf410b660 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcce402a6d0 tx=0x7fcce4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:06:07.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:07.265+0000 7fcce2ffd640 1 -- 172.21.15.103:0/4132214688 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcce402cf10 con 0x7fccf41011f0 2024-09-18T21:06:07.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:07.265+0000 7fccf8ad2640 1 -- 172.21.15.103:0/4132214688 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccf410bba0 con 0x7fccf41011f0 2024-09-18T21:06:07.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:07.265+0000 7fcce2ffd640 1 -- 172.21.15.103:0/4132214688 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcce4033ad0 con 0x7fccf41011f0 2024-09-18T21:06:07.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:07.265+0000 7fccf8ad2640 1 -- 172.21.15.103:0/4132214688 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccf410c070 con 0x7fccf41011f0 2024-09-18T21:06:07.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:07.265+0000 7fcce2ffd640 1 -- 172.21.15.103:0/4132214688 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcce403eb50 con 0x7fccf41011f0 2024-09-18T21:06:07.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:07.266+0000 7fcce2ffd640 1 -- 172.21.15.103:0/4132214688 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) v1 ==== 45620+0+0 (secure 0 0 0) 0x7fcce4030020 con 0x7fccf41011f0 2024-09-18T21:06:07.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:07.266+0000 7fccf8ad2640 1 -- 172.21.15.103:0/4132214688 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccf40fc960 con 0x7fccf41011f0 2024-09-18T21:06:07.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:07.266+0000 7fcce2ffd640 1 --2- 172.21.15.103:0/4132214688 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fccdc039670 0x7fccdc03bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:06:07.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:07.266+0000 7fcce2ffd640 1 -- 172.21.15.103:0/4132214688 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fcce406c6f0 con 0x7fccf41011f0 2024-09-18T21:06:07.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:07.266+0000 7fccf1d9b640 1 --2- 172.21.15.103:0/4132214688 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fccdc039670 0x7fccdc03bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:06:07.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:07.267+0000 7fccf1d9b640 1 --2- 172.21.15.103:0/4132214688 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fccdc039670 0x7fccdc03bb20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcce8006fd0 tx=0x7fcce8006db0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:06:07.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:07.271+0000 7fcce2ffd640 1 -- 172.21.15.103:0/4132214688 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fcce403ecb0 con 0x7fccf41011f0 2024-09-18T21:06:07.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:07.323+0000 7fcce2ffd640 1 -- 172.21.15.103:0/4132214688 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcce403ecb0 con 0x7fccf41011f0 2024-09-18T21:06:07.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:07.506+0000 7fccf8ad2640 1 -- 172.21.15.103:0/4132214688 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fccf40f9760 con 0x7fccf41011f0 2024-09-18T21:06:07.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:07 smithi077 ceph-mon[27689]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:06:12.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:12.336+0000 7fcce2ffd640 1 -- 172.21.15.103:0/4132214688 <== mon.0 v2:172.21.15.77:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1017 (secure 0 0 0) 0x7fccf40f9760 con 0x7fccf41011f0 2024-09-18T21:06:12.337 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:06:12.338 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":2,"fsid":"5a76ec16-7601-11ef-bceb-c7b262605968","modified":"2024-09-18T21:06:07.324545Z","created":"2024-09-18T21:03:43.159838Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi077","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:3300","nonce":0},{"type":"v1","addr":"172.21.15.77:6789","nonce":0}]},"addr":"172.21.15.77:6789/0","public_addr":"172.21.15.77:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi103","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-18T21:06:12.338 INFO:teuthology.orchestra.run.smithi103.stderr:dumped monmap epoch 2 2024-09-18T21:06:12.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:12.339+0000 7fccf8ad2640 1 -- 172.21.15.103:0/4132214688 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fccdc039670 msgr2=0x7fccdc03bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:06:12.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:12.339+0000 7fccf8ad2640 1 --2- 172.21.15.103:0/4132214688 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fccdc039670 0x7fccdc03bb20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcce8006fd0 tx=0x7fcce8006db0 comp rx=0 tx=0).stop 2024-09-18T21:06:12.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:12.339+0000 7fccf8ad2640 1 -- 172.21.15.103:0/4132214688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccf41011f0 msgr2=0x7fccf410b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:06:12.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:12.339+0000 7fccf8ad2640 1 --2- 172.21.15.103:0/4132214688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccf41011f0 0x7fccf410b660 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcce402a6d0 tx=0x7fcce4009da0 comp rx=0 tx=0).stop 2024-09-18T21:06:12.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:12.339+0000 7fccf8ad2640 1 -- 172.21.15.103:0/4132214688 shutdown_connections 2024-09-18T21:06:12.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:12.339+0000 7fccf8ad2640 1 --2- 172.21.15.103:0/4132214688 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fccdc039670 0x7fccdc03bb20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:06:12.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:12.339+0000 7fccf8ad2640 1 --2- 172.21.15.103:0/4132214688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccf41011f0 0x7fccf410b660 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:06:12.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:12.339+0000 7fccf8ad2640 1 -- 172.21.15.103:0/4132214688 >> 172.21.15.103:0/4132214688 conn(0x7fccf40711c0 msgr2=0x7fccf40fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:06:12.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:12.339+0000 7fccf8ad2640 1 -- 172.21.15.103:0/4132214688 shutdown_connections 2024-09-18T21:06:12.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:06:12.339+0000 7fccf8ad2640 1 -- 172.21.15.103:0/4132214688 wait complete. 2024-09-18T21:06:12.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:12 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mon metadata", "id": "smithi077"}]: dispatch 2024-09-18T21:06:12.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:12 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mon metadata", "id": "smithi103"}]: dispatch 2024-09-18T21:06:12.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:12 smithi077 ceph-mon[27689]: mon.smithi077 calling monitor election 2024-09-18T21:06:12.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:12 smithi077 ceph-mon[27689]: from='client.? 172.21.15.103:0/4132214688' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-18T21:06:12.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:12 smithi077 ceph-mon[27689]: from='mgr.? 172.21.15.103:0/3054315164' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi103.zjztqc/crt"}]: dispatch 2024-09-18T21:06:12.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:12 smithi077 ceph-mon[27689]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:06:12.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:12 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mon metadata", "id": "smithi103"}]: dispatch 2024-09-18T21:06:12.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:12 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mon metadata", "id": "smithi103"}]: dispatch 2024-09-18T21:06:12.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:12 smithi077 ceph-mon[27689]: mon.smithi103 calling monitor election 2024-09-18T21:06:12.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:12 smithi077 ceph-mon[27689]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:06:12.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:12 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mon metadata", "id": "smithi103"}]: dispatch 2024-09-18T21:06:12.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:12 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mon metadata", "id": "smithi103"}]: dispatch 2024-09-18T21:06:12.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:12 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mon metadata", "id": "smithi103"}]: dispatch 2024-09-18T21:06:12.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:12 smithi077 ceph-mon[27689]: mon.smithi077 is new leader, mons smithi077,smithi103 in quorum (ranks 0,1) 2024-09-18T21:06:12.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:12 smithi077 ceph-mon[27689]: monmap e2: 2 mons at {smithi077=[v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0],smithi103=[v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-18T21:06:12.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:12 smithi077 ceph-mon[27689]: fsmap 2024-09-18T21:06:12.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:12 smithi077 ceph-mon[27689]: osdmap e5: 0 total, 0 up, 0 in 2024-09-18T21:06:12.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:12 smithi077 ceph-mon[27689]: mgrmap e17: smithi077.utkpjg(active, since 28s) 2024-09-18T21:06:12.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:12 smithi077 ceph-mon[27689]: overall HEALTH_OK 2024-09-18T21:06:12.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:12 smithi077 ceph-mon[27689]: Standby manager daemon smithi103.zjztqc started 2024-09-18T21:06:12.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:12 smithi077 ceph-mon[27689]: from='mgr.? 172.21.15.103:0/3054315164' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T21:06:12.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:12 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:12.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:12 smithi077 ceph-mon[27689]: from='mgr.? 172.21.15.103:0/3054315164' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi103.zjztqc/key"}]: dispatch 2024-09-18T21:06:12.715 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:12 smithi077 ceph-mon[27689]: from='mgr.? 172.21.15.103:0/3054315164' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T21:06:12.715 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:12 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:12.715 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:12 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:12.715 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:12 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:12.715 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:12 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:13.168 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-18T21:06:13.168 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-18T21:06:13.422 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:06:13.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:13 smithi077 ceph-mon[27689]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:06:13.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:13 smithi077 ceph-mon[27689]: mgrmap e18: smithi077.utkpjg(active, since 28s), standbys: smithi103.zjztqc 2024-09-18T21:06:13.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:13 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mgr metadata", "who": "smithi103.zjztqc", "id": "smithi103.zjztqc"}]: dispatch 2024-09-18T21:06:13.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:13 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:06:13.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:13 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mon metadata", "id": "smithi103"}]: dispatch 2024-09-18T21:06:14.415 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:14 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:06:14.415 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:14 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:14.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:14 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:14.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:14.872+0000 7facc3e71640 1 -- 172.21.15.77:0/1040641309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7facbc0fd1f0 msgr2=0x7facbc0fd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:06:14.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:14.872+0000 7facc3e71640 1 --2- 172.21.15.77:0/1040641309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7facbc0fd1f0 0x7facbc0fd5c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7facb8004850 tx=0x7facb8009da0 comp rx=0 tx=0).stop 2024-09-18T21:06:14.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:14.872+0000 7facc3e71640 1 -- 172.21.15.77:0/1040641309 shutdown_connections 2024-09-18T21:06:14.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:14.872+0000 7facc3e71640 1 --2- 172.21.15.77:0/1040641309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7facbc0fd1f0 0x7facbc0fd5c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:06:14.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:14.872+0000 7facc3e71640 1 -- 172.21.15.77:0/1040641309 >> 172.21.15.77:0/1040641309 conn(0x7facbc0f6d10 msgr2=0x7facbc0f9120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:06:14.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:14.872+0000 7facc3e71640 1 -- 172.21.15.77:0/1040641309 shutdown_connections 2024-09-18T21:06:14.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:14.872+0000 7facc3e71640 1 -- 172.21.15.77:0/1040641309 wait complete. 2024-09-18T21:06:14.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:14.872+0000 7facc3e71640 1 Processor -- start 2024-09-18T21:06:14.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:14.872+0000 7facc3e71640 1 -- start start 2024-09-18T21:06:14.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:14.873+0000 7facc3e71640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7facbc0fd1f0 0x7facbc0fb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:06:14.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:14.873+0000 7facc3e71640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7facbc0fb5f0 0x7facbc0fba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:06:14.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:14.873+0000 7facc3e71640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facbc118c20 con 0x7facbc0fb5f0 2024-09-18T21:06:14.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:14.873+0000 7facc3e71640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facbc118d60 con 0x7facbc0fd1f0 2024-09-18T21:06:14.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:14.873+0000 7facc140c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7facbc0fb5f0 0x7facbc0fba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:06:14.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:14.873+0000 7facc140c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7facbc0fb5f0 0x7facbc0fba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55714/0 (socket says 172.21.15.77:55714) 2024-09-18T21:06:14.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:14.873+0000 7facc140c640 1 -- 172.21.15.77:0/2239340539 learned_addr learned my addr 172.21.15.77:0/2239340539 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:06:14.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:14.873+0000 7facc1c0d640 1 --2- 172.21.15.77:0/2239340539 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7facbc0fd1f0 0x7facbc0fb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:06:14.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:14.873+0000 7facc140c640 1 -- 172.21.15.77:0/2239340539 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7facbc0fd1f0 msgr2=0x7facbc0fb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:06:14.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:14.873+0000 7facc140c640 1 --2- 172.21.15.77:0/2239340539 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7facbc0fd1f0 0x7facbc0fb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:06:14.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:14.873+0000 7facc140c640 1 -- 172.21.15.77:0/2239340539 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb8005040 con 0x7facbc0fb5f0 2024-09-18T21:06:14.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:14.873+0000 7facc140c640 1 --2- 172.21.15.77:0/2239340539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7facbc0fb5f0 0x7facbc0fba40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7facb000b7c0 tx=0x7facb00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:06:14.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:14.873+0000 7facae7fc640 1 -- 172.21.15.77:0/2239340539 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7facb000c910 con 0x7facbc0fb5f0 2024-09-18T21:06:14.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:14.873+0000 7facae7fc640 1 -- 172.21.15.77:0/2239340539 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7facb000be90 con 0x7facbc0fb5f0 2024-09-18T21:06:14.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:14.873+0000 7facc3e71640 1 -- 172.21.15.77:0/2239340539 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facbc118f60 con 0x7facbc0fb5f0 2024-09-18T21:06:14.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:14.873+0000 7facae7fc640 1 -- 172.21.15.77:0/2239340539 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7facb00133a0 con 0x7facbc0fb5f0 2024-09-18T21:06:14.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:14.873+0000 7facc3e71640 1 -- 172.21.15.77:0/2239340539 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facbc119400 con 0x7facbc0fb5f0 2024-09-18T21:06:14.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:14.875+0000 7facc3e71640 1 -- 172.21.15.77:0/2239340539 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facbc065aa0 con 0x7facbc0fb5f0 2024-09-18T21:06:14.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:14.875+0000 7facae7fc640 1 -- 172.21.15.77:0/2239340539 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) v1 ==== 90811+0+0 (secure 0 0 0) 0x7facb0014440 con 0x7facbc0fb5f0 2024-09-18T21:06:14.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:14.875+0000 7facae7fc640 1 --2- 172.21.15.77:0/2239340539 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7faca806edd0 0x7faca8071280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:06:14.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:14.876+0000 7facae7fc640 1 -- 172.21.15.77:0/2239340539 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7facb008c700 con 0x7facbc0fb5f0 2024-09-18T21:06:14.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:14.876+0000 7facc1c0d640 1 --2- 172.21.15.77:0/2239340539 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7faca806edd0 0x7faca8071280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:06:14.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:14.876+0000 7facc1c0d640 1 --2- 172.21.15.77:0/2239340539 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7faca806edd0 0x7faca8071280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7facb8032430 tx=0x7facb8009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:06:14.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:14.883+0000 7facae7fc640 1 -- 172.21.15.77:0/2239340539 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7facb005a9b0 con 0x7facbc0fb5f0 2024-09-18T21:06:15.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:15.054+0000 7facc3e71640 1 -- 172.21.15.77:0/2239340539 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7facbc05ed70 con 0x7facbc0fb5f0 2024-09-18T21:06:15.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:15.054+0000 7facae7fc640 1 -- 172.21.15.77:0/2239340539 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+225 (secure 0 0 0) 0x7facb0019100 con 0x7facbc0fb5f0 2024-09-18T21:06:15.055 INFO:teuthology.orchestra.run.smithi077.stdout:# minimal ceph.conf for 5a76ec16-7601-11ef-bceb-c7b262605968 2024-09-18T21:06:15.055 INFO:teuthology.orchestra.run.smithi077.stdout:[global] 2024-09-18T21:06:15.056 INFO:teuthology.orchestra.run.smithi077.stdout: fsid = 5a76ec16-7601-11ef-bceb-c7b262605968 2024-09-18T21:06:15.056 INFO:teuthology.orchestra.run.smithi077.stdout: mon_host = [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] 2024-09-18T21:06:15.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:15.056+0000 7facc3e71640 1 -- 172.21.15.77:0/2239340539 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7faca806edd0 msgr2=0x7faca8071280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:06:15.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:15.056+0000 7facc3e71640 1 --2- 172.21.15.77:0/2239340539 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7faca806edd0 0x7faca8071280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7facb8032430 tx=0x7facb8009da0 comp rx=0 tx=0).stop 2024-09-18T21:06:15.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:15.056+0000 7facc3e71640 1 -- 172.21.15.77:0/2239340539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7facbc0fb5f0 msgr2=0x7facbc0fba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:06:15.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:15.056+0000 7facc3e71640 1 --2- 172.21.15.77:0/2239340539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7facbc0fb5f0 0x7facbc0fba40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7facb000b7c0 tx=0x7facb00091d0 comp rx=0 tx=0).stop 2024-09-18T21:06:15.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:15.056+0000 7facc3e71640 1 -- 172.21.15.77:0/2239340539 shutdown_connections 2024-09-18T21:06:15.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:15.056+0000 7facc3e71640 1 --2- 172.21.15.77:0/2239340539 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7faca806edd0 0x7faca8071280 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:06:15.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:15.056+0000 7facc3e71640 1 --2- 172.21.15.77:0/2239340539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7facbc0fb5f0 0x7facbc0fba40 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:06:15.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:15.056+0000 7facc3e71640 1 --2- 172.21.15.77:0/2239340539 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7facbc0fd1f0 0x7facbc0fb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:06:15.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:15.056+0000 7facc3e71640 1 -- 172.21.15.77:0/2239340539 >> 172.21.15.77:0/2239340539 conn(0x7facbc0f6d10 msgr2=0x7facbc0f8a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:06:15.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:15.056+0000 7facc3e71640 1 -- 172.21.15.77:0/2239340539 shutdown_connections 2024-09-18T21:06:15.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:15.056+0000 7facc3e71640 1 -- 172.21.15.77:0/2239340539 wait complete. 2024-09-18T21:06:15.615 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-18T21:06:15.615 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-18T21:06:15.615 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/ceph/ceph.conf 2024-09-18T21:06:15.642 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-18T21:06:15.642 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-18T21:06:15.707 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-18T21:06:15.707 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/ceph/ceph.conf 2024-09-18T21:06:15.736 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-18T21:06:15.736 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-18T21:06:15.802 INFO:tasks.cephadm:Deploying OSDs... 2024-09-18T21:06:15.802 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-18T21:06:15.802 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/scratch_devs of=/dev/stdout 2024-09-18T21:06:15.818 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-18T21:06:15.818 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_1 2024-09-18T21:06:15.872 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-18T21:06:15.872 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T21:06:15.873 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-18T21:06:15.873 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T21:06:15.873 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T21:06:15.873 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-09-18 21:05:38.108061512 +0000 2024-09-18T21:06:15.873 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-09-18 21:00:04.956423554 +0000 2024-09-18T21:06:15.873 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-09-18 21:00:04.956423554 +0000 2024-09-18T21:06:15.873 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-09-18 21:00:04.956423554 +0000 2024-09-18T21:06:15.873 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-18T21:06:15.906 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:15 smithi077 ceph-mon[27689]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:06:15.906 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:15 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:15.906 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:15 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:15.906 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:15 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:06:15.906 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:15 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:06:15.907 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:15 smithi077 ceph-mon[27689]: Updating smithi077:/etc/ceph/ceph.conf 2024-09-18T21:06:15.907 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:15 smithi077 ceph-mon[27689]: Updating smithi103:/etc/ceph/ceph.conf 2024-09-18T21:06:15.907 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:15 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/2239340539' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:06:15.907 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:15 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:15.907 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:15 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:15.907 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:15 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:15.907 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:15 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:15.907 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:15 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:15.907 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:15 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-18T21:06:15.907 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:15 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-18T21:06:15.907 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:15 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:06:15.931 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-09-18T21:06:15.931 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-09-18T21:06:15.931 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.00023321 s, 2.2 MB/s 2024-09-18T21:06:15.933 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-18T21:06:15.989 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_2 2024-09-18T21:06:16.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:15 smithi103 ceph-mon[34827]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:06:16.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:15 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:16.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:15 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:16.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:15 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:06:16.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:15 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:06:16.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:15 smithi103 ceph-mon[34827]: Updating smithi077:/etc/ceph/ceph.conf 2024-09-18T21:06:16.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:15 smithi103 ceph-mon[34827]: Updating smithi103:/etc/ceph/ceph.conf 2024-09-18T21:06:16.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:15 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/2239340539' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:06:16.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:15 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:16.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:15 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:16.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:15 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:16.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:15 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:16.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:15 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:16.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:15 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-18T21:06:16.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:15 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-18T21:06:16.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:15 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:06:16.046 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-18T21:06:16.046 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T21:06:16.046 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-18T21:06:16.046 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T21:06:16.046 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T21:06:16.046 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-09-18 21:05:38.109061490 +0000 2024-09-18T21:06:16.046 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-09-18 21:00:05.284416491 +0000 2024-09-18T21:06:16.046 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-09-18 21:00:05.284416491 +0000 2024-09-18T21:06:16.046 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-09-18 21:00:05.284416491 +0000 2024-09-18T21:06:16.047 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-18T21:06:16.109 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-09-18T21:06:16.110 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-09-18T21:06:16.110 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000216087 s, 2.4 MB/s 2024-09-18T21:06:16.111 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-18T21:06:16.168 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_3 2024-09-18T21:06:16.223 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-18T21:06:16.224 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T21:06:16.224 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-18T21:06:16.224 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T21:06:16.224 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T21:06:16.224 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-09-18 21:05:38.109061490 +0000 2024-09-18T21:06:16.224 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-09-18 21:00:05.610409470 +0000 2024-09-18T21:06:16.224 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-09-18 21:00:05.610409470 +0000 2024-09-18T21:06:16.224 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-09-18 21:00:05.610409470 +0000 2024-09-18T21:06:16.224 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-18T21:06:16.286 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-09-18T21:06:16.287 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-09-18T21:06:16.287 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000190207 s, 2.7 MB/s 2024-09-18T21:06:16.288 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-18T21:06:16.343 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_4 2024-09-18T21:06:16.399 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-18T21:06:16.399 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T21:06:16.399 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-18T21:06:16.399 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T21:06:16.399 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T21:06:16.399 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-09-18 21:05:38.109061490 +0000 2024-09-18T21:06:16.399 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-09-18 21:00:05.933402515 +0000 2024-09-18T21:06:16.399 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-09-18 21:00:05.933402515 +0000 2024-09-18T21:06:16.399 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-09-18 21:00:05.933402515 +0000 2024-09-18T21:06:16.400 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-18T21:06:16.461 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-09-18T21:06:16.461 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-09-18T21:06:16.461 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000230427 s, 2.2 MB/s 2024-09-18T21:06:16.462 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-18T21:06:16.519 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-18T21:06:16.519 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/scratch_devs of=/dev/stdout 2024-09-18T21:06:16.538 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-18T21:06:16.538 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_1 2024-09-18T21:06:16.596 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-18T21:06:16.596 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T21:06:16.597 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-18T21:06:16.597 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T21:06:16.597 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T21:06:16.597 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-18 21:06:05.750541153 +0000 2024-09-18T21:06:16.597 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-18 21:00:15.411388222 +0000 2024-09-18T21:06:16.597 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-18 21:00:15.411388222 +0000 2024-09-18T21:06:16.597 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-09-18 21:00:15.411388222 +0000 2024-09-18T21:06:16.597 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-18T21:06:16.664 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-09-18T21:06:16.665 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-18T21:06:16.665 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.00038438 s, 1.3 MB/s 2024-09-18T21:06:16.666 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-18T21:06:16.725 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_2 2024-09-18T21:06:16.783 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-18T21:06:16.783 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T21:06:16.783 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-18T21:06:16.783 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T21:06:16.783 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T21:06:16.783 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-18 21:06:05.750541153 +0000 2024-09-18T21:06:16.783 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-18 21:00:15.728381917 +0000 2024-09-18T21:06:16.783 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-18 21:00:15.728381917 +0000 2024-09-18T21:06:16.783 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-09-18 21:00:15.728381917 +0000 2024-09-18T21:06:16.783 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-18T21:06:16.849 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-09-18T21:06:16.850 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-18T21:06:16.850 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000227513 s, 2.3 MB/s 2024-09-18T21:06:16.851 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-18T21:06:16.909 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_3 2024-09-18T21:06:16.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:16 smithi077 ceph-mon[27689]: Updating smithi103:/var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T21:06:16.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:16 smithi077 ceph-mon[27689]: Updating smithi077:/var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T21:06:16.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:16 smithi077 ceph-mon[27689]: Reconfiguring mon.smithi077 (unknown last config time)... 2024-09-18T21:06:16.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:16 smithi077 ceph-mon[27689]: Reconfiguring daemon mon.smithi077 on smithi077 2024-09-18T21:06:16.966 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-18T21:06:16.966 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T21:06:16.966 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-18T21:06:16.966 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T21:06:16.966 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T21:06:16.966 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-18 21:06:05.751541133 +0000 2024-09-18T21:06:16.966 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-18 21:00:16.052375472 +0000 2024-09-18T21:06:16.966 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-18 21:00:16.052375472 +0000 2024-09-18T21:06:16.966 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-09-18 21:00:16.052375472 +0000 2024-09-18T21:06:16.966 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-18T21:06:17.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:16 smithi103 ceph-mon[34827]: Updating smithi103:/var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T21:06:17.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:16 smithi103 ceph-mon[34827]: Updating smithi077:/var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T21:06:17.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:16 smithi103 ceph-mon[34827]: Reconfiguring mon.smithi077 (unknown last config time)... 2024-09-18T21:06:17.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:16 smithi103 ceph-mon[34827]: Reconfiguring daemon mon.smithi077 on smithi077 2024-09-18T21:06:17.032 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-09-18T21:06:17.032 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-18T21:06:17.032 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000220067 s, 2.3 MB/s 2024-09-18T21:06:17.033 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-18T21:06:17.090 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_4 2024-09-18T21:06:17.146 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-18T21:06:17.146 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-18T21:06:17.146 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-18T21:06:17.146 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T21:06:17.146 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-09-18T21:06:17.147 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-18 21:06:05.751541133 +0000 2024-09-18T21:06:17.147 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-18 21:00:16.355369446 +0000 2024-09-18T21:06:17.147 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-18 21:00:16.355369446 +0000 2024-09-18T21:06:17.147 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-09-18 21:00:16.355369446 +0000 2024-09-18T21:06:17.147 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-18T21:06:17.210 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-09-18T21:06:17.210 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-18T21:06:17.211 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000248366 s, 2.1 MB/s 2024-09-18T21:06:17.212 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-18T21:06:17.269 INFO:tasks.cephadm:Deploying osd.0 on smithi077 with /dev/vg_nvme/lv_4... 2024-09-18T21:06:17.269 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-18T21:06:17.863 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:06:17.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:17 smithi077 ceph-mon[27689]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:06:17.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:17 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:17.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:17 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:17.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:17 smithi077 ceph-mon[27689]: Reconfiguring mgr.smithi077.utkpjg (unknown last config time)... 2024-09-18T21:06:17.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:17 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi077.utkpjg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T21:06:17.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:17 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T21:06:17.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:17 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:06:17.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:17 smithi077 ceph-mon[27689]: Reconfiguring daemon mgr.smithi077.utkpjg on smithi077 2024-09-18T21:06:18.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:17 smithi103 ceph-mon[34827]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:06:18.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:17 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:18.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:17 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:18.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:17 smithi103 ceph-mon[34827]: Reconfiguring mgr.smithi077.utkpjg (unknown last config time)... 2024-09-18T21:06:18.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:17 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi077.utkpjg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T21:06:18.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:17 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T21:06:18.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:17 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:06:18.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:17 smithi103 ceph-mon[34827]: Reconfiguring daemon mgr.smithi077.utkpjg on smithi077 2024-09-18T21:06:19.136 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:18 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:19.136 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:18 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:19.136 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:18 smithi077 ceph-mon[27689]: Reconfiguring crash.smithi077 (monmap changed)... 2024-09-18T21:06:19.136 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:18 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi077", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-18T21:06:19.136 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:18 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:06:19.136 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:18 smithi077 ceph-mon[27689]: Reconfiguring daemon crash.smithi077 on smithi077 2024-09-18T21:06:19.136 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:18 smithi077 ceph-mon[27689]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:06:19.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:18 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:19.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:18 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:19.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:18 smithi103 ceph-mon[34827]: Reconfiguring crash.smithi077 (monmap changed)... 2024-09-18T21:06:19.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:18 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi077", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-18T21:06:19.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:18 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:06:19.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:18 smithi103 ceph-mon[34827]: Reconfiguring daemon crash.smithi077 on smithi077 2024-09-18T21:06:19.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:18 smithi103 ceph-mon[34827]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:06:21.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:20 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:21.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:20 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:21.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:20 smithi077 ceph-mon[27689]: Reconfiguring alertmanager.smithi077 (dependencies changed)... 2024-09-18T21:06:21.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:20 smithi077 ceph-mon[27689]: Reconfiguring daemon alertmanager.smithi077 on smithi077 2024-09-18T21:06:21.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:20 smithi077 ceph-mon[27689]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:06:21.230 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:06:21.250 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi077:vg_nvme/lv_4 2024-09-18T21:06:21.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:20 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:21.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:20 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:21.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:20 smithi103 ceph-mon[34827]: Reconfiguring alertmanager.smithi077 (dependencies changed)... 2024-09-18T21:06:21.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:20 smithi103 ceph-mon[34827]: Reconfiguring daemon alertmanager.smithi077 on smithi077 2024-09-18T21:06:21.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:20 smithi103 ceph-mon[34827]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:06:23.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:23 smithi077 ceph-mon[27689]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:06:23.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:23 smithi103 ceph-mon[34827]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:06:23.708 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:06:25.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:25 smithi077 ceph-mon[27689]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:06:25.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:25.252+0000 7fb28a8c1640 1 -- 172.21.15.77:0/4166144544 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb284065ba0 msgr2=0x7fb2840ff1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:06:25.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:25.252+0000 7fb28a8c1640 1 --2- 172.21.15.77:0/4166144544 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb284065ba0 0x7fb2840ff1e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb2740048d0 tx=0x7fb274009da0 comp rx=0 tx=0).stop 2024-09-18T21:06:25.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:25.252+0000 7fb28a8c1640 1 -- 172.21.15.77:0/4166144544 shutdown_connections 2024-09-18T21:06:25.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:25.252+0000 7fb28a8c1640 1 --2- 172.21.15.77:0/4166144544 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2840ff720 0x7fb284101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:06:25.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:25.252+0000 7fb28a8c1640 1 --2- 172.21.15.77:0/4166144544 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb284065ba0 0x7fb2840ff1e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:06:25.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:25.252+0000 7fb28a8c1640 1 -- 172.21.15.77:0/4166144544 >> 172.21.15.77:0/4166144544 conn(0x7fb2840f6c10 msgr2=0x7fb2840f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:06:25.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:25.252+0000 7fb28a8c1640 1 -- 172.21.15.77:0/4166144544 shutdown_connections 2024-09-18T21:06:25.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:25.252+0000 7fb28a8c1640 1 -- 172.21.15.77:0/4166144544 wait complete. 2024-09-18T21:06:25.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:25.252+0000 7fb28a8c1640 1 Processor -- start 2024-09-18T21:06:25.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:25.252+0000 7fb28a8c1640 1 -- start start 2024-09-18T21:06:25.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:25.253+0000 7fb28a8c1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb284065ba0 0x7fb28410d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:06:25.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:25.253+0000 7fb28a8c1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2840ff720 0x7fb28410d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:06:25.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:25.253+0000 7fb28a8c1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb28410e500 con 0x7fb284065ba0 2024-09-18T21:06:25.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:25.253+0000 7fb28a8c1640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb28410e670 con 0x7fb2840ff720 2024-09-18T21:06:25.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:25.253+0000 7fb283fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb284065ba0 0x7fb28410d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:06:25.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:25.253+0000 7fb283fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb284065ba0 0x7fb28410d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36818/0 (socket says 172.21.15.77:36818) 2024-09-18T21:06:25.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:25.253+0000 7fb283fff640 1 -- 172.21.15.77:0/3130555493 learned_addr learned my addr 172.21.15.77:0/3130555493 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:06:25.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:25.253+0000 7fb27bfff640 1 --2- 172.21.15.77:0/3130555493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2840ff720 0x7fb28410d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:06:25.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:25.253+0000 7fb283fff640 1 -- 172.21.15.77:0/3130555493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2840ff720 msgr2=0x7fb28410d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:06:25.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:25.253+0000 7fb283fff640 1 --2- 172.21.15.77:0/3130555493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2840ff720 0x7fb28410d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:06:25.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:25.253+0000 7fb283fff640 1 -- 172.21.15.77:0/3130555493 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb274005040 con 0x7fb284065ba0 2024-09-18T21:06:25.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:25.253+0000 7fb283fff640 1 --2- 172.21.15.77:0/3130555493 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb284065ba0 0x7fb28410d1a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb2740048a0 tx=0x7fb274009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:06:25.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:25.253+0000 7fb2817fa640 1 -- 172.21.15.77:0/3130555493 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb274038070 con 0x7fb284065ba0 2024-09-18T21:06:25.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:25.253+0000 7fb2817fa640 1 -- 172.21.15.77:0/3130555493 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb27402ae90 con 0x7fb284065ba0 2024-09-18T21:06:25.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:25.253+0000 7fb28a8c1640 1 -- 172.21.15.77:0/3130555493 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb28410e8f0 con 0x7fb284065ba0 2024-09-18T21:06:25.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:25.253+0000 7fb2817fa640 1 -- 172.21.15.77:0/3130555493 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb27402c8b0 con 0x7fb284065ba0 2024-09-18T21:06:25.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:25.253+0000 7fb28a8c1640 1 -- 172.21.15.77:0/3130555493 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb28410edb0 con 0x7fb284065ba0 2024-09-18T21:06:25.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:25.254+0000 7fb28a8c1640 1 -- 172.21.15.77:0/3130555493 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2841057f0 con 0x7fb284065ba0 2024-09-18T21:06:25.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:25.255+0000 7fb2817fa640 1 -- 172.21.15.77:0/3130555493 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) v1 ==== 90811+0+0 (secure 0 0 0) 0x7fb274030020 con 0x7fb284065ba0 2024-09-18T21:06:25.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:25.256+0000 7fb2817fa640 1 --2- 172.21.15.77:0/3130555493 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fb27006ecc0 0x7fb270071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:06:25.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:25.256+0000 7fb27bfff640 1 --2- 172.21.15.77:0/3130555493 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fb27006ecc0 0x7fb270071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:06:25.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:25.256+0000 7fb2817fa640 1 -- 172.21.15.77:0/3130555493 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fb2740ad690 con 0x7fb284065ba0 2024-09-18T21:06:25.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:25.256+0000 7fb27bfff640 1 --2- 172.21.15.77:0/3130555493 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fb27006ecc0 0x7fb270071170 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb26c006fd0 tx=0x7fb26c008040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:06:25.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:25.260+0000 7fb2817fa640 1 -- 172.21.15.77:0/3130555493 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb27407b910 con 0x7fb284065ba0 2024-09-18T21:06:25.317 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:25 smithi103 ceph-mon[34827]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:06:25.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:25.427+0000 7fb28a8c1640 1 -- 172.21.15.77:0/3130555493 --> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fb28410f020 con 0x7fb27006ecc0 2024-09-18T21:06:26.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:26 smithi077 ceph-mon[27689]: from='client.14236 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:06:26.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:26 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-18T21:06:26.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:26 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-18T21:06:26.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:26 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:06:26.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:26 smithi103 ceph-mon[34827]: from='client.14236 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:06:26.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:26 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-18T21:06:26.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:26 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-18T21:06:26.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:26 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:06:27.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:27 smithi077 ceph-mon[27689]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:06:27.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:27 smithi103 ceph-mon[34827]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:06:29.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:29 smithi103 ceph-mon[34827]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:06:29.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:29 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:29.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:29 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:29.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:29 smithi103 ceph-mon[34827]: Reconfiguring grafana.smithi077 (dependencies changed)... 2024-09-18T21:06:29.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:29 smithi103 ceph-mon[34827]: Reconfiguring daemon grafana.smithi077 on smithi077 2024-09-18T21:06:29.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:29 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/1434500388' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "309fcfaf-2c45-482b-a95a-92bedbd7a042"}]: dispatch 2024-09-18T21:06:29.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:29 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/1434500388' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "309fcfaf-2c45-482b-a95a-92bedbd7a042"}]': finished 2024-09-18T21:06:29.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:29 smithi103 ceph-mon[34827]: osdmap e6: 1 total, 0 up, 1 in 2024-09-18T21:06:29.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:29 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T21:06:29.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:29 smithi077 ceph-mon[27689]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:06:29.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:29 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:29.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:29 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:29.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:29 smithi077 ceph-mon[27689]: Reconfiguring grafana.smithi077 (dependencies changed)... 2024-09-18T21:06:29.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:29 smithi077 ceph-mon[27689]: Reconfiguring daemon grafana.smithi077 on smithi077 2024-09-18T21:06:29.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:29 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/1434500388' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "309fcfaf-2c45-482b-a95a-92bedbd7a042"}]: dispatch 2024-09-18T21:06:29.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:29 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/1434500388' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "309fcfaf-2c45-482b-a95a-92bedbd7a042"}]': finished 2024-09-18T21:06:29.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:29 smithi077 ceph-mon[27689]: osdmap e6: 1 total, 0 up, 1 in 2024-09-18T21:06:29.464 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:29 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T21:06:30.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:30 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:06:30.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:30 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/1443815799' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-18T21:06:30.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:30 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:06:30.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:30 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/1443815799' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-18T21:06:31.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:31 smithi077 ceph-mon[27689]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:06:31.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:31 smithi103 ceph-mon[34827]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:06:33.363 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:33 smithi077 ceph-mon[27689]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:06:33.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:33 smithi103 ceph-mon[34827]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:06:35.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:35 smithi077 ceph-mon[27689]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:06:35.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:35 smithi103 ceph-mon[34827]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:06:37.351 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:37 smithi077 ceph-mon[27689]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:06:37.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:37 smithi103 ceph-mon[34827]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:06:39.061 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:39 smithi077 ceph-mon[27689]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:06:39.062 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:39 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:39.062 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:39 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:39.062 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:39 smithi077 ceph-mon[27689]: Reconfiguring prometheus.smithi077 (dependencies changed)... 2024-09-18T21:06:39.062 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:39 smithi077 ceph-mon[27689]: Reconfiguring daemon prometheus.smithi077 on smithi077 2024-09-18T21:06:39.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:39 smithi103 ceph-mon[34827]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:06:39.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:39 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:39.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:39 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:39.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:39 smithi103 ceph-mon[34827]: Reconfiguring prometheus.smithi077 (dependencies changed)... 2024-09-18T21:06:39.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:39 smithi103 ceph-mon[34827]: Reconfiguring daemon prometheus.smithi077 on smithi077 2024-09-18T21:06:40.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:40 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-18T21:06:40.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:40 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:06:40.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:40 smithi077 ceph-mon[27689]: Deploying daemon osd.0 on smithi077 2024-09-18T21:06:40.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:40 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-18T21:06:40.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:40 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:06:40.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:40 smithi103 ceph-mon[34827]: Deploying daemon osd.0 on smithi077 2024-09-18T21:06:41.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:41 smithi077 ceph-mon[27689]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:06:41.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:41 smithi103 ceph-mon[34827]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:06:43.178 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:43 smithi077 ceph-mon[27689]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:06:43.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:43 smithi103 ceph-mon[34827]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:06:44.525 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:44 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:44.525 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:44 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:44.525 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:44 smithi077 ceph-mon[27689]: Reconfiguring crash.smithi103 (monmap changed)... 2024-09-18T21:06:44.525 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:44 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi103", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-18T21:06:44.525 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:44 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:06:44.525 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:44 smithi077 ceph-mon[27689]: Reconfiguring daemon crash.smithi103 on smithi103 2024-09-18T21:06:44.525 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:44 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:06:44.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:44 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:44.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:44 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:44.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:44 smithi103 ceph-mon[34827]: Reconfiguring crash.smithi103 (monmap changed)... 2024-09-18T21:06:44.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:44 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi103", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-18T21:06:44.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:44 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:06:44.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:44 smithi103 ceph-mon[34827]: Reconfiguring daemon crash.smithi103 on smithi103 2024-09-18T21:06:44.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:44 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:06:45.508 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:45 smithi103 ceph-mon[34827]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:06:45.508 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:45 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:45.508 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:45 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:45.508 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:45 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi103.zjztqc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T21:06:45.508 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:45 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T21:06:45.508 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:45 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:06:45.606 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:45 smithi077 ceph-mon[27689]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:06:45.607 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:45 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:45.607 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:45 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:45.607 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:45 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi103.zjztqc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T21:06:45.607 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:45 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T21:06:45.607 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:45 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:06:46.602 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:46 smithi077 ceph-mon[27689]: Reconfiguring mgr.smithi103.zjztqc (monmap changed)... 2024-09-18T21:06:46.602 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:46 smithi077 ceph-mon[27689]: Reconfiguring daemon mgr.smithi103.zjztqc on smithi103 2024-09-18T21:06:46.602 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:46 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:46.603 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:46 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:46.603 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:46 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-18T21:06:46.603 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:46 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-18T21:06:46.603 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:46 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:06:46.672 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:46 smithi103 ceph-mon[34827]: Reconfiguring mgr.smithi103.zjztqc (monmap changed)... 2024-09-18T21:06:46.672 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:46 smithi103 ceph-mon[34827]: Reconfiguring daemon mgr.smithi103.zjztqc on smithi103 2024-09-18T21:06:46.672 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:46 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:46.673 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:46 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:46.673 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:46 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-18T21:06:46.673 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:46 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-18T21:06:46.673 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:46 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:06:47.669 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:47 smithi077 ceph-mon[27689]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:06:47.669 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:47 smithi077 ceph-mon[27689]: Reconfiguring mon.smithi103 (monmap changed)... 2024-09-18T21:06:47.670 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:47 smithi077 ceph-mon[27689]: Reconfiguring daemon mon.smithi103 on smithi103 2024-09-18T21:06:47.670 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:47 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:47.670 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:47 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:47.670 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:47 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-18T21:06:47.670 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:47 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi077.front.sepia.ceph.com:9093"}]: dispatch 2024-09-18T21:06:47.670 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:47 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:47.670 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:47 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-18T21:06:47.670 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:47 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi077.front.sepia.ceph.com:3000"}]: dispatch 2024-09-18T21:06:47.670 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:47 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:47.670 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:47 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T21:06:47.670 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:47 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi077.front.sepia.ceph.com:9095"}]: dispatch 2024-09-18T21:06:47.670 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:47 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:47.670 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:47 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:06:47.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:47 smithi103 ceph-mon[34827]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:06:47.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:47 smithi103 ceph-mon[34827]: Reconfiguring mon.smithi103 (monmap changed)... 2024-09-18T21:06:47.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:47 smithi103 ceph-mon[34827]: Reconfiguring daemon mon.smithi103 on smithi103 2024-09-18T21:06:47.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:47 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:47.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:47 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:47.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:47 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-18T21:06:47.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:47 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi077.front.sepia.ceph.com:9093"}]: dispatch 2024-09-18T21:06:47.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:47 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:47.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:47 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-18T21:06:47.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:47 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi077.front.sepia.ceph.com:3000"}]: dispatch 2024-09-18T21:06:47.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:47 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:47.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:47 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T21:06:47.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:47 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi077.front.sepia.ceph.com:9095"}]: dispatch 2024-09-18T21:06:47.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:47 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:47.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:47 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:06:48.604 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:48 smithi077 ceph-mon[27689]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-18T21:06:48.604 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:48 smithi077 ceph-mon[27689]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi077.front.sepia.ceph.com:9093"}]: dispatch 2024-09-18T21:06:48.604 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:48 smithi077 ceph-mon[27689]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-18T21:06:48.605 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:48 smithi077 ceph-mon[27689]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi077.front.sepia.ceph.com:3000"}]: dispatch 2024-09-18T21:06:48.605 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:48 smithi077 ceph-mon[27689]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T21:06:48.605 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:48 smithi077 ceph-mon[27689]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi077.front.sepia.ceph.com:9095"}]: dispatch 2024-09-18T21:06:48.605 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:48 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:48.605 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:48 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:48.756 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:48 smithi103 ceph-mon[34827]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-18T21:06:48.756 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:48 smithi103 ceph-mon[34827]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi077.front.sepia.ceph.com:9093"}]: dispatch 2024-09-18T21:06:48.756 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:48 smithi103 ceph-mon[34827]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-18T21:06:48.756 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:48 smithi103 ceph-mon[34827]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi077.front.sepia.ceph.com:3000"}]: dispatch 2024-09-18T21:06:48.756 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:48 smithi103 ceph-mon[34827]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T21:06:48.756 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:48 smithi103 ceph-mon[34827]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi077.front.sepia.ceph.com:9095"}]: dispatch 2024-09-18T21:06:48.756 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:48 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:48.756 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:48 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:49.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:49 smithi077 ceph-mon[27689]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:06:49.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:49 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:49.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:49 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:49.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:49 smithi103 ceph-mon[34827]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:06:49.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:49 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:49.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:49 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:51.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:51.388+0000 7fb2817fa640 1 -- 172.21.15.77:0/3130555493 <== mgr.14206 v2:172.21.15.77:6800/950747822 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb28410f020 con 0x7fb27006ecc0 2024-09-18T21:06:51.389 INFO:teuthology.orchestra.run.smithi077.stdout:Created osd(s) 0 on host 'smithi077' 2024-09-18T21:06:51.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:51.390+0000 7fb28a8c1640 1 -- 172.21.15.77:0/3130555493 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fb27006ecc0 msgr2=0x7fb270071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:06:51.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:51.390+0000 7fb28a8c1640 1 --2- 172.21.15.77:0/3130555493 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fb27006ecc0 0x7fb270071170 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb26c006fd0 tx=0x7fb26c008040 comp rx=0 tx=0).stop 2024-09-18T21:06:51.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:51.390+0000 7fb28a8c1640 1 -- 172.21.15.77:0/3130555493 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb284065ba0 msgr2=0x7fb28410d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:06:51.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:51.390+0000 7fb28a8c1640 1 --2- 172.21.15.77:0/3130555493 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb284065ba0 0x7fb28410d1a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb2740048a0 tx=0x7fb274009da0 comp rx=0 tx=0).stop 2024-09-18T21:06:51.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:51.390+0000 7fb28a8c1640 1 -- 172.21.15.77:0/3130555493 shutdown_connections 2024-09-18T21:06:51.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:51.390+0000 7fb28a8c1640 1 --2- 172.21.15.77:0/3130555493 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fb27006ecc0 0x7fb270071170 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:06:51.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:51.390+0000 7fb28a8c1640 1 --2- 172.21.15.77:0/3130555493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2840ff720 0x7fb28410d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:06:51.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:51.390+0000 7fb28a8c1640 1 --2- 172.21.15.77:0/3130555493 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb284065ba0 0x7fb28410d1a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:06:51.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:51.390+0000 7fb28a8c1640 1 -- 172.21.15.77:0/3130555493 >> 172.21.15.77:0/3130555493 conn(0x7fb2840f6c10 msgr2=0x7fb2840f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:06:51.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:51.390+0000 7fb28a8c1640 1 -- 172.21.15.77:0/3130555493 shutdown_connections 2024-09-18T21:06:51.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:06:51.390+0000 7fb28a8c1640 1 -- 172.21.15.77:0/3130555493 wait complete. 2024-09-18T21:06:51.690 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:51 smithi077 ceph-mon[27689]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:06:51.690 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:51 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:51.690 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:51 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:51.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:51 smithi103 ceph-mon[34827]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:06:51.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:51 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:51.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:51 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:52.032 DEBUG:teuthology.orchestra.run.smithi077:osd.0> sudo journalctl -f -n 0 -u ceph-5a76ec16-7601-11ef-bceb-c7b262605968@osd.0.service 2024-09-18T21:06:52.034 INFO:tasks.cephadm:Deploying osd.1 on smithi077 with /dev/vg_nvme/lv_3... 2024-09-18T21:06:52.035 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-18T21:06:52.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:52 smithi077 ceph-mon[27689]: from='osd.0 [v2:172.21.15.77:6802/1327461769,v1:172.21.15.77:6803/1327461769]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-18T21:06:52.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:52 smithi103 ceph-mon[34827]: from='osd.0 [v2:172.21.15.77:6802/1327461769,v1:172.21.15.77:6803/1327461769]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-18T21:06:53.463 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:06:53.708 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:53 smithi077 ceph-mon[27689]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:06:53.709 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:53 smithi077 ceph-mon[27689]: from='osd.0 [v2:172.21.15.77:6802/1327461769,v1:172.21.15.77:6803/1327461769]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-18T21:06:53.709 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:53 smithi077 ceph-mon[27689]: osdmap e7: 1 total, 0 up, 1 in 2024-09-18T21:06:53.709 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:53 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T21:06:53.709 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:53 smithi077 ceph-mon[27689]: from='osd.0 [v2:172.21.15.77:6802/1327461769,v1:172.21.15.77:6803/1327461769]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-09-18T21:06:53.709 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:06:53 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-0[46974]: 2024-09-18T21:06:53.432+0000 7f89216ff640 -1 osd.0 0 waiting for initial osdmap 2024-09-18T21:06:53.709 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:06:53 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-0[46974]: 2024-09-18T21:06:53.436+0000 7f891ad33640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T21:06:53.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:53 smithi103 ceph-mon[34827]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:06:53.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:53 smithi103 ceph-mon[34827]: from='osd.0 [v2:172.21.15.77:6802/1327461769,v1:172.21.15.77:6803/1327461769]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-18T21:06:53.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:53 smithi103 ceph-mon[34827]: osdmap e7: 1 total, 0 up, 1 in 2024-09-18T21:06:53.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:53 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T21:06:53.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:53 smithi103 ceph-mon[34827]: from='osd.0 [v2:172.21.15.77:6802/1327461769,v1:172.21.15.77:6803/1327461769]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-09-18T21:06:54.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:54 smithi077 ceph-mon[27689]: from='osd.0 [v2:172.21.15.77:6802/1327461769,v1:172.21.15.77:6803/1327461769]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-09-18T21:06:54.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:54 smithi077 ceph-mon[27689]: osdmap e8: 1 total, 0 up, 1 in 2024-09-18T21:06:54.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:54 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T21:06:54.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:54 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T21:06:54.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:54 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:54.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:54 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:54.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:54 smithi103 ceph-mon[34827]: from='osd.0 [v2:172.21.15.77:6802/1327461769,v1:172.21.15.77:6803/1327461769]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-09-18T21:06:54.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:54 smithi103 ceph-mon[34827]: osdmap e8: 1 total, 0 up, 1 in 2024-09-18T21:06:54.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:54 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T21:06:54.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:54 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T21:06:54.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:54 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:54.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:54 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:55.659 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:55 smithi077 ceph-mon[27689]: purged_snaps scrub starts 2024-09-18T21:06:55.659 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:55 smithi077 ceph-mon[27689]: purged_snaps scrub ok 2024-09-18T21:06:55.659 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:55 smithi077 ceph-mon[27689]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:06:55.659 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:55 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T21:06:55.659 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:55 smithi077 ceph-mon[27689]: osd.0 [v2:172.21.15.77:6802/1327461769,v1:172.21.15.77:6803/1327461769] boot 2024-09-18T21:06:55.659 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:55 smithi077 ceph-mon[27689]: osdmap e9: 1 total, 1 up, 1 in 2024-09-18T21:06:55.659 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:55 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T21:06:55.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:55 smithi103 ceph-mon[34827]: purged_snaps scrub starts 2024-09-18T21:06:55.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:55 smithi103 ceph-mon[34827]: purged_snaps scrub ok 2024-09-18T21:06:55.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:55 smithi103 ceph-mon[34827]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-18T21:06:55.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:55 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T21:06:55.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:55 smithi103 ceph-mon[34827]: osd.0 [v2:172.21.15.77:6802/1327461769,v1:172.21.15.77:6803/1327461769] boot 2024-09-18T21:06:55.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:55 smithi103 ceph-mon[34827]: osdmap e9: 1 total, 1 up, 1 in 2024-09-18T21:06:55.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:55 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T21:06:56.544 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:56 smithi077 ceph-mon[27689]: osdmap e10: 1 total, 1 up, 1 in 2024-09-18T21:06:56.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:56 smithi103 ceph-mon[34827]: osdmap e10: 1 total, 1 up, 1 in 2024-09-18T21:06:57.235 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:06:57.255 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi077:vg_nvme/lv_3 2024-09-18T21:06:57.573 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:57 smithi077 ceph-mon[27689]: pgmap v34: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-18T21:06:57.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:57 smithi103 ceph-mon[34827]: pgmap v34: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-18T21:06:57.801 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:06:59.710 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:59 smithi077 ceph-mon[27689]: pgmap v35: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-18T21:06:59.710 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:59 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:06:59.710 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:59 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:59.710 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:59 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:59.710 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:59 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:06:59.710 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:59 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:59.710 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:59 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:06:59.711 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:59 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:06:59.711 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:59 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:59.711 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:06:59 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:06:59.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:59 smithi103 ceph-mon[34827]: pgmap v35: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-18T21:06:59.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:59 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:06:59.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:59 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:59.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:59 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:59.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:59 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:06:59.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:59 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:59.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:59 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:06:59.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:59 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:06:59.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:59 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:06:59.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:06:59 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:07:00.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:00.033+0000 7f1117686640 1 -- 172.21.15.77:0/1530612684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1110065c40 msgr2=0x7f1110101540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:07:00.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:00.033+0000 7f1117686640 1 --2- 172.21.15.77:0/1530612684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1110065c40 0x7f1110101540 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1100009c50 tx=0x7f1100004d10 comp rx=0 tx=0).stop 2024-09-18T21:07:00.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:00.034+0000 7f1117686640 1 -- 172.21.15.77:0/1530612684 shutdown_connections 2024-09-18T21:07:00.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:00.034+0000 7f1117686640 1 --2- 172.21.15.77:0/1530612684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1110101a80 0x7f1110103e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:07:00.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:00.034+0000 7f1117686640 1 --2- 172.21.15.77:0/1530612684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1110065c40 0x7f1110101540 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:07:00.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:00.034+0000 7f1117686640 1 -- 172.21.15.77:0/1530612684 >> 172.21.15.77:0/1530612684 conn(0x7f11100f6c10 msgr2=0x7f11100f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:07:00.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:00.034+0000 7f1117686640 1 -- 172.21.15.77:0/1530612684 shutdown_connections 2024-09-18T21:07:00.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:00.034+0000 7f1117686640 1 -- 172.21.15.77:0/1530612684 wait complete. 2024-09-18T21:07:00.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:00.034+0000 7f1117686640 1 Processor -- start 2024-09-18T21:07:00.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:00.034+0000 7f1117686640 1 -- start start 2024-09-18T21:07:00.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:00.034+0000 7f1117686640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1110065c40 0x7f111010f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:07:00.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:00.034+0000 7f1117686640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1110101a80 0x7f111010f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:07:00.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:00.034+0000 7f1117686640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1110110680 con 0x7f1110065c40 2024-09-18T21:07:00.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:00.034+0000 7f1117686640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11101107f0 con 0x7f1110101a80 2024-09-18T21:07:00.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:00.034+0000 7f1115422640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1110065c40 0x7f111010f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:07:00.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:00.034+0000 7f1115422640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1110065c40 0x7f111010f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48514/0 (socket says 172.21.15.77:48514) 2024-09-18T21:07:00.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:00.034+0000 7f1115422640 1 -- 172.21.15.77:0/1537582508 learned_addr learned my addr 172.21.15.77:0/1537582508 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:07:00.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:00.035+0000 7f1114c21640 1 --2- 172.21.15.77:0/1537582508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1110101a80 0x7f111010f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:07:00.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:00.035+0000 7f1115422640 1 -- 172.21.15.77:0/1537582508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1110101a80 msgr2=0x7f111010f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:07:00.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:00.035+0000 7f1115422640 1 --2- 172.21.15.77:0/1537582508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1110101a80 0x7f111010f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:07:00.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:00.035+0000 7f1115422640 1 -- 172.21.15.77:0/1537582508 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11000098b0 con 0x7f1110065c40 2024-09-18T21:07:00.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:00.035+0000 7f1114c21640 1 --2- 172.21.15.77:0/1537582508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1110101a80 0x7f111010f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T21:07:00.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:00.035+0000 7f1115422640 1 --2- 172.21.15.77:0/1537582508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1110065c40 0x7f111010f370 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1100000f80 tx=0x7f1100004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:07:00.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:00.035+0000 7f110dffb640 1 -- 172.21.15.77:0/1537582508 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1100032850 con 0x7f1110065c40 2024-09-18T21:07:00.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:00.035+0000 7f110dffb640 1 -- 172.21.15.77:0/1537582508 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1100009710 con 0x7f1110065c40 2024-09-18T21:07:00.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:00.035+0000 7f1117686640 1 -- 172.21.15.77:0/1537582508 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1110110a70 con 0x7f1110065c40 2024-09-18T21:07:00.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:00.035+0000 7f110dffb640 1 -- 172.21.15.77:0/1537582508 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f110003db20 con 0x7f1110065c40 2024-09-18T21:07:00.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:00.035+0000 7f1117686640 1 -- 172.21.15.77:0/1537582508 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1110110f90 con 0x7f1110065c40 2024-09-18T21:07:00.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:00.036+0000 7f1117686640 1 -- 172.21.15.77:0/1537582508 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11101079c0 con 0x7f1110065c40 2024-09-18T21:07:00.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:00.037+0000 7f110dffb640 1 -- 172.21.15.77:0/1537582508 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) v1 ==== 90811+0+0 (secure 0 0 0) 0x7f110002f030 con 0x7f1110065c40 2024-09-18T21:07:00.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:00.037+0000 7f110dffb640 1 --2- 172.21.15.77:0/1537582508 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f10f806ecc0 0x7f10f8071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:07:00.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:00.037+0000 7f1114c21640 1 --2- 172.21.15.77:0/1537582508 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f10f806ecc0 0x7f10f8071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:07:00.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:00.037+0000 7f110dffb640 1 -- 172.21.15.77:0/1537582508 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1978+0+0 (secure 0 0 0) 0x7f11000ae620 con 0x7f1110065c40 2024-09-18T21:07:00.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:00.038+0000 7f1114c21640 1 --2- 172.21.15.77:0/1537582508 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f10f806ecc0 0x7f10f8071170 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1104006fd0 tx=0x7f1104008040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:07:00.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:00.041+0000 7f110dffb640 1 -- 172.21.15.77:0/1537582508 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f110007c5c0 con 0x7f1110065c40 2024-09-18T21:07:00.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:00.222+0000 7f1117686640 1 -- 172.21.15.77:0/1537582508 --> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f11101111b0 con 0x7f10f806ecc0 2024-09-18T21:07:00.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:00 smithi077 ceph-mon[27689]: Detected new or changed devices on smithi077 2024-09-18T21:07:00.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:00 smithi077 ceph-mon[27689]: Adjusting osd_memory_target on smithi077 to 12864M 2024-09-18T21:07:00.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:00 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-18T21:07:00.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:00 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-18T21:07:00.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:00 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:07:00.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:00 smithi103 ceph-mon[34827]: Detected new or changed devices on smithi077 2024-09-18T21:07:00.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:00 smithi103 ceph-mon[34827]: Adjusting osd_memory_target on smithi077 to 12864M 2024-09-18T21:07:00.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:00 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-18T21:07:00.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:00 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-18T21:07:00.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:00 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:07:01.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:01 smithi077 ceph-mon[27689]: pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-18T21:07:01.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:01 smithi077 ceph-mon[27689]: from='client.14254 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:07:01.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:01 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:01.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:01 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:01.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:01 smithi103 ceph-mon[34827]: pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-18T21:07:01.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:01 smithi103 ceph-mon[34827]: from='client.14254 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:07:01.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:01 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:01.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:01 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:03.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:03 smithi077 ceph-mon[27689]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-18T21:07:03.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:03 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/1115730658' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "782aa0e2-9332-4440-b0ef-e5260e767374"}]: dispatch 2024-09-18T21:07:03.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:03 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/1115730658' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "782aa0e2-9332-4440-b0ef-e5260e767374"}]': finished 2024-09-18T21:07:03.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:03 smithi077 ceph-mon[27689]: osdmap e11: 2 total, 1 up, 2 in 2024-09-18T21:07:03.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:03 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T21:07:03.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:03 smithi103 ceph-mon[34827]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-18T21:07:03.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:03 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/1115730658' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "782aa0e2-9332-4440-b0ef-e5260e767374"}]: dispatch 2024-09-18T21:07:03.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:03 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/1115730658' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "782aa0e2-9332-4440-b0ef-e5260e767374"}]': finished 2024-09-18T21:07:03.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:03 smithi103 ceph-mon[34827]: osdmap e11: 2 total, 1 up, 2 in 2024-09-18T21:07:03.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:03 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T21:07:04.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:04 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/2592922684' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-18T21:07:04.861 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:04 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/2592922684' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-18T21:07:05.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:05 smithi103 ceph-mon[34827]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-18T21:07:05.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:05 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:05.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:05 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:05.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:05 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:07:05.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:05 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:07:05.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:05 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:05.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:05 smithi077 ceph-mon[27689]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-18T21:07:05.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:05 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:05.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:05 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:05.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:05 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:07:05.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:05 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:07:05.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:05 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:07.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:07 smithi103 ceph-mon[34827]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-18T21:07:07.923 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:07 smithi077 ceph-mon[27689]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-18T21:07:09.610 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:09 smithi077 ceph-mon[27689]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-18T21:07:09.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:09 smithi103 ceph-mon[34827]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-18T21:07:11.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:11 smithi103 ceph-mon[34827]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-18T21:07:11.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:11 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-18T21:07:11.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:11 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:07:11.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:11 smithi103 ceph-mon[34827]: Deploying daemon osd.1 on smithi077 2024-09-18T21:07:11.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:11 smithi077 ceph-mon[27689]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-18T21:07:11.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:11 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-18T21:07:11.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:11 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:07:11.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:11 smithi077 ceph-mon[27689]: Deploying daemon osd.1 on smithi077 2024-09-18T21:07:13.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:13 smithi077 ceph-mon[27689]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-18T21:07:13.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:13 smithi103 ceph-mon[34827]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-18T21:07:14.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:14 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:07:14.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:14 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:07:15.568 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:15 smithi077 ceph-mon[27689]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-18T21:07:15.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:15 smithi103 ceph-mon[34827]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-18T21:07:16.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:16 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:07:16.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:16 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:16.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:16 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:16.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:16 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:07:16.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:16 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:16.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:16 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:17.869 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:17 smithi077 ceph-mon[27689]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-18T21:07:17.869 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:17 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:17.869 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:17 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:18.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:17 smithi103 ceph-mon[34827]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-18T21:07:18.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:17 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:18.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:17 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:18.509 INFO:teuthology.orchestra.run.smithi077.stdout:Created osd(s) 1 on host 'smithi077' 2024-09-18T21:07:18.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:18.507+0000 7f110dffb640 1 -- 172.21.15.77:0/1537582508 <== mgr.14206 v2:172.21.15.77:6800/950747822 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f11101111b0 con 0x7f10f806ecc0 2024-09-18T21:07:18.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:18.509+0000 7f1117686640 1 -- 172.21.15.77:0/1537582508 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f10f806ecc0 msgr2=0x7f10f8071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:07:18.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:18.509+0000 7f1117686640 1 --2- 172.21.15.77:0/1537582508 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f10f806ecc0 0x7f10f8071170 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1104006fd0 tx=0x7f1104008040 comp rx=0 tx=0).stop 2024-09-18T21:07:18.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:18.509+0000 7f1117686640 1 -- 172.21.15.77:0/1537582508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1110065c40 msgr2=0x7f111010f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:07:18.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:18.510+0000 7f1117686640 1 --2- 172.21.15.77:0/1537582508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1110065c40 0x7f111010f370 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1100000f80 tx=0x7f1100004d10 comp rx=0 tx=0).stop 2024-09-18T21:07:18.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:18.510+0000 7f1117686640 1 -- 172.21.15.77:0/1537582508 shutdown_connections 2024-09-18T21:07:18.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:18.510+0000 7f1117686640 1 --2- 172.21.15.77:0/1537582508 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f10f806ecc0 0x7f10f8071170 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:07:18.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:18.510+0000 7f1117686640 1 --2- 172.21.15.77:0/1537582508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1110101a80 0x7f111010f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:07:18.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:18.510+0000 7f1117686640 1 --2- 172.21.15.77:0/1537582508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1110065c40 0x7f111010f370 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:07:18.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:18.510+0000 7f1117686640 1 -- 172.21.15.77:0/1537582508 >> 172.21.15.77:0/1537582508 conn(0x7f11100f6c10 msgr2=0x7f11100f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:07:18.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:18.510+0000 7f1117686640 1 -- 172.21.15.77:0/1537582508 shutdown_connections 2024-09-18T21:07:18.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:18.510+0000 7f1117686640 1 -- 172.21.15.77:0/1537582508 wait complete. 2024-09-18T21:07:19.212 DEBUG:teuthology.orchestra.run.smithi077:osd.1> sudo journalctl -f -n 0 -u ceph-5a76ec16-7601-11ef-bceb-c7b262605968@osd.1.service 2024-09-18T21:07:19.215 INFO:tasks.cephadm:Deploying osd.2 on smithi077 with /dev/vg_nvme/lv_2... 2024-09-18T21:07:19.215 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-18T21:07:19.523 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:07:19.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:19 smithi103 ceph-mon[34827]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-18T21:07:19.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:19 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:19.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:19 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:19.764 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:19 smithi077 ceph-mon[27689]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-18T21:07:19.765 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:19 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:19.765 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:19 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:19.765 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:07:19 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1[54168]: 2024-09-18T21:07:19.609+0000 7ff2397f7440 -1 osd.1 0 log_to_monitors true 2024-09-18T21:07:20.763 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:20 smithi077 ceph-mon[27689]: from='osd.1 [v2:172.21.15.77:6810/164854543,v1:172.21.15.77:6811/164854543]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-18T21:07:21.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:20 smithi103 ceph-mon[34827]: from='osd.1 [v2:172.21.15.77:6810/164854543,v1:172.21.15.77:6811/164854543]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-18T21:07:21.790 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:21 smithi103 ceph-mon[34827]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-18T21:07:21.790 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:21 smithi103 ceph-mon[34827]: from='osd.1 [v2:172.21.15.77:6810/164854543,v1:172.21.15.77:6811/164854543]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-18T21:07:21.790 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:21 smithi103 ceph-mon[34827]: osdmap e12: 2 total, 1 up, 2 in 2024-09-18T21:07:21.790 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:21 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T21:07:21.791 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:21 smithi103 ceph-mon[34827]: from='osd.1 [v2:172.21.15.77:6810/164854543,v1:172.21.15.77:6811/164854543]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-09-18T21:07:21.866 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:07:21 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1[54168]: 2024-09-18T21:07:21.515+0000 7ff23678e640 -1 osd.1 0 waiting for initial osdmap 2024-09-18T21:07:21.866 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:07:21 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1[54168]: 2024-09-18T21:07:21.519+0000 7ff22dd9c640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T21:07:21.866 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:21 smithi077 ceph-mon[27689]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-18T21:07:21.866 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:21 smithi077 ceph-mon[27689]: from='osd.1 [v2:172.21.15.77:6810/164854543,v1:172.21.15.77:6811/164854543]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-18T21:07:21.866 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:21 smithi077 ceph-mon[27689]: osdmap e12: 2 total, 1 up, 2 in 2024-09-18T21:07:21.866 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:21 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T21:07:21.866 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:21 smithi077 ceph-mon[27689]: from='osd.1 [v2:172.21.15.77:6810/164854543,v1:172.21.15.77:6811/164854543]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-09-18T21:07:22.633 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:22 smithi077 ceph-mon[27689]: from='osd.1 [v2:172.21.15.77:6810/164854543,v1:172.21.15.77:6811/164854543]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-09-18T21:07:22.633 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:22 smithi077 ceph-mon[27689]: osdmap e13: 2 total, 1 up, 2 in 2024-09-18T21:07:22.634 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:22 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T21:07:22.634 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:22 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T21:07:22.634 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:22 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T21:07:22.639 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:07:22.660 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi077:vg_nvme/lv_2 2024-09-18T21:07:23.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:22 smithi103 ceph-mon[34827]: from='osd.1 [v2:172.21.15.77:6810/164854543,v1:172.21.15.77:6811/164854543]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-09-18T21:07:23.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:22 smithi103 ceph-mon[34827]: osdmap e13: 2 total, 1 up, 2 in 2024-09-18T21:07:23.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:22 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T21:07:23.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:22 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T21:07:23.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:22 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T21:07:23.045 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:07:23.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:23 smithi077 ceph-mon[27689]: purged_snaps scrub starts 2024-09-18T21:07:23.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:23 smithi077 ceph-mon[27689]: purged_snaps scrub ok 2024-09-18T21:07:23.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:23 smithi077 ceph-mon[27689]: pgmap v50: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-18T21:07:23.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:23 smithi077 ceph-mon[27689]: osd.1 [v2:172.21.15.77:6810/164854543,v1:172.21.15.77:6811/164854543] boot 2024-09-18T21:07:23.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:23 smithi077 ceph-mon[27689]: osdmap e14: 2 total, 2 up, 2 in 2024-09-18T21:07:23.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:23 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T21:07:24.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:23 smithi103 ceph-mon[34827]: purged_snaps scrub starts 2024-09-18T21:07:24.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:23 smithi103 ceph-mon[34827]: purged_snaps scrub ok 2024-09-18T21:07:24.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:23 smithi103 ceph-mon[34827]: pgmap v50: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-18T21:07:24.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:23 smithi103 ceph-mon[34827]: osd.1 [v2:172.21.15.77:6810/164854543,v1:172.21.15.77:6811/164854543] boot 2024-09-18T21:07:24.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:23 smithi103 ceph-mon[34827]: osdmap e14: 2 total, 2 up, 2 in 2024-09-18T21:07:24.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:23 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T21:07:24.803 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:24 smithi077 ceph-mon[27689]: osdmap e15: 2 total, 2 up, 2 in 2024-09-18T21:07:25.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:24 smithi103 ceph-mon[34827]: osdmap e15: 2 total, 2 up, 2 in 2024-09-18T21:07:25.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:25 smithi077 ceph-mon[27689]: pgmap v53: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-18T21:07:25.915 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:25 smithi103 ceph-mon[34827]: pgmap v53: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-18T21:07:25.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:25.940+0000 7ff305602640 1 -- 172.21.15.77:0/385667299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3000fd1f0 msgr2=0x7ff3000fb620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:07:25.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:25.940+0000 7ff305602640 1 --2- 172.21.15.77:0/385667299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3000fd1f0 0x7ff3000fb620 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff2f40048d0 tx=0x7ff2f4009da0 comp rx=0 tx=0).stop 2024-09-18T21:07:25.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:25.940+0000 7ff305602640 1 -- 172.21.15.77:0/385667299 shutdown_connections 2024-09-18T21:07:25.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:25.940+0000 7ff305602640 1 --2- 172.21.15.77:0/385667299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3000fd1f0 0x7ff3000fb620 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:07:25.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:25.940+0000 7ff305602640 1 --2- 172.21.15.77:0/385667299 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3000fc8a0 0x7ff3000fccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:07:25.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:25.940+0000 7ff305602640 1 -- 172.21.15.77:0/385667299 >> 172.21.15.77:0/385667299 conn(0x7ff3000f61e0 msgr2=0x7ff3000f8610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:07:25.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:25.940+0000 7ff305602640 1 -- 172.21.15.77:0/385667299 shutdown_connections 2024-09-18T21:07:25.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:25.940+0000 7ff305602640 1 -- 172.21.15.77:0/385667299 wait complete. 2024-09-18T21:07:25.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:25.941+0000 7ff305602640 1 Processor -- start 2024-09-18T21:07:25.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:25.941+0000 7ff305602640 1 -- start start 2024-09-18T21:07:25.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:25.941+0000 7ff305602640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3000fc8a0 0x7ff30010be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:07:25.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:25.941+0000 7ff305602640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3000fd1f0 0x7ff30010c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:07:25.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:25.941+0000 7ff305602640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff30010c9f0 con 0x7ff3000fd1f0 2024-09-18T21:07:25.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:25.941+0000 7ff305602640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff30010d130 con 0x7ff3000fc8a0 2024-09-18T21:07:25.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:25.941+0000 7ff2fe7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3000fd1f0 0x7ff30010c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:07:25.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:25.941+0000 7ff2fe7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3000fd1f0 0x7ff30010c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57110/0 (socket says 172.21.15.77:57110) 2024-09-18T21:07:25.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:25.941+0000 7ff2fe7fc640 1 -- 172.21.15.77:0/2549817469 learned_addr learned my addr 172.21.15.77:0/2549817469 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:07:25.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:25.941+0000 7ff2feffd640 1 --2- 172.21.15.77:0/2549817469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3000fc8a0 0x7ff30010be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:07:25.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:25.941+0000 7ff2fe7fc640 1 -- 172.21.15.77:0/2549817469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3000fc8a0 msgr2=0x7ff30010be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:07:25.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:25.941+0000 7ff2fe7fc640 1 --2- 172.21.15.77:0/2549817469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3000fc8a0 0x7ff30010be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:07:25.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:25.941+0000 7ff2fe7fc640 1 -- 172.21.15.77:0/2549817469 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f4005040 con 0x7ff3000fd1f0 2024-09-18T21:07:25.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:25.942+0000 7ff2fe7fc640 1 --2- 172.21.15.77:0/2549817469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3000fd1f0 0x7ff30010c3a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff2f40048a0 tx=0x7ff2f4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:07:25.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:25.942+0000 7ff2e77fe640 1 -- 172.21.15.77:0/2549817469 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2f403a070 con 0x7ff3000fd1f0 2024-09-18T21:07:25.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:25.942+0000 7ff2e77fe640 1 -- 172.21.15.77:0/2549817469 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff2f40338c0 con 0x7ff3000fd1f0 2024-09-18T21:07:25.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:25.942+0000 7ff305602640 1 -- 172.21.15.77:0/2549817469 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff30010d360 con 0x7ff3000fd1f0 2024-09-18T21:07:25.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:25.942+0000 7ff2e77fe640 1 -- 172.21.15.77:0/2549817469 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2f403e930 con 0x7ff3000fd1f0 2024-09-18T21:07:25.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:25.943+0000 7ff305602640 1 -- 172.21.15.77:0/2549817469 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff30010d8a0 con 0x7ff3000fd1f0 2024-09-18T21:07:25.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:25.943+0000 7ff305602640 1 -- 172.21.15.77:0/2549817469 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff30005ed70 con 0x7ff3000fd1f0 2024-09-18T21:07:25.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:25.944+0000 7ff2e77fe640 1 -- 172.21.15.77:0/2549817469 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) v1 ==== 90811+0+0 (secure 0 0 0) 0x7ff2f4030020 con 0x7ff3000fd1f0 2024-09-18T21:07:25.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:25.944+0000 7ff2e77fe640 1 --2- 172.21.15.77:0/2549817469 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7ff2e806ecd0 0x7ff2e8071180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:07:25.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:25.944+0000 7ff2e77fe640 1 -- 172.21.15.77:0/2549817469 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2410+0+0 (secure 0 0 0) 0x7ff2f40af460 con 0x7ff3000fd1f0 2024-09-18T21:07:25.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:25.945+0000 7ff2feffd640 1 --2- 172.21.15.77:0/2549817469 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7ff2e806ecd0 0x7ff2e8071180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:07:25.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:25.945+0000 7ff2feffd640 1 --2- 172.21.15.77:0/2549817469 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7ff2e806ecd0 0x7ff2e8071180 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff30010bbf0 tx=0x7ff2f000b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:07:25.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:25.949+0000 7ff2e77fe640 1 -- 172.21.15.77:0/2549817469 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff2f407d380 con 0x7ff3000fd1f0 2024-09-18T21:07:26.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:26.130+0000 7ff305602640 1 -- 172.21.15.77:0/2549817469 --> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7ff30010dcc0 con 0x7ff2e806ecd0 2024-09-18T21:07:27.119 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:26 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:27.120 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:26 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:27.120 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:26 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-18T21:07:27.120 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:26 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-18T21:07:27.120 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:26 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:07:27.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:26 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:27.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:26 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:27.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:26 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-18T21:07:27.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:26 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-18T21:07:27.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:26 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:07:28.057 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:27 smithi077 ceph-mon[27689]: pgmap v54: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-18T21:07:28.057 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:27 smithi077 ceph-mon[27689]: from='client.14272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:07:28.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:27 smithi103 ceph-mon[34827]: pgmap v54: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-18T21:07:28.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:27 smithi103 ceph-mon[34827]: from='client.14272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:07:29.098 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:28 smithi077 ceph-mon[27689]: pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-18T21:07:29.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:28 smithi103 ceph-mon[34827]: pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-18T21:07:29.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:29 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:07:29.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:29 smithi077 ceph-mon[27689]: Detected new or changed devices on smithi077 2024-09-18T21:07:29.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:29 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:29.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:29 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:29.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:29 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:07:29.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:29 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:07:29.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:29 smithi077 ceph-mon[27689]: Adjusting osd_memory_target on smithi077 to 6432M 2024-09-18T21:07:29.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:29 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:29.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:29 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:07:29.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:29 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:07:29.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:29 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:29.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:29 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:07:30.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:29 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:07:30.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:29 smithi103 ceph-mon[34827]: Detected new or changed devices on smithi077 2024-09-18T21:07:30.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:29 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:30.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:29 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:30.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:29 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:07:30.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:29 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:07:30.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:29 smithi103 ceph-mon[34827]: Adjusting osd_memory_target on smithi077 to 6432M 2024-09-18T21:07:30.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:29 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:30.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:29 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:07:30.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:29 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:07:30.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:29 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:30.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:29 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:07:31.076 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:30 smithi077 ceph-mon[27689]: pgmap v56: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-18T21:07:31.076 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:30 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/3096445033' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d3bbcd5-1c51-42ec-a670-e5081188f7cf"}]: dispatch 2024-09-18T21:07:31.076 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:30 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/3096445033' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0d3bbcd5-1c51-42ec-a670-e5081188f7cf"}]': finished 2024-09-18T21:07:31.076 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:30 smithi077 ceph-mon[27689]: osdmap e16: 3 total, 2 up, 3 in 2024-09-18T21:07:31.076 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:30 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T21:07:31.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:30 smithi103 ceph-mon[34827]: pgmap v56: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-18T21:07:31.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:30 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/3096445033' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0d3bbcd5-1c51-42ec-a670-e5081188f7cf"}]: dispatch 2024-09-18T21:07:31.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:30 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/3096445033' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0d3bbcd5-1c51-42ec-a670-e5081188f7cf"}]': finished 2024-09-18T21:07:31.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:30 smithi103 ceph-mon[34827]: osdmap e16: 3 total, 2 up, 3 in 2024-09-18T21:07:31.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:30 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T21:07:32.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:31 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/3936515528' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-18T21:07:32.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:31 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/3936515528' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-18T21:07:33.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:32 smithi077 ceph-mon[27689]: pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-18T21:07:33.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:32 smithi103 ceph-mon[34827]: pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-18T21:07:34.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:34 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:34.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:34 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:34.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:34 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:07:34.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:34 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:07:34.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:34 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:35.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:34 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:35.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:34 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:35.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:34 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:07:35.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:34 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:07:35.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:34 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:35.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:35 smithi077 ceph-mon[27689]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-18T21:07:36.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:35 smithi103 ceph-mon[34827]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-18T21:07:37.918 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:37 smithi077 ceph-mon[27689]: pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-18T21:07:37.918 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:37 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-18T21:07:37.918 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:37 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:07:38.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:37 smithi103 ceph-mon[34827]: pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-18T21:07:38.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:37 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-18T21:07:38.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:37 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:07:38.834 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:38 smithi077 ceph-mon[27689]: Deploying daemon osd.2 on smithi077 2024-09-18T21:07:39.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:38 smithi103 ceph-mon[34827]: Deploying daemon osd.2 on smithi077 2024-09-18T21:07:40.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:39 smithi103 ceph-mon[34827]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-18T21:07:40.099 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:39 smithi077 ceph-mon[27689]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-18T21:07:41.931 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:41 smithi077 ceph-mon[27689]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-18T21:07:42.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:41 smithi103 ceph-mon[34827]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-18T21:07:43.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:42 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:07:43.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:42 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:43.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:42 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:43.061 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:42 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:07:43.061 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:42 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:43.061 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:42 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:43.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:43 smithi077 ceph-mon[27689]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-18T21:07:44.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:43 smithi103 ceph-mon[34827]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-18T21:07:45.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:44 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:07:45.160 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:44 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:07:45.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:45 smithi077 ceph-mon[27689]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-18T21:07:46.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:45 smithi103 ceph-mon[34827]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-18T21:07:46.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:46.139+0000 7ff2e77fe640 1 -- 172.21.15.77:0/2549817469 <== mgr.14206 v2:172.21.15.77:6800/950747822 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ff30010dcc0 con 0x7ff2e806ecd0 2024-09-18T21:07:46.139 INFO:teuthology.orchestra.run.smithi077.stdout:Created osd(s) 2 on host 'smithi077' 2024-09-18T21:07:46.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:46.141+0000 7ff305602640 1 -- 172.21.15.77:0/2549817469 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7ff2e806ecd0 msgr2=0x7ff2e8071180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:07:46.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:46.141+0000 7ff305602640 1 --2- 172.21.15.77:0/2549817469 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7ff2e806ecd0 0x7ff2e8071180 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff30010bbf0 tx=0x7ff2f000b040 comp rx=0 tx=0).stop 2024-09-18T21:07:46.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:46.141+0000 7ff305602640 1 -- 172.21.15.77:0/2549817469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3000fd1f0 msgr2=0x7ff30010c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:07:46.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:46.141+0000 7ff305602640 1 --2- 172.21.15.77:0/2549817469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3000fd1f0 0x7ff30010c3a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff2f40048a0 tx=0x7ff2f4009da0 comp rx=0 tx=0).stop 2024-09-18T21:07:46.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:46.141+0000 7ff305602640 1 -- 172.21.15.77:0/2549817469 shutdown_connections 2024-09-18T21:07:46.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:46.141+0000 7ff305602640 1 --2- 172.21.15.77:0/2549817469 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7ff2e806ecd0 0x7ff2e8071180 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:07:46.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:46.141+0000 7ff305602640 1 --2- 172.21.15.77:0/2549817469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3000fd1f0 0x7ff30010c3a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:07:46.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:46.141+0000 7ff305602640 1 --2- 172.21.15.77:0/2549817469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3000fc8a0 0x7ff30010be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:07:46.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:46.141+0000 7ff305602640 1 -- 172.21.15.77:0/2549817469 >> 172.21.15.77:0/2549817469 conn(0x7ff3000f61e0 msgr2=0x7ff3000f79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:07:46.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:46.141+0000 7ff305602640 1 -- 172.21.15.77:0/2549817469 shutdown_connections 2024-09-18T21:07:46.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:07:46.141+0000 7ff305602640 1 -- 172.21.15.77:0/2549817469 wait complete. 2024-09-18T21:07:46.691 DEBUG:teuthology.orchestra.run.smithi077:osd.2> sudo journalctl -f -n 0 -u ceph-5a76ec16-7601-11ef-bceb-c7b262605968@osd.2.service 2024-09-18T21:07:46.693 INFO:tasks.cephadm:Deploying osd.3 on smithi103 with /dev/vg_nvme/lv_4... 2024-09-18T21:07:46.693 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-18T21:07:46.947 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-18T21:07:47.363 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:47 smithi103 ceph-mon[34827]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-18T21:07:47.364 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:47 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:47.364 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:47 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:47.364 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:47 smithi103 ceph-mon[34827]: from='osd.2 [v2:172.21.15.77:6818/462691237,v1:172.21.15.77:6819/462691237]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-18T21:07:47.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:47 smithi077 ceph-mon[27689]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-18T21:07:47.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:47 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:47.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:47 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:47.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:47 smithi077 ceph-mon[27689]: from='osd.2 [v2:172.21.15.77:6818/462691237,v1:172.21.15.77:6819/462691237]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-18T21:07:48.460 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:48 smithi103 ceph-mon[34827]: from='osd.2 [v2:172.21.15.77:6818/462691237,v1:172.21.15.77:6819/462691237]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-18T21:07:48.460 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:48 smithi103 ceph-mon[34827]: osdmap e17: 3 total, 2 up, 3 in 2024-09-18T21:07:48.461 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:48 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T21:07:48.461 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:48 smithi103 ceph-mon[34827]: from='osd.2 [v2:172.21.15.77:6818/462691237,v1:172.21.15.77:6819/462691237]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-09-18T21:07:48.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:48 smithi077 ceph-mon[27689]: from='osd.2 [v2:172.21.15.77:6818/462691237,v1:172.21.15.77:6819/462691237]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-18T21:07:48.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:48 smithi077 ceph-mon[27689]: osdmap e17: 3 total, 2 up, 3 in 2024-09-18T21:07:48.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:48 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T21:07:48.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:48 smithi077 ceph-mon[27689]: from='osd.2 [v2:172.21.15.77:6818/462691237,v1:172.21.15.77:6819/462691237]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-09-18T21:07:48.463 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:07:48 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-2[61561]: 2024-09-18T21:07:48.151+0000 7fa22bc21640 -1 osd.2 0 waiting for initial osdmap 2024-09-18T21:07:48.463 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:07:48 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-2[61561]: 2024-09-18T21:07:48.158+0000 7fa227259640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T21:07:49.038 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:07:49.058 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi103:vg_nvme/lv_4 2024-09-18T21:07:49.314 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-18T21:07:49.338 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:49 smithi103 ceph-mon[34827]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-18T21:07:49.338 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:49 smithi103 ceph-mon[34827]: from='osd.2 [v2:172.21.15.77:6818/462691237,v1:172.21.15.77:6819/462691237]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-09-18T21:07:49.338 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:49 smithi103 ceph-mon[34827]: osdmap e18: 3 total, 2 up, 3 in 2024-09-18T21:07:49.338 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:49 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T21:07:49.338 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:49 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T21:07:49.338 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:49 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:49.338 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:49 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:49.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:49 smithi077 ceph-mon[27689]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-18T21:07:49.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:49 smithi077 ceph-mon[27689]: from='osd.2 [v2:172.21.15.77:6818/462691237,v1:172.21.15.77:6819/462691237]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-09-18T21:07:49.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:49 smithi077 ceph-mon[27689]: osdmap e18: 3 total, 2 up, 3 in 2024-09-18T21:07:49.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:49 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T21:07:49.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:49 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T21:07:49.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:49 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:49.480 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:49 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:50.329 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:50 smithi103 ceph-mon[34827]: purged_snaps scrub starts 2024-09-18T21:07:50.329 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:50 smithi103 ceph-mon[34827]: purged_snaps scrub ok 2024-09-18T21:07:50.329 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:50 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T21:07:50.329 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:50 smithi103 ceph-mon[34827]: osd.2 [v2:172.21.15.77:6818/462691237,v1:172.21.15.77:6819/462691237] boot 2024-09-18T21:07:50.329 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:50 smithi103 ceph-mon[34827]: osdmap e19: 3 total, 3 up, 3 in 2024-09-18T21:07:50.329 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:50 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T21:07:50.574 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:50 smithi077 ceph-mon[27689]: purged_snaps scrub starts 2024-09-18T21:07:50.575 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:50 smithi077 ceph-mon[27689]: purged_snaps scrub ok 2024-09-18T21:07:50.575 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:50 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T21:07:50.575 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:50 smithi077 ceph-mon[27689]: osd.2 [v2:172.21.15.77:6818/462691237,v1:172.21.15.77:6819/462691237] boot 2024-09-18T21:07:50.575 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:50 smithi077 ceph-mon[27689]: osdmap e19: 3 total, 3 up, 3 in 2024-09-18T21:07:50.575 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:50 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T21:07:50.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:07:50.687+0000 7f6a36783640 1 -- 172.21.15.103:0/2660162020 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a300fb470 msgr2=0x7f6a300fb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:07:50.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:07:50.687+0000 7f6a36783640 1 --2- 172.21.15.103:0/2660162020 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a300fb470 0x7f6a300fb880 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f6a200048d0 tx=0x7f6a20009da0 comp rx=0 tx=0).stop 2024-09-18T21:07:50.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:07:50.687+0000 7f6a36783640 1 -- 172.21.15.103:0/2660162020 shutdown_connections 2024-09-18T21:07:50.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:07:50.687+0000 7f6a36783640 1 --2- 172.21.15.103:0/2660162020 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a300fc740 0x7f6a300fcbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:07:50.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:07:50.687+0000 7f6a36783640 1 --2- 172.21.15.103:0/2660162020 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a300fb470 0x7f6a300fb880 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:07:50.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:07:50.687+0000 7f6a36783640 1 -- 172.21.15.103:0/2660162020 >> 172.21.15.103:0/2660162020 conn(0x7f6a300f6c10 msgr2=0x7f6a300f9060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:07:50.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:07:50.687+0000 7f6a36783640 1 -- 172.21.15.103:0/2660162020 shutdown_connections 2024-09-18T21:07:50.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:07:50.687+0000 7f6a36783640 1 -- 172.21.15.103:0/2660162020 wait complete. 2024-09-18T21:07:50.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:07:50.688+0000 7f6a36783640 1 Processor -- start 2024-09-18T21:07:50.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:07:50.688+0000 7f6a36783640 1 -- start start 2024-09-18T21:07:50.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:07:50.688+0000 7f6a36783640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a300fb470 0x7f6a300ff590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:07:50.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:07:50.688+0000 7f6a36783640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a300fc740 0x7f6a300fda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:07:50.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:07:50.688+0000 7f6a36783640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a300fe010 con 0x7f6a300fb470 2024-09-18T21:07:50.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:07:50.688+0000 7f6a36783640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a300fe150 con 0x7f6a300fc740 2024-09-18T21:07:50.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:07:50.688+0000 7f6a27fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a300fc740 0x7f6a300fda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:07:50.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:07:50.688+0000 7f6a2ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a300fb470 0x7f6a300ff590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:07:50.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:07:50.688+0000 7f6a27fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a300fc740 0x7f6a300fda80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38606/0 (socket says 172.21.15.103:38606) 2024-09-18T21:07:50.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:07:50.688+0000 7f6a27fff640 1 -- 172.21.15.103:0/1362827300 learned_addr learned my addr 172.21.15.103:0/1362827300 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-18T21:07:50.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:07:50.689+0000 7f6a27fff640 1 -- 172.21.15.103:0/1362827300 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a300fb470 msgr2=0x7f6a300ff590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:07:50.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:07:50.689+0000 7f6a27fff640 1 --2- 172.21.15.103:0/1362827300 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a300fb470 0x7f6a300ff590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:07:50.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:07:50.689+0000 7f6a27fff640 1 -- 172.21.15.103:0/1362827300 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a20005040 con 0x7f6a300fc740 2024-09-18T21:07:50.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:07:50.689+0000 7f6a2ffff640 1 --2- 172.21.15.103:0/1362827300 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a300fb470 0x7f6a300ff590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T21:07:50.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:07:50.689+0000 7f6a27fff640 1 --2- 172.21.15.103:0/1362827300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a300fc740 0x7f6a300fda80 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f6a18002a50 tx=0x7f6a18004600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:07:50.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:07:50.689+0000 7f6a2d7fa640 1 -- 172.21.15.103:0/1362827300 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a18007c30 con 0x7f6a300fc740 2024-09-18T21:07:50.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:07:50.689+0000 7f6a36783640 1 -- 172.21.15.103:0/1362827300 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a300fe430 con 0x7f6a300fc740 2024-09-18T21:07:50.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:07:50.689+0000 7f6a2d7fa640 1 -- 172.21.15.103:0/1362827300 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6a1800f040 con 0x7f6a300fc740 2024-09-18T21:07:50.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:07:50.689+0000 7f6a2d7fa640 1 -- 172.21.15.103:0/1362827300 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a180094b0 con 0x7f6a300fc740 2024-09-18T21:07:50.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:07:50.689+0000 7f6a36783640 1 -- 172.21.15.103:0/1362827300 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a301150d0 con 0x7f6a300fc740 2024-09-18T21:07:50.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:07:50.690+0000 7f6a36783640 1 -- 172.21.15.103:0/1362827300 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a300fa8d0 con 0x7f6a300fc740 2024-09-18T21:07:50.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:07:50.691+0000 7f6a2d7fa640 1 -- 172.21.15.103:0/1362827300 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 18) v1 ==== 90811+0+0 (secure 0 0 0) 0x7f6a1800dc50 con 0x7f6a300fc740 2024-09-18T21:07:50.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:07:50.691+0000 7f6a2d7fa640 1 --2- 172.21.15.103:0/1362827300 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f6a1c06ecc0 0x7f6a1c071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:07:50.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:07:50.691+0000 7f6a2d7fa640 1 -- 172.21.15.103:0/1362827300 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3217+0+0 (secure 0 0 0) 0x7f6a1808d590 con 0x7f6a300fc740 2024-09-18T21:07:50.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:07:50.691+0000 7f6a2ffff640 1 --2- 172.21.15.103:0/1362827300 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f6a1c06ecc0 0x7f6a1c071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:07:50.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:07:50.692+0000 7f6a2ffff640 1 --2- 172.21.15.103:0/1362827300 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f6a1c06ecc0 0x7f6a1c071170 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6a20000c00 tx=0x7f6a20035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:07:50.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:07:50.695+0000 7f6a2d7fa640 1 -- 172.21.15.103:0/1362827300 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f6a1805b050 con 0x7f6a300fc740 2024-09-18T21:07:50.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:07:50.855+0000 7f6a36783640 1 -- 172.21.15.103:0/1362827300 --> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a3005db50 con 0x7f6a1c06ecc0 2024-09-18T21:07:51.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:51 smithi103 ceph-mon[34827]: pgmap v70: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-18T21:07:51.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:51 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-09-18T21:07:51.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:51 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-09-18T21:07:51.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:51 smithi103 ceph-mon[34827]: osdmap e20: 3 total, 3 up, 3 in 2024-09-18T21:07:51.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:51 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-18T21:07:51.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:51 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-18T21:07:51.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:51 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-18T21:07:51.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:51 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:07:51.649 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:51 smithi077 ceph-mon[27689]: pgmap v70: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-18T21:07:51.649 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:51 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-09-18T21:07:51.649 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:51 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-09-18T21:07:51.649 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:51 smithi077 ceph-mon[27689]: osdmap e20: 3 total, 3 up, 3 in 2024-09-18T21:07:51.649 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:51 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-18T21:07:51.649 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:51 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-18T21:07:51.650 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:51 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-18T21:07:51.650 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:51 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:07:51.962 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:07:51 smithi077 sudo[66076]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-18T21:07:51.963 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:07:51 smithi077 sudo[66076]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-18T21:07:51.963 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:07:51 smithi077 sudo[66076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-18T21:07:51.963 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:07:51 smithi077 sudo[66076]: pam_unix(sudo:session): session closed for user root 2024-09-18T21:07:52.300 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:07:52 smithi077 sudo[66080]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-18T21:07:52.300 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:07:52 smithi077 sudo[66080]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-18T21:07:52.301 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:07:52 smithi077 sudo[66080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-18T21:07:52.301 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:07:52 smithi077 sudo[66080]: pam_unix(sudo:session): session closed for user root 2024-09-18T21:07:52.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:07:52.305+0000 7f6a2d7fa640 1 -- 172.21.15.103:0/1362827300 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f6a180575b0 con 0x7f6a300fc740 2024-09-18T21:07:52.393 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:52 smithi103 ceph-mon[34827]: from='client.24119 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:07:52.393 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:52 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-18T21:07:52.393 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:52 smithi103 ceph-mon[34827]: osdmap e21: 3 total, 3 up, 3 in 2024-09-18T21:07:52.393 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:52 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:52.615 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:52 smithi077 ceph-mon[27689]: from='client.24119 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:07:52.616 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:52 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-18T21:07:52.616 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:52 smithi077 ceph-mon[27689]: osdmap e21: 3 total, 3 up, 3 in 2024-09-18T21:07:52.616 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:52 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:52.616 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:07:52 smithi077 sudo[66086]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-18T21:07:52.616 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:07:52 smithi077 sudo[66086]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-18T21:07:52.616 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:07:52 smithi077 sudo[66086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-18T21:07:52.616 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:07:52 smithi077 sudo[66086]: pam_unix(sudo:session): session closed for user root 2024-09-18T21:07:52.876 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:07:52 smithi077 sudo[66187]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-18T21:07:52.876 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:07:52 smithi077 sudo[66187]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-18T21:07:52.876 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:07:52 smithi077 sudo[66187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-18T21:07:52.876 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:07:52 smithi077 sudo[66187]: pam_unix(sudo:session): session closed for user root 2024-09-18T21:07:53.138 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:07:52 smithi077 sudo[66275]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-18T21:07:53.138 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:07:52 smithi077 sudo[66275]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-18T21:07:53.138 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:07:52 smithi077 sudo[66275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-18T21:07:53.138 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:07:52 smithi077 sudo[66275]: pam_unix(sudo:session): session closed for user root 2024-09-18T21:07:53.397 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:07:53 smithi077 sudo[66293]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-18T21:07:53.397 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:07:53 smithi077 sudo[66293]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-18T21:07:53.398 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:07:53 smithi077 sudo[66293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-18T21:07:53.398 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:07:53 smithi077 sudo[66293]: pam_unix(sudo:session): session closed for user root 2024-09-18T21:07:53.656 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:53 smithi077 sudo[66339]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-18T21:07:53.656 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:53 smithi077 sudo[66339]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-18T21:07:53.656 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:53 smithi077 sudo[66339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-18T21:07:53.656 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:53 smithi077 sudo[66339]: pam_unix(sudo:session): session closed for user root 2024-09-18T21:07:53.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:53 smithi077 sudo[66381]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-18T21:07:53.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:53 smithi077 sudo[66381]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-18T21:07:53.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:53 smithi077 sudo[66381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-18T21:07:53.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:53 smithi077 sudo[66381]: pam_unix(sudo:session): session closed for user root 2024-09-18T21:07:53.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:53 smithi077 ceph-mon[27689]: pgmap v73: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-18T21:07:53.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:53 smithi077 ceph-mon[27689]: mgrmap e19: smithi077.utkpjg(active, since 2m), standbys: smithi103.zjztqc 2024-09-18T21:07:53.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:53 smithi077 ceph-mon[27689]: osdmap e22: 3 total, 3 up, 3 in 2024-09-18T21:07:53.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:53 smithi077 ceph-mon[27689]: Detected new or changed devices on smithi077 2024-09-18T21:07:53.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:53 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:53.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:53 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:53.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:53 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:07:53.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:53 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:07:53.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:53 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:07:53.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:53 smithi077 ceph-mon[27689]: Adjusting osd_memory_target on smithi077 to 4288M 2024-09-18T21:07:53.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:53 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:53.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:53 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:07:53.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:53 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:07:53.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:53 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:53.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:53 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:07:53.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:53 smithi077 ceph-mon[27689]: from='client.? 172.21.15.103:0/744783845' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "200136ca-fc2a-4917-af11-1c3c730126c6"}]: dispatch 2024-09-18T21:07:53.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:53 smithi077 ceph-mon[27689]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "200136ca-fc2a-4917-af11-1c3c730126c6"}]: dispatch 2024-09-18T21:07:53.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:53 smithi077 ceph-mon[27689]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "200136ca-fc2a-4917-af11-1c3c730126c6"}]': finished 2024-09-18T21:07:53.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:53 smithi077 ceph-mon[27689]: osdmap e23: 4 total, 3 up, 4 in 2024-09-18T21:07:53.965 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:53 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T21:07:53.965 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:53 smithi077 ceph-mon[27689]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-18T21:07:54.243 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:53 smithi103 sudo[38158]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-18T21:07:54.243 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:53 smithi103 sudo[38158]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-18T21:07:54.243 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:53 smithi103 sudo[38158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-18T21:07:54.244 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:54 smithi103 sudo[38158]: pam_unix(sudo:session): session closed for user root 2024-09-18T21:07:54.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:54 smithi103 sudo[38183]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-18T21:07:54.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:54 smithi103 sudo[38183]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-18T21:07:54.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:54 smithi103 sudo[38183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-18T21:07:54.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:54 smithi103 sudo[38183]: pam_unix(sudo:session): session closed for user root 2024-09-18T21:07:54.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:54 smithi103 ceph-mon[34827]: pgmap v73: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-18T21:07:54.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:54 smithi103 ceph-mon[34827]: mgrmap e19: smithi077.utkpjg(active, since 2m), standbys: smithi103.zjztqc 2024-09-18T21:07:54.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:54 smithi103 ceph-mon[34827]: osdmap e22: 3 total, 3 up, 3 in 2024-09-18T21:07:54.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:54 smithi103 ceph-mon[34827]: Detected new or changed devices on smithi077 2024-09-18T21:07:54.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:54 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:54.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:54 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:54.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:54 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:07:54.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:54 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:07:54.515 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:54 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:07:54.515 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:54 smithi103 ceph-mon[34827]: Adjusting osd_memory_target on smithi077 to 4288M 2024-09-18T21:07:54.515 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:54 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:54.515 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:54 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:07:54.515 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:54 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:07:54.515 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:54 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:54.515 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:54 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:07:54.515 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:54 smithi103 ceph-mon[34827]: from='client.? 172.21.15.103:0/744783845' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "200136ca-fc2a-4917-af11-1c3c730126c6"}]: dispatch 2024-09-18T21:07:54.515 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:54 smithi103 ceph-mon[34827]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "200136ca-fc2a-4917-af11-1c3c730126c6"}]: dispatch 2024-09-18T21:07:54.515 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:54 smithi103 ceph-mon[34827]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "200136ca-fc2a-4917-af11-1c3c730126c6"}]': finished 2024-09-18T21:07:54.515 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:54 smithi103 ceph-mon[34827]: osdmap e23: 4 total, 3 up, 4 in 2024-09-18T21:07:54.515 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:54 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T21:07:54.515 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:54 smithi103 ceph-mon[34827]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-18T21:07:54.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:54 smithi077 ceph-mon[27689]: from='client.? 172.21.15.103:0/2396354484' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-18T21:07:54.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:54 smithi077 ceph-mon[27689]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-18T21:07:54.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:54 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mon metadata", "id": "smithi077"}]: dispatch 2024-09-18T21:07:54.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:54 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mon metadata", "id": "smithi103"}]: dispatch 2024-09-18T21:07:54.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:54 smithi077 ceph-mon[27689]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-18T21:07:54.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:54 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mon metadata", "id": "smithi077"}]: dispatch 2024-09-18T21:07:54.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:54 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mon metadata", "id": "smithi103"}]: dispatch 2024-09-18T21:07:54.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:54 smithi077 ceph-mon[27689]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-18T21:07:54.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:54 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:55.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:54 smithi103 ceph-mon[34827]: from='client.? 172.21.15.103:0/2396354484' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-18T21:07:55.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:54 smithi103 ceph-mon[34827]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-18T21:07:55.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:54 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mon metadata", "id": "smithi077"}]: dispatch 2024-09-18T21:07:55.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:54 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mon metadata", "id": "smithi103"}]: dispatch 2024-09-18T21:07:55.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:54 smithi103 ceph-mon[34827]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-18T21:07:55.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:54 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mon metadata", "id": "smithi077"}]: dispatch 2024-09-18T21:07:55.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:54 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mon metadata", "id": "smithi103"}]: dispatch 2024-09-18T21:07:55.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:54 smithi103 ceph-mon[34827]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-18T21:07:55.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:54 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:55.798 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:55 smithi077 ceph-mon[27689]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-18T21:07:56.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:55 smithi103 ceph-mon[34827]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-18T21:07:57.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:57 smithi103 ceph-mon[34827]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-18T21:07:57.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:57 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:57.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:57 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:57.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:57 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:07:57.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:57 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:07:57.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:57 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:57.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:57 smithi077 ceph-mon[27689]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-18T21:07:57.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:57 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:57.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:57 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:57.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:57 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:07:57.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:57 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:07:57.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:57 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:07:59.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:59 smithi103 ceph-mon[34827]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-18T21:07:59.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:07:59 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:07:59.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:59 smithi077 ceph-mon[27689]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-18T21:07:59.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:07:59 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:08:00.575 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:00 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-18T21:08:00.576 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:00 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:08:00.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:00 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-18T21:08:00.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:00 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:08:01.476 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:01 smithi103 ceph-mon[34827]: Deploying daemon osd.3 on smithi103 2024-09-18T21:08:01.476 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:01 smithi103 ceph-mon[34827]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-18T21:08:01.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:01 smithi077 ceph-mon[27689]: Deploying daemon osd.3 on smithi103 2024-09-18T21:08:01.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:01 smithi077 ceph-mon[27689]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-18T21:08:03.424 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:03 smithi103 ceph-mon[34827]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-09-18T21:08:03.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:03 smithi077 ceph-mon[27689]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-09-18T21:08:05.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:05 smithi077 ceph-mon[27689]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-18T21:08:05.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:05 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:08:05.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:05 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:05.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:05 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:05.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:05 smithi103 ceph-mon[34827]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-18T21:08:05.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:05 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:08:05.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:05 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:05.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:05 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:07.645 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:07 smithi103 ceph-mon[34827]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-18T21:08:07.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:07 smithi077 ceph-mon[27689]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-18T21:08:07.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:07.950+0000 7f6a2d7fa640 1 -- 172.21.15.103:0/1362827300 <== mgr.14206 v2:172.21.15.77:6800/950747822 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f6a3005db50 con 0x7f6a1c06ecc0 2024-09-18T21:08:07.951 INFO:teuthology.orchestra.run.smithi103.stdout:Created osd(s) 3 on host 'smithi103' 2024-09-18T21:08:07.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:07.952+0000 7f6a36783640 1 -- 172.21.15.103:0/1362827300 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f6a1c06ecc0 msgr2=0x7f6a1c071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:08:07.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:07.952+0000 7f6a36783640 1 --2- 172.21.15.103:0/1362827300 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f6a1c06ecc0 0x7f6a1c071170 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6a20000c00 tx=0x7f6a20035040 comp rx=0 tx=0).stop 2024-09-18T21:08:07.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:07.952+0000 7f6a36783640 1 -- 172.21.15.103:0/1362827300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a300fc740 msgr2=0x7f6a300fda80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:08:07.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:07.952+0000 7f6a36783640 1 --2- 172.21.15.103:0/1362827300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a300fc740 0x7f6a300fda80 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f6a18002a50 tx=0x7f6a18004600 comp rx=0 tx=0).stop 2024-09-18T21:08:07.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:07.952+0000 7f6a36783640 1 -- 172.21.15.103:0/1362827300 shutdown_connections 2024-09-18T21:08:07.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:07.952+0000 7f6a36783640 1 --2- 172.21.15.103:0/1362827300 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f6a1c06ecc0 0x7f6a1c071170 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:08:07.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:07.952+0000 7f6a36783640 1 --2- 172.21.15.103:0/1362827300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a300fc740 0x7f6a300fda80 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:08:07.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:07.952+0000 7f6a36783640 1 --2- 172.21.15.103:0/1362827300 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a300fb470 0x7f6a300ff590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:08:07.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:07.952+0000 7f6a36783640 1 -- 172.21.15.103:0/1362827300 >> 172.21.15.103:0/1362827300 conn(0x7f6a300f6c10 msgr2=0x7f6a300660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:08:07.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:07.952+0000 7f6a36783640 1 -- 172.21.15.103:0/1362827300 shutdown_connections 2024-09-18T21:08:07.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:07.952+0000 7f6a36783640 1 -- 172.21.15.103:0/1362827300 wait complete. 2024-09-18T21:08:08.564 DEBUG:teuthology.orchestra.run.smithi103:osd.3> sudo journalctl -f -n 0 -u ceph-5a76ec16-7601-11ef-bceb-c7b262605968@osd.3.service 2024-09-18T21:08:08.566 INFO:tasks.cephadm:Deploying osd.4 on smithi103 with /dev/vg_nvme/lv_3... 2024-09-18T21:08:08.567 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-18T21:08:08.873 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-18T21:08:09.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:08 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:09.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:08 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:09.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:08 smithi077 ceph-mon[27689]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-18T21:08:09.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:08 smithi077 ceph-mon[27689]: from='osd.3 [v2:172.21.15.103:6800/2640098104,v1:172.21.15.103:6801/2640098104]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-18T21:08:09.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:08 smithi077 ceph-mon[27689]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-18T21:08:09.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:08 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:09.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:08 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:09.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:08 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:09.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:08 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:09.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:08 smithi103 ceph-mon[34827]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-18T21:08:09.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:08 smithi103 ceph-mon[34827]: from='osd.3 [v2:172.21.15.103:6800/2640098104,v1:172.21.15.103:6801/2640098104]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-18T21:08:09.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:08 smithi103 ceph-mon[34827]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-18T21:08:09.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:08 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:09.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:08 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:09.990 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:09 smithi103 ceph-mon[34827]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-18T21:08:09.990 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:09 smithi103 ceph-mon[34827]: osdmap e24: 4 total, 3 up, 4 in 2024-09-18T21:08:09.990 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:09 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T21:08:09.990 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:09 smithi103 ceph-mon[34827]: from='osd.3 [v2:172.21.15.103:6800/2640098104,v1:172.21.15.103:6801/2640098104]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-18T21:08:09.990 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:09 smithi103 ceph-mon[34827]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-18T21:08:09.990 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:08:09 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3[40154]: 2024-09-18T21:08:09.964+0000 7f2277d91640 -1 osd.3 0 waiting for initial osdmap 2024-09-18T21:08:09.990 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:08:09 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3[40154]: 2024-09-18T21:08:09.970+0000 7f2274bcc640 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T21:08:10.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:09 smithi077 ceph-mon[27689]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-18T21:08:10.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:09 smithi077 ceph-mon[27689]: osdmap e24: 4 total, 3 up, 4 in 2024-09-18T21:08:10.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:09 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T21:08:10.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:09 smithi077 ceph-mon[27689]: from='osd.3 [v2:172.21.15.103:6800/2640098104,v1:172.21.15.103:6801/2640098104]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-18T21:08:10.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:09 smithi077 ceph-mon[27689]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-18T21:08:11.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:10 smithi103 ceph-mon[34827]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-09-18T21:08:11.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:10 smithi103 ceph-mon[34827]: osdmap e25: 4 total, 3 up, 4 in 2024-09-18T21:08:11.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:10 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T21:08:11.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:10 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T21:08:11.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:10 smithi103 ceph-mon[34827]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-18T21:08:11.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:10 smithi103 ceph-mon[34827]: osd.3 [v2:172.21.15.103:6800/2640098104,v1:172.21.15.103:6801/2640098104] boot 2024-09-18T21:08:11.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:10 smithi103 ceph-mon[34827]: osdmap e26: 4 total, 4 up, 4 in 2024-09-18T21:08:11.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:10 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T21:08:11.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:10 smithi077 ceph-mon[27689]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-09-18T21:08:11.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:10 smithi077 ceph-mon[27689]: osdmap e25: 4 total, 3 up, 4 in 2024-09-18T21:08:11.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:10 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T21:08:11.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:10 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T21:08:11.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:10 smithi077 ceph-mon[27689]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-18T21:08:11.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:10 smithi077 ceph-mon[27689]: osd.3 [v2:172.21.15.103:6800/2640098104,v1:172.21.15.103:6801/2640098104] boot 2024-09-18T21:08:11.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:10 smithi077 ceph-mon[27689]: osdmap e26: 4 total, 4 up, 4 in 2024-09-18T21:08:11.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:10 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T21:08:11.801 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:08:11.826 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi103:vg_nvme/lv_3 2024-09-18T21:08:12.102 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:11 smithi103 ceph-mon[34827]: purged_snaps scrub starts 2024-09-18T21:08:12.102 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:11 smithi103 ceph-mon[34827]: purged_snaps scrub ok 2024-09-18T21:08:12.103 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:11 smithi103 ceph-mon[34827]: osdmap e27: 4 total, 4 up, 4 in 2024-09-18T21:08:12.344 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-18T21:08:12.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:11 smithi077 ceph-mon[27689]: purged_snaps scrub starts 2024-09-18T21:08:12.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:11 smithi077 ceph-mon[27689]: purged_snaps scrub ok 2024-09-18T21:08:12.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:11 smithi077 ceph-mon[27689]: osdmap e27: 4 total, 4 up, 4 in 2024-09-18T21:08:13.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:12 smithi103 ceph-mon[34827]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-18T21:08:13.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:12 smithi103 ceph-mon[34827]: osdmap e28: 4 total, 4 up, 4 in 2024-09-18T21:08:13.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:12 smithi077 ceph-mon[27689]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-18T21:08:13.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:12 smithi077 ceph-mon[27689]: osdmap e28: 4 total, 4 up, 4 in 2024-09-18T21:08:14.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:14.515+0000 7f74ff2da640 1 -- 172.21.15.103:0/4160923161 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74f80fb450 msgr2=0x7f74f80fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:08:14.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:14.515+0000 7f74ff2da640 1 --2- 172.21.15.103:0/4160923161 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74f80fb450 0x7f74f80fb860 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f74f40048d0 tx=0x7f74f4009da0 comp rx=0 tx=0).stop 2024-09-18T21:08:14.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:14.515+0000 7f74ff2da640 1 -- 172.21.15.103:0/4160923161 shutdown_connections 2024-09-18T21:08:14.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:14.515+0000 7f74ff2da640 1 --2- 172.21.15.103:0/4160923161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74f80fc720 0x7f74f80fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:08:14.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:14.515+0000 7f74ff2da640 1 --2- 172.21.15.103:0/4160923161 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74f80fb450 0x7f74f80fb860 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:08:14.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:14.515+0000 7f74ff2da640 1 -- 172.21.15.103:0/4160923161 >> 172.21.15.103:0/4160923161 conn(0x7f74f80f6c10 msgr2=0x7f74f80f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:08:14.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:14.516+0000 7f74ff2da640 1 -- 172.21.15.103:0/4160923161 shutdown_connections 2024-09-18T21:08:14.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:14.516+0000 7f74ff2da640 1 -- 172.21.15.103:0/4160923161 wait complete. 2024-09-18T21:08:14.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:14.516+0000 7f74ff2da640 1 Processor -- start 2024-09-18T21:08:14.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:14.516+0000 7f74ff2da640 1 -- start start 2024-09-18T21:08:14.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:14.516+0000 7f74ff2da640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74f80fb450 0x7f74f810c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:08:14.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:14.516+0000 7f74fd076640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74f80fb450 0x7f74f810c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:08:14.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:14.516+0000 7f74fd076640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74f80fb450 0x7f74f810c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39626/0 (socket says 172.21.15.103:39626) 2024-09-18T21:08:14.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:14.516+0000 7f74ff2da640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74f80fc720 0x7f74f810c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:08:14.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:14.516+0000 7f74fd076640 1 -- 172.21.15.103:0/3021388944 learned_addr learned my addr 172.21.15.103:0/3021388944 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-18T21:08:14.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:14.516+0000 7f74ff2da640 1 -- 172.21.15.103:0/3021388944 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f810d400 con 0x7f74f80fc720 2024-09-18T21:08:14.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:14.516+0000 7f74ff2da640 1 -- 172.21.15.103:0/3021388944 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f810d570 con 0x7f74f80fb450 2024-09-18T21:08:14.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:14.517+0000 7f74fd076640 1 -- 172.21.15.103:0/3021388944 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74f80fc720 msgr2=0x7f74f810c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:08:14.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:14.517+0000 7f74fd076640 1 --2- 172.21.15.103:0/3021388944 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74f80fc720 0x7f74f810c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:08:14.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:14.517+0000 7f74fd076640 1 -- 172.21.15.103:0/3021388944 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f4005040 con 0x7f74f80fb450 2024-09-18T21:08:14.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:14.517+0000 7f74fd076640 1 --2- 172.21.15.103:0/3021388944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74f80fb450 0x7f74f810c050 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f74f4000c00 tx=0x7f74f4009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:08:14.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:14.517+0000 7f74e9ffb640 1 -- 172.21.15.103:0/3021388944 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74f4038070 con 0x7f74f80fb450 2024-09-18T21:08:14.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:14.517+0000 7f74ff2da640 1 -- 172.21.15.103:0/3021388944 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74f810d7f0 con 0x7f74f80fb450 2024-09-18T21:08:14.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:14.517+0000 7f74e9ffb640 1 -- 172.21.15.103:0/3021388944 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f74f402ae90 con 0x7f74f80fb450 2024-09-18T21:08:14.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:14.517+0000 7f74e9ffb640 1 -- 172.21.15.103:0/3021388944 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74f403d420 con 0x7f74f80fb450 2024-09-18T21:08:14.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:14.517+0000 7f74ff2da640 1 -- 172.21.15.103:0/3021388944 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74f810dcb0 con 0x7f74f80fb450 2024-09-18T21:08:14.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:14.518+0000 7f74ff2da640 1 -- 172.21.15.103:0/3021388944 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74f80fa8b0 con 0x7f74f80fb450 2024-09-18T21:08:14.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:14.518+0000 7f74e9ffb640 1 -- 172.21.15.103:0/3021388944 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f74f4030020 con 0x7f74f80fb450 2024-09-18T21:08:14.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:14.519+0000 7f74e9ffb640 1 --2- 172.21.15.103:0/3021388944 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f74e406ed60 0x7f74e4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:08:14.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:14.519+0000 7f74e9ffb640 1 -- 172.21.15.103:0/3021388944 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 3770+0+0 (secure 0 0 0) 0x7f74f40ae2a0 con 0x7f74f80fb450 2024-09-18T21:08:14.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:14.519+0000 7f74fc875640 1 --2- 172.21.15.103:0/3021388944 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f74e406ed60 0x7f74e4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:08:14.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:14.520+0000 7f74fc875640 1 --2- 172.21.15.103:0/3021388944 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f74e406ed60 0x7f74e4071210 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f74f810be00 tx=0x7f74ec006d20 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:08:14.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:14.523+0000 7f74e9ffb640 1 -- 172.21.15.103:0/3021388944 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f74f407ba60 con 0x7f74f80fb450 2024-09-18T21:08:14.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:14.687+0000 7f74ff2da640 1 -- 172.21.15.103:0/3021388944 --> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f74f810df30 con 0x7f74e406ed60 2024-09-18T21:08:14.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:14 smithi077 ceph-mon[27689]: Detected new or changed devices on smithi103 2024-09-18T21:08:14.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:14 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:14.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:14 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:14.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:14 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:08:14.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:14 smithi077 ceph-mon[27689]: Adjusting osd_memory_target on smithi103 to 15936M 2024-09-18T21:08:14.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:14 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:14.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:14 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:08:14.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:14 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:08:14.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:14 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:14.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:14 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:08:14.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:14 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:08:14.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:14 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:08:14.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:14 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:14.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:14 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:08:15.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:14 smithi103 ceph-mon[34827]: Detected new or changed devices on smithi103 2024-09-18T21:08:15.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:14 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:15.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:14 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:15.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:14 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:08:15.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:14 smithi103 ceph-mon[34827]: Adjusting osd_memory_target on smithi103 to 15936M 2024-09-18T21:08:15.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:14 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:15.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:14 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:08:15.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:14 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:08:15.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:14 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:15.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:14 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:08:15.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:14 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:08:15.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:14 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:08:15.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:14 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:15.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:14 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:08:15.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:15 smithi077 ceph-mon[27689]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 142 KiB/s, 0 objects/s recovering 2024-09-18T21:08:15.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:15 smithi077 ceph-mon[27689]: from='client.24139 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:08:15.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:15 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-18T21:08:15.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:15 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-18T21:08:15.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:15 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:08:16.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:15 smithi103 ceph-mon[34827]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 142 KiB/s, 0 objects/s recovering 2024-09-18T21:08:16.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:15 smithi103 ceph-mon[34827]: from='client.24139 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:08:16.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:15 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-18T21:08:16.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:15 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-18T21:08:16.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:15 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:08:17.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:17 smithi077 ceph-mon[27689]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-18T21:08:17.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:17 smithi077 ceph-mon[27689]: from='client.? 172.21.15.103:0/2564162248' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "146e24e4-931a-4a54-b32c-c96d4f2babe5"}]: dispatch 2024-09-18T21:08:17.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:17 smithi077 ceph-mon[27689]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "146e24e4-931a-4a54-b32c-c96d4f2babe5"}]: dispatch 2024-09-18T21:08:17.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:17 smithi077 ceph-mon[27689]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "146e24e4-931a-4a54-b32c-c96d4f2babe5"}]': finished 2024-09-18T21:08:17.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:17 smithi077 ceph-mon[27689]: osdmap e29: 5 total, 4 up, 5 in 2024-09-18T21:08:17.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:17 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T21:08:17.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:17 smithi077 ceph-mon[27689]: from='client.? 172.21.15.103:0/1107958730' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-18T21:08:18.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:17 smithi103 ceph-mon[34827]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-18T21:08:18.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:17 smithi103 ceph-mon[34827]: from='client.? 172.21.15.103:0/2564162248' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "146e24e4-931a-4a54-b32c-c96d4f2babe5"}]: dispatch 2024-09-18T21:08:18.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:17 smithi103 ceph-mon[34827]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "146e24e4-931a-4a54-b32c-c96d4f2babe5"}]: dispatch 2024-09-18T21:08:18.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:17 smithi103 ceph-mon[34827]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "146e24e4-931a-4a54-b32c-c96d4f2babe5"}]': finished 2024-09-18T21:08:18.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:17 smithi103 ceph-mon[34827]: osdmap e29: 5 total, 4 up, 5 in 2024-09-18T21:08:18.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:17 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T21:08:18.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:17 smithi103 ceph-mon[34827]: from='client.? 172.21.15.103:0/1107958730' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-18T21:08:19.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:19 smithi077 ceph-mon[27689]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-09-18T21:08:20.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:19 smithi103 ceph-mon[34827]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-09-18T21:08:21.923 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:21 smithi103 ceph-mon[34827]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-18T21:08:21.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:21 smithi077 ceph-mon[27689]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-18T21:08:23.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:23 smithi103 ceph-mon[34827]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-18T21:08:23.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:23 smithi077 ceph-mon[27689]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-18T21:08:24.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:24 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-18T21:08:24.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:24 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:08:25.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:24 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-18T21:08:25.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:24 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:08:25.859 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:25 smithi103 ceph-mon[34827]: Deploying daemon osd.4 on smithi103 2024-09-18T21:08:25.859 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:25 smithi103 ceph-mon[34827]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-18T21:08:25.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:25 smithi077 ceph-mon[27689]: Deploying daemon osd.4 on smithi103 2024-09-18T21:08:25.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:25 smithi077 ceph-mon[27689]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-18T21:08:27.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:27 smithi077 ceph-mon[27689]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-18T21:08:28.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:27 smithi103 ceph-mon[34827]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-18T21:08:29.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:29 smithi077 ceph-mon[27689]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-18T21:08:29.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:29 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:08:29.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:29 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:29.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:29 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:29.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:29 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:08:29.973 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:29 smithi103 ceph-mon[34827]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-18T21:08:29.973 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:29 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:08:29.973 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:29 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:29.973 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:29 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:29.973 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:29 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:08:31.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:31 smithi077 ceph-mon[27689]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-18T21:08:32.010 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:31 smithi103 ceph-mon[34827]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-18T21:08:32.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:32.317+0000 7f74e9ffb640 1 -- 172.21.15.103:0/3021388944 <== mgr.14206 v2:172.21.15.77:6800/950747822 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f74f810df30 con 0x7f74e406ed60 2024-09-18T21:08:32.319 INFO:teuthology.orchestra.run.smithi103.stdout:Created osd(s) 4 on host 'smithi103' 2024-09-18T21:08:32.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:32.320+0000 7f74ff2da640 1 -- 172.21.15.103:0/3021388944 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f74e406ed60 msgr2=0x7f74e4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:08:32.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:32.320+0000 7f74ff2da640 1 --2- 172.21.15.103:0/3021388944 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f74e406ed60 0x7f74e4071210 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f74f810be00 tx=0x7f74ec006d20 comp rx=0 tx=0).stop 2024-09-18T21:08:32.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:32.320+0000 7f74ff2da640 1 -- 172.21.15.103:0/3021388944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74f80fb450 msgr2=0x7f74f810c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:08:32.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:32.320+0000 7f74ff2da640 1 --2- 172.21.15.103:0/3021388944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74f80fb450 0x7f74f810c050 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f74f4000c00 tx=0x7f74f4009da0 comp rx=0 tx=0).stop 2024-09-18T21:08:32.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:32.320+0000 7f74ff2da640 1 -- 172.21.15.103:0/3021388944 shutdown_connections 2024-09-18T21:08:32.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:32.320+0000 7f74ff2da640 1 --2- 172.21.15.103:0/3021388944 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f74e406ed60 0x7f74e4071210 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:08:32.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:32.320+0000 7f74ff2da640 1 --2- 172.21.15.103:0/3021388944 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74f80fc720 0x7f74f810c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:08:32.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:32.320+0000 7f74ff2da640 1 --2- 172.21.15.103:0/3021388944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74f80fb450 0x7f74f810c050 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:08:32.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:32.320+0000 7f74ff2da640 1 -- 172.21.15.103:0/3021388944 >> 172.21.15.103:0/3021388944 conn(0x7f74f80f6c10 msgr2=0x7f74f80f8430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:08:32.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:32.320+0000 7f74ff2da640 1 -- 172.21.15.103:0/3021388944 shutdown_connections 2024-09-18T21:08:32.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:32.320+0000 7f74ff2da640 1 -- 172.21.15.103:0/3021388944 wait complete. 2024-09-18T21:08:32.930 DEBUG:teuthology.orchestra.run.smithi103:osd.4> sudo journalctl -f -n 0 -u ceph-5a76ec16-7601-11ef-bceb-c7b262605968@osd.4.service 2024-09-18T21:08:32.932 INFO:tasks.cephadm:Deploying osd.5 on smithi103 with /dev/vg_nvme/lv_2... 2024-09-18T21:08:32.933 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-18T21:08:33.274 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-18T21:08:33.619 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:33 smithi103 ceph-mon[34827]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-18T21:08:33.619 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:33 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:33.619 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:33 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:33.619 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:33 smithi103 ceph-mon[34827]: from='osd.4 [v2:172.21.15.103:6808/3297772484,v1:172.21.15.103:6809/3297772484]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-18T21:08:33.619 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:33 smithi103 ceph-mon[34827]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-18T21:08:33.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:33 smithi077 ceph-mon[27689]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-18T21:08:33.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:33 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:33.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:33 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:33.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:33 smithi077 ceph-mon[27689]: from='osd.4 [v2:172.21.15.103:6808/3297772484,v1:172.21.15.103:6809/3297772484]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-18T21:08:33.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:33 smithi077 ceph-mon[27689]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-18T21:08:35.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:34 smithi103 ceph-mon[34827]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-18T21:08:35.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:34 smithi103 ceph-mon[34827]: osdmap e30: 5 total, 4 up, 5 in 2024-09-18T21:08:35.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:34 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T21:08:35.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:34 smithi103 ceph-mon[34827]: from='osd.4 [v2:172.21.15.103:6808/3297772484,v1:172.21.15.103:6809/3297772484]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-18T21:08:35.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:34 smithi103 ceph-mon[34827]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-18T21:08:35.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:34 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:35.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:34 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:35.014 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:08:34 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4[46966]: 2024-09-18T21:08:34.728+0000 7fe5d7c8c640 -1 osd.4 0 waiting for initial osdmap 2024-09-18T21:08:35.014 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:08:34 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4[46966]: 2024-09-18T21:08:34.735+0000 7fe5d2ac3640 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T21:08:35.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:34 smithi077 ceph-mon[27689]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-18T21:08:35.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:34 smithi077 ceph-mon[27689]: osdmap e30: 5 total, 4 up, 5 in 2024-09-18T21:08:35.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:34 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T21:08:35.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:34 smithi077 ceph-mon[27689]: from='osd.4 [v2:172.21.15.103:6808/3297772484,v1:172.21.15.103:6809/3297772484]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-18T21:08:35.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:34 smithi077 ceph-mon[27689]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-18T21:08:35.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:34 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:35.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:34 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:35.784 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:35 smithi103 ceph-mon[34827]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-18T21:08:35.784 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:35 smithi103 ceph-mon[34827]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-09-18T21:08:35.784 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:35 smithi103 ceph-mon[34827]: osdmap e31: 5 total, 4 up, 5 in 2024-09-18T21:08:35.784 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:35 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T21:08:35.784 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:35 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T21:08:35.784 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:35 smithi103 ceph-mon[34827]: osd.4 [v2:172.21.15.103:6808/3297772484,v1:172.21.15.103:6809/3297772484] boot 2024-09-18T21:08:35.784 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:35 smithi103 ceph-mon[34827]: osdmap e32: 5 total, 5 up, 5 in 2024-09-18T21:08:35.784 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:35 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T21:08:35.789 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-18T21:08:35.809 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi103:vg_nvme/lv_2 2024-09-18T21:08:35.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:35 smithi077 ceph-mon[27689]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-18T21:08:35.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:35 smithi077 ceph-mon[27689]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-09-18T21:08:35.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:35 smithi077 ceph-mon[27689]: osdmap e31: 5 total, 4 up, 5 in 2024-09-18T21:08:35.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:35 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T21:08:35.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:35 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T21:08:35.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:35 smithi077 ceph-mon[27689]: osd.4 [v2:172.21.15.103:6808/3297772484,v1:172.21.15.103:6809/3297772484] boot 2024-09-18T21:08:35.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:35 smithi077 ceph-mon[27689]: osdmap e32: 5 total, 5 up, 5 in 2024-09-18T21:08:35.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:35 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T21:08:36.959 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:36 smithi103 ceph-mon[34827]: purged_snaps scrub starts 2024-09-18T21:08:36.959 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:36 smithi103 ceph-mon[34827]: purged_snaps scrub ok 2024-09-18T21:08:37.004 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-18T21:08:37.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:36 smithi077 ceph-mon[27689]: purged_snaps scrub starts 2024-09-18T21:08:37.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:36 smithi077 ceph-mon[27689]: purged_snaps scrub ok 2024-09-18T21:08:38.000 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:37 smithi103 ceph-mon[34827]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-18T21:08:38.001 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:37 smithi103 ceph-mon[34827]: osdmap e33: 5 total, 5 up, 5 in 2024-09-18T21:08:38.114 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:37 smithi077 ceph-mon[27689]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-18T21:08:38.114 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:37 smithi077 ceph-mon[27689]: osdmap e33: 5 total, 5 up, 5 in 2024-09-18T21:08:39.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:39.346+0000 7f9f0b585640 1 -- 172.21.15.103:0/2184595440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f040fc560 msgr2=0x7f9f040fc970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:08:39.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:39.346+0000 7f9f0b585640 1 --2- 172.21.15.103:0/2184595440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f040fc560 0x7f9f040fc970 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9f000048d0 tx=0x7f9f00009da0 comp rx=0 tx=0).stop 2024-09-18T21:08:39.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:39.346+0000 7f9f0b585640 1 -- 172.21.15.103:0/2184595440 shutdown_connections 2024-09-18T21:08:39.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:39.346+0000 7f9f0b585640 1 --2- 172.21.15.103:0/2184595440 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f040fd830 0x7f9f040fdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:08:39.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:39.346+0000 7f9f0b585640 1 --2- 172.21.15.103:0/2184595440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f040fc560 0x7f9f040fc970 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:08:39.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:39.346+0000 7f9f0b585640 1 -- 172.21.15.103:0/2184595440 >> 172.21.15.103:0/2184595440 conn(0x7f9f040f7d40 msgr2=0x7f9f040fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:08:39.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:39.346+0000 7f9f0b585640 1 -- 172.21.15.103:0/2184595440 shutdown_connections 2024-09-18T21:08:39.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:39.346+0000 7f9f0b585640 1 -- 172.21.15.103:0/2184595440 wait complete. 2024-09-18T21:08:39.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:39.347+0000 7f9f0b585640 1 Processor -- start 2024-09-18T21:08:39.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:39.347+0000 7f9f0b585640 1 -- start start 2024-09-18T21:08:39.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:39.347+0000 7f9f0b585640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f040fc560 0x7f9f0410d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:08:39.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:39.347+0000 7f9f0b585640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f040fd830 0x7f9f0410d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:08:39.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:39.347+0000 7f9f0b585640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0410e4a0 con 0x7f9f040fc560 2024-09-18T21:08:39.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:39.347+0000 7f9f0b585640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0410e610 con 0x7f9f040fd830 2024-09-18T21:08:39.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:39.347+0000 7f9f08b20640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f040fd830 0x7f9f0410d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:08:39.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:39.347+0000 7f9f08b20640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f040fd830 0x7f9f0410d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57438/0 (socket says 172.21.15.103:57438) 2024-09-18T21:08:39.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:39.347+0000 7f9f08b20640 1 -- 172.21.15.103:0/1660796097 learned_addr learned my addr 172.21.15.103:0/1660796097 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-18T21:08:39.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:39.347+0000 7f9f09321640 1 --2- 172.21.15.103:0/1660796097 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f040fc560 0x7f9f0410d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:08:39.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:39.347+0000 7f9f08b20640 1 -- 172.21.15.103:0/1660796097 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f040fc560 msgr2=0x7f9f0410d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:08:39.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:39.347+0000 7f9f08b20640 1 --2- 172.21.15.103:0/1660796097 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f040fc560 0x7f9f0410d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:08:39.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:39.347+0000 7f9f08b20640 1 -- 172.21.15.103:0/1660796097 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f00005040 con 0x7f9f040fd830 2024-09-18T21:08:39.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:39.347+0000 7f9f09321640 1 --2- 172.21.15.103:0/1660796097 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f040fc560 0x7f9f0410d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T21:08:39.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:39.347+0000 7f9f08b20640 1 --2- 172.21.15.103:0/1660796097 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f040fd830 0x7f9f0410d630 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9ef400b790 tx=0x7f9ef40091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:08:39.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:39.347+0000 7f9ef9ffb640 1 -- 172.21.15.103:0/1660796097 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ef400c700 con 0x7f9f040fd830 2024-09-18T21:08:39.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:39.347+0000 7f9ef9ffb640 1 -- 172.21.15.103:0/1660796097 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9ef400cd00 con 0x7f9f040fd830 2024-09-18T21:08:39.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:39.347+0000 7f9ef9ffb640 1 -- 172.21.15.103:0/1660796097 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ef4015e70 con 0x7f9f040fd830 2024-09-18T21:08:39.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:39.347+0000 7f9f0b585640 1 -- 172.21.15.103:0/1660796097 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f0410e8f0 con 0x7f9f040fd830 2024-09-18T21:08:39.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:39.348+0000 7f9f0b585640 1 -- 172.21.15.103:0/1660796097 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f0410ee10 con 0x7f9f040fd830 2024-09-18T21:08:39.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:39.349+0000 7f9f0b585640 1 -- 172.21.15.103:0/1660796097 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f040fb9c0 con 0x7f9f040fd830 2024-09-18T21:08:39.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:39.349+0000 7f9ef9ffb640 1 -- 172.21.15.103:0/1660796097 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f9ef4012070 con 0x7f9f040fd830 2024-09-18T21:08:39.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:39.349+0000 7f9ef9ffb640 1 --2- 172.21.15.103:0/1660796097 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f9ef006ed60 0x7f9ef0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:08:39.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:39.350+0000 7f9ef9ffb640 1 -- 172.21.15.103:0/1660796097 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4202+0+0 (secure 0 0 0) 0x7f9ef408d800 con 0x7f9f040fd830 2024-09-18T21:08:39.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:39.350+0000 7f9f09321640 1 --2- 172.21.15.103:0/1660796097 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f9ef006ed60 0x7f9ef0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:08:39.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:39.350+0000 7f9f09321640 1 --2- 172.21.15.103:0/1660796097 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f9ef006ed60 0x7f9ef0071210 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9f00004540 tx=0x7f9f00035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:08:39.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:39.354+0000 7f9ef9ffb640 1 -- 172.21.15.103:0/1660796097 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9ef405ae10 con 0x7f9f040fd830 2024-09-18T21:08:39.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:39.517+0000 7f9f0b585640 1 -- 172.21.15.103:0/1660796097 --> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f9f0410f090 con 0x7f9ef006ed60 2024-09-18T21:08:39.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:39 smithi077 ceph-mon[27689]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-18T21:08:39.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:39 smithi077 ceph-mon[27689]: Detected new or changed devices on smithi103 2024-09-18T21:08:39.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:39 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:39.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:39 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:39.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:39 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:08:39.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:39 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:08:39.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:39 smithi077 ceph-mon[27689]: Adjusting osd_memory_target on smithi103 to 7968M 2024-09-18T21:08:39.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:39 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:39.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:39 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:08:39.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:39 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:08:39.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:39 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:39.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:39 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:08:39.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:39 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:08:39.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:39 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:08:39.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:39 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:39.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:39 smithi103 ceph-mon[34827]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-18T21:08:39.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:39 smithi103 ceph-mon[34827]: Detected new or changed devices on smithi103 2024-09-18T21:08:39.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:39 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:39.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:39 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:39.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:39 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:08:39.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:39 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:08:39.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:39 smithi103 ceph-mon[34827]: Adjusting osd_memory_target on smithi103 to 7968M 2024-09-18T21:08:39.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:39 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:39.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:39 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:08:39.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:39 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:08:39.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:39 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:39.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:39 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:08:39.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:39 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:08:39.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:39 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:08:39.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:39 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:40.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:40 smithi103 ceph-mon[34827]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:08:40.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:40 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-18T21:08:40.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:40 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-18T21:08:40.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:40 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:08:40.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:40 smithi077 ceph-mon[27689]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:08:40.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:40 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-18T21:08:40.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:40 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-18T21:08:40.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:40 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:08:41.475 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:41 smithi103 ceph-mon[34827]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-18T21:08:41.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:41 smithi077 ceph-mon[27689]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-18T21:08:42.350 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:42 smithi103 ceph-mon[34827]: from='client.? 172.21.15.103:0/2492818072' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aab4da9a-351b-47ba-b3cc-b6d1fef36186"}]: dispatch 2024-09-18T21:08:42.351 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:42 smithi103 ceph-mon[34827]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aab4da9a-351b-47ba-b3cc-b6d1fef36186"}]: dispatch 2024-09-18T21:08:42.351 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:42 smithi103 ceph-mon[34827]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aab4da9a-351b-47ba-b3cc-b6d1fef36186"}]': finished 2024-09-18T21:08:42.351 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:42 smithi103 ceph-mon[34827]: osdmap e34: 6 total, 5 up, 6 in 2024-09-18T21:08:42.351 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:42 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T21:08:42.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:42 smithi077 ceph-mon[27689]: from='client.? 172.21.15.103:0/2492818072' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aab4da9a-351b-47ba-b3cc-b6d1fef36186"}]: dispatch 2024-09-18T21:08:42.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:42 smithi077 ceph-mon[27689]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aab4da9a-351b-47ba-b3cc-b6d1fef36186"}]: dispatch 2024-09-18T21:08:42.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:42 smithi077 ceph-mon[27689]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aab4da9a-351b-47ba-b3cc-b6d1fef36186"}]': finished 2024-09-18T21:08:42.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:42 smithi077 ceph-mon[27689]: osdmap e34: 6 total, 5 up, 6 in 2024-09-18T21:08:42.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:42 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T21:08:43.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:43 smithi077 ceph-mon[27689]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-18T21:08:43.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:43 smithi077 ceph-mon[27689]: from='client.? 172.21.15.103:0/1412526632' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-18T21:08:43.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:43 smithi103 ceph-mon[34827]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-18T21:08:43.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:43 smithi103 ceph-mon[34827]: from='client.? 172.21.15.103:0/1412526632' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-18T21:08:44.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:44 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:08:44.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:44 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:08:45.586 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:45 smithi103 ceph-mon[34827]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-18T21:08:45.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:45 smithi077 ceph-mon[27689]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-18T21:08:47.622 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:47 smithi103 ceph-mon[34827]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-18T21:08:47.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:47 smithi077 ceph-mon[27689]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-18T21:08:49.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:49 smithi103 ceph-mon[34827]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-18T21:08:49.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:49 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-18T21:08:49.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:49 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:08:49.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:49 smithi077 ceph-mon[27689]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-18T21:08:49.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:49 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-18T21:08:49.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:49 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:08:50.470 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:50 smithi103 ceph-mon[34827]: Deploying daemon osd.5 on smithi103 2024-09-18T21:08:50.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:50 smithi077 ceph-mon[27689]: Deploying daemon osd.5 on smithi103 2024-09-18T21:08:51.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:51 smithi103 ceph-mon[34827]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-18T21:08:51.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:51 smithi077 ceph-mon[27689]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-18T21:08:53.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:53 smithi077 ceph-mon[27689]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-18T21:08:53.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:53 smithi103 ceph-mon[34827]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-18T21:08:54.634 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:54 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:08:54.634 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:54 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:54.634 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:54 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:54.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:54 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:08:54.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:54 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:54.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:54 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:55.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:55 smithi077 ceph-mon[27689]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-18T21:08:56.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:55 smithi103 ceph-mon[34827]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-18T21:08:57.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:57 smithi103 ceph-mon[34827]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-18T21:08:57.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:57 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:57.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:57 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:57.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:57 smithi103 ceph-mon[34827]: from='osd.5 [v2:172.21.15.103:6816/2618312891,v1:172.21.15.103:6817/2618312891]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-18T21:08:57.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:57 smithi103 ceph-mon[34827]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-18T21:08:57.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:57 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:08:57.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:57 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:08:57.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:57 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:57.907 INFO:teuthology.orchestra.run.smithi103.stdout:Created osd(s) 5 on host 'smithi103' 2024-09-18T21:08:57.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:57.906+0000 7f9ef9ffb640 1 -- 172.21.15.103:0/1660796097 <== mgr.14206 v2:172.21.15.77:6800/950747822 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f9f0410f090 con 0x7f9ef006ed60 2024-09-18T21:08:57.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:57.909+0000 7f9f0b585640 1 -- 172.21.15.103:0/1660796097 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f9ef006ed60 msgr2=0x7f9ef0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:08:57.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:57.909+0000 7f9f0b585640 1 --2- 172.21.15.103:0/1660796097 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f9ef006ed60 0x7f9ef0071210 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9f00004540 tx=0x7f9f00035040 comp rx=0 tx=0).stop 2024-09-18T21:08:57.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:57.909+0000 7f9f0b585640 1 -- 172.21.15.103:0/1660796097 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f040fd830 msgr2=0x7f9f0410d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:08:57.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:57.909+0000 7f9f0b585640 1 --2- 172.21.15.103:0/1660796097 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f040fd830 0x7f9f0410d630 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9ef400b790 tx=0x7f9ef40091d0 comp rx=0 tx=0).stop 2024-09-18T21:08:57.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:57.909+0000 7f9f0b585640 1 -- 172.21.15.103:0/1660796097 shutdown_connections 2024-09-18T21:08:57.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:57.909+0000 7f9f0b585640 1 --2- 172.21.15.103:0/1660796097 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f9ef006ed60 0x7f9ef0071210 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:08:57.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:57.909+0000 7f9f0b585640 1 --2- 172.21.15.103:0/1660796097 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f040fd830 0x7f9f0410d630 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:08:57.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:57.909+0000 7f9f0b585640 1 --2- 172.21.15.103:0/1660796097 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f040fc560 0x7f9f0410d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:08:57.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:57.909+0000 7f9f0b585640 1 -- 172.21.15.103:0/1660796097 >> 172.21.15.103:0/1660796097 conn(0x7f9f040f7d40 msgr2=0x7f9f040f9480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:08:57.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:57.909+0000 7f9f0b585640 1 -- 172.21.15.103:0/1660796097 shutdown_connections 2024-09-18T21:08:57.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:08:57.909+0000 7f9f0b585640 1 -- 172.21.15.103:0/1660796097 wait complete. 2024-09-18T21:08:57.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:57 smithi077 ceph-mon[27689]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-18T21:08:57.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:57 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:57.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:57 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:57.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:57 smithi077 ceph-mon[27689]: from='osd.5 [v2:172.21.15.103:6816/2618312891,v1:172.21.15.103:6817/2618312891]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-18T21:08:57.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:57 smithi077 ceph-mon[27689]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-18T21:08:57.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:57 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:08:57.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:57 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:08:57.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:57 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:58.596 DEBUG:teuthology.orchestra.run.smithi103:osd.5> sudo journalctl -f -n 0 -u ceph-5a76ec16-7601-11ef-bceb-c7b262605968@osd.5.service 2024-09-18T21:08:58.599 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-09-18T21:08:58.599 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-18T21:08:58.744 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:58 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:08:58.744 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:58 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:58.745 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:58 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:58.745 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:58 smithi103 ceph-mon[34827]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-18T21:08:58.745 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:58 smithi103 ceph-mon[34827]: osdmap e35: 6 total, 5 up, 6 in 2024-09-18T21:08:58.745 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:58 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T21:08:58.745 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:58 smithi103 ceph-mon[34827]: from='osd.5 [v2:172.21.15.103:6816/2618312891,v1:172.21.15.103:6817/2618312891]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-18T21:08:58.745 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:58 smithi103 ceph-mon[34827]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-18T21:08:58.846 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:08:58.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:58 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:08:58.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:58 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:58.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:58 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:08:58.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:58 smithi077 ceph-mon[27689]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-18T21:08:58.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:58 smithi077 ceph-mon[27689]: osdmap e35: 6 total, 5 up, 6 in 2024-09-18T21:08:58.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:58 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T21:08:58.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:58 smithi077 ceph-mon[27689]: from='osd.5 [v2:172.21.15.103:6816/2618312891,v1:172.21.15.103:6817/2618312891]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-18T21:08:58.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:58 smithi077 ceph-mon[27689]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-18T21:08:59.263 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:08:59 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5[53353]: 2024-09-18T21:08:59.151+0000 7f8d17314640 -1 osd.5 0 waiting for initial osdmap 2024-09-18T21:08:59.263 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:08:59 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5[53353]: 2024-09-18T21:08:59.160+0000 7f8d1214b640 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T21:08:59.730 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:59 smithi103 ceph-mon[34827]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-18T21:08:59.730 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:59 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:08:59.730 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:59 smithi103 ceph-mon[34827]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-09-18T21:08:59.730 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:59 smithi103 ceph-mon[34827]: osdmap e36: 6 total, 5 up, 6 in 2024-09-18T21:08:59.730 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:59 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T21:08:59.730 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:08:59 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T21:08:59.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:59 smithi077 ceph-mon[27689]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-18T21:08:59.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:59 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:08:59.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:59 smithi077 ceph-mon[27689]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-09-18T21:08:59.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:59 smithi077 ceph-mon[27689]: osdmap e36: 6 total, 5 up, 6 in 2024-09-18T21:08:59.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:59 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T21:08:59.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:08:59 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T21:09:00.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:00.527+0000 7f335b792640 1 -- 172.21.15.77:0/400150499 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33540fc550 msgr2=0x7f33540fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:00.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:00.527+0000 7f335b792640 1 --2- 172.21.15.77:0/400150499 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33540fc550 0x7f33540fc960 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f33500048d0 tx=0x7f3350009da0 comp rx=0 tx=0).stop 2024-09-18T21:09:00.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:00.527+0000 7f335b792640 1 -- 172.21.15.77:0/400150499 shutdown_connections 2024-09-18T21:09:00.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:00.527+0000 7f335b792640 1 --2- 172.21.15.77:0/400150499 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33540fd820 0x7f33540fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:00.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:00.527+0000 7f335b792640 1 --2- 172.21.15.77:0/400150499 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33540fc550 0x7f33540fc960 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:00.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:00.527+0000 7f335b792640 1 -- 172.21.15.77:0/400150499 >> 172.21.15.77:0/400150499 conn(0x7f33540f7d30 msgr2=0x7f33540fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:09:00.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:00.527+0000 7f335b792640 1 -- 172.21.15.77:0/400150499 shutdown_connections 2024-09-18T21:09:00.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:00.527+0000 7f335b792640 1 -- 172.21.15.77:0/400150499 wait complete. 2024-09-18T21:09:00.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:00.528+0000 7f335b792640 1 Processor -- start 2024-09-18T21:09:00.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:00.528+0000 7f335b792640 1 -- start start 2024-09-18T21:09:00.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:00.528+0000 7f335b792640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33540fc550 0x7f335410d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:00.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:00.528+0000 7f335b792640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33540fd820 0x7f335410d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:00.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:00.528+0000 7f335b792640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f335410dc10 con 0x7f33540fc550 2024-09-18T21:09:00.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:00.528+0000 7f335b792640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f335410e430 con 0x7f33540fd820 2024-09-18T21:09:00.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:00.528+0000 7f335952e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33540fc550 0x7f335410d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:00.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:00.528+0000 7f335952e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33540fc550 0x7f335410d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43478/0 (socket says 172.21.15.77:43478) 2024-09-18T21:09:00.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:00.528+0000 7f335952e640 1 -- 172.21.15.77:0/2030170289 learned_addr learned my addr 172.21.15.77:0/2030170289 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:09:00.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:00.528+0000 7f3358d2d640 1 --2- 172.21.15.77:0/2030170289 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33540fd820 0x7f335410d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:00.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:00.528+0000 7f335952e640 1 -- 172.21.15.77:0/2030170289 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33540fd820 msgr2=0x7f335410d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:00.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:00.528+0000 7f335952e640 1 --2- 172.21.15.77:0/2030170289 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33540fd820 0x7f335410d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:00.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:00.528+0000 7f335952e640 1 -- 172.21.15.77:0/2030170289 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3350005040 con 0x7f33540fc550 2024-09-18T21:09:00.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:00.528+0000 7f3358d2d640 1 --2- 172.21.15.77:0/2030170289 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33540fd820 0x7f335410d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T21:09:00.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:00.529+0000 7f335952e640 1 --2- 172.21.15.77:0/2030170289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33540fc550 0x7f335410d080 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f33500048a0 tx=0x7f3350009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:00.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:00.529+0000 7f3349ffb640 1 -- 172.21.15.77:0/2030170289 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3350038070 con 0x7f33540fc550 2024-09-18T21:09:00.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:00.529+0000 7f3349ffb640 1 -- 172.21.15.77:0/2030170289 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3350004290 con 0x7f33540fc550 2024-09-18T21:09:00.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:00.529+0000 7f3349ffb640 1 -- 172.21.15.77:0/2030170289 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3350033660 con 0x7f33540fc550 2024-09-18T21:09:00.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:00.529+0000 7f335b792640 1 -- 172.21.15.77:0/2030170289 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f335410e660 con 0x7f33540fc550 2024-09-18T21:09:00.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:00.529+0000 7f335b792640 1 -- 172.21.15.77:0/2030170289 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f335410ec00 con 0x7f33540fc550 2024-09-18T21:09:00.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:00.530+0000 7f335b792640 1 -- 172.21.15.77:0/2030170289 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33540fb9b0 con 0x7f33540fc550 2024-09-18T21:09:00.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:00.531+0000 7f3349ffb640 1 -- 172.21.15.77:0/2030170289 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f3350030020 con 0x7f33540fc550 2024-09-18T21:09:00.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:00.531+0000 7f3349ffb640 1 --2- 172.21.15.77:0/2030170289 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f334006ed60 0x7f3340071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:00.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:00.531+0000 7f3358d2d640 1 --2- 172.21.15.77:0/2030170289 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f334006ed60 0x7f3340071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:00.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:00.531+0000 7f3349ffb640 1 -- 172.21.15.77:0/2030170289 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f33500adf70 con 0x7f33540fc550 2024-09-18T21:09:00.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:00.532+0000 7f3358d2d640 1 --2- 172.21.15.77:0/2030170289 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f334006ed60 0x7f3340071210 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3344004fd0 tx=0x7f334400b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:00.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:00.536+0000 7f3349ffb640 1 -- 172.21.15.77:0/2030170289 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f335007b480 con 0x7f33540fc550 2024-09-18T21:09:00.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:00.694+0000 7f335b792640 1 -- 172.21.15.77:0/2030170289 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f335404b720 con 0x7f33540fc550 2024-09-18T21:09:00.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:00.694+0000 7f3349ffb640 1 -- 172.21.15.77:0/2030170289 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v37) v1 ==== 74+0+130 (secure 0 0 0) 0x7f335002c870 con 0x7f33540fc550 2024-09-18T21:09:00.696 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:09:00.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:00.696+0000 7f335b792640 1 -- 172.21.15.77:0/2030170289 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f334006ed60 msgr2=0x7f3340071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:00.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:00.696+0000 7f335b792640 1 --2- 172.21.15.77:0/2030170289 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f334006ed60 0x7f3340071210 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3344004fd0 tx=0x7f334400b040 comp rx=0 tx=0).stop 2024-09-18T21:09:00.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:00.696+0000 7f335b792640 1 -- 172.21.15.77:0/2030170289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33540fc550 msgr2=0x7f335410d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:00.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:00.696+0000 7f335b792640 1 --2- 172.21.15.77:0/2030170289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33540fc550 0x7f335410d080 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f33500048a0 tx=0x7f3350009da0 comp rx=0 tx=0).stop 2024-09-18T21:09:00.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:00.696+0000 7f335b792640 1 -- 172.21.15.77:0/2030170289 shutdown_connections 2024-09-18T21:09:00.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:00.696+0000 7f335b792640 1 --2- 172.21.15.77:0/2030170289 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f334006ed60 0x7f3340071210 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:00.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:00.696+0000 7f335b792640 1 --2- 172.21.15.77:0/2030170289 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33540fd820 0x7f335410d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:00.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:00.696+0000 7f335b792640 1 --2- 172.21.15.77:0/2030170289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33540fc550 0x7f335410d080 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:00.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:00.696+0000 7f335b792640 1 -- 172.21.15.77:0/2030170289 >> 172.21.15.77:0/2030170289 conn(0x7f33540f7d30 msgr2=0x7f33540f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:09:00.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:00.696+0000 7f335b792640 1 -- 172.21.15.77:0/2030170289 shutdown_connections 2024-09-18T21:09:00.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:00.696+0000 7f335b792640 1 -- 172.21.15.77:0/2030170289 wait complete. 2024-09-18T21:09:01.356 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:01 smithi077 ceph-mon[27689]: purged_snaps scrub starts 2024-09-18T21:09:01.356 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:01 smithi077 ceph-mon[27689]: purged_snaps scrub ok 2024-09-18T21:09:01.356 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:01 smithi077 ceph-mon[27689]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-18T21:09:01.356 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:01 smithi077 ceph-mon[27689]: osd.5 [v2:172.21.15.103:6816/2618312891,v1:172.21.15.103:6817/2618312891] boot 2024-09-18T21:09:01.356 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:01 smithi077 ceph-mon[27689]: osdmap e37: 6 total, 6 up, 6 in 2024-09-18T21:09:01.356 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:01 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T21:09:01.356 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:01 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/2030170289' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-18T21:09:01.371 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:01 smithi103 ceph-mon[34827]: purged_snaps scrub starts 2024-09-18T21:09:01.371 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:01 smithi103 ceph-mon[34827]: purged_snaps scrub ok 2024-09-18T21:09:01.371 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:01 smithi103 ceph-mon[34827]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-18T21:09:01.371 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:01 smithi103 ceph-mon[34827]: osd.5 [v2:172.21.15.103:6816/2618312891,v1:172.21.15.103:6817/2618312891] boot 2024-09-18T21:09:01.371 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:01 smithi103 ceph-mon[34827]: osdmap e37: 6 total, 6 up, 6 in 2024-09-18T21:09:01.371 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:01 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T21:09:01.371 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:01 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/2030170289' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-18T21:09:01.378 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":37,"num_osds":6,"num_up_osds":6,"osd_up_since":1726693740,"num_in_osds":6,"osd_in_since":1726693721,"num_remapped_pgs":0} 2024-09-18T21:09:01.379 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-18T21:09:01.648 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:09:02.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:02 smithi077 ceph-mon[27689]: osdmap e38: 6 total, 6 up, 6 in 2024-09-18T21:09:02.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:02 smithi077 ceph-mon[27689]: Detected new or changed devices on smithi103 2024-09-18T21:09:02.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:02 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:09:02.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:02 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:09:02.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:02 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:09:02.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:02 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:09:02.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:02 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:09:02.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:02 smithi077 ceph-mon[27689]: Adjusting osd_memory_target on smithi103 to 5312M 2024-09-18T21:09:02.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:02 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:09:02.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:02 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:09:02.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:02 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:09:02.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:02 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:09:02.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:02 smithi103 ceph-mon[34827]: osdmap e38: 6 total, 6 up, 6 in 2024-09-18T21:09:02.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:02 smithi103 ceph-mon[34827]: Detected new or changed devices on smithi103 2024-09-18T21:09:02.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:02 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:09:02.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:02 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:09:02.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:02 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:09:02.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:02 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:09:02.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:02 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:09:02.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:02 smithi103 ceph-mon[34827]: Adjusting osd_memory_target on smithi103 to 5312M 2024-09-18T21:09:02.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:02 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:09:02.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:02 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:09:02.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:02 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:09:02.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:02 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:09:03.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:03.393+0000 7fd3bbe8a640 1 -- 172.21.15.77:0/2017885386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3b4102ef0 msgr2=0x7fd3b40fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:03.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:03.393+0000 7fd3bbe8a640 1 --2- 172.21.15.77:0/2017885386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3b4102ef0 0x7fd3b40fc5b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd3a80048d0 tx=0x7fd3a8009da0 comp rx=0 tx=0).stop 2024-09-18T21:09:03.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:03.393+0000 7fd3bbe8a640 1 -- 172.21.15.77:0/2017885386 shutdown_connections 2024-09-18T21:09:03.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:03.393+0000 7fd3bbe8a640 1 --2- 172.21.15.77:0/2017885386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3b4102ef0 0x7fd3b40fc5b0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:03.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:03.393+0000 7fd3bbe8a640 1 --2- 172.21.15.77:0/2017885386 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3b4102550 0x7fd3b4102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:03.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:03.393+0000 7fd3bbe8a640 1 -- 172.21.15.77:0/2017885386 >> 172.21.15.77:0/2017885386 conn(0x7fd3b40f80f0 msgr2=0x7fd3b40fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:09:03.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:03.393+0000 7fd3bbe8a640 1 -- 172.21.15.77:0/2017885386 shutdown_connections 2024-09-18T21:09:03.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:03.393+0000 7fd3bbe8a640 1 -- 172.21.15.77:0/2017885386 wait complete. 2024-09-18T21:09:03.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:03.394+0000 7fd3bbe8a640 1 Processor -- start 2024-09-18T21:09:03.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:03.394+0000 7fd3bbe8a640 1 -- start start 2024-09-18T21:09:03.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:03.394+0000 7fd3bbe8a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3b4102550 0x7fd3b4113520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:03.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:03.394+0000 7fd3bbe8a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3b4102ef0 0x7fd3b4113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:03.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:03.394+0000 7fd3bbe8a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b41140b0 con 0x7fd3b4102ef0 2024-09-18T21:09:03.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:03.394+0000 7fd3bbe8a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b410d4c0 con 0x7fd3b4102550 2024-09-18T21:09:03.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:03.394+0000 7fd3b9425640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3b4102ef0 0x7fd3b4113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:03.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:03.394+0000 7fd3b9425640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3b4102ef0 0x7fd3b4113a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43508/0 (socket says 172.21.15.77:43508) 2024-09-18T21:09:03.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:03.394+0000 7fd3b9425640 1 -- 172.21.15.77:0/4113090513 learned_addr learned my addr 172.21.15.77:0/4113090513 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:09:03.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:03.394+0000 7fd3b9c26640 1 --2- 172.21.15.77:0/4113090513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3b4102550 0x7fd3b4113520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:03.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:03.394+0000 7fd3b9425640 1 -- 172.21.15.77:0/4113090513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3b4102550 msgr2=0x7fd3b4113520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:03.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:03.394+0000 7fd3b9425640 1 --2- 172.21.15.77:0/4113090513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3b4102550 0x7fd3b4113520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:03.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:03.394+0000 7fd3b9425640 1 -- 172.21.15.77:0/4113090513 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a8005040 con 0x7fd3b4102ef0 2024-09-18T21:09:03.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:03.395+0000 7fd3b9425640 1 --2- 172.21.15.77:0/4113090513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3b4102ef0 0x7fd3b4113a60 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd3a80043d0 tx=0x7fd3a8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:03.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:03.395+0000 7fd3a67fc640 1 -- 172.21.15.77:0/4113090513 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3a8038070 con 0x7fd3b4102ef0 2024-09-18T21:09:03.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:03.395+0000 7fd3a67fc640 1 -- 172.21.15.77:0/4113090513 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd3a80096e0 con 0x7fd3b4102ef0 2024-09-18T21:09:03.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:03.395+0000 7fd3bbe8a640 1 -- 172.21.15.77:0/4113090513 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3b410d740 con 0x7fd3b4102ef0 2024-09-18T21:09:03.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:03.395+0000 7fd3a67fc640 1 -- 172.21.15.77:0/4113090513 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3a802c8a0 con 0x7fd3b4102ef0 2024-09-18T21:09:03.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:03.395+0000 7fd3bbe8a640 1 -- 172.21.15.77:0/4113090513 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3b410dc80 con 0x7fd3b4102ef0 2024-09-18T21:09:03.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:03.396+0000 7fd3bbe8a640 1 -- 172.21.15.77:0/4113090513 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3b40fdcd0 con 0x7fd3b4102ef0 2024-09-18T21:09:03.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:03.396+0000 7fd3a67fc640 1 -- 172.21.15.77:0/4113090513 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fd3a8030020 con 0x7fd3b4102ef0 2024-09-18T21:09:03.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:03.397+0000 7fd3a67fc640 1 --2- 172.21.15.77:0/4113090513 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fd3a006ed60 0x7fd3a0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:03.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:03.397+0000 7fd3a67fc640 1 -- 172.21.15.77:0/4113090513 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd3a80adab0 con 0x7fd3b4102ef0 2024-09-18T21:09:03.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:03.397+0000 7fd3b9c26640 1 --2- 172.21.15.77:0/4113090513 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fd3a006ed60 0x7fd3a0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:03.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:03.397+0000 7fd3b9c26640 1 --2- 172.21.15.77:0/4113090513 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fd3a006ed60 0x7fd3a0071210 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0004ed0 tx=0x7fd3b000b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:03.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:03.401+0000 7fd3a67fc640 1 -- 172.21.15.77:0/4113090513 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd3a807b040 con 0x7fd3b4102ef0 2024-09-18T21:09:03.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:03.558+0000 7fd3bbe8a640 1 -- 172.21.15.77:0/4113090513 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3b40fbd50 con 0x7fd3b4102ef0 2024-09-18T21:09:03.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:03.559+0000 7fd3a67fc640 1 -- 172.21.15.77:0/4113090513 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+11067 (secure 0 0 0) 0x7fd3a807a9e0 con 0x7fd3b4102ef0 2024-09-18T21:09:03.560 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:09:03.560 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":38,"fsid":"5a76ec16-7601-11ef-bceb-c7b262605968","created":"2024-09-18T21:03:45.904815+0000","modified":"2024-09-18T21:09:01.148412+0000","last_up_change":"2024-09-18T21:09:00.146831+0000","last_in_change":"2024-09-18T21:08:41.769170+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T21:07:50.288606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"309fcfaf-2c45-482b-a95a-92bedbd7a042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1327461769},{"type":"v1","addr":"172.21.15.77:6803","nonce":1327461769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1327461769},{"type":"v1","addr":"172.21.15.77:6805","nonce":1327461769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1327461769},{"type":"v1","addr":"172.21.15.77:6809","nonce":1327461769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1327461769},{"type":"v1","addr":"172.21.15.77:6807","nonce":1327461769}]},"public_addr":"172.21.15.77:6803/1327461769","cluster_addr":"172.21.15.77:6805/1327461769","heartbeat_back_addr":"172.21.15.77:6809/1327461769","heartbeat_front_addr":"172.21.15.77:6807/1327461769","state":["exists","up"]},{"osd":1,"uuid":"782aa0e2-9332-4440-b0ef-e5260e767374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":164854543},{"type":"v1","addr":"172.21.15.77:6811","nonce":164854543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":164854543},{"type":"v1","addr":"172.21.15.77:6813","nonce":164854543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":164854543},{"type":"v1","addr":"172.21.15.77:6817","nonce":164854543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":164854543},{"type":"v1","addr":"172.21.15.77:6815","nonce":164854543}]},"public_addr":"172.21.15.77:6811/164854543","cluster_addr":"172.21.15.77:6813/164854543","heartbeat_back_addr":"172.21.15.77:6817/164854543","heartbeat_front_addr":"172.21.15.77:6815/164854543","state":["exists","up"]},{"osd":2,"uuid":"0d3bbcd5-1c51-42ec-a670-e5081188f7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":462691237},{"type":"v1","addr":"172.21.15.77:6819","nonce":462691237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":462691237},{"type":"v1","addr":"172.21.15.77:6821","nonce":462691237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":462691237},{"type":"v1","addr":"172.21.15.77:6825","nonce":462691237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":462691237},{"type":"v1","addr":"172.21.15.77:6823","nonce":462691237}]},"public_addr":"172.21.15.77:6819/462691237","cluster_addr":"172.21.15.77:6821/462691237","heartbeat_back_addr":"172.21.15.77:6825/462691237","heartbeat_front_addr":"172.21.15.77:6823/462691237","state":["exists","up"]},{"osd":3,"uuid":"200136ca-fc2a-4917-af11-1c3c730126c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":2640098104},{"type":"v1","addr":"172.21.15.103:6801","nonce":2640098104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":2640098104},{"type":"v1","addr":"172.21.15.103:6803","nonce":2640098104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":2640098104},{"type":"v1","addr":"172.21.15.103:6807","nonce":2640098104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":2640098104},{"type":"v1","addr":"172.21.15.103:6805","nonce":2640098104}]},"public_addr":"172.21.15.103:6801/2640098104","cluster_addr":"172.21.15.103:6803/2640098104","heartbeat_back_addr":"172.21.15.103:6807/2640098104","heartbeat_front_addr":"172.21.15.103:6805/2640098104","state":["exists","up"]},{"osd":4,"uuid":"146e24e4-931a-4a54-b32c-c96d4f2babe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":3297772484},{"type":"v1","addr":"172.21.15.103:6809","nonce":3297772484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":3297772484},{"type":"v1","addr":"172.21.15.103:6811","nonce":3297772484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":3297772484},{"type":"v1","addr":"172.21.15.103:6815","nonce":3297772484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":3297772484},{"type":"v1","addr":"172.21.15.103:6813","nonce":3297772484}]},"public_addr":"172.21.15.103:6809/3297772484","cluster_addr":"172.21.15.103:6811/3297772484","heartbeat_back_addr":"172.21.15.103:6815/3297772484","heartbeat_front_addr":"172.21.15.103:6813/3297772484","state":["exists","up"]},{"osd":5,"uuid":"aab4da9a-351b-47ba-b3cc-b6d1fef36186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2618312891},{"type":"v1","addr":"172.21.15.103:6817","nonce":2618312891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":2618312891},{"type":"v1","addr":"172.21.15.103:6819","nonce":2618312891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2618312891},{"type":"v1","addr":"172.21.15.103:6823","nonce":2618312891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2618312891},{"type":"v1","addr":"172.21.15.103:6821","nonce":2618312891}]},"public_addr":"172.21.15.103:6817/2618312891","cluster_addr":"172.21.15.103:6819/2618312891","heartbeat_back_addr":"172.21.15.103:6823/2618312891","heartbeat_front_addr":"172.21.15.103:6821/2618312891","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T21:06:52.988132+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T21:07:20.637797+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T21:07:47.403897+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T21:08:09.448266+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T21:08:33.691899+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T21:08:58.481603+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:0/1737764691":"2024-09-19T21:05:43.984681+0000","172.21.15.77:6800/3162219942":"2024-09-19T21:04:16.080867+0000","172.21.15.77:6801/3162219942":"2024-09-19T21:04:16.080867+0000","172.21.15.77:0/366153409":"2024-09-19T21:04:16.080867+0000","172.21.15.77:6801/517401638":"2024-09-19T21:05:43.984681+0000","172.21.15.77:0/2651561696":"2024-09-19T21:04:16.080867+0000","172.21.15.77:0/3346293395":"2024-09-19T21:04:44.916890+0000","172.21.15.77:0/3396145514":"2024-09-19T21:05:43.984681+0000","172.21.15.77:0/1416108819":"2024-09-19T21:04:16.080867+0000","172.21.15.77:0/268486755":"2024-09-19T21:04:44.916890+0000","172.21.15.77:0/42563880":"2024-09-19T21:04:44.916890+0000","172.21.15.77:6801/2654225509":"2024-09-19T21:04:44.916890+0000","172.21.15.77:6800/2654225509":"2024-09-19T21:04:44.916890+0000","172.21.15.77:0/2389819393":"2024-09-19T21:05:43.984681+0000","172.21.15.77:6800/517401638":"2024-09-19T21:05:43.984681+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T21:09:03.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:03.561+0000 7fd3bbe8a640 1 -- 172.21.15.77:0/4113090513 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fd3a006ed60 msgr2=0x7fd3a0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:03.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:03.561+0000 7fd3bbe8a640 1 --2- 172.21.15.77:0/4113090513 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fd3a006ed60 0x7fd3a0071210 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0004ed0 tx=0x7fd3b000b040 comp rx=0 tx=0).stop 2024-09-18T21:09:03.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:03.561+0000 7fd3bbe8a640 1 -- 172.21.15.77:0/4113090513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3b4102ef0 msgr2=0x7fd3b4113a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:03.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:03.561+0000 7fd3bbe8a640 1 --2- 172.21.15.77:0/4113090513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3b4102ef0 0x7fd3b4113a60 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd3a80043d0 tx=0x7fd3a8009da0 comp rx=0 tx=0).stop 2024-09-18T21:09:03.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:03.561+0000 7fd3bbe8a640 1 -- 172.21.15.77:0/4113090513 shutdown_connections 2024-09-18T21:09:03.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:03.561+0000 7fd3bbe8a640 1 --2- 172.21.15.77:0/4113090513 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fd3a006ed60 0x7fd3a0071210 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:03.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:03.561+0000 7fd3bbe8a640 1 --2- 172.21.15.77:0/4113090513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3b4102ef0 0x7fd3b4113a60 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:03.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:03.561+0000 7fd3bbe8a640 1 --2- 172.21.15.77:0/4113090513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd3b4102550 0x7fd3b4113520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:03.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:03.561+0000 7fd3bbe8a640 1 -- 172.21.15.77:0/4113090513 >> 172.21.15.77:0/4113090513 conn(0x7fd3b40f80f0 msgr2=0x7fd3b40f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:09:03.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:03.561+0000 7fd3bbe8a640 1 -- 172.21.15.77:0/4113090513 shutdown_connections 2024-09-18T21:09:03.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:03.561+0000 7fd3bbe8a640 1 -- 172.21.15.77:0/4113090513 wait complete. 2024-09-18T21:09:03.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:03 smithi077 ceph-mon[27689]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:03.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:03 smithi103 ceph-mon[34827]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:04.181 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-18T21:07:50.288606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-09-18T21:09:04.181 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-18T21:09:04.428 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:09:04.683 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:04 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/4113090513' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-18T21:09:04.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:04 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/4113090513' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-18T21:09:05.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:05 smithi077 ceph-mon[27689]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:05.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:05 smithi103 ceph-mon[34827]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:06.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:06.102+0000 7fab3bd1e640 1 -- 172.21.15.77:0/1234590949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab34102550 msgr2=0x7fab34102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:06.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:06.102+0000 7fab3bd1e640 1 --2- 172.21.15.77:0/1234590949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab34102550 0x7fab34102920 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fab300048d0 tx=0x7fab30009da0 comp rx=0 tx=0).stop 2024-09-18T21:09:06.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:06.102+0000 7fab3bd1e640 1 -- 172.21.15.77:0/1234590949 shutdown_connections 2024-09-18T21:09:06.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:06.102+0000 7fab3bd1e640 1 --2- 172.21.15.77:0/1234590949 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab34102ef0 0x7fab340fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:06.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:06.102+0000 7fab3bd1e640 1 --2- 172.21.15.77:0/1234590949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab34102550 0x7fab34102920 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:06.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:06.102+0000 7fab3bd1e640 1 -- 172.21.15.77:0/1234590949 >> 172.21.15.77:0/1234590949 conn(0x7fab340f80f0 msgr2=0x7fab340fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:09:06.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:06.103+0000 7fab3bd1e640 1 -- 172.21.15.77:0/1234590949 shutdown_connections 2024-09-18T21:09:06.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:06.103+0000 7fab3bd1e640 1 -- 172.21.15.77:0/1234590949 wait complete. 2024-09-18T21:09:06.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:06.103+0000 7fab3bd1e640 1 Processor -- start 2024-09-18T21:09:06.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:06.103+0000 7fab3bd1e640 1 -- start start 2024-09-18T21:09:06.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:06.103+0000 7fab3bd1e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab34102550 0x7fab341135b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:06.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:06.103+0000 7fab3bd1e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab34102ef0 0x7fab34113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:06.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:06.103+0000 7fab3bd1e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab341141d0 con 0x7fab34102ef0 2024-09-18T21:09:06.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:06.103+0000 7fab3bd1e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab3410d550 con 0x7fab34102550 2024-09-18T21:09:06.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:06.104+0000 7fab392b9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab34102ef0 0x7fab34113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:06.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:06.104+0000 7fab392b9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab34102ef0 0x7fab34113af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43520/0 (socket says 172.21.15.77:43520) 2024-09-18T21:09:06.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:06.104+0000 7fab392b9640 1 -- 172.21.15.77:0/616341115 learned_addr learned my addr 172.21.15.77:0/616341115 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:09:06.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:06.104+0000 7fab39aba640 1 --2- 172.21.15.77:0/616341115 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab34102550 0x7fab341135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:06.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:06.104+0000 7fab392b9640 1 -- 172.21.15.77:0/616341115 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab34102550 msgr2=0x7fab341135b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:06.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:06.104+0000 7fab392b9640 1 --2- 172.21.15.77:0/616341115 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab34102550 0x7fab341135b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:06.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:06.104+0000 7fab392b9640 1 -- 172.21.15.77:0/616341115 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab30005040 con 0x7fab34102ef0 2024-09-18T21:09:06.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:06.104+0000 7fab392b9640 1 --2- 172.21.15.77:0/616341115 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab34102ef0 0x7fab34113af0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fab2400b540 tx=0x7fab240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:06.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:06.104+0000 7fab2a7fc640 1 -- 172.21.15.77:0/616341115 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab2400f6f0 con 0x7fab34102ef0 2024-09-18T21:09:06.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:06.104+0000 7fab2a7fc640 1 -- 172.21.15.77:0/616341115 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fab2400fcf0 con 0x7fab34102ef0 2024-09-18T21:09:06.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:06.104+0000 7fab3bd1e640 1 -- 172.21.15.77:0/616341115 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab3410d7e0 con 0x7fab34102ef0 2024-09-18T21:09:06.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:06.104+0000 7fab2a7fc640 1 -- 172.21.15.77:0/616341115 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab24011e80 con 0x7fab34102ef0 2024-09-18T21:09:06.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:06.104+0000 7fab3bd1e640 1 -- 172.21.15.77:0/616341115 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab3410dd00 con 0x7fab34102ef0 2024-09-18T21:09:06.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:06.105+0000 7fab3bd1e640 1 -- 172.21.15.77:0/616341115 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab340fdcd0 con 0x7fab34102ef0 2024-09-18T21:09:06.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:06.106+0000 7fab2a7fc640 1 -- 172.21.15.77:0/616341115 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fab240116b0 con 0x7fab34102ef0 2024-09-18T21:09:06.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:06.107+0000 7fab2a7fc640 1 --2- 172.21.15.77:0/616341115 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fab2006ed60 0x7fab20071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:06.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:06.107+0000 7fab39aba640 1 --2- 172.21.15.77:0/616341115 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fab2006ed60 0x7fab20071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:06.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:06.107+0000 7fab2a7fc640 1 -- 172.21.15.77:0/616341115 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fab2408dc20 con 0x7fab34102ef0 2024-09-18T21:09:06.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:06.107+0000 7fab39aba640 1 --2- 172.21.15.77:0/616341115 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fab2006ed60 0x7fab20071210 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fab300048a0 tx=0x7fab30035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:06.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:06.111+0000 7fab2a7fc640 1 -- 172.21.15.77:0/616341115 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fab2405b1a0 con 0x7fab34102ef0 2024-09-18T21:09:06.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:06.270+0000 7fab3bd1e640 1 -- 172.21.15.77:0/616341115 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fab3410ec20 con 0x7fab34102ef0 2024-09-18T21:09:06.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:06.270+0000 7fab2a7fc640 1 -- 172.21.15.77:0/616341115 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7fab2405ab40 con 0x7fab34102ef0 2024-09-18T21:09:06.272 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2024-09-18T21:09:06.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:06.272+0000 7fab3bd1e640 1 -- 172.21.15.77:0/616341115 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fab2006ed60 msgr2=0x7fab20071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:06.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:06.272+0000 7fab3bd1e640 1 --2- 172.21.15.77:0/616341115 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fab2006ed60 0x7fab20071210 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fab300048a0 tx=0x7fab30035040 comp rx=0 tx=0).stop 2024-09-18T21:09:06.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:06.272+0000 7fab3bd1e640 1 -- 172.21.15.77:0/616341115 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab34102ef0 msgr2=0x7fab34113af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:06.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:06.272+0000 7fab3bd1e640 1 --2- 172.21.15.77:0/616341115 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab34102ef0 0x7fab34113af0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fab2400b540 tx=0x7fab240091a0 comp rx=0 tx=0).stop 2024-09-18T21:09:06.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:06.272+0000 7fab3bd1e640 1 -- 172.21.15.77:0/616341115 shutdown_connections 2024-09-18T21:09:06.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:06.272+0000 7fab3bd1e640 1 --2- 172.21.15.77:0/616341115 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fab2006ed60 0x7fab20071210 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:06.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:06.272+0000 7fab3bd1e640 1 --2- 172.21.15.77:0/616341115 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab34102ef0 0x7fab34113af0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:06.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:06.272+0000 7fab3bd1e640 1 --2- 172.21.15.77:0/616341115 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab34102550 0x7fab341135b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:06.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:06.272+0000 7fab3bd1e640 1 -- 172.21.15.77:0/616341115 >> 172.21.15.77:0/616341115 conn(0x7fab340f80f0 msgr2=0x7fab340f9180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:09:06.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:06.272+0000 7fab3bd1e640 1 -- 172.21.15.77:0/616341115 shutdown_connections 2024-09-18T21:09:06.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:06.273+0000 7fab3bd1e640 1 -- 172.21.15.77:0/616341115 wait complete. 2024-09-18T21:09:06.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:06 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/616341115' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-18T21:09:06.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:06 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/616341115' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-18T21:09:06.928 INFO:tasks.cephadm:Setting up client nodes... 2024-09-18T21:09:06.928 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-18T21:09:07.172 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:09:07.549 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:07 smithi077 ceph-mon[27689]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:07.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:07 smithi103 ceph-mon[34827]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:08.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:08.915+0000 7f6186323640 1 -- 172.21.15.77:0/917369267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6180101b00 msgr2=0x7f6180103ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:08.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:08.915+0000 7f6186323640 1 --2- 172.21.15.77:0/917369267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6180101b00 0x7f6180103ee0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f61680048d0 tx=0x7f6168009da0 comp rx=0 tx=0).stop 2024-09-18T21:09:08.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:08.915+0000 7f6186323640 1 -- 172.21.15.77:0/917369267 shutdown_connections 2024-09-18T21:09:08.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:08.915+0000 7f6186323640 1 --2- 172.21.15.77:0/917369267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6180101b00 0x7f6180103ee0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:08.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:08.915+0000 7f6186323640 1 --2- 172.21.15.77:0/917369267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6180065bc0 0x7f61801015c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:08.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:08.915+0000 7f6186323640 1 -- 172.21.15.77:0/917369267 >> 172.21.15.77:0/917369267 conn(0x7f61800f6bf0 msgr2=0x7f61800f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:09:08.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:08.915+0000 7f6186323640 1 -- 172.21.15.77:0/917369267 shutdown_connections 2024-09-18T21:09:08.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:08.915+0000 7f6186323640 1 -- 172.21.15.77:0/917369267 wait complete. 2024-09-18T21:09:08.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:08.915+0000 7f6186323640 1 Processor -- start 2024-09-18T21:09:08.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:08.915+0000 7f6186323640 1 -- start start 2024-09-18T21:09:08.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:08.915+0000 7f6186323640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6180065bc0 0x7f618010f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:08.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:08.915+0000 7f6186323640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6180101b00 0x7f618010f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:08.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:08.915+0000 7f6186323640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618010fe00 con 0x7f6180101b00 2024-09-18T21:09:08.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:08.915+0000 7f6186323640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6180110620 con 0x7f6180065bc0 2024-09-18T21:09:08.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:08.915+0000 7f6177fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6180101b00 0x7f618010f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:08.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:08.915+0000 7f6177fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6180101b00 0x7f618010f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43538/0 (socket says 172.21.15.77:43538) 2024-09-18T21:09:08.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:08.915+0000 7f6177fff640 1 -- 172.21.15.77:0/301598133 learned_addr learned my addr 172.21.15.77:0/301598133 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:09:08.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:08.916+0000 7f617ffff640 1 --2- 172.21.15.77:0/301598133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6180065bc0 0x7f618010f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:08.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:08.916+0000 7f6177fff640 1 -- 172.21.15.77:0/301598133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6180065bc0 msgr2=0x7f618010f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:08.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:08.916+0000 7f6177fff640 1 --2- 172.21.15.77:0/301598133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6180065bc0 0x7f618010f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:08.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:08.916+0000 7f6177fff640 1 -- 172.21.15.77:0/301598133 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6168005040 con 0x7f6180101b00 2024-09-18T21:09:08.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:08.916+0000 7f617ffff640 1 --2- 172.21.15.77:0/301598133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6180065bc0 0x7f618010f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T21:09:08.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:08.916+0000 7f6177fff640 1 --2- 172.21.15.77:0/301598133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6180101b00 0x7f618010f7b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f61680048a0 tx=0x7f6168009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:08.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:08.916+0000 7f617d7fa640 1 -- 172.21.15.77:0/301598133 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6168038070 con 0x7f6180101b00 2024-09-18T21:09:08.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:08.916+0000 7f617d7fa640 1 -- 172.21.15.77:0/301598133 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f616802abd0 con 0x7f6180101b00 2024-09-18T21:09:08.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:08.916+0000 7f617d7fa640 1 -- 172.21.15.77:0/301598133 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6168033640 con 0x7f6180101b00 2024-09-18T21:09:08.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:08.916+0000 7f6186323640 1 -- 172.21.15.77:0/301598133 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6180110850 con 0x7f6180101b00 2024-09-18T21:09:08.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:08.916+0000 7f6186323640 1 -- 172.21.15.77:0/301598133 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6180110da0 con 0x7f6180101b00 2024-09-18T21:09:08.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:08.917+0000 7f6186323640 1 -- 172.21.15.77:0/301598133 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61800fa890 con 0x7f6180101b00 2024-09-18T21:09:08.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:08.918+0000 7f617d7fa640 1 -- 172.21.15.77:0/301598133 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f6168030020 con 0x7f6180101b00 2024-09-18T21:09:08.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:08.918+0000 7f617d7fa640 1 --2- 172.21.15.77:0/301598133 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f616c06ed60 0x7f616c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:08.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:08.918+0000 7f617d7fa640 1 -- 172.21.15.77:0/301598133 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f61680ae1b0 con 0x7f6180101b00 2024-09-18T21:09:08.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:08.918+0000 7f617ffff640 1 --2- 172.21.15.77:0/301598133 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f616c06ed60 0x7f616c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:08.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:08.919+0000 7f617ffff640 1 --2- 172.21.15.77:0/301598133 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f616c06ed60 0x7f616c071210 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6180065920 tx=0x7f6170009040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:08.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:08.922+0000 7f617d7fa640 1 -- 172.21.15.77:0/301598133 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f616807b610 con 0x7f6180101b00 2024-09-18T21:09:09.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:09.134+0000 7f6186323640 1 -- 172.21.15.77:0/301598133 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f618004b720 con 0x7f6180101b00 2024-09-18T21:09:09.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:09.138+0000 7f617d7fa640 1 -- 172.21.15.77:0/301598133 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7f616807afb0 con 0x7f6180101b00 2024-09-18T21:09:09.139 INFO:teuthology.orchestra.run.smithi077.stdout:[client.0] 2024-09-18T21:09:09.139 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQB1Qetm0cUQCBAAsmH0UpHaAJB7VyAAz8zBGw== 2024-09-18T21:09:09.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:09.139+0000 7f6186323640 1 -- 172.21.15.77:0/301598133 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f616c06ed60 msgr2=0x7f616c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:09.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:09.140+0000 7f6186323640 1 --2- 172.21.15.77:0/301598133 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f616c06ed60 0x7f616c071210 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6180065920 tx=0x7f6170009040 comp rx=0 tx=0).stop 2024-09-18T21:09:09.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:09.140+0000 7f6186323640 1 -- 172.21.15.77:0/301598133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6180101b00 msgr2=0x7f618010f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:09.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:09.140+0000 7f6186323640 1 --2- 172.21.15.77:0/301598133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6180101b00 0x7f618010f7b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f61680048a0 tx=0x7f6168009da0 comp rx=0 tx=0).stop 2024-09-18T21:09:09.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:09.140+0000 7f6186323640 1 -- 172.21.15.77:0/301598133 shutdown_connections 2024-09-18T21:09:09.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:09.140+0000 7f6186323640 1 --2- 172.21.15.77:0/301598133 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f616c06ed60 0x7f616c071210 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:09.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:09.140+0000 7f6186323640 1 --2- 172.21.15.77:0/301598133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6180101b00 0x7f618010f7b0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:09.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:09.140+0000 7f6186323640 1 --2- 172.21.15.77:0/301598133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6180065bc0 0x7f618010f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:09.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:09.140+0000 7f6186323640 1 -- 172.21.15.77:0/301598133 >> 172.21.15.77:0/301598133 conn(0x7f61800f6bf0 msgr2=0x7f61800f7010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:09:09.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:09.140+0000 7f6186323640 1 -- 172.21.15.77:0/301598133 shutdown_connections 2024-09-18T21:09:09.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:09.140+0000 7f6186323640 1 -- 172.21.15.77:0/301598133 wait complete. 2024-09-18T21:09:09.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:09 smithi077 ceph-mon[27689]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:09.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:09 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/301598133' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-18T21:09:09.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:09 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/301598133' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-18T21:09:09.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:09 smithi103 ceph-mon[34827]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:09.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:09 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/301598133' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-18T21:09:09.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:09 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/301598133' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-18T21:09:09.814 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-18T21:09:09.814 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-18T21:09:09.814 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-18T21:09:09.852 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-18T21:09:10.111 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi103/config 2024-09-18T21:09:11.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:09:11.623+0000 7f025e7be640 1 -- 172.21.15.103:0/317992468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02580fc700 msgr2=0x7f02580fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:11.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:09:11.623+0000 7f025e7be640 1 --2- 172.21.15.103:0/317992468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02580fc700 0x7f02580fcb70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f02400048d0 tx=0x7f0240009da0 comp rx=0 tx=0).stop 2024-09-18T21:09:11.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:09:11.623+0000 7f025e7be640 1 -- 172.21.15.103:0/317992468 shutdown_connections 2024-09-18T21:09:11.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:09:11.623+0000 7f025e7be640 1 --2- 172.21.15.103:0/317992468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02580fc700 0x7f02580fcb70 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:11.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:09:11.623+0000 7f025e7be640 1 --2- 172.21.15.103:0/317992468 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02580fb430 0x7f02580fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:11.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:09:11.623+0000 7f025e7be640 1 -- 172.21.15.103:0/317992468 >> 172.21.15.103:0/317992468 conn(0x7f02580f6bf0 msgr2=0x7f02580f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:09:11.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:09:11.623+0000 7f025e7be640 1 -- 172.21.15.103:0/317992468 shutdown_connections 2024-09-18T21:09:11.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:09:11.623+0000 7f025e7be640 1 -- 172.21.15.103:0/317992468 wait complete. 2024-09-18T21:09:11.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:09:11.623+0000 7f025e7be640 1 Processor -- start 2024-09-18T21:09:11.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:09:11.623+0000 7f025e7be640 1 -- start start 2024-09-18T21:09:11.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:09:11.624+0000 7f025e7be640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02580fb430 0x7f025810d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:11.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:09:11.624+0000 7f025e7be640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02580fc700 0x7f025810d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:11.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:09:11.624+0000 7f025e7be640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f025810dbd0 con 0x7f02580fc700 2024-09-18T21:09:11.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:09:11.624+0000 7f025e7be640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f025810e3f0 con 0x7f02580fb430 2024-09-18T21:09:11.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:09:11.624+0000 7f0257fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02580fb430 0x7f025810d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:11.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:09:11.624+0000 7f0257fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02580fb430 0x7f025810d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59504/0 (socket says 172.21.15.103:59504) 2024-09-18T21:09:11.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:09:11.624+0000 7f0257fff640 1 -- 172.21.15.103:0/3088695448 learned_addr learned my addr 172.21.15.103:0/3088695448 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-18T21:09:11.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:09:11.624+0000 7f0257fff640 1 -- 172.21.15.103:0/3088695448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02580fc700 msgr2=0x7f025810d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:11.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:09:11.624+0000 7f0257fff640 1 --2- 172.21.15.103:0/3088695448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02580fc700 0x7f025810d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:11.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:09:11.624+0000 7f0257fff640 1 -- 172.21.15.103:0/3088695448 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0240005040 con 0x7f02580fb430 2024-09-18T21:09:11.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:09:11.624+0000 7f0257fff640 1 --2- 172.21.15.103:0/3088695448 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02580fb430 0x7f025810d040 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0248002a80 tx=0x7f0248004600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:11.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:09:11.624+0000 7f02557fa640 1 -- 172.21.15.103:0/3088695448 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0248007c30 con 0x7f02580fb430 2024-09-18T21:09:11.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:09:11.624+0000 7f025e7be640 1 -- 172.21.15.103:0/3088695448 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f025810e680 con 0x7f02580fb430 2024-09-18T21:09:11.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:09:11.624+0000 7f02557fa640 1 -- 172.21.15.103:0/3088695448 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f024800f040 con 0x7f02580fb430 2024-09-18T21:09:11.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:09:11.624+0000 7f02557fa640 1 -- 172.21.15.103:0/3088695448 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0248009530 con 0x7f02580fb430 2024-09-18T21:09:11.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:09:11.624+0000 7f025e7be640 1 -- 172.21.15.103:0/3088695448 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f025810eba0 con 0x7f02580fb430 2024-09-18T21:09:11.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:09:11.625+0000 7f025e7be640 1 -- 172.21.15.103:0/3088695448 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02580fa890 con 0x7f02580fb430 2024-09-18T21:09:11.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:09:11.626+0000 7f02557fa640 1 -- 172.21.15.103:0/3088695448 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f02480097a0 con 0x7f02580fb430 2024-09-18T21:09:11.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:09:11.626+0000 7f02557fa640 1 --2- 172.21.15.103:0/3088695448 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f024406ed60 0x7f0244071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:11.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:09:11.626+0000 7f02557fa640 1 -- 172.21.15.103:0/3088695448 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f024808d800 con 0x7f02580fb430 2024-09-18T21:09:11.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:09:11.627+0000 7f024ffff640 1 --2- 172.21.15.103:0/3088695448 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f024406ed60 0x7f0244071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:11.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:09:11.627+0000 7f024ffff640 1 --2- 172.21.15.103:0/3088695448 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f024406ed60 0x7f0244071210 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f024002a530 tx=0x7f0240009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:11.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:09:11.631+0000 7f02557fa640 1 -- 172.21.15.103:0/3088695448 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f024804d2a0 con 0x7f02580fb430 2024-09-18T21:09:11.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:11 smithi077 ceph-mon[27689]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:11.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:11 smithi103 ceph-mon[34827]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:11.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:09:11.844+0000 7f025e7be640 1 -- 172.21.15.103:0/3088695448 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f0258103fc0 con 0x7f02580fb430 2024-09-18T21:09:11.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:09:11.850+0000 7f02557fa640 1 -- 172.21.15.103:0/3088695448 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7f0258103fc0 con 0x7f02580fb430 2024-09-18T21:09:11.852 INFO:teuthology.orchestra.run.smithi103.stdout:[client.1] 2024-09-18T21:09:11.852 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQB3QetmkjeEMhAAoSwLDUS9PEnQ+67WZ8m2LQ== 2024-09-18T21:09:11.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:09:11.852+0000 7f025e7be640 1 -- 172.21.15.103:0/3088695448 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f024406ed60 msgr2=0x7f0244071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:11.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:09:11.852+0000 7f025e7be640 1 --2- 172.21.15.103:0/3088695448 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f024406ed60 0x7f0244071210 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f024002a530 tx=0x7f0240009da0 comp rx=0 tx=0).stop 2024-09-18T21:09:11.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:09:11.852+0000 7f025e7be640 1 -- 172.21.15.103:0/3088695448 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02580fb430 msgr2=0x7f025810d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:11.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:09:11.852+0000 7f025e7be640 1 --2- 172.21.15.103:0/3088695448 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02580fb430 0x7f025810d040 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0248002a80 tx=0x7f0248004600 comp rx=0 tx=0).stop 2024-09-18T21:09:11.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:09:11.852+0000 7f025e7be640 1 -- 172.21.15.103:0/3088695448 shutdown_connections 2024-09-18T21:09:11.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:09:11.852+0000 7f025e7be640 1 --2- 172.21.15.103:0/3088695448 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f024406ed60 0x7f0244071210 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:11.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:09:11.852+0000 7f025e7be640 1 --2- 172.21.15.103:0/3088695448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02580fc700 0x7f025810d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:11.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:09:11.852+0000 7f025e7be640 1 --2- 172.21.15.103:0/3088695448 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02580fb430 0x7f025810d040 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:11.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:09:11.852+0000 7f025e7be640 1 -- 172.21.15.103:0/3088695448 >> 172.21.15.103:0/3088695448 conn(0x7f02580f6bf0 msgr2=0x7f02580f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:09:11.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:09:11.852+0000 7f025e7be640 1 -- 172.21.15.103:0/3088695448 shutdown_connections 2024-09-18T21:09:11.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:09:11.852+0000 7f025e7be640 1 -- 172.21.15.103:0/3088695448 wait complete. 2024-09-18T21:09:12.433 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-18T21:09:12.434 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-18T21:09:12.434 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-18T21:09:12.472 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-18T21:09:12.472 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-18T21:09:12.472 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-18T21:09:12.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:12 smithi077 ceph-mon[27689]: from='client.? 172.21.15.103:0/3088695448' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-18T21:09:12.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:12 smithi077 ceph-mon[27689]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-18T21:09:12.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:12 smithi077 ceph-mon[27689]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-18T21:09:12.730 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:09:12.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:12 smithi103 ceph-mon[34827]: from='client.? 172.21.15.103:0/3088695448' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-18T21:09:12.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:12 smithi103 ceph-mon[34827]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-18T21:09:12.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:12 smithi103 ceph-mon[34827]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-18T21:09:13.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:13 smithi077 ceph-mon[27689]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:13.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:13 smithi103 ceph-mon[34827]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:14.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:14.397+0000 7f2e815ac640 1 -- 172.21.15.77:0/3843623081 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e7c102550 msgr2=0x7f2e7c102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:14.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:14.397+0000 7f2e815ac640 1 --2- 172.21.15.77:0/3843623081 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e7c102550 0x7f2e7c102920 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c0048d0 tx=0x7f2e6c009da0 comp rx=0 tx=0).stop 2024-09-18T21:09:14.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:14.397+0000 7f2e815ac640 1 -- 172.21.15.77:0/3843623081 shutdown_connections 2024-09-18T21:09:14.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:14.397+0000 7f2e815ac640 1 --2- 172.21.15.77:0/3843623081 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e7c102ef0 0x7f2e7c0fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:14.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:14.397+0000 7f2e815ac640 1 --2- 172.21.15.77:0/3843623081 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e7c102550 0x7f2e7c102920 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:14.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:14.397+0000 7f2e815ac640 1 -- 172.21.15.77:0/3843623081 >> 172.21.15.77:0/3843623081 conn(0x7f2e7c0f80f0 msgr2=0x7f2e7c0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:09:14.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:14.397+0000 7f2e815ac640 1 -- 172.21.15.77:0/3843623081 shutdown_connections 2024-09-18T21:09:14.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:14.397+0000 7f2e815ac640 1 -- 172.21.15.77:0/3843623081 wait complete. 2024-09-18T21:09:14.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:14.398+0000 7f2e815ac640 1 Processor -- start 2024-09-18T21:09:14.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:14.398+0000 7f2e815ac640 1 -- start start 2024-09-18T21:09:14.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:14.398+0000 7f2e815ac640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e7c102550 0x7f2e7c113540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:14.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:14.398+0000 7f2e815ac640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e7c102ef0 0x7f2e7c113a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:14.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:14.398+0000 7f2e815ac640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7c1140d0 con 0x7f2e7c102550 2024-09-18T21:09:14.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:14.398+0000 7f2e815ac640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7c10d4e0 con 0x7f2e7c102ef0 2024-09-18T21:09:14.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:14.398+0000 7f2e7affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e7c102550 0x7f2e7c113540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:14.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:14.398+0000 7f2e7affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e7c102550 0x7f2e7c113540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34002/0 (socket says 172.21.15.77:34002) 2024-09-18T21:09:14.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:14.398+0000 7f2e7affd640 1 -- 172.21.15.77:0/2696986981 learned_addr learned my addr 172.21.15.77:0/2696986981 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:09:14.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:14.398+0000 7f2e727fc640 1 --2- 172.21.15.77:0/2696986981 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e7c102ef0 0x7f2e7c113a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:14.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:14.399+0000 7f2e7affd640 1 -- 172.21.15.77:0/2696986981 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e7c102ef0 msgr2=0x7f2e7c113a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:14.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:14.399+0000 7f2e7affd640 1 --2- 172.21.15.77:0/2696986981 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e7c102ef0 0x7f2e7c113a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:14.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:14.399+0000 7f2e7affd640 1 -- 172.21.15.77:0/2696986981 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e6c005040 con 0x7f2e7c102550 2024-09-18T21:09:14.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:14.399+0000 7f2e727fc640 1 --2- 172.21.15.77:0/2696986981 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e7c102ef0 0x7f2e7c113a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T21:09:14.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:14.399+0000 7f2e7affd640 1 --2- 172.21.15.77:0/2696986981 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e7c102550 0x7f2e7c113540 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c000c00 tx=0x7f2e6c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:14.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:14.399+0000 7f2e73fff640 1 -- 172.21.15.77:0/2696986981 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e6c038070 con 0x7f2e7c102550 2024-09-18T21:09:14.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:14.399+0000 7f2e73fff640 1 -- 172.21.15.77:0/2696986981 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2e6c02ade0 con 0x7f2e7c102550 2024-09-18T21:09:14.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:14.399+0000 7f2e815ac640 1 -- 172.21.15.77:0/2696986981 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e7c10d760 con 0x7f2e7c102550 2024-09-18T21:09:14.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:14.399+0000 7f2e73fff640 1 -- 172.21.15.77:0/2696986981 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e6c02c7e0 con 0x7f2e7c102550 2024-09-18T21:09:14.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:14.399+0000 7f2e815ac640 1 -- 172.21.15.77:0/2696986981 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e7c10dca0 con 0x7f2e7c102550 2024-09-18T21:09:14.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:14.400+0000 7f2e815ac640 1 -- 172.21.15.77:0/2696986981 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e7c0fdcd0 con 0x7f2e7c102550 2024-09-18T21:09:14.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:14.400+0000 7f2e73fff640 1 -- 172.21.15.77:0/2696986981 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f2e6c030020 con 0x7f2e7c102550 2024-09-18T21:09:14.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:14.401+0000 7f2e73fff640 1 --2- 172.21.15.77:0/2696986981 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f2e6806ed60 0x7f2e68071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:14.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:14.401+0000 7f2e727fc640 1 --2- 172.21.15.77:0/2696986981 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f2e6806ed60 0x7f2e68071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:14.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:14.401+0000 7f2e73fff640 1 -- 172.21.15.77:0/2696986981 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f2e6c0adad0 con 0x7f2e7c102550 2024-09-18T21:09:14.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:14.401+0000 7f2e727fc640 1 --2- 172.21.15.77:0/2696986981 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f2e6806ed60 0x7f2e68071210 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2e64007fd0 tx=0x7f2e64009e90 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:14.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:14.405+0000 7f2e73fff640 1 -- 172.21.15.77:0/2696986981 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f2e6c07afe0 con 0x7f2e7c102550 2024-09-18T21:09:14.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:14 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:09:14.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:14.601+0000 7f2e815ac640 1 -- 172.21.15.77:0/2696986981 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f2e7c04b750 con 0x7f2e7c102550 2024-09-18T21:09:14.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:14.604+0000 7f2e73fff640 1 -- 172.21.15.77:0/2696986981 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+176710 (secure 0 0 0) 0x7f2e6c07a980 con 0x7f2e7c102550 2024-09-18T21:09:14.608 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:09:14.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:14.606+0000 7f2e815ac640 1 -- 172.21.15.77:0/2696986981 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f2e6806ed60 msgr2=0x7f2e68071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:14.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:14.606+0000 7f2e815ac640 1 --2- 172.21.15.77:0/2696986981 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f2e6806ed60 0x7f2e68071210 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2e64007fd0 tx=0x7f2e64009e90 comp rx=0 tx=0).stop 2024-09-18T21:09:14.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:14.606+0000 7f2e815ac640 1 -- 172.21.15.77:0/2696986981 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e7c102550 msgr2=0x7f2e7c113540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:14.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:14.606+0000 7f2e815ac640 1 --2- 172.21.15.77:0/2696986981 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e7c102550 0x7f2e7c113540 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c000c00 tx=0x7f2e6c009da0 comp rx=0 tx=0).stop 2024-09-18T21:09:14.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:14.606+0000 7f2e815ac640 1 -- 172.21.15.77:0/2696986981 shutdown_connections 2024-09-18T21:09:14.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:14.606+0000 7f2e815ac640 1 --2- 172.21.15.77:0/2696986981 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f2e6806ed60 0x7f2e68071210 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:14.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:14.606+0000 7f2e815ac640 1 --2- 172.21.15.77:0/2696986981 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e7c102ef0 0x7f2e7c113a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:14.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:14.606+0000 7f2e815ac640 1 --2- 172.21.15.77:0/2696986981 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e7c102550 0x7f2e7c113540 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:14.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:14.607+0000 7f2e815ac640 1 -- 172.21.15.77:0/2696986981 >> 172.21.15.77:0/2696986981 conn(0x7f2e7c0f80f0 msgr2=0x7f2e7c0f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:09:14.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:14.607+0000 7f2e815ac640 1 -- 172.21.15.77:0/2696986981 shutdown_connections 2024-09-18T21:09:14.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:14.607+0000 7f2e815ac640 1 -- 172.21.15.77:0/2696986981 wait complete. 2024-09-18T21:09:14.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:14 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:09:15.285 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":19,"flags":0,"active_gid":14206,"active_name":"smithi077.utkpjg","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":950747822},{"type":"v1","addr":"172.21.15.77:6801","nonce":950747822}]},"active_addr":"172.21.15.77:6801/950747822","active_change":"2024-09-18T21:05:43.984798+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14226,"name":"smithi103.zjztqc","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.77:8443/","prometheus":"http://172.21.15.77:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":2000509866}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":1675041738}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":2441256396}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":1925894390}]}]} 2024-09-18T21:09:15.291 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-18T21:09:15.291 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-18T21:09:15.292 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-18T21:09:15.539 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:09:15.659 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:15 smithi077 ceph-mon[27689]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:15.660 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:15 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/2696986981' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-18T21:09:15.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:15 smithi103 ceph-mon[34827]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:15.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:15 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/2696986981' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-18T21:09:17.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:17.097+0000 7f4b96003640 1 -- 172.21.15.77:0/4095688910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b900fb4c0 msgr2=0x7f4b900fb930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:17.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:17.097+0000 7f4b96003640 1 --2- 172.21.15.77:0/4095688910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b900fb4c0 0x7f4b900fb930 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4b840048d0 tx=0x7f4b84009da0 comp rx=0 tx=0).stop 2024-09-18T21:09:17.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:17.097+0000 7f4b96003640 1 -- 172.21.15.77:0/4095688910 shutdown_connections 2024-09-18T21:09:17.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:17.097+0000 7f4b96003640 1 --2- 172.21.15.77:0/4095688910 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b900fb4c0 0x7f4b900fb930 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:17.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:17.097+0000 7f4b96003640 1 --2- 172.21.15.77:0/4095688910 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b90101500 0x7f4b901018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:17.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:17.097+0000 7f4b96003640 1 -- 172.21.15.77:0/4095688910 >> 172.21.15.77:0/4095688910 conn(0x7f4b900f7000 msgr2=0x7f4b900f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:09:17.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:17.097+0000 7f4b96003640 1 -- 172.21.15.77:0/4095688910 shutdown_connections 2024-09-18T21:09:17.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:17.097+0000 7f4b96003640 1 -- 172.21.15.77:0/4095688910 wait complete. 2024-09-18T21:09:17.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:17.098+0000 7f4b96003640 1 Processor -- start 2024-09-18T21:09:17.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:17.098+0000 7f4b96003640 1 -- start start 2024-09-18T21:09:17.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:17.098+0000 7f4b96003640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b900fb4c0 0x7f4b9010e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:17.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:17.098+0000 7f4b96003640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b90101500 0x7f4b9010e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:17.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:17.098+0000 7f4b96003640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9010ed20 con 0x7f4b900fb4c0 2024-09-18T21:09:17.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:17.098+0000 7f4b96003640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9010ee90 con 0x7f4b90101500 2024-09-18T21:09:17.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:17.098+0000 7f4b8f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b900fb4c0 0x7f4b9010e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:17.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:17.098+0000 7f4b8f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b900fb4c0 0x7f4b9010e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34018/0 (socket says 172.21.15.77:34018) 2024-09-18T21:09:17.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:17.098+0000 7f4b8f7fe640 1 -- 172.21.15.77:0/2543390480 learned_addr learned my addr 172.21.15.77:0/2543390480 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:09:17.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:17.098+0000 7f4b8effd640 1 --2- 172.21.15.77:0/2543390480 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b90101500 0x7f4b9010e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:17.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:17.098+0000 7f4b8f7fe640 1 -- 172.21.15.77:0/2543390480 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b90101500 msgr2=0x7f4b9010e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:17.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:17.098+0000 7f4b8f7fe640 1 --2- 172.21.15.77:0/2543390480 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b90101500 0x7f4b9010e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:17.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:17.098+0000 7f4b8f7fe640 1 -- 172.21.15.77:0/2543390480 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b84005040 con 0x7f4b900fb4c0 2024-09-18T21:09:17.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:17.099+0000 7f4b8f7fe640 1 --2- 172.21.15.77:0/2543390480 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b900fb4c0 0x7f4b9010e190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4b80002a50 tx=0x7f4b80004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:17.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:17.099+0000 7f4b77fff640 1 -- 172.21.15.77:0/2543390480 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b80007c30 con 0x7f4b900fb4c0 2024-09-18T21:09:17.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:17.099+0000 7f4b77fff640 1 -- 172.21.15.77:0/2543390480 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4b8000f040 con 0x7f4b900fb4c0 2024-09-18T21:09:17.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:17.099+0000 7f4b96003640 1 -- 172.21.15.77:0/2543390480 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b90117200 con 0x7f4b900fb4c0 2024-09-18T21:09:17.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:17.099+0000 7f4b77fff640 1 -- 172.21.15.77:0/2543390480 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b8000da10 con 0x7f4b900fb4c0 2024-09-18T21:09:17.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:17.099+0000 7f4b96003640 1 -- 172.21.15.77:0/2543390480 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b90117710 con 0x7f4b900fb4c0 2024-09-18T21:09:17.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:17.100+0000 7f4b96003640 1 -- 172.21.15.77:0/2543390480 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b900fcc00 con 0x7f4b900fb4c0 2024-09-18T21:09:17.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:17.100+0000 7f4b77fff640 1 -- 172.21.15.77:0/2543390480 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f4b8000dbb0 con 0x7f4b900fb4c0 2024-09-18T21:09:17.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:17.101+0000 7f4b77fff640 1 --2- 172.21.15.77:0/2543390480 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f4b7806ed50 0x7f4b78071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:17.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:17.101+0000 7f4b77fff640 1 -- 172.21.15.77:0/2543390480 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f4b8008d480 con 0x7f4b900fb4c0 2024-09-18T21:09:17.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:17.101+0000 7f4b8effd640 1 --2- 172.21.15.77:0/2543390480 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f4b7806ed50 0x7f4b78071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:17.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:17.101+0000 7f4b8effd640 1 --2- 172.21.15.77:0/2543390480 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f4b7806ed50 0x7f4b78071200 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4b84009ac0 tx=0x7f4b84035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:17.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:17.105+0000 7f4b77fff640 1 -- 172.21.15.77:0/2543390480 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4b8004d2a0 con 0x7f4b900fb4c0 2024-09-18T21:09:17.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:17.258+0000 7f4b96003640 1 -- 172.21.15.77:0/2543390480 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b900661a0 con 0x7f4b900fb4c0 2024-09-18T21:09:17.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:17.259+0000 7f4b77fff640 1 -- 172.21.15.77:0/2543390480 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+11067 (secure 0 0 0) 0x7f4b8005aad0 con 0x7f4b900fb4c0 2024-09-18T21:09:17.260 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:09:17.260 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":38,"fsid":"5a76ec16-7601-11ef-bceb-c7b262605968","created":"2024-09-18T21:03:45.904815+0000","modified":"2024-09-18T21:09:01.148412+0000","last_up_change":"2024-09-18T21:09:00.146831+0000","last_in_change":"2024-09-18T21:08:41.769170+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T21:07:50.288606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"309fcfaf-2c45-482b-a95a-92bedbd7a042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1327461769},{"type":"v1","addr":"172.21.15.77:6803","nonce":1327461769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1327461769},{"type":"v1","addr":"172.21.15.77:6805","nonce":1327461769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1327461769},{"type":"v1","addr":"172.21.15.77:6809","nonce":1327461769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1327461769},{"type":"v1","addr":"172.21.15.77:6807","nonce":1327461769}]},"public_addr":"172.21.15.77:6803/1327461769","cluster_addr":"172.21.15.77:6805/1327461769","heartbeat_back_addr":"172.21.15.77:6809/1327461769","heartbeat_front_addr":"172.21.15.77:6807/1327461769","state":["exists","up"]},{"osd":1,"uuid":"782aa0e2-9332-4440-b0ef-e5260e767374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":164854543},{"type":"v1","addr":"172.21.15.77:6811","nonce":164854543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":164854543},{"type":"v1","addr":"172.21.15.77:6813","nonce":164854543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":164854543},{"type":"v1","addr":"172.21.15.77:6817","nonce":164854543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":164854543},{"type":"v1","addr":"172.21.15.77:6815","nonce":164854543}]},"public_addr":"172.21.15.77:6811/164854543","cluster_addr":"172.21.15.77:6813/164854543","heartbeat_back_addr":"172.21.15.77:6817/164854543","heartbeat_front_addr":"172.21.15.77:6815/164854543","state":["exists","up"]},{"osd":2,"uuid":"0d3bbcd5-1c51-42ec-a670-e5081188f7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":462691237},{"type":"v1","addr":"172.21.15.77:6819","nonce":462691237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":462691237},{"type":"v1","addr":"172.21.15.77:6821","nonce":462691237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":462691237},{"type":"v1","addr":"172.21.15.77:6825","nonce":462691237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":462691237},{"type":"v1","addr":"172.21.15.77:6823","nonce":462691237}]},"public_addr":"172.21.15.77:6819/462691237","cluster_addr":"172.21.15.77:6821/462691237","heartbeat_back_addr":"172.21.15.77:6825/462691237","heartbeat_front_addr":"172.21.15.77:6823/462691237","state":["exists","up"]},{"osd":3,"uuid":"200136ca-fc2a-4917-af11-1c3c730126c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":2640098104},{"type":"v1","addr":"172.21.15.103:6801","nonce":2640098104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":2640098104},{"type":"v1","addr":"172.21.15.103:6803","nonce":2640098104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":2640098104},{"type":"v1","addr":"172.21.15.103:6807","nonce":2640098104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":2640098104},{"type":"v1","addr":"172.21.15.103:6805","nonce":2640098104}]},"public_addr":"172.21.15.103:6801/2640098104","cluster_addr":"172.21.15.103:6803/2640098104","heartbeat_back_addr":"172.21.15.103:6807/2640098104","heartbeat_front_addr":"172.21.15.103:6805/2640098104","state":["exists","up"]},{"osd":4,"uuid":"146e24e4-931a-4a54-b32c-c96d4f2babe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":3297772484},{"type":"v1","addr":"172.21.15.103:6809","nonce":3297772484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":3297772484},{"type":"v1","addr":"172.21.15.103:6811","nonce":3297772484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":3297772484},{"type":"v1","addr":"172.21.15.103:6815","nonce":3297772484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":3297772484},{"type":"v1","addr":"172.21.15.103:6813","nonce":3297772484}]},"public_addr":"172.21.15.103:6809/3297772484","cluster_addr":"172.21.15.103:6811/3297772484","heartbeat_back_addr":"172.21.15.103:6815/3297772484","heartbeat_front_addr":"172.21.15.103:6813/3297772484","state":["exists","up"]},{"osd":5,"uuid":"aab4da9a-351b-47ba-b3cc-b6d1fef36186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2618312891},{"type":"v1","addr":"172.21.15.103:6817","nonce":2618312891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":2618312891},{"type":"v1","addr":"172.21.15.103:6819","nonce":2618312891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2618312891},{"type":"v1","addr":"172.21.15.103:6823","nonce":2618312891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2618312891},{"type":"v1","addr":"172.21.15.103:6821","nonce":2618312891}]},"public_addr":"172.21.15.103:6817/2618312891","cluster_addr":"172.21.15.103:6819/2618312891","heartbeat_back_addr":"172.21.15.103:6823/2618312891","heartbeat_front_addr":"172.21.15.103:6821/2618312891","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T21:06:52.988132+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T21:07:20.637797+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T21:07:47.403897+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T21:08:09.448266+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T21:08:33.691899+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T21:08:58.481603+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:0/1737764691":"2024-09-19T21:05:43.984681+0000","172.21.15.77:6800/3162219942":"2024-09-19T21:04:16.080867+0000","172.21.15.77:6801/3162219942":"2024-09-19T21:04:16.080867+0000","172.21.15.77:0/366153409":"2024-09-19T21:04:16.080867+0000","172.21.15.77:6801/517401638":"2024-09-19T21:05:43.984681+0000","172.21.15.77:0/2651561696":"2024-09-19T21:04:16.080867+0000","172.21.15.77:0/3346293395":"2024-09-19T21:04:44.916890+0000","172.21.15.77:0/3396145514":"2024-09-19T21:05:43.984681+0000","172.21.15.77:0/1416108819":"2024-09-19T21:04:16.080867+0000","172.21.15.77:0/268486755":"2024-09-19T21:04:44.916890+0000","172.21.15.77:0/42563880":"2024-09-19T21:04:44.916890+0000","172.21.15.77:6801/2654225509":"2024-09-19T21:04:44.916890+0000","172.21.15.77:6800/2654225509":"2024-09-19T21:04:44.916890+0000","172.21.15.77:0/2389819393":"2024-09-19T21:05:43.984681+0000","172.21.15.77:6800/517401638":"2024-09-19T21:05:43.984681+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T21:09:17.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:17.261+0000 7f4b96003640 1 -- 172.21.15.77:0/2543390480 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f4b7806ed50 msgr2=0x7f4b78071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:17.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:17.261+0000 7f4b96003640 1 --2- 172.21.15.77:0/2543390480 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f4b7806ed50 0x7f4b78071200 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4b84009ac0 tx=0x7f4b84035040 comp rx=0 tx=0).stop 2024-09-18T21:09:17.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:17.261+0000 7f4b96003640 1 -- 172.21.15.77:0/2543390480 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b900fb4c0 msgr2=0x7f4b9010e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:17.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:17.261+0000 7f4b96003640 1 --2- 172.21.15.77:0/2543390480 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b900fb4c0 0x7f4b9010e190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4b80002a50 tx=0x7f4b80004600 comp rx=0 tx=0).stop 2024-09-18T21:09:17.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:17.261+0000 7f4b96003640 1 -- 172.21.15.77:0/2543390480 shutdown_connections 2024-09-18T21:09:17.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:17.261+0000 7f4b96003640 1 --2- 172.21.15.77:0/2543390480 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f4b7806ed50 0x7f4b78071200 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:17.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:17.261+0000 7f4b96003640 1 --2- 172.21.15.77:0/2543390480 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b90101500 0x7f4b9010e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:17.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:17.261+0000 7f4b96003640 1 --2- 172.21.15.77:0/2543390480 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b900fb4c0 0x7f4b9010e190 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:17.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:17.261+0000 7f4b96003640 1 -- 172.21.15.77:0/2543390480 >> 172.21.15.77:0/2543390480 conn(0x7f4b900f7000 msgr2=0x7f4b900f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:09:17.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:17.261+0000 7f4b96003640 1 -- 172.21.15.77:0/2543390480 shutdown_connections 2024-09-18T21:09:17.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:17.261+0000 7f4b96003640 1 -- 172.21.15.77:0/2543390480 wait complete. 2024-09-18T21:09:17.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:17 smithi077 ceph-mon[27689]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:17.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:17 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/2543390480' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-18T21:09:17.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:17 smithi103 ceph-mon[34827]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:17.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:17 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/2543390480' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-18T21:09:17.926 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-18T21:09:17.926 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-18T21:09:18.170 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:09:19.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:19 smithi077 ceph-mon[27689]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:19.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:19 smithi103 ceph-mon[34827]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:19.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:19.905+0000 7f793f929640 1 -- 172.21.15.77:0/2815921954 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79381014e0 msgr2=0x7f79381018b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:19.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:19.905+0000 7f793f929640 1 --2- 172.21.15.77:0/2815921954 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79381014e0 0x7f79381018b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f79340048d0 tx=0x7f7934009da0 comp rx=0 tx=0).stop 2024-09-18T21:09:19.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:19.905+0000 7f793f929640 1 -- 172.21.15.77:0/2815921954 shutdown_connections 2024-09-18T21:09:19.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:19.905+0000 7f793f929640 1 --2- 172.21.15.77:0/2815921954 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79380fb4a0 0x7f79380fb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:19.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:19.905+0000 7f793f929640 1 --2- 172.21.15.77:0/2815921954 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79381014e0 0x7f79381018b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:19.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:19.905+0000 7f793f929640 1 -- 172.21.15.77:0/2815921954 >> 172.21.15.77:0/2815921954 conn(0x7f79380f7020 msgr2=0x7f79380f9430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:09:19.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:19.905+0000 7f793f929640 1 -- 172.21.15.77:0/2815921954 shutdown_connections 2024-09-18T21:09:19.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:19.905+0000 7f793f929640 1 -- 172.21.15.77:0/2815921954 wait complete. 2024-09-18T21:09:19.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:19.906+0000 7f793f929640 1 Processor -- start 2024-09-18T21:09:19.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:19.906+0000 7f793f929640 1 -- start start 2024-09-18T21:09:19.908 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:19.906+0000 7f793f929640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79380fb4a0 0x7f793810e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:19.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:19.906+0000 7f793f929640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79381014e0 0x7f793810e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:19.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:19.906+0000 7f793f929640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f793810ece0 con 0x7f79380fb4a0 2024-09-18T21:09:19.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:19.906+0000 7f793f929640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f793810ee50 con 0x7f79381014e0 2024-09-18T21:09:19.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:19.906+0000 7f793d6c5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79380fb4a0 0x7f793810e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:19.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:19.906+0000 7f793d6c5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79380fb4a0 0x7f793810e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48726/0 (socket says 172.21.15.77:48726) 2024-09-18T21:09:19.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:19.906+0000 7f793d6c5640 1 -- 172.21.15.77:0/2358763996 learned_addr learned my addr 172.21.15.77:0/2358763996 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:09:19.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:19.906+0000 7f793cec4640 1 --2- 172.21.15.77:0/2358763996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79381014e0 0x7f793810e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:19.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:19.907+0000 7f793d6c5640 1 -- 172.21.15.77:0/2358763996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79381014e0 msgr2=0x7f793810e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:19.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:19.907+0000 7f793d6c5640 1 --2- 172.21.15.77:0/2358763996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79381014e0 0x7f793810e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:19.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:19.907+0000 7f793d6c5640 1 -- 172.21.15.77:0/2358763996 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7934005040 con 0x7f79380fb4a0 2024-09-18T21:09:19.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:19.907+0000 7f793d6c5640 1 --2- 172.21.15.77:0/2358763996 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79380fb4a0 0x7f793810e150 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7934003080 tx=0x7f7934009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:19.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:19.907+0000 7f792dffb640 1 -- 172.21.15.77:0/2358763996 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7934038070 con 0x7f79380fb4a0 2024-09-18T21:09:19.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:19.907+0000 7f792dffb640 1 -- 172.21.15.77:0/2358763996 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f79340097e0 con 0x7f79380fb4a0 2024-09-18T21:09:19.910 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:19.907+0000 7f792dffb640 1 -- 172.21.15.77:0/2358763996 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f793403d420 con 0x7f79380fb4a0 2024-09-18T21:09:19.910 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:19.907+0000 7f793f929640 1 -- 172.21.15.77:0/2358763996 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79381171c0 con 0x7f79380fb4a0 2024-09-18T21:09:19.910 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:19.907+0000 7f793f929640 1 -- 172.21.15.77:0/2358763996 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7938117620 con 0x7f79380fb4a0 2024-09-18T21:09:19.911 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:19.908+0000 7f793f929640 1 -- 172.21.15.77:0/2358763996 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79380fcbe0 con 0x7f79380fb4a0 2024-09-18T21:09:19.911 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:19.909+0000 7f792dffb640 1 -- 172.21.15.77:0/2358763996 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f7934030020 con 0x7f79380fb4a0 2024-09-18T21:09:19.911 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:19.909+0000 7f792dffb640 1 --2- 172.21.15.77:0/2358763996 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f792406ed60 0x7f7924071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:19.911 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:19.909+0000 7f792dffb640 1 -- 172.21.15.77:0/2358763996 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f79340ae370 con 0x7f79380fb4a0 2024-09-18T21:09:19.911 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:19.909+0000 7f793cec4640 1 --2- 172.21.15.77:0/2358763996 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f792406ed60 0x7f7924071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:19.911 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:19.910+0000 7f793cec4640 1 --2- 172.21.15.77:0/2358763996 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f792406ed60 0x7f7924071210 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7938066470 tx=0x7f7928009040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:19.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:19.913+0000 7f792dffb640 1 -- 172.21.15.77:0/2358763996 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f793407b7d0 con 0x7f79380fb4a0 2024-09-18T21:09:20.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:20.069+0000 7f793f929640 1 -- 172.21.15.77:0/2358763996 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7938066220 con 0x7f79380fb4a0 2024-09-18T21:09:20.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:20.070+0000 7f792dffb640 1 -- 172.21.15.77:0/2358763996 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+11067 (secure 0 0 0) 0x7f793407b170 con 0x7f79380fb4a0 2024-09-18T21:09:20.071 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:09:20.071 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":38,"fsid":"5a76ec16-7601-11ef-bceb-c7b262605968","created":"2024-09-18T21:03:45.904815+0000","modified":"2024-09-18T21:09:01.148412+0000","last_up_change":"2024-09-18T21:09:00.146831+0000","last_in_change":"2024-09-18T21:08:41.769170+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-18T21:07:50.288606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"309fcfaf-2c45-482b-a95a-92bedbd7a042","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1327461769},{"type":"v1","addr":"172.21.15.77:6803","nonce":1327461769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1327461769},{"type":"v1","addr":"172.21.15.77:6805","nonce":1327461769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1327461769},{"type":"v1","addr":"172.21.15.77:6809","nonce":1327461769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1327461769},{"type":"v1","addr":"172.21.15.77:6807","nonce":1327461769}]},"public_addr":"172.21.15.77:6803/1327461769","cluster_addr":"172.21.15.77:6805/1327461769","heartbeat_back_addr":"172.21.15.77:6809/1327461769","heartbeat_front_addr":"172.21.15.77:6807/1327461769","state":["exists","up"]},{"osd":1,"uuid":"782aa0e2-9332-4440-b0ef-e5260e767374","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":164854543},{"type":"v1","addr":"172.21.15.77:6811","nonce":164854543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":164854543},{"type":"v1","addr":"172.21.15.77:6813","nonce":164854543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":164854543},{"type":"v1","addr":"172.21.15.77:6817","nonce":164854543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":164854543},{"type":"v1","addr":"172.21.15.77:6815","nonce":164854543}]},"public_addr":"172.21.15.77:6811/164854543","cluster_addr":"172.21.15.77:6813/164854543","heartbeat_back_addr":"172.21.15.77:6817/164854543","heartbeat_front_addr":"172.21.15.77:6815/164854543","state":["exists","up"]},{"osd":2,"uuid":"0d3bbcd5-1c51-42ec-a670-e5081188f7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":462691237},{"type":"v1","addr":"172.21.15.77:6819","nonce":462691237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":462691237},{"type":"v1","addr":"172.21.15.77:6821","nonce":462691237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":462691237},{"type":"v1","addr":"172.21.15.77:6825","nonce":462691237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":462691237},{"type":"v1","addr":"172.21.15.77:6823","nonce":462691237}]},"public_addr":"172.21.15.77:6819/462691237","cluster_addr":"172.21.15.77:6821/462691237","heartbeat_back_addr":"172.21.15.77:6825/462691237","heartbeat_front_addr":"172.21.15.77:6823/462691237","state":["exists","up"]},{"osd":3,"uuid":"200136ca-fc2a-4917-af11-1c3c730126c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":2640098104},{"type":"v1","addr":"172.21.15.103:6801","nonce":2640098104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":2640098104},{"type":"v1","addr":"172.21.15.103:6803","nonce":2640098104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":2640098104},{"type":"v1","addr":"172.21.15.103:6807","nonce":2640098104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":2640098104},{"type":"v1","addr":"172.21.15.103:6805","nonce":2640098104}]},"public_addr":"172.21.15.103:6801/2640098104","cluster_addr":"172.21.15.103:6803/2640098104","heartbeat_back_addr":"172.21.15.103:6807/2640098104","heartbeat_front_addr":"172.21.15.103:6805/2640098104","state":["exists","up"]},{"osd":4,"uuid":"146e24e4-931a-4a54-b32c-c96d4f2babe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":3297772484},{"type":"v1","addr":"172.21.15.103:6809","nonce":3297772484}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":3297772484},{"type":"v1","addr":"172.21.15.103:6811","nonce":3297772484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":3297772484},{"type":"v1","addr":"172.21.15.103:6815","nonce":3297772484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":3297772484},{"type":"v1","addr":"172.21.15.103:6813","nonce":3297772484}]},"public_addr":"172.21.15.103:6809/3297772484","cluster_addr":"172.21.15.103:6811/3297772484","heartbeat_back_addr":"172.21.15.103:6815/3297772484","heartbeat_front_addr":"172.21.15.103:6813/3297772484","state":["exists","up"]},{"osd":5,"uuid":"aab4da9a-351b-47ba-b3cc-b6d1fef36186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2618312891},{"type":"v1","addr":"172.21.15.103:6817","nonce":2618312891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":2618312891},{"type":"v1","addr":"172.21.15.103:6819","nonce":2618312891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2618312891},{"type":"v1","addr":"172.21.15.103:6823","nonce":2618312891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2618312891},{"type":"v1","addr":"172.21.15.103:6821","nonce":2618312891}]},"public_addr":"172.21.15.103:6817/2618312891","cluster_addr":"172.21.15.103:6819/2618312891","heartbeat_back_addr":"172.21.15.103:6823/2618312891","heartbeat_front_addr":"172.21.15.103:6821/2618312891","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T21:06:52.988132+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T21:07:20.637797+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T21:07:47.403897+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T21:08:09.448266+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T21:08:33.691899+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-18T21:08:58.481603+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:0/1737764691":"2024-09-19T21:05:43.984681+0000","172.21.15.77:6800/3162219942":"2024-09-19T21:04:16.080867+0000","172.21.15.77:6801/3162219942":"2024-09-19T21:04:16.080867+0000","172.21.15.77:0/366153409":"2024-09-19T21:04:16.080867+0000","172.21.15.77:6801/517401638":"2024-09-19T21:05:43.984681+0000","172.21.15.77:0/2651561696":"2024-09-19T21:04:16.080867+0000","172.21.15.77:0/3346293395":"2024-09-19T21:04:44.916890+0000","172.21.15.77:0/3396145514":"2024-09-19T21:05:43.984681+0000","172.21.15.77:0/1416108819":"2024-09-19T21:04:16.080867+0000","172.21.15.77:0/268486755":"2024-09-19T21:04:44.916890+0000","172.21.15.77:0/42563880":"2024-09-19T21:04:44.916890+0000","172.21.15.77:6801/2654225509":"2024-09-19T21:04:44.916890+0000","172.21.15.77:6800/2654225509":"2024-09-19T21:04:44.916890+0000","172.21.15.77:0/2389819393":"2024-09-19T21:05:43.984681+0000","172.21.15.77:6800/517401638":"2024-09-19T21:05:43.984681+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-18T21:09:20.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:20.072+0000 7f793f929640 1 -- 172.21.15.77:0/2358763996 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f792406ed60 msgr2=0x7f7924071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:20.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:20.072+0000 7f793f929640 1 --2- 172.21.15.77:0/2358763996 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f792406ed60 0x7f7924071210 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7938066470 tx=0x7f7928009040 comp rx=0 tx=0).stop 2024-09-18T21:09:20.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:20.072+0000 7f793f929640 1 -- 172.21.15.77:0/2358763996 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79380fb4a0 msgr2=0x7f793810e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:20.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:20.072+0000 7f793f929640 1 --2- 172.21.15.77:0/2358763996 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79380fb4a0 0x7f793810e150 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7934003080 tx=0x7f7934009da0 comp rx=0 tx=0).stop 2024-09-18T21:09:20.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:20.072+0000 7f793f929640 1 -- 172.21.15.77:0/2358763996 shutdown_connections 2024-09-18T21:09:20.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:20.072+0000 7f793f929640 1 --2- 172.21.15.77:0/2358763996 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f792406ed60 0x7f7924071210 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:20.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:20.072+0000 7f793f929640 1 --2- 172.21.15.77:0/2358763996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79381014e0 0x7f793810e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:20.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:20.072+0000 7f793f929640 1 --2- 172.21.15.77:0/2358763996 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79380fb4a0 0x7f793810e150 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:20.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:20.072+0000 7f793f929640 1 -- 172.21.15.77:0/2358763996 >> 172.21.15.77:0/2358763996 conn(0x7f79380f7020 msgr2=0x7f79380f88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:09:20.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:20.072+0000 7f793f929640 1 -- 172.21.15.77:0/2358763996 shutdown_connections 2024-09-18T21:09:20.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:20.072+0000 7f793f929640 1 -- 172.21.15.77:0/2358763996 wait complete. 2024-09-18T21:09:20.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:20 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/2358763996' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-18T21:09:20.752 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-18T21:09:20.753 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-18T21:09:20.753 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-18T21:09:20.754 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-18T21:09:20.754 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-18T21:09:20.755 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-18T21:09:20.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:20 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/2358763996' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-18T21:09:21.051 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:09:21.053 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:09:21.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:21 smithi077 ceph-mon[27689]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:21.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:21 smithi103 ceph-mon[34827]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:23.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.644+0000 7f64b2f94640 1 -- 172.21.15.77:0/2558061719 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64ac0fac80 msgr2=0x7f64ac0fb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:23.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.644+0000 7f64b2f94640 1 --2- 172.21.15.77:0/2558061719 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64ac0fac80 0x7f64ac0fb0f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f64980048d0 tx=0x7f6498009da0 comp rx=0 tx=0).stop 2024-09-18T21:09:23.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.644+0000 7f64b2f94640 1 -- 172.21.15.77:0/2558061719 shutdown_connections 2024-09-18T21:09:23.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.644+0000 7f64b2f94640 1 --2- 172.21.15.77:0/2558061719 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64ac0fac80 0x7f64ac0fb0f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:23.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.644+0000 7f64b2f94640 1 --2- 172.21.15.77:0/2558061719 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64ac102620 0x7f64ac1029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:23.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.644+0000 7f64b2f94640 1 -- 172.21.15.77:0/2558061719 >> 172.21.15.77:0/2558061719 conn(0x7f64ac070ce0 msgr2=0x7f64ac0710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:09:23.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.644+0000 7f64b2f94640 1 -- 172.21.15.77:0/2558061719 shutdown_connections 2024-09-18T21:09:23.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.644+0000 7f64b2f94640 1 -- 172.21.15.77:0/2558061719 wait complete. 2024-09-18T21:09:23.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.645+0000 7f64b2f94640 1 Processor -- start 2024-09-18T21:09:23.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.645+0000 7f64b2f94640 1 -- start start 2024-09-18T21:09:23.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.645+0000 7f64b2f94640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64ac0fac80 0x7f64ac1131e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:23.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.645+0000 7f64b2f94640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64ac102620 0x7f64ac113720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:23.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.645+0000 7f64b2f94640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac113d20 con 0x7f64ac0fac80 2024-09-18T21:09:23.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.645+0000 7f64b2f94640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac10d160 con 0x7f64ac102620 2024-09-18T21:09:23.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.645+0000 7f64b0d30640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64ac0fac80 0x7f64ac1131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:23.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.645+0000 7f64b0d30640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64ac0fac80 0x7f64ac1131e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48746/0 (socket says 172.21.15.77:48746) 2024-09-18T21:09:23.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.645+0000 7f64b0d30640 1 -- 172.21.15.77:0/242578865 learned_addr learned my addr 172.21.15.77:0/242578865 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:09:23.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.645+0000 7f64abfff640 1 --2- 172.21.15.77:0/242578865 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64ac102620 0x7f64ac113720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:23.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.646+0000 7f64b0d30640 1 -- 172.21.15.77:0/242578865 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64ac102620 msgr2=0x7f64ac113720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:23.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.646+0000 7f64b0d30640 1 --2- 172.21.15.77:0/242578865 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64ac102620 0x7f64ac113720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:23.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.646+0000 7f64b0d30640 1 -- 172.21.15.77:0/242578865 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6498005040 con 0x7f64ac0fac80 2024-09-18T21:09:23.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.646+0000 7f64b0d30640 1 --2- 172.21.15.77:0/242578865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64ac0fac80 0x7f64ac1131e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f64a0002a50 tx=0x7f64a0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:23.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.646+0000 7f64a97fa640 1 -- 172.21.15.77:0/242578865 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64a0007c30 con 0x7f64ac0fac80 2024-09-18T21:09:23.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.646+0000 7f64a97fa640 1 -- 172.21.15.77:0/242578865 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f64a000f040 con 0x7f64ac0fac80 2024-09-18T21:09:23.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.646+0000 7f64b2f94640 1 -- 172.21.15.77:0/242578865 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64ac10d440 con 0x7f64ac0fac80 2024-09-18T21:09:23.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.646+0000 7f64a97fa640 1 -- 172.21.15.77:0/242578865 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64a000da10 con 0x7f64ac0fac80 2024-09-18T21:09:23.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.646+0000 7f64b2f94640 1 -- 172.21.15.77:0/242578865 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64ac10d9b0 con 0x7f64ac0fac80 2024-09-18T21:09:23.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.647+0000 7f64b2f94640 1 -- 172.21.15.77:0/242578865 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f64ac10df20 con 0x7f64ac0fac80 2024-09-18T21:09:23.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.647+0000 7f64a97fa640 1 -- 172.21.15.77:0/242578865 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f64a000dc80 con 0x7f64ac0fac80 2024-09-18T21:09:23.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.648+0000 7f64a97fa640 1 --2- 172.21.15.77:0/242578865 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f649c06ed60 0x7f649c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:23.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.648+0000 7f64a97fa640 1 -- 172.21.15.77:0/242578865 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f64a008d600 con 0x7f64ac0fac80 2024-09-18T21:09:23.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.648+0000 7f64abfff640 1 --2- 172.21.15.77:0/242578865 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f649c06ed60 0x7f649c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:23.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.648+0000 7f64a97fa640 1 --2- 172.21.15.77:0/242578865 >> [v2:172.21.15.77:6802/1327461769,v1:172.21.15.77:6803/1327461769] conn(0x7f649c074ae0 0x7f649c076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:23.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.648+0000 7f64a97fa640 1 -- 172.21.15.77:0/242578865 --> [v2:172.21.15.77:6802/1327461769,v1:172.21.15.77:6803/1327461769] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f649c0775a0 con 0x7f649c074ae0 2024-09-18T21:09:23.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.648+0000 7f64a97fa640 1 -- 172.21.15.77:0/242578865 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f64a008fc50 con 0x7f64ac0fac80 2024-09-18T21:09:23.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.648+0000 7f64b1531640 1 --2- 172.21.15.77:0/242578865 >> [v2:172.21.15.77:6802/1327461769,v1:172.21.15.77:6803/1327461769] conn(0x7f649c074ae0 0x7f649c076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:23.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.648+0000 7f64abfff640 1 --2- 172.21.15.77:0/242578865 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f649c06ed60 0x7f649c071210 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6498009ac0 tx=0x7f6498035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:23.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.649+0000 7f64b1531640 1 --2- 172.21.15.77:0/242578865 >> [v2:172.21.15.77:6802/1327461769,v1:172.21.15.77:6803/1327461769] conn(0x7f649c074ae0 0x7f649c076ef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:23.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.649+0000 7f64a97fa640 1 -- 172.21.15.77:0/242578865 <== osd.0 v2:172.21.15.77:6802/1327461769 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f649c0775a0 con 0x7f649c074ae0 2024-09-18T21:09:23.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.661+0000 7f64b2f94640 1 -- 172.21.15.77:0/242578865 --> [v2:172.21.15.77:6802/1327461769,v1:172.21.15.77:6803/1327461769] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f64ac0657b0 con 0x7f649c074ae0 2024-09-18T21:09:23.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.662+0000 7f64a97fa640 1 -- 172.21.15.77:0/242578865 <== osd.0 v2:172.21.15.77:6802/1327461769 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f64ac0657b0 con 0x7f649c074ae0 2024-09-18T21:09:23.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.662+0000 7f64b2f94640 1 -- 172.21.15.77:0/242578865 >> [v2:172.21.15.77:6802/1327461769,v1:172.21.15.77:6803/1327461769] conn(0x7f649c074ae0 msgr2=0x7f649c076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:23.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.662+0000 7f64b2f94640 1 --2- 172.21.15.77:0/242578865 >> [v2:172.21.15.77:6802/1327461769,v1:172.21.15.77:6803/1327461769] conn(0x7f649c074ae0 0x7f649c076ef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:23.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.662+0000 7f64b2f94640 1 -- 172.21.15.77:0/242578865 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f649c06ed60 msgr2=0x7f649c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:23.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.662+0000 7f64b2f94640 1 --2- 172.21.15.77:0/242578865 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f649c06ed60 0x7f649c071210 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6498009ac0 tx=0x7f6498035040 comp rx=0 tx=0).stop 2024-09-18T21:09:23.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.662+0000 7f64b2f94640 1 -- 172.21.15.77:0/242578865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64ac0fac80 msgr2=0x7f64ac1131e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:23.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.662+0000 7f64b2f94640 1 --2- 172.21.15.77:0/242578865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64ac0fac80 0x7f64ac1131e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f64a0002a50 tx=0x7f64a0004600 comp rx=0 tx=0).stop 2024-09-18T21:09:23.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.662+0000 7f64b2f94640 1 -- 172.21.15.77:0/242578865 shutdown_connections 2024-09-18T21:09:23.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.662+0000 7f64b2f94640 1 --2- 172.21.15.77:0/242578865 >> [v2:172.21.15.77:6802/1327461769,v1:172.21.15.77:6803/1327461769] conn(0x7f649c074ae0 0x7f649c076ef0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:23.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.662+0000 7f64b2f94640 1 --2- 172.21.15.77:0/242578865 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f649c06ed60 0x7f649c071210 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:23.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.662+0000 7f64b2f94640 1 --2- 172.21.15.77:0/242578865 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64ac102620 0x7f64ac113720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:23.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.662+0000 7f64b2f94640 1 --2- 172.21.15.77:0/242578865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64ac0fac80 0x7f64ac1131e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:23.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.662+0000 7f64b2f94640 1 -- 172.21.15.77:0/242578865 >> 172.21.15.77:0/242578865 conn(0x7f64ac070ce0 msgr2=0x7f64ac105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:09:23.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.662+0000 7f64b2f94640 1 -- 172.21.15.77:0/242578865 shutdown_connections 2024-09-18T21:09:23.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:23.662+0000 7f64b2f94640 1 -- 172.21.15.77:0/242578865 wait complete. 2024-09-18T21:09:23.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:23 smithi077 ceph-mon[27689]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:23.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:23 smithi103 ceph-mon[34827]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:23.892 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:09:23.892 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:09:25.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.653+0000 7fd88c438640 1 -- 172.21.15.77:0/4220900810 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8840fcf80 msgr2=0x7fd8840fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:25.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.653+0000 7fd88c438640 1 --2- 172.21.15.77:0/4220900810 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8840fcf80 0x7fd8840fd3d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd8740048d0 tx=0x7fd874009da0 comp rx=0 tx=0).stop 2024-09-18T21:09:25.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.653+0000 7fd88c438640 1 -- 172.21.15.77:0/4220900810 shutdown_connections 2024-09-18T21:09:25.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.653+0000 7fd88c438640 1 --2- 172.21.15.77:0/4220900810 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8840fcf80 0x7fd8840fd3d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:25.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.653+0000 7fd88c438640 1 --2- 172.21.15.77:0/4220900810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8840fb810 0x7fd8840fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:25.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.653+0000 7fd88c438640 1 -- 172.21.15.77:0/4220900810 >> 172.21.15.77:0/4220900810 conn(0x7fd8840723b0 msgr2=0x7fd8840727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:09:25.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.653+0000 7fd88c438640 1 -- 172.21.15.77:0/4220900810 shutdown_connections 2024-09-18T21:09:25.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.653+0000 7fd88c438640 1 -- 172.21.15.77:0/4220900810 wait complete. 2024-09-18T21:09:25.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.653+0000 7fd88c438640 1 Processor -- start 2024-09-18T21:09:25.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.654+0000 7fd88c438640 1 -- start start 2024-09-18T21:09:25.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.654+0000 7fd88c438640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8840fb810 0x7fd8841120d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:25.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.654+0000 7fd88c438640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8840fcf80 0x7fd884112610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:25.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.654+0000 7fd88c438640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd884112c10 con 0x7fd8840fcf80 2024-09-18T21:09:25.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.654+0000 7fd88c438640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd88410c050 con 0x7fd8840fb810 2024-09-18T21:09:25.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.654+0000 7fd8899d3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8840fcf80 0x7fd884112610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:25.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.654+0000 7fd8899d3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8840fcf80 0x7fd884112610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48778/0 (socket says 172.21.15.77:48778) 2024-09-18T21:09:25.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.654+0000 7fd8899d3640 1 -- 172.21.15.77:0/438278807 learned_addr learned my addr 172.21.15.77:0/438278807 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:09:25.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.654+0000 7fd88a1d4640 1 --2- 172.21.15.77:0/438278807 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8840fb810 0x7fd8841120d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:25.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.654+0000 7fd8899d3640 1 -- 172.21.15.77:0/438278807 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8840fb810 msgr2=0x7fd8841120d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:25.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.654+0000 7fd8899d3640 1 --2- 172.21.15.77:0/438278807 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8840fb810 0x7fd8841120d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:25.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.654+0000 7fd8899d3640 1 -- 172.21.15.77:0/438278807 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd874005040 con 0x7fd8840fcf80 2024-09-18T21:09:25.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.654+0000 7fd8899d3640 1 --2- 172.21.15.77:0/438278807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8840fcf80 0x7fd884112610 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd874000c00 tx=0x7fd874009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:25.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.655+0000 7fd87affd640 1 -- 172.21.15.77:0/438278807 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd874038070 con 0x7fd8840fcf80 2024-09-18T21:09:25.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.655+0000 7fd87affd640 1 -- 172.21.15.77:0/438278807 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd87402ade0 con 0x7fd8840fcf80 2024-09-18T21:09:25.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.655+0000 7fd88c438640 1 -- 172.21.15.77:0/438278807 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd88410c2d0 con 0x7fd8840fcf80 2024-09-18T21:09:25.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.655+0000 7fd87affd640 1 -- 172.21.15.77:0/438278807 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd87402c7e0 con 0x7fd8840fcf80 2024-09-18T21:09:25.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.655+0000 7fd88c438640 1 -- 172.21.15.77:0/438278807 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd88410c810 con 0x7fd8840fcf80 2024-09-18T21:09:25.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.656+0000 7fd88c438640 1 -- 172.21.15.77:0/438278807 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd88410cd40 con 0x7fd8840fcf80 2024-09-18T21:09:25.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.656+0000 7fd87affd640 1 -- 172.21.15.77:0/438278807 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fd874030020 con 0x7fd8840fcf80 2024-09-18T21:09:25.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.657+0000 7fd87affd640 1 --2- 172.21.15.77:0/438278807 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fd87006ed60 0x7fd870071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:25.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.657+0000 7fd87affd640 1 -- 172.21.15.77:0/438278807 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd8740ada00 con 0x7fd8840fcf80 2024-09-18T21:09:25.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.657+0000 7fd88a1d4640 1 --2- 172.21.15.77:0/438278807 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fd87006ed60 0x7fd870071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:25.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.657+0000 7fd87affd640 1 --2- 172.21.15.77:0/438278807 >> [v2:172.21.15.103:6800/2640098104,v1:172.21.15.103:6801/2640098104] conn(0x7fd870074ae0 0x7fd870076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:25.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.657+0000 7fd87affd640 1 -- 172.21.15.77:0/438278807 --> [v2:172.21.15.103:6800/2640098104,v1:172.21.15.103:6801/2640098104] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd8700775a0 con 0x7fd870074ae0 2024-09-18T21:09:25.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.657+0000 7fd87affd640 1 -- 172.21.15.77:0/438278807 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd8740b2220 con 0x7fd8840fcf80 2024-09-18T21:09:25.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.657+0000 7fd88a9d5640 1 --2- 172.21.15.77:0/438278807 >> [v2:172.21.15.103:6800/2640098104,v1:172.21.15.103:6801/2640098104] conn(0x7fd870074ae0 0x7fd870076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:25.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.657+0000 7fd88a1d4640 1 --2- 172.21.15.77:0/438278807 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fd87006ed60 0x7fd870071210 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd880004ed0 tx=0x7fd88000b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:25.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.658+0000 7fd88a9d5640 1 --2- 172.21.15.77:0/438278807 >> [v2:172.21.15.103:6800/2640098104,v1:172.21.15.103:6801/2640098104] conn(0x7fd870074ae0 0x7fd870076ef0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:25.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.659+0000 7fd87affd640 1 -- 172.21.15.77:0/438278807 <== osd.3 v2:172.21.15.103:6800/2640098104 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fd8700775a0 con 0x7fd870074ae0 2024-09-18T21:09:25.663 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:09:25.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.672+0000 7fd88c438640 1 -- 172.21.15.77:0/438278807 --> [v2:172.21.15.103:6800/2640098104,v1:172.21.15.103:6801/2640098104] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd8840fae90 con 0x7fd870074ae0 2024-09-18T21:09:25.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.672+0000 7fd87affd640 1 -- 172.21.15.77:0/438278807 <== osd.3 v2:172.21.15.103:6800/2640098104 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fd8840fae90 con 0x7fd870074ae0 2024-09-18T21:09:25.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.673+0000 7fd88c438640 1 -- 172.21.15.77:0/438278807 >> [v2:172.21.15.103:6800/2640098104,v1:172.21.15.103:6801/2640098104] conn(0x7fd870074ae0 msgr2=0x7fd870076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:25.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.673+0000 7fd88c438640 1 --2- 172.21.15.77:0/438278807 >> [v2:172.21.15.103:6800/2640098104,v1:172.21.15.103:6801/2640098104] conn(0x7fd870074ae0 0x7fd870076ef0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:25.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.673+0000 7fd88c438640 1 -- 172.21.15.77:0/438278807 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fd87006ed60 msgr2=0x7fd870071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:25.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.673+0000 7fd88c438640 1 --2- 172.21.15.77:0/438278807 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fd87006ed60 0x7fd870071210 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd880004ed0 tx=0x7fd88000b040 comp rx=0 tx=0).stop 2024-09-18T21:09:25.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.673+0000 7fd88c438640 1 -- 172.21.15.77:0/438278807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8840fcf80 msgr2=0x7fd884112610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:25.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.673+0000 7fd88c438640 1 --2- 172.21.15.77:0/438278807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8840fcf80 0x7fd884112610 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd874000c00 tx=0x7fd874009da0 comp rx=0 tx=0).stop 2024-09-18T21:09:25.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.673+0000 7fd88c438640 1 -- 172.21.15.77:0/438278807 shutdown_connections 2024-09-18T21:09:25.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.673+0000 7fd88c438640 1 --2- 172.21.15.77:0/438278807 >> [v2:172.21.15.103:6800/2640098104,v1:172.21.15.103:6801/2640098104] conn(0x7fd870074ae0 0x7fd870076ef0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:25.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.673+0000 7fd88c438640 1 --2- 172.21.15.77:0/438278807 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fd87006ed60 0x7fd870071210 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:25.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.673+0000 7fd88c438640 1 --2- 172.21.15.77:0/438278807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd8840fcf80 0x7fd884112610 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:25.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.673+0000 7fd88c438640 1 --2- 172.21.15.77:0/438278807 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8840fb810 0x7fd8841120d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:25.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.673+0000 7fd88c438640 1 -- 172.21.15.77:0/438278807 >> 172.21.15.77:0/438278807 conn(0x7fd8840723b0 msgr2=0x7fd8840fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:09:25.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.673+0000 7fd88c438640 1 -- 172.21.15.77:0/438278807 shutdown_connections 2024-09-18T21:09:25.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:25.673+0000 7fd88c438640 1 -- 172.21.15.77:0/438278807 wait complete. 2024-09-18T21:09:25.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:25 smithi077 ceph-mon[27689]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:25.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:25 smithi103 ceph-mon[34827]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:26.846 INFO:teuthology.orchestra.run.smithi077.stdout:111669149713 2024-09-18T21:09:26.847 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-18T21:09:27.213 INFO:teuthology.orchestra.run.smithi077.stdout:38654705697 2024-09-18T21:09:27.214 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-18T21:09:27.659 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:09:27.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:27 smithi103 ceph-mon[34827]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:27.769 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:27 smithi077 ceph-mon[27689]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:28.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.429+0000 7fb00bb8c640 1 -- 172.21.15.77:0/826985584 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0040fcf80 msgr2=0x7fb0040fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:28.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.429+0000 7fb00bb8c640 1 --2- 172.21.15.77:0/826985584 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0040fcf80 0x7fb0040fd3d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7faff40048d0 tx=0x7faff4009da0 comp rx=0 tx=0).stop 2024-09-18T21:09:28.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.429+0000 7fb00bb8c640 1 -- 172.21.15.77:0/826985584 shutdown_connections 2024-09-18T21:09:28.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.429+0000 7fb00bb8c640 1 --2- 172.21.15.77:0/826985584 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0040fcf80 0x7fb0040fd3d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:28.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.429+0000 7fb00bb8c640 1 --2- 172.21.15.77:0/826985584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0040fb810 0x7fb0040fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:28.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.429+0000 7fb00bb8c640 1 -- 172.21.15.77:0/826985584 >> 172.21.15.77:0/826985584 conn(0x7fb0040723b0 msgr2=0x7fb0040727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:09:28.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.429+0000 7fb00bb8c640 1 -- 172.21.15.77:0/826985584 shutdown_connections 2024-09-18T21:09:28.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.429+0000 7fb00bb8c640 1 -- 172.21.15.77:0/826985584 wait complete. 2024-09-18T21:09:28.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.429+0000 7fb00bb8c640 1 Processor -- start 2024-09-18T21:09:28.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.429+0000 7fb00bb8c640 1 -- start start 2024-09-18T21:09:28.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.429+0000 7fb00bb8c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0040fb810 0x7fb0041131a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:28.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.429+0000 7fb00bb8c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0040fcf80 0x7fb0041136e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:28.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.429+0000 7fb00bb8c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb004113ce0 con 0x7fb0040fb810 2024-09-18T21:09:28.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.429+0000 7fb00bb8c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb00410d120 con 0x7fb0040fcf80 2024-09-18T21:09:28.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.429+0000 7fb009928640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0040fb810 0x7fb0041131a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:28.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.430+0000 7fb009928640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0040fb810 0x7fb0041131a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48802/0 (socket says 172.21.15.77:48802) 2024-09-18T21:09:28.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.430+0000 7fb009928640 1 -- 172.21.15.77:0/2347016009 learned_addr learned my addr 172.21.15.77:0/2347016009 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:09:28.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.430+0000 7fb009127640 1 --2- 172.21.15.77:0/2347016009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0040fcf80 0x7fb0041136e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:28.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.430+0000 7fb009928640 1 -- 172.21.15.77:0/2347016009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0040fcf80 msgr2=0x7fb0041136e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:28.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.430+0000 7fb009928640 1 --2- 172.21.15.77:0/2347016009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0040fcf80 0x7fb0041136e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:28.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.430+0000 7fb009928640 1 -- 172.21.15.77:0/2347016009 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff4005040 con 0x7fb0040fb810 2024-09-18T21:09:28.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.430+0000 7fb009928640 1 --2- 172.21.15.77:0/2347016009 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0040fb810 0x7fb0041131a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb00000cb10 tx=0x7fb000007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:28.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.430+0000 7faffa7fc640 1 -- 172.21.15.77:0/2347016009 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb000004200 con 0x7fb0040fb810 2024-09-18T21:09:28.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.430+0000 7faffa7fc640 1 -- 172.21.15.77:0/2347016009 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb00000ac40 con 0x7fb0040fb810 2024-09-18T21:09:28.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.430+0000 7fb00bb8c640 1 -- 172.21.15.77:0/2347016009 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb00410d400 con 0x7fb0040fb810 2024-09-18T21:09:28.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.430+0000 7faffa7fc640 1 -- 172.21.15.77:0/2347016009 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb000003c50 con 0x7fb0040fb810 2024-09-18T21:09:28.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.430+0000 7fb00bb8c640 1 -- 172.21.15.77:0/2347016009 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb00410d970 con 0x7fb0040fb810 2024-09-18T21:09:28.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.431+0000 7fb00bb8c640 1 -- 172.21.15.77:0/2347016009 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb00410de80 con 0x7fb0040fb810 2024-09-18T21:09:28.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.432+0000 7faffa7fc640 1 -- 172.21.15.77:0/2347016009 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fb000003430 con 0x7fb0040fb810 2024-09-18T21:09:28.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.432+0000 7faffa7fc640 1 --2- 172.21.15.77:0/2347016009 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7faff006ed60 0x7faff0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:28.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.432+0000 7fb009127640 1 --2- 172.21.15.77:0/2347016009 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7faff006ed60 0x7faff0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:28.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.432+0000 7faffa7fc640 1 -- 172.21.15.77:0/2347016009 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb00008eb80 con 0x7fb0040fb810 2024-09-18T21:09:28.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.432+0000 7faffa7fc640 1 --2- 172.21.15.77:0/2347016009 >> [v2:172.21.15.77:6810/164854543,v1:172.21.15.77:6811/164854543] conn(0x7faff0074ae0 0x7faff0076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:28.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.432+0000 7faffa7fc640 1 -- 172.21.15.77:0/2347016009 --> [v2:172.21.15.77:6810/164854543,v1:172.21.15.77:6811/164854543] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faff00775a0 con 0x7faff0074ae0 2024-09-18T21:09:28.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.432+0000 7faffa7fc640 1 -- 172.21.15.77:0/2347016009 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb00008ef60 con 0x7fb0040fb810 2024-09-18T21:09:28.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.433+0000 7fb00a129640 1 --2- 172.21.15.77:0/2347016009 >> [v2:172.21.15.77:6810/164854543,v1:172.21.15.77:6811/164854543] conn(0x7faff0074ae0 0x7faff0076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:28.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.433+0000 7fb009127640 1 --2- 172.21.15.77:0/2347016009 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7faff006ed60 0x7faff0071210 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7faff4009ac0 tx=0x7faff4035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:28.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.433+0000 7fb00a129640 1 --2- 172.21.15.77:0/2347016009 >> [v2:172.21.15.77:6810/164854543,v1:172.21.15.77:6811/164854543] conn(0x7faff0074ae0 0x7faff0076ef0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:28.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.433+0000 7faffa7fc640 1 -- 172.21.15.77:0/2347016009 <== osd.1 v2:172.21.15.77:6810/164854543 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7faff00775a0 con 0x7faff0074ae0 2024-09-18T21:09:28.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.446+0000 7fb00bb8c640 1 -- 172.21.15.77:0/2347016009 --> [v2:172.21.15.77:6810/164854543,v1:172.21.15.77:6811/164854543] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb0040fcbc0 con 0x7faff0074ae0 2024-09-18T21:09:28.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.446+0000 7faffa7fc640 1 -- 172.21.15.77:0/2347016009 <== osd.1 v2:172.21.15.77:6810/164854543 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb0040fcbc0 con 0x7faff0074ae0 2024-09-18T21:09:28.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.446+0000 7fb00bb8c640 1 -- 172.21.15.77:0/2347016009 >> [v2:172.21.15.77:6810/164854543,v1:172.21.15.77:6811/164854543] conn(0x7faff0074ae0 msgr2=0x7faff0076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:28.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.446+0000 7fb00bb8c640 1 --2- 172.21.15.77:0/2347016009 >> [v2:172.21.15.77:6810/164854543,v1:172.21.15.77:6811/164854543] conn(0x7faff0074ae0 0x7faff0076ef0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:28.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.446+0000 7fb00bb8c640 1 -- 172.21.15.77:0/2347016009 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7faff006ed60 msgr2=0x7faff0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:28.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.446+0000 7fb00bb8c640 1 --2- 172.21.15.77:0/2347016009 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7faff006ed60 0x7faff0071210 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7faff4009ac0 tx=0x7faff4035040 comp rx=0 tx=0).stop 2024-09-18T21:09:28.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.446+0000 7fb00bb8c640 1 -- 172.21.15.77:0/2347016009 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0040fb810 msgr2=0x7fb0041131a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:28.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.446+0000 7fb00bb8c640 1 --2- 172.21.15.77:0/2347016009 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0040fb810 0x7fb0041131a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb00000cb10 tx=0x7fb000007ee0 comp rx=0 tx=0).stop 2024-09-18T21:09:28.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.446+0000 7fb00bb8c640 1 -- 172.21.15.77:0/2347016009 shutdown_connections 2024-09-18T21:09:28.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.446+0000 7fb00bb8c640 1 --2- 172.21.15.77:0/2347016009 >> [v2:172.21.15.77:6810/164854543,v1:172.21.15.77:6811/164854543] conn(0x7faff0074ae0 0x7faff0076ef0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:28.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.446+0000 7fb00bb8c640 1 --2- 172.21.15.77:0/2347016009 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7faff006ed60 0x7faff0071210 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:28.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.446+0000 7fb00bb8c640 1 --2- 172.21.15.77:0/2347016009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0040fcf80 0x7fb0041136e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:28.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.446+0000 7fb00bb8c640 1 --2- 172.21.15.77:0/2347016009 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0040fb810 0x7fb0041131a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:28.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.446+0000 7fb00bb8c640 1 -- 172.21.15.77:0/2347016009 >> 172.21.15.77:0/2347016009 conn(0x7fb0040723b0 msgr2=0x7fb0040fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:09:28.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.446+0000 7fb00bb8c640 1 -- 172.21.15.77:0/2347016009 shutdown_connections 2024-09-18T21:09:28.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.446+0000 7fb00bb8c640 1 -- 172.21.15.77:0/2347016009 wait complete. 2024-09-18T21:09:29.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.343+0000 7f19bead5640 1 -- 172.21.15.77:0/45530345 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19b81014c0 msgr2=0x7f19b8101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:29.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.343+0000 7f19bead5640 1 --2- 172.21.15.77:0/45530345 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19b81014c0 0x7f19b8101890 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f19ac0048d0 tx=0x7f19ac009da0 comp rx=0 tx=0).stop 2024-09-18T21:09:29.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.343+0000 7f19bead5640 1 -- 172.21.15.77:0/45530345 shutdown_connections 2024-09-18T21:09:29.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.343+0000 7f19bead5640 1 --2- 172.21.15.77:0/45530345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19b80fb480 0x7f19b80fb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:29.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.343+0000 7f19bead5640 1 --2- 172.21.15.77:0/45530345 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19b81014c0 0x7f19b8101890 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:29.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.343+0000 7f19bead5640 1 -- 172.21.15.77:0/45530345 >> 172.21.15.77:0/45530345 conn(0x7f19b80f7000 msgr2=0x7f19b80f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:09:29.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.343+0000 7f19bead5640 1 -- 172.21.15.77:0/45530345 shutdown_connections 2024-09-18T21:09:29.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.343+0000 7f19bead5640 1 -- 172.21.15.77:0/45530345 wait complete. 2024-09-18T21:09:29.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.343+0000 7f19bead5640 1 Processor -- start 2024-09-18T21:09:29.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.343+0000 7f19bead5640 1 -- start start 2024-09-18T21:09:29.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.344+0000 7f19bead5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19b80fb480 0x7f19b81131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:29.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.344+0000 7f19bead5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19b81014c0 0x7f19b81136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:29.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.344+0000 7f19bead5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b8113cf0 con 0x7f19b81014c0 2024-09-18T21:09:29.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.344+0000 7f19bead5640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b810d130 con 0x7f19b80fb480 2024-09-18T21:09:29.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.344+0000 7f19b7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19b81014c0 0x7f19b81136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:29.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.344+0000 7f19b7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19b81014c0 0x7f19b81136f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48788/0 (socket says 172.21.15.77:48788) 2024-09-18T21:09:29.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.344+0000 7f19b7fff640 1 -- 172.21.15.77:0/3108102052 learned_addr learned my addr 172.21.15.77:0/3108102052 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:09:29.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.344+0000 7f19b7fff640 1 -- 172.21.15.77:0/3108102052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19b80fb480 msgr2=0x7f19b81131b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:29.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.344+0000 7f19b7fff640 1 --2- 172.21.15.77:0/3108102052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19b80fb480 0x7f19b81131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:29.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.344+0000 7f19b7fff640 1 -- 172.21.15.77:0/3108102052 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19ac005040 con 0x7f19b81014c0 2024-09-18T21:09:29.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.344+0000 7f19b7fff640 1 --2- 172.21.15.77:0/3108102052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19b81014c0 0x7f19b81136f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f19a400c830 tx=0x7f19a4004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:29.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.344+0000 7f19b57fa640 1 -- 172.21.15.77:0/3108102052 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19a400a850 con 0x7f19b81014c0 2024-09-18T21:09:29.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.344+0000 7f19bead5640 1 -- 172.21.15.77:0/3108102052 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19b810d410 con 0x7f19b81014c0 2024-09-18T21:09:29.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.344+0000 7f19b57fa640 1 -- 172.21.15.77:0/3108102052 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f19a400ae50 con 0x7f19b81014c0 2024-09-18T21:09:29.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.344+0000 7f19b57fa640 1 -- 172.21.15.77:0/3108102052 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19a40113a0 con 0x7f19b81014c0 2024-09-18T21:09:29.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.344+0000 7f19bead5640 1 -- 172.21.15.77:0/3108102052 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b810d9b0 con 0x7f19b81014c0 2024-09-18T21:09:29.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.345+0000 7f19bead5640 1 -- 172.21.15.77:0/3108102052 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f19b810def0 con 0x7f19b81014c0 2024-09-18T21:09:29.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.346+0000 7f19b57fa640 1 -- 172.21.15.77:0/3108102052 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f19a4011560 con 0x7f19b81014c0 2024-09-18T21:09:29.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.346+0000 7f19b57fa640 1 --2- 172.21.15.77:0/3108102052 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f19a806ed50 0x7f19a8071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:29.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.346+0000 7f19b57fa640 1 -- 172.21.15.77:0/3108102052 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f19a408e070 con 0x7f19b81014c0 2024-09-18T21:09:29.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.346+0000 7f19bc871640 1 --2- 172.21.15.77:0/3108102052 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f19a806ed50 0x7f19a8071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:29.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.346+0000 7f19b57fa640 1 --2- 172.21.15.77:0/3108102052 >> [v2:172.21.15.103:6816/2618312891,v1:172.21.15.103:6817/2618312891] conn(0x7f19a8074ad0 0x7f19a8076ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:29.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.346+0000 7f19b57fa640 1 -- 172.21.15.77:0/3108102052 --> [v2:172.21.15.103:6816/2618312891,v1:172.21.15.103:6817/2618312891] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f19a8077590 con 0x7f19a8074ad0 2024-09-18T21:09:29.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.346+0000 7f19b57fa640 1 -- 172.21.15.77:0/3108102052 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f19a40906c0 con 0x7f19b81014c0 2024-09-18T21:09:29.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.347+0000 7f19bc871640 1 --2- 172.21.15.77:0/3108102052 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f19a806ed50 0x7f19a8071200 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f19ac02a530 tx=0x7f19ac009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:29.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.347+0000 7f19bd072640 1 --2- 172.21.15.77:0/3108102052 >> [v2:172.21.15.103:6816/2618312891,v1:172.21.15.103:6817/2618312891] conn(0x7f19a8074ad0 0x7f19a8076ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:29.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.347+0000 7f19bd072640 1 --2- 172.21.15.77:0/3108102052 >> [v2:172.21.15.103:6816/2618312891,v1:172.21.15.103:6817/2618312891] conn(0x7f19a8074ad0 0x7f19a8076ee0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:29.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.348+0000 7f19b57fa640 1 -- 172.21.15.77:0/3108102052 <== osd.5 v2:172.21.15.103:6816/2618312891 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f19a8077590 con 0x7f19a8074ad0 2024-09-18T21:09:29.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.360+0000 7f19bead5640 1 -- 172.21.15.77:0/3108102052 --> [v2:172.21.15.103:6816/2618312891,v1:172.21.15.103:6817/2618312891] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f19b80f7d20 con 0x7f19a8074ad0 2024-09-18T21:09:29.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.361+0000 7f19b57fa640 1 -- 172.21.15.77:0/3108102052 <== osd.5 v2:172.21.15.103:6816/2618312891 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f19b80f7d20 con 0x7f19a8074ad0 2024-09-18T21:09:29.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.361+0000 7f19bead5640 1 -- 172.21.15.77:0/3108102052 >> [v2:172.21.15.103:6816/2618312891,v1:172.21.15.103:6817/2618312891] conn(0x7f19a8074ad0 msgr2=0x7f19a8076ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:29.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.361+0000 7f19bead5640 1 --2- 172.21.15.77:0/3108102052 >> [v2:172.21.15.103:6816/2618312891,v1:172.21.15.103:6817/2618312891] conn(0x7f19a8074ad0 0x7f19a8076ee0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:29.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.361+0000 7f19bead5640 1 -- 172.21.15.77:0/3108102052 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f19a806ed50 msgr2=0x7f19a8071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:29.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.361+0000 7f19bead5640 1 --2- 172.21.15.77:0/3108102052 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f19a806ed50 0x7f19a8071200 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f19ac02a530 tx=0x7f19ac009da0 comp rx=0 tx=0).stop 2024-09-18T21:09:29.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.361+0000 7f19bead5640 1 -- 172.21.15.77:0/3108102052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19b81014c0 msgr2=0x7f19b81136f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:29.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.361+0000 7f19bead5640 1 --2- 172.21.15.77:0/3108102052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19b81014c0 0x7f19b81136f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f19a400c830 tx=0x7f19a4004430 comp rx=0 tx=0).stop 2024-09-18T21:09:29.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.361+0000 7f19bead5640 1 -- 172.21.15.77:0/3108102052 shutdown_connections 2024-09-18T21:09:29.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.361+0000 7f19bead5640 1 --2- 172.21.15.77:0/3108102052 >> [v2:172.21.15.103:6816/2618312891,v1:172.21.15.103:6817/2618312891] conn(0x7f19a8074ad0 0x7f19a8076ee0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:29.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.361+0000 7f19bead5640 1 --2- 172.21.15.77:0/3108102052 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f19a806ed50 0x7f19a8071200 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:29.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.361+0000 7f19bead5640 1 --2- 172.21.15.77:0/3108102052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19b81014c0 0x7f19b81136f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:29.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.361+0000 7f19bead5640 1 --2- 172.21.15.77:0/3108102052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19b80fb480 0x7f19b81131b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:29.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.361+0000 7f19bead5640 1 -- 172.21.15.77:0/3108102052 >> 172.21.15.77:0/3108102052 conn(0x7f19b80f7000 msgr2=0x7f19b80f73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:09:29.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.362+0000 7f19bead5640 1 -- 172.21.15.77:0/3108102052 shutdown_connections 2024-09-18T21:09:29.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:28.362+0000 7f19bead5640 1 -- 172.21.15.77:0/3108102052 wait complete. 2024-09-18T21:09:29.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:29 smithi077 ceph-mon[27689]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:29.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:29 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:09:29.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:29 smithi103 ceph-mon[34827]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:29.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:29 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:09:29.848 INFO:teuthology.orchestra.run.smithi077.stdout:60129542172 2024-09-18T21:09:29.849 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-18T21:09:30.161 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:09:31.604 INFO:teuthology.orchestra.run.smithi077.stdout:158913789960 2024-09-18T21:09:31.605 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-18T21:09:31.680 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:31 smithi077 ceph-mon[27689]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:31.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:31 smithi103 ceph-mon[34827]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:32.345 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:09:32.365 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:09:33.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.333+0000 7fb2cb4a7640 1 -- 172.21.15.77:0/3752734154 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2c40fb470 msgr2=0x7fb2c40fb8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:33.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.333+0000 7fb2cb4a7640 1 --2- 172.21.15.77:0/3752734154 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2c40fb470 0x7fb2c40fb8e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb2b40048d0 tx=0x7fb2b4009da0 comp rx=0 tx=0).stop 2024-09-18T21:09:33.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.333+0000 7fb2cb4a7640 1 -- 172.21.15.77:0/3752734154 shutdown_connections 2024-09-18T21:09:33.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.333+0000 7fb2cb4a7640 1 --2- 172.21.15.77:0/3752734154 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2c40fb470 0x7fb2c40fb8e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:33.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.333+0000 7fb2cb4a7640 1 --2- 172.21.15.77:0/3752734154 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2c41014b0 0x7fb2c4101880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:33.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.333+0000 7fb2cb4a7640 1 -- 172.21.15.77:0/3752734154 >> 172.21.15.77:0/3752734154 conn(0x7fb2c40f7030 msgr2=0x7fb2c40f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:09:33.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.333+0000 7fb2cb4a7640 1 -- 172.21.15.77:0/3752734154 shutdown_connections 2024-09-18T21:09:33.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.333+0000 7fb2cb4a7640 1 -- 172.21.15.77:0/3752734154 wait complete. 2024-09-18T21:09:33.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.334+0000 7fb2cb4a7640 1 Processor -- start 2024-09-18T21:09:33.338 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.334+0000 7fb2cb4a7640 1 -- start start 2024-09-18T21:09:33.338 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.334+0000 7fb2cb4a7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2c40fb470 0x7fb2c41131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:33.338 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.334+0000 7fb2cb4a7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2c41014b0 0x7fb2c4113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:33.338 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.334+0000 7fb2cb4a7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c4113d10 con 0x7fb2c41014b0 2024-09-18T21:09:33.338 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.334+0000 7fb2cb4a7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c410d150 con 0x7fb2c40fb470 2024-09-18T21:09:33.338 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.335+0000 7fb2c8a42640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2c41014b0 0x7fb2c4113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:33.338 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.335+0000 7fb2c8a42640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2c41014b0 0x7fb2c4113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57170/0 (socket says 172.21.15.77:57170) 2024-09-18T21:09:33.338 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.335+0000 7fb2c8a42640 1 -- 172.21.15.77:0/3695696062 learned_addr learned my addr 172.21.15.77:0/3695696062 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:09:33.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.335+0000 7fb2c9243640 1 --2- 172.21.15.77:0/3695696062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2c40fb470 0x7fb2c41131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:33.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.335+0000 7fb2c8a42640 1 -- 172.21.15.77:0/3695696062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2c40fb470 msgr2=0x7fb2c41131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:33.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.335+0000 7fb2c8a42640 1 --2- 172.21.15.77:0/3695696062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2c40fb470 0x7fb2c41131d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:33.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.335+0000 7fb2c8a42640 1 -- 172.21.15.77:0/3695696062 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b4005040 con 0x7fb2c41014b0 2024-09-18T21:09:33.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.335+0000 7fb2c8a42640 1 --2- 172.21.15.77:0/3695696062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2c41014b0 0x7fb2c4113710 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4000c00 tx=0x7fb2b4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:33.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.335+0000 7fb2b9ffb640 1 -- 172.21.15.77:0/3695696062 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2b4038070 con 0x7fb2c41014b0 2024-09-18T21:09:33.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.335+0000 7fb2cb4a7640 1 -- 172.21.15.77:0/3695696062 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2c410d3d0 con 0x7fb2c41014b0 2024-09-18T21:09:33.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.335+0000 7fb2b9ffb640 1 -- 172.21.15.77:0/3695696062 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb2b402ade0 con 0x7fb2c41014b0 2024-09-18T21:09:33.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.335+0000 7fb2b9ffb640 1 -- 172.21.15.77:0/3695696062 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2b402c7e0 con 0x7fb2c41014b0 2024-09-18T21:09:33.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.335+0000 7fb2cb4a7640 1 -- 172.21.15.77:0/3695696062 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2c410d910 con 0x7fb2c41014b0 2024-09-18T21:09:33.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.336+0000 7fb2cb4a7640 1 -- 172.21.15.77:0/3695696062 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb2c410deb0 con 0x7fb2c41014b0 2024-09-18T21:09:33.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.337+0000 7fb2b9ffb640 1 -- 172.21.15.77:0/3695696062 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fb2b4030020 con 0x7fb2c41014b0 2024-09-18T21:09:33.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.337+0000 7fb2b9ffb640 1 --2- 172.21.15.77:0/3695696062 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fb2b006ed60 0x7fb2b0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:33.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.338+0000 7fb2b9ffb640 1 -- 172.21.15.77:0/3695696062 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb2b40adf10 con 0x7fb2c41014b0 2024-09-18T21:09:33.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.338+0000 7fb2c9243640 1 --2- 172.21.15.77:0/3695696062 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fb2b006ed60 0x7fb2b0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:33.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.338+0000 7fb2b9ffb640 1 --2- 172.21.15.77:0/3695696062 >> [v2:172.21.15.77:6818/462691237,v1:172.21.15.77:6819/462691237] conn(0x7fb2b0074ae0 0x7fb2b0076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:33.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.338+0000 7fb2b9ffb640 1 -- 172.21.15.77:0/3695696062 --> [v2:172.21.15.77:6818/462691237,v1:172.21.15.77:6819/462691237] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb2b00775a0 con 0x7fb2b0074ae0 2024-09-18T21:09:33.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.338+0000 7fb2b9ffb640 1 -- 172.21.15.77:0/3695696062 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb2b40ae2f0 con 0x7fb2c41014b0 2024-09-18T21:09:33.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.338+0000 7fb2c9a44640 1 --2- 172.21.15.77:0/3695696062 >> [v2:172.21.15.77:6818/462691237,v1:172.21.15.77:6819/462691237] conn(0x7fb2b0074ae0 0x7fb2b0076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:33.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.338+0000 7fb2c9243640 1 --2- 172.21.15.77:0/3695696062 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fb2b006ed60 0x7fb2b0071210 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb2c0004ed0 tx=0x7fb2c000b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:33.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.338+0000 7fb2c9a44640 1 --2- 172.21.15.77:0/3695696062 >> [v2:172.21.15.77:6818/462691237,v1:172.21.15.77:6819/462691237] conn(0x7fb2b0074ae0 0x7fb2b0076ef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:33.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.339+0000 7fb2b9ffb640 1 -- 172.21.15.77:0/3695696062 <== osd.2 v2:172.21.15.77:6818/462691237 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fb2b00775a0 con 0x7fb2b0074ae0 2024-09-18T21:09:33.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.352+0000 7fb2cb4a7640 1 -- 172.21.15.77:0/3695696062 --> [v2:172.21.15.77:6818/462691237,v1:172.21.15.77:6819/462691237] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb2c40661a0 con 0x7fb2b0074ae0 2024-09-18T21:09:33.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.353+0000 7fb2b9ffb640 1 -- 172.21.15.77:0/3695696062 <== osd.2 v2:172.21.15.77:6818/462691237 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb2c40661a0 con 0x7fb2b0074ae0 2024-09-18T21:09:33.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.353+0000 7fb2cb4a7640 1 -- 172.21.15.77:0/3695696062 >> [v2:172.21.15.77:6818/462691237,v1:172.21.15.77:6819/462691237] conn(0x7fb2b0074ae0 msgr2=0x7fb2b0076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:33.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.353+0000 7fb2cb4a7640 1 --2- 172.21.15.77:0/3695696062 >> [v2:172.21.15.77:6818/462691237,v1:172.21.15.77:6819/462691237] conn(0x7fb2b0074ae0 0x7fb2b0076ef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:33.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.353+0000 7fb2cb4a7640 1 -- 172.21.15.77:0/3695696062 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fb2b006ed60 msgr2=0x7fb2b0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:33.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.353+0000 7fb2cb4a7640 1 --2- 172.21.15.77:0/3695696062 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fb2b006ed60 0x7fb2b0071210 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb2c0004ed0 tx=0x7fb2c000b040 comp rx=0 tx=0).stop 2024-09-18T21:09:33.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.353+0000 7fb2cb4a7640 1 -- 172.21.15.77:0/3695696062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2c41014b0 msgr2=0x7fb2c4113710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:33.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.353+0000 7fb2cb4a7640 1 --2- 172.21.15.77:0/3695696062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2c41014b0 0x7fb2c4113710 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4000c00 tx=0x7fb2b4009da0 comp rx=0 tx=0).stop 2024-09-18T21:09:33.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.353+0000 7fb2cb4a7640 1 -- 172.21.15.77:0/3695696062 shutdown_connections 2024-09-18T21:09:33.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.353+0000 7fb2cb4a7640 1 --2- 172.21.15.77:0/3695696062 >> [v2:172.21.15.77:6818/462691237,v1:172.21.15.77:6819/462691237] conn(0x7fb2b0074ae0 0x7fb2b0076ef0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:33.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.353+0000 7fb2cb4a7640 1 --2- 172.21.15.77:0/3695696062 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fb2b006ed60 0x7fb2b0071210 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:33.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.353+0000 7fb2cb4a7640 1 --2- 172.21.15.77:0/3695696062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2c41014b0 0x7fb2c4113710 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:33.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.353+0000 7fb2cb4a7640 1 --2- 172.21.15.77:0/3695696062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb2c40fb470 0x7fb2c41131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:33.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.353+0000 7fb2cb4a7640 1 -- 172.21.15.77:0/3695696062 >> 172.21.15.77:0/3695696062 conn(0x7fb2c40f7030 msgr2=0x7fb2c4065810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:09:33.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.353+0000 7fb2cb4a7640 1 -- 172.21.15.77:0/3695696062 shutdown_connections 2024-09-18T21:09:33.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:33.353+0000 7fb2cb4a7640 1 -- 172.21.15.77:0/3695696062 wait complete. 2024-09-18T21:09:33.634 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:33 smithi077 ceph-mon[27689]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:33.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:33 smithi103 ceph-mon[34827]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:35.057 INFO:teuthology.orchestra.run.smithi077.stdout:81604378648 2024-09-18T21:09:35.057 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-18T21:09:35.572 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:35 smithi077 ceph-mon[27689]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:35.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:35 smithi103 ceph-mon[34827]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:35.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:35.798+0000 7f8094bc8640 1 -- 172.21.15.77:0/3339180812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80900fb810 msgr2=0x7f80900fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:35.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:35.798+0000 7f8094bc8640 1 --2- 172.21.15.77:0/3339180812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80900fb810 0x7f80900fbbe0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f80800048d0 tx=0x7f8080009da0 comp rx=0 tx=0).stop 2024-09-18T21:09:35.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:35.798+0000 7f8094bc8640 1 -- 172.21.15.77:0/3339180812 shutdown_connections 2024-09-18T21:09:35.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:35.798+0000 7f8094bc8640 1 --2- 172.21.15.77:0/3339180812 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80900fcf80 0x7f80900fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:35.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:35.798+0000 7f8094bc8640 1 --2- 172.21.15.77:0/3339180812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80900fb810 0x7f80900fbbe0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:35.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:35.798+0000 7f8094bc8640 1 -- 172.21.15.77:0/3339180812 >> 172.21.15.77:0/3339180812 conn(0x7f80900723b0 msgr2=0x7f80900727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:09:35.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:35.798+0000 7f8094bc8640 1 -- 172.21.15.77:0/3339180812 shutdown_connections 2024-09-18T21:09:35.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:35.798+0000 7f8094bc8640 1 -- 172.21.15.77:0/3339180812 wait complete. 2024-09-18T21:09:35.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:35.799+0000 7f8094bc8640 1 Processor -- start 2024-09-18T21:09:35.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:35.799+0000 7f8094bc8640 1 -- start start 2024-09-18T21:09:35.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:35.799+0000 7f8094bc8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80900fb810 0x7f80901131e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:35.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:35.799+0000 7f8094bc8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80900fcf80 0x7f8090113720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:35.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:35.799+0000 7f8094bc8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8090113d20 con 0x7f80900fcf80 2024-09-18T21:09:35.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:35.799+0000 7f8094bc8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809010d160 con 0x7f80900fb810 2024-09-18T21:09:35.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:35.799+0000 7f8087fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80900fcf80 0x7f8090113720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:35.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:35.799+0000 7f8087fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80900fcf80 0x7f8090113720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57180/0 (socket says 172.21.15.77:57180) 2024-09-18T21:09:35.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:35.799+0000 7f8087fff640 1 -- 172.21.15.77:0/2787208404 learned_addr learned my addr 172.21.15.77:0/2787208404 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:09:35.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:35.799+0000 7f808e59c640 1 --2- 172.21.15.77:0/2787208404 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80900fb810 0x7f80901131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:35.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:35.800+0000 7f8087fff640 1 -- 172.21.15.77:0/2787208404 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80900fb810 msgr2=0x7f80901131e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:35.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:35.800+0000 7f8087fff640 1 --2- 172.21.15.77:0/2787208404 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80900fb810 0x7f80901131e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:35.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:35.800+0000 7f8087fff640 1 -- 172.21.15.77:0/2787208404 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8080005040 con 0x7f80900fcf80 2024-09-18T21:09:35.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:35.800+0000 7f8087fff640 1 --2- 172.21.15.77:0/2787208404 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80900fcf80 0x7f8090113720 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f807800c830 tx=0x7f8078004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:35.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:35.800+0000 7f8086ffd640 1 -- 172.21.15.77:0/2787208404 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f807800a7d0 con 0x7f80900fcf80 2024-09-18T21:09:35.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:35.800+0000 7f8086ffd640 1 -- 172.21.15.77:0/2787208404 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f807800add0 con 0x7f80900fcf80 2024-09-18T21:09:35.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:35.800+0000 7f8094bc8640 1 -- 172.21.15.77:0/2787208404 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f809010d440 con 0x7f80900fcf80 2024-09-18T21:09:35.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:35.800+0000 7f8086ffd640 1 -- 172.21.15.77:0/2787208404 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80780113a0 con 0x7f80900fcf80 2024-09-18T21:09:35.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:35.800+0000 7f8094bc8640 1 -- 172.21.15.77:0/2787208404 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f809010d9e0 con 0x7f80900fcf80 2024-09-18T21:09:35.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:35.801+0000 7f8094bc8640 1 -- 172.21.15.77:0/2787208404 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80900fcbc0 con 0x7f80900fcf80 2024-09-18T21:09:35.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:35.801+0000 7f8086ffd640 1 -- 172.21.15.77:0/2787208404 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f8078012400 con 0x7f80900fcf80 2024-09-18T21:09:35.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:35.802+0000 7f8086ffd640 1 --2- 172.21.15.77:0/2787208404 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f807c06ed60 0x7f807c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:35.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:35.802+0000 7f808e59c640 1 --2- 172.21.15.77:0/2787208404 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f807c06ed60 0x7f807c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:35.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:35.802+0000 7f8086ffd640 1 -- 172.21.15.77:0/2787208404 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f807808dfa0 con 0x7f80900fcf80 2024-09-18T21:09:35.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:35.802+0000 7f808e59c640 1 --2- 172.21.15.77:0/2787208404 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f807c06ed60 0x7f807c071210 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8080009ac0 tx=0x7f8080035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:35.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:35.806+0000 7f8086ffd640 1 -- 172.21.15.77:0/2787208404 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f807805b5e0 con 0x7f80900fcf80 2024-09-18T21:09:35.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:35.964+0000 7f8094bc8640 1 -- 172.21.15.77:0/2787208404 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8090072ec0 con 0x7f80900fcf80 2024-09-18T21:09:35.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:35.965+0000 7f8086ffd640 1 -- 172.21.15.77:0/2787208404 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f807805af80 con 0x7f80900fcf80 2024-09-18T21:09:35.967 INFO:teuthology.orchestra.run.smithi077.stdout:38654705699 2024-09-18T21:09:35.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:35.966+0000 7f8094bc8640 1 -- 172.21.15.77:0/2787208404 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f807c06ed60 msgr2=0x7f807c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:35.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:35.966+0000 7f8094bc8640 1 --2- 172.21.15.77:0/2787208404 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f807c06ed60 0x7f807c071210 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8080009ac0 tx=0x7f8080035040 comp rx=0 tx=0).stop 2024-09-18T21:09:35.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:35.966+0000 7f8094bc8640 1 -- 172.21.15.77:0/2787208404 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80900fcf80 msgr2=0x7f8090113720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:35.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:35.966+0000 7f8094bc8640 1 --2- 172.21.15.77:0/2787208404 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80900fcf80 0x7f8090113720 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f807800c830 tx=0x7f8078004430 comp rx=0 tx=0).stop 2024-09-18T21:09:35.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:35.966+0000 7f8094bc8640 1 -- 172.21.15.77:0/2787208404 shutdown_connections 2024-09-18T21:09:35.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:35.966+0000 7f8094bc8640 1 --2- 172.21.15.77:0/2787208404 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f807c06ed60 0x7f807c071210 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:35.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:35.966+0000 7f8094bc8640 1 --2- 172.21.15.77:0/2787208404 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80900fcf80 0x7f8090113720 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:35.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:35.966+0000 7f8094bc8640 1 --2- 172.21.15.77:0/2787208404 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80900fb810 0x7f80901131e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:35.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:35.966+0000 7f8094bc8640 1 -- 172.21.15.77:0/2787208404 >> 172.21.15.77:0/2787208404 conn(0x7f80900723b0 msgr2=0x7f80900fa8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:09:35.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:35.967+0000 7f8094bc8640 1 -- 172.21.15.77:0/2787208404 shutdown_connections 2024-09-18T21:09:35.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:35.967+0000 7f8094bc8640 1 -- 172.21.15.77:0/2787208404 wait complete. 2024-09-18T21:09:36.627 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:36 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/2787208404' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-18T21:09:36.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:36 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/2787208404' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-18T21:09:37.591 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:37 smithi077 ceph-mon[27689]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:37.619 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705697 got 38654705699 for osd.0 2024-09-18T21:09:37.619 DEBUG:teuthology.parallel:result is None 2024-09-18T21:09:37.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:37 smithi103 ceph-mon[34827]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:38.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.280+0000 7f97da278640 1 -- 172.21.15.77:0/731905878 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97d40fac80 msgr2=0x7f97d40fb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:38.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.280+0000 7f97da278640 1 --2- 172.21.15.77:0/731905878 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97d40fac80 0x7f97d40fb0d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f97bc0048d0 tx=0x7f97bc009da0 comp rx=0 tx=0).stop 2024-09-18T21:09:38.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.280+0000 7f97da278640 1 -- 172.21.15.77:0/731905878 shutdown_connections 2024-09-18T21:09:38.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.280+0000 7f97da278640 1 --2- 172.21.15.77:0/731905878 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97d40fac80 0x7f97d40fb0d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:38.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.280+0000 7f97da278640 1 --2- 172.21.15.77:0/731905878 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97d4102660 0x7f97d4102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:38.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.280+0000 7f97da278640 1 -- 172.21.15.77:0/731905878 >> 172.21.15.77:0/731905878 conn(0x7f97d4070ce0 msgr2=0x7f97d40710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:09:38.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.280+0000 7f97da278640 1 -- 172.21.15.77:0/731905878 shutdown_connections 2024-09-18T21:09:38.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.280+0000 7f97da278640 1 -- 172.21.15.77:0/731905878 wait complete. 2024-09-18T21:09:38.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.280+0000 7f97da278640 1 Processor -- start 2024-09-18T21:09:38.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.281+0000 7f97da278640 1 -- start start 2024-09-18T21:09:38.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.281+0000 7f97da278640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97d40fac80 0x7f97d4113250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:38.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.281+0000 7f97da278640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97d4102660 0x7f97d4113790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:38.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.281+0000 7f97da278640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d4113d90 con 0x7f97d4102660 2024-09-18T21:09:38.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.281+0000 7f97da278640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d410d1d0 con 0x7f97d40fac80 2024-09-18T21:09:38.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.281+0000 7f97d37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97d4102660 0x7f97d4113790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:38.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.281+0000 7f97d37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97d4102660 0x7f97d4113790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57192/0 (socket says 172.21.15.77:57192) 2024-09-18T21:09:38.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.281+0000 7f97d37fe640 1 -- 172.21.15.77:0/4021985671 learned_addr learned my addr 172.21.15.77:0/4021985671 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:09:38.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.281+0000 7f97d3fff640 1 --2- 172.21.15.77:0/4021985671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97d40fac80 0x7f97d4113250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:38.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.281+0000 7f97d37fe640 1 -- 172.21.15.77:0/4021985671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97d40fac80 msgr2=0x7f97d4113250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:38.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.281+0000 7f97d37fe640 1 --2- 172.21.15.77:0/4021985671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97d40fac80 0x7f97d4113250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:38.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.281+0000 7f97d37fe640 1 -- 172.21.15.77:0/4021985671 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97bc005040 con 0x7f97d4102660 2024-09-18T21:09:38.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.281+0000 7f97d3fff640 1 --2- 172.21.15.77:0/4021985671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97d40fac80 0x7f97d4113250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T21:09:38.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.281+0000 7f97d37fe640 1 --2- 172.21.15.77:0/4021985671 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97d4102660 0x7f97d4113790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f97bc000c00 tx=0x7f97bc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:38.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.281+0000 7f97d0ff9640 1 -- 172.21.15.77:0/4021985671 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97bc038070 con 0x7f97d4102660 2024-09-18T21:09:38.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.281+0000 7f97d0ff9640 1 -- 172.21.15.77:0/4021985671 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f97bc02ade0 con 0x7f97d4102660 2024-09-18T21:09:38.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.281+0000 7f97da278640 1 -- 172.21.15.77:0/4021985671 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97d410d450 con 0x7f97d4102660 2024-09-18T21:09:38.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.281+0000 7f97d0ff9640 1 -- 172.21.15.77:0/4021985671 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97bc02c7e0 con 0x7f97d4102660 2024-09-18T21:09:38.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.282+0000 7f97da278640 1 -- 172.21.15.77:0/4021985671 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97d410d910 con 0x7f97d4102660 2024-09-18T21:09:38.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.283+0000 7f97da278640 1 -- 172.21.15.77:0/4021985671 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97d40657d0 con 0x7f97d4102660 2024-09-18T21:09:38.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.283+0000 7f97d0ff9640 1 -- 172.21.15.77:0/4021985671 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f97bc030020 con 0x7f97d4102660 2024-09-18T21:09:38.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.284+0000 7f97d0ff9640 1 --2- 172.21.15.77:0/4021985671 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f97c006ed60 0x7f97c0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:38.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.284+0000 7f97d3fff640 1 --2- 172.21.15.77:0/4021985671 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f97c006ed60 0x7f97c0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:38.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.284+0000 7f97d0ff9640 1 -- 172.21.15.77:0/4021985671 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f97bc0ad9b0 con 0x7f97d4102660 2024-09-18T21:09:38.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.284+0000 7f97d3fff640 1 --2- 172.21.15.77:0/4021985671 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f97c006ed60 0x7f97c0071210 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f97c4009af0 tx=0x7f97c400b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:38.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.288+0000 7f97d0ff9640 1 -- 172.21.15.77:0/4021985671 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f97bc07af40 con 0x7f97d4102660 2024-09-18T21:09:38.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.450+0000 7f97da278640 1 -- 172.21.15.77:0/4021985671 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f97d4109600 con 0x7f97d4102660 2024-09-18T21:09:38.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.450+0000 7f97d0ff9640 1 -- 172.21.15.77:0/4021985671 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f97bc07a8e0 con 0x7f97d4102660 2024-09-18T21:09:38.452 INFO:teuthology.orchestra.run.smithi077.stdout:60129542174 2024-09-18T21:09:38.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.453+0000 7f97da278640 1 -- 172.21.15.77:0/4021985671 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f97c006ed60 msgr2=0x7f97c0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:38.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.453+0000 7f97da278640 1 --2- 172.21.15.77:0/4021985671 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f97c006ed60 0x7f97c0071210 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f97c4009af0 tx=0x7f97c400b040 comp rx=0 tx=0).stop 2024-09-18T21:09:38.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.453+0000 7f97da278640 1 -- 172.21.15.77:0/4021985671 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97d4102660 msgr2=0x7f97d4113790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:38.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.453+0000 7f97da278640 1 --2- 172.21.15.77:0/4021985671 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97d4102660 0x7f97d4113790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f97bc000c00 tx=0x7f97bc009da0 comp rx=0 tx=0).stop 2024-09-18T21:09:38.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.453+0000 7f97da278640 1 -- 172.21.15.77:0/4021985671 shutdown_connections 2024-09-18T21:09:38.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.453+0000 7f97da278640 1 --2- 172.21.15.77:0/4021985671 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f97c006ed60 0x7f97c0071210 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:38.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.453+0000 7f97da278640 1 --2- 172.21.15.77:0/4021985671 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f97d4102660 0x7f97d4113790 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:38.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.453+0000 7f97da278640 1 --2- 172.21.15.77:0/4021985671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97d40fac80 0x7f97d4113250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:38.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.453+0000 7f97da278640 1 -- 172.21.15.77:0/4021985671 >> 172.21.15.77:0/4021985671 conn(0x7f97d4070ce0 msgr2=0x7f97d40fa0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:09:38.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.453+0000 7f97da278640 1 -- 172.21.15.77:0/4021985671 shutdown_connections 2024-09-18T21:09:38.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.453+0000 7f97da278640 1 -- 172.21.15.77:0/4021985671 wait complete. 2024-09-18T21:09:38.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.498+0000 7fe9e2388640 1 -- 172.21.15.77:0/233208132 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9dc0fe450 msgr2=0x7fe9dc0fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:38.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.498+0000 7fe9e2388640 1 --2- 172.21.15.77:0/233208132 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9dc0fe450 0x7fe9dc0fe820 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc0048d0 tx=0x7fe9cc009da0 comp rx=0 tx=0).stop 2024-09-18T21:09:38.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.498+0000 7fe9e2388640 1 -- 172.21.15.77:0/233208132 shutdown_connections 2024-09-18T21:09:38.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.498+0000 7fe9e2388640 1 --2- 172.21.15.77:0/233208132 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9dc064fe0 0x7fe9dc065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:38.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.498+0000 7fe9e2388640 1 --2- 172.21.15.77:0/233208132 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9dc0fe450 0x7fe9dc0fe820 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:38.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.498+0000 7fe9e2388640 1 -- 172.21.15.77:0/233208132 >> 172.21.15.77:0/233208132 conn(0x7fe9dc0723b0 msgr2=0x7fe9dc0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:09:38.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.498+0000 7fe9e2388640 1 -- 172.21.15.77:0/233208132 shutdown_connections 2024-09-18T21:09:38.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.498+0000 7fe9e2388640 1 -- 172.21.15.77:0/233208132 wait complete. 2024-09-18T21:09:38.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.499+0000 7fe9e2388640 1 Processor -- start 2024-09-18T21:09:38.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.499+0000 7fe9e2388640 1 -- start start 2024-09-18T21:09:38.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.499+0000 7fe9e2388640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9dc064fe0 0x7fe9dc113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:38.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.499+0000 7fe9e2388640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9dc0fe450 0x7fe9dc113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:38.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.499+0000 7fe9e2388640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc113d50 con 0x7fe9dc0fe450 2024-09-18T21:09:38.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.499+0000 7fe9e2388640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc10d190 con 0x7fe9dc064fe0 2024-09-18T21:09:38.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.499+0000 7fe9db7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9dc0fe450 0x7fe9dc113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:38.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.499+0000 7fe9db7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9dc0fe450 0x7fe9dc113750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57220/0 (socket says 172.21.15.77:57220) 2024-09-18T21:09:38.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.499+0000 7fe9db7fe640 1 -- 172.21.15.77:0/1971205179 learned_addr learned my addr 172.21.15.77:0/1971205179 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:09:38.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.499+0000 7fe9dbfff640 1 --2- 172.21.15.77:0/1971205179 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9dc064fe0 0x7fe9dc113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:38.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.500+0000 7fe9db7fe640 1 -- 172.21.15.77:0/1971205179 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9dc064fe0 msgr2=0x7fe9dc113210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:38.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.500+0000 7fe9db7fe640 1 --2- 172.21.15.77:0/1971205179 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9dc064fe0 0x7fe9dc113210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:38.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.500+0000 7fe9db7fe640 1 -- 172.21.15.77:0/1971205179 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9cc005040 con 0x7fe9dc0fe450 2024-09-18T21:09:38.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.500+0000 7fe9db7fe640 1 --2- 172.21.15.77:0/1971205179 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9dc0fe450 0x7fe9dc113750 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0002a50 tx=0x7fe9d0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:38.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.500+0000 7fe9d8ff9640 1 -- 172.21.15.77:0/1971205179 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9d0007c30 con 0x7fe9dc0fe450 2024-09-18T21:09:38.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.500+0000 7fe9e2388640 1 -- 172.21.15.77:0/1971205179 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9dc10d470 con 0x7fe9dc0fe450 2024-09-18T21:09:38.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.500+0000 7fe9d8ff9640 1 -- 172.21.15.77:0/1971205179 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe9d000f040 con 0x7fe9dc0fe450 2024-09-18T21:09:38.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.500+0000 7fe9d8ff9640 1 -- 172.21.15.77:0/1971205179 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9d000da10 con 0x7fe9dc0fe450 2024-09-18T21:09:38.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.500+0000 7fe9e2388640 1 -- 172.21.15.77:0/1971205179 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9dc10d990 con 0x7fe9dc0fe450 2024-09-18T21:09:38.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.501+0000 7fe9e2388640 1 -- 172.21.15.77:0/1971205179 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9dc0fdce0 con 0x7fe9dc0fe450 2024-09-18T21:09:38.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.502+0000 7fe9d8ff9640 1 -- 172.21.15.77:0/1971205179 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fe9d000dc80 con 0x7fe9dc0fe450 2024-09-18T21:09:38.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.502+0000 7fe9d8ff9640 1 --2- 172.21.15.77:0/1971205179 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fe9c406ed60 0x7fe9c4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:38.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.502+0000 7fe9dbfff640 1 --2- 172.21.15.77:0/1971205179 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fe9c406ed60 0x7fe9c4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:38.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.502+0000 7fe9d8ff9640 1 -- 172.21.15.77:0/1971205179 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe9d008d6a0 con 0x7fe9dc0fe450 2024-09-18T21:09:38.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.503+0000 7fe9dbfff640 1 --2- 172.21.15.77:0/1971205179 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fe9c406ed60 0x7fe9c4071210 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc009ac0 tx=0x7fe9cc035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:38.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.506+0000 7fe9d8ff9640 1 -- 172.21.15.77:0/1971205179 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe9d004d2a0 con 0x7fe9dc0fe450 2024-09-18T21:09:38.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.665+0000 7fe9e2388640 1 -- 172.21.15.77:0/1971205179 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe9dc10e880 con 0x7fe9dc0fe450 2024-09-18T21:09:38.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.665+0000 7fe9d8ff9640 1 -- 172.21.15.77:0/1971205179 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe9d005abd0 con 0x7fe9dc0fe450 2024-09-18T21:09:38.668 INFO:teuthology.orchestra.run.smithi077.stdout:111669149716 2024-09-18T21:09:38.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.667+0000 7fe9e2388640 1 -- 172.21.15.77:0/1971205179 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fe9c406ed60 msgr2=0x7fe9c4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:38.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.667+0000 7fe9e2388640 1 --2- 172.21.15.77:0/1971205179 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fe9c406ed60 0x7fe9c4071210 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc009ac0 tx=0x7fe9cc035040 comp rx=0 tx=0).stop 2024-09-18T21:09:38.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.667+0000 7fe9e2388640 1 -- 172.21.15.77:0/1971205179 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9dc0fe450 msgr2=0x7fe9dc113750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:38.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.667+0000 7fe9e2388640 1 --2- 172.21.15.77:0/1971205179 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9dc0fe450 0x7fe9dc113750 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0002a50 tx=0x7fe9d0004600 comp rx=0 tx=0).stop 2024-09-18T21:09:38.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.667+0000 7fe9e2388640 1 -- 172.21.15.77:0/1971205179 shutdown_connections 2024-09-18T21:09:38.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.667+0000 7fe9e2388640 1 --2- 172.21.15.77:0/1971205179 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fe9c406ed60 0x7fe9c4071210 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:38.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.667+0000 7fe9e2388640 1 --2- 172.21.15.77:0/1971205179 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9dc0fe450 0x7fe9dc113750 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:38.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.667+0000 7fe9e2388640 1 --2- 172.21.15.77:0/1971205179 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9dc064fe0 0x7fe9dc113210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:38.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.667+0000 7fe9e2388640 1 -- 172.21.15.77:0/1971205179 >> 172.21.15.77:0/1971205179 conn(0x7fe9dc0723b0 msgr2=0x7fe9dc0fa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:09:38.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.668+0000 7fe9e2388640 1 -- 172.21.15.77:0/1971205179 shutdown_connections 2024-09-18T21:09:38.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:38.668+0000 7fe9e2388640 1 -- 172.21.15.77:0/1971205179 wait complete. 2024-09-18T21:09:38.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:38 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/4021985671' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-18T21:09:38.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:38 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/4021985671' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-18T21:09:38.869 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:09:38.870 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:09:39.377 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149713 got 111669149716 for osd.3 2024-09-18T21:09:39.377 DEBUG:teuthology.parallel:result is None 2024-09-18T21:09:39.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:39 smithi077 ceph-mon[27689]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:39.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:39 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/1971205179' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-18T21:09:39.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:39 smithi103 ceph-mon[34827]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:39.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:39 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/1971205179' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-18T21:09:39.829 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542172 got 60129542174 for osd.1 2024-09-18T21:09:39.829 DEBUG:teuthology.parallel:result is None 2024-09-18T21:09:41.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:41 smithi103 ceph-mon[34827]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:41.929 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:41 smithi077 ceph-mon[27689]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:42.374 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.334+0000 7f7e966d1640 1 -- 172.21.15.77:0/505918307 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e90102ef0 msgr2=0x7f7e900fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:42.374 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.334+0000 7f7e966d1640 1 --2- 172.21.15.77:0/505918307 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e90102ef0 0x7f7e900fc5b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7e840048d0 tx=0x7f7e84009da0 comp rx=0 tx=0).stop 2024-09-18T21:09:42.374 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.334+0000 7f7e966d1640 1 -- 172.21.15.77:0/505918307 shutdown_connections 2024-09-18T21:09:42.374 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.334+0000 7f7e966d1640 1 --2- 172.21.15.77:0/505918307 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e90102ef0 0x7f7e900fc5b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:42.374 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.334+0000 7f7e966d1640 1 --2- 172.21.15.77:0/505918307 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e90102550 0x7f7e90102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:42.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.334+0000 7f7e966d1640 1 -- 172.21.15.77:0/505918307 >> 172.21.15.77:0/505918307 conn(0x7f7e900f80f0 msgr2=0x7f7e900fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:09:42.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.334+0000 7f7e966d1640 1 -- 172.21.15.77:0/505918307 shutdown_connections 2024-09-18T21:09:42.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.334+0000 7f7e966d1640 1 -- 172.21.15.77:0/505918307 wait complete. 2024-09-18T21:09:42.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.334+0000 7f7e966d1640 1 Processor -- start 2024-09-18T21:09:42.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.335+0000 7f7e966d1640 1 -- start start 2024-09-18T21:09:42.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.335+0000 7f7e966d1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e90102550 0x7f7e90113500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:42.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.335+0000 7f7e966d1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e90102ef0 0x7f7e90113a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:42.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.335+0000 7f7e966d1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e90114090 con 0x7f7e90102550 2024-09-18T21:09:42.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.335+0000 7f7e966d1640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9010d4a0 con 0x7f7e90102ef0 2024-09-18T21:09:42.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.335+0000 7f7e8ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e90102550 0x7f7e90113500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:42.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.335+0000 7f7e8ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e90102550 0x7f7e90113500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53334/0 (socket says 172.21.15.77:53334) 2024-09-18T21:09:42.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.335+0000 7f7e8ffff640 1 -- 172.21.15.77:0/3311917027 learned_addr learned my addr 172.21.15.77:0/3311917027 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:09:42.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.335+0000 7f7e8ffff640 1 -- 172.21.15.77:0/3311917027 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e90102ef0 msgr2=0x7f7e90113a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:42.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.335+0000 7f7e8ffff640 1 --2- 172.21.15.77:0/3311917027 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e90102ef0 0x7f7e90113a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:42.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.335+0000 7f7e8ffff640 1 -- 172.21.15.77:0/3311917027 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e84005040 con 0x7f7e90102550 2024-09-18T21:09:42.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.335+0000 7f7e8ffff640 1 --2- 172.21.15.77:0/3311917027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e90102550 0x7f7e90113500 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7e80002a80 tx=0x7f7e80004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:42.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.336+0000 7f7e8cff9640 1 -- 172.21.15.77:0/3311917027 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e80007c30 con 0x7f7e90102550 2024-09-18T21:09:42.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.336+0000 7f7e966d1640 1 -- 172.21.15.77:0/3311917027 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e9010d780 con 0x7f7e90102550 2024-09-18T21:09:42.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.336+0000 7f7e8cff9640 1 -- 172.21.15.77:0/3311917027 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7e8000f040 con 0x7f7e90102550 2024-09-18T21:09:42.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.336+0000 7f7e8cff9640 1 -- 172.21.15.77:0/3311917027 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e80009530 con 0x7f7e90102550 2024-09-18T21:09:42.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.336+0000 7f7e966d1640 1 -- 172.21.15.77:0/3311917027 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e9010dca0 con 0x7f7e90102550 2024-09-18T21:09:42.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.337+0000 7f7e966d1640 1 -- 172.21.15.77:0/3311917027 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e900fdcd0 con 0x7f7e90102550 2024-09-18T21:09:42.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.337+0000 7f7e8cff9640 1 -- 172.21.15.77:0/3311917027 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f7e800097a0 con 0x7f7e90102550 2024-09-18T21:09:42.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.338+0000 7f7e8cff9640 1 --2- 172.21.15.77:0/3311917027 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f7e7806ed60 0x7f7e78071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:42.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.338+0000 7f7e8cff9640 1 -- 172.21.15.77:0/3311917027 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7e8008d800 con 0x7f7e90102550 2024-09-18T21:09:42.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.338+0000 7f7e8f7fe640 1 --2- 172.21.15.77:0/3311917027 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f7e7806ed60 0x7f7e78071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:42.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.338+0000 7f7e8f7fe640 1 --2- 172.21.15.77:0/3311917027 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f7e7806ed60 0x7f7e78071210 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7e84009ac0 tx=0x7f7e84009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:42.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.342+0000 7f7e8cff9640 1 -- 172.21.15.77:0/3311917027 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f7e8004d2a0 con 0x7f7e90102550 2024-09-18T21:09:42.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.235+0000 7fc7c09bc640 1 -- 172.21.15.77:0/3242986027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7bc1014e0 msgr2=0x7fc7bc1018b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:42.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.235+0000 7fc7c09bc640 1 --2- 172.21.15.77:0/3242986027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7bc1014e0 0x7fc7bc1018b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac0048d0 tx=0x7fc7ac009da0 comp rx=0 tx=0).stop 2024-09-18T21:09:42.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.235+0000 7fc7c09bc640 1 -- 172.21.15.77:0/3242986027 shutdown_connections 2024-09-18T21:09:42.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.235+0000 7fc7c09bc640 1 --2- 172.21.15.77:0/3242986027 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7bc0fb4a0 0x7fc7bc0fb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:42.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.235+0000 7fc7c09bc640 1 --2- 172.21.15.77:0/3242986027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7bc1014e0 0x7fc7bc1018b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:42.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.235+0000 7fc7c09bc640 1 -- 172.21.15.77:0/3242986027 >> 172.21.15.77:0/3242986027 conn(0x7fc7bc0f7020 msgr2=0x7fc7bc0f9430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:09:42.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.235+0000 7fc7c09bc640 1 -- 172.21.15.77:0/3242986027 shutdown_connections 2024-09-18T21:09:42.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.235+0000 7fc7c09bc640 1 -- 172.21.15.77:0/3242986027 wait complete. 2024-09-18T21:09:42.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.235+0000 7fc7c09bc640 1 Processor -- start 2024-09-18T21:09:42.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.235+0000 7fc7c09bc640 1 -- start start 2024-09-18T21:09:42.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.236+0000 7fc7c09bc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7bc0fb4a0 0x7fc7bc1131e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:42.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.236+0000 7fc7c09bc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7bc1014e0 0x7fc7bc113720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:42.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.236+0000 7fc7c09bc640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7bc113db0 con 0x7fc7bc0fb4a0 2024-09-18T21:09:42.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.236+0000 7fc7c09bc640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7bc10d160 con 0x7fc7bc1014e0 2024-09-18T21:09:42.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.236+0000 7fc7ba59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7bc0fb4a0 0x7fc7bc1131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:42.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.236+0000 7fc7ba59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7bc0fb4a0 0x7fc7bc1131e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53306/0 (socket says 172.21.15.77:53306) 2024-09-18T21:09:42.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.236+0000 7fc7ba59c640 1 -- 172.21.15.77:0/2682792281 learned_addr learned my addr 172.21.15.77:0/2682792281 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:09:42.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.236+0000 7fc7ba59c640 1 -- 172.21.15.77:0/2682792281 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7bc1014e0 msgr2=0x7fc7bc113720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:42.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.236+0000 7fc7b9d9b640 1 --2- 172.21.15.77:0/2682792281 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7bc1014e0 0x7fc7bc113720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:42.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.236+0000 7fc7ba59c640 1 --2- 172.21.15.77:0/2682792281 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7bc1014e0 0x7fc7bc113720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:42.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.236+0000 7fc7ba59c640 1 -- 172.21.15.77:0/2682792281 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7ac005040 con 0x7fc7bc0fb4a0 2024-09-18T21:09:42.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.236+0000 7fc7b9d9b640 1 --2- 172.21.15.77:0/2682792281 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7bc1014e0 0x7fc7bc113720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T21:09:42.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.236+0000 7fc7ba59c640 1 --2- 172.21.15.77:0/2682792281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7bc0fb4a0 0x7fc7bc1131e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac003080 tx=0x7fc7ac009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:42.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.236+0000 7fc7aaffd640 1 -- 172.21.15.77:0/2682792281 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7ac038070 con 0x7fc7bc0fb4a0 2024-09-18T21:09:42.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.236+0000 7fc7aaffd640 1 -- 172.21.15.77:0/2682792281 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc7ac0097e0 con 0x7fc7bc0fb4a0 2024-09-18T21:09:42.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.236+0000 7fc7aaffd640 1 -- 172.21.15.77:0/2682792281 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7ac03d420 con 0x7fc7bc0fb4a0 2024-09-18T21:09:42.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.236+0000 7fc7c09bc640 1 -- 172.21.15.77:0/2682792281 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7bc10d3e0 con 0x7fc7bc0fb4a0 2024-09-18T21:09:42.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.236+0000 7fc7c09bc640 1 -- 172.21.15.77:0/2682792281 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7bc10d8a0 con 0x7fc7bc0fb4a0 2024-09-18T21:09:42.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.237+0000 7fc7c09bc640 1 -- 172.21.15.77:0/2682792281 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc7bc10ddd0 con 0x7fc7bc0fb4a0 2024-09-18T21:09:42.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.238+0000 7fc7aaffd640 1 -- 172.21.15.77:0/2682792281 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fc7ac030020 con 0x7fc7bc0fb4a0 2024-09-18T21:09:42.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.238+0000 7fc7aaffd640 1 --2- 172.21.15.77:0/2682792281 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fc7a406ed60 0x7fc7a4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:42.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.238+0000 7fc7aaffd640 1 -- 172.21.15.77:0/2682792281 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc7ac0ae370 con 0x7fc7bc0fb4a0 2024-09-18T21:09:42.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.238+0000 7fc7b9d9b640 1 --2- 172.21.15.77:0/2682792281 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fc7a406ed60 0x7fc7a4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:42.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.238+0000 7fc7aaffd640 1 --2- 172.21.15.77:0/2682792281 >> [v2:172.21.15.103:6808/3297772484,v1:172.21.15.103:6809/3297772484] conn(0x7fc7a4074ae0 0x7fc7a4076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:42.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.238+0000 7fc7aaffd640 1 -- 172.21.15.77:0/2682792281 --> [v2:172.21.15.103:6808/3297772484,v1:172.21.15.103:6809/3297772484] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc7a40775a0 con 0x7fc7a4074ae0 2024-09-18T21:09:42.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.238+0000 7fc7aaffd640 1 -- 172.21.15.77:0/2682792281 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc7ac0b09c0 con 0x7fc7bc0fb4a0 2024-09-18T21:09:42.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.239+0000 7fc7bad9d640 1 --2- 172.21.15.77:0/2682792281 >> [v2:172.21.15.103:6808/3297772484,v1:172.21.15.103:6809/3297772484] conn(0x7fc7a4074ae0 0x7fc7a4076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:42.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.239+0000 7fc7b9d9b640 1 --2- 172.21.15.77:0/2682792281 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fc7a406ed60 0x7fc7a4071210 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0006fd0 tx=0x7fc7b0008040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:42.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.239+0000 7fc7bad9d640 1 --2- 172.21.15.77:0/2682792281 >> [v2:172.21.15.103:6808/3297772484,v1:172.21.15.103:6809/3297772484] conn(0x7fc7a4074ae0 0x7fc7a4076ef0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:42.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.240+0000 7fc7aaffd640 1 -- 172.21.15.77:0/2682792281 <== osd.4 v2:172.21.15.103:6808/3297772484 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fc7a40775a0 con 0x7fc7a4074ae0 2024-09-18T21:09:42.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.252+0000 7fc7c09bc640 1 -- 172.21.15.77:0/2682792281 --> [v2:172.21.15.103:6808/3297772484,v1:172.21.15.103:6809/3297772484] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc7bc10df90 con 0x7fc7a4074ae0 2024-09-18T21:09:42.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.252+0000 7fc7aaffd640 1 -- 172.21.15.77:0/2682792281 <== osd.4 v2:172.21.15.103:6808/3297772484 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fc7bc10df90 con 0x7fc7a4074ae0 2024-09-18T21:09:42.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.253+0000 7fc7c09bc640 1 -- 172.21.15.77:0/2682792281 >> [v2:172.21.15.103:6808/3297772484,v1:172.21.15.103:6809/3297772484] conn(0x7fc7a4074ae0 msgr2=0x7fc7a4076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:42.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.253+0000 7fc7c09bc640 1 --2- 172.21.15.77:0/2682792281 >> [v2:172.21.15.103:6808/3297772484,v1:172.21.15.103:6809/3297772484] conn(0x7fc7a4074ae0 0x7fc7a4076ef0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:42.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.253+0000 7fc7c09bc640 1 -- 172.21.15.77:0/2682792281 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fc7a406ed60 msgr2=0x7fc7a4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:42.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.253+0000 7fc7c09bc640 1 --2- 172.21.15.77:0/2682792281 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fc7a406ed60 0x7fc7a4071210 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0006fd0 tx=0x7fc7b0008040 comp rx=0 tx=0).stop 2024-09-18T21:09:42.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.253+0000 7fc7c09bc640 1 -- 172.21.15.77:0/2682792281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7bc0fb4a0 msgr2=0x7fc7bc1131e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:42.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.253+0000 7fc7c09bc640 1 --2- 172.21.15.77:0/2682792281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7bc0fb4a0 0x7fc7bc1131e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac003080 tx=0x7fc7ac009da0 comp rx=0 tx=0).stop 2024-09-18T21:09:42.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.253+0000 7fc7c09bc640 1 -- 172.21.15.77:0/2682792281 shutdown_connections 2024-09-18T21:09:42.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.253+0000 7fc7c09bc640 1 --2- 172.21.15.77:0/2682792281 >> [v2:172.21.15.103:6808/3297772484,v1:172.21.15.103:6809/3297772484] conn(0x7fc7a4074ae0 0x7fc7a4076ef0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:42.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.253+0000 7fc7c09bc640 1 --2- 172.21.15.77:0/2682792281 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fc7a406ed60 0x7fc7a4071210 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:42.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.253+0000 7fc7c09bc640 1 --2- 172.21.15.77:0/2682792281 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7bc1014e0 0x7fc7bc113720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:42.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.253+0000 7fc7c09bc640 1 --2- 172.21.15.77:0/2682792281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7bc0fb4a0 0x7fc7bc1131e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:42.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.253+0000 7fc7c09bc640 1 -- 172.21.15.77:0/2682792281 >> 172.21.15.77:0/2682792281 conn(0x7fc7bc0f7020 msgr2=0x7fc7bc065a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:09:42.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.253+0000 7fc7c09bc640 1 -- 172.21.15.77:0/2682792281 shutdown_connections 2024-09-18T21:09:42.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.253+0000 7fc7c09bc640 1 -- 172.21.15.77:0/2682792281 wait complete. 2024-09-18T21:09:42.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.500+0000 7f7e966d1640 1 -- 172.21.15.77:0/3311917027 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f7e9004b720 con 0x7f7e90102550 2024-09-18T21:09:42.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.501+0000 7f7e8cff9640 1 -- 172.21.15.77:0/3311917027 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7e8005ac60 con 0x7f7e90102550 2024-09-18T21:09:42.505 INFO:teuthology.orchestra.run.smithi077.stdout:158913789963 2024-09-18T21:09:42.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.503+0000 7f7e966d1640 1 -- 172.21.15.77:0/3311917027 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f7e7806ed60 msgr2=0x7f7e78071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:42.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.503+0000 7f7e966d1640 1 --2- 172.21.15.77:0/3311917027 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f7e7806ed60 0x7f7e78071210 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7e84009ac0 tx=0x7f7e84009da0 comp rx=0 tx=0).stop 2024-09-18T21:09:42.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.503+0000 7f7e966d1640 1 -- 172.21.15.77:0/3311917027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e90102550 msgr2=0x7f7e90113500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:42.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.503+0000 7f7e966d1640 1 --2- 172.21.15.77:0/3311917027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e90102550 0x7f7e90113500 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7e80002a80 tx=0x7f7e80004600 comp rx=0 tx=0).stop 2024-09-18T21:09:42.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.503+0000 7f7e966d1640 1 -- 172.21.15.77:0/3311917027 shutdown_connections 2024-09-18T21:09:42.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.503+0000 7f7e966d1640 1 --2- 172.21.15.77:0/3311917027 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f7e7806ed60 0x7f7e78071210 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:42.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.503+0000 7f7e966d1640 1 --2- 172.21.15.77:0/3311917027 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e90102ef0 0x7f7e90113a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:42.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.503+0000 7f7e966d1640 1 --2- 172.21.15.77:0/3311917027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7e90102550 0x7f7e90113500 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:42.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.503+0000 7f7e966d1640 1 -- 172.21.15.77:0/3311917027 >> 172.21.15.77:0/3311917027 conn(0x7f7e900f80f0 msgr2=0x7f7e900f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:09:42.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.503+0000 7f7e966d1640 1 -- 172.21.15.77:0/3311917027 shutdown_connections 2024-09-18T21:09:42.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:42.503+0000 7f7e966d1640 1 -- 172.21.15.77:0/3311917027 wait complete. 2024-09-18T21:09:43.169 INFO:teuthology.orchestra.run.smithi077.stdout:137438953488 2024-09-18T21:09:43.170 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-18T21:09:43.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:43 smithi103 ceph-mon[34827]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:43.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:43 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/3311917027' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-18T21:09:43.901 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:43 smithi077 ceph-mon[27689]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:43.902 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:43 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/3311917027' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-18T21:09:44.242 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913789960 got 158913789963 for osd.5 2024-09-18T21:09:44.242 DEBUG:teuthology.parallel:result is None 2024-09-18T21:09:44.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:44.672+0000 7f0bf285c640 1 -- 172.21.15.77:0/2734105823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bec102530 msgr2=0x7f0bec102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:44.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:44.672+0000 7f0bf285c640 1 --2- 172.21.15.77:0/2734105823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bec102530 0x7f0bec102900 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc0048d0 tx=0x7f0bdc009da0 comp rx=0 tx=0).stop 2024-09-18T21:09:44.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:44.672+0000 7f0bf285c640 1 -- 172.21.15.77:0/2734105823 shutdown_connections 2024-09-18T21:09:44.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:44.672+0000 7f0bf285c640 1 --2- 172.21.15.77:0/2734105823 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bec102ed0 0x7f0bec0fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:44.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:44.672+0000 7f0bf285c640 1 --2- 172.21.15.77:0/2734105823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bec102530 0x7f0bec102900 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:44.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:44.672+0000 7f0bf285c640 1 -- 172.21.15.77:0/2734105823 >> 172.21.15.77:0/2734105823 conn(0x7f0bec0f80f0 msgr2=0x7f0bec0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:09:44.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:44.672+0000 7f0bf285c640 1 -- 172.21.15.77:0/2734105823 shutdown_connections 2024-09-18T21:09:44.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:44.672+0000 7f0bf285c640 1 -- 172.21.15.77:0/2734105823 wait complete. 2024-09-18T21:09:44.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:44.672+0000 7f0bf285c640 1 Processor -- start 2024-09-18T21:09:44.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:44.673+0000 7f0bf285c640 1 -- start start 2024-09-18T21:09:44.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:44.673+0000 7f0bf285c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bec102530 0x7f0bec113250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:44.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:44.673+0000 7f0bf285c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bec102ed0 0x7f0bec113790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:44.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:44.673+0000 7f0bf285c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bec113e20 con 0x7f0bec102530 2024-09-18T21:09:44.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:44.673+0000 7f0bf285c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bec10d1d0 con 0x7f0bec102ed0 2024-09-18T21:09:44.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:44.673+0000 7f0bebfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bec102530 0x7f0bec113250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:44.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:44.673+0000 7f0bebfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bec102530 0x7f0bec113250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53344/0 (socket says 172.21.15.77:53344) 2024-09-18T21:09:44.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:44.673+0000 7f0bebfff640 1 -- 172.21.15.77:0/506736615 learned_addr learned my addr 172.21.15.77:0/506736615 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:09:44.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:44.673+0000 7f0bebfff640 1 -- 172.21.15.77:0/506736615 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bec102ed0 msgr2=0x7f0bec113790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:44.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:44.673+0000 7f0bebfff640 1 --2- 172.21.15.77:0/506736615 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bec102ed0 0x7f0bec113790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:44.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:44.673+0000 7f0bebfff640 1 -- 172.21.15.77:0/506736615 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bdc005040 con 0x7f0bec102530 2024-09-18T21:09:44.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:44.673+0000 7f0bebfff640 1 --2- 172.21.15.77:0/506736615 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bec102530 0x7f0bec113250 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc000c00 tx=0x7f0bdc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:44.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:44.674+0000 7f0be8ff9640 1 -- 172.21.15.77:0/506736615 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0bdc038070 con 0x7f0bec102530 2024-09-18T21:09:44.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:44.674+0000 7f0be8ff9640 1 -- 172.21.15.77:0/506736615 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0bdc03daf0 con 0x7f0bec102530 2024-09-18T21:09:44.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:44.674+0000 7f0bf285c640 1 -- 172.21.15.77:0/506736615 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bec10d450 con 0x7f0bec102530 2024-09-18T21:09:44.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:44.674+0000 7f0be8ff9640 1 -- 172.21.15.77:0/506736615 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0bdc033b20 con 0x7f0bec102530 2024-09-18T21:09:44.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:44.674+0000 7f0bf285c640 1 -- 172.21.15.77:0/506736615 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bec10d970 con 0x7f0bec102530 2024-09-18T21:09:44.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:44.675+0000 7f0bf285c640 1 -- 172.21.15.77:0/506736615 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bec0fdcb0 con 0x7f0bec102530 2024-09-18T21:09:44.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:44.675+0000 7f0be8ff9640 1 -- 172.21.15.77:0/506736615 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f0bdc030020 con 0x7f0bec102530 2024-09-18T21:09:44.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:44.675+0000 7f0be8ff9640 1 --2- 172.21.15.77:0/506736615 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f0bd406ed60 0x7f0bd4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:44.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:44.676+0000 7f0be8ff9640 1 -- 172.21.15.77:0/506736615 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0bdc0ae010 con 0x7f0bec102530 2024-09-18T21:09:44.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:44.676+0000 7f0beb7fe640 1 --2- 172.21.15.77:0/506736615 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f0bd406ed60 0x7f0bd4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:44.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:44.676+0000 7f0beb7fe640 1 --2- 172.21.15.77:0/506736615 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f0bd406ed60 0x7f0bd4071210 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0bec10eb10 tx=0x7f0be0006d20 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:44.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:44.680+0000 7f0be8ff9640 1 -- 172.21.15.77:0/506736615 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0bdc07b470 con 0x7f0bec102530 2024-09-18T21:09:44.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:44 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:09:44.764 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:09:44.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:44.860+0000 7f0bf285c640 1 -- 172.21.15.77:0/506736615 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0bec0fbd30 con 0x7f0bec102530 2024-09-18T21:09:44.863 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:44 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:09:44.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:44.861+0000 7f0be8ff9640 1 -- 172.21.15.77:0/506736615 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0bec0fbd30 con 0x7f0bec102530 2024-09-18T21:09:44.863 INFO:teuthology.orchestra.run.smithi077.stdout:81604378650 2024-09-18T21:09:44.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:44.863+0000 7f0bf285c640 1 -- 172.21.15.77:0/506736615 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f0bd406ed60 msgr2=0x7f0bd4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:44.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:44.863+0000 7f0bf285c640 1 --2- 172.21.15.77:0/506736615 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f0bd406ed60 0x7f0bd4071210 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0bec10eb10 tx=0x7f0be0006d20 comp rx=0 tx=0).stop 2024-09-18T21:09:44.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:44.863+0000 7f0bf285c640 1 -- 172.21.15.77:0/506736615 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bec102530 msgr2=0x7f0bec113250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:44.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:44.863+0000 7f0bf285c640 1 --2- 172.21.15.77:0/506736615 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bec102530 0x7f0bec113250 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc000c00 tx=0x7f0bdc009da0 comp rx=0 tx=0).stop 2024-09-18T21:09:44.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:44.863+0000 7f0bf285c640 1 -- 172.21.15.77:0/506736615 shutdown_connections 2024-09-18T21:09:44.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:44.863+0000 7f0bf285c640 1 --2- 172.21.15.77:0/506736615 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f0bd406ed60 0x7f0bd4071210 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:44.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:44.863+0000 7f0bf285c640 1 --2- 172.21.15.77:0/506736615 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bec102ed0 0x7f0bec113790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:44.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:44.863+0000 7f0bf285c640 1 --2- 172.21.15.77:0/506736615 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bec102530 0x7f0bec113250 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:44.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:44.863+0000 7f0bf285c640 1 -- 172.21.15.77:0/506736615 >> 172.21.15.77:0/506736615 conn(0x7f0bec0f80f0 msgr2=0x7f0bec0f9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:09:44.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:44.863+0000 7f0bf285c640 1 -- 172.21.15.77:0/506736615 shutdown_connections 2024-09-18T21:09:44.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:44.863+0000 7f0bf285c640 1 -- 172.21.15.77:0/506736615 wait complete. 2024-09-18T21:09:45.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:45 smithi077 ceph-mon[27689]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:45.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:45 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/506736615' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-18T21:09:45.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:45 smithi103 ceph-mon[34827]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:45.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:45 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/506736615' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-18T21:09:46.038 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378648 got 81604378650 for osd.2 2024-09-18T21:09:46.038 DEBUG:teuthology.parallel:result is None 2024-09-18T21:09:47.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:47.137+0000 7fad7624f640 1 -- 172.21.15.77:0/1926877732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad70102ef0 msgr2=0x7fad700fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:47.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:47.137+0000 7fad7624f640 1 --2- 172.21.15.77:0/1926877732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad70102ef0 0x7fad700fc5b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fad580048d0 tx=0x7fad58009da0 comp rx=0 tx=0).stop 2024-09-18T21:09:47.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:47.137+0000 7fad7624f640 1 -- 172.21.15.77:0/1926877732 shutdown_connections 2024-09-18T21:09:47.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:47.137+0000 7fad7624f640 1 --2- 172.21.15.77:0/1926877732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad70102ef0 0x7fad700fc5b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:47.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:47.137+0000 7fad7624f640 1 --2- 172.21.15.77:0/1926877732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad70102550 0x7fad70102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:47.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:47.137+0000 7fad7624f640 1 -- 172.21.15.77:0/1926877732 >> 172.21.15.77:0/1926877732 conn(0x7fad700f80f0 msgr2=0x7fad700fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:09:47.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:47.137+0000 7fad7624f640 1 -- 172.21.15.77:0/1926877732 shutdown_connections 2024-09-18T21:09:47.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:47.137+0000 7fad7624f640 1 -- 172.21.15.77:0/1926877732 wait complete. 2024-09-18T21:09:47.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:47.137+0000 7fad7624f640 1 Processor -- start 2024-09-18T21:09:47.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:47.138+0000 7fad7624f640 1 -- start start 2024-09-18T21:09:47.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:47.138+0000 7fad7624f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad70102550 0x7fad701135b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:47.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:47.138+0000 7fad7624f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad70102ef0 0x7fad70113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:47.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:47.138+0000 7fad7624f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad701141d0 con 0x7fad70102550 2024-09-18T21:09:47.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:47.138+0000 7fad7624f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7010d550 con 0x7fad70102ef0 2024-09-18T21:09:47.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:47.138+0000 7fad6f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad70102550 0x7fad701135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:47.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:47.138+0000 7fad6f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad70102550 0x7fad701135b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53364/0 (socket says 172.21.15.77:53364) 2024-09-18T21:09:47.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:47.138+0000 7fad6f7fe640 1 -- 172.21.15.77:0/2591231828 learned_addr learned my addr 172.21.15.77:0/2591231828 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:09:47.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:47.138+0000 7fad67fff640 1 --2- 172.21.15.77:0/2591231828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad70102ef0 0x7fad70113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:47.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:47.138+0000 7fad6f7fe640 1 -- 172.21.15.77:0/2591231828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad70102ef0 msgr2=0x7fad70113af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:47.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:47.138+0000 7fad6f7fe640 1 --2- 172.21.15.77:0/2591231828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad70102ef0 0x7fad70113af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:47.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:47.138+0000 7fad6f7fe640 1 -- 172.21.15.77:0/2591231828 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad58005040 con 0x7fad70102550 2024-09-18T21:09:47.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:47.138+0000 7fad67fff640 1 --2- 172.21.15.77:0/2591231828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad70102ef0 0x7fad70113af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T21:09:47.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:47.138+0000 7fad6f7fe640 1 --2- 172.21.15.77:0/2591231828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad70102550 0x7fad701135b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fad6000b790 tx=0x7fad600091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:47.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:47.138+0000 7fad6cff9640 1 -- 172.21.15.77:0/2591231828 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad6000c700 con 0x7fad70102550 2024-09-18T21:09:47.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:47.138+0000 7fad6cff9640 1 -- 172.21.15.77:0/2591231828 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fad6000cd00 con 0x7fad70102550 2024-09-18T21:09:47.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:47.139+0000 7fad6cff9640 1 -- 172.21.15.77:0/2591231828 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad60015e70 con 0x7fad70102550 2024-09-18T21:09:47.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:47.139+0000 7fad7624f640 1 -- 172.21.15.77:0/2591231828 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad7010d7e0 con 0x7fad70102550 2024-09-18T21:09:47.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:47.139+0000 7fad7624f640 1 -- 172.21.15.77:0/2591231828 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad7010dcb0 con 0x7fad70102550 2024-09-18T21:09:47.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:47.140+0000 7fad7624f640 1 -- 172.21.15.77:0/2591231828 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad700fdcd0 con 0x7fad70102550 2024-09-18T21:09:47.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:47.140+0000 7fad6cff9640 1 -- 172.21.15.77:0/2591231828 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fad60012070 con 0x7fad70102550 2024-09-18T21:09:47.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:47.141+0000 7fad6cff9640 1 --2- 172.21.15.77:0/2591231828 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fad5c06ed60 0x7fad5c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:47.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:47.141+0000 7fad6cff9640 1 -- 172.21.15.77:0/2591231828 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fad6008d930 con 0x7fad70102550 2024-09-18T21:09:47.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:47.141+0000 7fad67fff640 1 --2- 172.21.15.77:0/2591231828 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fad5c06ed60 0x7fad5c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:47.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:47.141+0000 7fad67fff640 1 --2- 172.21.15.77:0/2591231828 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fad5c06ed60 0x7fad5c071210 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fad7010e830 tx=0x7fad58009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:47.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:47.145+0000 7fad6cff9640 1 -- 172.21.15.77:0/2591231828 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fad6005ae10 con 0x7fad70102550 2024-09-18T21:09:47.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:47.303+0000 7fad7624f640 1 -- 172.21.15.77:0/2591231828 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fad7010ec20 con 0x7fad70102550 2024-09-18T21:09:47.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:47.303+0000 7fad6cff9640 1 -- 172.21.15.77:0/2591231828 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fad6005a7b0 con 0x7fad70102550 2024-09-18T21:09:47.305 INFO:teuthology.orchestra.run.smithi077.stdout:137438953489 2024-09-18T21:09:47.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:47.305+0000 7fad7624f640 1 -- 172.21.15.77:0/2591231828 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fad5c06ed60 msgr2=0x7fad5c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:47.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:47.305+0000 7fad7624f640 1 --2- 172.21.15.77:0/2591231828 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fad5c06ed60 0x7fad5c071210 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fad7010e830 tx=0x7fad58009da0 comp rx=0 tx=0).stop 2024-09-18T21:09:47.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:47.305+0000 7fad7624f640 1 -- 172.21.15.77:0/2591231828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad70102550 msgr2=0x7fad701135b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:47.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:47.305+0000 7fad7624f640 1 --2- 172.21.15.77:0/2591231828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad70102550 0x7fad701135b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fad6000b790 tx=0x7fad600091d0 comp rx=0 tx=0).stop 2024-09-18T21:09:47.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:47.305+0000 7fad7624f640 1 -- 172.21.15.77:0/2591231828 shutdown_connections 2024-09-18T21:09:47.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:47.305+0000 7fad7624f640 1 --2- 172.21.15.77:0/2591231828 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fad5c06ed60 0x7fad5c071210 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:47.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:47.305+0000 7fad7624f640 1 --2- 172.21.15.77:0/2591231828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad70102ef0 0x7fad70113af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:47.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:47.305+0000 7fad7624f640 1 --2- 172.21.15.77:0/2591231828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad70102550 0x7fad701135b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:47.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:47.305+0000 7fad7624f640 1 -- 172.21.15.77:0/2591231828 >> 172.21.15.77:0/2591231828 conn(0x7fad700f80f0 msgr2=0x7fad700f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:09:47.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:47.305+0000 7fad7624f640 1 -- 172.21.15.77:0/2591231828 shutdown_connections 2024-09-18T21:09:47.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:47.305+0000 7fad7624f640 1 -- 172.21.15.77:0/2591231828 wait complete. 2024-09-18T21:09:47.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:47 smithi077 ceph-mon[27689]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:47.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:47 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/2591231828' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-18T21:09:47.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:47 smithi103 ceph-mon[34827]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:47.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:47 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/2591231828' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-18T21:09:48.021 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953488 got 137438953489 for osd.4 2024-09-18T21:09:48.021 DEBUG:teuthology.parallel:result is None 2024-09-18T21:09:48.021 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-18T21:09:48.021 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-18T21:09:48.269 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:09:49.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:49 smithi077 ceph-mon[27689]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:49.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:49 smithi103 ceph-mon[34827]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:49.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:49.933+0000 7f13c8b36640 1 -- 172.21.15.77:0/1984608147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13c4102530 msgr2=0x7f13c4102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:49.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:49.933+0000 7f13c8b36640 1 --2- 172.21.15.77:0/1984608147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13c4102530 0x7f13c4102900 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f13b4009c50 tx=0x7f13b4004d10 comp rx=0 tx=0).stop 2024-09-18T21:09:49.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:49.933+0000 7f13c8b36640 1 -- 172.21.15.77:0/1984608147 shutdown_connections 2024-09-18T21:09:49.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:49.933+0000 7f13c8b36640 1 --2- 172.21.15.77:0/1984608147 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13c4102ed0 0x7f13c40fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:49.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:49.933+0000 7f13c8b36640 1 --2- 172.21.15.77:0/1984608147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13c4102530 0x7f13c4102900 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:49.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:49.933+0000 7f13c8b36640 1 -- 172.21.15.77:0/1984608147 >> 172.21.15.77:0/1984608147 conn(0x7f13c40f80f0 msgr2=0x7f13c40fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:09:49.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:49.933+0000 7f13c8b36640 1 -- 172.21.15.77:0/1984608147 shutdown_connections 2024-09-18T21:09:49.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:49.933+0000 7f13c8b36640 1 -- 172.21.15.77:0/1984608147 wait complete. 2024-09-18T21:09:49.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:49.933+0000 7f13c8b36640 1 Processor -- start 2024-09-18T21:09:49.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:49.933+0000 7f13c8b36640 1 -- start start 2024-09-18T21:09:49.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:49.934+0000 7f13c8b36640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13c4102530 0x7f13c4113240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:49.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:49.934+0000 7f13c8b36640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13c4102ed0 0x7f13c4113780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:49.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:49.934+0000 7f13c8b36640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c4113d80 con 0x7f13c4102ed0 2024-09-18T21:09:49.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:49.934+0000 7f13c8b36640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c410d1c0 con 0x7f13c4102530 2024-09-18T21:09:49.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:49.934+0000 7f13c1d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13c4102ed0 0x7f13c4113780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:49.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:49.934+0000 7f13c1d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13c4102ed0 0x7f13c4113780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49980/0 (socket says 172.21.15.77:49980) 2024-09-18T21:09:49.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:49.934+0000 7f13c1d9b640 1 -- 172.21.15.77:0/1645720570 learned_addr learned my addr 172.21.15.77:0/1645720570 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:09:49.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:49.934+0000 7f13c259c640 1 --2- 172.21.15.77:0/1645720570 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13c4102530 0x7f13c4113240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:49.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:49.934+0000 7f13c1d9b640 1 -- 172.21.15.77:0/1645720570 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13c4102530 msgr2=0x7f13c4113240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:49.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:49.934+0000 7f13c1d9b640 1 --2- 172.21.15.77:0/1645720570 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13c4102530 0x7f13c4113240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:49.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:49.934+0000 7f13c1d9b640 1 -- 172.21.15.77:0/1645720570 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b40098b0 con 0x7f13c4102ed0 2024-09-18T21:09:49.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:49.934+0000 7f13c1d9b640 1 --2- 172.21.15.77:0/1645720570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13c4102ed0 0x7f13c4113780 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f13b800c790 tx=0x7f13b80043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:49.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:49.934+0000 7f13b2ffd640 1 -- 172.21.15.77:0/1645720570 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13b800a820 con 0x7f13c4102ed0 2024-09-18T21:09:49.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:49.935+0000 7f13c8b36640 1 -- 172.21.15.77:0/1645720570 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13c410d4a0 con 0x7f13c4102ed0 2024-09-18T21:09:49.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:49.935+0000 7f13b2ffd640 1 -- 172.21.15.77:0/1645720570 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f13b800ae20 con 0x7f13c4102ed0 2024-09-18T21:09:49.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:49.935+0000 7f13b2ffd640 1 -- 172.21.15.77:0/1645720570 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13b8011380 con 0x7f13c4102ed0 2024-09-18T21:09:49.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:49.935+0000 7f13c8b36640 1 -- 172.21.15.77:0/1645720570 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13c410da40 con 0x7f13c4102ed0 2024-09-18T21:09:49.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:49.936+0000 7f13c8b36640 1 -- 172.21.15.77:0/1645720570 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13c40fdcb0 con 0x7f13c4102ed0 2024-09-18T21:09:49.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:49.936+0000 7f13b2ffd640 1 -- 172.21.15.77:0/1645720570 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f13b8012420 con 0x7f13c4102ed0 2024-09-18T21:09:49.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:49.937+0000 7f13b2ffd640 1 --2- 172.21.15.77:0/1645720570 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f13ac06ed60 0x7f13ac071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:49.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:49.937+0000 7f13b2ffd640 1 -- 172.21.15.77:0/1645720570 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f13b808e360 con 0x7f13c4102ed0 2024-09-18T21:09:49.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:49.937+0000 7f13c259c640 1 --2- 172.21.15.77:0/1645720570 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f13ac06ed60 0x7f13ac071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:49.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:49.937+0000 7f13c259c640 1 --2- 172.21.15.77:0/1645720570 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f13ac06ed60 0x7f13ac071210 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f13b4004a30 tx=0x7f13b4004d10 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:49.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:49.941+0000 7f13b2ffd640 1 -- 172.21.15.77:0/1645720570 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f13b805b7c0 con 0x7f13c4102ed0 2024-09-18T21:09:50.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:50.096+0000 7f13c8b36640 1 -- 172.21.15.77:0/1645720570 --> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f13c41095a0 con 0x7f13ac06ed60 2024-09-18T21:09:50.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:50.097+0000 7f13b2ffd640 1 -- 172.21.15.77:0/1645720570 <== mgr.14206 v2:172.21.15.77:6800/950747822 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28083 (secure 0 0 0) 0x7f13c41095a0 con 0x7f13ac06ed60 2024-09-18T21:09:50.098 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:09:50.099 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-18T21:09:50.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:50.099+0000 7f13c8b36640 1 -- 172.21.15.77:0/1645720570 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f13ac06ed60 msgr2=0x7f13ac071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:50.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:50.099+0000 7f13c8b36640 1 --2- 172.21.15.77:0/1645720570 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f13ac06ed60 0x7f13ac071210 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f13b4004a30 tx=0x7f13b4004d10 comp rx=0 tx=0).stop 2024-09-18T21:09:50.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:50.099+0000 7f13c8b36640 1 -- 172.21.15.77:0/1645720570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13c4102ed0 msgr2=0x7f13c4113780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:50.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:50.099+0000 7f13c8b36640 1 --2- 172.21.15.77:0/1645720570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13c4102ed0 0x7f13c4113780 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f13b800c790 tx=0x7f13b80043c0 comp rx=0 tx=0).stop 2024-09-18T21:09:50.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:50.099+0000 7f13c8b36640 1 -- 172.21.15.77:0/1645720570 shutdown_connections 2024-09-18T21:09:50.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:50.099+0000 7f13c8b36640 1 --2- 172.21.15.77:0/1645720570 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f13ac06ed60 0x7f13ac071210 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:50.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:50.099+0000 7f13c8b36640 1 --2- 172.21.15.77:0/1645720570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13c4102ed0 0x7f13c4113780 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:50.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:50.099+0000 7f13c8b36640 1 --2- 172.21.15.77:0/1645720570 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13c4102530 0x7f13c4113240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:50.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:50.099+0000 7f13c8b36640 1 -- 172.21.15.77:0/1645720570 >> 172.21.15.77:0/1645720570 conn(0x7f13c40f80f0 msgr2=0x7f13c40f90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:09:50.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:50.099+0000 7f13c8b36640 1 -- 172.21.15.77:0/1645720570 shutdown_connections 2024-09-18T21:09:50.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:50.099+0000 7f13c8b36640 1 -- 172.21.15.77:0/1645720570 wait complete. 2024-09-18T21:09:50.808 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2024-09-18T21:09:50.029573+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787920,"kb_used_data":3780,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682992,"statfs":{"total":575970213888,"available":574139383808,"internally_reserved":0,"allocated":3870720,"data_stored":2558100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002130"},"pg_stats":[{"pgid":"1.0","version":"23'72","reported_seq":129,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-18T21:08:59.148450+0000","last_change":"2024-09-18T21:08:35.727168+0000","last_active":"2024-09-18T21:08:59.148450+0000","last_peered":"2024-09-18T21:08:59.148450+0000","last_clean":"2024-09-18T21:08:59.148450+0000","last_became_active":"2024-09-18T21:08:35.726940+0000","last_became_peered":"2024-09-18T21:08:35.726940+0000","last_unstale":"2024-09-18T21:08:59.148450+0000","last_undegraded":"2024-09-18T21:08:59.148450+0000","last_fullsized":"2024-09-18T21:08:59.148450+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T21:07:50.289007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T21:07:50.289007+0000","last_clean_scrub_stamp":"2024-09-18T21:07:50.289007+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:00:09.133872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":37,"seq":158913789964,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297696,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447456,"statfs":{"total":95995035648,"available":95690194944,"internally_reserved":0,"allocated":348160,"data_stored":131166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]}]},{"osd":4,"up_from":32,"seq":137438953489,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297696,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447456,"statfs":{"total":95995035648,"available":95690194944,"internally_reserved":0,"allocated":348160,"data_stored":131166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 21:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.439},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.36099999999999999}]},{"osd":1,"last update":"Wed Sep 18 21:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.37}]},{"osd":2,"last update":"Wed Sep 18 21:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.39500000000000002}]},{"osd":3,"last update":"Wed Sep 18 21:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.29099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]}]},{"osd":3,"up_from":26,"seq":111669149718,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298276,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446876,"statfs":{"total":95995035648,"available":95689601024,"internally_reserved":0,"allocated":942080,"data_stored":721534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 21:09:13 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.5}]},{"osd":1,"last update":"Wed Sep 18 21:09:13 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.51800000000000002}]},{"osd":2,"last update":"Wed Sep 18 21:09:13 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.46600000000000003}]},{"osd":4,"last update":"Wed Sep 18 21:09:38 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.37},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.40600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]}]},{"osd":2,"up_from":19,"seq":81604378651,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297696,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447456,"statfs":{"total":95995035648,"available":95690194944,"internally_reserved":0,"allocated":348160,"data_stored":131166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 21:08:50 2024","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.503,"5min":0.503,"15min":0.503},"last":0.255}]},{"osd":1,"last update":"Wed Sep 18 21:08:50 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.27100000000000002}]},{"osd":3,"last update":"Wed Sep 18 21:09:13 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.47499999999999998}]},{"osd":4,"last update":"Wed Sep 18 21:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.45500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542177,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298276,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446876,"statfs":{"total":95995035648,"available":95689601024,"internally_reserved":0,"allocated":942080,"data_stored":721534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 21:09:29 2024","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.30599999999999999,"15min":0.30099999999999999},"min":{"1min":0.23699999999999999,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.29399999999999998,"15min":0.28999999999999998},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"last":0.47599999999999998}]},{"osd":2,"last update":"Wed Sep 18 21:08:50 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.46000000000000002}]},{"osd":3,"last update":"Wed Sep 18 21:09:12 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.59599999999999997}]},{"osd":4,"last update":"Wed Sep 18 21:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]}]},{"osd":0,"up_from":9,"seq":38654705702,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298280,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446872,"statfs":{"total":95995035648,"available":95689596928,"internally_reserved":0,"allocated":942080,"data_stored":721534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 18 21:09:31 2024","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.317,"15min":0.313},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"last":0.247},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.32300000000000001,"15min":0.32000000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.45400000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.27300000000000002}]},{"osd":2,"last update":"Wed Sep 18 21:08:50 2024","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.23100000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.28599999999999998}]},{"osd":3,"last update":"Wed Sep 18 21:09:12 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.58799999999999997}]},{"osd":4,"last update":"Wed Sep 18 21:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.55700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T21:09:50.809 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-18T21:09:51.054 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:09:51.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:51 smithi077 ceph-mon[27689]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:51.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:51 smithi077 ceph-mon[27689]: from='client.14402 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-18T21:09:51.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:51 smithi103 ceph-mon[34827]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:51.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:51 smithi103 ceph-mon[34827]: from='client.14402 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-18T21:09:52.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:52.702+0000 7fc8285cc640 1 -- 172.21.15.77:0/3057708283 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8200fac80 msgr2=0x7fc8200fb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:52.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:52.702+0000 7fc8285cc640 1 --2- 172.21.15.77:0/3057708283 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8200fac80 0x7fc8200fb0d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc814009c50 tx=0x7fc814004d10 comp rx=0 tx=0).stop 2024-09-18T21:09:52.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:52.702+0000 7fc8285cc640 1 -- 172.21.15.77:0/3057708283 shutdown_connections 2024-09-18T21:09:52.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:52.702+0000 7fc8285cc640 1 --2- 172.21.15.77:0/3057708283 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8200fac80 0x7fc8200fb0d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:52.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:52.702+0000 7fc8285cc640 1 --2- 172.21.15.77:0/3057708283 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc820100c70 0x7fc820101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:52.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:52.702+0000 7fc8285cc640 1 -- 172.21.15.77:0/3057708283 >> 172.21.15.77:0/3057708283 conn(0x7fc820070ce0 msgr2=0x7fc8200710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:09:52.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:52.702+0000 7fc8285cc640 1 -- 172.21.15.77:0/3057708283 shutdown_connections 2024-09-18T21:09:52.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:52.702+0000 7fc8285cc640 1 -- 172.21.15.77:0/3057708283 wait complete. 2024-09-18T21:09:52.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:52.702+0000 7fc8285cc640 1 Processor -- start 2024-09-18T21:09:52.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:52.702+0000 7fc8285cc640 1 -- start start 2024-09-18T21:09:52.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:52.703+0000 7fc8285cc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8200fac80 0x7fc820113220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:52.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:52.703+0000 7fc8285cc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc820100c70 0x7fc820113760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:52.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:52.703+0000 7fc8285cc640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc820113df0 con 0x7fc8200fac80 2024-09-18T21:09:52.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:52.703+0000 7fc8285cc640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82010d1a0 con 0x7fc820100c70 2024-09-18T21:09:52.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:52.703+0000 7fc826368640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8200fac80 0x7fc820113220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:52.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:52.703+0000 7fc826368640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8200fac80 0x7fc820113220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49992/0 (socket says 172.21.15.77:49992) 2024-09-18T21:09:52.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:52.703+0000 7fc826368640 1 -- 172.21.15.77:0/2764612411 learned_addr learned my addr 172.21.15.77:0/2764612411 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:09:52.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:52.703+0000 7fc825b67640 1 --2- 172.21.15.77:0/2764612411 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc820100c70 0x7fc820113760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:52.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:52.703+0000 7fc826368640 1 -- 172.21.15.77:0/2764612411 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc820100c70 msgr2=0x7fc820113760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:52.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:52.703+0000 7fc826368640 1 --2- 172.21.15.77:0/2764612411 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc820100c70 0x7fc820113760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:52.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:52.703+0000 7fc826368640 1 -- 172.21.15.77:0/2764612411 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8140098b0 con 0x7fc8200fac80 2024-09-18T21:09:52.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:52.703+0000 7fc825b67640 1 --2- 172.21.15.77:0/2764612411 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc820100c70 0x7fc820113760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T21:09:52.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:52.703+0000 7fc826368640 1 --2- 172.21.15.77:0/2764612411 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8200fac80 0x7fc820113220 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc81800b790 tx=0x7fc8180091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:52.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:52.703+0000 7fc81effd640 1 -- 172.21.15.77:0/2764612411 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc81800c700 con 0x7fc8200fac80 2024-09-18T21:09:52.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:52.704+0000 7fc81effd640 1 -- 172.21.15.77:0/2764612411 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc81800cd00 con 0x7fc8200fac80 2024-09-18T21:09:52.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:52.704+0000 7fc8285cc640 1 -- 172.21.15.77:0/2764612411 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc82010d480 con 0x7fc8200fac80 2024-09-18T21:09:52.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:52.704+0000 7fc81effd640 1 -- 172.21.15.77:0/2764612411 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc818015e70 con 0x7fc8200fac80 2024-09-18T21:09:52.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:52.704+0000 7fc8285cc640 1 -- 172.21.15.77:0/2764612411 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc82010d9a0 con 0x7fc8200fac80 2024-09-18T21:09:52.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:52.704+0000 7fc8285cc640 1 -- 172.21.15.77:0/2764612411 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8200fc370 con 0x7fc8200fac80 2024-09-18T21:09:52.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:52.705+0000 7fc81effd640 1 -- 172.21.15.77:0/2764612411 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fc818012070 con 0x7fc8200fac80 2024-09-18T21:09:52.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:52.705+0000 7fc81effd640 1 --2- 172.21.15.77:0/2764612411 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fc80806ed40 0x7fc8080711f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:52.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:52.705+0000 7fc81effd640 1 -- 172.21.15.77:0/2764612411 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc81808d9c0 con 0x7fc8200fac80 2024-09-18T21:09:52.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:52.705+0000 7fc825b67640 1 --2- 172.21.15.77:0/2764612411 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fc80806ed40 0x7fc8080711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:52.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:52.706+0000 7fc825b67640 1 --2- 172.21.15.77:0/2764612411 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fc80806ed40 0x7fc8080711f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc814000f80 tx=0x7fc814004d10 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:52.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:52.710+0000 7fc81effd640 1 -- 172.21.15.77:0/2764612411 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fc81805ae20 con 0x7fc8200fac80 2024-09-18T21:09:52.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:52.859+0000 7fc8285cc640 1 -- 172.21.15.77:0/2764612411 --> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc82004b7b0 con 0x7fc80806ed40 2024-09-18T21:09:52.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:52.861+0000 7fc81effd640 1 -- 172.21.15.77:0/2764612411 <== mgr.14206 v2:172.21.15.77:6800/950747822 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28116 (secure 0 0 0) 0x7fc82004b7b0 con 0x7fc80806ed40 2024-09-18T21:09:52.862 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:09:52.863 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-18T21:09:52.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:52.864+0000 7fc8285cc640 1 -- 172.21.15.77:0/2764612411 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fc80806ed40 msgr2=0x7fc8080711f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:52.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:52.864+0000 7fc8285cc640 1 --2- 172.21.15.77:0/2764612411 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fc80806ed40 0x7fc8080711f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc814000f80 tx=0x7fc814004d10 comp rx=0 tx=0).stop 2024-09-18T21:09:52.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:52.864+0000 7fc8285cc640 1 -- 172.21.15.77:0/2764612411 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8200fac80 msgr2=0x7fc820113220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:52.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:52.864+0000 7fc8285cc640 1 --2- 172.21.15.77:0/2764612411 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8200fac80 0x7fc820113220 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc81800b790 tx=0x7fc8180091d0 comp rx=0 tx=0).stop 2024-09-18T21:09:52.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:52.864+0000 7fc8285cc640 1 -- 172.21.15.77:0/2764612411 shutdown_connections 2024-09-18T21:09:52.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:52.864+0000 7fc8285cc640 1 --2- 172.21.15.77:0/2764612411 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fc80806ed40 0x7fc8080711f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:52.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:52.864+0000 7fc8285cc640 1 --2- 172.21.15.77:0/2764612411 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc820100c70 0x7fc820113760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:52.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:52.864+0000 7fc8285cc640 1 --2- 172.21.15.77:0/2764612411 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8200fac80 0x7fc820113220 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:52.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:52.864+0000 7fc8285cc640 1 -- 172.21.15.77:0/2764612411 >> 172.21.15.77:0/2764612411 conn(0x7fc820070ce0 msgr2=0x7fc8201039c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:09:52.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:52.864+0000 7fc8285cc640 1 -- 172.21.15.77:0/2764612411 shutdown_connections 2024-09-18T21:09:52.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:52.864+0000 7fc8285cc640 1 -- 172.21.15.77:0/2764612411 wait complete. 2024-09-18T21:09:53.538 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2024-09-18T21:09:52.029964+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787920,"kb_used_data":3780,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682992,"statfs":{"total":575970213888,"available":574139383808,"internally_reserved":0,"allocated":3870720,"data_stored":2558100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002036"},"pg_stats":[{"pgid":"1.0","version":"23'72","reported_seq":129,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-18T21:08:59.148450+0000","last_change":"2024-09-18T21:08:35.727168+0000","last_active":"2024-09-18T21:08:59.148450+0000","last_peered":"2024-09-18T21:08:59.148450+0000","last_clean":"2024-09-18T21:08:59.148450+0000","last_became_active":"2024-09-18T21:08:35.726940+0000","last_became_peered":"2024-09-18T21:08:35.726940+0000","last_unstale":"2024-09-18T21:08:59.148450+0000","last_undegraded":"2024-09-18T21:08:59.148450+0000","last_fullsized":"2024-09-18T21:08:59.148450+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-18T21:07:50.289007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-18T21:07:50.289007+0000","last_clean_scrub_stamp":"2024-09-18T21:07:50.289007+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:00:09.133872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":37,"seq":158913789965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297696,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447456,"statfs":{"total":95995035648,"available":95690194944,"internally_reserved":0,"allocated":348160,"data_stored":131166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]}]},{"osd":4,"up_from":32,"seq":137438953490,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297696,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447456,"statfs":{"total":95995035648,"available":95690194944,"internally_reserved":0,"allocated":348160,"data_stored":131166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 21:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.45700000000000002}]},{"osd":1,"last update":"Wed Sep 18 21:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.34999999999999998}]},{"osd":2,"last update":"Wed Sep 18 21:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.432}]},{"osd":3,"last update":"Wed Sep 18 21:09:40 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.27200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]}]},{"osd":3,"up_from":26,"seq":111669149719,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298276,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446876,"statfs":{"total":95995035648,"available":95689601024,"internally_reserved":0,"allocated":942080,"data_stored":721534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 21:09:13 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.52300000000000002}]},{"osd":1,"last update":"Wed Sep 18 21:09:13 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.434},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.47799999999999998}]},{"osd":2,"last update":"Wed Sep 18 21:09:13 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.504}]},{"osd":4,"last update":"Wed Sep 18 21:09:38 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.55400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297696,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447456,"statfs":{"total":95995035648,"available":95690194944,"internally_reserved":0,"allocated":348160,"data_stored":131166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 21:08:50 2024","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.503,"5min":0.503,"15min":0.503},"last":0.34599999999999997}]},{"osd":1,"last update":"Wed Sep 18 21:08:50 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.39100000000000001}]},{"osd":3,"last update":"Wed Sep 18 21:09:13 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.64100000000000001}]},{"osd":4,"last update":"Wed Sep 18 21:09:37 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]}]},{"osd":1,"up_from":14,"seq":60129542177,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298276,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446876,"statfs":{"total":95995035648,"available":95689601024,"internally_reserved":0,"allocated":942080,"data_stored":721534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 18 21:09:29 2024","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.30599999999999999,"15min":0.30099999999999999},"min":{"1min":0.23699999999999999,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.29399999999999998,"15min":0.28999999999999998},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"last":0.47599999999999998}]},{"osd":2,"last update":"Wed Sep 18 21:08:50 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.46000000000000002}]},{"osd":3,"last update":"Wed Sep 18 21:09:12 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.59599999999999997}]},{"osd":4,"last update":"Wed Sep 18 21:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]}]},{"osd":0,"up_from":9,"seq":38654705703,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298280,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446872,"statfs":{"total":95995035648,"available":95689596928,"internally_reserved":0,"allocated":942080,"data_stored":721534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 18 21:09:31 2024","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.317,"15min":0.313},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.32300000000000001,"15min":0.32000000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.45400000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"last":0.34599999999999997}]},{"osd":2,"last update":"Wed Sep 18 21:08:50 2024","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.378}]},{"osd":3,"last update":"Wed Sep 18 21:09:12 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.56599999999999995}]},{"osd":4,"last update":"Wed Sep 18 21:09:36 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.58999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-18T21:09:53.539 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-18T21:09:53.539 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-18T21:09:53.539 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-18T21:09:53.539 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-18T21:09:53.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:53 smithi103 ceph-mon[34827]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:53.783 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:09:53.903 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:53 smithi077 ceph-mon[27689]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:54.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:54 smithi077 ceph-mon[27689]: from='client.14406 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-18T21:09:55.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:54 smithi103 ceph-mon[34827]: from='client.14406 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-18T21:09:55.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:55.500+0000 7f7bc7027640 1 -- 172.21.15.77:0/2026434153 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bc00fd580 msgr2=0x7f7bc00fd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:55.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:55.500+0000 7f7bc7027640 1 --2- 172.21.15.77:0/2026434153 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bc00fd580 0x7f7bc00fd950 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4004900 tx=0x7f7bb4009da0 comp rx=0 tx=0).stop 2024-09-18T21:09:55.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:55.500+0000 7f7bc7027640 1 -- 172.21.15.77:0/2026434153 shutdown_connections 2024-09-18T21:09:55.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:55.500+0000 7f7bc7027640 1 --2- 172.21.15.77:0/2026434153 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bc00fdf20 0x7f7bc01065f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:55.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:55.500+0000 7f7bc7027640 1 --2- 172.21.15.77:0/2026434153 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bc00fd580 0x7f7bc00fd950 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:55.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:55.500+0000 7f7bc7027640 1 -- 172.21.15.77:0/2026434153 >> 172.21.15.77:0/2026434153 conn(0x7f7bc00f7060 msgr2=0x7f7bc00f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:09:55.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:55.500+0000 7f7bc7027640 1 -- 172.21.15.77:0/2026434153 shutdown_connections 2024-09-18T21:09:55.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:55.500+0000 7f7bc7027640 1 -- 172.21.15.77:0/2026434153 wait complete. 2024-09-18T21:09:55.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:55.501+0000 7f7bc7027640 1 Processor -- start 2024-09-18T21:09:55.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:55.501+0000 7f7bc7027640 1 -- start start 2024-09-18T21:09:55.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:55.501+0000 7f7bc7027640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bc00fd580 0x7f7bc0115410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:55.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:55.501+0000 7f7bc7027640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bc00fdf20 0x7f7bc0115950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:55.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:55.501+0000 7f7bc7027640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc0115f50 con 0x7f7bc00fd580 2024-09-18T21:09:55.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:55.501+0000 7f7bc7027640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc01160c0 con 0x7f7bc00fdf20 2024-09-18T21:09:55.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:55.501+0000 7f7bc4dc3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bc00fd580 0x7f7bc0115410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:55.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:55.501+0000 7f7bc4dc3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bc00fd580 0x7f7bc0115410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50022/0 (socket says 172.21.15.77:50022) 2024-09-18T21:09:55.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:55.501+0000 7f7bc4dc3640 1 -- 172.21.15.77:0/1135011764 learned_addr learned my addr 172.21.15.77:0/1135011764 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:09:55.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:55.502+0000 7f7bbffff640 1 --2- 172.21.15.77:0/1135011764 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bc00fdf20 0x7f7bc0115950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:55.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:55.502+0000 7f7bc4dc3640 1 -- 172.21.15.77:0/1135011764 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bc00fdf20 msgr2=0x7f7bc0115950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:55.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:55.502+0000 7f7bc4dc3640 1 --2- 172.21.15.77:0/1135011764 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bc00fdf20 0x7f7bc0115950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:55.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:55.502+0000 7f7bc4dc3640 1 -- 172.21.15.77:0/1135011764 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb4005040 con 0x7f7bc00fd580 2024-09-18T21:09:55.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:55.502+0000 7f7bbffff640 1 --2- 172.21.15.77:0/1135011764 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bc00fdf20 0x7f7bc0115950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T21:09:55.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:55.502+0000 7f7bc4dc3640 1 --2- 172.21.15.77:0/1135011764 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bc00fd580 0x7f7bc0115410 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4004960 tx=0x7f7bb4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:55.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:55.502+0000 7f7bbd7fa640 1 -- 172.21.15.77:0/1135011764 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bb4038070 con 0x7f7bc00fd580 2024-09-18T21:09:55.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:55.502+0000 7f7bbd7fa640 1 -- 172.21.15.77:0/1135011764 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7bb4008ed0 con 0x7f7bc00fd580 2024-09-18T21:09:55.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:55.502+0000 7f7bc7027640 1 -- 172.21.15.77:0/1135011764 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc010f4e0 con 0x7f7bc00fd580 2024-09-18T21:09:55.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:55.502+0000 7f7bc7027640 1 -- 172.21.15.77:0/1135011764 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc010f9a0 con 0x7f7bc00fd580 2024-09-18T21:09:55.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:55.502+0000 7f7bbd7fa640 1 -- 172.21.15.77:0/1135011764 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bb40095a0 con 0x7f7bc00fd580 2024-09-18T21:09:55.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:55.503+0000 7f7bc7027640 1 -- 172.21.15.77:0/1135011764 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ba4005210 con 0x7f7bc00fd580 2024-09-18T21:09:55.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:55.504+0000 7f7bbd7fa640 1 -- 172.21.15.77:0/1135011764 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f7bb4030020 con 0x7f7bc00fd580 2024-09-18T21:09:55.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:55.504+0000 7f7bbd7fa640 1 --2- 172.21.15.77:0/1135011764 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f7bb006ed60 0x7f7bb0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:55.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:55.505+0000 7f7bbd7fa640 1 -- 172.21.15.77:0/1135011764 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7bb40adb60 con 0x7f7bc00fd580 2024-09-18T21:09:55.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:55.505+0000 7f7bbffff640 1 --2- 172.21.15.77:0/1135011764 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f7bb006ed60 0x7f7bb0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:55.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:55.505+0000 7f7bbffff640 1 --2- 172.21.15.77:0/1135011764 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f7bb006ed60 0x7f7bb0071210 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0110d10 tx=0x7f7bac009040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:55.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:55.509+0000 7f7bbd7fa640 1 -- 172.21.15.77:0/1135011764 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f7bb407b040 con 0x7f7bc00fd580 2024-09-18T21:09:55.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:55.695+0000 7f7bc7027640 1 -- 172.21.15.77:0/1135011764 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f7ba4005a40 con 0x7f7bc00fd580 2024-09-18T21:09:55.697 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:55 smithi077 ceph-mon[27689]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:55.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:55.695+0000 7f7bbd7fa640 1 -- 172.21.15.77:0/1135011764 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f7bb407a9e0 con 0x7f7bc00fd580 2024-09-18T21:09:55.698 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:09:55.698 INFO:teuthology.orchestra.run.smithi077.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-18T21:09:55.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:55.697+0000 7f7bc7027640 1 -- 172.21.15.77:0/1135011764 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f7bb006ed60 msgr2=0x7f7bb0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:55.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:55.697+0000 7f7bc7027640 1 --2- 172.21.15.77:0/1135011764 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f7bb006ed60 0x7f7bb0071210 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0110d10 tx=0x7f7bac009040 comp rx=0 tx=0).stop 2024-09-18T21:09:55.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:55.697+0000 7f7bc7027640 1 -- 172.21.15.77:0/1135011764 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bc00fd580 msgr2=0x7f7bc0115410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:55.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:55.697+0000 7f7bc7027640 1 --2- 172.21.15.77:0/1135011764 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bc00fd580 0x7f7bc0115410 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4004960 tx=0x7f7bb4009da0 comp rx=0 tx=0).stop 2024-09-18T21:09:55.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:55.697+0000 7f7bc7027640 1 -- 172.21.15.77:0/1135011764 shutdown_connections 2024-09-18T21:09:55.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:55.697+0000 7f7bc7027640 1 --2- 172.21.15.77:0/1135011764 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f7bb006ed60 0x7f7bb0071210 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:55.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:55.697+0000 7f7bc7027640 1 --2- 172.21.15.77:0/1135011764 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bc00fdf20 0x7f7bc0115950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:55.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:55.697+0000 7f7bc7027640 1 --2- 172.21.15.77:0/1135011764 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bc00fd580 0x7f7bc0115410 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:55.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:55.697+0000 7f7bc7027640 1 -- 172.21.15.77:0/1135011764 >> 172.21.15.77:0/1135011764 conn(0x7f7bc00f7060 msgr2=0x7f7bc00f8660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:09:55.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:55.697+0000 7f7bc7027640 1 -- 172.21.15.77:0/1135011764 shutdown_connections 2024-09-18T21:09:55.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:55.697+0000 7f7bc7027640 1 -- 172.21.15.77:0/1135011764 wait complete. 2024-09-18T21:09:55.915 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:55 smithi103 ceph-mon[34827]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:56.441 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-18T21:09:56.442 INFO:tasks.cephadm:Setup complete, yielding 2024-09-18T21:09:56.442 INFO:teuthology.run_tasks:Running task print... 2024-09-18T21:09:57.181 INFO:teuthology.task.print:**** done end installing quincy cephadm ... 2024-09-18T21:09:57.182 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-18T21:09:57.752 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi077.front.sepia.ceph.com 2024-09-18T21:09:57.753 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-09-18T21:09:57.754 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:56 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/1135011764' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-18T21:09:57.754 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:56 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/1135011764' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-18T21:09:57.782 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:57 smithi077 ceph-mon[27689]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:58.009 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:09:58.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:57 smithi103 ceph-mon[34827]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:59.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:59.696+0000 7f4351a3a640 1 -- 172.21.15.77:0/1964925372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f434c0fb430 msgr2=0x7f434c0fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:59.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:59.696+0000 7f4351a3a640 1 --2- 172.21.15.77:0/1964925372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f434c0fb430 0x7f434c0fb840 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f433c009c50 tx=0x7f433c004d10 comp rx=0 tx=0).stop 2024-09-18T21:09:59.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:59.697+0000 7f4351a3a640 1 -- 172.21.15.77:0/1964925372 shutdown_connections 2024-09-18T21:09:59.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:59.697+0000 7f4351a3a640 1 --2- 172.21.15.77:0/1964925372 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f434c0fc700 0x7f434c0fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:59.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:59.697+0000 7f4351a3a640 1 --2- 172.21.15.77:0/1964925372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f434c0fb430 0x7f434c0fb840 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:59.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:59.697+0000 7f4351a3a640 1 -- 172.21.15.77:0/1964925372 >> 172.21.15.77:0/1964925372 conn(0x7f434c0f6c10 msgr2=0x7f434c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:09:59.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:59.697+0000 7f4351a3a640 1 -- 172.21.15.77:0/1964925372 shutdown_connections 2024-09-18T21:09:59.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:59.697+0000 7f4351a3a640 1 -- 172.21.15.77:0/1964925372 wait complete. 2024-09-18T21:09:59.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:59.697+0000 7f4351a3a640 1 Processor -- start 2024-09-18T21:09:59.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:59.697+0000 7f4351a3a640 1 -- start start 2024-09-18T21:09:59.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:59.698+0000 7f4351a3a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f434c0fb430 0x7f434c113720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:59.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:59.698+0000 7f4351a3a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f434c0fc700 0x7f434c113c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:59.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:59.698+0000 7f4351a3a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f434c114ad0 con 0x7f434c0fb430 2024-09-18T21:09:59.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:59.698+0000 7f4351a3a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f434c114c40 con 0x7f434c0fc700 2024-09-18T21:09:59.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:59.698+0000 7f434affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f434c0fb430 0x7f434c113720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:59.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:59.698+0000 7f434affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f434c0fb430 0x7f434c113720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49158/0 (socket says 172.21.15.77:49158) 2024-09-18T21:09:59.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:59.698+0000 7f434affd640 1 -- 172.21.15.77:0/3656687056 learned_addr learned my addr 172.21.15.77:0/3656687056 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:09:59.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:59.698+0000 7f434a7fc640 1 --2- 172.21.15.77:0/3656687056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f434c0fc700 0x7f434c113c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:59.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:59.698+0000 7f434affd640 1 -- 172.21.15.77:0/3656687056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f434c0fc700 msgr2=0x7f434c113c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:59.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:59.698+0000 7f434affd640 1 --2- 172.21.15.77:0/3656687056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f434c0fc700 0x7f434c113c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:59.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:59.698+0000 7f434affd640 1 -- 172.21.15.77:0/3656687056 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f433c0098b0 con 0x7f434c0fb430 2024-09-18T21:09:59.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:59.698+0000 7f434affd640 1 --2- 172.21.15.77:0/3656687056 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f434c0fb430 0x7f434c113720 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f433c004a30 tx=0x7f433c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:59.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:59.698+0000 7f43437fe640 1 -- 172.21.15.77:0/3656687056 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f433c032850 con 0x7f434c0fb430 2024-09-18T21:09:59.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:59.698+0000 7f43437fe640 1 -- 172.21.15.77:0/3656687056 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f433c009710 con 0x7f434c0fb430 2024-09-18T21:09:59.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:59.698+0000 7f4351a3a640 1 -- 172.21.15.77:0/3656687056 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f434c114ec0 con 0x7f434c0fb430 2024-09-18T21:09:59.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:59.698+0000 7f43437fe640 1 -- 172.21.15.77:0/3656687056 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f433c03dc20 con 0x7f434c0fb430 2024-09-18T21:09:59.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:59.698+0000 7f4351a3a640 1 -- 172.21.15.77:0/3656687056 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f434c1153e0 con 0x7f434c0fb430 2024-09-18T21:09:59.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:59.700+0000 7f4351a3a640 1 -- 172.21.15.77:0/3656687056 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f434c1046c0 con 0x7f434c0fb430 2024-09-18T21:09:59.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:59.700+0000 7f43437fe640 1 -- 172.21.15.77:0/3656687056 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f433c02f030 con 0x7f434c0fb430 2024-09-18T21:09:59.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:59.700+0000 7f43437fe640 1 --2- 172.21.15.77:0/3656687056 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f433806ed60 0x7f4338071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:09:59.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:59.701+0000 7f43437fe640 1 -- 172.21.15.77:0/3656687056 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f433c0af550 con 0x7f434c0fb430 2024-09-18T21:09:59.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:59.701+0000 7f434a7fc640 1 --2- 172.21.15.77:0/3656687056 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f433806ed60 0x7f4338071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:09:59.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:59.701+0000 7f434a7fc640 1 --2- 172.21.15.77:0/3656687056 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f433806ed60 0x7f4338071210 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4334006fd0 tx=0x7f4334008040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:09:59.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:59.705+0000 7f43437fe640 1 -- 172.21.15.77:0/3656687056 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f433c07c9b0 con 0x7f434c0fb430 2024-09-18T21:09:59.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:59.860+0000 7f4351a3a640 1 -- 172.21.15.77:0/3656687056 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f434c103eb0 con 0x7f434c0fb430 2024-09-18T21:09:59.862 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:59 smithi077 ceph-mon[27689]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:09:59.862 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:09:59 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:09:59.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:59.864+0000 7f43437fe640 1 -- 172.21.15.77:0/3656687056 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7f433c07c350 con 0x7f434c0fb430 2024-09-18T21:09:59.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:59.866+0000 7f4351a3a640 1 -- 172.21.15.77:0/3656687056 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f433806ed60 msgr2=0x7f4338071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:59.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:59.866+0000 7f4351a3a640 1 --2- 172.21.15.77:0/3656687056 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f433806ed60 0x7f4338071210 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4334006fd0 tx=0x7f4334008040 comp rx=0 tx=0).stop 2024-09-18T21:09:59.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:59.866+0000 7f4351a3a640 1 -- 172.21.15.77:0/3656687056 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f434c0fb430 msgr2=0x7f434c113720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:09:59.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:59.866+0000 7f4351a3a640 1 --2- 172.21.15.77:0/3656687056 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f434c0fb430 0x7f434c113720 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f433c004a30 tx=0x7f433c004d10 comp rx=0 tx=0).stop 2024-09-18T21:09:59.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:59.867+0000 7f4351a3a640 1 -- 172.21.15.77:0/3656687056 shutdown_connections 2024-09-18T21:09:59.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:59.867+0000 7f4351a3a640 1 --2- 172.21.15.77:0/3656687056 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f433806ed60 0x7f4338071210 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:59.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:59.867+0000 7f4351a3a640 1 --2- 172.21.15.77:0/3656687056 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f434c0fc700 0x7f434c113c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:59.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:59.867+0000 7f4351a3a640 1 --2- 172.21.15.77:0/3656687056 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f434c0fb430 0x7f434c113720 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:09:59.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:59.867+0000 7f4351a3a640 1 -- 172.21.15.77:0/3656687056 >> 172.21.15.77:0/3656687056 conn(0x7f434c0f6c10 msgr2=0x7f434c0655d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:09:59.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:59.867+0000 7f4351a3a640 1 -- 172.21.15.77:0/3656687056 shutdown_connections 2024-09-18T21:09:59.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:09:59.867+0000 7f4351a3a640 1 -- 172.21.15.77:0/3656687056 wait complete. 2024-09-18T21:10:00.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:59 smithi103 ceph-mon[34827]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:10:00.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:09:59 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:10:00.589 INFO:teuthology.run_tasks:Running task print... 2024-09-18T21:10:00.598 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-09-18T21:10:00.598 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-18T21:10:00.609 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi077.front.sepia.ceph.com 2024-09-18T21:10:00.609 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-18T21:10:00.875 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:10:01.200 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:00 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/3656687056' entity='client.admin' 2024-09-18T21:10:01.200 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:00 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:10:01.200 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:00 smithi077 ceph-mon[27689]: overall HEALTH_OK 2024-09-18T21:10:01.201 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:00 smithi077 ceph-mon[27689]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:10:01.201 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:00 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:10:01.201 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:00 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:10:01.201 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:00 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:01.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:00 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/3656687056' entity='client.admin' 2024-09-18T21:10:01.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:00 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:10:01.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:00 smithi103 ceph-mon[34827]: overall HEALTH_OK 2024-09-18T21:10:01.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:00 smithi103 ceph-mon[34827]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:10:01.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:00 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:10:01.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:00 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:10:01.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:00 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:02.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:02.492+0000 7f29b8c8b640 1 -- 172.21.15.77:0/3806594744 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29b40fe4f0 msgr2=0x7f29b40fa650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:02.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:02.492+0000 7f29b8c8b640 1 --2- 172.21.15.77:0/3806594744 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29b40fe4f0 0x7f29b40fa650 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f29a80048d0 tx=0x7f29a8009da0 comp rx=0 tx=0).stop 2024-09-18T21:10:02.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:02.492+0000 7f29b8c8b640 1 -- 172.21.15.77:0/3806594744 shutdown_connections 2024-09-18T21:10:02.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:02.492+0000 7f29b8c8b640 1 --2- 172.21.15.77:0/3806594744 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29b40fe4f0 0x7f29b40fa650 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:02.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:02.492+0000 7f29b8c8b640 1 --2- 172.21.15.77:0/3806594744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29b40fdba0 0x7f29b40fdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:02.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:02.492+0000 7f29b8c8b640 1 -- 172.21.15.77:0/3806594744 >> 172.21.15.77:0/3806594744 conn(0x7f29b40f63a0 msgr2=0x7f29b40f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:10:02.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:02.492+0000 7f29b8c8b640 1 -- 172.21.15.77:0/3806594744 shutdown_connections 2024-09-18T21:10:02.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:02.492+0000 7f29b8c8b640 1 -- 172.21.15.77:0/3806594744 wait complete. 2024-09-18T21:10:02.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:02.493+0000 7f29b8c8b640 1 Processor -- start 2024-09-18T21:10:02.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:02.493+0000 7f29b8c8b640 1 -- start start 2024-09-18T21:10:02.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:02.493+0000 7f29b8c8b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29b40fdba0 0x7f29b40fd340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:02.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:02.493+0000 7f29b8c8b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29b40fe4f0 0x7f29b40fb880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:02.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:02.493+0000 7f29b8c8b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b40fbdc0 con 0x7f29b40fdba0 2024-09-18T21:10:02.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:02.493+0000 7f29b8c8b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b40fbf00 con 0x7f29b40fe4f0 2024-09-18T21:10:02.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:02.493+0000 7f29b259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29b40fdba0 0x7f29b40fd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:02.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:02.493+0000 7f29b259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29b40fdba0 0x7f29b40fd340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49170/0 (socket says 172.21.15.77:49170) 2024-09-18T21:10:02.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:02.493+0000 7f29b259c640 1 -- 172.21.15.77:0/3161972315 learned_addr learned my addr 172.21.15.77:0/3161972315 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:10:02.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:02.493+0000 7f29b259c640 1 -- 172.21.15.77:0/3161972315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29b40fe4f0 msgr2=0x7f29b40fb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:02.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:02.493+0000 7f29b1d9b640 1 --2- 172.21.15.77:0/3161972315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29b40fe4f0 0x7f29b40fb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:02.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:02.493+0000 7f29b259c640 1 --2- 172.21.15.77:0/3161972315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29b40fe4f0 0x7f29b40fb880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:02.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:02.493+0000 7f29b259c640 1 -- 172.21.15.77:0/3161972315 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a8005040 con 0x7f29b40fdba0 2024-09-18T21:10:02.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:02.494+0000 7f29b259c640 1 --2- 172.21.15.77:0/3161972315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29b40fdba0 0x7f29b40fd340 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f29a400eb70 tx=0x7f29a400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:10:02.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:02.494+0000 7f29a2ffd640 1 -- 172.21.15.77:0/3161972315 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29a4007c30 con 0x7f29b40fdba0 2024-09-18T21:10:02.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:02.494+0000 7f29b8c8b640 1 -- 172.21.15.77:0/3161972315 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29b40fc180 con 0x7f29b40fdba0 2024-09-18T21:10:02.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:02.494+0000 7f29a2ffd640 1 -- 172.21.15.77:0/3161972315 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f29a400f040 con 0x7f29b40fdba0 2024-09-18T21:10:02.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:02.494+0000 7f29a2ffd640 1 -- 172.21.15.77:0/3161972315 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29a4009550 con 0x7f29b40fdba0 2024-09-18T21:10:02.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:02.494+0000 7f29b8c8b640 1 -- 172.21.15.77:0/3161972315 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29b4115110 con 0x7f29b40fdba0 2024-09-18T21:10:02.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:02.495+0000 7f29b8c8b640 1 -- 172.21.15.77:0/3161972315 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29b40fa040 con 0x7f29b40fdba0 2024-09-18T21:10:02.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:02.495+0000 7f29a2ffd640 1 -- 172.21.15.77:0/3161972315 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f29a400cca0 con 0x7f29b40fdba0 2024-09-18T21:10:02.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:02.496+0000 7f29a2ffd640 1 --2- 172.21.15.77:0/3161972315 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f299c06ed60 0x7f299c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:02.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:02.496+0000 7f29a2ffd640 1 -- 172.21.15.77:0/3161972315 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f29a408db20 con 0x7f29b40fdba0 2024-09-18T21:10:02.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:02.496+0000 7f29b1d9b640 1 --2- 172.21.15.77:0/3161972315 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f299c06ed60 0x7f299c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:02.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:02.496+0000 7f29b1d9b640 1 --2- 172.21.15.77:0/3161972315 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f299c06ed60 0x7f299c071210 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f29a8000c00 tx=0x7f29a8009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:10:02.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:02.500+0000 7f29a2ffd640 1 -- 172.21.15.77:0/3161972315 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f29a404e2a0 con 0x7f29b40fdba0 2024-09-18T21:10:02.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:02.677+0000 7f29b8c8b640 1 -- 172.21.15.77:0/3161972315 --> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f29b4101d80 con 0x7f299c06ed60 2024-09-18T21:10:02.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:02.678+0000 7f29a2ffd640 1 -- 172.21.15.77:0/3161972315 <== mgr.14206 v2:172.21.15.77:6800/950747822 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f29b4101d80 con 0x7f299c06ed60 2024-09-18T21:10:02.679 INFO:teuthology.orchestra.run.smithi077.stdout:Backend: cephadm 2024-09-18T21:10:02.679 INFO:teuthology.orchestra.run.smithi077.stdout:Available: Yes 2024-09-18T21:10:02.679 INFO:teuthology.orchestra.run.smithi077.stdout:Paused: No 2024-09-18T21:10:02.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:02.680+0000 7f29b8c8b640 1 -- 172.21.15.77:0/3161972315 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f299c06ed60 msgr2=0x7f299c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:02.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:02.680+0000 7f29b8c8b640 1 --2- 172.21.15.77:0/3161972315 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f299c06ed60 0x7f299c071210 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f29a8000c00 tx=0x7f29a8009da0 comp rx=0 tx=0).stop 2024-09-18T21:10:02.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:02.680+0000 7f29b8c8b640 1 -- 172.21.15.77:0/3161972315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29b40fdba0 msgr2=0x7f29b40fd340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:02.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:02.680+0000 7f29b8c8b640 1 --2- 172.21.15.77:0/3161972315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29b40fdba0 0x7f29b40fd340 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f29a400eb70 tx=0x7f29a400b040 comp rx=0 tx=0).stop 2024-09-18T21:10:02.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:02.680+0000 7f29b8c8b640 1 -- 172.21.15.77:0/3161972315 shutdown_connections 2024-09-18T21:10:02.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:02.680+0000 7f29b8c8b640 1 --2- 172.21.15.77:0/3161972315 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f299c06ed60 0x7f299c071210 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:02.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:02.680+0000 7f29b8c8b640 1 --2- 172.21.15.77:0/3161972315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f29b40fe4f0 0x7f29b40fb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:02.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:02.680+0000 7f29b8c8b640 1 --2- 172.21.15.77:0/3161972315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29b40fdba0 0x7f29b40fd340 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:02.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:02.680+0000 7f29b8c8b640 1 -- 172.21.15.77:0/3161972315 >> 172.21.15.77:0/3161972315 conn(0x7f29b40f63a0 msgr2=0x7f29b40f7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:10:02.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:02.680+0000 7f29b8c8b640 1 -- 172.21.15.77:0/3161972315 shutdown_connections 2024-09-18T21:10:02.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:02.680+0000 7f29b8c8b640 1 -- 172.21.15.77:0/3161972315 wait complete. 2024-09-18T21:10:03.303 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:03 smithi077 ceph-mon[27689]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:10:03.303 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:03 smithi077 ceph-mon[27689]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:10:03.327 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-18T21:10:03.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:03 smithi103 ceph-mon[34827]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:10:03.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:03 smithi103 ceph-mon[34827]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:10:03.581 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:10:05.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:05.048+0000 7fafe901d640 1 -- 172.21.15.77:0/3876985411 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fafe40fdba0 msgr2=0x7fafe40fdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:05.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:05.048+0000 7fafe901d640 1 --2- 172.21.15.77:0/3876985411 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fafe40fdba0 0x7fafe40fdfb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fafd40048d0 tx=0x7fafd4009da0 comp rx=0 tx=0).stop 2024-09-18T21:10:05.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:05.048+0000 7fafe901d640 1 -- 172.21.15.77:0/3876985411 shutdown_connections 2024-09-18T21:10:05.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:05.048+0000 7fafe901d640 1 --2- 172.21.15.77:0/3876985411 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fafe40fe4f0 0x7fafe40fa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:05.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:05.048+0000 7fafe901d640 1 --2- 172.21.15.77:0/3876985411 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fafe40fdba0 0x7fafe40fdfb0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:05.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:05.048+0000 7fafe901d640 1 -- 172.21.15.77:0/3876985411 >> 172.21.15.77:0/3876985411 conn(0x7fafe40f63a0 msgr2=0x7fafe40f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:10:05.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:05.048+0000 7fafe901d640 1 -- 172.21.15.77:0/3876985411 shutdown_connections 2024-09-18T21:10:05.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:05.048+0000 7fafe901d640 1 -- 172.21.15.77:0/3876985411 wait complete. 2024-09-18T21:10:05.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:05.049+0000 7fafe901d640 1 Processor -- start 2024-09-18T21:10:05.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:05.049+0000 7fafe901d640 1 -- start start 2024-09-18T21:10:05.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:05.049+0000 7fafe901d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fafe40fdba0 0x7fafe410d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:05.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:05.049+0000 7fafe901d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fafe40fe4f0 0x7fafe410d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:05.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:05.049+0000 7fafe901d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe410e4e0 con 0x7fafe40fdba0 2024-09-18T21:10:05.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:05.049+0000 7fafe901d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe410e650 con 0x7fafe40fe4f0 2024-09-18T21:10:05.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:05.049+0000 7fafe2d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fafe40fdba0 0x7fafe410d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:05.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:05.049+0000 7fafe2d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fafe40fdba0 0x7fafe410d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49174/0 (socket says 172.21.15.77:49174) 2024-09-18T21:10:05.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:05.049+0000 7fafe2d9d640 1 -- 172.21.15.77:0/670959315 learned_addr learned my addr 172.21.15.77:0/670959315 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:10:05.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:05.049+0000 7fafe259c640 1 --2- 172.21.15.77:0/670959315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fafe40fe4f0 0x7fafe410d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:05.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:05.049+0000 7fafe2d9d640 1 -- 172.21.15.77:0/670959315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fafe40fe4f0 msgr2=0x7fafe410d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:05.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:05.049+0000 7fafe2d9d640 1 --2- 172.21.15.77:0/670959315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fafe40fe4f0 0x7fafe410d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:05.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:05.049+0000 7fafe2d9d640 1 -- 172.21.15.77:0/670959315 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd4005040 con 0x7fafe40fdba0 2024-09-18T21:10:05.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:05.050+0000 7fafe2d9d640 1 --2- 172.21.15.77:0/670959315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fafe40fdba0 0x7fafe410d130 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fafd4003080 tx=0x7fafd4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:10:05.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:05.050+0000 7fafcb7fe640 1 -- 172.21.15.77:0/670959315 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafd4038070 con 0x7fafe40fdba0 2024-09-18T21:10:05.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:05.050+0000 7fafcb7fe640 1 -- 172.21.15.77:0/670959315 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fafd402abd0 con 0x7fafe40fdba0 2024-09-18T21:10:05.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:05.050+0000 7fafe901d640 1 -- 172.21.15.77:0/670959315 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafe410e8d0 con 0x7fafe40fdba0 2024-09-18T21:10:05.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:05.050+0000 7fafcb7fe640 1 -- 172.21.15.77:0/670959315 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafd403e670 con 0x7fafe40fdba0 2024-09-18T21:10:05.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:05.050+0000 7fafe901d640 1 -- 172.21.15.77:0/670959315 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafe410edf0 con 0x7fafe40fdba0 2024-09-18T21:10:05.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:05.051+0000 7fafe901d640 1 -- 172.21.15.77:0/670959315 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafe4105820 con 0x7fafe40fdba0 2024-09-18T21:10:05.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:05.051+0000 7fafcb7fe640 1 -- 172.21.15.77:0/670959315 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fafd4030020 con 0x7fafe40fdba0 2024-09-18T21:10:05.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:05.052+0000 7fafcb7fe640 1 --2- 172.21.15.77:0/670959315 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fafcc06ed60 0x7fafcc071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:05.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:05.052+0000 7fafcb7fe640 1 -- 172.21.15.77:0/670959315 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fafd40ae250 con 0x7fafe40fdba0 2024-09-18T21:10:05.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:05.052+0000 7fafe259c640 1 --2- 172.21.15.77:0/670959315 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fafcc06ed60 0x7fafcc071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:05.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:05.052+0000 7fafe259c640 1 --2- 172.21.15.77:0/670959315 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fafcc06ed60 0x7fafcc071210 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fafd8006fd0 tx=0x7fafd8008040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:10:05.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:05.056+0000 7fafcb7fe640 1 -- 172.21.15.77:0/670959315 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fafd407b6b0 con 0x7fafe40fdba0 2024-09-18T21:10:05.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:05 smithi077 ceph-mon[27689]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:10:05.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:05.220+0000 7fafe901d640 1 -- 172.21.15.77:0/670959315 --> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fafe410f010 con 0x7fafcc06ed60 2024-09-18T21:10:05.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:05.228+0000 7fafcb7fe640 1 -- 172.21.15.77:0/670959315 <== mgr.14206 v2:172.21.15.77:6800/950747822 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2790 (secure 0 0 0) 0x7fafe410f010 con 0x7fafcc06ed60 2024-09-18T21:10:05.228 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T21:10:05.229 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager.smithi077 smithi077 *:9093,9094 running (3m) 2m ago 4m 26.5M - 0.25.0 c8568f914cd2 e1881e21423c 2024-09-18T21:10:05.229 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi077 smithi077 running (5m) 2m ago 5m 6899k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 0beb64a8c2ea 2024-09-18T21:10:05.229 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi103 smithi103 running (4m) 68s ago 4m 6891k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 04981ca7bf34 2024-09-18T21:10:05.229 INFO:teuthology.orchestra.run.smithi077.stdout:grafana.smithi077 smithi077 *:3000 running (3m) 2m ago 4m 76.5M - 9.4.7 954c08fa6188 620f52934182 2024-09-18T21:10:05.229 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi077.utkpjg smithi077 *:9283,8765,8443 running (6m) 2m ago 6m 441M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 5d334eb01bea 2024-09-18T21:10:05.229 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi103.zjztqc smithi103 *:8443,9283 running (4m) 68s ago 4m 402M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 a2818ec1897e 2024-09-18T21:10:05.229 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi077 smithi077 running (6m) 2m ago 6m 44.0M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bcbf289fe027 2024-09-18T21:10:05.229 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi103 smithi103 running (3m) 68s ago 3m 39.2M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 d6ae2062e5e3 2024-09-18T21:10:05.229 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi077 smithi077 *:9100 running (4m) 2m ago 4m 16.2M - 1.5.0 0da6a335fe13 ee48144962b4 2024-09-18T21:10:05.229 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi103 smithi103 *:9100 running (4m) 68s ago 4m 16.3M - 1.5.0 0da6a335fe13 f7a4da7753f2 2024-09-18T21:10:05.229 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (3m) 2m ago 3m 41.1M 4288M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 2e3563c32cf5 2024-09-18T21:10:05.229 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi077 running (2m) 2m ago 2m 38.0M 4288M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 39c2ccbb7603 2024-09-18T21:10:05.229 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi077 running (2m) 2m ago 2m 37.3M 4288M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 2ff2728057e2 2024-09-18T21:10:05.230 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi103 running (2m) 68s ago 2m 39.2M 5312M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 0e72b1bbb8ce 2024-09-18T21:10:05.230 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi103 running (96s) 68s ago 96s 37.7M 5312M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 85f1ce1e8bee 2024-09-18T21:10:05.230 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi103 running (72s) 68s ago 71s 11.7M 5312M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 cf8964b3ac6d 2024-09-18T21:10:05.230 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus.smithi077 smithi077 *:9095 running (3m) 2m ago 4m 38.0M - 2.43.0 a07b618ecd1d 81e0f3809b2f 2024-09-18T21:10:05.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:05.229+0000 7fafe901d640 1 -- 172.21.15.77:0/670959315 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fafcc06ed60 msgr2=0x7fafcc071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:05.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:05.229+0000 7fafe901d640 1 --2- 172.21.15.77:0/670959315 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fafcc06ed60 0x7fafcc071210 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fafd8006fd0 tx=0x7fafd8008040 comp rx=0 tx=0).stop 2024-09-18T21:10:05.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:05.229+0000 7fafe901d640 1 -- 172.21.15.77:0/670959315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fafe40fdba0 msgr2=0x7fafe410d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:05.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:05.229+0000 7fafe901d640 1 --2- 172.21.15.77:0/670959315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fafe40fdba0 0x7fafe410d130 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fafd4003080 tx=0x7fafd4009da0 comp rx=0 tx=0).stop 2024-09-18T21:10:05.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:05.229+0000 7fafe901d640 1 -- 172.21.15.77:0/670959315 shutdown_connections 2024-09-18T21:10:05.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:05.229+0000 7fafe901d640 1 --2- 172.21.15.77:0/670959315 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fafcc06ed60 0x7fafcc071210 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:05.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:05.229+0000 7fafe901d640 1 --2- 172.21.15.77:0/670959315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fafe40fe4f0 0x7fafe410d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:05.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:05.229+0000 7fafe901d640 1 --2- 172.21.15.77:0/670959315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fafe40fdba0 0x7fafe410d130 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:05.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:05.229+0000 7fafe901d640 1 -- 172.21.15.77:0/670959315 >> 172.21.15.77:0/670959315 conn(0x7fafe40f63a0 msgr2=0x7fafe40f7ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:10:05.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:05.230+0000 7fafe901d640 1 -- 172.21.15.77:0/670959315 shutdown_connections 2024-09-18T21:10:05.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:05.230+0000 7fafe901d640 1 -- 172.21.15.77:0/670959315 wait complete. 2024-09-18T21:10:05.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:05 smithi103 ceph-mon[34827]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:10:05.919 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-18T21:10:06.166 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:10:06.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:06 smithi077 ceph-mon[27689]: from='client.14422 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:10:06.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:06 smithi103 ceph-mon[34827]: from='client.14422 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:10:07.384 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:07 smithi077 ceph-mon[27689]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:10:07.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:07 smithi103 ceph-mon[34827]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:10:07.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:07.679+0000 7f478e797640 1 -- 172.21.15.77:0/119419226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47880fb450 msgr2=0x7f47880fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:07.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:07.679+0000 7f478e797640 1 --2- 172.21.15.77:0/119419226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47880fb450 0x7f47880fb860 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f47780048d0 tx=0x7f4778009da0 comp rx=0 tx=0).stop 2024-09-18T21:10:07.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:07.679+0000 7f478e797640 1 -- 172.21.15.77:0/119419226 shutdown_connections 2024-09-18T21:10:07.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:07.679+0000 7f478e797640 1 --2- 172.21.15.77:0/119419226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47880fc720 0x7f47880fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:07.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:07.679+0000 7f478e797640 1 --2- 172.21.15.77:0/119419226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47880fb450 0x7f47880fb860 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:07.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:07.679+0000 7f478e797640 1 -- 172.21.15.77:0/119419226 >> 172.21.15.77:0/119419226 conn(0x7f47880f6c10 msgr2=0x7f47880f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:10:07.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:07.679+0000 7f478e797640 1 -- 172.21.15.77:0/119419226 shutdown_connections 2024-09-18T21:10:07.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:07.679+0000 7f478e797640 1 -- 172.21.15.77:0/119419226 wait complete. 2024-09-18T21:10:07.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:07.680+0000 7f478e797640 1 Processor -- start 2024-09-18T21:10:07.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:07.680+0000 7f478e797640 1 -- start start 2024-09-18T21:10:07.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:07.680+0000 7f478e797640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47880fb450 0x7f47880ff570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:07.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:07.680+0000 7f478e797640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47880fc720 0x7f47880fda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:07.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:07.680+0000 7f478e797640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47880fdff0 con 0x7f47880fc720 2024-09-18T21:10:07.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:07.680+0000 7f478e797640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47880fe130 con 0x7f47880fb450 2024-09-18T21:10:07.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:07.680+0000 7f477ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47880fc720 0x7f47880fda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:07.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:07.680+0000 7f477ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47880fc720 0x7f47880fda60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49178/0 (socket says 172.21.15.77:49178) 2024-09-18T21:10:07.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:07.680+0000 7f477ffff640 1 -- 172.21.15.77:0/2490086709 learned_addr learned my addr 172.21.15.77:0/2490086709 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:10:07.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:07.680+0000 7f4787fff640 1 --2- 172.21.15.77:0/2490086709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47880fb450 0x7f47880ff570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:07.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:07.680+0000 7f477ffff640 1 -- 172.21.15.77:0/2490086709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47880fb450 msgr2=0x7f47880ff570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:07.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:07.680+0000 7f477ffff640 1 --2- 172.21.15.77:0/2490086709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47880fb450 0x7f47880ff570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:07.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:07.680+0000 7f477ffff640 1 -- 172.21.15.77:0/2490086709 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4778005040 con 0x7f47880fc720 2024-09-18T21:10:07.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:07.680+0000 7f4787fff640 1 --2- 172.21.15.77:0/2490086709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47880fb450 0x7f47880ff570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T21:10:07.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:07.681+0000 7f477ffff640 1 --2- 172.21.15.77:0/2490086709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47880fc720 0x7f47880fda60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f477000eb70 tx=0x7f477000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:10:07.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:07.681+0000 7f47857fa640 1 -- 172.21.15.77:0/2490086709 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4770007c30 con 0x7f47880fc720 2024-09-18T21:10:07.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:07.681+0000 7f47857fa640 1 -- 172.21.15.77:0/2490086709 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f477000f040 con 0x7f47880fc720 2024-09-18T21:10:07.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:07.681+0000 7f47857fa640 1 -- 172.21.15.77:0/2490086709 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47700094e0 con 0x7f47880fc720 2024-09-18T21:10:07.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:07.681+0000 7f478e797640 1 -- 172.21.15.77:0/2490086709 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47880fe3b0 con 0x7f47880fc720 2024-09-18T21:10:07.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:07.681+0000 7f478e797640 1 -- 172.21.15.77:0/2490086709 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4788115130 con 0x7f47880fc720 2024-09-18T21:10:07.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:07.682+0000 7f478e797640 1 -- 172.21.15.77:0/2490086709 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47880fa8b0 con 0x7f47880fc720 2024-09-18T21:10:07.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:07.682+0000 7f47857fa640 1 -- 172.21.15.77:0/2490086709 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f4770009640 con 0x7f47880fc720 2024-09-18T21:10:07.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:07.683+0000 7f47857fa640 1 --2- 172.21.15.77:0/2490086709 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f477406ed60 0x7f4774071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:07.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:07.683+0000 7f47857fa640 1 -- 172.21.15.77:0/2490086709 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f477008db70 con 0x7f47880fc720 2024-09-18T21:10:07.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:07.683+0000 7f4787fff640 1 --2- 172.21.15.77:0/2490086709 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f477406ed60 0x7f4774071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:07.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:07.683+0000 7f4787fff640 1 --2- 172.21.15.77:0/2490086709 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f477406ed60 0x7f4774071210 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4778007ac0 tx=0x7f4778009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:10:07.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:07.687+0000 7f47857fa640 1 -- 172.21.15.77:0/2490086709 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f477005b110 con 0x7f47880fc720 2024-09-18T21:10:07.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:07.846+0000 7f478e797640 1 -- 172.21.15.77:0/2490086709 --> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f4788103ff0 con 0x7f477406ed60 2024-09-18T21:10:07.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:07.850+0000 7f47857fa640 1 -- 172.21.15.77:0/2490086709 <== mgr.14206 v2:172.21.15.77:6800/950747822 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1170 (secure 0 0 0) 0x7f4788103ff0 con 0x7f477406ed60 2024-09-18T21:10:07.851 INFO:teuthology.orchestra.run.smithi077.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-18T21:10:07.851 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager ?:9093,9094 1/1 2m ago 5m count:1 2024-09-18T21:10:07.851 INFO:teuthology.orchestra.run.smithi077.stdout:crash 2/2 2m ago 5m * 2024-09-18T21:10:07.852 INFO:teuthology.orchestra.run.smithi077.stdout:grafana ?:3000 1/1 2m ago 5m count:1 2024-09-18T21:10:07.852 INFO:teuthology.orchestra.run.smithi077.stdout:mgr 2/2 2m ago 5m count:2 2024-09-18T21:10:07.852 INFO:teuthology.orchestra.run.smithi077.stdout:mon 2/2 2m ago 4m smithi077:172.21.15.77=smithi077;smithi103:172.21.15.103=smithi103;count:2 2024-09-18T21:10:07.852 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter ?:9100 2/2 2m ago 5m * 2024-09-18T21:10:07.852 INFO:teuthology.orchestra.run.smithi077.stdout:osd 6 2m ago - 2024-09-18T21:10:07.852 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus ?:9095 1/1 2m ago 5m count:1 2024-09-18T21:10:07.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:07.852+0000 7f478e797640 1 -- 172.21.15.77:0/2490086709 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f477406ed60 msgr2=0x7f4774071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:07.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:07.852+0000 7f478e797640 1 --2- 172.21.15.77:0/2490086709 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f477406ed60 0x7f4774071210 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4778007ac0 tx=0x7f4778009da0 comp rx=0 tx=0).stop 2024-09-18T21:10:07.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:07.852+0000 7f478e797640 1 -- 172.21.15.77:0/2490086709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47880fc720 msgr2=0x7f47880fda60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:07.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:07.852+0000 7f478e797640 1 --2- 172.21.15.77:0/2490086709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47880fc720 0x7f47880fda60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f477000eb70 tx=0x7f477000b040 comp rx=0 tx=0).stop 2024-09-18T21:10:07.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:07.852+0000 7f478e797640 1 -- 172.21.15.77:0/2490086709 shutdown_connections 2024-09-18T21:10:07.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:07.852+0000 7f478e797640 1 --2- 172.21.15.77:0/2490086709 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f477406ed60 0x7f4774071210 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:07.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:07.852+0000 7f478e797640 1 --2- 172.21.15.77:0/2490086709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47880fc720 0x7f47880fda60 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:07.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:07.852+0000 7f478e797640 1 --2- 172.21.15.77:0/2490086709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47880fb450 0x7f47880ff570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:07.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:07.852+0000 7f478e797640 1 -- 172.21.15.77:0/2490086709 >> 172.21.15.77:0/2490086709 conn(0x7f47880f6c10 msgr2=0x7f4788066160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:10:07.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:07.852+0000 7f478e797640 1 -- 172.21.15.77:0/2490086709 shutdown_connections 2024-09-18T21:10:07.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:07.852+0000 7f478e797640 1 -- 172.21.15.77:0/2490086709 wait complete. 2024-09-18T21:10:08.641 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-18T21:10:08.888 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:10:09.263 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:09 smithi077 ceph-mon[27689]: from='client.14426 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:10:09.264 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:09 smithi077 ceph-mon[27689]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:10:09.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:09 smithi103 ceph-mon[34827]: from='client.14426 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:10:09.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:09 smithi103 ceph-mon[34827]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:10:10.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:10.402+0000 7fbfe1b11640 1 -- 172.21.15.77:0/392298840 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfdc0fd840 msgr2=0x7fbfdc0fdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:10.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:10.402+0000 7fbfe1b11640 1 --2- 172.21.15.77:0/392298840 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfdc0fd840 0x7fbfdc0fdcb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbfc40048d0 tx=0x7fbfc4009da0 comp rx=0 tx=0).stop 2024-09-18T21:10:10.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:10.402+0000 7fbfe1b11640 1 -- 172.21.15.77:0/392298840 shutdown_connections 2024-09-18T21:10:10.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:10.402+0000 7fbfe1b11640 1 --2- 172.21.15.77:0/392298840 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfdc0fd840 0x7fbfdc0fdcb0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:10.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:10.402+0000 7fbfe1b11640 1 --2- 172.21.15.77:0/392298840 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfdc0fc570 0x7fbfdc0fc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:10.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:10.402+0000 7fbfe1b11640 1 -- 172.21.15.77:0/392298840 >> 172.21.15.77:0/392298840 conn(0x7fbfdc0f7d30 msgr2=0x7fbfdc0fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:10:10.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:10.402+0000 7fbfe1b11640 1 -- 172.21.15.77:0/392298840 shutdown_connections 2024-09-18T21:10:10.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:10.402+0000 7fbfe1b11640 1 -- 172.21.15.77:0/392298840 wait complete. 2024-09-18T21:10:10.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:10.403+0000 7fbfe1b11640 1 Processor -- start 2024-09-18T21:10:10.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:10.403+0000 7fbfe1b11640 1 -- start start 2024-09-18T21:10:10.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:10.403+0000 7fbfe1b11640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfdc0fc570 0x7fbfdc10d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:10.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:10.403+0000 7fbfe1b11640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfdc0fd840 0x7fbfdc10d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:10.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:10.403+0000 7fbfe1b11640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc10dc30 con 0x7fbfdc0fc570 2024-09-18T21:10:10.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:10.403+0000 7fbfe1b11640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc10e450 con 0x7fbfdc0fd840 2024-09-18T21:10:10.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:10.403+0000 7fbfdb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfdc0fc570 0x7fbfdc10d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:10.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:10.403+0000 7fbfdb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfdc0fc570 0x7fbfdc10d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41606/0 (socket says 172.21.15.77:41606) 2024-09-18T21:10:10.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:10.403+0000 7fbfdb7fe640 1 -- 172.21.15.77:0/1897789598 learned_addr learned my addr 172.21.15.77:0/1897789598 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:10:10.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:10.404+0000 7fbfd2ffd640 1 --2- 172.21.15.77:0/1897789598 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfdc0fd840 0x7fbfdc10d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:10.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:10.404+0000 7fbfdb7fe640 1 -- 172.21.15.77:0/1897789598 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfdc0fd840 msgr2=0x7fbfdc10d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:10.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:10.404+0000 7fbfdb7fe640 1 --2- 172.21.15.77:0/1897789598 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfdc0fd840 0x7fbfdc10d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:10.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:10.404+0000 7fbfdb7fe640 1 -- 172.21.15.77:0/1897789598 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc4005040 con 0x7fbfdc0fc570 2024-09-18T21:10:10.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:10.404+0000 7fbfdb7fe640 1 --2- 172.21.15.77:0/1897789598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfdc0fc570 0x7fbfdc10d0a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc002a50 tx=0x7fbfcc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:10:10.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:10.404+0000 7fbfd8ff9640 1 -- 172.21.15.77:0/1897789598 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfcc007c30 con 0x7fbfdc0fc570 2024-09-18T21:10:10.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:10.404+0000 7fbfd8ff9640 1 -- 172.21.15.77:0/1897789598 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbfcc00f040 con 0x7fbfdc0fc570 2024-09-18T21:10:10.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:10.404+0000 7fbfe1b11640 1 -- 172.21.15.77:0/1897789598 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfdc10e6e0 con 0x7fbfdc0fc570 2024-09-18T21:10:10.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:10.404+0000 7fbfd8ff9640 1 -- 172.21.15.77:0/1897789598 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfcc00da10 con 0x7fbfdc0fc570 2024-09-18T21:10:10.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:10.404+0000 7fbfe1b11640 1 -- 172.21.15.77:0/1897789598 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfdc10ec80 con 0x7fbfdc0fc570 2024-09-18T21:10:10.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:10.405+0000 7fbfe1b11640 1 -- 172.21.15.77:0/1897789598 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfdc0fb9d0 con 0x7fbfdc0fc570 2024-09-18T21:10:10.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:10.406+0000 7fbfd8ff9640 1 -- 172.21.15.77:0/1897789598 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fbfcc00dc80 con 0x7fbfdc0fc570 2024-09-18T21:10:10.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:10.406+0000 7fbfd8ff9640 1 --2- 172.21.15.77:0/1897789598 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fbfc806ed60 0x7fbfc8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:10.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:10.406+0000 7fbfd2ffd640 1 --2- 172.21.15.77:0/1897789598 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fbfc806ed60 0x7fbfc8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:10.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:10.406+0000 7fbfd8ff9640 1 -- 172.21.15.77:0/1897789598 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fbfcc08d6a0 con 0x7fbfdc0fc570 2024-09-18T21:10:10.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:10.407+0000 7fbfd2ffd640 1 --2- 172.21.15.77:0/1897789598 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fbfc806ed60 0x7fbfc8071210 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc10ce50 tx=0x7fbfc4035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:10:10.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:10.410+0000 7fbfd8ff9640 1 -- 172.21.15.77:0/1897789598 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fbfcc04d2a0 con 0x7fbfdc0fc570 2024-09-18T21:10:10.571 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:10.570+0000 7fbfe1b11640 1 -- 172.21.15.77:0/1897789598 --> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fbfdc10efe0 con 0x7fbfc806ed60 2024-09-18T21:10:10.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:10.571+0000 7fbfd8ff9640 1 -- 172.21.15.77:0/1897789598 <== mgr.14206 v2:172.21.15.77:6800/950747822 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7fbfdc10efe0 con 0x7fbfc806ed60 2024-09-18T21:10:10.572 INFO:teuthology.orchestra.run.smithi077.stdout:HOST ADDR LABELS STATUS 2024-09-18T21:10:10.572 INFO:teuthology.orchestra.run.smithi077.stdout:smithi077 172.21.15.77 2024-09-18T21:10:10.573 INFO:teuthology.orchestra.run.smithi077.stdout:smithi103 172.21.15.103 2024-09-18T21:10:10.573 INFO:teuthology.orchestra.run.smithi077.stdout:2 hosts in cluster 2024-09-18T21:10:10.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:10.573+0000 7fbfe1b11640 1 -- 172.21.15.77:0/1897789598 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fbfc806ed60 msgr2=0x7fbfc8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:10.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:10.573+0000 7fbfe1b11640 1 --2- 172.21.15.77:0/1897789598 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fbfc806ed60 0x7fbfc8071210 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc10ce50 tx=0x7fbfc4035040 comp rx=0 tx=0).stop 2024-09-18T21:10:10.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:10.573+0000 7fbfe1b11640 1 -- 172.21.15.77:0/1897789598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfdc0fc570 msgr2=0x7fbfdc10d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:10.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:10.573+0000 7fbfe1b11640 1 --2- 172.21.15.77:0/1897789598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfdc0fc570 0x7fbfdc10d0a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc002a50 tx=0x7fbfcc004600 comp rx=0 tx=0).stop 2024-09-18T21:10:10.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:10.573+0000 7fbfe1b11640 1 -- 172.21.15.77:0/1897789598 shutdown_connections 2024-09-18T21:10:10.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:10.573+0000 7fbfe1b11640 1 --2- 172.21.15.77:0/1897789598 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fbfc806ed60 0x7fbfc8071210 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:10.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:10.573+0000 7fbfe1b11640 1 --2- 172.21.15.77:0/1897789598 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfdc0fd840 0x7fbfdc10d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:10.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:10.573+0000 7fbfe1b11640 1 --2- 172.21.15.77:0/1897789598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfdc0fc570 0x7fbfdc10d0a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:10.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:10.573+0000 7fbfe1b11640 1 -- 172.21.15.77:0/1897789598 >> 172.21.15.77:0/1897789598 conn(0x7fbfdc0f7d30 msgr2=0x7fbfdc0f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:10:10.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:10.574+0000 7fbfe1b11640 1 -- 172.21.15.77:0/1897789598 shutdown_connections 2024-09-18T21:10:10.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:10.574+0000 7fbfe1b11640 1 -- 172.21.15.77:0/1897789598 wait complete. 2024-09-18T21:10:11.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:11 smithi077 ceph-mon[27689]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:10:11.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:11 smithi077 ceph-mon[27689]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:10:11.262 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-18T21:10:11.505 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:10:11.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:11 smithi103 ceph-mon[34827]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:10:11.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:11 smithi103 ceph-mon[34827]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:10:13.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:13.061+0000 7f5c88443640 1 -- 172.21.15.77:0/4196639985 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c800fc530 msgr2=0x7f5c800fc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:13.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:13.061+0000 7f5c88443640 1 --2- 172.21.15.77:0/4196639985 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c800fc530 0x7f5c800fc940 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c0048d0 tx=0x7f5c7c009da0 comp rx=0 tx=0).stop 2024-09-18T21:10:13.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:13.061+0000 7f5c88443640 1 -- 172.21.15.77:0/4196639985 shutdown_connections 2024-09-18T21:10:13.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:13.061+0000 7f5c88443640 1 --2- 172.21.15.77:0/4196639985 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c800fd800 0x7f5c800fdc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:13.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:13.061+0000 7f5c88443640 1 --2- 172.21.15.77:0/4196639985 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c800fc530 0x7f5c800fc940 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:13.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:13.061+0000 7f5c88443640 1 -- 172.21.15.77:0/4196639985 >> 172.21.15.77:0/4196639985 conn(0x7f5c800f7d10 msgr2=0x7f5c800fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:10:13.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:13.061+0000 7f5c88443640 1 -- 172.21.15.77:0/4196639985 shutdown_connections 2024-09-18T21:10:13.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:13.061+0000 7f5c88443640 1 -- 172.21.15.77:0/4196639985 wait complete. 2024-09-18T21:10:13.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:13.062+0000 7f5c88443640 1 Processor -- start 2024-09-18T21:10:13.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:13.062+0000 7f5c88443640 1 -- start start 2024-09-18T21:10:13.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:13.062+0000 7f5c88443640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c800fc530 0x7f5c8010d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:13.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:13.062+0000 7f5c88443640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c800fd800 0x7f5c8010d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:13.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:13.062+0000 7f5c88443640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8010dc20 con 0x7f5c800fc530 2024-09-18T21:10:13.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:13.062+0000 7f5c88443640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8010e440 con 0x7f5c800fd800 2024-09-18T21:10:13.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:13.062+0000 7f5c861df640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c800fc530 0x7f5c8010d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:13.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:13.062+0000 7f5c861df640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c800fc530 0x7f5c8010d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41618/0 (socket says 172.21.15.77:41618) 2024-09-18T21:10:13.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:13.062+0000 7f5c861df640 1 -- 172.21.15.77:0/2077048410 learned_addr learned my addr 172.21.15.77:0/2077048410 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:10:13.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:13.062+0000 7f5c859de640 1 --2- 172.21.15.77:0/2077048410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c800fd800 0x7f5c8010d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:13.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:13.063+0000 7f5c861df640 1 -- 172.21.15.77:0/2077048410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c800fd800 msgr2=0x7f5c8010d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:13.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:13.063+0000 7f5c861df640 1 --2- 172.21.15.77:0/2077048410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c800fd800 0x7f5c8010d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:13.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:13.063+0000 7f5c861df640 1 -- 172.21.15.77:0/2077048410 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c7c005040 con 0x7f5c800fc530 2024-09-18T21:10:13.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:13.063+0000 7f5c861df640 1 --2- 172.21.15.77:0/2077048410 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c800fc530 0x7f5c8010d090 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c0043d0 tx=0x7f5c7c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:10:13.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:13.063+0000 7f5c76ffd640 1 -- 172.21.15.77:0/2077048410 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c7c038070 con 0x7f5c800fc530 2024-09-18T21:10:13.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:13.063+0000 7f5c76ffd640 1 -- 172.21.15.77:0/2077048410 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5c7c02ae90 con 0x7f5c800fc530 2024-09-18T21:10:13.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:13.063+0000 7f5c76ffd640 1 -- 172.21.15.77:0/2077048410 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c7c03e670 con 0x7f5c800fc530 2024-09-18T21:10:13.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:13.063+0000 7f5c88443640 1 -- 172.21.15.77:0/2077048410 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c8010e670 con 0x7f5c800fc530 2024-09-18T21:10:13.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:13.063+0000 7f5c88443640 1 -- 172.21.15.77:0/2077048410 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c8010ec10 con 0x7f5c800fc530 2024-09-18T21:10:13.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:13.064+0000 7f5c88443640 1 -- 172.21.15.77:0/2077048410 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c800fb990 con 0x7f5c800fc530 2024-09-18T21:10:13.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:13.065+0000 7f5c76ffd640 1 -- 172.21.15.77:0/2077048410 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f5c7c030020 con 0x7f5c800fc530 2024-09-18T21:10:13.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:13.065+0000 7f5c76ffd640 1 --2- 172.21.15.77:0/2077048410 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f5c6c06ed60 0x7f5c6c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:13.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:13.065+0000 7f5c76ffd640 1 -- 172.21.15.77:0/2077048410 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5c7c0adf70 con 0x7f5c800fc530 2024-09-18T21:10:13.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:13.065+0000 7f5c859de640 1 --2- 172.21.15.77:0/2077048410 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f5c6c06ed60 0x7f5c6c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:13.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:13.065+0000 7f5c859de640 1 --2- 172.21.15.77:0/2077048410 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f5c6c06ed60 0x7f5c6c071210 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5c8010ce40 tx=0x7f5c7000b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:10:13.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:13.069+0000 7f5c76ffd640 1 -- 172.21.15.77:0/2077048410 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5c7c07b500 con 0x7f5c800fc530 2024-09-18T21:10:13.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:13 smithi077 ceph-mon[27689]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:10:13.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:13.233+0000 7f5c88443640 1 -- 172.21.15.77:0/2077048410 --> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c8010ef90 con 0x7f5c6c06ed60 2024-09-18T21:10:13.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:13.235+0000 7f5c76ffd640 1 -- 172.21.15.77:0/2077048410 <== mgr.14206 v2:172.21.15.77:6800/950747822 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7f5c8010ef90 con 0x7f5c6c06ed60 2024-09-18T21:10:13.236 INFO:teuthology.orchestra.run.smithi077.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-18T21:10:13.236 INFO:teuthology.orchestra.run.smithi077.stdout:smithi077 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400ZJ400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-18T21:10:13.236 INFO:teuthology.orchestra.run.smithi077.stdout:smithi103 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT6204012Z400BGN 372G No 71s ago Has a FileSystem, LVM detected 2024-09-18T21:10:13.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:13.237+0000 7f5c88443640 1 -- 172.21.15.77:0/2077048410 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f5c6c06ed60 msgr2=0x7f5c6c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:13.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:13.237+0000 7f5c88443640 1 --2- 172.21.15.77:0/2077048410 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f5c6c06ed60 0x7f5c6c071210 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5c8010ce40 tx=0x7f5c7000b040 comp rx=0 tx=0).stop 2024-09-18T21:10:13.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:13.237+0000 7f5c88443640 1 -- 172.21.15.77:0/2077048410 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c800fc530 msgr2=0x7f5c8010d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:13.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:13.237+0000 7f5c88443640 1 --2- 172.21.15.77:0/2077048410 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c800fc530 0x7f5c8010d090 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c0043d0 tx=0x7f5c7c009da0 comp rx=0 tx=0).stop 2024-09-18T21:10:13.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:13.237+0000 7f5c88443640 1 -- 172.21.15.77:0/2077048410 shutdown_connections 2024-09-18T21:10:13.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:13.237+0000 7f5c88443640 1 --2- 172.21.15.77:0/2077048410 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f5c6c06ed60 0x7f5c6c071210 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:13.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:13.237+0000 7f5c88443640 1 --2- 172.21.15.77:0/2077048410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c800fd800 0x7f5c8010d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:13.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:13.237+0000 7f5c88443640 1 --2- 172.21.15.77:0/2077048410 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c800fc530 0x7f5c8010d090 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:13.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:13.237+0000 7f5c88443640 1 -- 172.21.15.77:0/2077048410 >> 172.21.15.77:0/2077048410 conn(0x7f5c800f7d10 msgr2=0x7f5c800f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:10:13.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:13.237+0000 7f5c88443640 1 -- 172.21.15.77:0/2077048410 shutdown_connections 2024-09-18T21:10:13.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:13.237+0000 7f5c88443640 1 -- 172.21.15.77:0/2077048410 wait complete. 2024-09-18T21:10:13.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:13 smithi103 ceph-mon[34827]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:10:13.943 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-18T21:10:13.953 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi077.front.sepia.ceph.com 2024-09-18T21:10:13.953 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-09-18T21:10:14.211 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:10:14.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:14 smithi077 ceph-mon[27689]: from='client.14434 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:10:14.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:14 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:10:14.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:14 smithi103 ceph-mon[34827]: from='client.14434 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:10:14.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:14 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:10:15.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:15 smithi077 ceph-mon[27689]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:10:15.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:15 smithi103 ceph-mon[34827]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:10:15.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:15.749+0000 7f6940148640 1 -- 172.21.15.77:0/768904595 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69380fb450 msgr2=0x7f69380fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:15.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:15.749+0000 7f6940148640 1 --2- 172.21.15.77:0/768904595 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69380fb450 0x7f69380fb860 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6934009c50 tx=0x7f6934004d10 comp rx=0 tx=0).stop 2024-09-18T21:10:15.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:15.749+0000 7f6940148640 1 -- 172.21.15.77:0/768904595 shutdown_connections 2024-09-18T21:10:15.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:15.749+0000 7f6940148640 1 --2- 172.21.15.77:0/768904595 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69380fc720 0x7f69380fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:15.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:15.749+0000 7f6940148640 1 --2- 172.21.15.77:0/768904595 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69380fb450 0x7f69380fb860 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:15.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:15.749+0000 7f6940148640 1 -- 172.21.15.77:0/768904595 >> 172.21.15.77:0/768904595 conn(0x7f69380f6c10 msgr2=0x7f69380f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:10:15.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:15.749+0000 7f6940148640 1 -- 172.21.15.77:0/768904595 shutdown_connections 2024-09-18T21:10:15.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:15.749+0000 7f6940148640 1 -- 172.21.15.77:0/768904595 wait complete. 2024-09-18T21:10:15.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:15.750+0000 7f6940148640 1 Processor -- start 2024-09-18T21:10:15.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:15.750+0000 7f6940148640 1 -- start start 2024-09-18T21:10:15.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:15.750+0000 7f6940148640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69380fb450 0x7f693810bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:15.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:15.750+0000 7f6940148640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69380fc720 0x7f693810c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:15.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:15.750+0000 7f6940148640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f693810cb80 con 0x7f69380fc720 2024-09-18T21:10:15.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:15.750+0000 7f6940148640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f693810d3a0 con 0x7f69380fb450 2024-09-18T21:10:15.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:15.750+0000 7f693d6e3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69380fc720 0x7f693810c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:15.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:15.750+0000 7f693d6e3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69380fc720 0x7f693810c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41628/0 (socket says 172.21.15.77:41628) 2024-09-18T21:10:15.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:15.750+0000 7f693d6e3640 1 -- 172.21.15.77:0/3096174577 learned_addr learned my addr 172.21.15.77:0/3096174577 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:10:15.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:15.750+0000 7f693dee4640 1 --2- 172.21.15.77:0/3096174577 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69380fb450 0x7f693810bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:15.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:15.750+0000 7f693d6e3640 1 -- 172.21.15.77:0/3096174577 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69380fb450 msgr2=0x7f693810bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:15.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:15.750+0000 7f693d6e3640 1 --2- 172.21.15.77:0/3096174577 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69380fb450 0x7f693810bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:15.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:15.750+0000 7f693d6e3640 1 -- 172.21.15.77:0/3096174577 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69340098b0 con 0x7f69380fc720 2024-09-18T21:10:15.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:15.751+0000 7f693d6e3640 1 --2- 172.21.15.77:0/3096174577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69380fc720 0x7f693810c530 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f692800fce0 tx=0x7f6928004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:10:15.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:15.751+0000 7f692e7fc640 1 -- 172.21.15.77:0/3096174577 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6928007a20 con 0x7f69380fc720 2024-09-18T21:10:15.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:15.751+0000 7f692e7fc640 1 -- 172.21.15.77:0/3096174577 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6928007b80 con 0x7f69380fc720 2024-09-18T21:10:15.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:15.751+0000 7f6940148640 1 -- 172.21.15.77:0/3096174577 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f693810d5d0 con 0x7f69380fc720 2024-09-18T21:10:15.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:15.751+0000 7f692e7fc640 1 -- 172.21.15.77:0/3096174577 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69280126a0 con 0x7f69380fc720 2024-09-18T21:10:15.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:15.751+0000 7f6940148640 1 -- 172.21.15.77:0/3096174577 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f693810db70 con 0x7f69380fc720 2024-09-18T21:10:15.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:15.752+0000 7f6940148640 1 -- 172.21.15.77:0/3096174577 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69380fa8b0 con 0x7f69380fc720 2024-09-18T21:10:15.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:15.752+0000 7f692e7fc640 1 -- 172.21.15.77:0/3096174577 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f6928007cf0 con 0x7f69380fc720 2024-09-18T21:10:15.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:15.753+0000 7f692e7fc640 1 --2- 172.21.15.77:0/3096174577 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f692406ed60 0x7f6924071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:15.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:15.753+0000 7f692e7fc640 1 -- 172.21.15.77:0/3096174577 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f6928090420 con 0x7f69380fc720 2024-09-18T21:10:15.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:15.753+0000 7f693dee4640 1 --2- 172.21.15.77:0/3096174577 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f692406ed60 0x7f6924071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:15.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:15.753+0000 7f693dee4640 1 --2- 172.21.15.77:0/3096174577 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f692406ed60 0x7f6924071210 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6934000f80 tx=0x7f6934004d10 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:10:15.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:15.757+0000 7f692e7fc640 1 -- 172.21.15.77:0/3096174577 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f692805d880 con 0x7f69380fc720 2024-09-18T21:10:15.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:15.936+0000 7f6940148640 1 -- 172.21.15.77:0/3096174577 --> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f693810dea0 con 0x7f692406ed60 2024-09-18T21:10:16.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:16 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-18T21:10:16.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:16 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-18T21:10:17.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:17.252+0000 7f692e7fc640 1 -- 172.21.15.77:0/3096174577 <== mgr.14206 v2:172.21.15.77:6800/950747822 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f693810dea0 con 0x7f692406ed60 2024-09-18T21:10:17.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:17.255+0000 7f6940148640 1 -- 172.21.15.77:0/3096174577 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f692406ed60 msgr2=0x7f6924071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:17.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:17.255+0000 7f6940148640 1 --2- 172.21.15.77:0/3096174577 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f692406ed60 0x7f6924071210 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6934000f80 tx=0x7f6934004d10 comp rx=0 tx=0).stop 2024-09-18T21:10:17.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:17.255+0000 7f6940148640 1 -- 172.21.15.77:0/3096174577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69380fc720 msgr2=0x7f693810c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:17.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:17.255+0000 7f6940148640 1 --2- 172.21.15.77:0/3096174577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69380fc720 0x7f693810c530 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f692800fce0 tx=0x7f6928004600 comp rx=0 tx=0).stop 2024-09-18T21:10:17.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:17.255+0000 7f6940148640 1 -- 172.21.15.77:0/3096174577 shutdown_connections 2024-09-18T21:10:17.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:17.255+0000 7f6940148640 1 --2- 172.21.15.77:0/3096174577 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f692406ed60 0x7f6924071210 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:17.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:17.255+0000 7f6940148640 1 --2- 172.21.15.77:0/3096174577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69380fc720 0x7f693810c530 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:17.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:17.255+0000 7f6940148640 1 --2- 172.21.15.77:0/3096174577 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69380fb450 0x7f693810bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:17.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:17.255+0000 7f6940148640 1 -- 172.21.15.77:0/3096174577 >> 172.21.15.77:0/3096174577 conn(0x7f69380f6c10 msgr2=0x7f69380f8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:10:17.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:17.255+0000 7f6940148640 1 -- 172.21.15.77:0/3096174577 shutdown_connections 2024-09-18T21:10:17.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:17.255+0000 7f6940148640 1 -- 172.21.15.77:0/3096174577 wait complete. 2024-09-18T21:10:17.568 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:17 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-mon-smithi077[27685]: 2024-09-18T21:10:17.229+0000 7fdd23041640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-18T21:10:17.569 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:17 smithi077 ceph-mon[27689]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:10:17.569 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:17 smithi077 ceph-mon[27689]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:10:17.569 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:17 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-18T21:10:17.569 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:17 smithi077 ceph-mon[27689]: osdmap e39: 6 total, 6 up, 6 in 2024-09-18T21:10:17.569 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:17 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-18T21:10:17.569 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:17 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-18T21:10:17.569 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:17 smithi077 ceph-mon[27689]: osdmap e40: 6 total, 6 up, 6 in 2024-09-18T21:10:17.569 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:17 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-18T21:10:17.569 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:17 smithi077 ceph-mon[27689]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-18T21:10:17.569 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:17 smithi077 ceph-mon[27689]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-18T21:10:17.569 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:17 smithi077 ceph-mon[27689]: osdmap e41: 6 total, 6 up, 6 in 2024-09-18T21:10:17.569 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:17 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-18T21:10:17.569 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:17 smithi077 ceph-mon[27689]: fsmap cephfs:0 2024-09-18T21:10:17.570 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:17 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:17.570 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:17 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:10:17.570 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:17 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:10:17.570 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:17 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:10:17.570 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:17 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:17.570 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:17 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi077.vruydi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-18T21:10:17.570 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:17 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi077.vruydi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-18T21:10:17.570 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:17 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:10:17.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:17 smithi103 ceph-mon[34827]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:10:17.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:17 smithi103 ceph-mon[34827]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:10:17.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:17 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-18T21:10:17.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:17 smithi103 ceph-mon[34827]: osdmap e39: 6 total, 6 up, 6 in 2024-09-18T21:10:17.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:17 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-18T21:10:17.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:17 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-18T21:10:17.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:17 smithi103 ceph-mon[34827]: osdmap e40: 6 total, 6 up, 6 in 2024-09-18T21:10:17.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:17 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-18T21:10:17.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:17 smithi103 ceph-mon[34827]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-18T21:10:17.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:17 smithi103 ceph-mon[34827]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-18T21:10:17.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:17 smithi103 ceph-mon[34827]: osdmap e41: 6 total, 6 up, 6 in 2024-09-18T21:10:17.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:17 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-18T21:10:17.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:17 smithi103 ceph-mon[34827]: fsmap cephfs:0 2024-09-18T21:10:17.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:17 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:17.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:17 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:10:17.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:17 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:10:17.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:17 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:10:17.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:17 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:17.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:17 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi077.vruydi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-18T21:10:17.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:17 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi077.vruydi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-18T21:10:17.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:17 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:10:17.892 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-18T21:10:18.684 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:10:18.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:18 smithi077 ceph-mon[27689]: Saving service mds.cephfs spec with placement count:4 2024-09-18T21:10:18.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:18 smithi077 ceph-mon[27689]: Deploying daemon mds.cephfs.smithi077.vruydi on smithi077 2024-09-18T21:10:18.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:18 smithi077 ceph-mon[27689]: osdmap e42: 6 total, 6 up, 6 in 2024-09-18T21:10:18.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:18 smithi103 ceph-mon[34827]: Saving service mds.cephfs spec with placement count:4 2024-09-18T21:10:18.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:18 smithi103 ceph-mon[34827]: Deploying daemon mds.cephfs.smithi077.vruydi on smithi077 2024-09-18T21:10:18.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:18 smithi103 ceph-mon[34827]: osdmap e42: 6 total, 6 up, 6 in 2024-09-18T21:10:19.557 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:19 smithi077 ceph-mon[27689]: pgmap v166: 65 pgs: 64 unknown, 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:10:19.557 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:19 smithi077 ceph-mon[27689]: osdmap e43: 6 total, 6 up, 6 in 2024-09-18T21:10:19.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:19 smithi103 ceph-mon[34827]: pgmap v166: 65 pgs: 64 unknown, 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:10:19.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:19 smithi103 ceph-mon[34827]: osdmap e43: 6 total, 6 up, 6 in 2024-09-18T21:10:20.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:20.689+0000 7f67959a7640 1 -- 172.21.15.77:0/920800763 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67900fc530 msgr2=0x7f67900fc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:20.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:20.689+0000 7f67959a7640 1 --2- 172.21.15.77:0/920800763 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67900fc530 0x7f67900fc940 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f67800048d0 tx=0x7f6780009da0 comp rx=0 tx=0).stop 2024-09-18T21:10:20.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:20.689+0000 7f67959a7640 1 -- 172.21.15.77:0/920800763 shutdown_connections 2024-09-18T21:10:20.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:20.689+0000 7f67959a7640 1 --2- 172.21.15.77:0/920800763 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67900fd800 0x7f67900fdc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:20.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:20.689+0000 7f67959a7640 1 --2- 172.21.15.77:0/920800763 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67900fc530 0x7f67900fc940 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:20.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:20.689+0000 7f67959a7640 1 -- 172.21.15.77:0/920800763 >> 172.21.15.77:0/920800763 conn(0x7f67900f7d10 msgr2=0x7f67900fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:10:20.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:20.689+0000 7f67959a7640 1 -- 172.21.15.77:0/920800763 shutdown_connections 2024-09-18T21:10:20.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:20.689+0000 7f67959a7640 1 -- 172.21.15.77:0/920800763 wait complete. 2024-09-18T21:10:20.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:20.689+0000 7f67959a7640 1 Processor -- start 2024-09-18T21:10:20.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:20.690+0000 7f67959a7640 1 -- start start 2024-09-18T21:10:20.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:20.690+0000 7f67959a7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67900fc530 0x7f679010d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:20.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:20.690+0000 7f67959a7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67900fd800 0x7f679010d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:20.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:20.690+0000 7f67959a7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f679010dc20 con 0x7f67900fc530 2024-09-18T21:10:20.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:20.690+0000 7f67959a7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f679010e440 con 0x7f67900fd800 2024-09-18T21:10:20.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:20.690+0000 7f678effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67900fc530 0x7f679010d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:20.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:20.690+0000 7f678effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67900fc530 0x7f679010d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51946/0 (socket says 172.21.15.77:51946) 2024-09-18T21:10:20.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:20.690+0000 7f678effd640 1 -- 172.21.15.77:0/4063874191 learned_addr learned my addr 172.21.15.77:0/4063874191 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:10:20.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:20.690+0000 7f678e7fc640 1 --2- 172.21.15.77:0/4063874191 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67900fd800 0x7f679010d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:20.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:20.690+0000 7f678effd640 1 -- 172.21.15.77:0/4063874191 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67900fd800 msgr2=0x7f679010d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:20.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:20.690+0000 7f678effd640 1 --2- 172.21.15.77:0/4063874191 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67900fd800 0x7f679010d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:20.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:20.690+0000 7f678effd640 1 -- 172.21.15.77:0/4063874191 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6780005040 con 0x7f67900fc530 2024-09-18T21:10:20.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:20.690+0000 7f678effd640 1 --2- 172.21.15.77:0/4063874191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67900fc530 0x7f679010d090 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f67800043d0 tx=0x7f6780009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:10:20.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:20.690+0000 7f67777fe640 1 -- 172.21.15.77:0/4063874191 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6780038070 con 0x7f67900fc530 2024-09-18T21:10:20.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:20.690+0000 7f67777fe640 1 -- 172.21.15.77:0/4063874191 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f678002ae90 con 0x7f67900fc530 2024-09-18T21:10:20.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:20.690+0000 7f67959a7640 1 -- 172.21.15.77:0/4063874191 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f679010e670 con 0x7f67900fc530 2024-09-18T21:10:20.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:20.690+0000 7f67777fe640 1 -- 172.21.15.77:0/4063874191 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f678003e670 con 0x7f67900fc530 2024-09-18T21:10:20.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:20.690+0000 7f67959a7640 1 -- 172.21.15.77:0/4063874191 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f679010ec10 con 0x7f67900fc530 2024-09-18T21:10:20.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:20.691+0000 7f67959a7640 1 -- 172.21.15.77:0/4063874191 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67900fb990 con 0x7f67900fc530 2024-09-18T21:10:20.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:20.692+0000 7f67777fe640 1 -- 172.21.15.77:0/4063874191 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f6780030020 con 0x7f67900fc530 2024-09-18T21:10:20.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:20.693+0000 7f67777fe640 1 --2- 172.21.15.77:0/4063874191 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f677806ed60 0x7f6778071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:20.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:20.693+0000 7f678e7fc640 1 --2- 172.21.15.77:0/4063874191 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f677806ed60 0x7f6778071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:20.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:20.693+0000 7f67777fe640 1 -- 172.21.15.77:0/4063874191 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f67800ae420 con 0x7f67900fc530 2024-09-18T21:10:20.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:20.693+0000 7f678e7fc640 1 --2- 172.21.15.77:0/4063874191 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f677806ed60 0x7f6778071210 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6784007fd0 tx=0x7f6784009e90 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:10:20.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:20.697+0000 7f67777fe640 1 -- 172.21.15.77:0/4063874191 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f678007b540 con 0x7f67900fc530 2024-09-18T21:10:20.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:20.899+0000 7f67959a7640 1 -- 172.21.15.77:0/4063874191 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f679010eed0 con 0x7f67900fc530 2024-09-18T21:10:20.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:20.899+0000 7f67777fe640 1 -- 172.21.15.77:0/4063874191 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1076 (secure 0 0 0) 0x7f678007aee0 con 0x7f67900fc530 2024-09-18T21:10:20.901 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 2 2024-09-18T21:10:20.901 INFO:teuthology.orchestra.run.smithi077.stdout:e2 2024-09-18T21:10:20.901 INFO:teuthology.orchestra.run.smithi077.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T21:10:20.901 INFO:teuthology.orchestra.run.smithi077.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T21:10:20.901 INFO:teuthology.orchestra.run.smithi077.stdout:legacy client fscid: 1 2024-09-18T21:10:20.901 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:10:20.901 INFO:teuthology.orchestra.run.smithi077.stdout:Filesystem 'cephfs' (1) 2024-09-18T21:10:20.901 INFO:teuthology.orchestra.run.smithi077.stdout:fs_name cephfs 2024-09-18T21:10:20.902 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 2 2024-09-18T21:10:20.902 INFO:teuthology.orchestra.run.smithi077.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T21:10:20.902 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-09-18T21:10:17.230179+0000 2024-09-18T21:10:20.902 INFO:teuthology.orchestra.run.smithi077.stdout:modified 2024-09-18T21:10:17.230240+0000 2024-09-18T21:10:20.902 INFO:teuthology.orchestra.run.smithi077.stdout:tableserver 0 2024-09-18T21:10:20.902 INFO:teuthology.orchestra.run.smithi077.stdout:root 0 2024-09-18T21:10:20.902 INFO:teuthology.orchestra.run.smithi077.stdout:session_timeout 60 2024-09-18T21:10:20.902 INFO:teuthology.orchestra.run.smithi077.stdout:session_autoclose 300 2024-09-18T21:10:20.902 INFO:teuthology.orchestra.run.smithi077.stdout:max_file_size 1099511627776 2024-09-18T21:10:20.902 INFO:teuthology.orchestra.run.smithi077.stdout:required_client_features {} 2024-09-18T21:10:20.902 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure 0 2024-09-18T21:10:20.902 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure_osd_epoch 0 2024-09-18T21:10:20.902 INFO:teuthology.orchestra.run.smithi077.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T21:10:20.902 INFO:teuthology.orchestra.run.smithi077.stdout:max_mds 1 2024-09-18T21:10:20.902 INFO:teuthology.orchestra.run.smithi077.stdout:in 2024-09-18T21:10:20.903 INFO:teuthology.orchestra.run.smithi077.stdout:up {} 2024-09-18T21:10:20.903 INFO:teuthology.orchestra.run.smithi077.stdout:failed 2024-09-18T21:10:20.903 INFO:teuthology.orchestra.run.smithi077.stdout:damaged 2024-09-18T21:10:20.903 INFO:teuthology.orchestra.run.smithi077.stdout:stopped 2024-09-18T21:10:20.903 INFO:teuthology.orchestra.run.smithi077.stdout:data_pools [3] 2024-09-18T21:10:20.903 INFO:teuthology.orchestra.run.smithi077.stdout:metadata_pool 2 2024-09-18T21:10:20.903 INFO:teuthology.orchestra.run.smithi077.stdout:inline_data disabled 2024-09-18T21:10:20.903 INFO:teuthology.orchestra.run.smithi077.stdout:balancer 2024-09-18T21:10:20.903 INFO:teuthology.orchestra.run.smithi077.stdout:standby_count_wanted 0 2024-09-18T21:10:20.903 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:10:20.903 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:10:20.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:20.901+0000 7f67959a7640 1 -- 172.21.15.77:0/4063874191 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f677806ed60 msgr2=0x7f6778071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:20.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:20.901+0000 7f67959a7640 1 --2- 172.21.15.77:0/4063874191 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f677806ed60 0x7f6778071210 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6784007fd0 tx=0x7f6784009e90 comp rx=0 tx=0).stop 2024-09-18T21:10:20.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:20.901+0000 7f67959a7640 1 -- 172.21.15.77:0/4063874191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67900fc530 msgr2=0x7f679010d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:20.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:20.901+0000 7f67959a7640 1 --2- 172.21.15.77:0/4063874191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67900fc530 0x7f679010d090 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f67800043d0 tx=0x7f6780009da0 comp rx=0 tx=0).stop 2024-09-18T21:10:20.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:20.901+0000 7f67959a7640 1 -- 172.21.15.77:0/4063874191 shutdown_connections 2024-09-18T21:10:20.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:20.901+0000 7f67959a7640 1 --2- 172.21.15.77:0/4063874191 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f677806ed60 0x7f6778071210 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:20.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:20.901+0000 7f67959a7640 1 --2- 172.21.15.77:0/4063874191 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67900fd800 0x7f679010d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:20.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:20.901+0000 7f67959a7640 1 --2- 172.21.15.77:0/4063874191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67900fc530 0x7f679010d090 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:20.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:20.901+0000 7f67959a7640 1 -- 172.21.15.77:0/4063874191 >> 172.21.15.77:0/4063874191 conn(0x7f67900f7d10 msgr2=0x7f67900f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:10:20.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:20.901+0000 7f67959a7640 1 -- 172.21.15.77:0/4063874191 shutdown_connections 2024-09-18T21:10:20.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:20.901+0000 7f67959a7640 1 -- 172.21.15.77:0/4063874191 wait complete. 2024-09-18T21:10:21.615 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:21 smithi077 ceph-mon[27689]: pgmap v169: 65 pgs: 52 unknown, 13 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:10:21.615 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:21 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/4063874191' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T21:10:21.615 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:21 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:21.616 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:21 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:21.616 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:21 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:21.616 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:21 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi103.zhdmdg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-18T21:10:21.616 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:21 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi103.zhdmdg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-18T21:10:21.616 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:21 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:10:21.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:21 smithi103 ceph-mon[34827]: pgmap v169: 65 pgs: 52 unknown, 13 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:10:21.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:21 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/4063874191' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T21:10:21.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:21 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:21.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:21 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:21.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:21 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:21.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:21 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi103.zhdmdg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-18T21:10:21.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:21 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi103.zhdmdg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-18T21:10:21.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:21 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:10:21.811 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-18T21:10:21.821 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi077.front.sepia.ceph.com 2024-09-18T21:10:21.821 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 1' 2024-09-18T21:10:22.069 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:10:22.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:22 smithi103 ceph-mon[34827]: Deploying daemon mds.cephfs.smithi103.zhdmdg on smithi103 2024-09-18T21:10:22.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:22 smithi103 ceph-mon[34827]: mds.? [v2:172.21.15.77:6826/334039954,v1:172.21.15.77:6827/334039954] up:boot 2024-09-18T21:10:22.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:22 smithi103 ceph-mon[34827]: daemon mds.cephfs.smithi077.vruydi assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-18T21:10:22.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:22 smithi103 ceph-mon[34827]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-18T21:10:22.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:22 smithi103 ceph-mon[34827]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-18T21:10:22.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:22 smithi103 ceph-mon[34827]: Cluster is now healthy 2024-09-18T21:10:22.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:22 smithi103 ceph-mon[34827]: fsmap cephfs:0 1 up:standby 2024-09-18T21:10:22.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:22 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.vruydi"}]: dispatch 2024-09-18T21:10:22.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:22 smithi103 ceph-mon[34827]: fsmap cephfs:1 {0=cephfs.smithi077.vruydi=up:creating} 2024-09-18T21:10:22.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:22 smithi103 ceph-mon[34827]: daemon mds.cephfs.smithi077.vruydi is now active in filesystem cephfs as rank 0 2024-09-18T21:10:22.778 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:22 smithi077 ceph-mon[27689]: Deploying daemon mds.cephfs.smithi103.zhdmdg on smithi103 2024-09-18T21:10:22.778 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:22 smithi077 ceph-mon[27689]: mds.? [v2:172.21.15.77:6826/334039954,v1:172.21.15.77:6827/334039954] up:boot 2024-09-18T21:10:22.778 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:22 smithi077 ceph-mon[27689]: daemon mds.cephfs.smithi077.vruydi assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-18T21:10:22.778 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:22 smithi077 ceph-mon[27689]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-18T21:10:22.779 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:22 smithi077 ceph-mon[27689]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-18T21:10:22.779 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:22 smithi077 ceph-mon[27689]: Cluster is now healthy 2024-09-18T21:10:22.779 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:22 smithi077 ceph-mon[27689]: fsmap cephfs:0 1 up:standby 2024-09-18T21:10:22.779 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:22 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.vruydi"}]: dispatch 2024-09-18T21:10:22.779 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:22 smithi077 ceph-mon[27689]: fsmap cephfs:1 {0=cephfs.smithi077.vruydi=up:creating} 2024-09-18T21:10:22.779 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:22 smithi077 ceph-mon[27689]: daemon mds.cephfs.smithi077.vruydi is now active in filesystem cephfs as rank 0 2024-09-18T21:10:23.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:23.553+0000 7fdfdfb77640 1 -- 172.21.15.77:0/325551395 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdfd80fd820 msgr2=0x7fdfd80fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:23.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:23.553+0000 7fdfdfb77640 1 --2- 172.21.15.77:0/325551395 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdfd80fd820 0x7fdfd80fdc90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fdfd40048d0 tx=0x7fdfd4009da0 comp rx=0 tx=0).stop 2024-09-18T21:10:23.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:23.553+0000 7fdfdfb77640 1 -- 172.21.15.77:0/325551395 shutdown_connections 2024-09-18T21:10:23.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:23.553+0000 7fdfdfb77640 1 --2- 172.21.15.77:0/325551395 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdfd80fd820 0x7fdfd80fdc90 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:23.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:23.553+0000 7fdfdfb77640 1 --2- 172.21.15.77:0/325551395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdfd80fc550 0x7fdfd80fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:23.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:23.553+0000 7fdfdfb77640 1 -- 172.21.15.77:0/325551395 >> 172.21.15.77:0/325551395 conn(0x7fdfd80f7d30 msgr2=0x7fdfd80fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:10:23.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:23.553+0000 7fdfdfb77640 1 -- 172.21.15.77:0/325551395 shutdown_connections 2024-09-18T21:10:23.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:23.553+0000 7fdfdfb77640 1 -- 172.21.15.77:0/325551395 wait complete. 2024-09-18T21:10:23.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:23.554+0000 7fdfdfb77640 1 Processor -- start 2024-09-18T21:10:23.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:23.554+0000 7fdfdfb77640 1 -- start start 2024-09-18T21:10:23.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:23.554+0000 7fdfdfb77640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdfd80fc550 0x7fdfd810d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:23.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:23.554+0000 7fdfdfb77640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdfd80fd820 0x7fdfd810d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:23.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:23.554+0000 7fdfdfb77640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd810dc20 con 0x7fdfd80fc550 2024-09-18T21:10:23.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:23.554+0000 7fdfdfb77640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd810e440 con 0x7fdfd80fd820 2024-09-18T21:10:23.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:23.554+0000 7fdfdd913640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdfd80fc550 0x7fdfd810d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:23.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:23.554+0000 7fdfdd913640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdfd80fc550 0x7fdfd810d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51982/0 (socket says 172.21.15.77:51982) 2024-09-18T21:10:23.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:23.554+0000 7fdfdd913640 1 -- 172.21.15.77:0/1953285915 learned_addr learned my addr 172.21.15.77:0/1953285915 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:10:23.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:23.554+0000 7fdfdd112640 1 --2- 172.21.15.77:0/1953285915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdfd80fd820 0x7fdfd810d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:23.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:23.554+0000 7fdfdd913640 1 -- 172.21.15.77:0/1953285915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdfd80fd820 msgr2=0x7fdfd810d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:23.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:23.554+0000 7fdfdd913640 1 --2- 172.21.15.77:0/1953285915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdfd80fd820 0x7fdfd810d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:23.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:23.554+0000 7fdfdd913640 1 -- 172.21.15.77:0/1953285915 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd4005040 con 0x7fdfd80fc550 2024-09-18T21:10:23.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:23.554+0000 7fdfdd112640 1 --2- 172.21.15.77:0/1953285915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdfd80fd820 0x7fdfd810d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T21:10:23.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:23.554+0000 7fdfdd913640 1 --2- 172.21.15.77:0/1953285915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdfd80fc550 0x7fdfd810d090 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdfc800eb70 tx=0x7fdfc800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:10:23.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:23.555+0000 7fdfce7fc640 1 -- 172.21.15.77:0/1953285915 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfc8007c30 con 0x7fdfd80fc550 2024-09-18T21:10:23.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:23.555+0000 7fdfce7fc640 1 -- 172.21.15.77:0/1953285915 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdfc800f040 con 0x7fdfd80fc550 2024-09-18T21:10:23.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:23.555+0000 7fdfdfb77640 1 -- 172.21.15.77:0/1953285915 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfd810e670 con 0x7fdfd80fc550 2024-09-18T21:10:23.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:23.555+0000 7fdfce7fc640 1 -- 172.21.15.77:0/1953285915 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfc80094e0 con 0x7fdfd80fc550 2024-09-18T21:10:23.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:23.555+0000 7fdfdfb77640 1 -- 172.21.15.77:0/1953285915 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfd810ec10 con 0x7fdfd80fc550 2024-09-18T21:10:23.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:23.556+0000 7fdfdfb77640 1 -- 172.21.15.77:0/1953285915 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfd80fb9b0 con 0x7fdfd80fc550 2024-09-18T21:10:23.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:23.556+0000 7fdfce7fc640 1 -- 172.21.15.77:0/1953285915 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fdfc80096a0 con 0x7fdfd80fc550 2024-09-18T21:10:23.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:23.557+0000 7fdfce7fc640 1 --2- 172.21.15.77:0/1953285915 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fdfc406ed60 0x7fdfc4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:23.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:23.557+0000 7fdfdd112640 1 --2- 172.21.15.77:0/1953285915 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fdfc406ed60 0x7fdfc4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:23.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:23.557+0000 7fdfce7fc640 1 -- 172.21.15.77:0/1953285915 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fdfc808dcd0 con 0x7fdfd80fc550 2024-09-18T21:10:23.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:23.557+0000 7fdfdd112640 1 --2- 172.21.15.77:0/1953285915 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fdfc406ed60 0x7fdfc4071210 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdfd810ce40 tx=0x7fdfd4035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:10:23.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:23.561+0000 7fdfce7fc640 1 -- 172.21.15.77:0/1953285915 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fdfc804e2a0 con 0x7fdfd80fc550 2024-09-18T21:10:23.681 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:23 smithi103 ceph-mon[34827]: pgmap v170: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:10:23.682 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:23 smithi103 ceph-mon[34827]: mds.? [v2:172.21.15.77:6826/334039954,v1:172.21.15.77:6827/334039954] up:active 2024-09-18T21:10:23.682 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:23 smithi103 ceph-mon[34827]: fsmap cephfs:1 {0=cephfs.smithi077.vruydi=up:active} 2024-09-18T21:10:23.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:23 smithi077 ceph-mon[27689]: pgmap v170: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:10:23.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:23 smithi077 ceph-mon[27689]: mds.? [v2:172.21.15.77:6826/334039954,v1:172.21.15.77:6827/334039954] up:active 2024-09-18T21:10:23.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:23 smithi077 ceph-mon[27689]: fsmap cephfs:1 {0=cephfs.smithi077.vruydi=up:active} 2024-09-18T21:10:23.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:23.753+0000 7fdfdfb77640 1 -- 172.21.15.77:0/1953285915 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7fdfd81050c0 con 0x7fdfd80fc550 2024-09-18T21:10:24.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:24.484+0000 7fdfce7fc640 1 -- 172.21.15.77:0/1953285915 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7fdfc805af20 con 0x7fdfd80fc550 2024-09-18T21:10:24.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:24.486+0000 7fdfdfb77640 1 -- 172.21.15.77:0/1953285915 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fdfc406ed60 msgr2=0x7fdfc4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:24.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:24.486+0000 7fdfdfb77640 1 --2- 172.21.15.77:0/1953285915 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fdfc406ed60 0x7fdfc4071210 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdfd810ce40 tx=0x7fdfd4035040 comp rx=0 tx=0).stop 2024-09-18T21:10:24.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:24.486+0000 7fdfdfb77640 1 -- 172.21.15.77:0/1953285915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdfd80fc550 msgr2=0x7fdfd810d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:24.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:24.486+0000 7fdfdfb77640 1 --2- 172.21.15.77:0/1953285915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdfd80fc550 0x7fdfd810d090 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdfc800eb70 tx=0x7fdfc800b040 comp rx=0 tx=0).stop 2024-09-18T21:10:24.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:24.486+0000 7fdfdfb77640 1 -- 172.21.15.77:0/1953285915 shutdown_connections 2024-09-18T21:10:24.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:24.486+0000 7fdfdfb77640 1 --2- 172.21.15.77:0/1953285915 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fdfc406ed60 0x7fdfc4071210 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:24.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:24.486+0000 7fdfdfb77640 1 --2- 172.21.15.77:0/1953285915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdfd80fd820 0x7fdfd810d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:24.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:24.486+0000 7fdfdfb77640 1 --2- 172.21.15.77:0/1953285915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdfd80fc550 0x7fdfd810d090 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:24.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:24.486+0000 7fdfdfb77640 1 -- 172.21.15.77:0/1953285915 >> 172.21.15.77:0/1953285915 conn(0x7fdfd80f7d30 msgr2=0x7fdfd80f9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:10:24.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:24.486+0000 7fdfdfb77640 1 -- 172.21.15.77:0/1953285915 shutdown_connections 2024-09-18T21:10:24.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:24.486+0000 7fdfdfb77640 1 -- 172.21.15.77:0/1953285915 wait complete. 2024-09-18T21:10:24.660 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:24 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/1953285915' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-18T21:10:24.660 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:24 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:24.660 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:24 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:24.660 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:24 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:24.661 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:24 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi077.cqfhlw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-18T21:10:24.661 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:24 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi077.cqfhlw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-18T21:10:24.661 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:24 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:10:24.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:24 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/1953285915' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-18T21:10:24.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:24 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:24.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:24 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:24.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:24 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:24.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:24 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi077.cqfhlw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-18T21:10:24.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:24 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi077.cqfhlw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-18T21:10:24.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:24 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:10:25.673 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:25 smithi077 ceph-mon[27689]: Deploying daemon mds.cephfs.smithi077.cqfhlw on smithi077 2024-09-18T21:10:25.673 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:25 smithi077 ceph-mon[27689]: pgmap v171: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 301 B/s wr, 0 op/s 2024-09-18T21:10:25.673 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:25 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/1953285915' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-18T21:10:25.673 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:25 smithi077 ceph-mon[27689]: mds.? [v2:172.21.15.103:6824/2170237078,v1:172.21.15.103:6825/2170237078] up:boot 2024-09-18T21:10:25.673 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:25 smithi077 ceph-mon[27689]: fsmap cephfs:1 {0=cephfs.smithi077.vruydi=up:active} 1 up:standby 2024-09-18T21:10:25.674 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:25 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi103.zhdmdg"}]: dispatch 2024-09-18T21:10:25.674 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:25 smithi077 ceph-mon[27689]: fsmap cephfs:1 {0=cephfs.smithi077.vruydi=up:active} 1 up:standby 2024-09-18T21:10:25.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:25 smithi103 ceph-mon[34827]: Deploying daemon mds.cephfs.smithi077.cqfhlw on smithi077 2024-09-18T21:10:25.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:25 smithi103 ceph-mon[34827]: pgmap v171: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 301 B/s wr, 0 op/s 2024-09-18T21:10:25.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:25 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/1953285915' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-18T21:10:25.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:25 smithi103 ceph-mon[34827]: mds.? [v2:172.21.15.103:6824/2170237078,v1:172.21.15.103:6825/2170237078] up:boot 2024-09-18T21:10:25.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:25 smithi103 ceph-mon[34827]: fsmap cephfs:1 {0=cephfs.smithi077.vruydi=up:active} 1 up:standby 2024-09-18T21:10:25.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:25 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi103.zhdmdg"}]: dispatch 2024-09-18T21:10:25.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:25 smithi103 ceph-mon[34827]: fsmap cephfs:1 {0=cephfs.smithi077.vruydi=up:active} 1 up:standby 2024-09-18T21:10:26.086 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-18T21:10:26.097 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi077.front.sepia.ceph.com 2024-09-18T21:10:26.097 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2024-09-18T21:10:26.781 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:10:27.921 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:27 smithi077 ceph-mon[27689]: pgmap v172: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-18T21:10:27.921 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:27 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:27.922 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:27 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:27.922 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:27 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:27.922 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:27 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi103.opftmf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-18T21:10:27.922 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:27 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi103.opftmf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-18T21:10:27.922 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:27 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:10:27.922 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:27 smithi077 ceph-mon[27689]: mds.? [v2:172.21.15.77:6828/862540650,v1:172.21.15.77:6829/862540650] up:boot 2024-09-18T21:10:27.922 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:27 smithi077 ceph-mon[27689]: fsmap cephfs:1 {0=cephfs.smithi077.vruydi=up:active} 2 up:standby 2024-09-18T21:10:27.922 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:27 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.cqfhlw"}]: dispatch 2024-09-18T21:10:28.246 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:27 smithi103 ceph-mon[34827]: pgmap v172: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-18T21:10:28.246 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:27 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:28.246 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:27 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:28.246 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:27 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:28.246 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:27 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi103.opftmf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-18T21:10:28.246 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:27 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi103.opftmf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-18T21:10:28.247 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:27 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:10:28.247 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:27 smithi103 ceph-mon[34827]: mds.? [v2:172.21.15.77:6828/862540650,v1:172.21.15.77:6829/862540650] up:boot 2024-09-18T21:10:28.247 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:27 smithi103 ceph-mon[34827]: fsmap cephfs:1 {0=cephfs.smithi077.vruydi=up:active} 2 up:standby 2024-09-18T21:10:28.247 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:27 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.cqfhlw"}]: dispatch 2024-09-18T21:10:28.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:28.405+0000 7f33a7e72640 1 -- 172.21.15.77:0/741656761 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33a00fc570 msgr2=0x7f33a00fc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:28.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:28.405+0000 7f33a7e72640 1 --2- 172.21.15.77:0/741656761 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33a00fc570 0x7f33a00fc980 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3390009cf0 tx=0x7f3390004cb0 comp rx=0 tx=0).stop 2024-09-18T21:10:28.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:28.405+0000 7f33a7e72640 1 -- 172.21.15.77:0/741656761 shutdown_connections 2024-09-18T21:10:28.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:28.405+0000 7f33a7e72640 1 --2- 172.21.15.77:0/741656761 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33a00fd840 0x7f33a00fdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:28.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:28.405+0000 7f33a7e72640 1 --2- 172.21.15.77:0/741656761 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33a00fc570 0x7f33a00fc980 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:28.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:28.405+0000 7f33a7e72640 1 -- 172.21.15.77:0/741656761 >> 172.21.15.77:0/741656761 conn(0x7f33a00f7d30 msgr2=0x7f33a00fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:10:28.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:28.405+0000 7f33a7e72640 1 -- 172.21.15.77:0/741656761 shutdown_connections 2024-09-18T21:10:28.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:28.405+0000 7f33a7e72640 1 -- 172.21.15.77:0/741656761 wait complete. 2024-09-18T21:10:28.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:28.405+0000 7f33a7e72640 1 Processor -- start 2024-09-18T21:10:28.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:28.405+0000 7f33a7e72640 1 -- start start 2024-09-18T21:10:28.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:28.405+0000 7f33a7e72640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33a00fc570 0x7f33a010d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:28.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:28.405+0000 7f33a7e72640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33a00fd840 0x7f33a010d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:28.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:28.405+0000 7f33a7e72640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a010dbc0 con 0x7f33a00fc570 2024-09-18T21:10:28.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:28.405+0000 7f33a7e72640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a010e3e0 con 0x7f33a00fd840 2024-09-18T21:10:28.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:28.406+0000 7f33a5c0e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33a00fc570 0x7f33a010d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:28.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:28.406+0000 7f33a5c0e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33a00fc570 0x7f33a010d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52020/0 (socket says 172.21.15.77:52020) 2024-09-18T21:10:28.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:28.406+0000 7f33a5c0e640 1 -- 172.21.15.77:0/3262993859 learned_addr learned my addr 172.21.15.77:0/3262993859 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:10:28.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:28.406+0000 7f33a540d640 1 --2- 172.21.15.77:0/3262993859 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33a00fd840 0x7f33a010d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:28.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:28.406+0000 7f33a5c0e640 1 -- 172.21.15.77:0/3262993859 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33a00fd840 msgr2=0x7f33a010d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:28.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:28.406+0000 7f33a5c0e640 1 --2- 172.21.15.77:0/3262993859 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33a00fd840 0x7f33a010d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:28.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:28.406+0000 7f33a5c0e640 1 -- 172.21.15.77:0/3262993859 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33900098b0 con 0x7f33a00fc570 2024-09-18T21:10:28.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:28.406+0000 7f33a5c0e640 1 --2- 172.21.15.77:0/3262993859 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33a00fc570 0x7f33a010d030 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f33900046f0 tx=0x7f3390004cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:10:28.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:28.406+0000 7f339e7fc640 1 -- 172.21.15.77:0/3262993859 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3390009430 con 0x7f33a00fc570 2024-09-18T21:10:28.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:28.406+0000 7f33a7e72640 1 -- 172.21.15.77:0/3262993859 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33a010e610 con 0x7f33a00fc570 2024-09-18T21:10:28.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:28.406+0000 7f339e7fc640 1 -- 172.21.15.77:0/3262993859 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3390004330 con 0x7f33a00fc570 2024-09-18T21:10:28.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:28.406+0000 7f339e7fc640 1 -- 172.21.15.77:0/3262993859 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3390003790 con 0x7f33a00fc570 2024-09-18T21:10:28.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:28.406+0000 7f33a7e72640 1 -- 172.21.15.77:0/3262993859 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33a010ead0 con 0x7f33a00fc570 2024-09-18T21:10:28.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:28.407+0000 7f33a7e72640 1 -- 172.21.15.77:0/3262993859 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33a00fb9d0 con 0x7f33a00fc570 2024-09-18T21:10:28.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:28.408+0000 7f339e7fc640 1 -- 172.21.15.77:0/3262993859 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f339002f030 con 0x7f33a00fc570 2024-09-18T21:10:28.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:28.408+0000 7f339e7fc640 1 --2- 172.21.15.77:0/3262993859 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f338806ed60 0x7f3388071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:28.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:28.408+0000 7f33a540d640 1 --2- 172.21.15.77:0/3262993859 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f338806ed60 0x7f3388071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:28.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:28.408+0000 7f339e7fc640 1 -- 172.21.15.77:0/3262993859 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f33900af370 con 0x7f33a00fc570 2024-09-18T21:10:28.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:28.409+0000 7f33a540d640 1 --2- 172.21.15.77:0/3262993859 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f338806ed60 0x7f3388071210 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f33a010cde0 tx=0x7f339400b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:10:28.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:28.413+0000 7f339e7fc640 1 -- 172.21.15.77:0/3262993859 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f339007c490 con 0x7f33a00fc570 2024-09-18T21:10:28.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:28.605+0000 7f33a7e72640 1 -- 172.21.15.77:0/3262993859 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f33a004b720 con 0x7f33a00fc570 2024-09-18T21:10:28.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:28.796+0000 7f339e7fc640 1 -- 172.21.15.77:0/3262993859 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f339007be30 con 0x7f33a00fc570 2024-09-18T21:10:28.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:28.798+0000 7f33a7e72640 1 -- 172.21.15.77:0/3262993859 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f338806ed60 msgr2=0x7f3388071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:28.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:28.798+0000 7f33a7e72640 1 --2- 172.21.15.77:0/3262993859 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f338806ed60 0x7f3388071210 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f33a010cde0 tx=0x7f339400b040 comp rx=0 tx=0).stop 2024-09-18T21:10:28.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:28.798+0000 7f33a7e72640 1 -- 172.21.15.77:0/3262993859 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33a00fc570 msgr2=0x7f33a010d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:28.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:28.798+0000 7f33a7e72640 1 --2- 172.21.15.77:0/3262993859 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33a00fc570 0x7f33a010d030 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f33900046f0 tx=0x7f3390004cb0 comp rx=0 tx=0).stop 2024-09-18T21:10:28.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:28.798+0000 7f33a7e72640 1 -- 172.21.15.77:0/3262993859 shutdown_connections 2024-09-18T21:10:28.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:28.798+0000 7f33a7e72640 1 --2- 172.21.15.77:0/3262993859 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f338806ed60 0x7f3388071210 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:28.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:28.798+0000 7f33a7e72640 1 --2- 172.21.15.77:0/3262993859 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33a00fd840 0x7f33a010d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:28.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:28.798+0000 7f33a7e72640 1 --2- 172.21.15.77:0/3262993859 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33a00fc570 0x7f33a010d030 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:28.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:28.798+0000 7f33a7e72640 1 -- 172.21.15.77:0/3262993859 >> 172.21.15.77:0/3262993859 conn(0x7f33a00f7d30 msgr2=0x7f33a00f9480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:10:28.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:28.798+0000 7f33a7e72640 1 -- 172.21.15.77:0/3262993859 shutdown_connections 2024-09-18T21:10:28.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:28.799+0000 7f33a7e72640 1 -- 172.21.15.77:0/3262993859 wait complete. 2024-09-18T21:10:28.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:28 smithi077 ceph-mon[27689]: Deploying daemon mds.cephfs.smithi103.opftmf on smithi103 2024-09-18T21:10:28.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:28 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/3262993859' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-09-18T21:10:29.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:28 smithi103 ceph-mon[34827]: Deploying daemon mds.cephfs.smithi103.opftmf on smithi103 2024-09-18T21:10:29.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:28 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/3262993859' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-09-18T21:10:29.504 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-18T21:10:29.514 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi077.front.sepia.ceph.com 2024-09-18T21:10:29.514 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data false' 2024-09-18T21:10:30.103 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:29 smithi103 ceph-mon[34827]: pgmap v173: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-09-18T21:10:30.103 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:29 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/3262993859' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-09-18T21:10:30.103 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:29 smithi103 ceph-mon[34827]: fsmap cephfs:1 {0=cephfs.smithi077.vruydi=up:active} 2 up:standby 2024-09-18T21:10:30.103 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:29 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:10:30.103 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:29 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:30.104 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:29 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:30.104 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:29 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:30.104 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:29 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:30.104 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:29 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:30.104 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:29 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:30.104 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:29 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:10:30.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:29 smithi077 ceph-mon[27689]: pgmap v173: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-09-18T21:10:30.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:29 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/3262993859' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-09-18T21:10:30.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:29 smithi077 ceph-mon[27689]: fsmap cephfs:1 {0=cephfs.smithi077.vruydi=up:active} 2 up:standby 2024-09-18T21:10:30.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:29 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:10:30.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:29 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:30.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:29 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:30.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:29 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:30.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:29 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:30.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:29 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:30.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:29 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:30.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:29 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:10:30.326 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:10:31.457 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:31 smithi077 ceph-mon[27689]: pgmap v174: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 4 op/s 2024-09-18T21:10:31.457 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:31 smithi077 ceph-mon[27689]: mds.? [v2:172.21.15.103:6826/4241818403,v1:172.21.15.103:6827/4241818403] up:boot 2024-09-18T21:10:31.457 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:31 smithi077 ceph-mon[27689]: mds.? [v2:172.21.15.77:6826/334039954,v1:172.21.15.77:6827/334039954] up:active 2024-09-18T21:10:31.457 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:31 smithi077 ceph-mon[27689]: fsmap cephfs:1 {0=cephfs.smithi077.vruydi=up:active} 3 up:standby 2024-09-18T21:10:31.457 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:31 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi103.opftmf"}]: dispatch 2024-09-18T21:10:31.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:31 smithi103 ceph-mon[34827]: pgmap v174: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 4 op/s 2024-09-18T21:10:31.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:31 smithi103 ceph-mon[34827]: mds.? [v2:172.21.15.103:6826/4241818403,v1:172.21.15.103:6827/4241818403] up:boot 2024-09-18T21:10:31.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:31 smithi103 ceph-mon[34827]: mds.? [v2:172.21.15.77:6826/334039954,v1:172.21.15.77:6827/334039954] up:active 2024-09-18T21:10:31.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:31 smithi103 ceph-mon[34827]: fsmap cephfs:1 {0=cephfs.smithi077.vruydi=up:active} 3 up:standby 2024-09-18T21:10:31.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:31 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi103.opftmf"}]: dispatch 2024-09-18T21:10:32.196 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:32 smithi077 ceph-mon[27689]: mds.? [v2:172.21.15.77:6828/862540650,v1:172.21.15.77:6829/862540650] up:standby 2024-09-18T21:10:32.196 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:32 smithi077 ceph-mon[27689]: fsmap cephfs:1 {0=cephfs.smithi077.vruydi=up:active} 3 up:standby 2024-09-18T21:10:32.196 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:32 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:32.196 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:32 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:32.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:32 smithi103 ceph-mon[34827]: mds.? [v2:172.21.15.77:6828/862540650,v1:172.21.15.77:6829/862540650] up:standby 2024-09-18T21:10:32.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:32 smithi103 ceph-mon[34827]: fsmap cephfs:1 {0=cephfs.smithi077.vruydi=up:active} 3 up:standby 2024-09-18T21:10:32.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:32 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:32.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:32 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:32.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:32.609+0000 7f90f4c09640 1 -- 172.21.15.77:0/1723489728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90f00fc700 msgr2=0x7f90f00fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:32.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:32.609+0000 7f90f4c09640 1 --2- 172.21.15.77:0/1723489728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90f00fc700 0x7f90f00fcb70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f90d80048d0 tx=0x7f90d8009da0 comp rx=0 tx=0).stop 2024-09-18T21:10:32.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:32.609+0000 7f90f4c09640 1 -- 172.21.15.77:0/1723489728 shutdown_connections 2024-09-18T21:10:32.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:32.609+0000 7f90f4c09640 1 --2- 172.21.15.77:0/1723489728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90f00fc700 0x7f90f00fcb70 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:32.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:32.609+0000 7f90f4c09640 1 --2- 172.21.15.77:0/1723489728 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90f00fb430 0x7f90f00fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:32.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:32.609+0000 7f90f4c09640 1 -- 172.21.15.77:0/1723489728 >> 172.21.15.77:0/1723489728 conn(0x7f90f00f6c10 msgr2=0x7f90f00f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:10:32.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:32.609+0000 7f90f4c09640 1 -- 172.21.15.77:0/1723489728 shutdown_connections 2024-09-18T21:10:32.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:32.609+0000 7f90f4c09640 1 -- 172.21.15.77:0/1723489728 wait complete. 2024-09-18T21:10:32.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:32.609+0000 7f90f4c09640 1 Processor -- start 2024-09-18T21:10:32.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:32.609+0000 7f90f4c09640 1 -- start start 2024-09-18T21:10:32.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:32.609+0000 7f90f4c09640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90f00fb430 0x7f90f010bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:32.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:32.610+0000 7f90f4c09640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90f00fc700 0x7f90f010c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:32.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:32.610+0000 7f90f4c09640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f010d370 con 0x7f90f00fb430 2024-09-18T21:10:32.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:32.610+0000 7f90f4c09640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f010d4e0 con 0x7f90f00fc700 2024-09-18T21:10:32.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:32.610+0000 7f90ee59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90f00fb430 0x7f90f010bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:32.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:32.610+0000 7f90ee59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90f00fb430 0x7f90f010bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45782/0 (socket says 172.21.15.77:45782) 2024-09-18T21:10:32.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:32.610+0000 7f90ee59c640 1 -- 172.21.15.77:0/2010115409 learned_addr learned my addr 172.21.15.77:0/2010115409 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:10:32.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:32.610+0000 7f90ee59c640 1 -- 172.21.15.77:0/2010115409 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90f00fc700 msgr2=0x7f90f010c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:32.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:32.610+0000 7f90ee59c640 1 --2- 172.21.15.77:0/2010115409 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90f00fc700 0x7f90f010c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:32.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:32.610+0000 7f90ee59c640 1 -- 172.21.15.77:0/2010115409 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d8005040 con 0x7f90f00fb430 2024-09-18T21:10:32.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:32.610+0000 7f90ee59c640 1 --2- 172.21.15.77:0/2010115409 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90f00fb430 0x7f90f010bfc0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f90e000b790 tx=0x7f90e00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:10:32.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:32.610+0000 7f90e6ffd640 1 -- 172.21.15.77:0/2010115409 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90e000c700 con 0x7f90f00fb430 2024-09-18T21:10:32.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:32.610+0000 7f90e6ffd640 1 -- 172.21.15.77:0/2010115409 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f90e000cd00 con 0x7f90f00fb430 2024-09-18T21:10:32.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:32.610+0000 7f90f4c09640 1 -- 172.21.15.77:0/2010115409 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f010d7c0 con 0x7f90f00fb430 2024-09-18T21:10:32.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:32.610+0000 7f90e6ffd640 1 -- 172.21.15.77:0/2010115409 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90e0015e70 con 0x7f90f00fb430 2024-09-18T21:10:32.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:32.610+0000 7f90f4c09640 1 -- 172.21.15.77:0/2010115409 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f010dce0 con 0x7f90f00fb430 2024-09-18T21:10:32.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:32.611+0000 7f90f4c09640 1 -- 172.21.15.77:0/2010115409 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90f00fa890 con 0x7f90f00fb430 2024-09-18T21:10:32.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:32.612+0000 7f90e6ffd640 1 -- 172.21.15.77:0/2010115409 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f90e0012070 con 0x7f90f00fb430 2024-09-18T21:10:32.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:32.612+0000 7f90e6ffd640 1 --2- 172.21.15.77:0/2010115409 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f90dc06ed60 0x7f90dc071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:32.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:32.612+0000 7f90e6ffd640 1 -- 172.21.15.77:0/2010115409 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f90e008dd00 con 0x7f90f00fb430 2024-09-18T21:10:32.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:32.612+0000 7f90edd9b640 1 --2- 172.21.15.77:0/2010115409 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f90dc06ed60 0x7f90dc071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:32.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:32.613+0000 7f90edd9b640 1 --2- 172.21.15.77:0/2010115409 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f90dc06ed60 0x7f90dc071210 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f90d802a530 tx=0x7f90d8009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:10:32.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:32.616+0000 7f90e6ffd640 1 -- 172.21.15.77:0/2010115409 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f90e0091030 con 0x7f90f00fb430 2024-09-18T21:10:32.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:32.814+0000 7f90f4c09640 1 -- 172.21.15.77:0/2010115409 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7f90f004b720 con 0x7f90f00fb430 2024-09-18T21:10:33.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:33.377+0000 7f90e6ffd640 1 -- 172.21.15.77:0/2010115409 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v13) v1 ==== 133+0+0 (secure 0 0 0) 0x7f90e005ae20 con 0x7f90f00fb430 2024-09-18T21:10:33.380 INFO:teuthology.orchestra.run.smithi077.stderr:inline data disabled 2024-09-18T21:10:33.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:33.381+0000 7f90f4c09640 1 -- 172.21.15.77:0/2010115409 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f90dc06ed60 msgr2=0x7f90dc071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:33.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:33.381+0000 7f90f4c09640 1 --2- 172.21.15.77:0/2010115409 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f90dc06ed60 0x7f90dc071210 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f90d802a530 tx=0x7f90d8009da0 comp rx=0 tx=0).stop 2024-09-18T21:10:33.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:33.381+0000 7f90f4c09640 1 -- 172.21.15.77:0/2010115409 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90f00fb430 msgr2=0x7f90f010bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:33.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:33.381+0000 7f90f4c09640 1 --2- 172.21.15.77:0/2010115409 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90f00fb430 0x7f90f010bfc0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f90e000b790 tx=0x7f90e00091d0 comp rx=0 tx=0).stop 2024-09-18T21:10:33.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:33.381+0000 7f90f4c09640 1 -- 172.21.15.77:0/2010115409 shutdown_connections 2024-09-18T21:10:33.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:33.381+0000 7f90f4c09640 1 --2- 172.21.15.77:0/2010115409 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f90dc06ed60 0x7f90dc071210 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:33.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:33.381+0000 7f90f4c09640 1 --2- 172.21.15.77:0/2010115409 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90f00fc700 0x7f90f010c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:33.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:33.381+0000 7f90f4c09640 1 --2- 172.21.15.77:0/2010115409 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90f00fb430 0x7f90f010bfc0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:33.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:33.381+0000 7f90f4c09640 1 -- 172.21.15.77:0/2010115409 >> 172.21.15.77:0/2010115409 conn(0x7f90f00f6c10 msgr2=0x7f90f00f83a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:10:33.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:33.381+0000 7f90f4c09640 1 -- 172.21.15.77:0/2010115409 shutdown_connections 2024-09-18T21:10:33.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:33.381+0000 7f90f4c09640 1 -- 172.21.15.77:0/2010115409 wait complete. 2024-09-18T21:10:33.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:33 smithi077 ceph-mon[27689]: pgmap v175: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-09-18T21:10:33.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:33 smithi077 ceph-mon[27689]: mds.? [v2:172.21.15.103:6824/2170237078,v1:172.21.15.103:6825/2170237078] up:standby 2024-09-18T21:10:33.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:33 smithi077 ceph-mon[27689]: fsmap cephfs:1 {0=cephfs.smithi077.vruydi=up:active} 3 up:standby 2024-09-18T21:10:33.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:33 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/2010115409' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-09-18T21:10:33.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:33 smithi103 ceph-mon[34827]: pgmap v175: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-09-18T21:10:33.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:33 smithi103 ceph-mon[34827]: mds.? [v2:172.21.15.103:6824/2170237078,v1:172.21.15.103:6825/2170237078] up:standby 2024-09-18T21:10:33.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:33 smithi103 ceph-mon[34827]: fsmap cephfs:1 {0=cephfs.smithi077.vruydi=up:active} 3 up:standby 2024-09-18T21:10:33.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:33 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/2010115409' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-09-18T21:10:34.502 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:34 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/2010115409' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-09-18T21:10:34.502 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:34 smithi077 ceph-mon[27689]: mds.? [v2:172.21.15.103:6826/4241818403,v1:172.21.15.103:6827/4241818403] up:standby 2024-09-18T21:10:34.502 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:34 smithi077 ceph-mon[27689]: fsmap cephfs:1 {0=cephfs.smithi077.vruydi=up:active} 3 up:standby 2024-09-18T21:10:34.502 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:34 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:34.576 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-18T21:10:34.585 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi077.front.sepia.ceph.com 2024-09-18T21:10:34.586 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-18T21:10:34.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:34 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/2010115409' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-09-18T21:10:34.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:34 smithi103 ceph-mon[34827]: mds.? [v2:172.21.15.103:6826/4241818403,v1:172.21.15.103:6827/4241818403] up:standby 2024-09-18T21:10:34.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:34 smithi103 ceph-mon[34827]: fsmap cephfs:1 {0=cephfs.smithi077.vruydi=up:active} 3 up:standby 2024-09-18T21:10:34.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:34 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:35.304 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:10:35.657 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:35 smithi077 ceph-mon[27689]: pgmap v176: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-09-18T21:10:35.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:35 smithi103 ceph-mon[34827]: pgmap v176: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-09-18T21:10:36.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:36.900+0000 7f163b3d6640 1 -- 172.21.15.77:0/2967154757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16340fd820 msgr2=0x7f16340fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:36.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:36.900+0000 7f163b3d6640 1 --2- 172.21.15.77:0/2967154757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16340fd820 0x7f16340fdc90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f16280048d0 tx=0x7f1628009da0 comp rx=0 tx=0).stop 2024-09-18T21:10:36.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:36.900+0000 7f163b3d6640 1 -- 172.21.15.77:0/2967154757 shutdown_connections 2024-09-18T21:10:36.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:36.900+0000 7f163b3d6640 1 --2- 172.21.15.77:0/2967154757 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16340fd820 0x7f16340fdc90 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:36.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:36.900+0000 7f163b3d6640 1 --2- 172.21.15.77:0/2967154757 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16340fc550 0x7f16340fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:36.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:36.900+0000 7f163b3d6640 1 -- 172.21.15.77:0/2967154757 >> 172.21.15.77:0/2967154757 conn(0x7f16340f7d30 msgr2=0x7f16340fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:10:36.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:36.900+0000 7f163b3d6640 1 -- 172.21.15.77:0/2967154757 shutdown_connections 2024-09-18T21:10:36.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:36.900+0000 7f163b3d6640 1 -- 172.21.15.77:0/2967154757 wait complete. 2024-09-18T21:10:36.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:36.900+0000 7f163b3d6640 1 Processor -- start 2024-09-18T21:10:36.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:36.900+0000 7f163b3d6640 1 -- start start 2024-09-18T21:10:36.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:36.900+0000 7f163b3d6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16340fc550 0x7f1634071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:36.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:36.900+0000 7f163b3d6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16340fd820 0x7f163406fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:36.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:36.900+0000 7f163b3d6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f163406fff0 con 0x7f16340fc550 2024-09-18T21:10:36.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:36.900+0000 7f163b3d6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1634070130 con 0x7f16340fd820 2024-09-18T21:10:36.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:36.901+0000 7f1639172640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16340fc550 0x7f1634071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:36.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:36.901+0000 7f1639172640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16340fc550 0x7f1634071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45808/0 (socket says 172.21.15.77:45808) 2024-09-18T21:10:36.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:36.901+0000 7f1639172640 1 -- 172.21.15.77:0/3981116817 learned_addr learned my addr 172.21.15.77:0/3981116817 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:10:36.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:36.901+0000 7f1638971640 1 --2- 172.21.15.77:0/3981116817 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16340fd820 0x7f163406fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:36.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:36.901+0000 7f1639172640 1 -- 172.21.15.77:0/3981116817 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16340fd820 msgr2=0x7f163406fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:36.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:36.901+0000 7f1639172640 1 --2- 172.21.15.77:0/3981116817 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16340fd820 0x7f163406fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:36.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:36.901+0000 7f1639172640 1 -- 172.21.15.77:0/3981116817 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1628005040 con 0x7f16340fc550 2024-09-18T21:10:36.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:36.901+0000 7f1639172640 1 --2- 172.21.15.77:0/3981116817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16340fc550 0x7f1634071570 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f162c002a50 tx=0x7f162c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:10:36.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:36.901+0000 7f1631ffb640 1 -- 172.21.15.77:0/3981116817 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f162c007c30 con 0x7f16340fc550 2024-09-18T21:10:36.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:36.901+0000 7f1631ffb640 1 -- 172.21.15.77:0/3981116817 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f162c00f040 con 0x7f16340fc550 2024-09-18T21:10:36.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:36.901+0000 7f163b3d6640 1 -- 172.21.15.77:0/3981116817 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1634070410 con 0x7f16340fc550 2024-09-18T21:10:36.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:36.901+0000 7f1631ffb640 1 -- 172.21.15.77:0/3981116817 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f162c00dad0 con 0x7f16340fc550 2024-09-18T21:10:36.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:36.901+0000 7f163b3d6640 1 -- 172.21.15.77:0/3981116817 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16341150e0 con 0x7f16340fc550 2024-09-18T21:10:36.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:36.902+0000 7f163b3d6640 1 -- 172.21.15.77:0/3981116817 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16340fb9b0 con 0x7f16340fc550 2024-09-18T21:10:36.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:36.903+0000 7f1631ffb640 1 -- 172.21.15.77:0/3981116817 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f162c00dc30 con 0x7f16340fc550 2024-09-18T21:10:36.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:36.903+0000 7f1631ffb640 1 --2- 172.21.15.77:0/3981116817 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f161c06ed60 0x7f161c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:36.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:36.903+0000 7f1631ffb640 1 -- 172.21.15.77:0/3981116817 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f162c08df00 con 0x7f16340fc550 2024-09-18T21:10:36.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:36.903+0000 7f1638971640 1 --2- 172.21.15.77:0/3981116817 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f161c06ed60 0x7f161c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:36.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:36.904+0000 7f1638971640 1 --2- 172.21.15.77:0/3981116817 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f161c06ed60 0x7f161c071210 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f162800b020 tx=0x7f1628035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:10:36.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:36.907+0000 7f1631ffb640 1 -- 172.21.15.77:0/3981116817 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f162c05b0a0 con 0x7f16340fc550 2024-09-18T21:10:37.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:37.107+0000 7f163b3d6640 1 -- 172.21.15.77:0/3981116817 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1634115370 con 0x7f16340fc550 2024-09-18T21:10:37.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:37.108+0000 7f1631ffb640 1 -- 172.21.15.77:0/3981116817 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1807 (secure 0 0 0) 0x7f162c05aa40 con 0x7f16340fc550 2024-09-18T21:10:37.109 INFO:teuthology.orchestra.run.smithi077.stdout:e13 2024-09-18T21:10:37.109 INFO:teuthology.orchestra.run.smithi077.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T21:10:37.109 INFO:teuthology.orchestra.run.smithi077.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T21:10:37.109 INFO:teuthology.orchestra.run.smithi077.stdout:legacy client fscid: 1 2024-09-18T21:10:37.109 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:10:37.109 INFO:teuthology.orchestra.run.smithi077.stdout:Filesystem 'cephfs' (1) 2024-09-18T21:10:37.110 INFO:teuthology.orchestra.run.smithi077.stdout:fs_name cephfs 2024-09-18T21:10:37.110 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 13 2024-09-18T21:10:37.110 INFO:teuthology.orchestra.run.smithi077.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T21:10:37.110 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-09-18T21:10:17.230179+0000 2024-09-18T21:10:37.110 INFO:teuthology.orchestra.run.smithi077.stdout:modified 2024-09-18T21:10:33.373241+0000 2024-09-18T21:10:37.110 INFO:teuthology.orchestra.run.smithi077.stdout:tableserver 0 2024-09-18T21:10:37.110 INFO:teuthology.orchestra.run.smithi077.stdout:root 0 2024-09-18T21:10:37.110 INFO:teuthology.orchestra.run.smithi077.stdout:session_timeout 60 2024-09-18T21:10:37.110 INFO:teuthology.orchestra.run.smithi077.stdout:session_autoclose 300 2024-09-18T21:10:37.110 INFO:teuthology.orchestra.run.smithi077.stdout:max_file_size 1099511627776 2024-09-18T21:10:37.110 INFO:teuthology.orchestra.run.smithi077.stdout:required_client_features {} 2024-09-18T21:10:37.110 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure 0 2024-09-18T21:10:37.110 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure_osd_epoch 0 2024-09-18T21:10:37.110 INFO:teuthology.orchestra.run.smithi077.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T21:10:37.110 INFO:teuthology.orchestra.run.smithi077.stdout:max_mds 1 2024-09-18T21:10:37.111 INFO:teuthology.orchestra.run.smithi077.stdout:in 0 2024-09-18T21:10:37.111 INFO:teuthology.orchestra.run.smithi077.stdout:up {0=14446} 2024-09-18T21:10:37.111 INFO:teuthology.orchestra.run.smithi077.stdout:failed 2024-09-18T21:10:37.111 INFO:teuthology.orchestra.run.smithi077.stdout:damaged 2024-09-18T21:10:37.111 INFO:teuthology.orchestra.run.smithi077.stdout:stopped 2024-09-18T21:10:37.111 INFO:teuthology.orchestra.run.smithi077.stdout:data_pools [3] 2024-09-18T21:10:37.111 INFO:teuthology.orchestra.run.smithi077.stdout:metadata_pool 2 2024-09-18T21:10:37.111 INFO:teuthology.orchestra.run.smithi077.stdout:inline_data disabled 2024-09-18T21:10:37.111 INFO:teuthology.orchestra.run.smithi077.stdout:balancer 2024-09-18T21:10:37.111 INFO:teuthology.orchestra.run.smithi077.stdout:standby_count_wanted 1 2024-09-18T21:10:37.111 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.vruydi{0:14446} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.77:6826/334039954,v1:172.21.15.77:6827/334039954] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:10:37.111 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:10:37.111 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:10:37.111 INFO:teuthology.orchestra.run.smithi077.stdout:Standby daemons: 2024-09-18T21:10:37.112 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:10:37.112 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.cqfhlw{-1:14458} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.77:6828/862540650,v1:172.21.15.77:6829/862540650] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:10:37.112 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi103.zhdmdg{-1:24255} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.103:6824/2170237078,v1:172.21.15.103:6825/2170237078] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:10:37.112 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi103.opftmf{-1:24267} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.103:6826/4241818403,v1:172.21.15.103:6827/4241818403] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:10:37.112 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 13 2024-09-18T21:10:37.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:37.110+0000 7f163b3d6640 1 -- 172.21.15.77:0/3981116817 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f161c06ed60 msgr2=0x7f161c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:37.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:37.110+0000 7f163b3d6640 1 --2- 172.21.15.77:0/3981116817 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f161c06ed60 0x7f161c071210 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f162800b020 tx=0x7f1628035040 comp rx=0 tx=0).stop 2024-09-18T21:10:37.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:37.110+0000 7f163b3d6640 1 -- 172.21.15.77:0/3981116817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16340fc550 msgr2=0x7f1634071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:37.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:37.110+0000 7f163b3d6640 1 --2- 172.21.15.77:0/3981116817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16340fc550 0x7f1634071570 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f162c002a50 tx=0x7f162c004600 comp rx=0 tx=0).stop 2024-09-18T21:10:37.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:37.110+0000 7f163b3d6640 1 -- 172.21.15.77:0/3981116817 shutdown_connections 2024-09-18T21:10:37.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:37.110+0000 7f163b3d6640 1 --2- 172.21.15.77:0/3981116817 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f161c06ed60 0x7f161c071210 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:37.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:37.110+0000 7f163b3d6640 1 --2- 172.21.15.77:0/3981116817 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16340fd820 0x7f163406fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:37.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:37.110+0000 7f163b3d6640 1 --2- 172.21.15.77:0/3981116817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16340fc550 0x7f1634071570 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:37.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:37.110+0000 7f163b3d6640 1 -- 172.21.15.77:0/3981116817 >> 172.21.15.77:0/3981116817 conn(0x7f16340f7d30 msgr2=0x7f16340f9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:10:37.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:37.110+0000 7f163b3d6640 1 -- 172.21.15.77:0/3981116817 shutdown_connections 2024-09-18T21:10:37.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:37.111+0000 7f163b3d6640 1 -- 172.21.15.77:0/3981116817 wait complete. 2024-09-18T21:10:37.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:37 smithi103 ceph-mon[34827]: pgmap v177: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 3 op/s 2024-09-18T21:10:37.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:37 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:37.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:37 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:37.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:37 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:10:37.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:37 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:10:37.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:37 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:37.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:37 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:10:37.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:37 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/3981116817' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T21:10:37.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:37 smithi077 ceph-mon[27689]: pgmap v177: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 3 op/s 2024-09-18T21:10:37.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:37 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:37.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:37 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:37.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:37 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:10:37.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:37 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:10:37.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:37 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:37.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:37 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:10:37.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:37 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/3981116817' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T21:10:37.837 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-09-18T21:10:38.571 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:10:39.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:39 smithi077 ceph-mon[27689]: pgmap v178: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-09-18T21:10:39.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:39 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:39.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:39 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:39.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:39 smithi103 ceph-mon[34827]: pgmap v178: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-09-18T21:10:39.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:39 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:39.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:39 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:40.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:40.268+0000 7ffbe2570640 1 -- 172.21.15.77:0/2485989887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffbdc0fc720 msgr2=0x7ffbdc0fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:40.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:40.268+0000 7ffbe2570640 1 --2- 172.21.15.77:0/2485989887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffbdc0fc720 0x7ffbdc0fcb90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ffbd00048d0 tx=0x7ffbd0009da0 comp rx=0 tx=0).stop 2024-09-18T21:10:40.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:40.268+0000 7ffbe2570640 1 -- 172.21.15.77:0/2485989887 shutdown_connections 2024-09-18T21:10:40.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:40.268+0000 7ffbe2570640 1 --2- 172.21.15.77:0/2485989887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffbdc0fc720 0x7ffbdc0fcb90 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:40.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:40.268+0000 7ffbe2570640 1 --2- 172.21.15.77:0/2485989887 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffbdc0fb450 0x7ffbdc0fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:40.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:40.268+0000 7ffbe2570640 1 -- 172.21.15.77:0/2485989887 >> 172.21.15.77:0/2485989887 conn(0x7ffbdc0f6c10 msgr2=0x7ffbdc0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:10:40.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:40.268+0000 7ffbe2570640 1 -- 172.21.15.77:0/2485989887 shutdown_connections 2024-09-18T21:10:40.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:40.268+0000 7ffbe2570640 1 -- 172.21.15.77:0/2485989887 wait complete. 2024-09-18T21:10:40.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:40.269+0000 7ffbe2570640 1 Processor -- start 2024-09-18T21:10:40.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:40.269+0000 7ffbe2570640 1 -- start start 2024-09-18T21:10:40.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:40.269+0000 7ffbe2570640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffbdc0fb450 0x7ffbdc10fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:40.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:40.269+0000 7ffbe2570640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffbdc0fc720 0x7ffbdc112330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:40.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:40.269+0000 7ffbe2570640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc066750 con 0x7ffbdc0fc720 2024-09-18T21:10:40.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:40.269+0000 7ffbe2570640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc0668c0 con 0x7ffbdc0fb450 2024-09-18T21:10:40.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:40.269+0000 7ffbdb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffbdc0fc720 0x7ffbdc112330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:40.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:40.269+0000 7ffbdb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffbdc0fc720 0x7ffbdc112330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41422/0 (socket says 172.21.15.77:41422) 2024-09-18T21:10:40.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:40.269+0000 7ffbdb7fe640 1 -- 172.21.15.77:0/2877783082 learned_addr learned my addr 172.21.15.77:0/2877783082 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:10:40.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:40.269+0000 7ffbdbfff640 1 --2- 172.21.15.77:0/2877783082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffbdc0fb450 0x7ffbdc10fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:40.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:40.269+0000 7ffbdb7fe640 1 -- 172.21.15.77:0/2877783082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffbdc0fb450 msgr2=0x7ffbdc10fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:40.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:40.269+0000 7ffbdb7fe640 1 --2- 172.21.15.77:0/2877783082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffbdc0fb450 0x7ffbdc10fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:40.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:40.269+0000 7ffbdb7fe640 1 -- 172.21.15.77:0/2877783082 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd0005040 con 0x7ffbdc0fc720 2024-09-18T21:10:40.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:40.270+0000 7ffbdb7fe640 1 --2- 172.21.15.77:0/2877783082 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffbdc0fc720 0x7ffbdc112330 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ffbd00043d0 tx=0x7ffbd0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:10:40.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:40.270+0000 7ffbd8ff9640 1 -- 172.21.15.77:0/2877783082 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffbd0038070 con 0x7ffbdc0fc720 2024-09-18T21:10:40.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:40.270+0000 7ffbe2570640 1 -- 172.21.15.77:0/2877783082 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbdc112870 con 0x7ffbdc0fc720 2024-09-18T21:10:40.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:40.270+0000 7ffbd8ff9640 1 -- 172.21.15.77:0/2877783082 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ffbd002ae90 con 0x7ffbdc0fc720 2024-09-18T21:10:40.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:40.270+0000 7ffbd8ff9640 1 -- 172.21.15.77:0/2877783082 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffbd003e670 con 0x7ffbdc0fc720 2024-09-18T21:10:40.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:40.270+0000 7ffbe2570640 1 -- 172.21.15.77:0/2877783082 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbdc112d90 con 0x7ffbdc0fc720 2024-09-18T21:10:40.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:40.271+0000 7ffbe2570640 1 -- 172.21.15.77:0/2877783082 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbdc0fa8b0 con 0x7ffbdc0fc720 2024-09-18T21:10:40.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:40.272+0000 7ffbd8ff9640 1 -- 172.21.15.77:0/2877783082 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7ffbd0030020 con 0x7ffbdc0fc720 2024-09-18T21:10:40.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:40.273+0000 7ffbd8ff9640 1 --2- 172.21.15.77:0/2877783082 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7ffbc406ed60 0x7ffbc4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:40.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:40.273+0000 7ffbd8ff9640 1 -- 172.21.15.77:0/2877783082 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7ffbd00ae410 con 0x7ffbdc0fc720 2024-09-18T21:10:40.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:40.273+0000 7ffbdbfff640 1 --2- 172.21.15.77:0/2877783082 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7ffbc406ed60 0x7ffbc4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:40.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:40.273+0000 7ffbdbfff640 1 --2- 172.21.15.77:0/2877783082 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7ffbc406ed60 0x7ffbc4071210 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc066440 tx=0x7ffbcc009ed0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:10:40.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:40.277+0000 7ffbd8ff9640 1 -- 172.21.15.77:0/2877783082 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ffbd007b530 con 0x7ffbdc0fc720 2024-09-18T21:10:40.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:40.475+0000 7ffbe2570640 1 -- 172.21.15.77:0/2877783082 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffbdc04b720 con 0x7ffbdc0fc720 2024-09-18T21:10:40.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:40.475+0000 7ffbd8ff9640 1 -- 172.21.15.77:0/2877783082 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4686 (secure 0 0 0) 0x7ffbd007aed0 con 0x7ffbdc0fc720 2024-09-18T21:10:40.477 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 13 2024-09-18T21:10:40.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:40.477+0000 7ffbe2570640 1 -- 172.21.15.77:0/2877783082 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7ffbc406ed60 msgr2=0x7ffbc4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:40.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:40.477+0000 7ffbe2570640 1 --2- 172.21.15.77:0/2877783082 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7ffbc406ed60 0x7ffbc4071210 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc066440 tx=0x7ffbcc009ed0 comp rx=0 tx=0).stop 2024-09-18T21:10:40.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:40.477+0000 7ffbe2570640 1 -- 172.21.15.77:0/2877783082 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffbdc0fc720 msgr2=0x7ffbdc112330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:40.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:40.478+0000 7ffbe2570640 1 --2- 172.21.15.77:0/2877783082 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffbdc0fc720 0x7ffbdc112330 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ffbd00043d0 tx=0x7ffbd0009da0 comp rx=0 tx=0).stop 2024-09-18T21:10:40.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:40.478+0000 7ffbe2570640 1 -- 172.21.15.77:0/2877783082 shutdown_connections 2024-09-18T21:10:40.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:40.478+0000 7ffbe2570640 1 --2- 172.21.15.77:0/2877783082 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7ffbc406ed60 0x7ffbc4071210 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:40.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:40.478+0000 7ffbe2570640 1 --2- 172.21.15.77:0/2877783082 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffbdc0fc720 0x7ffbdc112330 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:40.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:40.478+0000 7ffbe2570640 1 --2- 172.21.15.77:0/2877783082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffbdc0fb450 0x7ffbdc10fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:40.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:40.478+0000 7ffbe2570640 1 -- 172.21.15.77:0/2877783082 >> 172.21.15.77:0/2877783082 conn(0x7ffbdc0f6c10 msgr2=0x7ffbdc0f8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:10:40.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:40.478+0000 7ffbe2570640 1 -- 172.21.15.77:0/2877783082 shutdown_connections 2024-09-18T21:10:40.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:40.478+0000 7ffbe2570640 1 -- 172.21.15.77:0/2877783082 wait complete. 2024-09-18T21:10:40.487 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-09-18T21:10:41.533 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-09-18T21:10:41.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:41 smithi077 ceph-mon[27689]: pgmap v179: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-09-18T21:10:41.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:41 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/2877783082' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-18T21:10:41.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:41 smithi103 ceph-mon[34827]: pgmap v179: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-09-18T21:10:41.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:41 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/2877783082' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-18T21:10:42.201 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:10:43.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:43 smithi077 ceph-mon[27689]: pgmap v180: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:10:43.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:43 smithi103 ceph-mon[34827]: pgmap v180: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:10:44.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:44.453+0000 7f6c26c39640 1 -- 172.21.15.77:0/2059648751 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c200fc530 msgr2=0x7f6c200fc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:44.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:44.453+0000 7f6c26c39640 1 --2- 172.21.15.77:0/2059648751 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c200fc530 0x7f6c200fc940 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6c140048d0 tx=0x7f6c14009da0 comp rx=0 tx=0).stop 2024-09-18T21:10:44.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:44.453+0000 7f6c26c39640 1 -- 172.21.15.77:0/2059648751 shutdown_connections 2024-09-18T21:10:44.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:44.453+0000 7f6c26c39640 1 --2- 172.21.15.77:0/2059648751 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c200fd800 0x7f6c200fdc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:44.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:44.453+0000 7f6c26c39640 1 --2- 172.21.15.77:0/2059648751 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c200fc530 0x7f6c200fc940 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:44.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:44.453+0000 7f6c26c39640 1 -- 172.21.15.77:0/2059648751 >> 172.21.15.77:0/2059648751 conn(0x7f6c200f7d10 msgr2=0x7f6c200fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:10:44.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:44.453+0000 7f6c26c39640 1 -- 172.21.15.77:0/2059648751 shutdown_connections 2024-09-18T21:10:44.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:44.453+0000 7f6c26c39640 1 -- 172.21.15.77:0/2059648751 wait complete. 2024-09-18T21:10:44.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:44.453+0000 7f6c26c39640 1 Processor -- start 2024-09-18T21:10:44.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:44.453+0000 7f6c26c39640 1 -- start start 2024-09-18T21:10:44.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:44.454+0000 7f6c26c39640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c200fc530 0x7f6c2010d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:44.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:44.454+0000 7f6c26c39640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c200fd800 0x7f6c2010d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:44.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:44.454+0000 7f6c26c39640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2010dc20 con 0x7f6c200fd800 2024-09-18T21:10:44.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:44.454+0000 7f6c26c39640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2010e440 con 0x7f6c200fc530 2024-09-18T21:10:44.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:44.454+0000 7f6c1ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c200fd800 0x7f6c2010d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:44.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:44.454+0000 7f6c1ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c200fd800 0x7f6c2010d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41438/0 (socket says 172.21.15.77:41438) 2024-09-18T21:10:44.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:44.454+0000 7f6c1ffff640 1 -- 172.21.15.77:0/1806327533 learned_addr learned my addr 172.21.15.77:0/1806327533 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:10:44.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:44.454+0000 7f6c249d5640 1 --2- 172.21.15.77:0/1806327533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c200fc530 0x7f6c2010d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:44.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:44.454+0000 7f6c1ffff640 1 -- 172.21.15.77:0/1806327533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c200fc530 msgr2=0x7f6c2010d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:44.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:44.454+0000 7f6c1ffff640 1 --2- 172.21.15.77:0/1806327533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c200fc530 0x7f6c2010d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:44.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:44.454+0000 7f6c1ffff640 1 -- 172.21.15.77:0/1806327533 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c14005040 con 0x7f6c200fd800 2024-09-18T21:10:44.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:44.454+0000 7f6c1ffff640 1 --2- 172.21.15.77:0/1806327533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c200fd800 0x7f6c2010d5d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c002a50 tx=0x7f6c0c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:10:44.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:44.454+0000 7f6c1d7fa640 1 -- 172.21.15.77:0/1806327533 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c0c007c30 con 0x7f6c200fd800 2024-09-18T21:10:44.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:44.455+0000 7f6c1d7fa640 1 -- 172.21.15.77:0/1806327533 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6c0c00f040 con 0x7f6c200fd800 2024-09-18T21:10:44.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:44.455+0000 7f6c26c39640 1 -- 172.21.15.77:0/1806327533 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c2010e6d0 con 0x7f6c200fd800 2024-09-18T21:10:44.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:44.455+0000 7f6c1d7fa640 1 -- 172.21.15.77:0/1806327533 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c0c00da10 con 0x7f6c200fd800 2024-09-18T21:10:44.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:44.455+0000 7f6c26c39640 1 -- 172.21.15.77:0/1806327533 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c2010ec70 con 0x7f6c200fd800 2024-09-18T21:10:44.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:44.456+0000 7f6c26c39640 1 -- 172.21.15.77:0/1806327533 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c200fb990 con 0x7f6c200fd800 2024-09-18T21:10:44.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:44.456+0000 7f6c1d7fa640 1 -- 172.21.15.77:0/1806327533 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f6c0c00dc80 con 0x7f6c200fd800 2024-09-18T21:10:44.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:44.456+0000 7f6c1d7fa640 1 --2- 172.21.15.77:0/1806327533 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f6c1006ed50 0x7f6c10071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:44.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:44.457+0000 7f6c249d5640 1 --2- 172.21.15.77:0/1806327533 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f6c1006ed50 0x7f6c10071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:44.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:44.457+0000 7f6c1d7fa640 1 -- 172.21.15.77:0/1806327533 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f6c0c08d940 con 0x7f6c200fd800 2024-09-18T21:10:44.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:44.457+0000 7f6c249d5640 1 --2- 172.21.15.77:0/1806327533 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f6c1006ed50 0x7f6c10071200 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6c14000c00 tx=0x7f6c14035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:10:44.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:44.460+0000 7f6c1d7fa640 1 -- 172.21.15.77:0/1806327533 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f6c0c04d2a0 con 0x7f6c200fd800 2024-09-18T21:10:44.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:44.680+0000 7f6c26c39640 1 -- 172.21.15.77:0/1806327533 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f6c2010ef30 con 0x7f6c200fd800 2024-09-18T21:10:44.681 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:44 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:10:44.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:44.680+0000 7f6c1d7fa640 1 -- 172.21.15.77:0/1806327533 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v13) v1 ==== 78+0+100 (secure 0 0 0) 0x7f6c0c05ab10 con 0x7f6c200fd800 2024-09-18T21:10:44.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:44.682+0000 7f6c26c39640 1 -- 172.21.15.77:0/1806327533 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f6c1006ed50 msgr2=0x7f6c10071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:44.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:44.682+0000 7f6c26c39640 1 --2- 172.21.15.77:0/1806327533 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f6c1006ed50 0x7f6c10071200 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6c14000c00 tx=0x7f6c14035040 comp rx=0 tx=0).stop 2024-09-18T21:10:44.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:44.682+0000 7f6c26c39640 1 -- 172.21.15.77:0/1806327533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c200fd800 msgr2=0x7f6c2010d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:44.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:44.682+0000 7f6c26c39640 1 --2- 172.21.15.77:0/1806327533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c200fd800 0x7f6c2010d5d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c002a50 tx=0x7f6c0c004600 comp rx=0 tx=0).stop 2024-09-18T21:10:44.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:44.682+0000 7f6c26c39640 1 -- 172.21.15.77:0/1806327533 shutdown_connections 2024-09-18T21:10:44.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:44.682+0000 7f6c26c39640 1 --2- 172.21.15.77:0/1806327533 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f6c1006ed50 0x7f6c10071200 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:44.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:44.682+0000 7f6c26c39640 1 --2- 172.21.15.77:0/1806327533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c200fd800 0x7f6c2010d5d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:44.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:44.682+0000 7f6c26c39640 1 --2- 172.21.15.77:0/1806327533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c200fc530 0x7f6c2010d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:44.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:44.682+0000 7f6c26c39640 1 -- 172.21.15.77:0/1806327533 >> 172.21.15.77:0/1806327533 conn(0x7f6c200f7d10 msgr2=0x7f6c200f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:10:44.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:44.683+0000 7f6c26c39640 1 -- 172.21.15.77:0/1806327533 shutdown_connections 2024-09-18T21:10:44.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:44.683+0000 7f6c26c39640 1 -- 172.21.15.77:0/1806327533 wait complete. 2024-09-18T21:10:44.692 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-09-18T21:10:44.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:44 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:10:45.483 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-09-18T21:10:45.497 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-18T21:10:45.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:45 smithi077 ceph-mon[27689]: pgmap v181: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:10:45.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:45 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/1806327533' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-18T21:10:45.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:45 smithi103 ceph-mon[34827]: pgmap v181: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:10:45.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:45 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/1806327533' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-18T21:10:45.792 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:10:46.875 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:46 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:46.875 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:46 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:46.875 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:46 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:10:46.875 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:46 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:10:46.875 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:46 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:47.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:46 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:47.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:46 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:47.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:46 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:10:47.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:46 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:10:47.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:46 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:10:47.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:47.323+0000 7f6c97a57640 1 -- 172.21.15.77:0/1400840627 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c90102570 msgr2=0x7f6c90102940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:47.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:47.323+0000 7f6c97a57640 1 --2- 172.21.15.77:0/1400840627 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c90102570 0x7f6c90102940 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c0048d0 tx=0x7f6c8c009da0 comp rx=0 tx=0).stop 2024-09-18T21:10:47.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:47.323+0000 7f6c97a57640 1 -- 172.21.15.77:0/1400840627 shutdown_connections 2024-09-18T21:10:47.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:47.323+0000 7f6c97a57640 1 --2- 172.21.15.77:0/1400840627 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c90102f10 0x7f6c900fc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:47.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:47.323+0000 7f6c97a57640 1 --2- 172.21.15.77:0/1400840627 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c90102570 0x7f6c90102940 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:47.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:47.323+0000 7f6c97a57640 1 -- 172.21.15.77:0/1400840627 >> 172.21.15.77:0/1400840627 conn(0x7f6c900f8110 msgr2=0x7f6c900fa520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:10:47.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:47.324+0000 7f6c97a57640 1 -- 172.21.15.77:0/1400840627 shutdown_connections 2024-09-18T21:10:47.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:47.324+0000 7f6c97a57640 1 -- 172.21.15.77:0/1400840627 wait complete. 2024-09-18T21:10:47.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:47.324+0000 7f6c97a57640 1 Processor -- start 2024-09-18T21:10:47.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:47.324+0000 7f6c97a57640 1 -- start start 2024-09-18T21:10:47.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:47.324+0000 7f6c97a57640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c90102570 0x7f6c90113270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:47.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:47.324+0000 7f6c97a57640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c90102f10 0x7f6c901137b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:47.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:47.324+0000 7f6c97a57640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c90113e40 con 0x7f6c90102f10 2024-09-18T21:10:47.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:47.324+0000 7f6c97a57640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9010d1f0 con 0x7f6c90102570 2024-09-18T21:10:47.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:47.324+0000 7f6c94ff2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c90102f10 0x7f6c901137b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:47.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:47.324+0000 7f6c94ff2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c90102f10 0x7f6c901137b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41448/0 (socket says 172.21.15.77:41448) 2024-09-18T21:10:47.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:47.324+0000 7f6c94ff2640 1 -- 172.21.15.77:0/1448529759 learned_addr learned my addr 172.21.15.77:0/1448529759 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:10:47.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:47.325+0000 7f6c957f3640 1 --2- 172.21.15.77:0/1448529759 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c90102570 0x7f6c90113270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:47.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:47.325+0000 7f6c94ff2640 1 -- 172.21.15.77:0/1448529759 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c90102570 msgr2=0x7f6c90113270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:47.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:47.325+0000 7f6c94ff2640 1 --2- 172.21.15.77:0/1448529759 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c90102570 0x7f6c90113270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:47.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:47.325+0000 7f6c94ff2640 1 -- 172.21.15.77:0/1448529759 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8c005040 con 0x7f6c90102f10 2024-09-18T21:10:47.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:47.325+0000 7f6c94ff2640 1 --2- 172.21.15.77:0/1448529759 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c90102f10 0x7f6c901137b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6c8000b540 tx=0x7f6c800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:10:47.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:47.325+0000 7f6c85ffb640 1 -- 172.21.15.77:0/1448529759 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c8000f6f0 con 0x7f6c90102f10 2024-09-18T21:10:47.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:47.325+0000 7f6c85ffb640 1 -- 172.21.15.77:0/1448529759 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6c8000fcf0 con 0x7f6c90102f10 2024-09-18T21:10:47.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:47.325+0000 7f6c85ffb640 1 -- 172.21.15.77:0/1448529759 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c800103a0 con 0x7f6c90102f10 2024-09-18T21:10:47.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:47.325+0000 7f6c97a57640 1 -- 172.21.15.77:0/1448529759 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c9010d4d0 con 0x7f6c90102f10 2024-09-18T21:10:47.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:47.325+0000 7f6c97a57640 1 -- 172.21.15.77:0/1448529759 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c9010d9f0 con 0x7f6c90102f10 2024-09-18T21:10:47.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:47.326+0000 7f6c97a57640 1 -- 172.21.15.77:0/1448529759 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c900fdcf0 con 0x7f6c90102f10 2024-09-18T21:10:47.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:47.327+0000 7f6c85ffb640 1 -- 172.21.15.77:0/1448529759 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f6c8000f850 con 0x7f6c90102f10 2024-09-18T21:10:47.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:47.327+0000 7f6c85ffb640 1 --2- 172.21.15.77:0/1448529759 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f6c7c06ed60 0x7f6c7c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:47.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:47.327+0000 7f6c957f3640 1 --2- 172.21.15.77:0/1448529759 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f6c7c06ed60 0x7f6c7c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:47.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:47.327+0000 7f6c85ffb640 1 -- 172.21.15.77:0/1448529759 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f6c8008dfd0 con 0x7f6c90102f10 2024-09-18T21:10:47.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:47.328+0000 7f6c957f3640 1 --2- 172.21.15.77:0/1448529759 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f6c7c06ed60 0x7f6c7c071210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c000c00 tx=0x7f6c8c035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:10:47.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:47.331+0000 7f6c85ffb640 1 -- 172.21.15.77:0/1448529759 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f6c8005b210 con 0x7f6c90102f10 2024-09-18T21:10:47.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:47.518+0000 7f6c97a57640 1 -- 172.21.15.77:0/1448529759 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c90109680 con 0x7f6c90102f10 2024-09-18T21:10:47.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:47.518+0000 7f6c85ffb640 1 -- 172.21.15.77:0/1448529759 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4686 (secure 0 0 0) 0x7f6c8005abb0 con 0x7f6c90102f10 2024-09-18T21:10:47.519 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:10:47.519 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14458,"name":"cephfs.smithi077.cqfhlw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.77:6829/862540650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":862540650},{"type":"v1","addr":"172.21.15.77:6829","nonce":862540650}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24255,"name":"cephfs.smithi103.zhdmdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.103:6825/2170237078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2170237078},{"type":"v1","addr":"172.21.15.103:6825","nonce":2170237078}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24267,"name":"cephfs.smithi103.opftmf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.103:6827/4241818403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":4241818403},{"type":"v1","addr":"172.21.15.103:6827","nonce":4241818403}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T21:10:17.230179+0000","modified":"2024-09-18T21:10:33.373241+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14446},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14446":{"gid":14446,"name":"cephfs.smithi077.vruydi","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.77:6827/334039954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":334039954},{"type":"v1","addr":"172.21.15.77:6827","nonce":334039954}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-09-18T21:10:47.520 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 13 2024-09-18T21:10:47.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:47.520+0000 7f6c97a57640 1 -- 172.21.15.77:0/1448529759 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f6c7c06ed60 msgr2=0x7f6c7c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:47.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:47.520+0000 7f6c97a57640 1 --2- 172.21.15.77:0/1448529759 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f6c7c06ed60 0x7f6c7c071210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c000c00 tx=0x7f6c8c035040 comp rx=0 tx=0).stop 2024-09-18T21:10:47.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:47.520+0000 7f6c97a57640 1 -- 172.21.15.77:0/1448529759 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c90102f10 msgr2=0x7f6c901137b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:47.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:47.520+0000 7f6c97a57640 1 --2- 172.21.15.77:0/1448529759 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c90102f10 0x7f6c901137b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6c8000b540 tx=0x7f6c800091a0 comp rx=0 tx=0).stop 2024-09-18T21:10:47.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:47.520+0000 7f6c97a57640 1 -- 172.21.15.77:0/1448529759 shutdown_connections 2024-09-18T21:10:47.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:47.520+0000 7f6c97a57640 1 --2- 172.21.15.77:0/1448529759 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f6c7c06ed60 0x7f6c7c071210 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:47.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:47.520+0000 7f6c97a57640 1 --2- 172.21.15.77:0/1448529759 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c90102f10 0x7f6c901137b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:47.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:47.520+0000 7f6c97a57640 1 --2- 172.21.15.77:0/1448529759 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c90102570 0x7f6c90113270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:47.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:47.520+0000 7f6c97a57640 1 -- 172.21.15.77:0/1448529759 >> 172.21.15.77:0/1448529759 conn(0x7f6c900f8110 msgr2=0x7f6c900f9130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:10:47.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:47.520+0000 7f6c97a57640 1 -- 172.21.15.77:0/1448529759 shutdown_connections 2024-09-18T21:10:47.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:47.520+0000 7f6c97a57640 1 -- 172.21.15.77:0/1448529759 wait complete. 2024-09-18T21:10:47.844 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:47 smithi077 ceph-mon[27689]: pgmap v182: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:10:47.844 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:47 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/1448529759' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-18T21:10:48.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:47 smithi103 ceph-mon[34827]: pgmap v182: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:10:48.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:47 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/1448529759' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-18T21:10:48.151 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 13, 'max_mds': 1, 'flags': 18} 2024-09-18T21:10:48.151 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-18T21:10:48.179 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-18T21:10:48.179 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-09-18T21:10:48.180 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-18T21:10:48.180 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-18T21:10:48.180 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-18T21:10:48.180 INFO:tasks.ceph_fuse:client.1 config is {} 2024-09-18T21:10:48.180 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-18T21:10:48.180 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-18T21:10:48.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T21:10:48.180 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2024-09-18T21:10:48.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T21:10:48.199 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link delete ceph-brx 2024-09-18T21:10:48.266 INFO:teuthology.orchestra.run.smithi077.stderr:Cannot find device "ceph-brx" 2024-09-18T21:10:48.267 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T21:10:48.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T21:10:48.268 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-09-18T21:10:48.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T21:10:48.288 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link delete ceph-brx 2024-09-18T21:10:48.361 INFO:teuthology.orchestra.run.smithi103.stderr:Cannot find device "ceph-brx" 2024-09-18T21:10:48.362 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T21:10:48.363 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-18T21:10:48.363 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-18T21:10:48.363 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-18T21:10:48.606 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:10:49.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:49 smithi077 ceph-mon[27689]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:10:50.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:50.176+0000 7f8d7cbe8640 1 -- 172.21.15.77:0/1521792574 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d78102560 msgr2=0x7f8d78102930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:50.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:50.176+0000 7f8d7cbe8640 1 --2- 172.21.15.77:0/1521792574 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d78102560 0x7f8d78102930 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8d680048d0 tx=0x7f8d68009da0 comp rx=0 tx=0).stop 2024-09-18T21:10:50.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:50.176+0000 7f8d7cbe8640 1 -- 172.21.15.77:0/1521792574 shutdown_connections 2024-09-18T21:10:50.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:50.176+0000 7f8d7cbe8640 1 --2- 172.21.15.77:0/1521792574 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d78102f00 0x7f8d780fc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:50.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:50.176+0000 7f8d7cbe8640 1 --2- 172.21.15.77:0/1521792574 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d78102560 0x7f8d78102930 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:50.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:50.176+0000 7f8d7cbe8640 1 -- 172.21.15.77:0/1521792574 >> 172.21.15.77:0/1521792574 conn(0x7f8d780f8120 msgr2=0x7f8d780fa530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:10:50.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:50.176+0000 7f8d7cbe8640 1 -- 172.21.15.77:0/1521792574 shutdown_connections 2024-09-18T21:10:50.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:50.176+0000 7f8d7cbe8640 1 -- 172.21.15.77:0/1521792574 wait complete. 2024-09-18T21:10:50.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:50.177+0000 7f8d7cbe8640 1 Processor -- start 2024-09-18T21:10:50.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:50.177+0000 7f8d7cbe8640 1 -- start start 2024-09-18T21:10:50.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:50.177+0000 7f8d7cbe8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d78102560 0x7f8d78113220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:50.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:50.177+0000 7f8d7cbe8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d78102f00 0x7f8d78113760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:50.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:50.177+0000 7f8d7cbe8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d78113d60 con 0x7f8d78102f00 2024-09-18T21:10:50.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:50.177+0000 7f8d7cbe8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7810d1a0 con 0x7f8d78102560 2024-09-18T21:10:50.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:50.177+0000 7f8d75d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d78102f00 0x7f8d78113760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:50.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:50.177+0000 7f8d75d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d78102f00 0x7f8d78113760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57830/0 (socket says 172.21.15.77:57830) 2024-09-18T21:10:50.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:50.177+0000 7f8d75d9b640 1 -- 172.21.15.77:0/67789324 learned_addr learned my addr 172.21.15.77:0/67789324 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:10:50.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:50.177+0000 7f8d7659c640 1 --2- 172.21.15.77:0/67789324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d78102560 0x7f8d78113220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:50.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:50.177+0000 7f8d75d9b640 1 -- 172.21.15.77:0/67789324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d78102560 msgr2=0x7f8d78113220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:50.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:50.177+0000 7f8d75d9b640 1 --2- 172.21.15.77:0/67789324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d78102560 0x7f8d78113220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:50.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:50.177+0000 7f8d75d9b640 1 -- 172.21.15.77:0/67789324 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d68005040 con 0x7f8d78102f00 2024-09-18T21:10:50.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:50.177+0000 7f8d75d9b640 1 --2- 172.21.15.77:0/67789324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d78102f00 0x7f8d78113760 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8d6000c760 tx=0x7f8d6000cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:10:50.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:50.178+0000 7f8d6effd640 1 -- 172.21.15.77:0/67789324 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d6000a7a0 con 0x7f8d78102f00 2024-09-18T21:10:50.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:50.178+0000 7f8d6effd640 1 -- 172.21.15.77:0/67789324 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8d6000ada0 con 0x7f8d78102f00 2024-09-18T21:10:50.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:50.178+0000 7f8d7cbe8640 1 -- 172.21.15.77:0/67789324 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d7810d480 con 0x7f8d78102f00 2024-09-18T21:10:50.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:50.178+0000 7f8d6effd640 1 -- 172.21.15.77:0/67789324 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d600113a0 con 0x7f8d78102f00 2024-09-18T21:10:50.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:50.178+0000 7f8d7cbe8640 1 -- 172.21.15.77:0/67789324 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d7810da20 con 0x7f8d78102f00 2024-09-18T21:10:50.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:50.179+0000 7f8d7cbe8640 1 -- 172.21.15.77:0/67789324 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d780fdce0 con 0x7f8d78102f00 2024-09-18T21:10:50.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:50.179+0000 7f8d6effd640 1 -- 172.21.15.77:0/67789324 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f8d60012400 con 0x7f8d78102f00 2024-09-18T21:10:50.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:50.180+0000 7f8d6effd640 1 --2- 172.21.15.77:0/67789324 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f8d6406ed50 0x7f8d64071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:50.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:50.180+0000 7f8d6effd640 1 -- 172.21.15.77:0/67789324 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f8d6008e290 con 0x7f8d78102f00 2024-09-18T21:10:50.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:50.180+0000 7f8d7659c640 1 --2- 172.21.15.77:0/67789324 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f8d6406ed50 0x7f8d64071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:50.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:50.180+0000 7f8d7659c640 1 --2- 172.21.15.77:0/67789324 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f8d6406ed50 0x7f8d64071200 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8d68009ac0 tx=0x7f8d68035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:10:50.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:50.184+0000 7f8d6effd640 1 -- 172.21.15.77:0/67789324 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8d6005b430 con 0x7f8d78102f00 2024-09-18T21:10:50.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:49 smithi103 ceph-mon[34827]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:10:50.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:50.376+0000 7f8d7cbe8640 1 -- 172.21.15.77:0/67789324 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8d780fbd60 con 0x7f8d78102f00 2024-09-18T21:10:50.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:50.376+0000 7f8d6effd640 1 -- 172.21.15.77:0/67789324 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+83 (secure 0 0 0) 0x7f8d6005add0 con 0x7f8d78102f00 2024-09-18T21:10:50.377 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-18T21:10:50.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:50.378+0000 7f8d7cbe8640 1 -- 172.21.15.77:0/67789324 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f8d6406ed50 msgr2=0x7f8d64071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:50.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:50.378+0000 7f8d7cbe8640 1 --2- 172.21.15.77:0/67789324 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f8d6406ed50 0x7f8d64071200 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8d68009ac0 tx=0x7f8d68035040 comp rx=0 tx=0).stop 2024-09-18T21:10:50.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:50.378+0000 7f8d7cbe8640 1 -- 172.21.15.77:0/67789324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d78102f00 msgr2=0x7f8d78113760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:50.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:50.378+0000 7f8d7cbe8640 1 --2- 172.21.15.77:0/67789324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d78102f00 0x7f8d78113760 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8d6000c760 tx=0x7f8d6000cb60 comp rx=0 tx=0).stop 2024-09-18T21:10:50.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:50.378+0000 7f8d7cbe8640 1 -- 172.21.15.77:0/67789324 shutdown_connections 2024-09-18T21:10:50.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:50.379+0000 7f8d7cbe8640 1 --2- 172.21.15.77:0/67789324 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f8d6406ed50 0x7f8d64071200 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:50.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:50.379+0000 7f8d7cbe8640 1 --2- 172.21.15.77:0/67789324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d78102f00 0x7f8d78113760 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:50.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:50.379+0000 7f8d7cbe8640 1 --2- 172.21.15.77:0/67789324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8d78102560 0x7f8d78113220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:50.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:50.379+0000 7f8d7cbe8640 1 -- 172.21.15.77:0/67789324 >> 172.21.15.77:0/67789324 conn(0x7f8d780f8120 msgr2=0x7f8d780f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:10:50.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:50.379+0000 7f8d7cbe8640 1 -- 172.21.15.77:0/67789324 shutdown_connections 2024-09-18T21:10:50.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:50.379+0000 7f8d7cbe8640 1 -- 172.21.15.77:0/67789324 wait complete. 2024-09-18T21:10:50.976 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-18T21:10:50.976 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-18T21:10:50.976 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi077.front.sepia.ceph.com 2024-09-18T21:10:50.976 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-18T21:10:50.976 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-18T21:10:50.976 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-18T21:10:50.976 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-18T21:10:50.976 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-18T21:10:50.976 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-18T21:10:50.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T21:10:50.976 DEBUG:teuthology.orchestra.run.smithi077:> ip addr 2024-09-18T21:10:50.993 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-18T21:10:50.993 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-18T21:10:50.993 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2024-09-18T21:10:50.994 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-09-18T21:10:50.994 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2024-09-18T21:10:50.994 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-09-18T21:10:50.994 INFO:teuthology.orchestra.run.smithi077.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-18T21:10:50.994 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d8 brd ff:ff:ff:ff:ff:ff 2024-09-18T21:10:50.994 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f0 2024-09-18T21:10:50.994 INFO:teuthology.orchestra.run.smithi077.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-18T21:10:50.994 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d9 brd ff:ff:ff:ff:ff:ff 2024-09-18T21:10:50.994 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f1 2024-09-18T21:10:50.994 INFO:teuthology.orchestra.run.smithi077.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-18T21:10:50.994 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d2 brd ff:ff:ff:ff:ff:ff 2024-09-18T21:10:50.994 INFO:teuthology.orchestra.run.smithi077.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-18T21:10:50.994 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d3 brd ff:ff:ff:ff:ff:ff 2024-09-18T21:10:50.994 INFO:teuthology.orchestra.run.smithi077.stdout: inet 172.21.15.77/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-18T21:10:50.994 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft 42344sec preferred_lft 42344sec 2024-09-18T21:10:50.995 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::ec4:7aff:fe8f:d3d3/64 scope link noprefixroute 2024-09-18T21:10:50.995 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-09-18T21:10:50.995 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-18T21:10:50.995 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-18T21:10:50.995 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-09-18T21:10:50.995 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link add name ceph-brx type bridge 2024-09-18T21:10:50.995 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip addr flush dev ceph-brx 2024-09-18T21:10:50.995 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set ceph-brx up 2024-09-18T21:10:50.995 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-18T21:10:50.996 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-09-18T21:10:51.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-18T21:10:51.090 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:50 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/67789324' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-18T21:10:51.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T21:10:51.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T21:10:51.204 DEBUG:teuthology.orchestra.run.smithi077:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-18T21:10:51.229 INFO:teuthology.orchestra.run.smithi077.stdout:1 2024-09-18T21:10:51.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T21:10:51.231 DEBUG:teuthology.orchestra.run.smithi077:> route 2024-09-18T21:10:51.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:50 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/67789324' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-18T21:10:51.306 INFO:teuthology.orchestra.run.smithi077.stdout:Kernel IP routing table 2024-09-18T21:10:51.306 INFO:teuthology.orchestra.run.smithi077.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-18T21:10:51.306 INFO:teuthology.orchestra.run.smithi077.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-18T21:10:51.306 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-18T21:10:51.306 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-18T21:10:51.306 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-18T21:10:51.307 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-09-18T21:10:51.307 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-18T21:10:51.307 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-18T21:10:51.307 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-18T21:10:51.307 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-09-18T21:10:51.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-18T21:10:51.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T21:10:51.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T21:10:51.627 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2024-09-18T21:10:51.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T21:10:51.643 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list-id 2024-09-18T21:10:51.698 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-18T21:10:51.698 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-09-18T21:10:51.698 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-18T21:10:51.698 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-18T21:10:51.698 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-09-18T21:10:51.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-18T21:10:51.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T21:10:51.815 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-18T21:10:51.815 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-18T21:10:51.815 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-09-18T21:10:51.815 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-18T21:10:51.815 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-18T21:10:51.815 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-18T21:10:51.815 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-18T21:10:51.815 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-18T21:10:51.815 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-09-18T21:10:51.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-18T21:10:51.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T21:10:51.943 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-18T21:10:51.943 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-09-18T21:10:51.943 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set brx.0 up 2024-09-18T21:10:51.943 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set dev brx.0 master ceph-brx 2024-09-18T21:10:51.943 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-09-18T21:10:51.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-18T21:10:52.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T21:10:52.019 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-18T21:10:52.019 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-18T21:10:52.019 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-18T21:10:52.034 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-18T21:10:52.034 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-18T21:10:52.034 DEBUG:teuthology.orchestra.run.smithi077:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-18T21:10:52.089 DEBUG:teuthology.orchestra.run.smithi077:> sudo modprobe fuse 2024-09-18T21:10:52.150 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:51 smithi077 ceph-mon[27689]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:10:52.155 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2024-09-18T21:10:52.212 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2024-09-18T21:10:52.212 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2024-09-18T21:10:52.212 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2024-09-18T21:10:52.212 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2024-09-18T21:10:52.212 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2024-09-18T21:10:52.212 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2024-09-18T21:10:52.212 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2024-09-18T21:10:52.213 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2024-09-18T21:10:52.213 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2024-09-18T21:10:52.213 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2024-09-18T21:10:52.213 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2024-09-18T21:10:52.213 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/selinux 2024-09-18T21:10:52.213 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2024-09-18T21:10:52.213 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2024-09-18T21:10:52.213 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2024-09-18T21:10:52.213 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2024-09-18T21:10:52.213 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2024-09-18T21:10:52.213 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2024-09-18T21:10:52.213 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2024-09-18T21:10:52.214 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysctl.service 2024-09-18T21:10:52.214 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-18T21:10:52.214 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-18T21:10:52.214 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/nfs/rpc_pipefs 2024-09-18T21:10:52.214 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2024-09-18T21:10:52.214 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2024-09-18T21:10:52.214 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay 2024-09-18T21:10:52.214 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/2a3e7285ff589bce80a87f2eb9a68d20cb51db34dd956376d1b17d005b848410/merged 2024-09-18T21:10:52.214 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/a422c668e535549689c617f01119151bf99de4dce10e6006e066abe184e91cc6/merged 2024-09-18T21:10:52.214 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/0 2024-09-18T21:10:52.214 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2024-09-18T21:10:52.214 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/a6107c40efcd53e25a27c22ede0cac6e15c4e15f2d9a2f1a5d83a4618e42c3a9/merged 2024-09-18T21:10:52.214 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/b16a0fc00b34ac5a410205159f62848f8d61c466f00a296551d45cd1e7bca0cb/merged 2024-09-18T21:10:52.214 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/bdc1ef6235c809d0bad1fbfe475ee50b8f904faaaee762d5d1c3bbb44d034137/merged 2024-09-18T21:10:52.214 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/5441ae2e508ed89158e283d87bc4b4b636167f95ab71ef9d42e6ab5cd5f462f6/merged 2024-09-18T21:10:52.215 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/aea07215aa117daf7b79ffba4591e37e4dae107ce1314ebcc4a61a9b28bc0cc2/merged 2024-09-18T21:10:52.215 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/36fb8bd03f79e7dc301909022ee96979e24d78d964116748b9ca29db37e9b5de/merged 2024-09-18T21:10:52.215 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/7378666dce062f55040d1b28a033db4a71af3f6487f79f776fafc2172f709790/merged 2024-09-18T21:10:52.215 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/824165ecf78d0f06614dc551452d85a46a3954c2e12d6c14094c310ef9d3902e/merged 2024-09-18T21:10:52.215 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/ed0a70f9f2a6a2825145cdae0c4a390f5ef5225d7f4d39b89d57c99347a6c528/merged 2024-09-18T21:10:52.215 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/ba4bab959cbebb5436c612c5818509a9e0a2b5e94d760a36373e5cba97189cb7/merged 2024-09-18T21:10:52.215 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2024-09-18T21:10:52.215 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-18T21:10:52.215 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-18T21:10:52.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T21:10:52.215 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2024-09-18T21:10:52.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:51 smithi103 ceph-mon[34827]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:10:52.267 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-18T21:10:52.268 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-18T21:10:52.310 DEBUG:teuthology.orchestra.run.smithi077:> sudo modprobe fuse 2024-09-18T21:10:52.334 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2024-09-18T21:10:52.390 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2024-09-18T21:10:52.391 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2024-09-18T21:10:52.391 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2024-09-18T21:10:52.391 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2024-09-18T21:10:52.391 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2024-09-18T21:10:52.391 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2024-09-18T21:10:52.391 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2024-09-18T21:10:52.391 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2024-09-18T21:10:52.391 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2024-09-18T21:10:52.391 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2024-09-18T21:10:52.391 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2024-09-18T21:10:52.392 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/selinux 2024-09-18T21:10:52.392 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2024-09-18T21:10:52.392 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2024-09-18T21:10:52.392 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2024-09-18T21:10:52.392 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2024-09-18T21:10:52.392 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2024-09-18T21:10:52.392 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2024-09-18T21:10:52.392 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2024-09-18T21:10:52.392 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysctl.service 2024-09-18T21:10:52.392 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-18T21:10:52.392 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-18T21:10:52.392 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/nfs/rpc_pipefs 2024-09-18T21:10:52.393 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2024-09-18T21:10:52.393 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2024-09-18T21:10:52.393 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay 2024-09-18T21:10:52.393 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/2a3e7285ff589bce80a87f2eb9a68d20cb51db34dd956376d1b17d005b848410/merged 2024-09-18T21:10:52.393 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/a422c668e535549689c617f01119151bf99de4dce10e6006e066abe184e91cc6/merged 2024-09-18T21:10:52.393 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/0 2024-09-18T21:10:52.393 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2024-09-18T21:10:52.393 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/a6107c40efcd53e25a27c22ede0cac6e15c4e15f2d9a2f1a5d83a4618e42c3a9/merged 2024-09-18T21:10:52.393 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/b16a0fc00b34ac5a410205159f62848f8d61c466f00a296551d45cd1e7bca0cb/merged 2024-09-18T21:10:52.393 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/bdc1ef6235c809d0bad1fbfe475ee50b8f904faaaee762d5d1c3bbb44d034137/merged 2024-09-18T21:10:52.393 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/5441ae2e508ed89158e283d87bc4b4b636167f95ab71ef9d42e6ab5cd5f462f6/merged 2024-09-18T21:10:52.393 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/aea07215aa117daf7b79ffba4591e37e4dae107ce1314ebcc4a61a9b28bc0cc2/merged 2024-09-18T21:10:52.393 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/36fb8bd03f79e7dc301909022ee96979e24d78d964116748b9ca29db37e9b5de/merged 2024-09-18T21:10:52.394 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/7378666dce062f55040d1b28a033db4a71af3f6487f79f776fafc2172f709790/merged 2024-09-18T21:10:52.394 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/824165ecf78d0f06614dc551452d85a46a3954c2e12d6c14094c310ef9d3902e/merged 2024-09-18T21:10:52.394 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/ed0a70f9f2a6a2825145cdae0c4a390f5ef5225d7f4d39b89d57c99347a6c528/merged 2024-09-18T21:10:52.394 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/ba4bab959cbebb5436c612c5818509a9e0a2b5e94d760a36373e5cba97189cb7/merged 2024-09-18T21:10:52.394 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2024-09-18T21:10:52.394 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-18T21:10:52.394 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-18T21:10:52.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T21:10:52.394 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2024-09-18T21:10:52.410 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:2024-09-18T21:10:52.409+0000 7fb3dbcc1300 -1 init, newargv = 0x556a1c3d74f0 newargc=15 2024-09-18T21:10:52.410 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:ceph-fuse[75559]: starting ceph client 2024-09-18T21:10:52.414 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:ceph-fuse[75559]: starting fuse 2024-09-18T21:10:52.425 INFO:teuthology.orchestra.run.smithi077.stdout:153 2024-09-18T21:10:52.425 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [153] 2024-09-18T21:10:52.426 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer -- python3 -c ' 2024-09-18T21:10:52.426 DEBUG:teuthology.orchestra.run.smithi077:> import glob 2024-09-18T21:10:52.426 DEBUG:teuthology.orchestra.run.smithi077:> import re 2024-09-18T21:10:52.426 DEBUG:teuthology.orchestra.run.smithi077:> import os 2024-09-18T21:10:52.426 DEBUG:teuthology.orchestra.run.smithi077:> import subprocess 2024-09-18T21:10:52.426 DEBUG:teuthology.orchestra.run.smithi077:> 2024-09-18T21:10:52.426 DEBUG:teuthology.orchestra.run.smithi077:> def _find_admin_socket(client_name): 2024-09-18T21:10:52.426 DEBUG:teuthology.orchestra.run.smithi077:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-18T21:10:52.426 DEBUG:teuthology.orchestra.run.smithi077:> files = glob.glob(asok_path) 2024-09-18T21:10:52.427 DEBUG:teuthology.orchestra.run.smithi077:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-18T21:10:52.427 DEBUG:teuthology.orchestra.run.smithi077:> 2024-09-18T21:10:52.427 DEBUG:teuthology.orchestra.run.smithi077:> # Given a non-glob path, it better be there 2024-09-18T21:10:52.427 DEBUG:teuthology.orchestra.run.smithi077:> if "*" not in asok_path: 2024-09-18T21:10:52.427 DEBUG:teuthology.orchestra.run.smithi077:> assert(len(files) == 1) 2024-09-18T21:10:52.427 DEBUG:teuthology.orchestra.run.smithi077:> return files[0] 2024-09-18T21:10:52.427 DEBUG:teuthology.orchestra.run.smithi077:> 2024-09-18T21:10:52.427 DEBUG:teuthology.orchestra.run.smithi077:> for f in files: 2024-09-18T21:10:52.427 DEBUG:teuthology.orchestra.run.smithi077:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-18T21:10:52.427 DEBUG:teuthology.orchestra.run.smithi077:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-18T21:10:52.427 DEBUG:teuthology.orchestra.run.smithi077:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-18T21:10:52.427 DEBUG:teuthology.orchestra.run.smithi077:> contents = proc_f.read() 2024-09-18T21:10:52.427 DEBUG:teuthology.orchestra.run.smithi077:> if mountpoint in contents: 2024-09-18T21:10:52.427 DEBUG:teuthology.orchestra.run.smithi077:> return f 2024-09-18T21:10:52.428 DEBUG:teuthology.orchestra.run.smithi077:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-18T21:10:52.428 DEBUG:teuthology.orchestra.run.smithi077:> 2024-09-18T21:10:52.428 DEBUG:teuthology.orchestra.run.smithi077:> print(_find_admin_socket("client.0")) 2024-09-18T21:10:52.428 DEBUG:teuthology.orchestra.run.smithi077:> ' 2024-09-18T21:10:52.544 INFO:teuthology.orchestra.run.smithi077.stdout:/var/run/ceph/ceph-client.0.75559.asok 2024-09-18T21:10:52.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T21:10:52.554 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.75559.asok 2024-09-18T21:10:52.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T21:10:52.555 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.75559.asok status 2024-09-18T21:10:52.683 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-18T21:10:52.683 INFO:teuthology.orchestra.run.smithi077.stdout: "metadata": { 2024-09-18T21:10:52.683 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_sha1": "6e06d1e002b6603c076b9260a58131a040dabe75", 2024-09-18T21:10:52.683 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_version": "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)", 2024-09-18T21:10:52.683 INFO:teuthology.orchestra.run.smithi077.stdout: "entity_id": "0", 2024-09-18T21:10:52.683 INFO:teuthology.orchestra.run.smithi077.stdout: "hostname": "smithi077", 2024-09-18T21:10:52.683 INFO:teuthology.orchestra.run.smithi077.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-18T21:10:52.684 INFO:teuthology.orchestra.run.smithi077.stdout: "pid": "75559", 2024-09-18T21:10:52.684 INFO:teuthology.orchestra.run.smithi077.stdout: "root": "/" 2024-09-18T21:10:52.684 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:10:52.684 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_count": 0, 2024-09-18T21:10:52.684 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_pinned_count": 0, 2024-09-18T21:10:52.684 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 14492, 2024-09-18T21:10:52.684 INFO:teuthology.orchestra.run.smithi077.stdout: "inst": { 2024-09-18T21:10:52.684 INFO:teuthology.orchestra.run.smithi077.stdout: "name": { 2024-09-18T21:10:52.684 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "client", 2024-09-18T21:10:52.684 INFO:teuthology.orchestra.run.smithi077.stdout: "num": 14492 2024-09-18T21:10:52.684 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:10:52.684 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2024-09-18T21:10:52.684 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-09-18T21:10:52.684 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.1:0", 2024-09-18T21:10:52.684 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1125901818 2024-09-18T21:10:52.685 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-18T21:10:52.685 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:10:52.685 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2024-09-18T21:10:52.685 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-09-18T21:10:52.685 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.1:0", 2024-09-18T21:10:52.685 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1125901818 2024-09-18T21:10:52.685 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:10:52.685 INFO:teuthology.orchestra.run.smithi077.stdout: "inst_str": "client.14492 192.168.0.1:0/1125901818", 2024-09-18T21:10:52.685 INFO:teuthology.orchestra.run.smithi077.stdout: "addr_str": "192.168.0.1:0/1125901818", 2024-09-18T21:10:52.685 INFO:teuthology.orchestra.run.smithi077.stdout: "inode_count": 1, 2024-09-18T21:10:52.685 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_epoch": 13, 2024-09-18T21:10:52.685 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch": 43, 2024-09-18T21:10:52.685 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch_barrier": 0, 2024-09-18T21:10:52.686 INFO:teuthology.orchestra.run.smithi077.stdout: "blocklisted": false, 2024-09-18T21:10:52.686 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs" 2024-09-18T21:10:52.686 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-18T21:10:52.691 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-18T21:10:52.692 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-18T21:10:52.937 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:10:54.065 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:53 smithi077 ceph-mon[27689]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:10:54.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:53 smithi103 ceph-mon[34827]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:10:54.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:54.391+0000 7f4488af1640 1 -- 172.21.15.77:0/3747125367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4484102ed0 msgr2=0x7f44840fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:54.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:54.391+0000 7f4488af1640 1 --2- 172.21.15.77:0/3747125367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4484102ed0 0x7f44840fc590 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f44780048d0 tx=0x7f4478009da0 comp rx=0 tx=0).stop 2024-09-18T21:10:54.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:54.391+0000 7f4488af1640 1 -- 172.21.15.77:0/3747125367 shutdown_connections 2024-09-18T21:10:54.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:54.391+0000 7f4488af1640 1 --2- 172.21.15.77:0/3747125367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4484102ed0 0x7f44840fc590 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:54.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:54.391+0000 7f4488af1640 1 --2- 172.21.15.77:0/3747125367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4484102530 0x7f4484102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:54.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:54.391+0000 7f4488af1640 1 -- 172.21.15.77:0/3747125367 >> 172.21.15.77:0/3747125367 conn(0x7f44840f8110 msgr2=0x7f44840fa520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:10:54.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:54.391+0000 7f4488af1640 1 -- 172.21.15.77:0/3747125367 shutdown_connections 2024-09-18T21:10:54.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:54.391+0000 7f4488af1640 1 -- 172.21.15.77:0/3747125367 wait complete. 2024-09-18T21:10:54.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:54.392+0000 7f4488af1640 1 Processor -- start 2024-09-18T21:10:54.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:54.392+0000 7f4488af1640 1 -- start start 2024-09-18T21:10:54.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:54.392+0000 7f4488af1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4484102530 0x7f448406fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:54.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:54.392+0000 7f4488af1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4484102ed0 0x7f448406ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:54.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:54.392+0000 7f4488af1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4484070490 con 0x7f4484102ed0 2024-09-18T21:10:54.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:54.392+0000 7f4488af1640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4484070600 con 0x7f4484102530 2024-09-18T21:10:54.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:54.392+0000 7f4481d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4484102ed0 0x7f448406ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:54.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:54.392+0000 7f4481d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4484102ed0 0x7f448406ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57848/0 (socket says 172.21.15.77:57848) 2024-09-18T21:10:54.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:54.392+0000 7f4481d9b640 1 -- 172.21.15.77:0/316822511 learned_addr learned my addr 172.21.15.77:0/316822511 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:10:54.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:54.392+0000 7f448259c640 1 --2- 172.21.15.77:0/316822511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4484102530 0x7f448406fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:54.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:54.392+0000 7f4481d9b640 1 -- 172.21.15.77:0/316822511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4484102530 msgr2=0x7f448406fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:54.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:54.392+0000 7f4481d9b640 1 --2- 172.21.15.77:0/316822511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4484102530 0x7f448406fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:54.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:54.392+0000 7f4481d9b640 1 -- 172.21.15.77:0/316822511 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4478005040 con 0x7f4484102ed0 2024-09-18T21:10:54.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:54.392+0000 7f448259c640 1 --2- 172.21.15.77:0/316822511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4484102530 0x7f448406fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T21:10:54.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:54.393+0000 7f4481d9b640 1 --2- 172.21.15.77:0/316822511 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4484102ed0 0x7f448406ff50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f44780043d0 tx=0x7f4478009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:10:54.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:54.393+0000 7f4472ffd640 1 -- 172.21.15.77:0/316822511 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4478038070 con 0x7f4484102ed0 2024-09-18T21:10:54.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:54.393+0000 7f4472ffd640 1 -- 172.21.15.77:0/316822511 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f44780096e0 con 0x7f4484102ed0 2024-09-18T21:10:54.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:54.393+0000 7f4488af1640 1 -- 172.21.15.77:0/316822511 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4484070830 con 0x7f4484102ed0 2024-09-18T21:10:54.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:54.393+0000 7f4472ffd640 1 -- 172.21.15.77:0/316822511 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f447802c8a0 con 0x7f4484102ed0 2024-09-18T21:10:54.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:54.393+0000 7f4488af1640 1 -- 172.21.15.77:0/316822511 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44841197f0 con 0x7f4484102ed0 2024-09-18T21:10:54.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:54.394+0000 7f4488af1640 1 -- 172.21.15.77:0/316822511 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44840fdcb0 con 0x7f4484102ed0 2024-09-18T21:10:54.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:54.394+0000 7f4472ffd640 1 -- 172.21.15.77:0/316822511 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f4478030020 con 0x7f4484102ed0 2024-09-18T21:10:54.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:54.395+0000 7f4472ffd640 1 --2- 172.21.15.77:0/316822511 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f446c06ed60 0x7f446c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:54.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:54.395+0000 7f448259c640 1 --2- 172.21.15.77:0/316822511 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f446c06ed60 0x7f446c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:54.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:54.395+0000 7f4472ffd640 1 -- 172.21.15.77:0/316822511 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f44780adea0 con 0x7f4484102ed0 2024-09-18T21:10:54.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:54.395+0000 7f448259c640 1 --2- 172.21.15.77:0/316822511 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f446c06ed60 0x7f446c071210 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f44740093f0 tx=0x7f4474009ed0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:10:54.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:54.400+0000 7f4472ffd640 1 -- 172.21.15.77:0/316822511 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f447807b040 con 0x7f4484102ed0 2024-09-18T21:10:54.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:54.589+0000 7f4488af1640 1 -- 172.21.15.77:0/316822511 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f448404b720 con 0x7f4484102ed0 2024-09-18T21:10:54.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:54.590+0000 7f4472ffd640 1 -- 172.21.15.77:0/316822511 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+83 (secure 0 0 0) 0x7f447807a9e0 con 0x7f4484102ed0 2024-09-18T21:10:54.591 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-18T21:10:54.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:54.592+0000 7f4488af1640 1 -- 172.21.15.77:0/316822511 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f446c06ed60 msgr2=0x7f446c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:54.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:54.592+0000 7f4488af1640 1 --2- 172.21.15.77:0/316822511 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f446c06ed60 0x7f446c071210 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f44740093f0 tx=0x7f4474009ed0 comp rx=0 tx=0).stop 2024-09-18T21:10:54.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:54.592+0000 7f4488af1640 1 -- 172.21.15.77:0/316822511 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4484102ed0 msgr2=0x7f448406ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:54.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:54.592+0000 7f4488af1640 1 --2- 172.21.15.77:0/316822511 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4484102ed0 0x7f448406ff50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f44780043d0 tx=0x7f4478009da0 comp rx=0 tx=0).stop 2024-09-18T21:10:54.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:54.592+0000 7f4488af1640 1 -- 172.21.15.77:0/316822511 shutdown_connections 2024-09-18T21:10:54.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:54.592+0000 7f4488af1640 1 --2- 172.21.15.77:0/316822511 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f446c06ed60 0x7f446c071210 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:54.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:54.592+0000 7f4488af1640 1 --2- 172.21.15.77:0/316822511 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4484102ed0 0x7f448406ff50 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:54.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:54.592+0000 7f4488af1640 1 --2- 172.21.15.77:0/316822511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4484102530 0x7f448406fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:54.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:54.592+0000 7f4488af1640 1 -- 172.21.15.77:0/316822511 >> 172.21.15.77:0/316822511 conn(0x7f44840f8110 msgr2=0x7f44840f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:10:54.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:54.592+0000 7f4488af1640 1 -- 172.21.15.77:0/316822511 shutdown_connections 2024-09-18T21:10:54.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:54.592+0000 7f4488af1640 1 -- 172.21.15.77:0/316822511 wait complete. 2024-09-18T21:10:54.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:54 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/316822511' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-18T21:10:55.165 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:54 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/316822511' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-18T21:10:55.191 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-18T21:10:55.192 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-18T21:10:55.192 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi103.front.sepia.ceph.com 2024-09-18T21:10:55.192 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-18T21:10:55.192 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-18T21:10:55.192 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-18T21:10:55.192 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-18T21:10:55.192 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-18T21:10:55.192 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-18T21:10:55.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T21:10:55.192 DEBUG:teuthology.orchestra.run.smithi103:> ip addr 2024-09-18T21:10:55.212 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-18T21:10:55.212 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-18T21:10:55.212 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2024-09-18T21:10:55.212 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-18T21:10:55.212 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2024-09-18T21:10:55.212 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-18T21:10:55.212 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-18T21:10:55.212 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2024-09-18T21:10:55.212 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f0 2024-09-18T21:10:55.213 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-18T21:10:55.213 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2024-09-18T21:10:55.213 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f1 2024-09-18T21:10:55.213 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-18T21:10:55.213 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2024-09-18T21:10:55.213 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-18T21:10:55.213 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2024-09-18T21:10:55.213 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-18T21:10:55.213 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42335sec preferred_lft 42335sec 2024-09-18T21:10:55.213 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link noprefixroute 2024-09-18T21:10:55.214 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-18T21:10:55.214 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-18T21:10:55.214 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-18T21:10:55.214 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-18T21:10:55.214 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link add name ceph-brx type bridge 2024-09-18T21:10:55.214 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip addr flush dev ceph-brx 2024-09-18T21:10:55.214 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set ceph-brx up 2024-09-18T21:10:55.214 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-18T21:10:55.214 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-18T21:10:55.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:10:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-18T21:10:55.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:10:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T21:10:55.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T21:10:55.431 DEBUG:teuthology.orchestra.run.smithi103:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-18T21:10:55.457 INFO:teuthology.orchestra.run.smithi103.stdout:1 2024-09-18T21:10:55.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T21:10:55.459 DEBUG:teuthology.orchestra.run.smithi103:> route 2024-09-18T21:10:55.530 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2024-09-18T21:10:55.530 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-18T21:10:55.530 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-18T21:10:55.530 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-18T21:10:55.530 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-18T21:10:55.530 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-18T21:10:55.531 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-18T21:10:55.531 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-18T21:10:55.531 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-18T21:10:55.531 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-18T21:10:55.531 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-18T21:10:55.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:10:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-18T21:10:55.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:10:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T21:10:55.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T21:10:55.867 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-09-18T21:10:55.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T21:10:55.883 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list-id 2024-09-18T21:10:55.938 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-18T21:10:55.938 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-18T21:10:55.938 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-18T21:10:55.938 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-18T21:10:55.938 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-18T21:10:56.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:55 smithi103 ceph-mon[34827]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:10:56.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:10:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-18T21:10:56.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:10:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T21:10:56.056 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-18T21:10:56.056 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-18T21:10:56.057 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-18T21:10:56.057 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-18T21:10:56.057 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-18T21:10:56.057 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-18T21:10:56.057 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-18T21:10:56.057 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-18T21:10:56.057 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-18T21:10:56.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:10:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-18T21:10:56.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:55 smithi077 ceph-mon[27689]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:10:56.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:10:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T21:10:56.227 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-18T21:10:56.228 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-18T21:10:56.228 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set brx.0 up 2024-09-18T21:10:56.228 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set dev brx.0 master ceph-brx 2024-09-18T21:10:56.228 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-18T21:10:56.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:10:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-18T21:10:56.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:10:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T21:10:56.304 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-18T21:10:56.304 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-18T21:10:56.304 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-18T21:10:56.319 INFO:teuthology.orchestra.run.smithi103.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-18T21:10:56.319 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-18T21:10:56.320 DEBUG:teuthology.orchestra.run.smithi103:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-18T21:10:56.374 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2024-09-18T21:10:56.444 DEBUG:teuthology.orchestra.run.smithi103:> cat /proc/self/mounts | awk '{print $2}' 2024-09-18T21:10:56.501 INFO:teuthology.orchestra.run.smithi103.stdout:/proc 2024-09-18T21:10:56.501 INFO:teuthology.orchestra.run.smithi103.stdout:/sys 2024-09-18T21:10:56.501 INFO:teuthology.orchestra.run.smithi103.stdout:/dev 2024-09-18T21:10:56.501 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/security 2024-09-18T21:10:56.501 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/shm 2024-09-18T21:10:56.501 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/pts 2024-09-18T21:10:56.501 INFO:teuthology.orchestra.run.smithi103.stdout:/run 2024-09-18T21:10:56.501 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/cgroup 2024-09-18T21:10:56.502 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/pstore 2024-09-18T21:10:56.502 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/bpf 2024-09-18T21:10:56.502 INFO:teuthology.orchestra.run.smithi103.stdout:/ 2024-09-18T21:10:56.502 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/selinux 2024-09-18T21:10:56.502 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-09-18T21:10:56.502 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/tracing 2024-09-18T21:10:56.502 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/debug 2024-09-18T21:10:56.502 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/mqueue 2024-09-18T21:10:56.502 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/hugepages 2024-09-18T21:10:56.502 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/fuse/connections 2024-09-18T21:10:56.502 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/config 2024-09-18T21:10:56.502 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysctl.service 2024-09-18T21:10:56.502 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-18T21:10:56.502 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-18T21:10:56.503 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/nfs/rpc_pipefs 2024-09-18T21:10:56.503 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/1000 2024-09-18T21:10:56.503 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph 2024-09-18T21:10:56.503 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/0 2024-09-18T21:10:56.503 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-09-18T21:10:56.503 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay 2024-09-18T21:10:56.503 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/82471040e043da001792bc0242bd05c9b155f2729e1c71baa9a124c25510c52e/merged 2024-09-18T21:10:56.503 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/9b85e669f6138e6a3d7af2c2804dd193127e48ab8fae21cb6dc8b9be062d997e/merged 2024-09-18T21:10:56.503 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/33ca8603ef8285f05008144602b96a0fc7c7b837f56a75372327607d95ced7f8/merged 2024-09-18T21:10:56.503 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/8109973b46638019b3a1a549a615d370813ae3a9d17c2ea76f7397b1daa868a2/merged 2024-09-18T21:10:56.503 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/7a241494fde4c0143b6b9ceae371a717223074a8b342dcff5cabcf4b66fb8d47/merged 2024-09-18T21:10:56.503 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/28cc0233a4c1f751bb709c4831de3ad68ee1095306a551416924c77410545de2/merged 2024-09-18T21:10:56.503 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/79f56e8a0a52c3e5554c4401a8fe343f12a4f30c5db7eec2722df5f034daa768/merged 2024-09-18T21:10:56.503 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/5bb8c3f20954f37d561b37dd2ed5450b341b922f81c8165ba856295cc1ec34c5/merged 2024-09-18T21:10:56.504 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/1b9c9c2d543d36e60c325023331aa38984d3b0f17cc99cf5c9a3b1c2d9416ea2/merged 2024-09-18T21:10:56.504 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns 2024-09-18T21:10:56.504 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-18T21:10:56.504 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-18T21:10:56.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T21:10:56.504 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2024-09-18T21:10:56.557 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-18T21:10:56.557 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-18T21:10:56.600 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2024-09-18T21:10:56.624 DEBUG:teuthology.orchestra.run.smithi103:> cat /proc/self/mounts | awk '{print $2}' 2024-09-18T21:10:56.681 INFO:teuthology.orchestra.run.smithi103.stdout:/proc 2024-09-18T21:10:56.682 INFO:teuthology.orchestra.run.smithi103.stdout:/sys 2024-09-18T21:10:56.682 INFO:teuthology.orchestra.run.smithi103.stdout:/dev 2024-09-18T21:10:56.682 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/security 2024-09-18T21:10:56.682 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/shm 2024-09-18T21:10:56.682 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/pts 2024-09-18T21:10:56.682 INFO:teuthology.orchestra.run.smithi103.stdout:/run 2024-09-18T21:10:56.682 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/cgroup 2024-09-18T21:10:56.682 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/pstore 2024-09-18T21:10:56.682 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/bpf 2024-09-18T21:10:56.682 INFO:teuthology.orchestra.run.smithi103.stdout:/ 2024-09-18T21:10:56.682 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/selinux 2024-09-18T21:10:56.683 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-09-18T21:10:56.683 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/tracing 2024-09-18T21:10:56.683 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/debug 2024-09-18T21:10:56.683 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/mqueue 2024-09-18T21:10:56.683 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/hugepages 2024-09-18T21:10:56.683 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/fuse/connections 2024-09-18T21:10:56.683 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/config 2024-09-18T21:10:56.683 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysctl.service 2024-09-18T21:10:56.683 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-18T21:10:56.683 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-18T21:10:56.683 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/nfs/rpc_pipefs 2024-09-18T21:10:56.683 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/1000 2024-09-18T21:10:56.683 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph 2024-09-18T21:10:56.684 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/0 2024-09-18T21:10:56.684 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-09-18T21:10:56.684 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay 2024-09-18T21:10:56.684 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/82471040e043da001792bc0242bd05c9b155f2729e1c71baa9a124c25510c52e/merged 2024-09-18T21:10:56.684 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/9b85e669f6138e6a3d7af2c2804dd193127e48ab8fae21cb6dc8b9be062d997e/merged 2024-09-18T21:10:56.684 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/33ca8603ef8285f05008144602b96a0fc7c7b837f56a75372327607d95ced7f8/merged 2024-09-18T21:10:56.684 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/8109973b46638019b3a1a549a615d370813ae3a9d17c2ea76f7397b1daa868a2/merged 2024-09-18T21:10:56.684 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/7a241494fde4c0143b6b9ceae371a717223074a8b342dcff5cabcf4b66fb8d47/merged 2024-09-18T21:10:56.684 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/28cc0233a4c1f751bb709c4831de3ad68ee1095306a551416924c77410545de2/merged 2024-09-18T21:10:56.684 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/79f56e8a0a52c3e5554c4401a8fe343f12a4f30c5db7eec2722df5f034daa768/merged 2024-09-18T21:10:56.684 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/5bb8c3f20954f37d561b37dd2ed5450b341b922f81c8165ba856295cc1ec34c5/merged 2024-09-18T21:10:56.684 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/1b9c9c2d543d36e60c325023331aa38984d3b0f17cc99cf5c9a3b1c2d9416ea2/merged 2024-09-18T21:10:56.685 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns 2024-09-18T21:10:56.685 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-18T21:10:56.685 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-18T21:10:56.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T21:10:56.685 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2024-09-18T21:10:56.725 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:2024-09-18T21:10:56.723+0000 7f9def6cf300 -1 init, newargv = 0x557de227f520 newargc=15 2024-09-18T21:10:56.725 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:ceph-fuse[59676]: starting ceph client 2024-09-18T21:10:56.730 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:ceph-fuse[59676]: starting fuse 2024-09-18T21:10:56.738 INFO:teuthology.orchestra.run.smithi103.stdout:117 2024-09-18T21:10:56.738 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [117] 2024-09-18T21:10:56.738 DEBUG:teuthology.orchestra.run.smithi103:> sudo stdin-killer -- python3 -c ' 2024-09-18T21:10:56.738 DEBUG:teuthology.orchestra.run.smithi103:> import glob 2024-09-18T21:10:56.738 DEBUG:teuthology.orchestra.run.smithi103:> import re 2024-09-18T21:10:56.738 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-09-18T21:10:56.738 DEBUG:teuthology.orchestra.run.smithi103:> import subprocess 2024-09-18T21:10:56.738 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-18T21:10:56.738 DEBUG:teuthology.orchestra.run.smithi103:> def _find_admin_socket(client_name): 2024-09-18T21:10:56.738 DEBUG:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-18T21:10:56.739 DEBUG:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2024-09-18T21:10:56.739 DEBUG:teuthology.orchestra.run.smithi103:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-18T21:10:56.739 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-18T21:10:56.739 DEBUG:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2024-09-18T21:10:56.739 DEBUG:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2024-09-18T21:10:56.739 DEBUG:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2024-09-18T21:10:56.739 DEBUG:teuthology.orchestra.run.smithi103:> return files[0] 2024-09-18T21:10:56.739 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-18T21:10:56.739 DEBUG:teuthology.orchestra.run.smithi103:> for f in files: 2024-09-18T21:10:56.739 DEBUG:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-18T21:10:56.739 DEBUG:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-18T21:10:56.739 DEBUG:teuthology.orchestra.run.smithi103:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-18T21:10:56.739 DEBUG:teuthology.orchestra.run.smithi103:> contents = proc_f.read() 2024-09-18T21:10:56.739 DEBUG:teuthology.orchestra.run.smithi103:> if mountpoint in contents: 2024-09-18T21:10:56.739 DEBUG:teuthology.orchestra.run.smithi103:> return f 2024-09-18T21:10:56.739 DEBUG:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-18T21:10:56.740 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-18T21:10:56.740 DEBUG:teuthology.orchestra.run.smithi103:> print(_find_admin_socket("client.1")) 2024-09-18T21:10:56.740 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-09-18T21:10:56.856 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.1.59676.asok 2024-09-18T21:10:56.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-18T21:10:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-18T21:10:56.867 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.59676.asok 2024-09-18T21:10:56.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T21:10:56.867 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.59676.asok status 2024-09-18T21:10:56.997 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-18T21:10:56.997 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2024-09-18T21:10:56.997 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "6e06d1e002b6603c076b9260a58131a040dabe75", 2024-09-18T21:10:56.997 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)", 2024-09-18T21:10:56.997 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "1", 2024-09-18T21:10:56.997 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2024-09-18T21:10:56.997 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-18T21:10:56.997 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "59676", 2024-09-18T21:10:56.998 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2024-09-18T21:10:56.998 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-18T21:10:56.998 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2024-09-18T21:10:56.998 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2024-09-18T21:10:56.998 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 24295, 2024-09-18T21:10:56.998 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2024-09-18T21:10:56.998 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2024-09-18T21:10:56.998 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2024-09-18T21:10:56.998 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 24295 2024-09-18T21:10:56.998 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-18T21:10:56.998 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2024-09-18T21:10:56.998 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-18T21:10:56.998 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2024-09-18T21:10:56.998 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 178146206 2024-09-18T21:10:56.999 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-18T21:10:56.999 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-18T21:10:56.999 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2024-09-18T21:10:56.999 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-18T21:10:56.999 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2024-09-18T21:10:56.999 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 178146206 2024-09-18T21:10:56.999 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-18T21:10:56.999 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.24295 192.168.0.1:0/178146206", 2024-09-18T21:10:56.999 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.1:0/178146206", 2024-09-18T21:10:56.999 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2024-09-18T21:10:56.999 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 13, 2024-09-18T21:10:56.999 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 43, 2024-09-18T21:10:56.999 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2024-09-18T21:10:56.999 INFO:teuthology.orchestra.run.smithi103.stdout: "blocklisted": false, 2024-09-18T21:10:56.999 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs" 2024-09-18T21:10:56.999 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-18T21:10:57.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T21:10:57.005 DEBUG:teuthology.orchestra.run.smithi077:> stat --file-system '--printf=%T 2024-09-18T21:10:57.005 DEBUG:teuthology.orchestra.run.smithi077:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-18T21:10:57.026 INFO:teuthology.orchestra.run.smithi077.stdout:fuseblk 2024-09-18T21:10:57.026 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-18T21:10:57.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T21:10:57.026 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-18T21:10:57.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T21:10:57.099 DEBUG:teuthology.orchestra.run.smithi103:> stat --file-system '--printf=%T 2024-09-18T21:10:57.099 DEBUG:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-18T21:10:57.115 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2024-09-18T21:10:57.116 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-18T21:10:57.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T21:10:57.116 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-18T21:10:57.184 INFO:teuthology.run_tasks:Running task print... 2024-09-18T21:10:57.195 INFO:teuthology.task.print:**** done client 2024-09-18T21:10:57.196 INFO:teuthology.run_tasks:Running task parallel... 2024-09-18T21:10:57.211 INFO:teuthology.task.parallel:starting parallel... 2024-09-18T21:10:57.212 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-18T21:10:57.212 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-18T21:10:57.213 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi077.front.sepia.ceph.com 2024-09-18T21:10:57.213 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -e sha1=06b1b1de896d25f0645e4a306558ab0b4d4fc56f -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs false || true' 2024-09-18T21:10:57.213 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-18T21:10:57.214 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-09-18T21:10:57.218 INFO:tasks.workunit:Pulling workunits from ref c27976df948bf97893b1a7826e51bfff94e4f88c 2024-09-18T21:10:57.218 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-18T21:10:57.218 INFO:tasks.workunit:timeout=3h 2024-09-18T21:10:57.219 INFO:tasks.workunit:cleanup=True 2024-09-18T21:10:57.219 DEBUG:teuthology.orchestra.run.smithi077:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-18T21:10:57.238 INFO:teuthology.orchestra.run.smithi077.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-18T21:10:57.239 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-18T21:10:57.239 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 99h/153d Inode: 1 Links: 2 2024-09-18T21:10:57.239 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T21:10:57.239 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-18T21:10:57.239 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-18T21:10:57.239 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-09-18 21:10:21.477220334 +0000 2024-09-18T21:10:57.239 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-09-18 21:10:57.096552433 +0000 2024-09-18T21:10:57.239 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: - 2024-09-18T21:10:57.239 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-18T21:10:57.239 DEBUG:teuthology.orchestra.run.smithi077:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-18T21:10:57.309 DEBUG:teuthology.orchestra.run.smithi103:> stat -- /home/ubuntu/cephtest/mnt.1 2024-09-18T21:10:57.326 INFO:teuthology.orchestra.run.smithi103.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-09-18T21:10:57.326 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-18T21:10:57.327 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 75h/117d Inode: 1 Links: 3 2024-09-18T21:10:57.327 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-18T21:10:57.327 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-18T21:10:57.327 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-18T21:10:57.327 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-18 21:10:57.303781992 +0000 2024-09-18T21:10:57.327 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-18 21:10:57.303781992 +0000 2024-09-18T21:10:57.327 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: - 2024-09-18T21:10:57.327 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-09-18T21:10:57.327 DEBUG:teuthology.orchestra.run.smithi103:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-09-18T21:10:57.396 DEBUG:teuthology.orchestra.run.smithi077:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/kamoltat/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout c27976df948bf97893b1a7826e51bfff94e4f88c 2024-09-18T21:10:57.397 DEBUG:teuthology.orchestra.run.smithi103:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://github.com/kamoltat/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout c27976df948bf97893b1a7826e51bfff94e4f88c 2024-09-18T21:10:57.413 INFO:tasks.workunit.client.0.smithi077.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-18T21:10:57.452 INFO:tasks.workunit.client.1.smithi103.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-09-18T21:10:57.480 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:10:57.865 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:57 smithi077 ceph-mon[27689]: pgmap v187: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-18T21:10:58.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:57 smithi103 ceph-mon[34827]: pgmap v187: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-18T21:10:59.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:59.103+0000 7f5861f71640 1 -- 172.21.15.77:0/2966919316 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f585c0fb450 msgr2=0x7f585c0fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:59.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:59.103+0000 7f5861f71640 1 --2- 172.21.15.77:0/2966919316 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f585c0fb450 0x7f585c0fb860 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f584c009c50 tx=0x7f584c004d10 comp rx=0 tx=0).stop 2024-09-18T21:10:59.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:59.103+0000 7f5861f71640 1 -- 172.21.15.77:0/2966919316 shutdown_connections 2024-09-18T21:10:59.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:59.103+0000 7f5861f71640 1 --2- 172.21.15.77:0/2966919316 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f585c0fc720 0x7f585c0fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:59.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:59.103+0000 7f5861f71640 1 --2- 172.21.15.77:0/2966919316 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f585c0fb450 0x7f585c0fb860 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:59.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:59.103+0000 7f5861f71640 1 -- 172.21.15.77:0/2966919316 >> 172.21.15.77:0/2966919316 conn(0x7f585c0f6c10 msgr2=0x7f585c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:10:59.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:59.104+0000 7f5861f71640 1 -- 172.21.15.77:0/2966919316 shutdown_connections 2024-09-18T21:10:59.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:59.104+0000 7f5861f71640 1 -- 172.21.15.77:0/2966919316 wait complete. 2024-09-18T21:10:59.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:59.104+0000 7f5861f71640 1 Processor -- start 2024-09-18T21:10:59.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:59.104+0000 7f5861f71640 1 -- start start 2024-09-18T21:10:59.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:59.104+0000 7f5861f71640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f585c0fb450 0x7f585c10fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:59.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:59.104+0000 7f5861f71640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f585c0fc720 0x7f585c112370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:59.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:59.104+0000 7f5861f71640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585c066860 con 0x7f585c0fb450 2024-09-18T21:10:59.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:59.104+0000 7f5861f71640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585c0669d0 con 0x7f585c0fc720 2024-09-18T21:10:59.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:59.105+0000 7f585b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f585c0fb450 0x7f585c10fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:59.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:59.105+0000 7f585b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f585c0fb450 0x7f585c10fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57868/0 (socket says 172.21.15.77:57868) 2024-09-18T21:10:59.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:59.105+0000 7f585b7fe640 1 -- 172.21.15.77:0/3490914501 learned_addr learned my addr 172.21.15.77:0/3490914501 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:10:59.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:59.105+0000 7f585affd640 1 --2- 172.21.15.77:0/3490914501 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f585c0fc720 0x7f585c112370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:59.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:59.105+0000 7f585b7fe640 1 -- 172.21.15.77:0/3490914501 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f585c0fc720 msgr2=0x7f585c112370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:10:59.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:59.105+0000 7f585b7fe640 1 --2- 172.21.15.77:0/3490914501 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f585c0fc720 0x7f585c112370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:10:59.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:59.105+0000 7f585b7fe640 1 -- 172.21.15.77:0/3490914501 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f584c0098b0 con 0x7f585c0fb450 2024-09-18T21:10:59.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:59.105+0000 7f585b7fe640 1 --2- 172.21.15.77:0/3490914501 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f585c0fb450 0x7f585c10fe20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f584c004a30 tx=0x7f584c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:10:59.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:59.105+0000 7f5843fff640 1 -- 172.21.15.77:0/3490914501 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f584c032850 con 0x7f585c0fb450 2024-09-18T21:10:59.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:59.105+0000 7f5861f71640 1 -- 172.21.15.77:0/3490914501 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f585c112970 con 0x7f585c0fb450 2024-09-18T21:10:59.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:59.105+0000 7f5843fff640 1 -- 172.21.15.77:0/3490914501 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f584c009710 con 0x7f585c0fb450 2024-09-18T21:10:59.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:59.105+0000 7f5843fff640 1 -- 172.21.15.77:0/3490914501 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f584c03dc20 con 0x7f585c0fb450 2024-09-18T21:10:59.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:59.105+0000 7f5861f71640 1 -- 172.21.15.77:0/3490914501 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f585c112e40 con 0x7f585c0fb450 2024-09-18T21:10:59.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:59.106+0000 7f5861f71640 1 -- 172.21.15.77:0/3490914501 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f585c0fa8b0 con 0x7f585c0fb450 2024-09-18T21:10:59.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:59.107+0000 7f5843fff640 1 -- 172.21.15.77:0/3490914501 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f584c02f030 con 0x7f585c0fb450 2024-09-18T21:10:59.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:59.107+0000 7f5843fff640 1 --2- 172.21.15.77:0/3490914501 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f584406ed60 0x7f5844071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:10:59.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:59.107+0000 7f5843fff640 1 -- 172.21.15.77:0/3490914501 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f584c0af890 con 0x7f585c0fb450 2024-09-18T21:10:59.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:59.107+0000 7f585affd640 1 --2- 172.21.15.77:0/3490914501 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f584406ed60 0x7f5844071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:10:59.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:59.107+0000 7f585affd640 1 --2- 172.21.15.77:0/3490914501 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f584406ed60 0x7f5844071210 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5850006fd0 tx=0x7f5850008040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:10:59.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:59.111+0000 7f5843fff640 1 -- 172.21.15.77:0/3490914501 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f584c07c9b0 con 0x7f585c0fb450 2024-09-18T21:10:59.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:59.267+0000 7f5861f71640 1 -- 172.21.15.77:0/3490914501 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f585c04b720 con 0x7f585c0fb450 2024-09-18T21:10:59.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:10:59.268+0000 7f5843fff640 1 -- 172.21.15.77:0/3490914501 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v21)=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v21) v1 ==== 179+0+0 (secure 0 0 0) 0x7f584c07c350 con 0x7f585c0fb450 2024-09-18T21:10:59.269 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: unrecognized config option 'mgr/orchestrator/fail_fs' 2024-09-18T21:10:59.936 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:59 smithi077 ceph-mon[27689]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-18T21:10:59.936 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:10:59 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:10:59.960 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-18T21:10:59.965 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi077.front.sepia.ceph.com 2024-09-18T21:10:59.965 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -e sha1=06b1b1de896d25f0645e4a306558ab0b4d4fc56f -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-18T21:11:00.256 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:11:00.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:59 smithi103 ceph-mon[34827]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-18T21:11:00.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:10:59 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:11:01.915 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:01.892+0000 7f08f6911640 1 -- 172.21.15.77:0/1553346738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08f00fc570 msgr2=0x7f08f00fc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:01.915 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:01.892+0000 7f08f6911640 1 --2- 172.21.15.77:0/1553346738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08f00fc570 0x7f08f00fc980 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f08e0004950 tx=0x7f08e0009d40 comp rx=0 tx=0).stop 2024-09-18T21:11:01.915 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:01.892+0000 7f08f6911640 1 -- 172.21.15.77:0/1553346738 shutdown_connections 2024-09-18T21:11:01.915 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:01.892+0000 7f08f6911640 1 --2- 172.21.15.77:0/1553346738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08f00fd840 0x7f08f00fdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:01.915 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:01.892+0000 7f08f6911640 1 --2- 172.21.15.77:0/1553346738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08f00fc570 0x7f08f00fc980 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:01.915 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:01.892+0000 7f08f6911640 1 -- 172.21.15.77:0/1553346738 >> 172.21.15.77:0/1553346738 conn(0x7f08f00f7d30 msgr2=0x7f08f00fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:11:01.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:01.892+0000 7f08f6911640 1 -- 172.21.15.77:0/1553346738 shutdown_connections 2024-09-18T21:11:01.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:01.892+0000 7f08f6911640 1 -- 172.21.15.77:0/1553346738 wait complete. 2024-09-18T21:11:01.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:01.893+0000 7f08f6911640 1 Processor -- start 2024-09-18T21:11:01.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:01.893+0000 7f08f6911640 1 -- start start 2024-09-18T21:11:01.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:01.893+0000 7f08f6911640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08f00fc570 0x7f08f010d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:01.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:01.893+0000 7f08f6911640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08f00fd840 0x7f08f010d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:01.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:01.893+0000 7f08f6911640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f010dc00 con 0x7f08f00fd840 2024-09-18T21:11:01.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:01.893+0000 7f08f6911640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f010e420 con 0x7f08f00fc570 2024-09-18T21:11:01.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:01.893+0000 7f08ef7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08f00fd840 0x7f08f010d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:01.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:01.893+0000 7f08effff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08f00fc570 0x7f08f010d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:01.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:01.893+0000 7f08ef7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08f00fd840 0x7f08f010d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51142/0 (socket says 172.21.15.77:51142) 2024-09-18T21:11:01.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:01.893+0000 7f08ef7fe640 1 -- 172.21.15.77:0/4109128220 learned_addr learned my addr 172.21.15.77:0/4109128220 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:11:01.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:01.894+0000 7f08effff640 1 -- 172.21.15.77:0/4109128220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08f00fd840 msgr2=0x7f08f010d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:01.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:01.894+0000 7f08effff640 1 --2- 172.21.15.77:0/4109128220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08f00fd840 0x7f08f010d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:01.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:01.894+0000 7f08effff640 1 -- 172.21.15.77:0/4109128220 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e0004510 con 0x7f08f00fc570 2024-09-18T21:11:01.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:01.894+0000 7f08effff640 1 --2- 172.21.15.77:0/4109128220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08f00fc570 0x7f08f010d070 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f08e002a5a0 tx=0x7f08e0009d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:11:01.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:01.894+0000 7f08ecff9640 1 -- 172.21.15.77:0/4109128220 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08e0038070 con 0x7f08f00fc570 2024-09-18T21:11:01.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:01.894+0000 7f08ecff9640 1 -- 172.21.15.77:0/4109128220 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f08e002c5b0 con 0x7f08f00fc570 2024-09-18T21:11:01.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:01.894+0000 7f08f6911640 1 -- 172.21.15.77:0/4109128220 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08f010e650 con 0x7f08f00fc570 2024-09-18T21:11:01.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:01.894+0000 7f08ecff9640 1 -- 172.21.15.77:0/4109128220 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08e003d930 con 0x7f08f00fc570 2024-09-18T21:11:01.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:01.894+0000 7f08f6911640 1 -- 172.21.15.77:0/4109128220 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08f010eb40 con 0x7f08f00fc570 2024-09-18T21:11:01.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:01.895+0000 7f08f6911640 1 -- 172.21.15.77:0/4109128220 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08f01057a0 con 0x7f08f00fc570 2024-09-18T21:11:01.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:01.895+0000 7f08ecff9640 1 -- 172.21.15.77:0/4109128220 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f08e0030020 con 0x7f08f00fc570 2024-09-18T21:11:01.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:01.896+0000 7f08ecff9640 1 --2- 172.21.15.77:0/4109128220 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f08d806ed60 0x7f08d8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:01.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:01.896+0000 7f08ecff9640 1 -- 172.21.15.77:0/4109128220 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f08e00ae590 con 0x7f08f00fc570 2024-09-18T21:11:01.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:01.896+0000 7f08ef7fe640 1 --2- 172.21.15.77:0/4109128220 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f08d806ed60 0x7f08d8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:01.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:01.896+0000 7f08ef7fe640 1 --2- 172.21.15.77:0/4109128220 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f08d806ed60 0x7f08d8071210 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f08f010ce20 tx=0x7f08e400b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:11:01.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:01.900+0000 7f08ecff9640 1 -- 172.21.15.77:0/4109128220 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f08e007b690 con 0x7f08f00fc570 2024-09-18T21:11:01.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:01 smithi077 ceph-mon[27689]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-18T21:11:02.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:02.067+0000 7f08f6911640 1 -- 172.21.15.77:0/4109128220 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f08f004b7a0 con 0x7f08f00fc570 2024-09-18T21:11:02.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:02.068+0000 7f08ecff9640 1 -- 172.21.15.77:0/4109128220 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7f08f004b7a0 con 0x7f08f00fc570 2024-09-18T21:11:02.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:02.070+0000 7f08f6911640 1 -- 172.21.15.77:0/4109128220 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f08d806ed60 msgr2=0x7f08d8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:02.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:02.070+0000 7f08f6911640 1 --2- 172.21.15.77:0/4109128220 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f08d806ed60 0x7f08d8071210 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f08f010ce20 tx=0x7f08e400b040 comp rx=0 tx=0).stop 2024-09-18T21:11:02.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:02.070+0000 7f08f6911640 1 -- 172.21.15.77:0/4109128220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08f00fc570 msgr2=0x7f08f010d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:02.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:02.070+0000 7f08f6911640 1 --2- 172.21.15.77:0/4109128220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08f00fc570 0x7f08f010d070 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f08e002a5a0 tx=0x7f08e0009d40 comp rx=0 tx=0).stop 2024-09-18T21:11:02.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:02.070+0000 7f08f6911640 1 -- 172.21.15.77:0/4109128220 shutdown_connections 2024-09-18T21:11:02.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:02.070+0000 7f08f6911640 1 --2- 172.21.15.77:0/4109128220 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f08d806ed60 0x7f08d8071210 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:02.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:02.070+0000 7f08f6911640 1 --2- 172.21.15.77:0/4109128220 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08f00fd840 0x7f08f010d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:02.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:02.070+0000 7f08f6911640 1 --2- 172.21.15.77:0/4109128220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08f00fc570 0x7f08f010d070 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:02.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:02.070+0000 7f08f6911640 1 -- 172.21.15.77:0/4109128220 >> 172.21.15.77:0/4109128220 conn(0x7f08f00f7d30 msgr2=0x7f08f00f94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:11:02.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:02.070+0000 7f08f6911640 1 -- 172.21.15.77:0/4109128220 shutdown_connections 2024-09-18T21:11:02.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:02.070+0000 7f08f6911640 1 -- 172.21.15.77:0/4109128220 wait complete. 2024-09-18T21:11:02.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:01 smithi103 ceph-mon[34827]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-18T21:11:02.775 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -e sha1=06b1b1de896d25f0645e4a306558ab0b4d4fc56f -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-18T21:11:03.026 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:11:04.169 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:03 smithi077 ceph-mon[27689]: pgmap v190: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-09-18T21:11:04.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:03 smithi103 ceph-mon[34827]: pgmap v190: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-09-18T21:11:04.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:04.716+0000 7f1074fe2640 1 -- 172.21.15.77:0/3358663218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10700fb430 msgr2=0x7f10700fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:04.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:04.716+0000 7f1074fe2640 1 --2- 172.21.15.77:0/3358663218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10700fb430 0x7f10700fb840 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f10600048d0 tx=0x7f1060009da0 comp rx=0 tx=0).stop 2024-09-18T21:11:04.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:04.716+0000 7f1074fe2640 1 -- 172.21.15.77:0/3358663218 shutdown_connections 2024-09-18T21:11:04.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:04.716+0000 7f1074fe2640 1 --2- 172.21.15.77:0/3358663218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10700fc700 0x7f10700fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:04.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:04.716+0000 7f1074fe2640 1 --2- 172.21.15.77:0/3358663218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10700fb430 0x7f10700fb840 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:04.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:04.716+0000 7f1074fe2640 1 -- 172.21.15.77:0/3358663218 >> 172.21.15.77:0/3358663218 conn(0x7f10700f6c10 msgr2=0x7f10700f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:11:04.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:04.716+0000 7f1074fe2640 1 -- 172.21.15.77:0/3358663218 shutdown_connections 2024-09-18T21:11:04.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:04.716+0000 7f1074fe2640 1 -- 172.21.15.77:0/3358663218 wait complete. 2024-09-18T21:11:04.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:04.717+0000 7f1074fe2640 1 Processor -- start 2024-09-18T21:11:04.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:04.717+0000 7f1074fe2640 1 -- start start 2024-09-18T21:11:04.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:04.717+0000 7f1074fe2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10700fb430 0x7f107010bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:04.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:04.717+0000 7f1074fe2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10700fc700 0x7f107010c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:04.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:04.717+0000 7f1074fe2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107010cb20 con 0x7f10700fc700 2024-09-18T21:11:04.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:04.717+0000 7f1074fe2640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107010d340 con 0x7f10700fb430 2024-09-18T21:11:04.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:04.717+0000 7f106e59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10700fb430 0x7f107010bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:04.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:04.717+0000 7f106e59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10700fb430 0x7f107010bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:47990/0 (socket says 172.21.15.77:47990) 2024-09-18T21:11:04.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:04.717+0000 7f106e59c640 1 -- 172.21.15.77:0/3634100398 learned_addr learned my addr 172.21.15.77:0/3634100398 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:11:04.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:04.717+0000 7f106dd9b640 1 --2- 172.21.15.77:0/3634100398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10700fc700 0x7f107010c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:04.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:04.718+0000 7f106e59c640 1 -- 172.21.15.77:0/3634100398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10700fc700 msgr2=0x7f107010c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:04.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:04.718+0000 7f106e59c640 1 --2- 172.21.15.77:0/3634100398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10700fc700 0x7f107010c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:04.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:04.718+0000 7f106e59c640 1 -- 172.21.15.77:0/3634100398 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1060005040 con 0x7f10700fb430 2024-09-18T21:11:04.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:04.718+0000 7f106e59c640 1 --2- 172.21.15.77:0/3634100398 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10700fb430 0x7f107010bf90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f10600048a0 tx=0x7f1060009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:11:04.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:04.718+0000 7f105effd640 1 -- 172.21.15.77:0/3634100398 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1060038070 con 0x7f10700fb430 2024-09-18T21:11:04.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:04.718+0000 7f105effd640 1 -- 172.21.15.77:0/3634100398 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1060004290 con 0x7f10700fb430 2024-09-18T21:11:04.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:04.718+0000 7f1074fe2640 1 -- 172.21.15.77:0/3634100398 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f107010d540 con 0x7f10700fb430 2024-09-18T21:11:04.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:04.718+0000 7f105effd640 1 -- 172.21.15.77:0/3634100398 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1060033660 con 0x7f10700fb430 2024-09-18T21:11:04.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:04.718+0000 7f1074fe2640 1 -- 172.21.15.77:0/3634100398 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f107010dae0 con 0x7f10700fb430 2024-09-18T21:11:04.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:04.719+0000 7f1074fe2640 1 -- 172.21.15.77:0/3634100398 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10700fa890 con 0x7f10700fb430 2024-09-18T21:11:04.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:04.720+0000 7f105effd640 1 -- 172.21.15.77:0/3634100398 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f1060030020 con 0x7f10700fb430 2024-09-18T21:11:04.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:04.720+0000 7f105effd640 1 --2- 172.21.15.77:0/3634100398 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f105806ed60 0x7f1058071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:04.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:04.720+0000 7f105effd640 1 -- 172.21.15.77:0/3634100398 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f10600ae270 con 0x7f10700fb430 2024-09-18T21:11:04.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:04.720+0000 7f106dd9b640 1 --2- 172.21.15.77:0/3634100398 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f105806ed60 0x7f1058071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:04.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:04.721+0000 7f106dd9b640 1 --2- 172.21.15.77:0/3634100398 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f105806ed60 0x7f1058071210 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f107010bd40 tx=0x7f106400b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:11:04.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:04.724+0000 7f105effd640 1 -- 172.21.15.77:0/3634100398 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f106007b460 con 0x7f10700fb430 2024-09-18T21:11:04.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:04.887+0000 7f1074fe2640 1 -- 172.21.15.77:0/3634100398 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f107004b720 con 0x7f10700fb430 2024-09-18T21:11:04.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:04.888+0000 7f105effd640 1 -- 172.21.15.77:0/3634100398 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7f106002c870 con 0x7f10700fb430 2024-09-18T21:11:04.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:04.890+0000 7f1074fe2640 1 -- 172.21.15.77:0/3634100398 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f105806ed60 msgr2=0x7f1058071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:04.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:04.890+0000 7f1074fe2640 1 --2- 172.21.15.77:0/3634100398 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f105806ed60 0x7f1058071210 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f107010bd40 tx=0x7f106400b040 comp rx=0 tx=0).stop 2024-09-18T21:11:04.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:04.890+0000 7f1074fe2640 1 -- 172.21.15.77:0/3634100398 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10700fb430 msgr2=0x7f107010bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:04.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:04.890+0000 7f1074fe2640 1 --2- 172.21.15.77:0/3634100398 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10700fb430 0x7f107010bf90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f10600048a0 tx=0x7f1060009da0 comp rx=0 tx=0).stop 2024-09-18T21:11:04.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:04.890+0000 7f1074fe2640 1 -- 172.21.15.77:0/3634100398 shutdown_connections 2024-09-18T21:11:04.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:04.890+0000 7f1074fe2640 1 --2- 172.21.15.77:0/3634100398 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f105806ed60 0x7f1058071210 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:04.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:04.890+0000 7f1074fe2640 1 --2- 172.21.15.77:0/3634100398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10700fc700 0x7f107010c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:04.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:04.890+0000 7f1074fe2640 1 --2- 172.21.15.77:0/3634100398 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10700fb430 0x7f107010bf90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:04.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:04.890+0000 7f1074fe2640 1 -- 172.21.15.77:0/3634100398 >> 172.21.15.77:0/3634100398 conn(0x7f10700f6c10 msgr2=0x7f10700f8380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:11:04.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:04.890+0000 7f1074fe2640 1 -- 172.21.15.77:0/3634100398 shutdown_connections 2024-09-18T21:11:04.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:04.890+0000 7f1074fe2640 1 -- 172.21.15.77:0/3634100398 wait complete. 2024-09-18T21:11:05.545 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -e sha1=06b1b1de896d25f0645e4a306558ab0b4d4fc56f -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-18T21:11:05.818 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:11:06.052 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:05 smithi077 ceph-mon[27689]: pgmap v191: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-09-18T21:11:06.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:05 smithi103 ceph-mon[34827]: pgmap v191: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-09-18T21:11:07.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:07.515+0000 7f0f616d5640 1 -- 172.21.15.77:0/2967109507 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f5c0fc700 msgr2=0x7f0f5c0fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:07.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:07.515+0000 7f0f616d5640 1 --2- 172.21.15.77:0/2967109507 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f5c0fc700 0x7f0f5c0fcb70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0f440048d0 tx=0x7f0f44009da0 comp rx=0 tx=0).stop 2024-09-18T21:11:07.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:07.515+0000 7f0f616d5640 1 -- 172.21.15.77:0/2967109507 shutdown_connections 2024-09-18T21:11:07.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:07.515+0000 7f0f616d5640 1 --2- 172.21.15.77:0/2967109507 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f5c0fc700 0x7f0f5c0fcb70 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:07.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:07.515+0000 7f0f616d5640 1 --2- 172.21.15.77:0/2967109507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f5c0fb430 0x7f0f5c0fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:07.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:07.515+0000 7f0f616d5640 1 -- 172.21.15.77:0/2967109507 >> 172.21.15.77:0/2967109507 conn(0x7f0f5c0f6c10 msgr2=0x7f0f5c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:11:07.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:07.515+0000 7f0f616d5640 1 -- 172.21.15.77:0/2967109507 shutdown_connections 2024-09-18T21:11:07.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:07.515+0000 7f0f616d5640 1 -- 172.21.15.77:0/2967109507 wait complete. 2024-09-18T21:11:07.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:07.516+0000 7f0f616d5640 1 Processor -- start 2024-09-18T21:11:07.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:07.516+0000 7f0f616d5640 1 -- start start 2024-09-18T21:11:07.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:07.516+0000 7f0f616d5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f5c0fb430 0x7f0f5c10bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:07.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:07.516+0000 7f0f616d5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f5c0fc700 0x7f0f5c10c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:07.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:07.516+0000 7f0f616d5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c10caf0 con 0x7f0f5c0fc700 2024-09-18T21:11:07.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:07.516+0000 7f0f616d5640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c10d310 con 0x7f0f5c0fb430 2024-09-18T21:11:07.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:07.516+0000 7f0f53fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f5c0fc700 0x7f0f5c10c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:07.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:07.516+0000 7f0f53fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f5c0fc700 0x7f0f5c10c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51162/0 (socket says 172.21.15.77:51162) 2024-09-18T21:11:07.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:07.516+0000 7f0f53fff640 1 -- 172.21.15.77:0/4155372363 learned_addr learned my addr 172.21.15.77:0/4155372363 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:11:07.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:07.516+0000 7f0f5affd640 1 --2- 172.21.15.77:0/4155372363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f5c0fb430 0x7f0f5c10bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:07.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:07.516+0000 7f0f53fff640 1 -- 172.21.15.77:0/4155372363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f5c0fb430 msgr2=0x7f0f5c10bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:07.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:07.516+0000 7f0f53fff640 1 --2- 172.21.15.77:0/4155372363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f5c0fb430 0x7f0f5c10bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:07.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:07.516+0000 7f0f53fff640 1 -- 172.21.15.77:0/4155372363 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f44005040 con 0x7f0f5c0fc700 2024-09-18T21:11:07.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:07.516+0000 7f0f53fff640 1 --2- 172.21.15.77:0/4155372363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f5c0fc700 0x7f0f5c10c4a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0f440048a0 tx=0x7f0f44009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:11:07.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:07.517+0000 7f0f537fe640 1 -- 172.21.15.77:0/4155372363 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f44038070 con 0x7f0f5c0fc700 2024-09-18T21:11:07.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:07.517+0000 7f0f537fe640 1 -- 172.21.15.77:0/4155372363 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0f44004290 con 0x7f0f5c0fc700 2024-09-18T21:11:07.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:07.517+0000 7f0f616d5640 1 -- 172.21.15.77:0/4155372363 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f5c10d540 con 0x7f0f5c0fc700 2024-09-18T21:11:07.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:07.517+0000 7f0f537fe640 1 -- 172.21.15.77:0/4155372363 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f44033660 con 0x7f0f5c0fc700 2024-09-18T21:11:07.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:07.517+0000 7f0f616d5640 1 -- 172.21.15.77:0/4155372363 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f5c10dae0 con 0x7f0f5c0fc700 2024-09-18T21:11:07.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:07.518+0000 7f0f616d5640 1 -- 172.21.15.77:0/4155372363 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f5c0fa890 con 0x7f0f5c0fc700 2024-09-18T21:11:07.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:07.519+0000 7f0f537fe640 1 -- 172.21.15.77:0/4155372363 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f0f44030020 con 0x7f0f5c0fc700 2024-09-18T21:11:07.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:07.519+0000 7f0f537fe640 1 --2- 172.21.15.77:0/4155372363 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f0f4806ed60 0x7f0f48071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:07.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:07.519+0000 7f0f537fe640 1 -- 172.21.15.77:0/4155372363 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f0f440ae2b0 con 0x7f0f5c0fc700 2024-09-18T21:11:07.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:07.519+0000 7f0f5affd640 1 --2- 172.21.15.77:0/4155372363 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f0f4806ed60 0x7f0f48071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:07.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:07.520+0000 7f0f5affd640 1 --2- 172.21.15.77:0/4155372363 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f0f4806ed60 0x7f0f48071210 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c009af0 tx=0x7f0f4c00b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:11:07.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:07.523+0000 7f0f537fe640 1 -- 172.21.15.77:0/4155372363 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0f4407b480 con 0x7f0f5c0fc700 2024-09-18T21:11:07.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:07.711+0000 7f0f616d5640 1 -- 172.21.15.77:0/4155372363 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f0f5c04b720 con 0x7f0f5c0fc700 2024-09-18T21:11:07.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:07.712+0000 7f0f537fe640 1 -- 172.21.15.77:0/4155372363 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7f0f4402c870 con 0x7f0f5c0fc700 2024-09-18T21:11:07.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:07.714+0000 7f0f616d5640 1 -- 172.21.15.77:0/4155372363 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f0f4806ed60 msgr2=0x7f0f48071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:07.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:07.714+0000 7f0f616d5640 1 --2- 172.21.15.77:0/4155372363 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f0f4806ed60 0x7f0f48071210 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c009af0 tx=0x7f0f4c00b040 comp rx=0 tx=0).stop 2024-09-18T21:11:07.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:07.714+0000 7f0f616d5640 1 -- 172.21.15.77:0/4155372363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f5c0fc700 msgr2=0x7f0f5c10c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:07.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:07.714+0000 7f0f616d5640 1 --2- 172.21.15.77:0/4155372363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f5c0fc700 0x7f0f5c10c4a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0f440048a0 tx=0x7f0f44009da0 comp rx=0 tx=0).stop 2024-09-18T21:11:07.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:07.714+0000 7f0f616d5640 1 -- 172.21.15.77:0/4155372363 shutdown_connections 2024-09-18T21:11:07.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:07.714+0000 7f0f616d5640 1 --2- 172.21.15.77:0/4155372363 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f0f4806ed60 0x7f0f48071210 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:07.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:07.714+0000 7f0f616d5640 1 --2- 172.21.15.77:0/4155372363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f5c0fc700 0x7f0f5c10c4a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:07.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:07.714+0000 7f0f616d5640 1 --2- 172.21.15.77:0/4155372363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f5c0fb430 0x7f0f5c10bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:07.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:07.714+0000 7f0f616d5640 1 -- 172.21.15.77:0/4155372363 >> 172.21.15.77:0/4155372363 conn(0x7f0f5c0f6c10 msgr2=0x7f0f5c0f8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:11:07.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:07.715+0000 7f0f616d5640 1 -- 172.21.15.77:0/4155372363 shutdown_connections 2024-09-18T21:11:07.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:07.715+0000 7f0f616d5640 1 -- 172.21.15.77:0/4155372363 wait complete. 2024-09-18T21:11:08.087 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:07 smithi077 ceph-mon[27689]: pgmap v192: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-09-18T21:11:08.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:07 smithi103 ceph-mon[34827]: pgmap v192: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-09-18T21:11:08.420 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -e sha1=06b1b1de896d25f0645e4a306558ab0b4d4fc56f -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-09-18T21:11:08.674 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:11:10.124 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:09 smithi077 ceph-mon[27689]: pgmap v193: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-18T21:11:10.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:09 smithi103 ceph-mon[34827]: pgmap v193: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-18T21:11:10.374 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:10.346+0000 7f8eea1ec640 1 -- 172.21.15.77:0/1757124201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ee40ff740 msgr2=0x7f8ee4101b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:10.374 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:10.346+0000 7f8eea1ec640 1 --2- 172.21.15.77:0/1757124201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ee40ff740 0x7f8ee4101b20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8ed80048d0 tx=0x7f8ed8009da0 comp rx=0 tx=0).stop 2024-09-18T21:11:10.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:10.346+0000 7f8eea1ec640 1 -- 172.21.15.77:0/1757124201 shutdown_connections 2024-09-18T21:11:10.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:10.346+0000 7f8eea1ec640 1 --2- 172.21.15.77:0/1757124201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ee40ff740 0x7f8ee4101b20 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:10.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:10.346+0000 7f8eea1ec640 1 --2- 172.21.15.77:0/1757124201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ee4065b80 0x7f8ee40ff200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:10.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:10.346+0000 7f8eea1ec640 1 -- 172.21.15.77:0/1757124201 >> 172.21.15.77:0/1757124201 conn(0x7f8ee40f6c10 msgr2=0x7f8ee40f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:11:10.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:10.346+0000 7f8eea1ec640 1 -- 172.21.15.77:0/1757124201 shutdown_connections 2024-09-18T21:11:10.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:10.346+0000 7f8eea1ec640 1 -- 172.21.15.77:0/1757124201 wait complete. 2024-09-18T21:11:10.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:10.347+0000 7f8eea1ec640 1 Processor -- start 2024-09-18T21:11:10.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:10.347+0000 7f8eea1ec640 1 -- start start 2024-09-18T21:11:10.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:10.347+0000 7f8eea1ec640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ee4065b80 0x7f8ee410d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:10.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:10.347+0000 7f8eea1ec640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ee40ff740 0x7f8ee410d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:10.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:10.347+0000 7f8eea1ec640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee410dc20 con 0x7f8ee4065b80 2024-09-18T21:11:10.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:10.347+0000 7f8eea1ec640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee410e3f0 con 0x7f8ee40ff740 2024-09-18T21:11:10.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:10.347+0000 7f8ee37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ee4065b80 0x7f8ee410d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:10.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:10.347+0000 7f8ee37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ee4065b80 0x7f8ee410d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:32954/0 (socket says 172.21.15.77:32954) 2024-09-18T21:11:10.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:10.347+0000 7f8ee37fe640 1 -- 172.21.15.77:0/1501553850 learned_addr learned my addr 172.21.15.77:0/1501553850 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:11:10.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:10.347+0000 7f8ee2ffd640 1 --2- 172.21.15.77:0/1501553850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ee40ff740 0x7f8ee410d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:10.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:10.347+0000 7f8ee37fe640 1 -- 172.21.15.77:0/1501553850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ee40ff740 msgr2=0x7f8ee410d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:10.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:10.347+0000 7f8ee37fe640 1 --2- 172.21.15.77:0/1501553850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ee40ff740 0x7f8ee410d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:10.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:10.347+0000 7f8ee37fe640 1 -- 172.21.15.77:0/1501553850 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed8005040 con 0x7f8ee4065b80 2024-09-18T21:11:10.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:10.348+0000 7f8ee37fe640 1 --2- 172.21.15.77:0/1501553850 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ee4065b80 0x7f8ee410d090 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4002a80 tx=0x7f8ed4004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:11:10.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:10.348+0000 7f8ecbfff640 1 -- 172.21.15.77:0/1501553850 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ed4007c30 con 0x7f8ee4065b80 2024-09-18T21:11:10.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:10.348+0000 7f8ecbfff640 1 -- 172.21.15.77:0/1501553850 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8ed400f040 con 0x7f8ee4065b80 2024-09-18T21:11:10.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:10.348+0000 7f8eea1ec640 1 -- 172.21.15.77:0/1501553850 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ee410e680 con 0x7f8ee4065b80 2024-09-18T21:11:10.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:10.348+0000 7f8ecbfff640 1 -- 172.21.15.77:0/1501553850 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ed400dad0 con 0x7f8ee4065b80 2024-09-18T21:11:10.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:10.348+0000 7f8eea1ec640 1 -- 172.21.15.77:0/1501553850 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ee410ec20 con 0x7f8ee4065b80 2024-09-18T21:11:10.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:10.349+0000 7f8eea1ec640 1 -- 172.21.15.77:0/1501553850 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ee40fa890 con 0x7f8ee4065b80 2024-09-18T21:11:10.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:10.350+0000 7f8ecbfff640 1 -- 172.21.15.77:0/1501553850 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f8ed400dc30 con 0x7f8ee4065b80 2024-09-18T21:11:10.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:10.350+0000 7f8ecbfff640 1 --2- 172.21.15.77:0/1501553850 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f8ecc06ed60 0x7f8ecc071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:10.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:10.350+0000 7f8ecbfff640 1 -- 172.21.15.77:0/1501553850 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f8ed408dfd0 con 0x7f8ee4065b80 2024-09-18T21:11:10.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:10.350+0000 7f8ee2ffd640 1 --2- 172.21.15.77:0/1501553850 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f8ecc06ed60 0x7f8ecc071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:10.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:10.351+0000 7f8ee2ffd640 1 --2- 172.21.15.77:0/1501553850 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f8ecc06ed60 0x7f8ecc071210 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8ee410ce40 tx=0x7f8ed8035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:11:10.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:10.358+0000 7f8ecbfff640 1 -- 172.21.15.77:0/1501553850 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8ed405b0f0 con 0x7f8ee4065b80 2024-09-18T21:11:10.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:10.535+0000 7f8eea1ec640 1 -- 172.21.15.77:0/1501553850 --> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:06b1b1de896d25f0645e4a306558ab0b4d4fc56f", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ee410ef70 con 0x7f8ecc06ed60 2024-09-18T21:11:10.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:10.541+0000 7f8ecbfff640 1 -- 172.21.15.77:0/1501553850 <== mgr.14206 v2:172.21.15.77:6800/950747822 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f8ee410ef70 con 0x7f8ecc06ed60 2024-09-18T21:11:10.543 INFO:teuthology.orchestra.run.smithi077.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:06b1b1de896d25f0645e4a306558ab0b4d4fc56f 2024-09-18T21:11:10.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:10.544+0000 7f8eea1ec640 1 -- 172.21.15.77:0/1501553850 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f8ecc06ed60 msgr2=0x7f8ecc071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:10.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:10.544+0000 7f8eea1ec640 1 --2- 172.21.15.77:0/1501553850 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f8ecc06ed60 0x7f8ecc071210 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8ee410ce40 tx=0x7f8ed8035040 comp rx=0 tx=0).stop 2024-09-18T21:11:10.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:10.544+0000 7f8eea1ec640 1 -- 172.21.15.77:0/1501553850 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ee4065b80 msgr2=0x7f8ee410d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:10.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:10.544+0000 7f8eea1ec640 1 --2- 172.21.15.77:0/1501553850 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ee4065b80 0x7f8ee410d090 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4002a80 tx=0x7f8ed4004570 comp rx=0 tx=0).stop 2024-09-18T21:11:10.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:10.544+0000 7f8eea1ec640 1 -- 172.21.15.77:0/1501553850 shutdown_connections 2024-09-18T21:11:10.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:10.544+0000 7f8eea1ec640 1 --2- 172.21.15.77:0/1501553850 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f8ecc06ed60 0x7f8ecc071210 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:10.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:10.544+0000 7f8eea1ec640 1 --2- 172.21.15.77:0/1501553850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ee40ff740 0x7f8ee410d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:10.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:10.544+0000 7f8eea1ec640 1 --2- 172.21.15.77:0/1501553850 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ee4065b80 0x7f8ee410d090 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:10.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:10.544+0000 7f8eea1ec640 1 -- 172.21.15.77:0/1501553850 >> 172.21.15.77:0/1501553850 conn(0x7f8ee40f6c10 msgr2=0x7f8ee40f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:11:10.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:10.544+0000 7f8eea1ec640 1 -- 172.21.15.77:0/1501553850 shutdown_connections 2024-09-18T21:11:10.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:10.544+0000 7f8eea1ec640 1 -- 172.21.15.77:0/1501553850 wait complete. 2024-09-18T21:11:11.367 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-18T21:11:11.367 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi077.front.sepia.ceph.com 2024-09-18T21:11:11.368 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -e sha1=06b1b1de896d25f0645e4a306558ab0b4d4fc56f -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-09-18T21:11:11.646 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:11:11.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:11 smithi077 ceph-mon[27689]: pgmap v194: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-09-18T21:11:11.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:11 smithi077 ceph-mon[27689]: from='client.14518 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:06b1b1de896d25f0645e4a306558ab0b4d4fc56f", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:11:11.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:11 smithi077 ceph-mon[27689]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:06b1b1de896d25f0645e4a306558ab0b4d4fc56f 2024-09-18T21:11:11.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:11 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:11:11.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:11 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:11:11.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:11 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:11:11.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:11 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:11:11.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:11 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:11:12.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:11 smithi103 ceph-mon[34827]: pgmap v194: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-09-18T21:11:12.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:11 smithi103 ceph-mon[34827]: from='client.14518 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:06b1b1de896d25f0645e4a306558ab0b4d4fc56f", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:11:12.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:11 smithi103 ceph-mon[34827]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:06b1b1de896d25f0645e4a306558ab0b4d4fc56f 2024-09-18T21:11:12.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:11 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:11:12.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:11 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:11:12.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:11 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:11:12.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:11 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:11:12.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:11 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:11:12.873 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:12 smithi077 ceph-mon[27689]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:06b1b1de896d25f0645e4a306558ab0b4d4fc56f 2024-09-18T21:11:13.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:12 smithi103 ceph-mon[34827]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:06b1b1de896d25f0645e4a306558ab0b4d4fc56f 2024-09-18T21:11:13.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.521+0000 7ff930599640 1 -- 172.21.15.77:0/2657200185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9280fc520 msgr2=0x7ff9280fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:13.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.521+0000 7ff930599640 1 --2- 172.21.15.77:0/2657200185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9280fc520 0x7ff9280fc930 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff9240048d0 tx=0x7ff924009da0 comp rx=0 tx=0).stop 2024-09-18T21:11:13.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.521+0000 7ff930599640 1 -- 172.21.15.77:0/2657200185 shutdown_connections 2024-09-18T21:11:13.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.521+0000 7ff930599640 1 --2- 172.21.15.77:0/2657200185 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9280fd7f0 0x7ff9280fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:13.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.521+0000 7ff930599640 1 --2- 172.21.15.77:0/2657200185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9280fc520 0x7ff9280fc930 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:13.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.521+0000 7ff930599640 1 -- 172.21.15.77:0/2657200185 >> 172.21.15.77:0/2657200185 conn(0x7ff9280f7ce0 msgr2=0x7ff9280fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:11:13.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.521+0000 7ff930599640 1 -- 172.21.15.77:0/2657200185 shutdown_connections 2024-09-18T21:11:13.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.521+0000 7ff930599640 1 -- 172.21.15.77:0/2657200185 wait complete. 2024-09-18T21:11:13.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.522+0000 7ff930599640 1 Processor -- start 2024-09-18T21:11:13.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.522+0000 7ff930599640 1 -- start start 2024-09-18T21:11:13.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.522+0000 7ff930599640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9280fc520 0x7ff9281136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:13.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.522+0000 7ff930599640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9280fd7f0 0x7ff928113c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:13.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.522+0000 7ff930599640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff928114280 con 0x7ff9280fd7f0 2024-09-18T21:11:13.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.522+0000 7ff930599640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff928114aa0 con 0x7ff9280fc520 2024-09-18T21:11:13.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.522+0000 7ff92db34640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9280fd7f0 0x7ff928113c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:13.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.522+0000 7ff92db34640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9280fd7f0 0x7ff928113c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:32966/0 (socket says 172.21.15.77:32966) 2024-09-18T21:11:13.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.522+0000 7ff92db34640 1 -- 172.21.15.77:0/3472377022 learned_addr learned my addr 172.21.15.77:0/3472377022 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:11:13.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.522+0000 7ff92e335640 1 --2- 172.21.15.77:0/3472377022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9280fc520 0x7ff9281136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:13.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.522+0000 7ff92db34640 1 -- 172.21.15.77:0/3472377022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9280fc520 msgr2=0x7ff9281136f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:13.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.522+0000 7ff92db34640 1 --2- 172.21.15.77:0/3472377022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9280fc520 0x7ff9281136f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:13.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.522+0000 7ff92db34640 1 -- 172.21.15.77:0/3472377022 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff924005040 con 0x7ff9280fd7f0 2024-09-18T21:11:13.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.523+0000 7ff92db34640 1 --2- 172.21.15.77:0/3472377022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9280fd7f0 0x7ff928113c30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff91800eb70 tx=0x7ff91800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:11:13.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.523+0000 7ff91effd640 1 -- 172.21.15.77:0/3472377022 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff918007c30 con 0x7ff9280fd7f0 2024-09-18T21:11:13.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.523+0000 7ff91effd640 1 -- 172.21.15.77:0/3472377022 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff91800f040 con 0x7ff9280fd7f0 2024-09-18T21:11:13.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.523+0000 7ff91effd640 1 -- 172.21.15.77:0/3472377022 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff91800ca60 con 0x7ff9280fd7f0 2024-09-18T21:11:13.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.523+0000 7ff930599640 1 -- 172.21.15.77:0/3472377022 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff928114cd0 con 0x7ff9280fd7f0 2024-09-18T21:11:13.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.523+0000 7ff930599640 1 -- 172.21.15.77:0/3472377022 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff928115270 con 0x7ff9280fd7f0 2024-09-18T21:11:13.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.525+0000 7ff91effd640 1 -- 172.21.15.77:0/3472377022 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7ff91800cbc0 con 0x7ff9280fd7f0 2024-09-18T21:11:13.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.525+0000 7ff930599640 1 -- 172.21.15.77:0/3472377022 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9280fb980 con 0x7ff9280fd7f0 2024-09-18T21:11:13.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.525+0000 7ff91effd640 1 --2- 172.21.15.77:0/3472377022 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7ff91406ed60 0x7ff914071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:13.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.526+0000 7ff91effd640 1 -- 172.21.15.77:0/3472377022 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7ff91808dcb0 con 0x7ff9280fd7f0 2024-09-18T21:11:13.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.526+0000 7ff92e335640 1 --2- 172.21.15.77:0/3472377022 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7ff91406ed60 0x7ff914071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:13.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.526+0000 7ff92e335640 1 --2- 172.21.15.77:0/3472377022 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7ff91406ed60 0x7ff914071210 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff924004540 tx=0x7ff924035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:11:13.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.530+0000 7ff91effd640 1 -- 172.21.15.77:0/3472377022 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff91805afc0 con 0x7ff9280fd7f0 2024-09-18T21:11:13.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.744+0000 7ff930599640 1 -- 172.21.15.77:0/3472377022 --> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9281155a0 con 0x7ff91406ed60 2024-09-18T21:11:13.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.745+0000 7ff91effd640 1 -- 172.21.15.77:0/3472377022 <== mgr.14206 v2:172.21.15.77:6800/950747822 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7ff9281155a0 con 0x7ff91406ed60 2024-09-18T21:11:13.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.748+0000 7ff930599640 1 -- 172.21.15.77:0/3472377022 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7ff91406ed60 msgr2=0x7ff914071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:13.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.748+0000 7ff930599640 1 --2- 172.21.15.77:0/3472377022 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7ff91406ed60 0x7ff914071210 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff924004540 tx=0x7ff924035040 comp rx=0 tx=0).stop 2024-09-18T21:11:13.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.748+0000 7ff930599640 1 -- 172.21.15.77:0/3472377022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9280fd7f0 msgr2=0x7ff928113c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:13.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.748+0000 7ff930599640 1 --2- 172.21.15.77:0/3472377022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9280fd7f0 0x7ff928113c30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff91800eb70 tx=0x7ff91800b040 comp rx=0 tx=0).stop 2024-09-18T21:11:13.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.748+0000 7ff930599640 1 -- 172.21.15.77:0/3472377022 shutdown_connections 2024-09-18T21:11:13.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.748+0000 7ff930599640 1 --2- 172.21.15.77:0/3472377022 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7ff91406ed60 0x7ff914071210 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:13.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.748+0000 7ff930599640 1 --2- 172.21.15.77:0/3472377022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9280fd7f0 0x7ff928113c30 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:13.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.748+0000 7ff930599640 1 --2- 172.21.15.77:0/3472377022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9280fc520 0x7ff9281136f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:13.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.748+0000 7ff930599640 1 -- 172.21.15.77:0/3472377022 >> 172.21.15.77:0/3472377022 conn(0x7ff9280f7ce0 msgr2=0x7ff9280f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:11:13.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.748+0000 7ff930599640 1 -- 172.21.15.77:0/3472377022 shutdown_connections 2024-09-18T21:11:13.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.748+0000 7ff930599640 1 -- 172.21.15.77:0/3472377022 wait complete. 2024-09-18T21:11:13.758 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-09-18T21:11:13.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.840+0000 7fb5ddb14640 1 -- 172.21.15.77:0/106349403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5d80fb430 msgr2=0x7fb5d80fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:13.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.840+0000 7fb5ddb14640 1 --2- 172.21.15.77:0/106349403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5d80fb430 0x7fb5d80fb840 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb5c80048d0 tx=0x7fb5c8009da0 comp rx=0 tx=0).stop 2024-09-18T21:11:13.842 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:13 smithi077 ceph-mon[27689]: pgmap v195: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-09-18T21:11:13.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.840+0000 7fb5ddb14640 1 -- 172.21.15.77:0/106349403 shutdown_connections 2024-09-18T21:11:13.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.840+0000 7fb5ddb14640 1 --2- 172.21.15.77:0/106349403 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5d80fc700 0x7fb5d80fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:13.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.840+0000 7fb5ddb14640 1 --2- 172.21.15.77:0/106349403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5d80fb430 0x7fb5d80fb840 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:13.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.840+0000 7fb5ddb14640 1 -- 172.21.15.77:0/106349403 >> 172.21.15.77:0/106349403 conn(0x7fb5d80f6c10 msgr2=0x7fb5d80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:11:13.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.841+0000 7fb5ddb14640 1 -- 172.21.15.77:0/106349403 shutdown_connections 2024-09-18T21:11:13.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.841+0000 7fb5ddb14640 1 -- 172.21.15.77:0/106349403 wait complete. 2024-09-18T21:11:13.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.841+0000 7fb5ddb14640 1 Processor -- start 2024-09-18T21:11:13.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.842+0000 7fb5ddb14640 1 -- start start 2024-09-18T21:11:13.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.842+0000 7fb5ddb14640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5d80fb430 0x7fb5d80ff550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:13.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.842+0000 7fb5ddb14640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5d80fc700 0x7fb5d80fda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:13.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.842+0000 7fb5ddb14640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d80fdfd0 con 0x7fb5d80fb430 2024-09-18T21:11:13.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.842+0000 7fb5ddb14640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d80fe110 con 0x7fb5d80fc700 2024-09-18T21:11:13.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.842+0000 7fb5d6ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5d80fc700 0x7fb5d80fda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:13.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.842+0000 7fb5d6ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5d80fc700 0x7fb5d80fda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:59918/0 (socket says 172.21.15.77:59918) 2024-09-18T21:11:13.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.842+0000 7fb5d6ffd640 1 -- 172.21.15.77:0/2878894947 learned_addr learned my addr 172.21.15.77:0/2878894947 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:11:13.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.843+0000 7fb5d77fe640 1 --2- 172.21.15.77:0/2878894947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5d80fb430 0x7fb5d80ff550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:13.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.843+0000 7fb5d6ffd640 1 -- 172.21.15.77:0/2878894947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5d80fb430 msgr2=0x7fb5d80ff550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:13.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.843+0000 7fb5d6ffd640 1 --2- 172.21.15.77:0/2878894947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5d80fb430 0x7fb5d80ff550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:13.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.843+0000 7fb5d6ffd640 1 -- 172.21.15.77:0/2878894947 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c8005040 con 0x7fb5d80fc700 2024-09-18T21:11:13.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.843+0000 7fb5d6ffd640 1 --2- 172.21.15.77:0/2878894947 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5d80fc700 0x7fb5d80fda40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc002a80 tx=0x7fb5cc004600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:11:13.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.843+0000 7fb5bffff640 1 -- 172.21.15.77:0/2878894947 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5cc007c30 con 0x7fb5d80fc700 2024-09-18T21:11:13.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.843+0000 7fb5ddb14640 1 -- 172.21.15.77:0/2878894947 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5d80fe3f0 con 0x7fb5d80fc700 2024-09-18T21:11:13.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.843+0000 7fb5ddb14640 1 -- 172.21.15.77:0/2878894947 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5d81150b0 con 0x7fb5d80fc700 2024-09-18T21:11:13.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.843+0000 7fb5bffff640 1 -- 172.21.15.77:0/2878894947 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb5cc00f040 con 0x7fb5d80fc700 2024-09-18T21:11:13.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.843+0000 7fb5bffff640 1 -- 172.21.15.77:0/2878894947 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5cc0094f0 con 0x7fb5d80fc700 2024-09-18T21:11:13.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.844+0000 7fb5ddb14640 1 -- 172.21.15.77:0/2878894947 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5d80fa890 con 0x7fb5d80fc700 2024-09-18T21:11:13.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.845+0000 7fb5bffff640 1 -- 172.21.15.77:0/2878894947 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fb5cc009760 con 0x7fb5d80fc700 2024-09-18T21:11:13.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.846+0000 7fb5bffff640 1 --2- 172.21.15.77:0/2878894947 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fb5c006ed60 0x7fb5c0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:13.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.846+0000 7fb5bffff640 1 -- 172.21.15.77:0/2878894947 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fb5cc08db30 con 0x7fb5d80fc700 2024-09-18T21:11:13.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.846+0000 7fb5d77fe640 1 --2- 172.21.15.77:0/2878894947 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fb5c006ed60 0x7fb5c0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:13.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.846+0000 7fb5d77fe640 1 --2- 172.21.15.77:0/2878894947 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fb5c006ed60 0x7fb5c0071210 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb5c8007ac0 tx=0x7fb5c8035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:11:13.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:13.853+0000 7fb5bffff640 1 -- 172.21.15.77:0/2878894947 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb5cc04d2a0 con 0x7fb5d80fc700 2024-09-18T21:11:14.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:13 smithi103 ceph-mon[34827]: pgmap v195: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-09-18T21:11:14.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.100+0000 7fb5ddb14640 1 -- 172.21.15.77:0/2878894947 --> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb5d805db50 con 0x7fb5c006ed60 2024-09-18T21:11:14.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.102+0000 7fb5bffff640 1 -- 172.21.15.77:0/2878894947 <== mgr.14206 v2:172.21.15.77:6800/950747822 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fb5d805db50 con 0x7fb5c006ed60 2024-09-18T21:11:14.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.104+0000 7fb5ddb14640 1 -- 172.21.15.77:0/2878894947 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fb5c006ed60 msgr2=0x7fb5c0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:14.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.104+0000 7fb5ddb14640 1 --2- 172.21.15.77:0/2878894947 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fb5c006ed60 0x7fb5c0071210 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb5c8007ac0 tx=0x7fb5c8035040 comp rx=0 tx=0).stop 2024-09-18T21:11:14.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.104+0000 7fb5ddb14640 1 -- 172.21.15.77:0/2878894947 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5d80fc700 msgr2=0x7fb5d80fda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:14.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.104+0000 7fb5ddb14640 1 --2- 172.21.15.77:0/2878894947 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5d80fc700 0x7fb5d80fda40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc002a80 tx=0x7fb5cc004600 comp rx=0 tx=0).stop 2024-09-18T21:11:14.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.104+0000 7fb5ddb14640 1 -- 172.21.15.77:0/2878894947 shutdown_connections 2024-09-18T21:11:14.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.104+0000 7fb5ddb14640 1 --2- 172.21.15.77:0/2878894947 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fb5c006ed60 0x7fb5c0071210 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:14.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.104+0000 7fb5ddb14640 1 --2- 172.21.15.77:0/2878894947 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5d80fc700 0x7fb5d80fda40 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:14.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.104+0000 7fb5ddb14640 1 --2- 172.21.15.77:0/2878894947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5d80fb430 0x7fb5d80ff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:14.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.104+0000 7fb5ddb14640 1 -- 172.21.15.77:0/2878894947 >> 172.21.15.77:0/2878894947 conn(0x7fb5d80f6c10 msgr2=0x7fb5d8065640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:11:14.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.104+0000 7fb5ddb14640 1 -- 172.21.15.77:0/2878894947 shutdown_connections 2024-09-18T21:11:14.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.104+0000 7fb5ddb14640 1 -- 172.21.15.77:0/2878894947 wait complete. 2024-09-18T21:11:14.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.212+0000 7f018396d640 1 -- 172.21.15.77:0/2100537936 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f017c0fb420 msgr2=0x7f017c0fb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:14.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.212+0000 7f018396d640 1 --2- 172.21.15.77:0/2100537936 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f017c0fb420 0x7f017c0fb830 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f01780048d0 tx=0x7f0178009da0 comp rx=0 tx=0).stop 2024-09-18T21:11:14.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.212+0000 7f018396d640 1 -- 172.21.15.77:0/2100537936 shutdown_connections 2024-09-18T21:11:14.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.212+0000 7f018396d640 1 --2- 172.21.15.77:0/2100537936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f017c0fc6f0 0x7f017c0fcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:14.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.212+0000 7f018396d640 1 --2- 172.21.15.77:0/2100537936 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f017c0fb420 0x7f017c0fb830 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:14.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.212+0000 7f018396d640 1 -- 172.21.15.77:0/2100537936 >> 172.21.15.77:0/2100537936 conn(0x7f017c0f6c00 msgr2=0x7f017c0f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:11:14.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.212+0000 7f018396d640 1 -- 172.21.15.77:0/2100537936 shutdown_connections 2024-09-18T21:11:14.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.213+0000 7f018396d640 1 -- 172.21.15.77:0/2100537936 wait complete. 2024-09-18T21:11:14.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.213+0000 7f018396d640 1 Processor -- start 2024-09-18T21:11:14.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.213+0000 7f018396d640 1 -- start start 2024-09-18T21:11:14.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.213+0000 7f018396d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f017c0fb420 0x7f017c10bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:14.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.213+0000 7f018396d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f017c0fc6f0 0x7f017c10c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:14.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.213+0000 7f018396d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017c10cae0 con 0x7f017c0fb420 2024-09-18T21:11:14.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.213+0000 7f018396d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017c10d300 con 0x7f017c0fc6f0 2024-09-18T21:11:14.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.214+0000 7f0180f08640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f017c0fc6f0 0x7f017c10c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:14.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.214+0000 7f0180f08640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f017c0fc6f0 0x7f017c10c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:59948/0 (socket says 172.21.15.77:59948) 2024-09-18T21:11:14.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.214+0000 7f0180f08640 1 -- 172.21.15.77:0/126292664 learned_addr learned my addr 172.21.15.77:0/126292664 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:11:14.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.214+0000 7f0181709640 1 --2- 172.21.15.77:0/126292664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f017c0fb420 0x7f017c10bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:14.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.214+0000 7f0180f08640 1 -- 172.21.15.77:0/126292664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f017c0fb420 msgr2=0x7f017c10bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:14.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.214+0000 7f0180f08640 1 --2- 172.21.15.77:0/126292664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f017c0fb420 0x7f017c10bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:14.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.214+0000 7f0180f08640 1 -- 172.21.15.77:0/126292664 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0178005040 con 0x7f017c0fc6f0 2024-09-18T21:11:14.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.214+0000 7f0180f08640 1 --2- 172.21.15.77:0/126292664 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f017c0fc6f0 0x7f017c10c490 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f016c002a80 tx=0x7f016c004600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:11:14.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.215+0000 7f0171ffb640 1 -- 172.21.15.77:0/126292664 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f016c007c30 con 0x7f017c0fc6f0 2024-09-18T21:11:14.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.215+0000 7f018396d640 1 -- 172.21.15.77:0/126292664 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f017c10d530 con 0x7f017c0fc6f0 2024-09-18T21:11:14.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.215+0000 7f0171ffb640 1 -- 172.21.15.77:0/126292664 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f016c00f040 con 0x7f017c0fc6f0 2024-09-18T21:11:14.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.215+0000 7f0171ffb640 1 -- 172.21.15.77:0/126292664 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f016c0095b0 con 0x7f017c0fc6f0 2024-09-18T21:11:14.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.215+0000 7f018396d640 1 -- 172.21.15.77:0/126292664 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f017c10da50 con 0x7f017c0fc6f0 2024-09-18T21:11:14.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.216+0000 7f018396d640 1 -- 172.21.15.77:0/126292664 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f017c0fa880 con 0x7f017c0fc6f0 2024-09-18T21:11:14.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.217+0000 7f0171ffb640 1 -- 172.21.15.77:0/126292664 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f016c009710 con 0x7f017c0fc6f0 2024-09-18T21:11:14.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.218+0000 7f0171ffb640 1 --2- 172.21.15.77:0/126292664 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f016806eda0 0x7f0168071250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:14.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.218+0000 7f0171ffb640 1 -- 172.21.15.77:0/126292664 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f016c08db20 con 0x7f017c0fc6f0 2024-09-18T21:11:14.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.218+0000 7f0181709640 1 --2- 172.21.15.77:0/126292664 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f016806eda0 0x7f0168071250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:14.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.219+0000 7f0181709640 1 --2- 172.21.15.77:0/126292664 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f016806eda0 0x7f0168071250 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f017800b020 tx=0x7f0178037040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:11:14.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.226+0000 7f0171ffb640 1 -- 172.21.15.77:0/126292664 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f016c04d2a0 con 0x7f017c0fc6f0 2024-09-18T21:11:14.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.534+0000 7f018396d640 1 -- 172.21.15.77:0/126292664 --> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f017c10dd50 con 0x7f016806eda0 2024-09-18T21:11:14.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.546+0000 7f0171ffb640 1 -- 172.21.15.77:0/126292664 <== mgr.14206 v2:172.21.15.77:6800/950747822 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f017c10dd50 con 0x7f016806eda0 2024-09-18T21:11:14.548 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T21:11:14.548 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager.smithi077 smithi077 *:9093,9094 running (4m) 28s ago 5m 25.5M - 0.25.0 c8568f914cd2 e1881e21423c 2024-09-18T21:11:14.548 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi077 smithi077 running (6m) 28s ago 6m 6899k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 0beb64a8c2ea 2024-09-18T21:11:14.548 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi103 smithi103 running (5m) 35s ago 5m 6891k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 04981ca7bf34 2024-09-18T21:11:14.549 INFO:teuthology.orchestra.run.smithi077.stdout:grafana.smithi077 smithi077 *:3000 running (4m) 28s ago 5m 83.6M - 9.4.7 954c08fa6188 620f52934182 2024-09-18T21:11:14.549 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.cqfhlw smithi077 running (48s) 28s ago 47s 11.7M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 a7ec3b7701b6 2024-09-18T21:11:14.549 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.vruydi smithi077 running (53s) 28s ago 53s 15.4M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 affbba097d3b 2024-09-18T21:11:14.549 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi103.opftmf smithi103 running (45s) 35s ago 45s 13.9M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 111f884c5a34 2024-09-18T21:11:14.549 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi103.zhdmdg smithi103 running (51s) 35s ago 50s 14.3M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 50b77d0edda5 2024-09-18T21:11:14.549 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi077.utkpjg smithi077 *:9283,8765,8443 running (7m) 28s ago 7m 448M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 5d334eb01bea 2024-09-18T21:11:14.549 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi103.zjztqc smithi103 *:8443,9283 running (5m) 35s ago 5m 403M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 a2818ec1897e 2024-09-18T21:11:14.549 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi077 smithi077 running (7m) 28s ago 7m 49.1M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bcbf289fe027 2024-09-18T21:11:14.549 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi103 smithi103 running (5m) 35s ago 5m 41.9M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 d6ae2062e5e3 2024-09-18T21:11:14.549 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi077 smithi077 *:9100 running (6m) 28s ago 6m 16.8M - 1.5.0 0da6a335fe13 ee48144962b4 2024-09-18T21:11:14.549 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi103 smithi103 *:9100 running (5m) 35s ago 5m 16.8M - 1.5.0 0da6a335fe13 f7a4da7753f2 2024-09-18T21:11:14.549 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (4m) 28s ago 4m 47.1M 4288M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 2e3563c32cf5 2024-09-18T21:11:14.549 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi077 running (3m) 28s ago 3m 44.1M 4288M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 39c2ccbb7603 2024-09-18T21:11:14.550 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi077 running (3m) 28s ago 3m 43.0M 4288M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 2ff2728057e2 2024-09-18T21:11:14.550 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi103 running (3m) 35s ago 3m 43.9M 5312M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 0e72b1bbb8ce 2024-09-18T21:11:14.550 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi103 running (2m) 35s ago 2m 42.5M 5312M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 85f1ce1e8bee 2024-09-18T21:11:14.550 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi103 running (2m) 35s ago 2m 41.8M 5312M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 cf8964b3ac6d 2024-09-18T21:11:14.550 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus.smithi077 smithi077 *:9095 running (4m) 28s ago 5m 56.4M - 2.43.0 a07b618ecd1d 81e0f3809b2f 2024-09-18T21:11:14.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.549+0000 7f018396d640 1 -- 172.21.15.77:0/126292664 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f016806eda0 msgr2=0x7f0168071250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:14.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.550+0000 7f018396d640 1 --2- 172.21.15.77:0/126292664 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f016806eda0 0x7f0168071250 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f017800b020 tx=0x7f0178037040 comp rx=0 tx=0).stop 2024-09-18T21:11:14.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.550+0000 7f018396d640 1 -- 172.21.15.77:0/126292664 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f017c0fc6f0 msgr2=0x7f017c10c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:14.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.550+0000 7f018396d640 1 --2- 172.21.15.77:0/126292664 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f017c0fc6f0 0x7f017c10c490 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f016c002a80 tx=0x7f016c004600 comp rx=0 tx=0).stop 2024-09-18T21:11:14.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.550+0000 7f018396d640 1 -- 172.21.15.77:0/126292664 shutdown_connections 2024-09-18T21:11:14.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.550+0000 7f018396d640 1 --2- 172.21.15.77:0/126292664 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f016806eda0 0x7f0168071250 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:14.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.550+0000 7f018396d640 1 --2- 172.21.15.77:0/126292664 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f017c0fc6f0 0x7f017c10c490 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:14.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.550+0000 7f018396d640 1 --2- 172.21.15.77:0/126292664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f017c0fb420 0x7f017c10bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:14.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.550+0000 7f018396d640 1 -- 172.21.15.77:0/126292664 >> 172.21.15.77:0/126292664 conn(0x7f017c0f6c00 msgr2=0x7f017c0f83a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:11:14.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.550+0000 7f018396d640 1 -- 172.21.15.77:0/126292664 shutdown_connections 2024-09-18T21:11:14.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.550+0000 7f018396d640 1 -- 172.21.15.77:0/126292664 wait complete. 2024-09-18T21:11:14.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.654+0000 7f1c34fad640 1 -- 172.21.15.77:0/4075284474 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c30065b80 msgr2=0x7f1c300ff200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:14.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.654+0000 7f1c34fad640 1 --2- 172.21.15.77:0/4075284474 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c30065b80 0x7f1c300ff200 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1c200048d0 tx=0x7f1c20009da0 comp rx=0 tx=0).stop 2024-09-18T21:11:14.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.655+0000 7f1c34fad640 1 -- 172.21.15.77:0/4075284474 shutdown_connections 2024-09-18T21:11:14.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.655+0000 7f1c34fad640 1 --2- 172.21.15.77:0/4075284474 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c300ff740 0x7f1c30101b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:14.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.655+0000 7f1c34fad640 1 --2- 172.21.15.77:0/4075284474 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c30065b80 0x7f1c300ff200 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:14.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.655+0000 7f1c34fad640 1 -- 172.21.15.77:0/4075284474 >> 172.21.15.77:0/4075284474 conn(0x7f1c300f6c10 msgr2=0x7f1c300f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:11:14.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.655+0000 7f1c34fad640 1 -- 172.21.15.77:0/4075284474 shutdown_connections 2024-09-18T21:11:14.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.655+0000 7f1c34fad640 1 -- 172.21.15.77:0/4075284474 wait complete. 2024-09-18T21:11:14.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.656+0000 7f1c34fad640 1 Processor -- start 2024-09-18T21:11:14.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.656+0000 7f1c34fad640 1 -- start start 2024-09-18T21:11:14.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.656+0000 7f1c34fad640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c30065b80 0x7f1c3010d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:14.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.656+0000 7f1c34fad640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c300ff740 0x7f1c3010d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:14.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.656+0000 7f1c34fad640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3010dc20 con 0x7f1c30065b80 2024-09-18T21:11:14.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.656+0000 7f1c34fad640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3010e3f0 con 0x7f1c300ff740 2024-09-18T21:11:14.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.656+0000 7f1c2e59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c30065b80 0x7f1c3010d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:14.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.656+0000 7f1c2e59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c30065b80 0x7f1c3010d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33024/0 (socket says 172.21.15.77:33024) 2024-09-18T21:11:14.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.656+0000 7f1c2e59c640 1 -- 172.21.15.77:0/4275135775 learned_addr learned my addr 172.21.15.77:0/4275135775 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:11:14.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.656+0000 7f1c2dd9b640 1 --2- 172.21.15.77:0/4275135775 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c300ff740 0x7f1c3010d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:14.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.657+0000 7f1c2e59c640 1 -- 172.21.15.77:0/4275135775 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c300ff740 msgr2=0x7f1c3010d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:14.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.657+0000 7f1c2e59c640 1 --2- 172.21.15.77:0/4275135775 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c300ff740 0x7f1c3010d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:14.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.657+0000 7f1c2e59c640 1 -- 172.21.15.77:0/4275135775 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c20005040 con 0x7f1c30065b80 2024-09-18T21:11:14.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.657+0000 7f1c2dd9b640 1 --2- 172.21.15.77:0/4275135775 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c300ff740 0x7f1c3010d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T21:11:14.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.657+0000 7f1c2e59c640 1 --2- 172.21.15.77:0/4275135775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c30065b80 0x7f1c3010d090 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1c200043d0 tx=0x7f1c20009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:11:14.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.657+0000 7f1c1effd640 1 -- 172.21.15.77:0/4275135775 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c20038070 con 0x7f1c30065b80 2024-09-18T21:11:14.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.657+0000 7f1c1effd640 1 -- 172.21.15.77:0/4275135775 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1c2002ae90 con 0x7f1c30065b80 2024-09-18T21:11:14.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.657+0000 7f1c1effd640 1 -- 172.21.15.77:0/4275135775 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c2003e670 con 0x7f1c30065b80 2024-09-18T21:11:14.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.658+0000 7f1c34fad640 1 -- 172.21.15.77:0/4275135775 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c3010e620 con 0x7f1c30065b80 2024-09-18T21:11:14.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.658+0000 7f1c34fad640 1 -- 172.21.15.77:0/4275135775 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c3010eb00 con 0x7f1c30065b80 2024-09-18T21:11:14.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.660+0000 7f1c34fad640 1 -- 172.21.15.77:0/4275135775 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c300fa890 con 0x7f1c30065b80 2024-09-18T21:11:14.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.661+0000 7f1c1effd640 1 -- 172.21.15.77:0/4275135775 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f1c20030020 con 0x7f1c30065b80 2024-09-18T21:11:14.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.661+0000 7f1c1effd640 1 --2- 172.21.15.77:0/4275135775 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f1c1806ee20 0x7f1c180712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:14.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.662+0000 7f1c1effd640 1 -- 172.21.15.77:0/4275135775 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f1c200ae190 con 0x7f1c30065b80 2024-09-18T21:11:14.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.662+0000 7f1c2dd9b640 1 --2- 172.21.15.77:0/4275135775 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f1c1806ee20 0x7f1c180712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:14.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.663+0000 7f1c2dd9b640 1 --2- 172.21.15.77:0/4275135775 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f1c1806ee20 0x7f1c180712d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1c24004fd0 tx=0x7f1c2400b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:11:14.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:14.667+0000 7f1c1effd640 1 -- 172.21.15.77:0/4275135775 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f1c2007b480 con 0x7f1c30065b80 2024-09-18T21:11:14.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:14 smithi077 ceph-mon[27689]: from='client.14522 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:11:14.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:14 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:11:15.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:14 smithi103 ceph-mon[34827]: from='client.14522 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:11:15.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:14 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:11:15.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.089+0000 7f1c34fad640 1 -- 172.21.15.77:0/4275135775 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1c3010ee70 con 0x7f1c30065b80 2024-09-18T21:11:15.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.090+0000 7f1c1effd640 1 -- 172.21.15.77:0/4275135775 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+643 (secure 0 0 0) 0x7f1c2007ae20 con 0x7f1c30065b80 2024-09-18T21:11:15.093 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-18T21:11:15.093 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": { 2024-09-18T21:11:15.093 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 2 2024-09-18T21:11:15.093 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:11:15.093 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": { 2024-09-18T21:11:15.093 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 2 2024-09-18T21:11:15.093 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:11:15.093 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": { 2024-09-18T21:11:15.093 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 6 2024-09-18T21:11:15.093 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:11:15.094 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-09-18T21:11:15.094 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4 2024-09-18T21:11:15.094 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:11:15.094 INFO:teuthology.orchestra.run.smithi077.stdout: "overall": { 2024-09-18T21:11:15.094 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 14 2024-09-18T21:11:15.094 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-18T21:11:15.094 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-18T21:11:15.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.093+0000 7f1c34fad640 1 -- 172.21.15.77:0/4275135775 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f1c1806ee20 msgr2=0x7f1c180712d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:15.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.093+0000 7f1c34fad640 1 --2- 172.21.15.77:0/4275135775 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f1c1806ee20 0x7f1c180712d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1c24004fd0 tx=0x7f1c2400b040 comp rx=0 tx=0).stop 2024-09-18T21:11:15.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.093+0000 7f1c34fad640 1 -- 172.21.15.77:0/4275135775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c30065b80 msgr2=0x7f1c3010d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:15.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.093+0000 7f1c34fad640 1 --2- 172.21.15.77:0/4275135775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c30065b80 0x7f1c3010d090 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1c200043d0 tx=0x7f1c20009da0 comp rx=0 tx=0).stop 2024-09-18T21:11:15.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.093+0000 7f1c34fad640 1 -- 172.21.15.77:0/4275135775 shutdown_connections 2024-09-18T21:11:15.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.093+0000 7f1c34fad640 1 --2- 172.21.15.77:0/4275135775 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f1c1806ee20 0x7f1c180712d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:15.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.093+0000 7f1c34fad640 1 --2- 172.21.15.77:0/4275135775 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c300ff740 0x7f1c3010d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:15.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.093+0000 7f1c34fad640 1 --2- 172.21.15.77:0/4275135775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c30065b80 0x7f1c3010d090 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:15.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.093+0000 7f1c34fad640 1 -- 172.21.15.77:0/4275135775 >> 172.21.15.77:0/4275135775 conn(0x7f1c300f6c10 msgr2=0x7f1c300f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:11:15.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.093+0000 7f1c34fad640 1 -- 172.21.15.77:0/4275135775 shutdown_connections 2024-09-18T21:11:15.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.093+0000 7f1c34fad640 1 -- 172.21.15.77:0/4275135775 wait complete. 2024-09-18T21:11:15.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.200+0000 7f46d9978640 1 -- 172.21.15.77:0/3955694790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46cc0a7ae0 msgr2=0x7f46cc0a9ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:15.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.200+0000 7f46d9978640 1 --2- 172.21.15.77:0/3955694790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46cc0a7ae0 0x7f46cc0a9ee0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f46c00048d0 tx=0x7f46c0009da0 comp rx=0 tx=0).stop 2024-09-18T21:11:15.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.200+0000 7f46d9978640 1 -- 172.21.15.77:0/3955694790 shutdown_connections 2024-09-18T21:11:15.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.200+0000 7f46d9978640 1 --2- 172.21.15.77:0/3955694790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46cc0a7ae0 0x7f46cc0a9ee0 secure :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f46c00048d0 tx=0x7f46c0009da0 comp rx=0 tx=0).stop 2024-09-18T21:11:15.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.200+0000 7f46d9978640 1 --2- 172.21.15.77:0/3955694790 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46cc0a51c0 0x7f46cc0a75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:15.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.200+0000 7f46d9978640 1 -- 172.21.15.77:0/3955694790 >> 172.21.15.77:0/3955694790 conn(0x7f46cc09f470 msgr2=0x7f46cc0a18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:11:15.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.200+0000 7f46d9978640 1 -- 172.21.15.77:0/3955694790 shutdown_connections 2024-09-18T21:11:15.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.200+0000 7f46d9978640 1 -- 172.21.15.77:0/3955694790 wait complete. 2024-09-18T21:11:15.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.202+0000 7f46d9978640 1 Processor -- start 2024-09-18T21:11:15.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.202+0000 7f46d9978640 1 -- start start 2024-09-18T21:11:15.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.203+0000 7f46d9978640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46cc0a51c0 0x7f46cc0b6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:15.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.203+0000 7f46d9978640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46cc0b6b50 0x7f46cc0bbba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:15.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.203+0000 7f46d9978640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46cc0b7010 con 0x7f46cc0a51c0 2024-09-18T21:11:15.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.203+0000 7f46d9978640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46cc0b7150 con 0x7f46cc0b6b50 2024-09-18T21:11:15.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.203+0000 7f46d8976640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46cc0a51c0 0x7f46cc0b6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:15.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.203+0000 7f46d8976640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46cc0a51c0 0x7f46cc0b6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33042/0 (socket says 172.21.15.77:33042) 2024-09-18T21:11:15.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.203+0000 7f46d8976640 1 -- 172.21.15.77:0/506592331 learned_addr learned my addr 172.21.15.77:0/506592331 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:11:15.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.203+0000 7f46d3fff640 1 --2- 172.21.15.77:0/506592331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46cc0b6b50 0x7f46cc0bbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:15.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.203+0000 7f46d3fff640 1 -- 172.21.15.77:0/506592331 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46cc0a51c0 msgr2=0x7f46cc0b6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:15.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.203+0000 7f46d3fff640 1 --2- 172.21.15.77:0/506592331 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46cc0a51c0 0x7f46cc0b6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:15.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.203+0000 7f46d3fff640 1 -- 172.21.15.77:0/506592331 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c0005040 con 0x7f46cc0b6b50 2024-09-18T21:11:15.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.203+0000 7f46d3fff640 1 --2- 172.21.15.77:0/506592331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46cc0b6b50 0x7f46cc0bbba0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f46cc0181a0 tx=0x7f46c0009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:11:15.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.204+0000 7f46d17fa640 1 -- 172.21.15.77:0/506592331 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46c0038070 con 0x7f46cc0b6b50 2024-09-18T21:11:15.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.204+0000 7f46d17fa640 1 -- 172.21.15.77:0/506592331 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f46c0032b20 con 0x7f46cc0b6b50 2024-09-18T21:11:15.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.204+0000 7f46d9978640 1 -- 172.21.15.77:0/506592331 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46cc0aa8f0 con 0x7f46cc0b6b50 2024-09-18T21:11:15.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.204+0000 7f46d17fa640 1 -- 172.21.15.77:0/506592331 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46c003d710 con 0x7f46cc0b6b50 2024-09-18T21:11:15.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.204+0000 7f46d9978640 1 -- 172.21.15.77:0/506592331 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46cc0aae60 con 0x7f46cc0b6b50 2024-09-18T21:11:15.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.205+0000 7f46d9978640 1 -- 172.21.15.77:0/506592331 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46cc004bf0 con 0x7f46cc0b6b50 2024-09-18T21:11:15.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.206+0000 7f46d17fa640 1 -- 172.21.15.77:0/506592331 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f46c0030020 con 0x7f46cc0b6b50 2024-09-18T21:11:15.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.207+0000 7f46d17fa640 1 --2- 172.21.15.77:0/506592331 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f46c406ee30 0x7f46c40712e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:15.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.207+0000 7f46d17fa640 1 -- 172.21.15.77:0/506592331 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f46c00ae200 con 0x7f46cc0b6b50 2024-09-18T21:11:15.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.207+0000 7f46d8976640 1 --2- 172.21.15.77:0/506592331 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f46c406ee30 0x7f46c40712e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:15.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.208+0000 7f46d8976640 1 --2- 172.21.15.77:0/506592331 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f46c406ee30 0x7f46c40712e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f46c80044e0 tx=0x7f46c800b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:11:15.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.215+0000 7f46d17fa640 1 -- 172.21.15.77:0/506592331 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f46c007b300 con 0x7f46cc0b6b50 2024-09-18T21:11:15.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.555+0000 7f46d9978640 1 -- 172.21.15.77:0/506592331 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f46cc002740 con 0x7f46cc0b6b50 2024-09-18T21:11:15.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.559+0000 7f46d17fa640 1 -- 172.21.15.77:0/506592331 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1807 (secure 0 0 0) 0x7f46c007aca0 con 0x7f46cc0b6b50 2024-09-18T21:11:15.561 INFO:teuthology.orchestra.run.smithi077.stdout:e13 2024-09-18T21:11:15.561 INFO:teuthology.orchestra.run.smithi077.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T21:11:15.561 INFO:teuthology.orchestra.run.smithi077.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T21:11:15.561 INFO:teuthology.orchestra.run.smithi077.stdout:legacy client fscid: 1 2024-09-18T21:11:15.561 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:11:15.561 INFO:teuthology.orchestra.run.smithi077.stdout:Filesystem 'cephfs' (1) 2024-09-18T21:11:15.561 INFO:teuthology.orchestra.run.smithi077.stdout:fs_name cephfs 2024-09-18T21:11:15.561 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 13 2024-09-18T21:11:15.561 INFO:teuthology.orchestra.run.smithi077.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T21:11:15.562 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-09-18T21:10:17.230179+0000 2024-09-18T21:11:15.562 INFO:teuthology.orchestra.run.smithi077.stdout:modified 2024-09-18T21:10:33.373241+0000 2024-09-18T21:11:15.562 INFO:teuthology.orchestra.run.smithi077.stdout:tableserver 0 2024-09-18T21:11:15.562 INFO:teuthology.orchestra.run.smithi077.stdout:root 0 2024-09-18T21:11:15.562 INFO:teuthology.orchestra.run.smithi077.stdout:session_timeout 60 2024-09-18T21:11:15.562 INFO:teuthology.orchestra.run.smithi077.stdout:session_autoclose 300 2024-09-18T21:11:15.562 INFO:teuthology.orchestra.run.smithi077.stdout:max_file_size 1099511627776 2024-09-18T21:11:15.562 INFO:teuthology.orchestra.run.smithi077.stdout:required_client_features {} 2024-09-18T21:11:15.562 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure 0 2024-09-18T21:11:15.562 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure_osd_epoch 0 2024-09-18T21:11:15.562 INFO:teuthology.orchestra.run.smithi077.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T21:11:15.562 INFO:teuthology.orchestra.run.smithi077.stdout:max_mds 1 2024-09-18T21:11:15.562 INFO:teuthology.orchestra.run.smithi077.stdout:in 0 2024-09-18T21:11:15.563 INFO:teuthology.orchestra.run.smithi077.stdout:up {0=14446} 2024-09-18T21:11:15.563 INFO:teuthology.orchestra.run.smithi077.stdout:failed 2024-09-18T21:11:15.563 INFO:teuthology.orchestra.run.smithi077.stdout:damaged 2024-09-18T21:11:15.563 INFO:teuthology.orchestra.run.smithi077.stdout:stopped 2024-09-18T21:11:15.563 INFO:teuthology.orchestra.run.smithi077.stdout:data_pools [3] 2024-09-18T21:11:15.563 INFO:teuthology.orchestra.run.smithi077.stdout:metadata_pool 2 2024-09-18T21:11:15.563 INFO:teuthology.orchestra.run.smithi077.stdout:inline_data disabled 2024-09-18T21:11:15.563 INFO:teuthology.orchestra.run.smithi077.stdout:balancer 2024-09-18T21:11:15.563 INFO:teuthology.orchestra.run.smithi077.stdout:standby_count_wanted 1 2024-09-18T21:11:15.563 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.vruydi{0:14446} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.77:6826/334039954,v1:172.21.15.77:6827/334039954] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:11:15.563 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:11:15.563 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:11:15.563 INFO:teuthology.orchestra.run.smithi077.stdout:Standby daemons: 2024-09-18T21:11:15.563 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:11:15.564 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.cqfhlw{-1:14458} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.77:6828/862540650,v1:172.21.15.77:6829/862540650] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:11:15.564 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi103.zhdmdg{-1:24255} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.103:6824/2170237078,v1:172.21.15.103:6825/2170237078] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:11:15.564 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi103.opftmf{-1:24267} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.103:6826/4241818403,v1:172.21.15.103:6827/4241818403] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:11:15.564 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 13 2024-09-18T21:11:15.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.562+0000 7f46d9978640 1 -- 172.21.15.77:0/506592331 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f46c406ee30 msgr2=0x7f46c40712e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:15.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.562+0000 7f46d9978640 1 --2- 172.21.15.77:0/506592331 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f46c406ee30 0x7f46c40712e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f46c80044e0 tx=0x7f46c800b040 comp rx=0 tx=0).stop 2024-09-18T21:11:15.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.562+0000 7f46d9978640 1 -- 172.21.15.77:0/506592331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46cc0b6b50 msgr2=0x7f46cc0bbba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:15.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.562+0000 7f46d9978640 1 --2- 172.21.15.77:0/506592331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46cc0b6b50 0x7f46cc0bbba0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f46cc0181a0 tx=0x7f46c0009da0 comp rx=0 tx=0).stop 2024-09-18T21:11:15.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.562+0000 7f46d9978640 1 -- 172.21.15.77:0/506592331 shutdown_connections 2024-09-18T21:11:15.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.562+0000 7f46d9978640 1 --2- 172.21.15.77:0/506592331 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f46c406ee30 0x7f46c40712e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:15.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.562+0000 7f46d9978640 1 --2- 172.21.15.77:0/506592331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f46cc0b6b50 0x7f46cc0bbba0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:15.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.562+0000 7f46d9978640 1 --2- 172.21.15.77:0/506592331 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46cc0a51c0 0x7f46cc0b6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:15.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.562+0000 7f46d9978640 1 -- 172.21.15.77:0/506592331 >> 172.21.15.77:0/506592331 conn(0x7f46cc09f470 msgr2=0x7f46cc09f840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:11:15.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.562+0000 7f46d9978640 1 -- 172.21.15.77:0/506592331 shutdown_connections 2024-09-18T21:11:15.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.562+0000 7f46d9978640 1 -- 172.21.15.77:0/506592331 wait complete. 2024-09-18T21:11:15.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.660+0000 7fca773cf640 1 -- 172.21.15.77:0/1792344859 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca700fc700 msgr2=0x7fca700fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:15.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.660+0000 7fca773cf640 1 --2- 172.21.15.77:0/1792344859 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca700fc700 0x7fca700fcb70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fca600048d0 tx=0x7fca60009da0 comp rx=0 tx=0).stop 2024-09-18T21:11:15.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.660+0000 7fca773cf640 1 -- 172.21.15.77:0/1792344859 shutdown_connections 2024-09-18T21:11:15.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.660+0000 7fca773cf640 1 --2- 172.21.15.77:0/1792344859 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca700fc700 0x7fca700fcb70 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:15.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.660+0000 7fca773cf640 1 --2- 172.21.15.77:0/1792344859 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca700fb430 0x7fca700fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:15.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.660+0000 7fca773cf640 1 -- 172.21.15.77:0/1792344859 >> 172.21.15.77:0/1792344859 conn(0x7fca700f6c10 msgr2=0x7fca700f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:11:15.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.660+0000 7fca773cf640 1 -- 172.21.15.77:0/1792344859 shutdown_connections 2024-09-18T21:11:15.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.660+0000 7fca773cf640 1 -- 172.21.15.77:0/1792344859 wait complete. 2024-09-18T21:11:15.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.661+0000 7fca773cf640 1 Processor -- start 2024-09-18T21:11:15.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.661+0000 7fca773cf640 1 -- start start 2024-09-18T21:11:15.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.661+0000 7fca773cf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca700fb430 0x7fca700ff550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:15.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.661+0000 7fca773cf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca700fc700 0x7fca700fda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:15.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.661+0000 7fca773cf640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca700fdfd0 con 0x7fca700fc700 2024-09-18T21:11:15.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.661+0000 7fca773cf640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca700fe110 con 0x7fca700fb430 2024-09-18T21:11:15.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.661+0000 7fca7496a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca700fc700 0x7fca700fda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:15.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.661+0000 7fca7496a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca700fc700 0x7fca700fda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33062/0 (socket says 172.21.15.77:33062) 2024-09-18T21:11:15.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.661+0000 7fca7496a640 1 -- 172.21.15.77:0/1878035446 learned_addr learned my addr 172.21.15.77:0/1878035446 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:11:15.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.661+0000 7fca7516b640 1 --2- 172.21.15.77:0/1878035446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca700fb430 0x7fca700ff550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:15.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.662+0000 7fca7496a640 1 -- 172.21.15.77:0/1878035446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca700fb430 msgr2=0x7fca700ff550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:15.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.662+0000 7fca7496a640 1 --2- 172.21.15.77:0/1878035446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca700fb430 0x7fca700ff550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:15.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.662+0000 7fca7496a640 1 -- 172.21.15.77:0/1878035446 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca60005040 con 0x7fca700fc700 2024-09-18T21:11:15.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.662+0000 7fca7516b640 1 --2- 172.21.15.77:0/1878035446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca700fb430 0x7fca700ff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T21:11:15.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.662+0000 7fca7496a640 1 --2- 172.21.15.77:0/1878035446 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca700fc700 0x7fca700fda40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fca600048a0 tx=0x7fca60009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:11:15.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.662+0000 7fca65ffb640 1 -- 172.21.15.77:0/1878035446 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca60038070 con 0x7fca700fc700 2024-09-18T21:11:15.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.662+0000 7fca773cf640 1 -- 172.21.15.77:0/1878035446 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca700fe390 con 0x7fca700fc700 2024-09-18T21:11:15.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.662+0000 7fca65ffb640 1 -- 172.21.15.77:0/1878035446 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fca60004290 con 0x7fca700fc700 2024-09-18T21:11:15.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.662+0000 7fca65ffb640 1 -- 172.21.15.77:0/1878035446 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca60033660 con 0x7fca700fc700 2024-09-18T21:11:15.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.663+0000 7fca773cf640 1 -- 172.21.15.77:0/1878035446 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca701150d0 con 0x7fca700fc700 2024-09-18T21:11:15.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.664+0000 7fca773cf640 1 -- 172.21.15.77:0/1878035446 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca700fa890 con 0x7fca700fc700 2024-09-18T21:11:15.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.665+0000 7fca65ffb640 1 -- 172.21.15.77:0/1878035446 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fca60030020 con 0x7fca700fc700 2024-09-18T21:11:15.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.666+0000 7fca65ffb640 1 --2- 172.21.15.77:0/1878035446 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fca5c06ed60 0x7fca5c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:15.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.666+0000 7fca7516b640 1 --2- 172.21.15.77:0/1878035446 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fca5c06ed60 0x7fca5c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:15.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.666+0000 7fca65ffb640 1 -- 172.21.15.77:0/1878035446 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fca600ae210 con 0x7fca700fc700 2024-09-18T21:11:15.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.666+0000 7fca7516b640 1 --2- 172.21.15.77:0/1878035446 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fca5c06ed60 0x7fca5c071210 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fca700ff300 tx=0x7fca6c00b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:11:15.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.672+0000 7fca65ffb640 1 -- 172.21.15.77:0/1878035446 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fca6007b460 con 0x7fca700fc700 2024-09-18T21:11:15.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:15 smithi077 ceph-mon[27689]: pgmap v196: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-18T21:11:15.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:15 smithi077 ceph-mon[27689]: from='client.24321 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:11:15.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:15 smithi077 ceph-mon[27689]: from='client.24325 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:11:15.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:15 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/4275135775' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:11:15.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.970+0000 7fca773cf640 1 -- 172.21.15.77:0/1878035446 --> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fca70103f60 con 0x7fca5c06ed60 2024-09-18T21:11:15.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.971+0000 7fca65ffb640 1 -- 172.21.15.77:0/1878035446 <== mgr.14206 v2:172.21.15.77:6800/950747822 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fca70103f60 con 0x7fca5c06ed60 2024-09-18T21:11:15.973 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-18T21:11:15.974 INFO:teuthology.orchestra.run.smithi077.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:06b1b1de896d25f0645e4a306558ab0b4d4fc56f", 2024-09-18T21:11:15.974 INFO:teuthology.orchestra.run.smithi077.stdout: "in_progress": true, 2024-09-18T21:11:15.974 INFO:teuthology.orchestra.run.smithi077.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T21:11:15.974 INFO:teuthology.orchestra.run.smithi077.stdout: "services_complete": [], 2024-09-18T21:11:15.974 INFO:teuthology.orchestra.run.smithi077.stdout: "progress": "", 2024-09-18T21:11:15.974 INFO:teuthology.orchestra.run.smithi077.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:06b1b1de896d25f0645e4a306558ab0b4d4fc56f image", 2024-09-18T21:11:15.974 INFO:teuthology.orchestra.run.smithi077.stdout: "is_paused": false 2024-09-18T21:11:15.974 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-18T21:11:15.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.974+0000 7fca773cf640 1 -- 172.21.15.77:0/1878035446 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fca5c06ed60 msgr2=0x7fca5c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:15.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.974+0000 7fca773cf640 1 --2- 172.21.15.77:0/1878035446 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fca5c06ed60 0x7fca5c071210 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fca700ff300 tx=0x7fca6c00b040 comp rx=0 tx=0).stop 2024-09-18T21:11:15.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.974+0000 7fca773cf640 1 -- 172.21.15.77:0/1878035446 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca700fc700 msgr2=0x7fca700fda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:15.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.974+0000 7fca773cf640 1 --2- 172.21.15.77:0/1878035446 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca700fc700 0x7fca700fda40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fca600048a0 tx=0x7fca60009da0 comp rx=0 tx=0).stop 2024-09-18T21:11:15.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.974+0000 7fca773cf640 1 -- 172.21.15.77:0/1878035446 shutdown_connections 2024-09-18T21:11:15.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.974+0000 7fca773cf640 1 --2- 172.21.15.77:0/1878035446 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fca5c06ed60 0x7fca5c071210 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:15.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.974+0000 7fca773cf640 1 --2- 172.21.15.77:0/1878035446 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca700fc700 0x7fca700fda40 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:15.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.974+0000 7fca773cf640 1 --2- 172.21.15.77:0/1878035446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca700fb430 0x7fca700ff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:15.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.974+0000 7fca773cf640 1 -- 172.21.15.77:0/1878035446 >> 172.21.15.77:0/1878035446 conn(0x7fca700f6c10 msgr2=0x7fca70065600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:11:15.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.975+0000 7fca773cf640 1 -- 172.21.15.77:0/1878035446 shutdown_connections 2024-09-18T21:11:15.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:15.975+0000 7fca773cf640 1 -- 172.21.15.77:0/1878035446 wait complete. 2024-09-18T21:11:16.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:15 smithi103 ceph-mon[34827]: pgmap v196: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-18T21:11:16.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:15 smithi103 ceph-mon[34827]: from='client.24321 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:11:16.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:15 smithi103 ceph-mon[34827]: from='client.24325 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:11:16.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:15 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/4275135775' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:11:16.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:16.078+0000 7fc0a80ee640 1 -- 172.21.15.77:0/3448144947 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0a00fb450 msgr2=0x7fc0a00fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:16.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:16.078+0000 7fc0a80ee640 1 --2- 172.21.15.77:0/3448144947 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0a00fb450 0x7fc0a00fb860 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc09c004810 tx=0x7fc09c009da0 comp rx=0 tx=0).stop 2024-09-18T21:11:16.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:16.078+0000 7fc0a80ee640 1 -- 172.21.15.77:0/3448144947 shutdown_connections 2024-09-18T21:11:16.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:16.078+0000 7fc0a80ee640 1 --2- 172.21.15.77:0/3448144947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0a00fc720 0x7fc0a00fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:16.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:16.078+0000 7fc0a80ee640 1 --2- 172.21.15.77:0/3448144947 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0a00fb450 0x7fc0a00fb860 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:16.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:16.078+0000 7fc0a80ee640 1 -- 172.21.15.77:0/3448144947 >> 172.21.15.77:0/3448144947 conn(0x7fc0a00f6c30 msgr2=0x7fc0a00f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:11:16.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:16.078+0000 7fc0a80ee640 1 -- 172.21.15.77:0/3448144947 shutdown_connections 2024-09-18T21:11:16.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:16.078+0000 7fc0a80ee640 1 -- 172.21.15.77:0/3448144947 wait complete. 2024-09-18T21:11:16.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:16.079+0000 7fc0a80ee640 1 Processor -- start 2024-09-18T21:11:16.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:16.079+0000 7fc0a80ee640 1 -- start start 2024-09-18T21:11:16.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:16.079+0000 7fc0a80ee640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0a00fb450 0x7fc0a010bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:16.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:16.080+0000 7fc0a80ee640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0a00fc720 0x7fc0a010c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:16.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:16.080+0000 7fc0a80ee640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a010c9b0 con 0x7fc0a00fc720 2024-09-18T21:11:16.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:16.080+0000 7fc0a5e8a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0a00fb450 0x7fc0a010bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:16.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:16.080+0000 7fc0a5e8a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0a00fb450 0x7fc0a010bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:59988/0 (socket says 172.21.15.77:59988) 2024-09-18T21:11:16.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:16.080+0000 7fc0a5e8a640 1 -- 172.21.15.77:0/3357430954 learned_addr learned my addr 172.21.15.77:0/3357430954 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:11:16.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:16.080+0000 7fc0a5689640 1 --2- 172.21.15.77:0/3357430954 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0a00fc720 0x7fc0a010c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:16.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:16.080+0000 7fc0a80ee640 1 -- 172.21.15.77:0/3357430954 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a010d0f0 con 0x7fc0a00fb450 2024-09-18T21:11:16.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:16.080+0000 7fc0a5e8a640 1 -- 172.21.15.77:0/3357430954 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0a00fc720 msgr2=0x7fc0a010c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:16.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:16.080+0000 7fc0a5e8a640 1 --2- 172.21.15.77:0/3357430954 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0a00fc720 0x7fc0a010c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:16.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:16.080+0000 7fc0a5e8a640 1 -- 172.21.15.77:0/3357430954 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc09c005040 con 0x7fc0a00fb450 2024-09-18T21:11:16.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:16.081+0000 7fc0a5e8a640 1 --2- 172.21.15.77:0/3357430954 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0a00fb450 0x7fc0a010bdf0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc09c004730 tx=0x7fc09c009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:11:16.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:16.081+0000 7fc0967fc640 1 -- 172.21.15.77:0/3357430954 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc09c038070 con 0x7fc0a00fb450 2024-09-18T21:11:16.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:16.081+0000 7fc0967fc640 1 -- 172.21.15.77:0/3357430954 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc09c032d20 con 0x7fc0a00fb450 2024-09-18T21:11:16.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:16.081+0000 7fc0967fc640 1 -- 172.21.15.77:0/3357430954 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc09c033990 con 0x7fc0a00fb450 2024-09-18T21:11:16.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:16.081+0000 7fc0a80ee640 1 -- 172.21.15.77:0/3357430954 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0a010d310 con 0x7fc0a00fb450 2024-09-18T21:11:16.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:16.081+0000 7fc0a80ee640 1 -- 172.21.15.77:0/3357430954 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a010d6c0 con 0x7fc0a00fb450 2024-09-18T21:11:16.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:16.082+0000 7fc0a80ee640 1 -- 172.21.15.77:0/3357430954 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0a00fa8e0 con 0x7fc0a00fb450 2024-09-18T21:11:16.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:16.083+0000 7fc0967fc640 1 -- 172.21.15.77:0/3357430954 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fc09c030020 con 0x7fc0a00fb450 2024-09-18T21:11:16.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:16.083+0000 7fc0967fc640 1 --2- 172.21.15.77:0/3357430954 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fc08c06eda0 0x7fc08c071250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:16.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:16.084+0000 7fc0967fc640 1 -- 172.21.15.77:0/3357430954 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fc09c0ae1e0 con 0x7fc0a00fb450 2024-09-18T21:11:16.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:16.084+0000 7fc0a5689640 1 --2- 172.21.15.77:0/3357430954 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fc08c06eda0 0x7fc08c071250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:16.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:16.084+0000 7fc0a5689640 1 --2- 172.21.15.77:0/3357430954 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fc08c06eda0 0x7fc08c071250 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc0a010bba0 tx=0x7fc09000b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:11:16.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:16.091+0000 7fc0967fc640 1 -- 172.21.15.77:0/3357430954 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fc09c07b260 con 0x7fc0a00fb450 2024-09-18T21:11:16.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:16.507+0000 7fc0a80ee640 1 -- 172.21.15.77:0/3357430954 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc0a010dc00 con 0x7fc0a00fb450 2024-09-18T21:11:16.509 INFO:teuthology.orchestra.run.smithi077.stdout:HEALTH_OK 2024-09-18T21:11:16.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:16.508+0000 7fc0967fc640 1 -- 172.21.15.77:0/3357430954 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fc09c07ac00 con 0x7fc0a00fb450 2024-09-18T21:11:16.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:16.510+0000 7fc0a80ee640 1 -- 172.21.15.77:0/3357430954 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fc08c06eda0 msgr2=0x7fc08c071250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:16.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:16.511+0000 7fc0a80ee640 1 --2- 172.21.15.77:0/3357430954 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fc08c06eda0 0x7fc08c071250 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc0a010bba0 tx=0x7fc09000b040 comp rx=0 tx=0).stop 2024-09-18T21:11:16.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:16.511+0000 7fc0a80ee640 1 -- 172.21.15.77:0/3357430954 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0a00fb450 msgr2=0x7fc0a010bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:16.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:16.511+0000 7fc0a80ee640 1 --2- 172.21.15.77:0/3357430954 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0a00fb450 0x7fc0a010bdf0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc09c004730 tx=0x7fc09c009da0 comp rx=0 tx=0).stop 2024-09-18T21:11:16.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:16.511+0000 7fc0a80ee640 1 -- 172.21.15.77:0/3357430954 shutdown_connections 2024-09-18T21:11:16.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:16.511+0000 7fc0a80ee640 1 --2- 172.21.15.77:0/3357430954 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fc08c06eda0 0x7fc08c071250 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:16.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:16.511+0000 7fc0a80ee640 1 --2- 172.21.15.77:0/3357430954 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0a00fc720 0x7fc0a010c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:16.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:16.511+0000 7fc0a80ee640 1 --2- 172.21.15.77:0/3357430954 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0a00fb450 0x7fc0a010bdf0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:16.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:16.511+0000 7fc0a80ee640 1 -- 172.21.15.77:0/3357430954 >> 172.21.15.77:0/3357430954 conn(0x7fc0a00f6c30 msgr2=0x7fc0a00f81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:11:16.514 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:16.511+0000 7fc0a80ee640 1 -- 172.21.15.77:0/3357430954 shutdown_connections 2024-09-18T21:11:16.514 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:16.511+0000 7fc0a80ee640 1 -- 172.21.15.77:0/3357430954 wait complete. 2024-09-18T21:11:16.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:16 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/506592331' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T21:11:16.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:16 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/3357430954' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T21:11:17.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:16 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/506592331' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T21:11:17.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:16 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/3357430954' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T21:11:17.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:17 smithi077 ceph-mon[27689]: from='client.14542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:11:17.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:17 smithi077 ceph-mon[27689]: pgmap v197: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-18T21:11:18.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:17 smithi103 ceph-mon[34827]: from='client.14542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:11:18.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:17 smithi103 ceph-mon[34827]: pgmap v197: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-18T21:11:19.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:19 smithi077 ceph-mon[27689]: pgmap v198: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-18T21:11:20.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:19 smithi103 ceph-mon[34827]: pgmap v198: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-18T21:11:21.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:21 smithi077 ceph-mon[27689]: pgmap v199: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-18T21:11:22.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:21 smithi103 ceph-mon[34827]: pgmap v199: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-18T21:11:23.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:23 smithi077 ceph-mon[27689]: pgmap v200: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-09-18T21:11:24.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:23 smithi103 ceph-mon[34827]: pgmap v200: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-09-18T21:11:25.834 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:25 smithi103 ceph-mon[34827]: pgmap v201: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:11:25.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:25 smithi077 ceph-mon[27689]: pgmap v201: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:11:27.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:27 smithi103 ceph-mon[34827]: pgmap v202: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:11:27.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:27 smithi077 ceph-mon[27689]: pgmap v202: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:11:29.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:29 smithi077 ceph-mon[27689]: pgmap v203: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:11:29.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:29 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:11:30.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:29 smithi103 ceph-mon[34827]: pgmap v203: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:11:30.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:29 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:11:31.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:31 smithi077 ceph-mon[27689]: pgmap v204: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:11:32.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:31 smithi103 ceph-mon[34827]: pgmap v204: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:11:33.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:33 smithi077 ceph-mon[27689]: pgmap v205: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:11:34.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:33 smithi103 ceph-mon[34827]: pgmap v205: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:11:35.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:35 smithi077 ceph-mon[27689]: pgmap v206: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:11:36.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:35 smithi103 ceph-mon[34827]: pgmap v206: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:11:37.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:37 smithi077 ceph-mon[27689]: pgmap v207: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:11:38.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:37 smithi103 ceph-mon[34827]: pgmap v207: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:11:39.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:39 smithi077 ceph-mon[27689]: pgmap v208: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:11:39.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:39 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:11:39.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:39 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:11:40.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:39 smithi103 ceph-mon[34827]: pgmap v208: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:11:40.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:39 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:11:40.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:39 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:11:40.899 INFO:tasks.workunit.client.1.smithi103.stderr:Note: switching to 'c27976df948bf97893b1a7826e51bfff94e4f88c'. 2024-09-18T21:11:40.899 INFO:tasks.workunit.client.1.smithi103.stderr: 2024-09-18T21:11:40.900 INFO:tasks.workunit.client.1.smithi103.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-18T21:11:40.900 INFO:tasks.workunit.client.1.smithi103.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-18T21:11:40.900 INFO:tasks.workunit.client.1.smithi103.stderr:state without impacting any branches by switching back to a branch. 2024-09-18T21:11:40.900 INFO:tasks.workunit.client.1.smithi103.stderr: 2024-09-18T21:11:40.900 INFO:tasks.workunit.client.1.smithi103.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-18T21:11:40.900 INFO:tasks.workunit.client.1.smithi103.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-18T21:11:40.900 INFO:tasks.workunit.client.1.smithi103.stderr: 2024-09-18T21:11:40.900 INFO:tasks.workunit.client.1.smithi103.stderr: git switch -c 2024-09-18T21:11:40.900 INFO:tasks.workunit.client.1.smithi103.stderr: 2024-09-18T21:11:40.900 INFO:tasks.workunit.client.1.smithi103.stderr:Or undo this operation with: 2024-09-18T21:11:40.900 INFO:tasks.workunit.client.1.smithi103.stderr: 2024-09-18T21:11:40.900 INFO:tasks.workunit.client.1.smithi103.stderr: git switch - 2024-09-18T21:11:40.900 INFO:tasks.workunit.client.1.smithi103.stderr: 2024-09-18T21:11:40.901 INFO:tasks.workunit.client.1.smithi103.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-18T21:11:40.901 INFO:tasks.workunit.client.1.smithi103.stderr: 2024-09-18T21:11:40.901 INFO:tasks.workunit.client.1.smithi103.stderr:HEAD is now at c27976df948 upgrade/cephfs/mds_upgrade_sequence: ignore osds down 2024-09-18T21:11:40.903 DEBUG:teuthology.orchestra.run.smithi103:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-09-18T21:11:40.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:40 smithi077 ceph-mon[27689]: Upgrade: Target is version 19.1.1-17-g06b1b1de (unknown) 2024-09-18T21:11:40.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:40 smithi077 ceph-mon[27689]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, digests ['quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a'] 2024-09-18T21:11:40.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:40 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:11:40.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:40 smithi077 ceph-mon[27689]: Upgrade: Need to upgrade myself (mgr.smithi077.utkpjg) 2024-09-18T21:11:40.967 INFO:tasks.workunit.client.1.smithi103.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-18T21:11:40.970 INFO:tasks.workunit.client.1.smithi103.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-18T21:11:40.970 INFO:tasks.workunit.client.1.smithi103.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-18T21:11:41.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:40 smithi103 ceph-mon[34827]: Upgrade: Target is version 19.1.1-17-g06b1b1de (unknown) 2024-09-18T21:11:41.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:40 smithi103 ceph-mon[34827]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, digests ['quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a'] 2024-09-18T21:11:41.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:40 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:11:41.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:40 smithi103 ceph-mon[34827]: Upgrade: Need to upgrade myself (mgr.smithi077.utkpjg) 2024-09-18T21:11:41.710 INFO:tasks.workunit.client.1.smithi103.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-18T21:11:41.775 INFO:tasks.workunit.client.1.smithi103.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-18T21:11:41.818 INFO:tasks.workunit.client.1.smithi103.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-18T21:11:41.819 INFO:tasks.workunit.client.1.smithi103.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-18T21:11:41.819 INFO:tasks.workunit.client.1.smithi103.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-18T21:11:41.861 INFO:tasks.workunit.client.1.smithi103.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-18T21:11:41.865 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-18T21:11:41.865 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-09-18T21:11:41.922 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-09-18T21:11:41.924 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-18T21:11:41.924 DEBUG:teuthology.orchestra.run.smithi103:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c27976df948bf97893b1a7826e51bfff94e4f88c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-09-18T21:11:41.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:41 smithi077 ceph-mon[27689]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a on smithi103 2024-09-18T21:11:41.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:41 smithi077 ceph-mon[27689]: pgmap v209: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:11:41.989 INFO:tasks.workunit.client.1.smithi103.stderr:+ mkdir -p fsstress 2024-09-18T21:11:41.991 INFO:tasks.workunit.client.1.smithi103.stderr:+ pushd fsstress 2024-09-18T21:11:41.992 INFO:tasks.workunit.client.1.smithi103.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-18T21:11:41.992 INFO:tasks.workunit.client.1.smithi103.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-18T21:11:42.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:41 smithi103 ceph-mon[34827]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a on smithi103 2024-09-18T21:11:42.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:41 smithi103 ceph-mon[34827]: pgmap v209: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:11:42.899 INFO:tasks.workunit.client.1.smithi103.stderr:+ tar xzf ltp-full.tgz 2024-09-18T21:11:43.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:43 smithi077 ceph-mon[27689]: pgmap v210: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:11:44.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:43 smithi103 ceph-mon[34827]: pgmap v210: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:11:44.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:44 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:11:45.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:44 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:11:45.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:45 smithi077 ceph-mon[27689]: pgmap v211: 65 pgs: 65 active+clean; 7.0 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 548 KiB/s wr, 3 op/s 2024-09-18T21:11:46.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:45 smithi103 ceph-mon[34827]: pgmap v211: 65 pgs: 65 active+clean; 7.0 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 548 KiB/s wr, 3 op/s 2024-09-18T21:11:46.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.606+0000 7f6ca357a640 1 -- 172.21.15.77:0/1302765816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c9c0fd7c0 msgr2=0x7f6c9c0fdc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:46.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.606+0000 7f6ca357a640 1 --2- 172.21.15.77:0/1302765816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c9c0fd7c0 0x7f6c9c0fdc30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c0048d0 tx=0x7f6c8c009da0 comp rx=0 tx=0).stop 2024-09-18T21:11:46.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.606+0000 7f6ca357a640 1 -- 172.21.15.77:0/1302765816 shutdown_connections 2024-09-18T21:11:46.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.606+0000 7f6ca357a640 1 --2- 172.21.15.77:0/1302765816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c9c0fd7c0 0x7f6c9c0fdc30 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:46.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.606+0000 7f6ca357a640 1 --2- 172.21.15.77:0/1302765816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c9c0fc4f0 0x7f6c9c0fc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:46.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.606+0000 7f6ca357a640 1 -- 172.21.15.77:0/1302765816 >> 172.21.15.77:0/1302765816 conn(0x7f6c9c0f7c90 msgr2=0x7f6c9c0fa0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:11:46.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.606+0000 7f6ca357a640 1 -- 172.21.15.77:0/1302765816 shutdown_connections 2024-09-18T21:11:46.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.606+0000 7f6ca357a640 1 -- 172.21.15.77:0/1302765816 wait complete. 2024-09-18T21:11:46.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.606+0000 7f6ca357a640 1 Processor -- start 2024-09-18T21:11:46.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.606+0000 7f6ca357a640 1 -- start start 2024-09-18T21:11:46.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.607+0000 7f6ca357a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c9c0fc4f0 0x7f6c9c071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:46.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.607+0000 7f6ca357a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c9c0fd7c0 0x7f6c9c06fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:46.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.607+0000 7f6ca357a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9c06fff0 con 0x7f6c9c0fd7c0 2024-09-18T21:11:46.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.607+0000 7f6ca357a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9c070130 con 0x7f6c9c0fc4f0 2024-09-18T21:11:46.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.607+0000 7f6ca0b15640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c9c0fd7c0 0x7f6c9c06fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:46.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.607+0000 7f6ca1316640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c9c0fc4f0 0x7f6c9c071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:46.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.607+0000 7f6ca1316640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c9c0fc4f0 0x7f6c9c071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:52610/0 (socket says 172.21.15.77:52610) 2024-09-18T21:11:46.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.607+0000 7f6ca0b15640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c9c0fd7c0 0x7f6c9c06fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55232/0 (socket says 172.21.15.77:55232) 2024-09-18T21:11:46.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.607+0000 7f6ca1316640 1 -- 172.21.15.77:0/1309371124 learned_addr learned my addr 172.21.15.77:0/1309371124 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:11:46.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.607+0000 7f6ca1316640 1 -- 172.21.15.77:0/1309371124 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c9c0fd7c0 msgr2=0x7f6c9c06fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:46.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.607+0000 7f6ca1316640 1 --2- 172.21.15.77:0/1309371124 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c9c0fd7c0 0x7f6c9c06fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:46.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.607+0000 7f6ca1316640 1 -- 172.21.15.77:0/1309371124 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8c005040 con 0x7f6c9c0fc4f0 2024-09-18T21:11:46.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.607+0000 7f6ca1316640 1 --2- 172.21.15.77:0/1309371124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c9c0fc4f0 0x7f6c9c071570 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6c9800eb70 tx=0x7f6c9800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:11:46.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.608+0000 7f6c91ffb640 1 -- 172.21.15.77:0/1309371124 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c98007c30 con 0x7f6c9c0fc4f0 2024-09-18T21:11:46.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.608+0000 7f6ca357a640 1 -- 172.21.15.77:0/1309371124 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c9c0703b0 con 0x7f6c9c0fc4f0 2024-09-18T21:11:46.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.608+0000 7f6c91ffb640 1 -- 172.21.15.77:0/1309371124 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6c9800f040 con 0x7f6c9c0fc4f0 2024-09-18T21:11:46.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.608+0000 7f6c91ffb640 1 -- 172.21.15.77:0/1309371124 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c98009550 con 0x7f6c9c0fc4f0 2024-09-18T21:11:46.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.608+0000 7f6ca357a640 1 -- 172.21.15.77:0/1309371124 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c9c115060 con 0x7f6c9c0fc4f0 2024-09-18T21:11:46.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.609+0000 7f6ca357a640 1 -- 172.21.15.77:0/1309371124 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c9c05ed70 con 0x7f6c9c0fc4f0 2024-09-18T21:11:46.613 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.609+0000 7f6c91ffb640 1 -- 172.21.15.77:0/1309371124 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f6c980096b0 con 0x7f6c9c0fc4f0 2024-09-18T21:11:46.613 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.610+0000 7f6c91ffb640 1 --2- 172.21.15.77:0/1309371124 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f6c8806ed50 0x7f6c88071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:46.613 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.610+0000 7f6c91ffb640 1 -- 172.21.15.77:0/1309371124 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f6c9808de00 con 0x7f6c9c0fc4f0 2024-09-18T21:11:46.613 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.610+0000 7f6ca0b15640 1 --2- 172.21.15.77:0/1309371124 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f6c8806ed50 0x7f6c88071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:46.613 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.611+0000 7f6ca0b15640 1 --2- 172.21.15.77:0/1309371124 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f6c8806ed50 0x7f6c88071200 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c004540 tx=0x7f6c8c035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:11:46.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.616+0000 7f6c91ffb640 1 -- 172.21.15.77:0/1309371124 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f6c9804e2a0 con 0x7f6c9c0fc4f0 2024-09-18T21:11:46.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.865+0000 7f6ca357a640 1 -- 172.21.15.77:0/1309371124 --> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c9c101c20 con 0x7f6c8806ed50 2024-09-18T21:11:46.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.867+0000 7f6c91ffb640 1 -- 172.21.15.77:0/1309371124 <== mgr.14206 v2:172.21.15.77:6800/950747822 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f6c9c101c20 con 0x7f6c8806ed50 2024-09-18T21:11:46.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.869+0000 7f6ca357a640 1 -- 172.21.15.77:0/1309371124 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f6c8806ed50 msgr2=0x7f6c88071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:46.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.869+0000 7f6ca357a640 1 --2- 172.21.15.77:0/1309371124 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f6c8806ed50 0x7f6c88071200 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c004540 tx=0x7f6c8c035040 comp rx=0 tx=0).stop 2024-09-18T21:11:46.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.869+0000 7f6ca357a640 1 -- 172.21.15.77:0/1309371124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c9c0fc4f0 msgr2=0x7f6c9c071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:46.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.869+0000 7f6ca357a640 1 --2- 172.21.15.77:0/1309371124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c9c0fc4f0 0x7f6c9c071570 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6c9800eb70 tx=0x7f6c9800b040 comp rx=0 tx=0).stop 2024-09-18T21:11:46.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.869+0000 7f6ca357a640 1 -- 172.21.15.77:0/1309371124 shutdown_connections 2024-09-18T21:11:46.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.869+0000 7f6ca357a640 1 --2- 172.21.15.77:0/1309371124 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f6c8806ed50 0x7f6c88071200 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:46.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.869+0000 7f6ca357a640 1 --2- 172.21.15.77:0/1309371124 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c9c0fd7c0 0x7f6c9c06fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:46.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.869+0000 7f6ca357a640 1 --2- 172.21.15.77:0/1309371124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c9c0fc4f0 0x7f6c9c071570 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:46.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.869+0000 7f6ca357a640 1 -- 172.21.15.77:0/1309371124 >> 172.21.15.77:0/1309371124 conn(0x7f6c9c0f7c90 msgr2=0x7f6c9c0f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:11:46.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.870+0000 7f6ca357a640 1 -- 172.21.15.77:0/1309371124 shutdown_connections 2024-09-18T21:11:46.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.870+0000 7f6ca357a640 1 -- 172.21.15.77:0/1309371124 wait complete. 2024-09-18T21:11:46.881 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-09-18T21:11:46.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.964+0000 7ffb6bb07640 1 -- 172.21.15.77:0/4299197 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb640fc700 msgr2=0x7ffb640fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:46.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.964+0000 7ffb6bb07640 1 --2- 172.21.15.77:0/4299197 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb640fc700 0x7ffb640fcb70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ffb540048d0 tx=0x7ffb54009da0 comp rx=0 tx=0).stop 2024-09-18T21:11:46.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.964+0000 7ffb6bb07640 1 -- 172.21.15.77:0/4299197 shutdown_connections 2024-09-18T21:11:46.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.964+0000 7ffb6bb07640 1 --2- 172.21.15.77:0/4299197 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb640fc700 0x7ffb640fcb70 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:46.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.964+0000 7ffb6bb07640 1 --2- 172.21.15.77:0/4299197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb640fb430 0x7ffb640fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:46.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.964+0000 7ffb6bb07640 1 -- 172.21.15.77:0/4299197 >> 172.21.15.77:0/4299197 conn(0x7ffb640f6c10 msgr2=0x7ffb640f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:11:46.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.964+0000 7ffb6bb07640 1 -- 172.21.15.77:0/4299197 shutdown_connections 2024-09-18T21:11:46.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.964+0000 7ffb6bb07640 1 -- 172.21.15.77:0/4299197 wait complete. 2024-09-18T21:11:46.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.965+0000 7ffb6bb07640 1 Processor -- start 2024-09-18T21:11:46.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.965+0000 7ffb6bb07640 1 -- start start 2024-09-18T21:11:46.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.965+0000 7ffb6bb07640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb640fb430 0x7ffb6410d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:46.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.965+0000 7ffb6bb07640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb640fc700 0x7ffb6410d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:46.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.965+0000 7ffb6bb07640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6410dc10 con 0x7ffb640fb430 2024-09-18T21:11:46.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.965+0000 7ffb6bb07640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6410e430 con 0x7ffb640fc700 2024-09-18T21:11:46.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.965+0000 7ffb698a3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb640fb430 0x7ffb6410d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:46.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.965+0000 7ffb698a3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb640fb430 0x7ffb6410d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55244/0 (socket says 172.21.15.77:55244) 2024-09-18T21:11:46.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.965+0000 7ffb698a3640 1 -- 172.21.15.77:0/2816415647 learned_addr learned my addr 172.21.15.77:0/2816415647 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:11:46.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.966+0000 7ffb690a2640 1 --2- 172.21.15.77:0/2816415647 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb640fc700 0x7ffb6410d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:46.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.966+0000 7ffb698a3640 1 -- 172.21.15.77:0/2816415647 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb640fc700 msgr2=0x7ffb6410d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:46.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.966+0000 7ffb698a3640 1 --2- 172.21.15.77:0/2816415647 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb640fc700 0x7ffb6410d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:46.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.966+0000 7ffb698a3640 1 -- 172.21.15.77:0/2816415647 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb54005040 con 0x7ffb640fb430 2024-09-18T21:11:46.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.966+0000 7ffb698a3640 1 --2- 172.21.15.77:0/2816415647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb640fb430 0x7ffb6410d080 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ffb6000ece0 tx=0x7ffb6000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:11:46.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.966+0000 7ffb5a7fc640 1 -- 172.21.15.77:0/2816415647 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb6000ee40 con 0x7ffb640fb430 2024-09-18T21:11:46.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.966+0000 7ffb6bb07640 1 -- 172.21.15.77:0/2816415647 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb6410e6c0 con 0x7ffb640fb430 2024-09-18T21:11:46.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.966+0000 7ffb6bb07640 1 -- 172.21.15.77:0/2816415647 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb6410ec60 con 0x7ffb640fb430 2024-09-18T21:11:46.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.967+0000 7ffb5a7fc640 1 -- 172.21.15.77:0/2816415647 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ffb6000f040 con 0x7ffb640fb430 2024-09-18T21:11:46.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.967+0000 7ffb5a7fc640 1 -- 172.21.15.77:0/2816415647 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb60009600 con 0x7ffb640fb430 2024-09-18T21:11:46.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.968+0000 7ffb6bb07640 1 -- 172.21.15.77:0/2816415647 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb48005240 con 0x7ffb640fb430 2024-09-18T21:11:46.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.968+0000 7ffb5a7fc640 1 -- 172.21.15.77:0/2816415647 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7ffb60007890 con 0x7ffb640fb430 2024-09-18T21:11:46.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.969+0000 7ffb5a7fc640 1 --2- 172.21.15.77:0/2816415647 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7ffb5006ed60 0x7ffb50071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:46.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.969+0000 7ffb5a7fc640 1 -- 172.21.15.77:0/2816415647 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7ffb6008e700 con 0x7ffb640fb430 2024-09-18T21:11:46.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.969+0000 7ffb690a2640 1 --2- 172.21.15.77:0/2816415647 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7ffb5006ed60 0x7ffb50071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:46.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.969+0000 7ffb690a2640 1 --2- 172.21.15.77:0/2816415647 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7ffb5006ed60 0x7ffb50071210 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ffb54007ac0 tx=0x7ffb54035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:11:46.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:46.973+0000 7ffb5a7fc640 1 -- 172.21.15.77:0/2816415647 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ffb6005b8a0 con 0x7ffb640fb430 2024-09-18T21:11:47.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.181+0000 7ffb6bb07640 1 -- 172.21.15.77:0/2816415647 --> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb48000bf0 con 0x7ffb5006ed60 2024-09-18T21:11:47.184 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.183+0000 7ffb5a7fc640 1 -- 172.21.15.77:0/2816415647 <== mgr.14206 v2:172.21.15.77:6800/950747822 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7ffb48000bf0 con 0x7ffb5006ed60 2024-09-18T21:11:47.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.185+0000 7ffb6bb07640 1 -- 172.21.15.77:0/2816415647 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7ffb5006ed60 msgr2=0x7ffb50071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:47.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.185+0000 7ffb6bb07640 1 --2- 172.21.15.77:0/2816415647 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7ffb5006ed60 0x7ffb50071210 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ffb54007ac0 tx=0x7ffb54035040 comp rx=0 tx=0).stop 2024-09-18T21:11:47.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.185+0000 7ffb6bb07640 1 -- 172.21.15.77:0/2816415647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb640fb430 msgr2=0x7ffb6410d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:47.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.185+0000 7ffb6bb07640 1 --2- 172.21.15.77:0/2816415647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb640fb430 0x7ffb6410d080 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ffb6000ece0 tx=0x7ffb6000b040 comp rx=0 tx=0).stop 2024-09-18T21:11:47.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.185+0000 7ffb6bb07640 1 -- 172.21.15.77:0/2816415647 shutdown_connections 2024-09-18T21:11:47.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.185+0000 7ffb6bb07640 1 --2- 172.21.15.77:0/2816415647 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7ffb5006ed60 0x7ffb50071210 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:47.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.185+0000 7ffb6bb07640 1 --2- 172.21.15.77:0/2816415647 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb640fc700 0x7ffb6410d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:47.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.185+0000 7ffb6bb07640 1 --2- 172.21.15.77:0/2816415647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb640fb430 0x7ffb6410d080 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:47.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.185+0000 7ffb6bb07640 1 -- 172.21.15.77:0/2816415647 >> 172.21.15.77:0/2816415647 conn(0x7ffb640f6c10 msgr2=0x7ffb64065550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:11:47.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.185+0000 7ffb6bb07640 1 -- 172.21.15.77:0/2816415647 shutdown_connections 2024-09-18T21:11:47.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.185+0000 7ffb6bb07640 1 -- 172.21.15.77:0/2816415647 wait complete. 2024-09-18T21:11:47.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.272+0000 7fd41b9a1640 1 -- 172.21.15.77:0/3351798984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4140fd830 msgr2=0x7fd4140fdca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:47.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.272+0000 7fd41b9a1640 1 --2- 172.21.15.77:0/3351798984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4140fd830 0x7fd4140fdca0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd4040048d0 tx=0x7fd404009da0 comp rx=0 tx=0).stop 2024-09-18T21:11:47.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.272+0000 7fd41b9a1640 1 -- 172.21.15.77:0/3351798984 shutdown_connections 2024-09-18T21:11:47.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.272+0000 7fd41b9a1640 1 --2- 172.21.15.77:0/3351798984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4140fd830 0x7fd4140fdca0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:47.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.272+0000 7fd41b9a1640 1 --2- 172.21.15.77:0/3351798984 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4140fc560 0x7fd4140fc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:47.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.272+0000 7fd41b9a1640 1 -- 172.21.15.77:0/3351798984 >> 172.21.15.77:0/3351798984 conn(0x7fd4140f7d20 msgr2=0x7fd4140fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:11:47.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.272+0000 7fd41b9a1640 1 -- 172.21.15.77:0/3351798984 shutdown_connections 2024-09-18T21:11:47.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.272+0000 7fd41b9a1640 1 -- 172.21.15.77:0/3351798984 wait complete. 2024-09-18T21:11:47.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.273+0000 7fd41b9a1640 1 Processor -- start 2024-09-18T21:11:47.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.273+0000 7fd41b9a1640 1 -- start start 2024-09-18T21:11:47.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.273+0000 7fd41b9a1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4140fc560 0x7fd41410d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:47.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.273+0000 7fd41b9a1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4140fd830 0x7fd41410d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:47.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.273+0000 7fd41b9a1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd41410dbe0 con 0x7fd4140fd830 2024-09-18T21:11:47.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.273+0000 7fd41b9a1640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd41410e400 con 0x7fd4140fc560 2024-09-18T21:11:47.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.273+0000 7fd418f3c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4140fd830 0x7fd41410d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:47.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.273+0000 7fd418f3c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4140fd830 0x7fd41410d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55268/0 (socket says 172.21.15.77:55268) 2024-09-18T21:11:47.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.273+0000 7fd418f3c640 1 -- 172.21.15.77:0/724185004 learned_addr learned my addr 172.21.15.77:0/724185004 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:11:47.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.273+0000 7fd41973d640 1 --2- 172.21.15.77:0/724185004 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4140fc560 0x7fd41410d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:47.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.273+0000 7fd418f3c640 1 -- 172.21.15.77:0/724185004 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4140fc560 msgr2=0x7fd41410d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:47.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.273+0000 7fd418f3c640 1 --2- 172.21.15.77:0/724185004 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4140fc560 0x7fd41410d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:47.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.273+0000 7fd418f3c640 1 -- 172.21.15.77:0/724185004 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd404005040 con 0x7fd4140fd830 2024-09-18T21:11:47.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.274+0000 7fd418f3c640 1 --2- 172.21.15.77:0/724185004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4140fd830 0x7fd41410d590 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd4040048a0 tx=0x7fd404009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:11:47.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.274+0000 7fd409ffb640 1 -- 172.21.15.77:0/724185004 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd404038070 con 0x7fd4140fd830 2024-09-18T21:11:47.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.274+0000 7fd409ffb640 1 -- 172.21.15.77:0/724185004 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd404009800 con 0x7fd4140fd830 2024-09-18T21:11:47.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.274+0000 7fd41b9a1640 1 -- 172.21.15.77:0/724185004 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd41410e630 con 0x7fd4140fd830 2024-09-18T21:11:47.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.274+0000 7fd409ffb640 1 -- 172.21.15.77:0/724185004 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd40403e670 con 0x7fd4140fd830 2024-09-18T21:11:47.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.274+0000 7fd41b9a1640 1 -- 172.21.15.77:0/724185004 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd41410ebd0 con 0x7fd4140fd830 2024-09-18T21:11:47.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.275+0000 7fd41b9a1640 1 -- 172.21.15.77:0/724185004 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4140fb9c0 con 0x7fd4140fd830 2024-09-18T21:11:47.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.276+0000 7fd409ffb640 1 -- 172.21.15.77:0/724185004 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fd404030020 con 0x7fd4140fd830 2024-09-18T21:11:47.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.276+0000 7fd409ffb640 1 --2- 172.21.15.77:0/724185004 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fd40006ed50 0x7fd400071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:47.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.276+0000 7fd409ffb640 1 -- 172.21.15.77:0/724185004 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fd4040ae180 con 0x7fd4140fd830 2024-09-18T21:11:47.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.276+0000 7fd41973d640 1 --2- 172.21.15.77:0/724185004 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fd40006ed50 0x7fd400071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:47.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.277+0000 7fd41973d640 1 --2- 172.21.15.77:0/724185004 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fd40006ed50 0x7fd400071200 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd410004fd0 tx=0x7fd41000b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:11:47.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.281+0000 7fd409ffb640 1 -- 172.21.15.77:0/724185004 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd40407b3d0 con 0x7fd4140fd830 2024-09-18T21:11:47.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.482+0000 7fd41b9a1640 1 -- 172.21.15.77:0/724185004 --> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd41410eee0 con 0x7fd40006ed50 2024-09-18T21:11:47.493 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.492+0000 7fd409ffb640 1 -- 172.21.15.77:0/724185004 <== mgr.14206 v2:172.21.15.77:6800/950747822 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fd41410eee0 con 0x7fd40006ed50 2024-09-18T21:11:47.493 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T21:11:47.493 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager.smithi077 smithi077 *:9093,9094 running (5m) 61s ago 6m 25.5M - 0.25.0 c8568f914cd2 e1881e21423c 2024-09-18T21:11:47.493 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi077 smithi077 running (6m) 61s ago 6m 6899k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 0beb64a8c2ea 2024-09-18T21:11:47.493 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi103 smithi103 running (5m) 68s ago 5m 6891k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 04981ca7bf34 2024-09-18T21:11:47.493 INFO:teuthology.orchestra.run.smithi077.stdout:grafana.smithi077 smithi077 *:3000 running (5m) 61s ago 6m 83.6M - 9.4.7 954c08fa6188 620f52934182 2024-09-18T21:11:47.493 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.cqfhlw smithi077 running (81s) 61s ago 80s 11.7M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 a7ec3b7701b6 2024-09-18T21:11:47.493 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.vruydi smithi077 running (86s) 61s ago 86s 15.4M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 affbba097d3b 2024-09-18T21:11:47.494 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi103.opftmf smithi103 running (78s) 68s ago 78s 13.9M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 111f884c5a34 2024-09-18T21:11:47.494 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi103.zhdmdg smithi103 running (84s) 68s ago 83s 14.3M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 50b77d0edda5 2024-09-18T21:11:47.494 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi077.utkpjg smithi077 *:9283,8765,8443 running (7m) 61s ago 7m 448M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 5d334eb01bea 2024-09-18T21:11:47.494 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi103.zjztqc smithi103 *:8443,9283 running (5m) 68s ago 5m 403M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 a2818ec1897e 2024-09-18T21:11:47.494 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi077 smithi077 running (7m) 61s ago 8m 49.1M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bcbf289fe027 2024-09-18T21:11:47.494 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi103 smithi103 running (5m) 68s ago 5m 41.9M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 d6ae2062e5e3 2024-09-18T21:11:47.494 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi077 smithi077 *:9100 running (6m) 61s ago 6m 16.8M - 1.5.0 0da6a335fe13 ee48144962b4 2024-09-18T21:11:47.494 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi103 smithi103 *:9100 running (5m) 68s ago 5m 16.8M - 1.5.0 0da6a335fe13 f7a4da7753f2 2024-09-18T21:11:47.494 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (4m) 61s ago 4m 47.1M 4288M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 2e3563c32cf5 2024-09-18T21:11:47.494 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi077 running (4m) 61s ago 4m 44.1M 4288M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 39c2ccbb7603 2024-09-18T21:11:47.494 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi077 running (4m) 61s ago 4m 43.0M 4288M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 2ff2728057e2 2024-09-18T21:11:47.494 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi103 running (3m) 68s ago 3m 43.9M 5312M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 0e72b1bbb8ce 2024-09-18T21:11:47.494 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi103 running (3m) 68s ago 3m 42.5M 5312M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 85f1ce1e8bee 2024-09-18T21:11:47.494 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi103 running (2m) 68s ago 2m 41.8M 5312M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 cf8964b3ac6d 2024-09-18T21:11:47.494 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus.smithi077 smithi077 *:9095 running (5m) 61s ago 6m 56.4M - 2.43.0 a07b618ecd1d 81e0f3809b2f 2024-09-18T21:11:47.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.494+0000 7fd41b9a1640 1 -- 172.21.15.77:0/724185004 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fd40006ed50 msgr2=0x7fd400071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:47.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.494+0000 7fd41b9a1640 1 --2- 172.21.15.77:0/724185004 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fd40006ed50 0x7fd400071200 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd410004fd0 tx=0x7fd41000b040 comp rx=0 tx=0).stop 2024-09-18T21:11:47.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.494+0000 7fd41b9a1640 1 -- 172.21.15.77:0/724185004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4140fd830 msgr2=0x7fd41410d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:47.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.494+0000 7fd41b9a1640 1 --2- 172.21.15.77:0/724185004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4140fd830 0x7fd41410d590 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd4040048a0 tx=0x7fd404009da0 comp rx=0 tx=0).stop 2024-09-18T21:11:47.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.494+0000 7fd41b9a1640 1 -- 172.21.15.77:0/724185004 shutdown_connections 2024-09-18T21:11:47.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.494+0000 7fd41b9a1640 1 --2- 172.21.15.77:0/724185004 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fd40006ed50 0x7fd400071200 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:47.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.494+0000 7fd41b9a1640 1 --2- 172.21.15.77:0/724185004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4140fd830 0x7fd41410d590 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:47.496 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.494+0000 7fd41b9a1640 1 --2- 172.21.15.77:0/724185004 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd4140fc560 0x7fd41410d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:47.496 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.494+0000 7fd41b9a1640 1 -- 172.21.15.77:0/724185004 >> 172.21.15.77:0/724185004 conn(0x7fd4140f7d20 msgr2=0x7fd4140f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:11:47.496 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.495+0000 7fd41b9a1640 1 -- 172.21.15.77:0/724185004 shutdown_connections 2024-09-18T21:11:47.496 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.495+0000 7fd41b9a1640 1 -- 172.21.15.77:0/724185004 wait complete. 2024-09-18T21:11:47.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.584+0000 7fb550adb640 1 -- 172.21.15.77:0/1943855627 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb54c0fca30 msgr2=0x7fb54c0fce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:47.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.584+0000 7fb550adb640 1 --2- 172.21.15.77:0/1943855627 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb54c0fca30 0x7fb54c0fce40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb53c0048d0 tx=0x7fb53c009da0 comp rx=0 tx=0).stop 2024-09-18T21:11:47.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.584+0000 7fb550adb640 1 -- 172.21.15.77:0/1943855627 shutdown_connections 2024-09-18T21:11:47.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.584+0000 7fb550adb640 1 --2- 172.21.15.77:0/1943855627 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb54c0fd380 0x7fb54c0fb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:47.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.584+0000 7fb550adb640 1 --2- 172.21.15.77:0/1943855627 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb54c0fca30 0x7fb54c0fce40 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:47.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.584+0000 7fb550adb640 1 -- 172.21.15.77:0/1943855627 >> 172.21.15.77:0/1943855627 conn(0x7fb54c0f6390 msgr2=0x7fb54c0f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:11:47.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.584+0000 7fb550adb640 1 -- 172.21.15.77:0/1943855627 shutdown_connections 2024-09-18T21:11:47.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.584+0000 7fb550adb640 1 -- 172.21.15.77:0/1943855627 wait complete. 2024-09-18T21:11:47.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.585+0000 7fb550adb640 1 Processor -- start 2024-09-18T21:11:47.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.585+0000 7fb550adb640 1 -- start start 2024-09-18T21:11:47.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.585+0000 7fb550adb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb54c0fca30 0x7fb54c10fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:47.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.585+0000 7fb550adb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb54c0fd380 0x7fb54c112320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:47.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.585+0000 7fb550adb640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c0fb380 con 0x7fb54c0fca30 2024-09-18T21:11:47.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.585+0000 7fb550adb640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c0fb4f0 con 0x7fb54c0fd380 2024-09-18T21:11:47.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.585+0000 7fb54a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb54c0fca30 0x7fb54c10fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:47.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.585+0000 7fb54a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb54c0fca30 0x7fb54c10fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55286/0 (socket says 172.21.15.77:55286) 2024-09-18T21:11:47.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.585+0000 7fb54a59c640 1 -- 172.21.15.77:0/3927216491 learned_addr learned my addr 172.21.15.77:0/3927216491 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:11:47.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.585+0000 7fb549d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb54c0fd380 0x7fb54c112320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:47.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.585+0000 7fb54a59c640 1 -- 172.21.15.77:0/3927216491 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb54c0fd380 msgr2=0x7fb54c112320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:47.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.585+0000 7fb54a59c640 1 --2- 172.21.15.77:0/3927216491 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb54c0fd380 0x7fb54c112320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:47.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.585+0000 7fb54a59c640 1 -- 172.21.15.77:0/3927216491 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb53c005040 con 0x7fb54c0fca30 2024-09-18T21:11:47.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.586+0000 7fb54a59c640 1 --2- 172.21.15.77:0/3927216491 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb54c0fca30 0x7fb54c10fdd0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb53c0048a0 tx=0x7fb53c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:11:47.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.586+0000 7fb53affd640 1 -- 172.21.15.77:0/3927216491 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb53c038070 con 0x7fb54c0fca30 2024-09-18T21:11:47.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.586+0000 7fb550adb640 1 -- 172.21.15.77:0/3927216491 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb54c112860 con 0x7fb54c0fca30 2024-09-18T21:11:47.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.586+0000 7fb53affd640 1 -- 172.21.15.77:0/3927216491 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb53c004290 con 0x7fb54c0fca30 2024-09-18T21:11:47.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.586+0000 7fb53affd640 1 -- 172.21.15.77:0/3927216491 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb53c033660 con 0x7fb54c0fca30 2024-09-18T21:11:47.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.586+0000 7fb550adb640 1 -- 172.21.15.77:0/3927216491 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb54c112dd0 con 0x7fb54c0fca30 2024-09-18T21:11:47.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.587+0000 7fb550adb640 1 -- 172.21.15.77:0/3927216491 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb54c0fa010 con 0x7fb54c0fca30 2024-09-18T21:11:47.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.588+0000 7fb53affd640 1 -- 172.21.15.77:0/3927216491 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fb53c030020 con 0x7fb54c0fca30 2024-09-18T21:11:47.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.588+0000 7fb53affd640 1 --2- 172.21.15.77:0/3927216491 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fb53406ed60 0x7fb534071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:47.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.588+0000 7fb53affd640 1 -- 172.21.15.77:0/3927216491 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fb53c0ae290 con 0x7fb54c0fca30 2024-09-18T21:11:47.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.589+0000 7fb549d9b640 1 --2- 172.21.15.77:0/3927216491 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fb53406ed60 0x7fb534071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:47.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.589+0000 7fb549d9b640 1 --2- 172.21.15.77:0/3927216491 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fb53406ed60 0x7fb534071210 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb540009af0 tx=0x7fb54000b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:11:47.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.594+0000 7fb53affd640 1 -- 172.21.15.77:0/3927216491 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb53c07b460 con 0x7fb54c0fca30 2024-09-18T21:11:47.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.862+0000 7fb550adb640 1 -- 172.21.15.77:0/3927216491 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb54c04b720 con 0x7fb54c0fca30 2024-09-18T21:11:47.863 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:47 smithi077 ceph-mon[27689]: pgmap v212: 65 pgs: 65 active+clean; 16 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s wr, 62 op/s 2024-09-18T21:11:47.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.863+0000 7fb53affd640 1 -- 172.21.15.77:0/3927216491 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+643 (secure 0 0 0) 0x7fb53c02c870 con 0x7fb54c0fca30 2024-09-18T21:11:47.864 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-18T21:11:47.864 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": { 2024-09-18T21:11:47.864 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 2 2024-09-18T21:11:47.864 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:11:47.864 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": { 2024-09-18T21:11:47.864 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 2 2024-09-18T21:11:47.864 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:11:47.865 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": { 2024-09-18T21:11:47.865 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 6 2024-09-18T21:11:47.865 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:11:47.865 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-09-18T21:11:47.865 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4 2024-09-18T21:11:47.865 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:11:47.865 INFO:teuthology.orchestra.run.smithi077.stdout: "overall": { 2024-09-18T21:11:47.865 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 14 2024-09-18T21:11:47.865 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-18T21:11:47.865 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-18T21:11:47.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.866+0000 7fb550adb640 1 -- 172.21.15.77:0/3927216491 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fb53406ed60 msgr2=0x7fb534071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:47.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.866+0000 7fb550adb640 1 --2- 172.21.15.77:0/3927216491 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fb53406ed60 0x7fb534071210 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb540009af0 tx=0x7fb54000b040 comp rx=0 tx=0).stop 2024-09-18T21:11:47.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.866+0000 7fb550adb640 1 -- 172.21.15.77:0/3927216491 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb54c0fca30 msgr2=0x7fb54c10fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:47.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.866+0000 7fb550adb640 1 --2- 172.21.15.77:0/3927216491 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb54c0fca30 0x7fb54c10fdd0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb53c0048a0 tx=0x7fb53c009da0 comp rx=0 tx=0).stop 2024-09-18T21:11:47.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.866+0000 7fb550adb640 1 -- 172.21.15.77:0/3927216491 shutdown_connections 2024-09-18T21:11:47.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.866+0000 7fb550adb640 1 --2- 172.21.15.77:0/3927216491 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fb53406ed60 0x7fb534071210 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:47.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.866+0000 7fb550adb640 1 --2- 172.21.15.77:0/3927216491 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb54c0fd380 0x7fb54c112320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:47.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.866+0000 7fb550adb640 1 --2- 172.21.15.77:0/3927216491 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb54c0fca30 0x7fb54c10fdd0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:47.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.866+0000 7fb550adb640 1 -- 172.21.15.77:0/3927216491 >> 172.21.15.77:0/3927216491 conn(0x7fb54c0f6390 msgr2=0x7fb54c0f7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:11:47.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.866+0000 7fb550adb640 1 -- 172.21.15.77:0/3927216491 shutdown_connections 2024-09-18T21:11:47.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.866+0000 7fb550adb640 1 -- 172.21.15.77:0/3927216491 wait complete. 2024-09-18T21:11:47.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.958+0000 7f2621fcd640 1 -- 172.21.15.77:0/2991862820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f261c0fb420 msgr2=0x7f261c0fb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:47.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.958+0000 7f2621fcd640 1 --2- 172.21.15.77:0/2991862820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f261c0fb420 0x7f261c0fb830 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f260c0048d0 tx=0x7f260c009da0 comp rx=0 tx=0).stop 2024-09-18T21:11:47.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.958+0000 7f2621fcd640 1 -- 172.21.15.77:0/2991862820 shutdown_connections 2024-09-18T21:11:47.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.958+0000 7f2621fcd640 1 --2- 172.21.15.77:0/2991862820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f261c0fc6f0 0x7f261c0fcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:47.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.958+0000 7f2621fcd640 1 --2- 172.21.15.77:0/2991862820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f261c0fb420 0x7f261c0fb830 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:47.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.958+0000 7f2621fcd640 1 -- 172.21.15.77:0/2991862820 >> 172.21.15.77:0/2991862820 conn(0x7f261c0f6c00 msgr2=0x7f261c0f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:11:47.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.958+0000 7f2621fcd640 1 -- 172.21.15.77:0/2991862820 shutdown_connections 2024-09-18T21:11:47.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.958+0000 7f2621fcd640 1 -- 172.21.15.77:0/2991862820 wait complete. 2024-09-18T21:11:47.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.958+0000 7f2621fcd640 1 Processor -- start 2024-09-18T21:11:47.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.959+0000 7f2621fcd640 1 -- start start 2024-09-18T21:11:47.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.959+0000 7f2621fcd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f261c0fb420 0x7f261c10d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:47.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.959+0000 7f2621fcd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f261c0fc6f0 0x7f261c10d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:47.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.959+0000 7f2621fcd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261c10dbf0 con 0x7f261c0fc6f0 2024-09-18T21:11:47.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.959+0000 7f2621fcd640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261c10e410 con 0x7f261c0fb420 2024-09-18T21:11:47.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.959+0000 7f261affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f261c0fc6f0 0x7f261c10d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:47.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.959+0000 7f261affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f261c0fc6f0 0x7f261c10d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55310/0 (socket says 172.21.15.77:55310) 2024-09-18T21:11:47.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.959+0000 7f261affd640 1 -- 172.21.15.77:0/3822957790 learned_addr learned my addr 172.21.15.77:0/3822957790 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:11:47.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.959+0000 7f261b7fe640 1 --2- 172.21.15.77:0/3822957790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f261c0fb420 0x7f261c10d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:47.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.959+0000 7f261affd640 1 -- 172.21.15.77:0/3822957790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f261c0fb420 msgr2=0x7f261c10d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:47.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.959+0000 7f261affd640 1 --2- 172.21.15.77:0/3822957790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f261c0fb420 0x7f261c10d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:47.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.959+0000 7f261affd640 1 -- 172.21.15.77:0/3822957790 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260c005040 con 0x7f261c0fc6f0 2024-09-18T21:11:47.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.959+0000 7f261affd640 1 --2- 172.21.15.77:0/3822957790 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f261c0fc6f0 0x7f261c10d5a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2610002a50 tx=0x7f2610004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:11:47.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.960+0000 7f2603fff640 1 -- 172.21.15.77:0/3822957790 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2610007c30 con 0x7f261c0fc6f0 2024-09-18T21:11:47.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.960+0000 7f2603fff640 1 -- 172.21.15.77:0/3822957790 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f261000f040 con 0x7f261c0fc6f0 2024-09-18T21:11:47.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.960+0000 7f2603fff640 1 -- 172.21.15.77:0/3822957790 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f261000dad0 con 0x7f261c0fc6f0 2024-09-18T21:11:47.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.960+0000 7f2621fcd640 1 -- 172.21.15.77:0/3822957790 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f261c10e6a0 con 0x7f261c0fc6f0 2024-09-18T21:11:47.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.960+0000 7f2621fcd640 1 -- 172.21.15.77:0/3822957790 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f261c10eb30 con 0x7f261c0fc6f0 2024-09-18T21:11:47.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.961+0000 7f2621fcd640 1 -- 172.21.15.77:0/3822957790 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f261c0fa880 con 0x7f261c0fc6f0 2024-09-18T21:11:47.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.962+0000 7f2603fff640 1 -- 172.21.15.77:0/3822957790 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f261000dc30 con 0x7f261c0fc6f0 2024-09-18T21:11:47.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.962+0000 7f2603fff640 1 --2- 172.21.15.77:0/3822957790 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f260406ed60 0x7f2604071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:47.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.962+0000 7f2603fff640 1 -- 172.21.15.77:0/3822957790 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f261008dfd0 con 0x7f261c0fc6f0 2024-09-18T21:11:47.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.962+0000 7f261b7fe640 1 --2- 172.21.15.77:0/3822957790 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f260406ed60 0x7f2604071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:47.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.963+0000 7f261b7fe640 1 --2- 172.21.15.77:0/3822957790 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f260406ed60 0x7f2604071210 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f260c00b020 tx=0x7f260c035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:11:47.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:47.967+0000 7f2603fff640 1 -- 172.21.15.77:0/3822957790 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f261005b0f0 con 0x7f261c0fc6f0 2024-09-18T21:11:48.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:47 smithi103 ceph-mon[34827]: pgmap v212: 65 pgs: 65 active+clean; 16 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s wr, 62 op/s 2024-09-18T21:11:48.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.205+0000 7f2621fcd640 1 -- 172.21.15.77:0/3822957790 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f261c103f60 con 0x7f261c0fc6f0 2024-09-18T21:11:48.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.205+0000 7f2603fff640 1 -- 172.21.15.77:0/3822957790 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1807 (secure 0 0 0) 0x7f261005aa90 con 0x7f261c0fc6f0 2024-09-18T21:11:48.206 INFO:teuthology.orchestra.run.smithi077.stdout:e13 2024-09-18T21:11:48.206 INFO:teuthology.orchestra.run.smithi077.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T21:11:48.206 INFO:teuthology.orchestra.run.smithi077.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T21:11:48.206 INFO:teuthology.orchestra.run.smithi077.stdout:legacy client fscid: 1 2024-09-18T21:11:48.207 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:11:48.207 INFO:teuthology.orchestra.run.smithi077.stdout:Filesystem 'cephfs' (1) 2024-09-18T21:11:48.207 INFO:teuthology.orchestra.run.smithi077.stdout:fs_name cephfs 2024-09-18T21:11:48.207 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 13 2024-09-18T21:11:48.207 INFO:teuthology.orchestra.run.smithi077.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T21:11:48.207 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-09-18T21:10:17.230179+0000 2024-09-18T21:11:48.207 INFO:teuthology.orchestra.run.smithi077.stdout:modified 2024-09-18T21:10:33.373241+0000 2024-09-18T21:11:48.207 INFO:teuthology.orchestra.run.smithi077.stdout:tableserver 0 2024-09-18T21:11:48.207 INFO:teuthology.orchestra.run.smithi077.stdout:root 0 2024-09-18T21:11:48.207 INFO:teuthology.orchestra.run.smithi077.stdout:session_timeout 60 2024-09-18T21:11:48.207 INFO:teuthology.orchestra.run.smithi077.stdout:session_autoclose 300 2024-09-18T21:11:48.207 INFO:teuthology.orchestra.run.smithi077.stdout:max_file_size 1099511627776 2024-09-18T21:11:48.207 INFO:teuthology.orchestra.run.smithi077.stdout:required_client_features {} 2024-09-18T21:11:48.208 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure 0 2024-09-18T21:11:48.208 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure_osd_epoch 0 2024-09-18T21:11:48.208 INFO:teuthology.orchestra.run.smithi077.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T21:11:48.208 INFO:teuthology.orchestra.run.smithi077.stdout:max_mds 1 2024-09-18T21:11:48.208 INFO:teuthology.orchestra.run.smithi077.stdout:in 0 2024-09-18T21:11:48.208 INFO:teuthology.orchestra.run.smithi077.stdout:up {0=14446} 2024-09-18T21:11:48.208 INFO:teuthology.orchestra.run.smithi077.stdout:failed 2024-09-18T21:11:48.208 INFO:teuthology.orchestra.run.smithi077.stdout:damaged 2024-09-18T21:11:48.208 INFO:teuthology.orchestra.run.smithi077.stdout:stopped 2024-09-18T21:11:48.208 INFO:teuthology.orchestra.run.smithi077.stdout:data_pools [3] 2024-09-18T21:11:48.208 INFO:teuthology.orchestra.run.smithi077.stdout:metadata_pool 2 2024-09-18T21:11:48.208 INFO:teuthology.orchestra.run.smithi077.stdout:inline_data disabled 2024-09-18T21:11:48.209 INFO:teuthology.orchestra.run.smithi077.stdout:balancer 2024-09-18T21:11:48.209 INFO:teuthology.orchestra.run.smithi077.stdout:standby_count_wanted 1 2024-09-18T21:11:48.209 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.vruydi{0:14446} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.77:6826/334039954,v1:172.21.15.77:6827/334039954] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:11:48.209 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:11:48.209 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:11:48.209 INFO:teuthology.orchestra.run.smithi077.stdout:Standby daemons: 2024-09-18T21:11:48.209 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:11:48.209 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.cqfhlw{-1:14458} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.77:6828/862540650,v1:172.21.15.77:6829/862540650] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:11:48.209 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi103.zhdmdg{-1:24255} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.103:6824/2170237078,v1:172.21.15.103:6825/2170237078] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:11:48.209 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi103.opftmf{-1:24267} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.103:6826/4241818403,v1:172.21.15.103:6827/4241818403] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:11:48.210 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 13 2024-09-18T21:11:48.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.208+0000 7f2621fcd640 1 -- 172.21.15.77:0/3822957790 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f260406ed60 msgr2=0x7f2604071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:48.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.208+0000 7f2621fcd640 1 --2- 172.21.15.77:0/3822957790 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f260406ed60 0x7f2604071210 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f260c00b020 tx=0x7f260c035040 comp rx=0 tx=0).stop 2024-09-18T21:11:48.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.208+0000 7f2621fcd640 1 -- 172.21.15.77:0/3822957790 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f261c0fc6f0 msgr2=0x7f261c10d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:48.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.208+0000 7f2621fcd640 1 --2- 172.21.15.77:0/3822957790 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f261c0fc6f0 0x7f261c10d5a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2610002a50 tx=0x7f2610004600 comp rx=0 tx=0).stop 2024-09-18T21:11:48.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.208+0000 7f2621fcd640 1 -- 172.21.15.77:0/3822957790 shutdown_connections 2024-09-18T21:11:48.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.208+0000 7f2621fcd640 1 --2- 172.21.15.77:0/3822957790 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f260406ed60 0x7f2604071210 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:48.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.208+0000 7f2621fcd640 1 --2- 172.21.15.77:0/3822957790 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f261c0fc6f0 0x7f261c10d5a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:48.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.208+0000 7f2621fcd640 1 --2- 172.21.15.77:0/3822957790 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f261c0fb420 0x7f261c10d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:48.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.208+0000 7f2621fcd640 1 -- 172.21.15.77:0/3822957790 >> 172.21.15.77:0/3822957790 conn(0x7f261c0f6c00 msgr2=0x7f261c065e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:11:48.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.208+0000 7f2621fcd640 1 -- 172.21.15.77:0/3822957790 shutdown_connections 2024-09-18T21:11:48.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.208+0000 7f2621fcd640 1 -- 172.21.15.77:0/3822957790 wait complete. 2024-09-18T21:11:48.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.300+0000 7f5f17da7640 1 -- 172.21.15.77:0/1016401172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f10101b00 msgr2=0x7f5f10103ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:48.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.300+0000 7f5f17da7640 1 --2- 172.21.15.77:0/1016401172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f10101b00 0x7f5f10103ee0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c0048d0 tx=0x7f5f0c009da0 comp rx=0 tx=0).stop 2024-09-18T21:11:48.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.300+0000 7f5f17da7640 1 -- 172.21.15.77:0/1016401172 shutdown_connections 2024-09-18T21:11:48.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.300+0000 7f5f17da7640 1 --2- 172.21.15.77:0/1016401172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f10101b00 0x7f5f10103ee0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:48.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.300+0000 7f5f17da7640 1 --2- 172.21.15.77:0/1016401172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f10065bc0 0x7f5f101015c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:48.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.300+0000 7f5f17da7640 1 -- 172.21.15.77:0/1016401172 >> 172.21.15.77:0/1016401172 conn(0x7f5f100f6c10 msgr2=0x7f5f100f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:11:48.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.300+0000 7f5f17da7640 1 -- 172.21.15.77:0/1016401172 shutdown_connections 2024-09-18T21:11:48.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.300+0000 7f5f17da7640 1 -- 172.21.15.77:0/1016401172 wait complete. 2024-09-18T21:11:48.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.301+0000 7f5f17da7640 1 Processor -- start 2024-09-18T21:11:48.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.301+0000 7f5f17da7640 1 -- start start 2024-09-18T21:11:48.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.301+0000 7f5f17da7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f10065bc0 0x7f5f1010f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:48.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.301+0000 7f5f17da7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f10101b00 0x7f5f1010f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:48.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.301+0000 7f5f17da7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1010fc60 con 0x7f5f10065bc0 2024-09-18T21:11:48.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.301+0000 7f5f17da7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f10110430 con 0x7f5f10101b00 2024-09-18T21:11:48.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.301+0000 7f5f15b43640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f10065bc0 0x7f5f1010f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:48.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.301+0000 7f5f15b43640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f10065bc0 0x7f5f1010f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55328/0 (socket says 172.21.15.77:55328) 2024-09-18T21:11:48.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.301+0000 7f5f15342640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f10101b00 0x7f5f1010f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:48.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.301+0000 7f5f15342640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f10101b00 0x7f5f1010f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:52714/0 (socket says 172.21.15.77:52714) 2024-09-18T21:11:48.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.301+0000 7f5f15342640 1 -- 172.21.15.77:0/1814827390 learned_addr learned my addr 172.21.15.77:0/1814827390 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:11:48.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.302+0000 7f5f15342640 1 -- 172.21.15.77:0/1814827390 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f10065bc0 msgr2=0x7f5f1010f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:48.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.302+0000 7f5f15342640 1 --2- 172.21.15.77:0/1814827390 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f10065bc0 0x7f5f1010f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:48.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.302+0000 7f5f15342640 1 -- 172.21.15.77:0/1814827390 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f0c005040 con 0x7f5f10101b00 2024-09-18T21:11:48.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.302+0000 7f5f15342640 1 --2- 172.21.15.77:0/1814827390 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f10101b00 0x7f5f1010f610 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c02a530 tx=0x7f5f0c009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:11:48.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.302+0000 7f5f067fc640 1 -- 172.21.15.77:0/1814827390 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f0c038070 con 0x7f5f10101b00 2024-09-18T21:11:48.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.303+0000 7f5f17da7640 1 -- 172.21.15.77:0/1814827390 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f10110660 con 0x7f5f10101b00 2024-09-18T21:11:48.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.303+0000 7f5f067fc640 1 -- 172.21.15.77:0/1814827390 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5f0c004290 con 0x7f5f10101b00 2024-09-18T21:11:48.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.303+0000 7f5f067fc640 1 -- 172.21.15.77:0/1814827390 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f0c032e30 con 0x7f5f10101b00 2024-09-18T21:11:48.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.303+0000 7f5f17da7640 1 -- 172.21.15.77:0/1814827390 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f10110b20 con 0x7f5f10101b00 2024-09-18T21:11:48.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.304+0000 7f5f17da7640 1 -- 172.21.15.77:0/1814827390 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f100fa890 con 0x7f5f10101b00 2024-09-18T21:11:48.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.304+0000 7f5f067fc640 1 -- 172.21.15.77:0/1814827390 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f5f0c030020 con 0x7f5f10101b00 2024-09-18T21:11:48.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.305+0000 7f5f067fc640 1 --2- 172.21.15.77:0/1814827390 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f5efc06ed60 0x7f5efc071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:48.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.305+0000 7f5f067fc640 1 -- 172.21.15.77:0/1814827390 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f5f0c0ae240 con 0x7f5f10101b00 2024-09-18T21:11:48.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.305+0000 7f5f15b43640 1 --2- 172.21.15.77:0/1814827390 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f5efc06ed60 0x7f5efc071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:48.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.305+0000 7f5f15b43640 1 --2- 172.21.15.77:0/1814827390 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f5efc06ed60 0x7f5efc071210 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5f00009af0 tx=0x7f5f0000b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:11:48.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.311+0000 7f5f067fc640 1 -- 172.21.15.77:0/1814827390 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5f0c07b370 con 0x7f5f10101b00 2024-09-18T21:11:48.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.531+0000 7f5f17da7640 1 -- 172.21.15.77:0/1814827390 --> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f10110e70 con 0x7f5efc06ed60 2024-09-18T21:11:48.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.532+0000 7f5f067fc640 1 -- 172.21.15.77:0/1814827390 <== mgr.14206 v2:172.21.15.77:6800/950747822 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f5f10110e70 con 0x7f5efc06ed60 2024-09-18T21:11:48.533 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-18T21:11:48.533 INFO:teuthology.orchestra.run.smithi077.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a", 2024-09-18T21:11:48.533 INFO:teuthology.orchestra.run.smithi077.stdout: "in_progress": true, 2024-09-18T21:11:48.533 INFO:teuthology.orchestra.run.smithi077.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T21:11:48.533 INFO:teuthology.orchestra.run.smithi077.stdout: "services_complete": [], 2024-09-18T21:11:48.533 INFO:teuthology.orchestra.run.smithi077.stdout: "progress": "0/21 daemons upgraded", 2024-09-18T21:11:48.533 INFO:teuthology.orchestra.run.smithi077.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a image on host smithi103", 2024-09-18T21:11:48.533 INFO:teuthology.orchestra.run.smithi077.stdout: "is_paused": false 2024-09-18T21:11:48.533 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-18T21:11:48.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.534+0000 7f5f17da7640 1 -- 172.21.15.77:0/1814827390 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f5efc06ed60 msgr2=0x7f5efc071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:48.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.534+0000 7f5f17da7640 1 --2- 172.21.15.77:0/1814827390 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f5efc06ed60 0x7f5efc071210 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5f00009af0 tx=0x7f5f0000b040 comp rx=0 tx=0).stop 2024-09-18T21:11:48.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.534+0000 7f5f17da7640 1 -- 172.21.15.77:0/1814827390 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f10101b00 msgr2=0x7f5f1010f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:48.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.534+0000 7f5f17da7640 1 --2- 172.21.15.77:0/1814827390 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f10101b00 0x7f5f1010f610 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c02a530 tx=0x7f5f0c009da0 comp rx=0 tx=0).stop 2024-09-18T21:11:48.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.534+0000 7f5f17da7640 1 -- 172.21.15.77:0/1814827390 shutdown_connections 2024-09-18T21:11:48.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.534+0000 7f5f17da7640 1 --2- 172.21.15.77:0/1814827390 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f5efc06ed60 0x7f5efc071210 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:48.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.534+0000 7f5f17da7640 1 --2- 172.21.15.77:0/1814827390 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f10101b00 0x7f5f1010f610 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:48.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.534+0000 7f5f17da7640 1 --2- 172.21.15.77:0/1814827390 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f10065bc0 0x7f5f1010f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:48.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.534+0000 7f5f17da7640 1 -- 172.21.15.77:0/1814827390 >> 172.21.15.77:0/1814827390 conn(0x7f5f100f6c10 msgr2=0x7f5f100f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:11:48.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.534+0000 7f5f17da7640 1 -- 172.21.15.77:0/1814827390 shutdown_connections 2024-09-18T21:11:48.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.534+0000 7f5f17da7640 1 -- 172.21.15.77:0/1814827390 wait complete. 2024-09-18T21:11:48.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.625+0000 7fb623f1b640 1 -- 172.21.15.77:0/3340856499 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb61c0fd350 msgr2=0x7fb61c0fb750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:48.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.625+0000 7fb623f1b640 1 --2- 172.21.15.77:0/3340856499 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb61c0fd350 0x7fb61c0fb750 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb60c0048d0 tx=0x7fb60c009da0 comp rx=0 tx=0).stop 2024-09-18T21:11:48.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.625+0000 7fb623f1b640 1 -- 172.21.15.77:0/3340856499 shutdown_connections 2024-09-18T21:11:48.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.625+0000 7fb623f1b640 1 --2- 172.21.15.77:0/3340856499 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb61c0fd350 0x7fb61c0fb750 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:48.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.625+0000 7fb623f1b640 1 --2- 172.21.15.77:0/3340856499 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb61c0fca00 0x7fb61c0fce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:48.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.625+0000 7fb623f1b640 1 -- 172.21.15.77:0/3340856499 >> 172.21.15.77:0/3340856499 conn(0x7fb61c0f6390 msgr2=0x7fb61c0f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:11:48.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.626+0000 7fb623f1b640 1 -- 172.21.15.77:0/3340856499 shutdown_connections 2024-09-18T21:11:48.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.626+0000 7fb623f1b640 1 -- 172.21.15.77:0/3340856499 wait complete. 2024-09-18T21:11:48.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.626+0000 7fb623f1b640 1 Processor -- start 2024-09-18T21:11:48.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.627+0000 7fb623f1b640 1 -- start start 2024-09-18T21:11:48.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.627+0000 7fb623f1b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb61c0fca00 0x7fb61c10fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:48.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.627+0000 7fb623f1b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb61c0fd350 0x7fb61c112330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:48.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.627+0000 7fb623f1b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61c0fb300 con 0x7fb61c0fd350 2024-09-18T21:11:48.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.627+0000 7fb623f1b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61c0fb470 con 0x7fb61c0fca00 2024-09-18T21:11:48.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.627+0000 7fb621cb7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb61c0fca00 0x7fb61c10fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:48.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.627+0000 7fb621cb7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb61c0fca00 0x7fb61c10fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:52738/0 (socket says 172.21.15.77:52738) 2024-09-18T21:11:48.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.627+0000 7fb621cb7640 1 -- 172.21.15.77:0/144847218 learned_addr learned my addr 172.21.15.77:0/144847218 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:11:48.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.627+0000 7fb6214b6640 1 --2- 172.21.15.77:0/144847218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb61c0fd350 0x7fb61c112330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:48.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.627+0000 7fb621cb7640 1 -- 172.21.15.77:0/144847218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb61c0fd350 msgr2=0x7fb61c112330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:48.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.627+0000 7fb621cb7640 1 --2- 172.21.15.77:0/144847218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb61c0fd350 0x7fb61c112330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:48.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.627+0000 7fb621cb7640 1 -- 172.21.15.77:0/144847218 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb60c005040 con 0x7fb61c0fca00 2024-09-18T21:11:48.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.628+0000 7fb621cb7640 1 --2- 172.21.15.77:0/144847218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb61c0fca00 0x7fb61c10fde0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb61800eb70 tx=0x7fb61800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:11:48.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.628+0000 7fb6127fc640 1 -- 172.21.15.77:0/144847218 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb618007c30 con 0x7fb61c0fca00 2024-09-18T21:11:48.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.628+0000 7fb623f1b640 1 -- 172.21.15.77:0/144847218 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb61c10bc20 con 0x7fb61c0fca00 2024-09-18T21:11:48.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.628+0000 7fb6127fc640 1 -- 172.21.15.77:0/144847218 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb61800f040 con 0x7fb61c0fca00 2024-09-18T21:11:48.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.628+0000 7fb623f1b640 1 -- 172.21.15.77:0/144847218 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb61c10c1c0 con 0x7fb61c0fca00 2024-09-18T21:11:48.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.628+0000 7fb6127fc640 1 -- 172.21.15.77:0/144847218 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb61800caf0 con 0x7fb61c0fca00 2024-09-18T21:11:48.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.630+0000 7fb6127fc640 1 -- 172.21.15.77:0/144847218 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fb618009110 con 0x7fb61c0fca00 2024-09-18T21:11:48.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.630+0000 7fb623f1b640 1 -- 172.21.15.77:0/144847218 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb61c0fa010 con 0x7fb61c0fca00 2024-09-18T21:11:48.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.630+0000 7fb6127fc640 1 --2- 172.21.15.77:0/144847218 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fb60806ed60 0x7fb608071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:11:48.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.630+0000 7fb6214b6640 1 --2- 172.21.15.77:0/144847218 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fb60806ed60 0x7fb608071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:11:48.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.631+0000 7fb6127fc640 1 -- 172.21.15.77:0/144847218 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fb61808e420 con 0x7fb61c0fca00 2024-09-18T21:11:48.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.631+0000 7fb6214b6640 1 --2- 172.21.15.77:0/144847218 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fb60806ed60 0x7fb608071210 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb60c007ac0 tx=0x7fb60c035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:11:48.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.637+0000 7fb6127fc640 1 -- 172.21.15.77:0/144847218 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb61805b4e0 con 0x7fb61c0fca00 2024-09-18T21:11:48.910 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.909+0000 7fb623f1b640 1 -- 172.21.15.77:0/144847218 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb61c103e60 con 0x7fb61c0fca00 2024-09-18T21:11:48.910 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:48 smithi077 ceph-mon[27689]: from='client.24345 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:11:48.910 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:48 smithi077 ceph-mon[27689]: from='client.14554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:11:48.910 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:48 smithi077 ceph-mon[27689]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:11:48.910 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:48 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/3927216491' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:11:48.911 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:48 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/3822957790' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T21:11:48.911 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.909+0000 7fb6127fc640 1 -- 172.21.15.77:0/144847218 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fb61805ae80 con 0x7fb61c0fca00 2024-09-18T21:11:48.911 INFO:teuthology.orchestra.run.smithi077.stdout:HEALTH_OK 2024-09-18T21:11:48.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.912+0000 7fb623f1b640 1 -- 172.21.15.77:0/144847218 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fb60806ed60 msgr2=0x7fb608071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:48.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.912+0000 7fb623f1b640 1 --2- 172.21.15.77:0/144847218 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fb60806ed60 0x7fb608071210 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb60c007ac0 tx=0x7fb60c035040 comp rx=0 tx=0).stop 2024-09-18T21:11:48.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.912+0000 7fb623f1b640 1 -- 172.21.15.77:0/144847218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb61c0fca00 msgr2=0x7fb61c10fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:11:48.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.912+0000 7fb623f1b640 1 --2- 172.21.15.77:0/144847218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb61c0fca00 0x7fb61c10fde0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb61800eb70 tx=0x7fb61800b040 comp rx=0 tx=0).stop 2024-09-18T21:11:48.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.912+0000 7fb623f1b640 1 -- 172.21.15.77:0/144847218 shutdown_connections 2024-09-18T21:11:48.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.912+0000 7fb623f1b640 1 --2- 172.21.15.77:0/144847218 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fb60806ed60 0x7fb608071210 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:48.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.912+0000 7fb623f1b640 1 --2- 172.21.15.77:0/144847218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb61c0fd350 0x7fb61c112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:48.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.912+0000 7fb623f1b640 1 --2- 172.21.15.77:0/144847218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb61c0fca00 0x7fb61c10fde0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:11:48.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.912+0000 7fb623f1b640 1 -- 172.21.15.77:0/144847218 >> 172.21.15.77:0/144847218 conn(0x7fb61c0f6390 msgr2=0x7fb61c0f7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:11:48.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.912+0000 7fb623f1b640 1 -- 172.21.15.77:0/144847218 shutdown_connections 2024-09-18T21:11:48.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:11:48.912+0000 7fb623f1b640 1 -- 172.21.15.77:0/144847218 wait complete. 2024-09-18T21:11:49.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:48 smithi103 ceph-mon[34827]: from='client.24345 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:11:49.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:48 smithi103 ceph-mon[34827]: from='client.14554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:11:49.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:48 smithi103 ceph-mon[34827]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:11:49.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:48 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/3927216491' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:11:49.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:48 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/3822957790' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T21:11:49.053 INFO:tasks.workunit.client.0.smithi077.stderr:Updating files: 95% (11806/12357) Updating files: 96% (11863/12357) Updating files: 97% (11987/12357) Updating files: 98% (12110/12357) Updating files: 99% (12234/12357) Updating files: 100% (12357/12357) Updating files: 100% (12357/12357), done. 2024-09-18T21:11:49.409 INFO:tasks.workunit.client.0.smithi077.stderr:Note: switching to 'c27976df948bf97893b1a7826e51bfff94e4f88c'. 2024-09-18T21:11:49.409 INFO:tasks.workunit.client.0.smithi077.stderr: 2024-09-18T21:11:49.409 INFO:tasks.workunit.client.0.smithi077.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-18T21:11:49.409 INFO:tasks.workunit.client.0.smithi077.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-18T21:11:49.409 INFO:tasks.workunit.client.0.smithi077.stderr:state without impacting any branches by switching back to a branch. 2024-09-18T21:11:49.409 INFO:tasks.workunit.client.0.smithi077.stderr: 2024-09-18T21:11:49.409 INFO:tasks.workunit.client.0.smithi077.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-18T21:11:49.409 INFO:tasks.workunit.client.0.smithi077.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-18T21:11:49.410 INFO:tasks.workunit.client.0.smithi077.stderr: 2024-09-18T21:11:49.410 INFO:tasks.workunit.client.0.smithi077.stderr: git switch -c 2024-09-18T21:11:49.410 INFO:tasks.workunit.client.0.smithi077.stderr: 2024-09-18T21:11:49.410 INFO:tasks.workunit.client.0.smithi077.stderr:Or undo this operation with: 2024-09-18T21:11:49.410 INFO:tasks.workunit.client.0.smithi077.stderr: 2024-09-18T21:11:49.410 INFO:tasks.workunit.client.0.smithi077.stderr: git switch - 2024-09-18T21:11:49.410 INFO:tasks.workunit.client.0.smithi077.stderr: 2024-09-18T21:11:49.410 INFO:tasks.workunit.client.0.smithi077.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-18T21:11:49.410 INFO:tasks.workunit.client.0.smithi077.stderr: 2024-09-18T21:11:49.410 INFO:tasks.workunit.client.0.smithi077.stderr:HEAD is now at c27976df948 upgrade/cephfs/mds_upgrade_sequence: ignore osds down 2024-09-18T21:11:49.412 DEBUG:teuthology.orchestra.run.smithi077:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-18T21:11:49.440 INFO:tasks.workunit.client.0.smithi077.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-18T21:11:49.443 INFO:tasks.workunit.client.0.smithi077.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-18T21:11:49.443 INFO:tasks.workunit.client.0.smithi077.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-18T21:11:49.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:49 smithi077 ceph-mon[27689]: pgmap v213: 65 pgs: 65 active+clean; 16 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s wr, 62 op/s 2024-09-18T21:11:49.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:49 smithi077 ceph-mon[27689]: from='client.24365 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:11:49.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:49 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/144847218' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T21:11:50.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:49 smithi103 ceph-mon[34827]: pgmap v213: 65 pgs: 65 active+clean; 16 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s wr, 62 op/s 2024-09-18T21:11:50.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:49 smithi103 ceph-mon[34827]: from='client.24365 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:11:50.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:49 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/144847218' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T21:11:50.172 INFO:tasks.workunit.client.0.smithi077.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-18T21:11:50.239 INFO:tasks.workunit.client.0.smithi077.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-18T21:11:50.281 INFO:tasks.workunit.client.0.smithi077.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-18T21:11:50.283 INFO:tasks.workunit.client.0.smithi077.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-18T21:11:50.283 INFO:tasks.workunit.client.0.smithi077.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-18T21:11:50.325 INFO:tasks.workunit.client.0.smithi077.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-18T21:11:50.328 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-18T21:11:50.328 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-18T21:11:50.391 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-18T21:11:50.392 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-18T21:11:50.392 DEBUG:teuthology.orchestra.run.smithi077:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c27976df948bf97893b1a7826e51bfff94e4f88c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-18T21:11:50.457 INFO:tasks.workunit.client.0.smithi077.stderr:+ mkdir -p fsstress 2024-09-18T21:11:50.459 INFO:tasks.workunit.client.0.smithi077.stderr:+ pushd fsstress 2024-09-18T21:11:50.460 INFO:tasks.workunit.client.0.smithi077.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-18T21:11:50.461 INFO:tasks.workunit.client.0.smithi077.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-18T21:11:51.512 INFO:tasks.workunit.client.0.smithi077.stderr:+ tar xzf ltp-full.tgz 2024-09-18T21:11:51.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:51 smithi077 ceph-mon[27689]: pgmap v214: 65 pgs: 65 active+clean; 16 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s wr, 85 op/s 2024-09-18T21:11:52.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:51 smithi103 ceph-mon[34827]: pgmap v214: 65 pgs: 65 active+clean; 16 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s wr, 85 op/s 2024-09-18T21:11:53.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:53 smithi077 ceph-mon[27689]: pgmap v215: 65 pgs: 65 active+clean; 24 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s wr, 201 op/s 2024-09-18T21:11:54.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:53 smithi103 ceph-mon[34827]: pgmap v215: 65 pgs: 65 active+clean; 24 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s wr, 201 op/s 2024-09-18T21:11:55.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:55 smithi077 ceph-mon[27689]: pgmap v216: 65 pgs: 65 active+clean; 29 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.5 MiB/s wr, 233 op/s 2024-09-18T21:11:56.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:55 smithi103 ceph-mon[34827]: pgmap v216: 65 pgs: 65 active+clean; 29 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.5 MiB/s wr, 233 op/s 2024-09-18T21:11:57.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:57 smithi103 ceph-mon[34827]: pgmap v217: 65 pgs: 65 active+clean; 57 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 4.4 MiB/s wr, 401 op/s 2024-09-18T21:11:57.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:57 smithi077 ceph-mon[27689]: pgmap v217: 65 pgs: 65 active+clean; 57 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 4.4 MiB/s wr, 401 op/s 2024-09-18T21:11:59.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:59 smithi077 ceph-mon[27689]: pgmap v218: 65 pgs: 65 active+clean; 57 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 3.7 MiB/s wr, 342 op/s 2024-09-18T21:11:59.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:11:59 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:12:00.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:59 smithi103 ceph-mon[34827]: pgmap v218: 65 pgs: 65 active+clean; 57 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 3.7 MiB/s wr, 342 op/s 2024-09-18T21:12:00.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:11:59 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:12:01.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:01 smithi077 ceph-mon[27689]: pgmap v219: 65 pgs: 65 active+clean; 59 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 3.8 MiB/s wr, 377 op/s 2024-09-18T21:12:02.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:01 smithi103 ceph-mon[34827]: pgmap v219: 65 pgs: 65 active+clean; 59 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 3.8 MiB/s wr, 377 op/s 2024-09-18T21:12:03.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:03 smithi077 ceph-mon[27689]: pgmap v220: 65 pgs: 65 active+clean; 76 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 5.3 MiB/s wr, 529 op/s 2024-09-18T21:12:04.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:03 smithi103 ceph-mon[34827]: pgmap v220: 65 pgs: 65 active+clean; 76 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 5.3 MiB/s wr, 529 op/s 2024-09-18T21:12:05.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:05 smithi077 ceph-mon[27689]: pgmap v221: 65 pgs: 65 active+clean; 77 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 4.7 MiB/s wr, 443 op/s 2024-09-18T21:12:06.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:05 smithi103 ceph-mon[34827]: pgmap v221: 65 pgs: 65 active+clean; 77 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 4.7 MiB/s wr, 443 op/s 2024-09-18T21:12:07.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:07 smithi077 ceph-mon[27689]: pgmap v222: 65 pgs: 65 active+clean; 100 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 6.3 MiB/s wr, 598 op/s 2024-09-18T21:12:08.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:07 smithi103 ceph-mon[34827]: pgmap v222: 65 pgs: 65 active+clean; 100 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 6.3 MiB/s wr, 598 op/s 2024-09-18T21:12:09.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:09 smithi077 ceph-mon[27689]: pgmap v223: 65 pgs: 65 active+clean; 100 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.9 MiB/s wr, 426 op/s 2024-09-18T21:12:10.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:09 smithi103 ceph-mon[34827]: pgmap v223: 65 pgs: 65 active+clean; 100 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.9 MiB/s wr, 426 op/s 2024-09-18T21:12:11.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:11 smithi103 ceph-mon[34827]: pgmap v224: 65 pgs: 65 active+clean; 103 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 4.1 MiB/s wr, 456 op/s 2024-09-18T21:12:11.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:11 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:12:11.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:11 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi103.zjztqc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T21:12:11.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:11 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T21:12:11.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:11 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:12:11.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:11 smithi077 ceph-mon[27689]: pgmap v224: 65 pgs: 65 active+clean; 103 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 4.1 MiB/s wr, 456 op/s 2024-09-18T21:12:11.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:11 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:12:11.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:11 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi103.zjztqc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T21:12:11.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:11 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T21:12:11.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:11 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:12:12.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:12 smithi077 ceph-mon[27689]: Upgrade: Updating mgr.smithi103.zjztqc 2024-09-18T21:12:12.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:12 smithi077 ceph-mon[27689]: Deploying daemon mgr.smithi103.zjztqc on smithi103 2024-09-18T21:12:12.978 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:12 smithi103 ceph-mon[34827]: Upgrade: Updating mgr.smithi103.zjztqc 2024-09-18T21:12:12.978 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:12 smithi103 ceph-mon[34827]: Deploying daemon mgr.smithi103.zjztqc on smithi103 2024-09-18T21:12:13.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:13 smithi077 ceph-mon[27689]: pgmap v225: 65 pgs: 65 active+clean; 120 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 5.4 MiB/s wr, 581 op/s 2024-09-18T21:12:14.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:13 smithi103 ceph-mon[34827]: pgmap v225: 65 pgs: 65 active+clean; 120 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 5.4 MiB/s wr, 581 op/s 2024-09-18T21:12:14.935 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:14 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:12:14.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:14 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:12:15.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:15 smithi103 ceph-mon[34827]: pgmap v226: 65 pgs: 65 active+clean; 122 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 4.0 MiB/s wr, 437 op/s 2024-09-18T21:12:15.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:15 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:12:15.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:15 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:12:15.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:15 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:12:15.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:15 smithi077 ceph-mon[27689]: pgmap v226: 65 pgs: 65 active+clean; 122 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 4.0 MiB/s wr, 437 op/s 2024-09-18T21:12:15.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:15 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:12:15.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:15 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:12:15.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:15 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:12:17.898 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:17 smithi103 ceph-mon[34827]: pgmap v227: 65 pgs: 65 active+clean; 138 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 5.4 MiB/s wr, 594 op/s 2024-09-18T21:12:17.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:17 smithi077 ceph-mon[27689]: pgmap v227: 65 pgs: 65 active+clean; 138 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 5.4 MiB/s wr, 594 op/s 2024-09-18T21:12:19.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.014+0000 7fb98f303640 1 -- 172.21.15.77:0/2555524017 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9880fc6f0 msgr2=0x7fb9880fcb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:19.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.014+0000 7fb98f303640 1 --2- 172.21.15.77:0/2555524017 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9880fc6f0 0x7fb9880fcb60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb9780048d0 tx=0x7fb978009da0 comp rx=0 tx=0).stop 2024-09-18T21:12:19.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.016+0000 7fb98f303640 1 -- 172.21.15.77:0/2555524017 shutdown_connections 2024-09-18T21:12:19.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.016+0000 7fb98f303640 1 --2- 172.21.15.77:0/2555524017 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9880fc6f0 0x7fb9880fcb60 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:19.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.016+0000 7fb98f303640 1 --2- 172.21.15.77:0/2555524017 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9880fb420 0x7fb9880fb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:19.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.016+0000 7fb98f303640 1 -- 172.21.15.77:0/2555524017 >> 172.21.15.77:0/2555524017 conn(0x7fb9880f6c00 msgr2=0x7fb9880f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:12:19.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.018+0000 7fb98f303640 1 -- 172.21.15.77:0/2555524017 shutdown_connections 2024-09-18T21:12:19.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.018+0000 7fb98f303640 1 -- 172.21.15.77:0/2555524017 wait complete. 2024-09-18T21:12:19.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.019+0000 7fb98f303640 1 Processor -- start 2024-09-18T21:12:19.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.019+0000 7fb98f303640 1 -- start start 2024-09-18T21:12:19.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.020+0000 7fb98f303640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9880fb420 0x7fb988065990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:12:19.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.020+0000 7fb98f303640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9880fc6f0 0x7fb988065ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:12:19.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.020+0000 7fb98f303640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb98806f630 con 0x7fb9880fb420 2024-09-18T21:12:19.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.020+0000 7fb98f303640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb98806f7a0 con 0x7fb9880fc6f0 2024-09-18T21:12:19.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.020+0000 7fb98d09f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9880fb420 0x7fb988065990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:12:19.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.020+0000 7fb98d09f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9880fb420 0x7fb988065990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58386/0 (socket says 172.21.15.77:58386) 2024-09-18T21:12:19.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.020+0000 7fb98d09f640 1 -- 172.21.15.77:0/2898817309 learned_addr learned my addr 172.21.15.77:0/2898817309 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:12:19.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.020+0000 7fb98c89e640 1 --2- 172.21.15.77:0/2898817309 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9880fc6f0 0x7fb988065ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:12:19.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.021+0000 7fb98c89e640 1 -- 172.21.15.77:0/2898817309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9880fb420 msgr2=0x7fb988065990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:19.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.021+0000 7fb98c89e640 1 --2- 172.21.15.77:0/2898817309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9880fb420 0x7fb988065990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:19.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.021+0000 7fb98c89e640 1 -- 172.21.15.77:0/2898817309 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb978005040 con 0x7fb9880fc6f0 2024-09-18T21:12:19.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.021+0000 7fb98c89e640 1 --2- 172.21.15.77:0/2898817309 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9880fc6f0 0x7fb988065ed0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb97802a530 tx=0x7fb978009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:12:19.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.021+0000 7fb98d09f640 1 --2- 172.21.15.77:0/2898817309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9880fb420 0x7fb988065990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T21:12:19.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.021+0000 7fb97dffb640 1 -- 172.21.15.77:0/2898817309 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb978038070 con 0x7fb9880fc6f0 2024-09-18T21:12:19.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.021+0000 7fb97dffb640 1 -- 172.21.15.77:0/2898817309 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb97802ae90 con 0x7fb9880fc6f0 2024-09-18T21:12:19.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.022+0000 7fb97dffb640 1 -- 172.21.15.77:0/2898817309 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb978033660 con 0x7fb9880fc6f0 2024-09-18T21:12:19.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.022+0000 7fb98f303640 1 -- 172.21.15.77:0/2898817309 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb988066500 con 0x7fb9880fc6f0 2024-09-18T21:12:19.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.022+0000 7fb98f303640 1 -- 172.21.15.77:0/2898817309 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb98806dc80 con 0x7fb9880fc6f0 2024-09-18T21:12:19.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.024+0000 7fb98f303640 1 -- 172.21.15.77:0/2898817309 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9880fa880 con 0x7fb9880fc6f0 2024-09-18T21:12:19.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.024+0000 7fb97dffb640 1 -- 172.21.15.77:0/2898817309 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fb978030020 con 0x7fb9880fc6f0 2024-09-18T21:12:19.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.025+0000 7fb97dffb640 1 --2- 172.21.15.77:0/2898817309 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fb97406ee20 0x7fb9740712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:12:19.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.026+0000 7fb97dffb640 1 -- 172.21.15.77:0/2898817309 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fb9780ae1c0 con 0x7fb9880fc6f0 2024-09-18T21:12:19.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.026+0000 7fb98d09f640 1 --2- 172.21.15.77:0/2898817309 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fb97406ee20 0x7fb9740712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:12:19.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.026+0000 7fb98d09f640 1 --2- 172.21.15.77:0/2898817309 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fb97406ee20 0x7fb9740712d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb98806f320 tx=0x7fb98400b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:12:19.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.032+0000 7fb97dffb640 1 -- 172.21.15.77:0/2898817309 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb97807b380 con 0x7fb9880fc6f0 2024-09-18T21:12:19.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.291+0000 7fb98f303640 1 -- 172.21.15.77:0/2898817309 --> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb988100af0 con 0x7fb97406ee20 2024-09-18T21:12:19.293 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.293+0000 7fb97dffb640 1 -- 172.21.15.77:0/2898817309 <== mgr.14206 v2:172.21.15.77:6800/950747822 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7fb988100af0 con 0x7fb97406ee20 2024-09-18T21:12:19.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.295+0000 7fb98f303640 1 -- 172.21.15.77:0/2898817309 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fb97406ee20 msgr2=0x7fb9740712d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:19.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.295+0000 7fb98f303640 1 --2- 172.21.15.77:0/2898817309 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fb97406ee20 0x7fb9740712d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb98806f320 tx=0x7fb98400b040 comp rx=0 tx=0).stop 2024-09-18T21:12:19.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.295+0000 7fb98f303640 1 -- 172.21.15.77:0/2898817309 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9880fc6f0 msgr2=0x7fb988065ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:19.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.295+0000 7fb98f303640 1 --2- 172.21.15.77:0/2898817309 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9880fc6f0 0x7fb988065ed0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb97802a530 tx=0x7fb978009da0 comp rx=0 tx=0).stop 2024-09-18T21:12:19.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.295+0000 7fb98f303640 1 -- 172.21.15.77:0/2898817309 shutdown_connections 2024-09-18T21:12:19.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.295+0000 7fb98f303640 1 --2- 172.21.15.77:0/2898817309 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fb97406ee20 0x7fb9740712d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:19.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.295+0000 7fb98f303640 1 --2- 172.21.15.77:0/2898817309 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9880fc6f0 0x7fb988065ed0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:19.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.295+0000 7fb98f303640 1 --2- 172.21.15.77:0/2898817309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9880fb420 0x7fb988065990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:19.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.295+0000 7fb98f303640 1 -- 172.21.15.77:0/2898817309 >> 172.21.15.77:0/2898817309 conn(0x7fb9880f6c00 msgr2=0x7fb9880f83d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:12:19.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.296+0000 7fb98f303640 1 -- 172.21.15.77:0/2898817309 shutdown_connections 2024-09-18T21:12:19.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.296+0000 7fb98f303640 1 -- 172.21.15.77:0/2898817309 wait complete. 2024-09-18T21:12:19.308 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-09-18T21:12:19.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.402+0000 7f5a8275c640 1 -- 172.21.15.77:0/1216301327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a7c0fc700 msgr2=0x7f5a7c0fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:19.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.402+0000 7f5a8275c640 1 --2- 172.21.15.77:0/1216301327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a7c0fc700 0x7f5a7c0fcb70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5a700048d0 tx=0x7f5a70009da0 comp rx=0 tx=0).stop 2024-09-18T21:12:19.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.402+0000 7f5a8275c640 1 -- 172.21.15.77:0/1216301327 shutdown_connections 2024-09-18T21:12:19.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.402+0000 7f5a8275c640 1 --2- 172.21.15.77:0/1216301327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a7c0fc700 0x7f5a7c0fcb70 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:19.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.402+0000 7f5a8275c640 1 --2- 172.21.15.77:0/1216301327 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a7c0fb430 0x7f5a7c0fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:19.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.402+0000 7f5a8275c640 1 -- 172.21.15.77:0/1216301327 >> 172.21.15.77:0/1216301327 conn(0x7f5a7c0f6c10 msgr2=0x7f5a7c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:12:19.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.402+0000 7f5a8275c640 1 -- 172.21.15.77:0/1216301327 shutdown_connections 2024-09-18T21:12:19.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.402+0000 7f5a8275c640 1 -- 172.21.15.77:0/1216301327 wait complete. 2024-09-18T21:12:19.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.403+0000 7f5a8275c640 1 Processor -- start 2024-09-18T21:12:19.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.403+0000 7f5a8275c640 1 -- start start 2024-09-18T21:12:19.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.403+0000 7f5a8275c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a7c0fb430 0x7f5a7c10fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:12:19.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.403+0000 7f5a8275c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a7c065bc0 0x7f5a7c112440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:12:19.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.403+0000 7f5a8275c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7c112980 con 0x7f5a7c065bc0 2024-09-18T21:12:19.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.403+0000 7f5a8275c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7c112ac0 con 0x7f5a7c0fb430 2024-09-18T21:12:19.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.404+0000 7f5a7b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a7c065bc0 0x7f5a7c112440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:12:19.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.404+0000 7f5a7b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a7c065bc0 0x7f5a7c112440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58968/0 (socket says 172.21.15.77:58968) 2024-09-18T21:12:19.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.404+0000 7f5a7b7fe640 1 -- 172.21.15.77:0/1112457194 learned_addr learned my addr 172.21.15.77:0/1112457194 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:12:19.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.404+0000 7f5a7bfff640 1 --2- 172.21.15.77:0/1112457194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a7c0fb430 0x7f5a7c10fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:12:19.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.404+0000 7f5a7b7fe640 1 -- 172.21.15.77:0/1112457194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a7c0fb430 msgr2=0x7f5a7c10fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:19.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.404+0000 7f5a7b7fe640 1 --2- 172.21.15.77:0/1112457194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a7c0fb430 0x7f5a7c10fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:19.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.404+0000 7f5a7b7fe640 1 -- 172.21.15.77:0/1112457194 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a70005040 con 0x7f5a7c065bc0 2024-09-18T21:12:19.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.404+0000 7f5a7b7fe640 1 --2- 172.21.15.77:0/1112457194 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a7c065bc0 0x7f5a7c112440 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5a700048a0 tx=0x7f5a70009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:12:19.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.405+0000 7f5a78ff9640 1 -- 172.21.15.77:0/1112457194 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a70038070 con 0x7f5a7c065bc0 2024-09-18T21:12:19.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.405+0000 7f5a8275c640 1 -- 172.21.15.77:0/1112457194 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a7c112d40 con 0x7f5a7c065bc0 2024-09-18T21:12:19.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.405+0000 7f5a8275c640 1 -- 172.21.15.77:0/1112457194 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a7c113280 con 0x7f5a7c065bc0 2024-09-18T21:12:19.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.405+0000 7f5a78ff9640 1 -- 172.21.15.77:0/1112457194 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5a70004290 con 0x7f5a7c065bc0 2024-09-18T21:12:19.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.405+0000 7f5a78ff9640 1 -- 172.21.15.77:0/1112457194 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a7002c780 con 0x7f5a7c065bc0 2024-09-18T21:12:19.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.407+0000 7f5a8275c640 1 -- 172.21.15.77:0/1112457194 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a68005240 con 0x7f5a7c065bc0 2024-09-18T21:12:19.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.407+0000 7f5a78ff9640 1 -- 172.21.15.77:0/1112457194 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f5a70030020 con 0x7f5a7c065bc0 2024-09-18T21:12:19.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.408+0000 7f5a78ff9640 1 --2- 172.21.15.77:0/1112457194 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f5a6406ed60 0x7f5a64071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:12:19.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.408+0000 7f5a7bfff640 1 --2- 172.21.15.77:0/1112457194 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f5a6406ed60 0x7f5a64071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:12:19.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.408+0000 7f5a78ff9640 1 -- 172.21.15.77:0/1112457194 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f5a700ae6b0 con 0x7f5a7c065bc0 2024-09-18T21:12:19.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.409+0000 7f5a7bfff640 1 --2- 172.21.15.77:0/1112457194 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f5a6406ed60 0x7f5a64071210 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c065970 tx=0x7f5a6c00b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:12:19.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.416+0000 7f5a78ff9640 1 -- 172.21.15.77:0/1112457194 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5a7007b7b0 con 0x7f5a7c065bc0 2024-09-18T21:12:19.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.693+0000 7f5a8275c640 1 -- 172.21.15.77:0/1112457194 --> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5a68000bf0 con 0x7f5a6406ed60 2024-09-18T21:12:19.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.695+0000 7f5a78ff9640 1 -- 172.21.15.77:0/1112457194 <== mgr.14206 v2:172.21.15.77:6800/950747822 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f5a68000bf0 con 0x7f5a6406ed60 2024-09-18T21:12:19.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.697+0000 7f5a8275c640 1 -- 172.21.15.77:0/1112457194 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f5a6406ed60 msgr2=0x7f5a64071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:19.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.697+0000 7f5a8275c640 1 --2- 172.21.15.77:0/1112457194 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f5a6406ed60 0x7f5a64071210 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c065970 tx=0x7f5a6c00b040 comp rx=0 tx=0).stop 2024-09-18T21:12:19.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.697+0000 7f5a8275c640 1 -- 172.21.15.77:0/1112457194 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a7c065bc0 msgr2=0x7f5a7c112440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:19.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.697+0000 7f5a8275c640 1 --2- 172.21.15.77:0/1112457194 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a7c065bc0 0x7f5a7c112440 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5a700048a0 tx=0x7f5a70009da0 comp rx=0 tx=0).stop 2024-09-18T21:12:19.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.697+0000 7f5a8275c640 1 -- 172.21.15.77:0/1112457194 shutdown_connections 2024-09-18T21:12:19.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.697+0000 7f5a8275c640 1 --2- 172.21.15.77:0/1112457194 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f5a6406ed60 0x7f5a64071210 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:19.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.697+0000 7f5a8275c640 1 --2- 172.21.15.77:0/1112457194 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a7c065bc0 0x7f5a7c112440 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:19.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.697+0000 7f5a8275c640 1 --2- 172.21.15.77:0/1112457194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a7c0fb430 0x7f5a7c10fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:19.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.697+0000 7f5a8275c640 1 -- 172.21.15.77:0/1112457194 >> 172.21.15.77:0/1112457194 conn(0x7f5a7c0f6c10 msgr2=0x7f5a7c0f8470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:12:19.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.698+0000 7f5a8275c640 1 -- 172.21.15.77:0/1112457194 shutdown_connections 2024-09-18T21:12:19.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.698+0000 7f5a8275c640 1 -- 172.21.15.77:0/1112457194 wait complete. 2024-09-18T21:12:19.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.816+0000 7f86f23dc640 1 -- 172.21.15.77:0/487261676 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f86ec0fb430 msgr2=0x7f86ec0fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:19.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.816+0000 7f86f23dc640 1 --2- 172.21.15.77:0/487261676 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f86ec0fb430 0x7f86ec0fb840 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f86dc0048d0 tx=0x7f86dc009da0 comp rx=0 tx=0).stop 2024-09-18T21:12:19.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.816+0000 7f86f23dc640 1 -- 172.21.15.77:0/487261676 shutdown_connections 2024-09-18T21:12:19.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.816+0000 7f86f23dc640 1 --2- 172.21.15.77:0/487261676 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86ec0fc700 0x7f86ec0fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:19.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.816+0000 7f86f23dc640 1 --2- 172.21.15.77:0/487261676 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f86ec0fb430 0x7f86ec0fb840 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:19.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.816+0000 7f86f23dc640 1 -- 172.21.15.77:0/487261676 >> 172.21.15.77:0/487261676 conn(0x7f86ec0f6c10 msgr2=0x7f86ec0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:12:19.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.816+0000 7f86f23dc640 1 -- 172.21.15.77:0/487261676 shutdown_connections 2024-09-18T21:12:19.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.816+0000 7f86f23dc640 1 -- 172.21.15.77:0/487261676 wait complete. 2024-09-18T21:12:19.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.817+0000 7f86f23dc640 1 Processor -- start 2024-09-18T21:12:19.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.817+0000 7f86f23dc640 1 -- start start 2024-09-18T21:12:19.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.818+0000 7f86f23dc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86ec0fb430 0x7f86ec10bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:12:19.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.818+0000 7f86f23dc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f86ec0fc700 0x7f86ec10c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:12:19.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.818+0000 7f86f23dc640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec10cb10 con 0x7f86ec0fc700 2024-09-18T21:12:19.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.818+0000 7f86f23dc640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec10d330 con 0x7f86ec0fb430 2024-09-18T21:12:19.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.818+0000 7f86eb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f86ec0fc700 0x7f86ec10c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:12:19.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.818+0000 7f86eb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f86ec0fc700 0x7f86ec10c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58978/0 (socket says 172.21.15.77:58978) 2024-09-18T21:12:19.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.818+0000 7f86eb7fe640 1 -- 172.21.15.77:0/1904440029 learned_addr learned my addr 172.21.15.77:0/1904440029 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:12:19.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.818+0000 7f86ebfff640 1 --2- 172.21.15.77:0/1904440029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86ec0fb430 0x7f86ec10bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:12:19.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.819+0000 7f86ebfff640 1 -- 172.21.15.77:0/1904440029 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f86ec0fc700 msgr2=0x7f86ec10c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:19.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.819+0000 7f86ebfff640 1 --2- 172.21.15.77:0/1904440029 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f86ec0fc700 0x7f86ec10c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:19.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.819+0000 7f86ebfff640 1 -- 172.21.15.77:0/1904440029 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86dc005040 con 0x7f86ec0fb430 2024-09-18T21:12:19.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.819+0000 7f86ebfff640 1 --2- 172.21.15.77:0/1904440029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86ec0fb430 0x7f86ec10bf80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f86dc000c00 tx=0x7f86dc009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:12:19.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.820+0000 7f86e8ff9640 1 -- 172.21.15.77:0/1904440029 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86dc038070 con 0x7f86ec0fb430 2024-09-18T21:12:19.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.820+0000 7f86f23dc640 1 -- 172.21.15.77:0/1904440029 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86ec10d560 con 0x7f86ec0fb430 2024-09-18T21:12:19.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.820+0000 7f86f23dc640 1 -- 172.21.15.77:0/1904440029 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86ec10da80 con 0x7f86ec0fb430 2024-09-18T21:12:19.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.820+0000 7f86e8ff9640 1 -- 172.21.15.77:0/1904440029 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f86dc02ae90 con 0x7f86ec0fb430 2024-09-18T21:12:19.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.820+0000 7f86e8ff9640 1 -- 172.21.15.77:0/1904440029 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86dc033420 con 0x7f86ec0fb430 2024-09-18T21:12:19.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.821+0000 7f86f23dc640 1 -- 172.21.15.77:0/1904440029 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86d8005240 con 0x7f86ec0fb430 2024-09-18T21:12:19.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.822+0000 7f86e8ff9640 1 -- 172.21.15.77:0/1904440029 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f86dc030020 con 0x7f86ec0fb430 2024-09-18T21:12:19.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.823+0000 7f86e8ff9640 1 --2- 172.21.15.77:0/1904440029 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f86d406ed60 0x7f86d4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:12:19.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.823+0000 7f86e8ff9640 1 -- 172.21.15.77:0/1904440029 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f86dc0ae2f0 con 0x7f86ec0fb430 2024-09-18T21:12:19.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.823+0000 7f86eb7fe640 1 --2- 172.21.15.77:0/1904440029 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f86d406ed60 0x7f86d4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:12:19.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.824+0000 7f86eb7fe640 1 --2- 172.21.15.77:0/1904440029 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f86d406ed60 0x7f86d4071210 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f86ec10bd30 tx=0x7f86e000b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:12:19.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:19.828+0000 7f86e8ff9640 1 -- 172.21.15.77:0/1904440029 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f86dc07b370 con 0x7f86ec0fb430 2024-09-18T21:12:19.935 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:19 smithi103 ceph-mon[34827]: pgmap v228: 65 pgs: 65 active+clean; 138 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 3.3 MiB/s wr, 407 op/s 2024-09-18T21:12:19.935 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:19 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:12:19.935 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:19 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:12:19.936 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:19 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:12:19.936 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:19 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:12:19.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:19 smithi077 ceph-mon[27689]: pgmap v228: 65 pgs: 65 active+clean; 138 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 3.3 MiB/s wr, 407 op/s 2024-09-18T21:12:19.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:19 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:12:19.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:19 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:12:19.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:19 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:12:19.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:19 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:12:20.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.042+0000 7f86f23dc640 1 -- 172.21.15.77:0/1904440029 --> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f86d8000bf0 con 0x7f86d406ed60 2024-09-18T21:12:20.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.052+0000 7f86e8ff9640 1 -- 172.21.15.77:0/1904440029 <== mgr.14206 v2:172.21.15.77:6800/950747822 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7f86d8000bf0 con 0x7f86d406ed60 2024-09-18T21:12:20.053 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T21:12:20.053 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager.smithi077 smithi077 *:9093,9094 running (5m) 94s ago 7m 25.5M - 0.25.0 c8568f914cd2 e1881e21423c 2024-09-18T21:12:20.053 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi077 smithi077 running (7m) 94s ago 7m 6899k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 0beb64a8c2ea 2024-09-18T21:12:20.053 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi103 smithi103 running (6m) 1s ago 6m 6891k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 04981ca7bf34 2024-09-18T21:12:20.053 INFO:teuthology.orchestra.run.smithi077.stdout:grafana.smithi077 smithi077 *:3000 running (5m) 94s ago 6m 83.6M - 9.4.7 954c08fa6188 620f52934182 2024-09-18T21:12:20.053 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.cqfhlw smithi077 running (113s) 94s ago 113s 11.7M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 a7ec3b7701b6 2024-09-18T21:12:20.053 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.vruydi smithi077 running (119s) 94s ago 118s 15.4M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 affbba097d3b 2024-09-18T21:12:20.053 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi103.opftmf smithi103 running (111s) 1s ago 110s 14.5M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 111f884c5a34 2024-09-18T21:12:20.053 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi103.zhdmdg smithi103 running (116s) 1s ago 116s 14.4M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 50b77d0edda5 2024-09-18T21:12:20.053 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi077.utkpjg smithi077 *:9283,8765,8443 running (8m) 94s ago 8m 448M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 5d334eb01bea 2024-09-18T21:12:20.053 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi103.zjztqc smithi103 *:8443,9283 running (4s) 1s ago 6m 66.9M - 19.1.1-17-g06b1b1de f79f744f586d 0fe6f5f18bf6 2024-09-18T21:12:20.053 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi077 smithi077 running (8m) 94s ago 8m 49.1M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bcbf289fe027 2024-09-18T21:12:20.054 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi103 smithi103 running (6m) 1s ago 6m 37.5M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 d6ae2062e5e3 2024-09-18T21:12:20.054 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi077 smithi077 *:9100 running (7m) 94s ago 7m 16.8M - 1.5.0 0da6a335fe13 ee48144962b4 2024-09-18T21:12:20.054 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi103 smithi103 *:9100 running (6m) 1s ago 6m 16.7M - 1.5.0 0da6a335fe13 f7a4da7753f2 2024-09-18T21:12:20.054 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (5m) 94s ago 5m 47.1M 4288M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 2e3563c32cf5 2024-09-18T21:12:20.054 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi077 running (5m) 94s ago 5m 44.1M 4288M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 39c2ccbb7603 2024-09-18T21:12:20.054 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi077 running (4m) 94s ago 4m 43.0M 4288M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 2ff2728057e2 2024-09-18T21:12:20.054 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi103 running (4m) 1s ago 4m 112M 5312M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 0e72b1bbb8ce 2024-09-18T21:12:20.054 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi103 running (3m) 1s ago 3m 110M 5312M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 85f1ce1e8bee 2024-09-18T21:12:20.054 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi103 running (3m) 1s ago 3m 104M 5312M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 cf8964b3ac6d 2024-09-18T21:12:20.054 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus.smithi077 smithi077 *:9095 running (5m) 94s ago 6m 56.4M - 2.43.0 a07b618ecd1d 81e0f3809b2f 2024-09-18T21:12:20.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.054+0000 7f86f23dc640 1 -- 172.21.15.77:0/1904440029 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f86d406ed60 msgr2=0x7f86d4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:20.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.054+0000 7f86f23dc640 1 --2- 172.21.15.77:0/1904440029 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f86d406ed60 0x7f86d4071210 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f86ec10bd30 tx=0x7f86e000b040 comp rx=0 tx=0).stop 2024-09-18T21:12:20.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.054+0000 7f86f23dc640 1 -- 172.21.15.77:0/1904440029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86ec0fb430 msgr2=0x7f86ec10bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:20.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.054+0000 7f86f23dc640 1 --2- 172.21.15.77:0/1904440029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86ec0fb430 0x7f86ec10bf80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f86dc000c00 tx=0x7f86dc009da0 comp rx=0 tx=0).stop 2024-09-18T21:12:20.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.054+0000 7f86f23dc640 1 -- 172.21.15.77:0/1904440029 shutdown_connections 2024-09-18T21:12:20.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.054+0000 7f86f23dc640 1 --2- 172.21.15.77:0/1904440029 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f86d406ed60 0x7f86d4071210 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:20.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.054+0000 7f86f23dc640 1 --2- 172.21.15.77:0/1904440029 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f86ec0fc700 0x7f86ec10c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:20.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.054+0000 7f86f23dc640 1 --2- 172.21.15.77:0/1904440029 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86ec0fb430 0x7f86ec10bf80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:20.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.054+0000 7f86f23dc640 1 -- 172.21.15.77:0/1904440029 >> 172.21.15.77:0/1904440029 conn(0x7f86ec0f6c10 msgr2=0x7f86ec0f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:12:20.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.054+0000 7f86f23dc640 1 -- 172.21.15.77:0/1904440029 shutdown_connections 2024-09-18T21:12:20.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.054+0000 7f86f23dc640 1 -- 172.21.15.77:0/1904440029 wait complete. 2024-09-18T21:12:20.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.162+0000 7fd7b995b640 1 -- 172.21.15.77:0/2661256834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7b40fd840 msgr2=0x7fd7b40fdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:20.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.162+0000 7fd7b995b640 1 --2- 172.21.15.77:0/2661256834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7b40fd840 0x7fd7b40fdcb0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd7a80048d0 tx=0x7fd7a8009da0 comp rx=0 tx=0).stop 2024-09-18T21:12:20.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.162+0000 7fd7b995b640 1 -- 172.21.15.77:0/2661256834 shutdown_connections 2024-09-18T21:12:20.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.162+0000 7fd7b995b640 1 --2- 172.21.15.77:0/2661256834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7b40fd840 0x7fd7b40fdcb0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:20.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.162+0000 7fd7b995b640 1 --2- 172.21.15.77:0/2661256834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7b40fc570 0x7fd7b40fc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:20.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.162+0000 7fd7b995b640 1 -- 172.21.15.77:0/2661256834 >> 172.21.15.77:0/2661256834 conn(0x7fd7b40f7d10 msgr2=0x7fd7b40fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:12:20.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.163+0000 7fd7b995b640 1 -- 172.21.15.77:0/2661256834 shutdown_connections 2024-09-18T21:12:20.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.163+0000 7fd7b995b640 1 -- 172.21.15.77:0/2661256834 wait complete. 2024-09-18T21:12:20.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.163+0000 7fd7b995b640 1 Processor -- start 2024-09-18T21:12:20.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.164+0000 7fd7b995b640 1 -- start start 2024-09-18T21:12:20.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.164+0000 7fd7b995b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7b40fc570 0x7fd7b4071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:12:20.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.164+0000 7fd7b2ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7b40fc570 0x7fd7b4071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:12:20.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.164+0000 7fd7b2ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7b40fc570 0x7fd7b4071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58996/0 (socket says 172.21.15.77:58996) 2024-09-18T21:12:20.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.164+0000 7fd7b2ffd640 1 -- 172.21.15.77:0/260791963 learned_addr learned my addr 172.21.15.77:0/260791963 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:12:20.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.164+0000 7fd7b995b640 1 --2- 172.21.15.77:0/260791963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7b40fd840 0x7fd7b406fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:12:20.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.165+0000 7fd7b995b640 1 -- 172.21.15.77:0/260791963 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b4110d10 con 0x7fd7b40fc570 2024-09-18T21:12:20.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.165+0000 7fd7b995b640 1 -- 172.21.15.77:0/260791963 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b4110e50 con 0x7fd7b40fd840 2024-09-18T21:12:20.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.165+0000 7fd7b27fc640 1 --2- 172.21.15.77:0/260791963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7b40fd840 0x7fd7b406fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:12:20.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.165+0000 7fd7b2ffd640 1 -- 172.21.15.77:0/260791963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7b40fd840 msgr2=0x7fd7b406fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:20.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.165+0000 7fd7b2ffd640 1 --2- 172.21.15.77:0/260791963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7b40fd840 0x7fd7b406fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:20.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.165+0000 7fd7b2ffd640 1 -- 172.21.15.77:0/260791963 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a8005040 con 0x7fd7b40fc570 2024-09-18T21:12:20.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.165+0000 7fd7b2ffd640 1 --2- 172.21.15.77:0/260791963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7b40fc570 0x7fd7b4071570 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd7a400eb70 tx=0x7fd7a400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:12:20.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.166+0000 7fd79b7fe640 1 -- 172.21.15.77:0/260791963 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7a4007c30 con 0x7fd7b40fc570 2024-09-18T21:12:20.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.166+0000 7fd79b7fe640 1 -- 172.21.15.77:0/260791963 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd7a400f040 con 0x7fd7b40fc570 2024-09-18T21:12:20.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.166+0000 7fd79b7fe640 1 -- 172.21.15.77:0/260791963 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7a4009470 con 0x7fd7b40fc570 2024-09-18T21:12:20.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.166+0000 7fd7b995b640 1 -- 172.21.15.77:0/260791963 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7b4070000 con 0x7fd7b40fc570 2024-09-18T21:12:20.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.166+0000 7fd7b995b640 1 -- 172.21.15.77:0/260791963 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7b40704e0 con 0x7fd7b40fc570 2024-09-18T21:12:20.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.167+0000 7fd7b995b640 1 -- 172.21.15.77:0/260791963 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7b40fb9d0 con 0x7fd7b40fc570 2024-09-18T21:12:20.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.168+0000 7fd79b7fe640 1 -- 172.21.15.77:0/260791963 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fd7a40095d0 con 0x7fd7b40fc570 2024-09-18T21:12:20.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.169+0000 7fd79b7fe640 1 --2- 172.21.15.77:0/260791963 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fd79c06ed60 0x7fd79c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:12:20.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.169+0000 7fd79b7fe640 1 -- 172.21.15.77:0/260791963 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fd7a408dcd0 con 0x7fd7b40fc570 2024-09-18T21:12:20.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.169+0000 7fd7b27fc640 1 --2- 172.21.15.77:0/260791963 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fd79c06ed60 0x7fd79c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:12:20.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.170+0000 7fd7b27fc640 1 --2- 172.21.15.77:0/260791963 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fd79c06ed60 0x7fd79c071210 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8004540 tx=0x7fd7a8035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:12:20.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.177+0000 7fd79b7fe640 1 -- 172.21.15.77:0/260791963 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd7a405af20 con 0x7fd7b40fc570 2024-09-18T21:12:20.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.536+0000 7fd7b995b640 1 -- 172.21.15.77:0/260791963 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd7b41198c0 con 0x7fd7b40fc570 2024-09-18T21:12:20.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.537+0000 7fd79b7fe640 1 -- 172.21.15.77:0/260791963 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+643 (secure 0 0 0) 0x7fd7a405a8c0 con 0x7fd7b40fc570 2024-09-18T21:12:20.538 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-18T21:12:20.538 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": { 2024-09-18T21:12:20.538 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 2 2024-09-18T21:12:20.538 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:12:20.538 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": { 2024-09-18T21:12:20.538 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 2 2024-09-18T21:12:20.538 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:12:20.538 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": { 2024-09-18T21:12:20.538 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 6 2024-09-18T21:12:20.539 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:12:20.539 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-09-18T21:12:20.539 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4 2024-09-18T21:12:20.539 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:12:20.539 INFO:teuthology.orchestra.run.smithi077.stdout: "overall": { 2024-09-18T21:12:20.539 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 14 2024-09-18T21:12:20.539 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-18T21:12:20.539 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-18T21:12:20.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.539+0000 7fd7b995b640 1 -- 172.21.15.77:0/260791963 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fd79c06ed60 msgr2=0x7fd79c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:20.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.539+0000 7fd7b995b640 1 --2- 172.21.15.77:0/260791963 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fd79c06ed60 0x7fd79c071210 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8004540 tx=0x7fd7a8035040 comp rx=0 tx=0).stop 2024-09-18T21:12:20.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.539+0000 7fd7b995b640 1 -- 172.21.15.77:0/260791963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7b40fc570 msgr2=0x7fd7b4071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:20.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.539+0000 7fd7b995b640 1 --2- 172.21.15.77:0/260791963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7b40fc570 0x7fd7b4071570 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd7a400eb70 tx=0x7fd7a400b040 comp rx=0 tx=0).stop 2024-09-18T21:12:20.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.540+0000 7fd7b995b640 1 -- 172.21.15.77:0/260791963 shutdown_connections 2024-09-18T21:12:20.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.540+0000 7fd7b995b640 1 --2- 172.21.15.77:0/260791963 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fd79c06ed60 0x7fd79c071210 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:20.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.540+0000 7fd7b995b640 1 --2- 172.21.15.77:0/260791963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7b40fd840 0x7fd7b406fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:20.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.540+0000 7fd7b995b640 1 --2- 172.21.15.77:0/260791963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7b40fc570 0x7fd7b4071570 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:20.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.540+0000 7fd7b995b640 1 -- 172.21.15.77:0/260791963 >> 172.21.15.77:0/260791963 conn(0x7fd7b40f7d10 msgr2=0x7fd7b40f94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:12:20.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.540+0000 7fd7b995b640 1 -- 172.21.15.77:0/260791963 shutdown_connections 2024-09-18T21:12:20.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.540+0000 7fd7b995b640 1 -- 172.21.15.77:0/260791963 wait complete. 2024-09-18T21:12:20.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.642+0000 7fbd9b6bb640 1 -- 172.21.15.77:0/3600917278 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd94066410 msgr2=0x7fbd940ff1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:20.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.642+0000 7fbd9b6bb640 1 --2- 172.21.15.77:0/3600917278 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd94066410 0x7fbd940ff1f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbd900048d0 tx=0x7fbd90009da0 comp rx=0 tx=0).stop 2024-09-18T21:12:20.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.643+0000 7fbd9b6bb640 1 -- 172.21.15.77:0/3600917278 shutdown_connections 2024-09-18T21:12:20.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.643+0000 7fbd9b6bb640 1 --2- 172.21.15.77:0/3600917278 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd940ff730 0x7fbd94101b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:20.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.643+0000 7fbd9b6bb640 1 --2- 172.21.15.77:0/3600917278 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd94066410 0x7fbd940ff1f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:20.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.643+0000 7fbd9b6bb640 1 -- 172.21.15.77:0/3600917278 >> 172.21.15.77:0/3600917278 conn(0x7fbd940f6c00 msgr2=0x7fbd940f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:12:20.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.643+0000 7fbd9b6bb640 1 -- 172.21.15.77:0/3600917278 shutdown_connections 2024-09-18T21:12:20.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.643+0000 7fbd9b6bb640 1 -- 172.21.15.77:0/3600917278 wait complete. 2024-09-18T21:12:20.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.643+0000 7fbd9b6bb640 1 Processor -- start 2024-09-18T21:12:20.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.643+0000 7fbd9b6bb640 1 -- start start 2024-09-18T21:12:20.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.644+0000 7fbd9b6bb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd94066410 0x7fbd940fb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:12:20.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.644+0000 7fbd9b6bb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd940ff730 0x7fbd940fba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:12:20.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.644+0000 7fbd9b6bb640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd940fd090 con 0x7fbd94066410 2024-09-18T21:12:20.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.644+0000 7fbd9b6bb640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd940fbf70 con 0x7fbd940ff730 2024-09-18T21:12:20.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.644+0000 7fbd98c56640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd940ff730 0x7fbd940fba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:12:20.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.644+0000 7fbd98c56640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd940ff730 0x7fbd940fba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:53274/0 (socket says 172.21.15.77:53274) 2024-09-18T21:12:20.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.644+0000 7fbd98c56640 1 -- 172.21.15.77:0/2042615319 learned_addr learned my addr 172.21.15.77:0/2042615319 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:12:20.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.644+0000 7fbd99457640 1 --2- 172.21.15.77:0/2042615319 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd94066410 0x7fbd940fb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:12:20.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.644+0000 7fbd98c56640 1 -- 172.21.15.77:0/2042615319 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd94066410 msgr2=0x7fbd940fb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:20.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.644+0000 7fbd98c56640 1 --2- 172.21.15.77:0/2042615319 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd94066410 0x7fbd940fb4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:20.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.644+0000 7fbd98c56640 1 -- 172.21.15.77:0/2042615319 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd90005040 con 0x7fbd940ff730 2024-09-18T21:12:20.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.644+0000 7fbd99457640 1 --2- 172.21.15.77:0/2042615319 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd94066410 0x7fbd940fb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T21:12:20.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.644+0000 7fbd98c56640 1 --2- 172.21.15.77:0/2042615319 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd940ff730 0x7fbd940fba00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbd8800eb70 tx=0x7fbd8800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:12:20.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.645+0000 7fbd85ffb640 1 -- 172.21.15.77:0/2042615319 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd88007c30 con 0x7fbd940ff730 2024-09-18T21:12:20.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.645+0000 7fbd85ffb640 1 -- 172.21.15.77:0/2042615319 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbd8800f040 con 0x7fbd940ff730 2024-09-18T21:12:20.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.645+0000 7fbd85ffb640 1 -- 172.21.15.77:0/2042615319 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd88009550 con 0x7fbd940ff730 2024-09-18T21:12:20.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.645+0000 7fbd9b6bb640 1 -- 172.21.15.77:0/2042615319 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd940fc1f0 con 0x7fbd940ff730 2024-09-18T21:12:20.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.645+0000 7fbd9b6bb640 1 -- 172.21.15.77:0/2042615319 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd94114f70 con 0x7fbd940ff730 2024-09-18T21:12:20.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.646+0000 7fbd9b6bb640 1 -- 172.21.15.77:0/2042615319 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd940fa880 con 0x7fbd940ff730 2024-09-18T21:12:20.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.648+0000 7fbd85ffb640 1 -- 172.21.15.77:0/2042615319 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fbd8800cca0 con 0x7fbd940ff730 2024-09-18T21:12:20.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.648+0000 7fbd85ffb640 1 --2- 172.21.15.77:0/2042615319 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fbd8006ed50 0x7fbd80071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:12:20.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.649+0000 7fbd85ffb640 1 -- 172.21.15.77:0/2042615319 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fbd8808de60 con 0x7fbd940ff730 2024-09-18T21:12:20.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.649+0000 7fbd99457640 1 --2- 172.21.15.77:0/2042615319 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fbd8006ed50 0x7fbd80071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:12:20.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.649+0000 7fbd99457640 1 --2- 172.21.15.77:0/2042615319 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fbd8006ed50 0x7fbd80071200 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbd90000c00 tx=0x7fbd90035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:12:20.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.653+0000 7fbd85ffb640 1 -- 172.21.15.77:0/2042615319 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fbd8804e2a0 con 0x7fbd940ff730 2024-09-18T21:12:20.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:20 smithi103 ceph-mon[34827]: from='client.24377 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:12:20.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:20 smithi103 ceph-mon[34827]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:12:20.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:20 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/260791963' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:12:20.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.943+0000 7fbd9b6bb640 1 -- 172.21.15.77:0/2042615319 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbd9404b720 con 0x7fbd940ff730 2024-09-18T21:12:20.945 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:20 smithi077 ceph-mon[27689]: from='client.24377 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:12:20.945 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:20 smithi077 ceph-mon[27689]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:12:20.945 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:20 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/260791963' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:12:20.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.944+0000 7fbd85ffb640 1 -- 172.21.15.77:0/2042615319 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1807 (secure 0 0 0) 0x7fbd8805abb0 con 0x7fbd940ff730 2024-09-18T21:12:20.945 INFO:teuthology.orchestra.run.smithi077.stdout:e13 2024-09-18T21:12:20.946 INFO:teuthology.orchestra.run.smithi077.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T21:12:20.946 INFO:teuthology.orchestra.run.smithi077.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T21:12:20.946 INFO:teuthology.orchestra.run.smithi077.stdout:legacy client fscid: 1 2024-09-18T21:12:20.946 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:12:20.946 INFO:teuthology.orchestra.run.smithi077.stdout:Filesystem 'cephfs' (1) 2024-09-18T21:12:20.946 INFO:teuthology.orchestra.run.smithi077.stdout:fs_name cephfs 2024-09-18T21:12:20.946 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 13 2024-09-18T21:12:20.946 INFO:teuthology.orchestra.run.smithi077.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T21:12:20.946 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-09-18T21:10:17.230179+0000 2024-09-18T21:12:20.946 INFO:teuthology.orchestra.run.smithi077.stdout:modified 2024-09-18T21:10:33.373241+0000 2024-09-18T21:12:20.946 INFO:teuthology.orchestra.run.smithi077.stdout:tableserver 0 2024-09-18T21:12:20.946 INFO:teuthology.orchestra.run.smithi077.stdout:root 0 2024-09-18T21:12:20.946 INFO:teuthology.orchestra.run.smithi077.stdout:session_timeout 60 2024-09-18T21:12:20.946 INFO:teuthology.orchestra.run.smithi077.stdout:session_autoclose 300 2024-09-18T21:12:20.947 INFO:teuthology.orchestra.run.smithi077.stdout:max_file_size 1099511627776 2024-09-18T21:12:20.947 INFO:teuthology.orchestra.run.smithi077.stdout:required_client_features {} 2024-09-18T21:12:20.947 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure 0 2024-09-18T21:12:20.947 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure_osd_epoch 0 2024-09-18T21:12:20.947 INFO:teuthology.orchestra.run.smithi077.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T21:12:20.947 INFO:teuthology.orchestra.run.smithi077.stdout:max_mds 1 2024-09-18T21:12:20.947 INFO:teuthology.orchestra.run.smithi077.stdout:in 0 2024-09-18T21:12:20.947 INFO:teuthology.orchestra.run.smithi077.stdout:up {0=14446} 2024-09-18T21:12:20.947 INFO:teuthology.orchestra.run.smithi077.stdout:failed 2024-09-18T21:12:20.947 INFO:teuthology.orchestra.run.smithi077.stdout:damaged 2024-09-18T21:12:20.947 INFO:teuthology.orchestra.run.smithi077.stdout:stopped 2024-09-18T21:12:20.947 INFO:teuthology.orchestra.run.smithi077.stdout:data_pools [3] 2024-09-18T21:12:20.947 INFO:teuthology.orchestra.run.smithi077.stdout:metadata_pool 2 2024-09-18T21:12:20.947 INFO:teuthology.orchestra.run.smithi077.stdout:inline_data disabled 2024-09-18T21:12:20.948 INFO:teuthology.orchestra.run.smithi077.stdout:balancer 2024-09-18T21:12:20.948 INFO:teuthology.orchestra.run.smithi077.stdout:standby_count_wanted 1 2024-09-18T21:12:20.948 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.vruydi{0:14446} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.77:6826/334039954,v1:172.21.15.77:6827/334039954] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:12:20.948 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:12:20.948 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:12:20.948 INFO:teuthology.orchestra.run.smithi077.stdout:Standby daemons: 2024-09-18T21:12:20.948 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:12:20.948 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.cqfhlw{-1:14458} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.77:6828/862540650,v1:172.21.15.77:6829/862540650] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:12:20.948 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi103.zhdmdg{-1:24255} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.103:6824/2170237078,v1:172.21.15.103:6825/2170237078] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:12:20.948 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi103.opftmf{-1:24267} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.103:6826/4241818403,v1:172.21.15.103:6827/4241818403] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:12:20.949 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 13 2024-09-18T21:12:20.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.947+0000 7fbd9b6bb640 1 -- 172.21.15.77:0/2042615319 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fbd8006ed50 msgr2=0x7fbd80071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:20.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.947+0000 7fbd9b6bb640 1 --2- 172.21.15.77:0/2042615319 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fbd8006ed50 0x7fbd80071200 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbd90000c00 tx=0x7fbd90035040 comp rx=0 tx=0).stop 2024-09-18T21:12:20.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.947+0000 7fbd9b6bb640 1 -- 172.21.15.77:0/2042615319 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd940ff730 msgr2=0x7fbd940fba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:20.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.947+0000 7fbd9b6bb640 1 --2- 172.21.15.77:0/2042615319 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd940ff730 0x7fbd940fba00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbd8800eb70 tx=0x7fbd8800b040 comp rx=0 tx=0).stop 2024-09-18T21:12:20.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.947+0000 7fbd9b6bb640 1 -- 172.21.15.77:0/2042615319 shutdown_connections 2024-09-18T21:12:20.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.947+0000 7fbd9b6bb640 1 --2- 172.21.15.77:0/2042615319 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7fbd8006ed50 0x7fbd80071200 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:20.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.947+0000 7fbd9b6bb640 1 --2- 172.21.15.77:0/2042615319 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd940ff730 0x7fbd940fba00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:20.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.947+0000 7fbd9b6bb640 1 --2- 172.21.15.77:0/2042615319 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd94066410 0x7fbd940fb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:20.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.947+0000 7fbd9b6bb640 1 -- 172.21.15.77:0/2042615319 >> 172.21.15.77:0/2042615319 conn(0x7fbd940f6c00 msgr2=0x7fbd940f6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:12:20.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.947+0000 7fbd9b6bb640 1 -- 172.21.15.77:0/2042615319 shutdown_connections 2024-09-18T21:12:20.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:20.947+0000 7fbd9b6bb640 1 -- 172.21.15.77:0/2042615319 wait complete. 2024-09-18T21:12:21.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.040+0000 7f4603a62640 1 -- 172.21.15.77:0/1350371271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45fc108200 msgr2=0x7f45fc108670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:21.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.040+0000 7f4603a62640 1 --2- 172.21.15.77:0/1350371271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45fc108200 0x7f45fc108670 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f45ec0048d0 tx=0x7f45ec009da0 comp rx=0 tx=0).stop 2024-09-18T21:12:21.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.041+0000 7f4603a62640 1 -- 172.21.15.77:0/1350371271 shutdown_connections 2024-09-18T21:12:21.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.041+0000 7f4603a62640 1 --2- 172.21.15.77:0/1350371271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45fc108200 0x7f45fc108670 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:21.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.041+0000 7f4603a62640 1 --2- 172.21.15.77:0/1350371271 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45fc106f30 0x7f45fc107340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:21.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.041+0000 7f4603a62640 1 -- 172.21.15.77:0/1350371271 >> 172.21.15.77:0/1350371271 conn(0x7f45fc066e00 msgr2=0x7f45fc067200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:12:21.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.041+0000 7f4603a62640 1 -- 172.21.15.77:0/1350371271 shutdown_connections 2024-09-18T21:12:21.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.041+0000 7f4603a62640 1 -- 172.21.15.77:0/1350371271 wait complete. 2024-09-18T21:12:21.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.041+0000 7f4603a62640 1 Processor -- start 2024-09-18T21:12:21.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.042+0000 7f4603a62640 1 -- start start 2024-09-18T21:12:21.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.042+0000 7f4603a62640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45fc106f30 0x7f45fc069120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:12:21.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.042+0000 7f4603a62640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45fc108200 0x7f45fc069660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:12:21.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.042+0000 7f4603a62640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc069c60 con 0x7f45fc108200 2024-09-18T21:12:21.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.042+0000 7f4603a62640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc06a520 con 0x7f45fc106f30 2024-09-18T21:12:21.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.042+0000 7f46017fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45fc106f30 0x7f45fc069120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:12:21.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.042+0000 7f46017fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45fc106f30 0x7f45fc069120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:53296/0 (socket says 172.21.15.77:53296) 2024-09-18T21:12:21.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.042+0000 7f46017fe640 1 -- 172.21.15.77:0/1564220695 learned_addr learned my addr 172.21.15.77:0/1564220695 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:12:21.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.042+0000 7f4600ffd640 1 --2- 172.21.15.77:0/1564220695 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45fc108200 0x7f45fc069660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:12:21.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.043+0000 7f46017fe640 1 -- 172.21.15.77:0/1564220695 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45fc108200 msgr2=0x7f45fc069660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:21.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.043+0000 7f46017fe640 1 --2- 172.21.15.77:0/1564220695 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45fc108200 0x7f45fc069660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:21.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.043+0000 7f46017fe640 1 -- 172.21.15.77:0/1564220695 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ec005040 con 0x7f45fc106f30 2024-09-18T21:12:21.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.043+0000 7f46017fe640 1 --2- 172.21.15.77:0/1564220695 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45fc106f30 0x7f45fc069120 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f45f800eb70 tx=0x7f45f800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:12:21.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.043+0000 7f45f1ffb640 1 -- 172.21.15.77:0/1564220695 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45f8007c30 con 0x7f45fc106f30 2024-09-18T21:12:21.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.043+0000 7f45f1ffb640 1 -- 172.21.15.77:0/1564220695 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f45f800f040 con 0x7f45fc106f30 2024-09-18T21:12:21.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.043+0000 7f45f1ffb640 1 -- 172.21.15.77:0/1564220695 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45f8009420 con 0x7f45fc106f30 2024-09-18T21:12:21.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.043+0000 7f4603a62640 1 -- 172.21.15.77:0/1564220695 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45fc06a7a0 con 0x7f45fc106f30 2024-09-18T21:12:21.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.043+0000 7f4603a62640 1 -- 172.21.15.77:0/1564220695 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45fc06ad40 con 0x7f45fc106f30 2024-09-18T21:12:21.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.045+0000 7f4603a62640 1 -- 172.21.15.77:0/1564220695 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45fc068a00 con 0x7f45fc106f30 2024-09-18T21:12:21.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.046+0000 7f45f1ffb640 1 -- 172.21.15.77:0/1564220695 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f45f800c6a0 con 0x7f45fc106f30 2024-09-18T21:12:21.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.047+0000 7f45f1ffb640 1 --2- 172.21.15.77:0/1564220695 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f45e806ed50 0x7f45e8071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:12:21.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.047+0000 7f45f1ffb640 1 -- 172.21.15.77:0/1564220695 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f45f808dda0 con 0x7f45fc106f30 2024-09-18T21:12:21.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.047+0000 7f4600ffd640 1 --2- 172.21.15.77:0/1564220695 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f45e806ed50 0x7f45e8071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:12:21.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.047+0000 7f4600ffd640 1 --2- 172.21.15.77:0/1564220695 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f45e806ed50 0x7f45e8071200 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f45ec000c00 tx=0x7f45ec035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:12:21.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.052+0000 7f45f1ffb640 1 -- 172.21.15.77:0/1564220695 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f45f805af90 con 0x7f45fc106f30 2024-09-18T21:12:21.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.327+0000 7f4603a62640 1 -- 172.21.15.77:0/1564220695 --> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f45fc06b020 con 0x7f45e806ed50 2024-09-18T21:12:21.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.330+0000 7f45f1ffb640 1 -- 172.21.15.77:0/1564220695 <== mgr.14206 v2:172.21.15.77:6800/950747822 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f45fc06b020 con 0x7f45e806ed50 2024-09-18T21:12:21.331 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-18T21:12:21.331 INFO:teuthology.orchestra.run.smithi077.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a", 2024-09-18T21:12:21.331 INFO:teuthology.orchestra.run.smithi077.stdout: "in_progress": true, 2024-09-18T21:12:21.331 INFO:teuthology.orchestra.run.smithi077.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T21:12:21.331 INFO:teuthology.orchestra.run.smithi077.stdout: "services_complete": [], 2024-09-18T21:12:21.331 INFO:teuthology.orchestra.run.smithi077.stdout: "progress": "1/21 daemons upgraded", 2024-09-18T21:12:21.332 INFO:teuthology.orchestra.run.smithi077.stdout: "message": "Currently upgrading mgr daemons", 2024-09-18T21:12:21.332 INFO:teuthology.orchestra.run.smithi077.stdout: "is_paused": false 2024-09-18T21:12:21.332 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-18T21:12:21.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.333+0000 7f4603a62640 1 -- 172.21.15.77:0/1564220695 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f45e806ed50 msgr2=0x7f45e8071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:21.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.333+0000 7f4603a62640 1 --2- 172.21.15.77:0/1564220695 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f45e806ed50 0x7f45e8071200 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f45ec000c00 tx=0x7f45ec035040 comp rx=0 tx=0).stop 2024-09-18T21:12:21.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.333+0000 7f4603a62640 1 -- 172.21.15.77:0/1564220695 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45fc106f30 msgr2=0x7f45fc069120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:21.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.333+0000 7f4603a62640 1 --2- 172.21.15.77:0/1564220695 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45fc106f30 0x7f45fc069120 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f45f800eb70 tx=0x7f45f800b040 comp rx=0 tx=0).stop 2024-09-18T21:12:21.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.333+0000 7f4603a62640 1 -- 172.21.15.77:0/1564220695 shutdown_connections 2024-09-18T21:12:21.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.334+0000 7f4603a62640 1 --2- 172.21.15.77:0/1564220695 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f45e806ed50 0x7f45e8071200 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:21.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.334+0000 7f4603a62640 1 --2- 172.21.15.77:0/1564220695 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45fc108200 0x7f45fc069660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:21.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.334+0000 7f4603a62640 1 --2- 172.21.15.77:0/1564220695 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45fc106f30 0x7f45fc069120 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:21.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.334+0000 7f4603a62640 1 -- 172.21.15.77:0/1564220695 >> 172.21.15.77:0/1564220695 conn(0x7f45fc066e00 msgr2=0x7f45fc105670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:12:21.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.334+0000 7f4603a62640 1 -- 172.21.15.77:0/1564220695 shutdown_connections 2024-09-18T21:12:21.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.334+0000 7f4603a62640 1 -- 172.21.15.77:0/1564220695 wait complete. 2024-09-18T21:12:21.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.448+0000 7f06dccc5640 1 -- 172.21.15.77:0/2579488893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06d80ff680 msgr2=0x7f06d8101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:21.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.448+0000 7f06dccc5640 1 --2- 172.21.15.77:0/2579488893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06d80ff680 0x7f06d8101a60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f06cc0048d0 tx=0x7f06cc009da0 comp rx=0 tx=0).stop 2024-09-18T21:12:21.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.448+0000 7f06dccc5640 1 -- 172.21.15.77:0/2579488893 shutdown_connections 2024-09-18T21:12:21.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.448+0000 7f06dccc5640 1 --2- 172.21.15.77:0/2579488893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06d80ff680 0x7f06d8101a60 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:21.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.448+0000 7f06dccc5640 1 --2- 172.21.15.77:0/2579488893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06d8065c40 0x7f06d80ff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:21.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.448+0000 7f06dccc5640 1 -- 172.21.15.77:0/2579488893 >> 172.21.15.77:0/2579488893 conn(0x7f06d80f6c10 msgr2=0x7f06d80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:12:21.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.448+0000 7f06dccc5640 1 -- 172.21.15.77:0/2579488893 shutdown_connections 2024-09-18T21:12:21.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.448+0000 7f06dccc5640 1 -- 172.21.15.77:0/2579488893 wait complete. 2024-09-18T21:12:21.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.449+0000 7f06dccc5640 1 Processor -- start 2024-09-18T21:12:21.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.449+0000 7f06dccc5640 1 -- start start 2024-09-18T21:12:21.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.449+0000 7f06dccc5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06d8065c40 0x7f06d810d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:12:21.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.449+0000 7f06dccc5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06d80ff680 0x7f06d810d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:12:21.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.449+0000 7f06dccc5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d810e480 con 0x7f06d80ff680 2024-09-18T21:12:21.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.449+0000 7f06dccc5640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d810e5f0 con 0x7f06d8065c40 2024-09-18T21:12:21.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.450+0000 7f06d659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06d8065c40 0x7f06d810d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:12:21.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.450+0000 7f06d659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06d8065c40 0x7f06d810d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:53302/0 (socket says 172.21.15.77:53302) 2024-09-18T21:12:21.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.450+0000 7f06d659c640 1 -- 172.21.15.77:0/2781088873 learned_addr learned my addr 172.21.15.77:0/2781088873 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:12:21.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.450+0000 7f06d5d9b640 1 --2- 172.21.15.77:0/2781088873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06d80ff680 0x7f06d810d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:12:21.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.450+0000 7f06d659c640 1 -- 172.21.15.77:0/2781088873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06d80ff680 msgr2=0x7f06d810d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:21.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.450+0000 7f06d659c640 1 --2- 172.21.15.77:0/2781088873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06d80ff680 0x7f06d810d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:21.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.450+0000 7f06d659c640 1 -- 172.21.15.77:0/2781088873 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06cc005040 con 0x7f06d8065c40 2024-09-18T21:12:21.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.450+0000 7f06d5d9b640 1 --2- 172.21.15.77:0/2781088873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06d80ff680 0x7f06d810d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T21:12:21.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.450+0000 7f06d659c640 1 --2- 172.21.15.77:0/2781088873 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06d8065c40 0x7f06d810d0d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f06c800b580 tx=0x7f06c80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:12:21.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.450+0000 7f06c6ffd640 1 -- 172.21.15.77:0/2781088873 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06c800f6f0 con 0x7f06d8065c40 2024-09-18T21:12:21.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.451+0000 7f06c6ffd640 1 -- 172.21.15.77:0/2781088873 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f06c800fcf0 con 0x7f06d8065c40 2024-09-18T21:12:21.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.451+0000 7f06dccc5640 1 -- 172.21.15.77:0/2781088873 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06d810e8d0 con 0x7f06d8065c40 2024-09-18T21:12:21.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.451+0000 7f06c6ffd640 1 -- 172.21.15.77:0/2781088873 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06c80103a0 con 0x7f06d8065c40 2024-09-18T21:12:21.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.451+0000 7f06dccc5640 1 -- 172.21.15.77:0/2781088873 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06d810eda0 con 0x7f06d8065c40 2024-09-18T21:12:21.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.452+0000 7f06dccc5640 1 -- 172.21.15.77:0/2781088873 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06d81057e0 con 0x7f06d8065c40 2024-09-18T21:12:21.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.453+0000 7f06c6ffd640 1 -- 172.21.15.77:0/2781088873 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f06c800f850 con 0x7f06d8065c40 2024-09-18T21:12:21.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.453+0000 7f06c6ffd640 1 --2- 172.21.15.77:0/2781088873 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f06c006ed50 0x7f06c0071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:12:21.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.453+0000 7f06c6ffd640 1 -- 172.21.15.77:0/2781088873 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f06c808dfe0 con 0x7f06d8065c40 2024-09-18T21:12:21.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.453+0000 7f06d5d9b640 1 --2- 172.21.15.77:0/2781088873 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f06c006ed50 0x7f06c0071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:12:21.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.454+0000 7f06d5d9b640 1 --2- 172.21.15.77:0/2781088873 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f06c006ed50 0x7f06c0071200 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f06d810ce80 tx=0x7f06cc035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:12:21.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.458+0000 7f06c6ffd640 1 -- 172.21.15.77:0/2781088873 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f06c805ad00 con 0x7f06d8065c40 2024-09-18T21:12:21.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.832+0000 7f06dccc5640 1 -- 172.21.15.77:0/2781088873 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f06d80fa890 con 0x7f06d8065c40 2024-09-18T21:12:21.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.833+0000 7f06c6ffd640 1 -- 172.21.15.77:0/2781088873 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f06c805ad00 con 0x7f06d8065c40 2024-09-18T21:12:21.834 INFO:teuthology.orchestra.run.smithi077.stdout:HEALTH_OK 2024-09-18T21:12:21.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.836+0000 7f06dccc5640 1 -- 172.21.15.77:0/2781088873 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f06c006ed50 msgr2=0x7f06c0071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:21.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.836+0000 7f06dccc5640 1 --2- 172.21.15.77:0/2781088873 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f06c006ed50 0x7f06c0071200 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f06d810ce80 tx=0x7f06cc035040 comp rx=0 tx=0).stop 2024-09-18T21:12:21.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.836+0000 7f06dccc5640 1 -- 172.21.15.77:0/2781088873 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06d8065c40 msgr2=0x7f06d810d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:21.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.836+0000 7f06dccc5640 1 --2- 172.21.15.77:0/2781088873 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06d8065c40 0x7f06d810d0d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f06c800b580 tx=0x7f06c80091a0 comp rx=0 tx=0).stop 2024-09-18T21:12:21.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.836+0000 7f06dccc5640 1 -- 172.21.15.77:0/2781088873 shutdown_connections 2024-09-18T21:12:21.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.836+0000 7f06dccc5640 1 --2- 172.21.15.77:0/2781088873 >> [v2:172.21.15.77:6800/950747822,v1:172.21.15.77:6801/950747822] conn(0x7f06c006ed50 0x7f06c0071200 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:21.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.836+0000 7f06dccc5640 1 --2- 172.21.15.77:0/2781088873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06d80ff680 0x7f06d810d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:21.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.836+0000 7f06dccc5640 1 --2- 172.21.15.77:0/2781088873 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06d8065c40 0x7f06d810d0d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:21.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.836+0000 7f06dccc5640 1 -- 172.21.15.77:0/2781088873 >> 172.21.15.77:0/2781088873 conn(0x7f06d80f6c10 msgr2=0x7f06d80f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:12:21.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.836+0000 7f06dccc5640 1 -- 172.21.15.77:0/2781088873 shutdown_connections 2024-09-18T21:12:21.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:21.836+0000 7f06dccc5640 1 -- 172.21.15.77:0/2781088873 wait complete. 2024-09-18T21:12:21.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:21 smithi077 ceph-mon[27689]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:12:21.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:21 smithi077 ceph-mon[27689]: pgmap v229: 65 pgs: 65 active+clean; 139 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 3.5 MiB/s wr, 435 op/s 2024-09-18T21:12:21.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:21 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/2042615319' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T21:12:21.968 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:21 smithi103 ceph-mon[34827]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:12:21.968 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:21 smithi103 ceph-mon[34827]: pgmap v229: 65 pgs: 65 active+clean; 139 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 3.5 MiB/s wr, 435 op/s 2024-09-18T21:12:21.968 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:21 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/2042615319' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T21:12:22.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:22 smithi103 ceph-mon[34827]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:12:22.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:22 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/2781088873' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T21:12:22.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:22 smithi103 ceph-mon[34827]: Standby manager daemon smithi103.zjztqc restarted 2024-09-18T21:12:22.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:22 smithi103 ceph-mon[34827]: Standby manager daemon smithi103.zjztqc started 2024-09-18T21:12:22.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:22 smithi103 ceph-mon[34827]: from='mgr.? 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi103.zjztqc/crt"}]: dispatch 2024-09-18T21:12:22.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:22 smithi103 ceph-mon[34827]: from='mgr.? 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T21:12:22.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:22 smithi103 ceph-mon[34827]: from='mgr.? 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi103.zjztqc/key"}]: dispatch 2024-09-18T21:12:22.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:22 smithi103 ceph-mon[34827]: from='mgr.? 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T21:12:22.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:22 smithi077 ceph-mon[27689]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:12:22.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:22 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/2781088873' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T21:12:22.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:22 smithi077 ceph-mon[27689]: Standby manager daemon smithi103.zjztqc restarted 2024-09-18T21:12:22.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:22 smithi077 ceph-mon[27689]: Standby manager daemon smithi103.zjztqc started 2024-09-18T21:12:22.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:22 smithi077 ceph-mon[27689]: from='mgr.? 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi103.zjztqc/crt"}]: dispatch 2024-09-18T21:12:22.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:22 smithi077 ceph-mon[27689]: from='mgr.? 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T21:12:22.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:22 smithi077 ceph-mon[27689]: from='mgr.? 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi103.zjztqc/key"}]: dispatch 2024-09-18T21:12:22.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:22 smithi077 ceph-mon[27689]: from='mgr.? 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T21:12:23.736 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:23 smithi103 ceph-mon[34827]: pgmap v230: 65 pgs: 65 active+clean; 156 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 4.7 MiB/s wr, 551 op/s 2024-09-18T21:12:23.736 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:23 smithi103 ceph-mon[34827]: mgrmap e20: smithi077.utkpjg(active, since 6m), standbys: smithi103.zjztqc 2024-09-18T21:12:23.736 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:23 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:12:23.736 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:23 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:12:23.737 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:23 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:12:23.737 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:23 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:12:23.737 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:23 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:12:23.737 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:23 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:12:23.737 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:23 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mgr fail", "who": "smithi077.utkpjg"}]: dispatch 2024-09-18T21:12:23.737 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:23 smithi103 ceph-mon[34827]: Activating manager daemon smithi103.zjztqc 2024-09-18T21:12:23.737 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:23 smithi103 ceph-mon[34827]: osdmap e44: 6 total, 6 up, 6 in 2024-09-18T21:12:23.737 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:23 smithi103 ceph-mon[34827]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "mgr fail", "who": "smithi077.utkpjg"}]': finished 2024-09-18T21:12:23.737 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:23 smithi103 ceph-mon[34827]: mgrmap e21: smithi103.zjztqc(active, starting, since 0.00984397s) 2024-09-18T21:12:23.737 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:23 smithi103 ceph-mon[34827]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "mon metadata", "id": "smithi077"}]: dispatch 2024-09-18T21:12:23.737 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:23 smithi103 ceph-mon[34827]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "mon metadata", "id": "smithi103"}]: dispatch 2024-09-18T21:12:23.737 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:23 smithi103 ceph-mon[34827]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.vruydi"}]: dispatch 2024-09-18T21:12:23.738 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:23 smithi103 ceph-mon[34827]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.cqfhlw"}]: dispatch 2024-09-18T21:12:23.738 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:23 smithi103 ceph-mon[34827]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi103.zhdmdg"}]: dispatch 2024-09-18T21:12:23.738 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:23 smithi103 ceph-mon[34827]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi103.opftmf"}]: dispatch 2024-09-18T21:12:23.738 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:23 smithi103 ceph-mon[34827]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "mgr metadata", "who": "smithi103.zjztqc", "id": "smithi103.zjztqc"}]: dispatch 2024-09-18T21:12:23.738 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:23 smithi103 ceph-mon[34827]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T21:12:23.738 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:23 smithi103 ceph-mon[34827]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T21:12:23.738 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:23 smithi103 ceph-mon[34827]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T21:12:23.738 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:23 smithi103 ceph-mon[34827]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T21:12:23.738 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:23 smithi103 ceph-mon[34827]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T21:12:23.738 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:23 smithi103 ceph-mon[34827]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T21:12:23.738 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:23 smithi103 ceph-mon[34827]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-18T21:12:23.738 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:23 smithi103 ceph-mon[34827]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-18T21:12:23.738 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:23 smithi103 ceph-mon[34827]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-18T21:12:23.738 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:23 smithi103 ceph-mon[34827]: Manager daemon smithi103.zjztqc is now available 2024-09-18T21:12:23.739 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:23 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:12:23.739 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:23 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:12:23.739 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:23 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:12:23.739 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:23 smithi103 ceph-mon[34827]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:12:23.739 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:23 smithi103 ceph-mon[34827]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:12:23.739 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:23 smithi103 ceph-mon[34827]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi103.zjztqc/mirror_snapshot_schedule"}]: dispatch 2024-09-18T21:12:23.739 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:23 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi103.zjztqc/mirror_snapshot_schedule"}]: dispatch 2024-09-18T21:12:23.739 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:23 smithi103 ceph-mon[34827]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi103.zjztqc/trash_purge_schedule"}]: dispatch 2024-09-18T21:12:23.739 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:23 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi103.zjztqc/trash_purge_schedule"}]: dispatch 2024-09-18T21:12:23.886 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:23 smithi077 ceph-mon[27689]: pgmap v230: 65 pgs: 65 active+clean; 156 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 4.7 MiB/s wr, 551 op/s 2024-09-18T21:12:23.886 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:23 smithi077 ceph-mon[27689]: mgrmap e20: smithi077.utkpjg(active, since 6m), standbys: smithi103.zjztqc 2024-09-18T21:12:23.886 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:23 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:12:23.886 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:23 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:12:23.886 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:23 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:12:23.886 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:23 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:12:23.887 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:23 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' 2024-09-18T21:12:23.887 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:23 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:12:23.887 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:23 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mgr fail", "who": "smithi077.utkpjg"}]: dispatch 2024-09-18T21:12:23.887 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:23 smithi077 ceph-mon[27689]: Activating manager daemon smithi103.zjztqc 2024-09-18T21:12:23.887 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:23 smithi077 ceph-mon[27689]: osdmap e44: 6 total, 6 up, 6 in 2024-09-18T21:12:23.887 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:23 smithi077 ceph-mon[27689]: from='mgr.14206 172.21.15.77:0/2479503856' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "mgr fail", "who": "smithi077.utkpjg"}]': finished 2024-09-18T21:12:23.887 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:23 smithi077 ceph-mon[27689]: mgrmap e21: smithi103.zjztqc(active, starting, since 0.00984397s) 2024-09-18T21:12:23.887 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:23 smithi077 ceph-mon[27689]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "mon metadata", "id": "smithi077"}]: dispatch 2024-09-18T21:12:23.887 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:23 smithi077 ceph-mon[27689]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "mon metadata", "id": "smithi103"}]: dispatch 2024-09-18T21:12:23.887 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:23 smithi077 ceph-mon[27689]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.vruydi"}]: dispatch 2024-09-18T21:12:23.887 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:23 smithi077 ceph-mon[27689]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.cqfhlw"}]: dispatch 2024-09-18T21:12:23.887 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:23 smithi077 ceph-mon[27689]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi103.zhdmdg"}]: dispatch 2024-09-18T21:12:23.887 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:23 smithi077 ceph-mon[27689]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi103.opftmf"}]: dispatch 2024-09-18T21:12:23.887 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:23 smithi077 ceph-mon[27689]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "mgr metadata", "who": "smithi103.zjztqc", "id": "smithi103.zjztqc"}]: dispatch 2024-09-18T21:12:23.887 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:23 smithi077 ceph-mon[27689]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T21:12:23.888 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:23 smithi077 ceph-mon[27689]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T21:12:23.888 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:23 smithi077 ceph-mon[27689]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T21:12:23.888 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:23 smithi077 ceph-mon[27689]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T21:12:23.888 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:23 smithi077 ceph-mon[27689]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T21:12:23.888 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:23 smithi077 ceph-mon[27689]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T21:12:23.888 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:23 smithi077 ceph-mon[27689]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-18T21:12:23.888 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:23 smithi077 ceph-mon[27689]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-18T21:12:23.888 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:23 smithi077 ceph-mon[27689]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-18T21:12:23.888 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:23 smithi077 ceph-mon[27689]: Manager daemon smithi103.zjztqc is now available 2024-09-18T21:12:23.888 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:23 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:12:23.888 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:23 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:12:23.888 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:23 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:12:23.888 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:23 smithi077 ceph-mon[27689]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:12:23.888 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:23 smithi077 ceph-mon[27689]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:12:23.889 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:23 smithi077 ceph-mon[27689]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi103.zjztqc/mirror_snapshot_schedule"}]: dispatch 2024-09-18T21:12:23.889 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:23 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi103.zjztqc/mirror_snapshot_schedule"}]: dispatch 2024-09-18T21:12:23.889 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:23 smithi077 ceph-mon[27689]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi103.zjztqc/trash_purge_schedule"}]: dispatch 2024-09-18T21:12:23.889 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:23 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi103.zjztqc/trash_purge_schedule"}]: dispatch 2024-09-18T21:12:25.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:25 smithi077 ceph-mon[27689]: Checking for cert/key for grafana.smithi077 2024-09-18T21:12:25.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:25 smithi077 ceph-mon[27689]: Migrating grafana.smithi077 cert to cert store 2024-09-18T21:12:25.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:25 smithi077 ceph-mon[27689]: Migrating grafana.smithi077 key to cert store 2024-09-18T21:12:25.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:25 smithi077 ceph-mon[27689]: Deploying cephadm binary to smithi103 2024-09-18T21:12:25.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:25 smithi077 ceph-mon[27689]: Deploying cephadm binary to smithi077 2024-09-18T21:12:25.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:25 smithi077 ceph-mon[27689]: mgrmap e22: smithi103.zjztqc(active, since 1.00803s) 2024-09-18T21:12:25.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:25 smithi077 ceph-mon[27689]: pgmap v3: 65 pgs: 65 active+clean; 181 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:12:25.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:25 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:12:25.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:25 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:12:25.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:25 smithi103 ceph-mon[34827]: Checking for cert/key for grafana.smithi077 2024-09-18T21:12:25.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:25 smithi103 ceph-mon[34827]: Migrating grafana.smithi077 cert to cert store 2024-09-18T21:12:25.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:25 smithi103 ceph-mon[34827]: Migrating grafana.smithi077 key to cert store 2024-09-18T21:12:25.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:25 smithi103 ceph-mon[34827]: Deploying cephadm binary to smithi103 2024-09-18T21:12:25.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:25 smithi103 ceph-mon[34827]: Deploying cephadm binary to smithi077 2024-09-18T21:12:25.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:25 smithi103 ceph-mon[34827]: mgrmap e22: smithi103.zjztqc(active, since 1.00803s) 2024-09-18T21:12:25.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:25 smithi103 ceph-mon[34827]: pgmap v3: 65 pgs: 65 active+clean; 181 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:12:25.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:25 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:12:25.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:25 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:12:26.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:26 smithi077 ceph-mon[27689]: pgmap v4: 65 pgs: 65 active+clean; 181 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:12:26.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:26 smithi103 ceph-mon[34827]: pgmap v4: 65 pgs: 65 active+clean; 181 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:12:26.925 INFO:tasks.workunit.client.1.smithi103.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-18T21:12:26.930 INFO:tasks.workunit.client.1.smithi103.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-18T21:12:26.930 INFO:tasks.workunit.client.1.smithi103.stderr:+ make 2024-09-18T21:12:27.383 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:27 smithi077 ceph-mon[27689]: [18/Sep/2024:21:12:25] ENGINE Bus STARTING 2024-09-18T21:12:27.383 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:27 smithi077 ceph-mon[27689]: [18/Sep/2024:21:12:25] ENGINE Serving on https://172.21.15.103:7150 2024-09-18T21:12:27.383 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:27 smithi077 ceph-mon[27689]: [18/Sep/2024:21:12:25] ENGINE Error in HTTPServer.serve 2024-09-18T21:12:27.383 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Traceback (most recent call last): 2024-09-18T21:12:27.383 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-18T21:12:27.383 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: self._connections.run(self.expiration_interval) 2024-09-18T21:12:27.383 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-18T21:12:27.383 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: self._run(expiration_interval) 2024-09-18T21:12:27.384 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-18T21:12:27.384 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-18T21:12:27.384 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-18T21:12:27.384 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-18T21:12:27.384 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-18T21:12:27.384 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: s = self.context.wrap_socket( 2024-09-18T21:12:27.384 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-18T21:12:27.384 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: return self.sslsocket_class._create( 2024-09-18T21:12:27.384 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-18T21:12:27.384 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: self.do_handshake() 2024-09-18T21:12:27.384 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-18T21:12:27.384 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: self._sslobj.do_handshake() 2024-09-18T21:12:27.384 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-18T21:12:27.384 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:27 smithi077 ceph-mon[27689]: [18/Sep/2024:21:12:25] ENGINE Serving on http://172.21.15.103:8765 2024-09-18T21:12:27.385 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:27 smithi077 ceph-mon[27689]: [18/Sep/2024:21:12:25] ENGINE Bus STARTED 2024-09-18T21:12:27.385 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:27 smithi077 ceph-mon[27689]: mgrmap e23: smithi103.zjztqc(active, since 3s) 2024-09-18T21:12:27.644 INFO:tasks.workunit.client.1.smithi103.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-18T21:12:27.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:27 smithi103 ceph-mon[34827]: [18/Sep/2024:21:12:25] ENGINE Bus STARTING 2024-09-18T21:12:27.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:27 smithi103 ceph-mon[34827]: [18/Sep/2024:21:12:25] ENGINE Serving on https://172.21.15.103:7150 2024-09-18T21:12:27.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:27 smithi103 ceph-mon[34827]: [18/Sep/2024:21:12:25] ENGINE Error in HTTPServer.serve 2024-09-18T21:12:27.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Traceback (most recent call last): 2024-09-18T21:12:27.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-18T21:12:27.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: self._connections.run(self.expiration_interval) 2024-09-18T21:12:27.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-18T21:12:27.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: self._run(expiration_interval) 2024-09-18T21:12:27.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-18T21:12:27.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-18T21:12:27.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-18T21:12:27.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-18T21:12:27.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-18T21:12:27.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: s = self.context.wrap_socket( 2024-09-18T21:12:27.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-18T21:12:27.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: return self.sslsocket_class._create( 2024-09-18T21:12:27.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-18T21:12:27.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: self.do_handshake() 2024-09-18T21:12:27.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-18T21:12:27.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: self._sslobj.do_handshake() 2024-09-18T21:12:27.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-18T21:12:27.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:27 smithi103 ceph-mon[34827]: [18/Sep/2024:21:12:25] ENGINE Serving on http://172.21.15.103:8765 2024-09-18T21:12:27.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:27 smithi103 ceph-mon[34827]: [18/Sep/2024:21:12:25] ENGINE Bus STARTED 2024-09-18T21:12:27.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:27 smithi103 ceph-mon[34827]: mgrmap e23: smithi103.zjztqc(active, since 3s) 2024-09-18T21:12:28.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:28 smithi077 ceph-mon[27689]: pgmap v5: 65 pgs: 65 active+clean; 181 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:12:28.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:28 smithi103 ceph-mon[34827]: pgmap v5: 65 pgs: 65 active+clean; 181 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:12:29.339 INFO:tasks.workunit.client.1.smithi103.stderr:++ readlink -f fsstress 2024-09-18T21:12:29.341 INFO:tasks.workunit.client.1.smithi103.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-18T21:12:29.341 INFO:tasks.workunit.client.1.smithi103.stderr:+ popd 2024-09-18T21:12:29.343 INFO:tasks.workunit.client.1.smithi103.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-18T21:12:29.343 INFO:tasks.workunit.client.1.smithi103.stderr:+ popd 2024-09-18T21:12:29.343 INFO:tasks.workunit.client.1.smithi103.stdout:~/cephtest/mnt.1/client.1/tmp 2024-09-18T21:12:29.343 INFO:tasks.workunit.client.1.smithi103.stderr:++ mktemp -d -p . 2024-09-18T21:12:29.346 INFO:tasks.workunit.client.1.smithi103.stderr:+ T=./tmp.aJeDW0uknx 2024-09-18T21:12:29.346 INFO:tasks.workunit.client.1.smithi103.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.aJeDW0uknx -l 1 -n 1000 -p 10 -v 2024-09-18T21:12:29.351 INFO:tasks.workunit.client.1.smithi103.stdout:seed = 1726880880 2024-09-18T21:12:29.356 INFO:tasks.workunit.client.1.smithi103.stdout:0/0: rename - no filename 2024-09-18T21:12:29.356 INFO:tasks.workunit.client.1.smithi103.stdout:0/1: rename - no filename 2024-09-18T21:12:29.356 INFO:tasks.workunit.client.1.smithi103.stdout:0/2: truncate - no filename 2024-09-18T21:12:29.359 INFO:tasks.workunit.client.1.smithi103.stdout:0/3: symlink l0 0 2024-09-18T21:12:29.360 INFO:tasks.workunit.client.1.smithi103.stdout:2/0: dread - no filename 2024-09-18T21:12:29.362 INFO:tasks.workunit.client.1.smithi103.stdout:0/4: mkdir d1 0 2024-09-18T21:12:29.362 INFO:tasks.workunit.client.1.smithi103.stdout:0/5: dwrite - no filename 2024-09-18T21:12:29.362 INFO:tasks.workunit.client.1.smithi103.stdout:0/6: truncate - no filename 2024-09-18T21:12:29.363 INFO:tasks.workunit.client.1.smithi103.stdout:3/0: dread - no filename 2024-09-18T21:12:29.363 INFO:tasks.workunit.client.1.smithi103.stdout:3/1: truncate - no filename 2024-09-18T21:12:29.363 INFO:tasks.workunit.client.1.smithi103.stdout:3/2: dwrite - no filename 2024-09-18T21:12:29.363 INFO:tasks.workunit.client.1.smithi103.stdout:3/3: read - no filename 2024-09-18T21:12:29.363 INFO:tasks.workunit.client.1.smithi103.stdout:3/4: stat - no entries 2024-09-18T21:12:29.365 INFO:tasks.workunit.client.1.smithi103.stdout:1/0: mkdir d0 0 2024-09-18T21:12:29.365 INFO:tasks.workunit.client.1.smithi103.stdout:1/1: fdatasync - no filename 2024-09-18T21:12:29.366 INFO:tasks.workunit.client.1.smithi103.stdout:2/1: mknod c0 0 2024-09-18T21:12:29.367 INFO:tasks.workunit.client.1.smithi103.stdout:2/2: write - no filename 2024-09-18T21:12:29.367 INFO:tasks.workunit.client.1.smithi103.stdout:4/0: write - no filename 2024-09-18T21:12:29.369 INFO:tasks.workunit.client.1.smithi103.stdout:0/7: creat d1/f2 x:0 0 0 2024-09-18T21:12:29.370 INFO:tasks.workunit.client.1.smithi103.stdout:2/3: unlink c0 0 2024-09-18T21:12:29.370 INFO:tasks.workunit.client.1.smithi103.stdout:2/4: rmdir - no directory 2024-09-18T21:12:29.370 INFO:tasks.workunit.client.1.smithi103.stdout:2/5: fdatasync - no filename 2024-09-18T21:12:29.370 INFO:tasks.workunit.client.1.smithi103.stdout:2/6: dwrite - no filename 2024-09-18T21:12:29.373 INFO:tasks.workunit.client.1.smithi103.stdout:3/5: getdents . 0 2024-09-18T21:12:29.373 INFO:tasks.workunit.client.1.smithi103.stdout:3/6: dread - no filename 2024-09-18T21:12:29.373 INFO:tasks.workunit.client.1.smithi103.stdout:3/7: readlink - no filename 2024-09-18T21:12:29.374 INFO:tasks.workunit.client.1.smithi103.stdout:0/8: symlink d1/l3 0 2024-09-18T21:12:29.374 INFO:tasks.workunit.client.1.smithi103.stdout:0/9: stat d1 0 2024-09-18T21:12:29.374 INFO:tasks.workunit.client.1.smithi103.stdout:0/10: fdatasync d1/f2 0 2024-09-18T21:12:29.375 INFO:tasks.workunit.client.1.smithi103.stdout:2/7: mknod c1 0 2024-09-18T21:12:29.375 INFO:tasks.workunit.client.1.smithi103.stdout:2/8: dwrite - no filename 2024-09-18T21:12:29.375 INFO:tasks.workunit.client.1.smithi103.stdout:0/11: dread - d1/f2 zero size 2024-09-18T21:12:29.376 INFO:tasks.workunit.client.1.smithi103.stdout:6/0: truncate - no filename 2024-09-18T21:12:29.376 INFO:tasks.workunit.client.1.smithi103.stdout:6/1: chown . 171287 1 2024-09-18T21:12:29.376 INFO:tasks.workunit.client.1.smithi103.stdout:6/2: rmdir - no directory 2024-09-18T21:12:29.376 INFO:tasks.workunit.client.1.smithi103.stdout:6/3: write - no filename 2024-09-18T21:12:29.383 INFO:tasks.workunit.client.1.smithi103.stdout:4/1: creat f0 x:0 0 0 2024-09-18T21:12:29.384 INFO:tasks.workunit.client.1.smithi103.stdout:2/9: rename c1 to c2 0 2024-09-18T21:12:29.384 INFO:tasks.workunit.client.1.smithi103.stdout:0/12: creat d1/f4 x:0 0 0 2024-09-18T21:12:29.385 INFO:tasks.workunit.client.1.smithi103.stdout:7/0: dwrite - no filename 2024-09-18T21:12:29.385 INFO:tasks.workunit.client.1.smithi103.stdout:7/1: write - no filename 2024-09-18T21:12:29.385 INFO:tasks.workunit.client.1.smithi103.stdout:7/2: rmdir - no directory 2024-09-18T21:12:29.386 INFO:tasks.workunit.client.1.smithi103.stdout:7/3: truncate - no filename 2024-09-18T21:12:29.386 INFO:tasks.workunit.client.1.smithi103.stdout:7/4: truncate - no filename 2024-09-18T21:12:29.386 INFO:tasks.workunit.client.1.smithi103.stdout:7/5: write - no filename 2024-09-18T21:12:29.386 INFO:tasks.workunit.client.1.smithi103.stdout:7/6: dwrite - no filename 2024-09-18T21:12:29.386 INFO:tasks.workunit.client.1.smithi103.stdout:7/7: rename - no filename 2024-09-18T21:12:29.386 INFO:tasks.workunit.client.1.smithi103.stdout:7/8: rmdir - no directory 2024-09-18T21:12:29.386 INFO:tasks.workunit.client.1.smithi103.stdout:7/9: dread - no filename 2024-09-18T21:12:29.392 INFO:tasks.workunit.client.1.smithi103.stdout:0/13: dwrite d1/f4 [0,4194304] 0 2024-09-18T21:12:29.393 INFO:tasks.workunit.client.1.smithi103.stdout:0/14: chown l0 11365593 1 2024-09-18T21:12:29.393 INFO:tasks.workunit.client.1.smithi103.stdout:0/15: fdatasync d1/f2 0 2024-09-18T21:12:29.394 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:29 smithi077 ceph-mon[27689]: Standby manager daemon smithi077.utkpjg started 2024-09-18T21:12:29.394 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:29 smithi077 ceph-mon[27689]: from='mgr.? 172.21.15.77:0/2358004800' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi077.utkpjg/crt"}]: dispatch 2024-09-18T21:12:29.394 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:29 smithi077 ceph-mon[27689]: from='mgr.? 172.21.15.77:0/2358004800' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T21:12:29.394 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:29 smithi077 ceph-mon[27689]: from='mgr.? 172.21.15.77:0/2358004800' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi077.utkpjg/key"}]: dispatch 2024-09-18T21:12:29.397 INFO:tasks.workunit.client.1.smithi103.stdout:0/16: dread d1/f4 [0,4194304] 0 2024-09-18T21:12:29.682 INFO:tasks.workunit.client.1.smithi103.stdout:3/8: symlink l0 0 2024-09-18T21:12:29.683 INFO:tasks.workunit.client.1.smithi103.stdout:3/9: truncate - no filename 2024-09-18T21:12:29.686 INFO:tasks.workunit.client.1.smithi103.stdout:4/2: rename f0 to f1 0 2024-09-18T21:12:29.686 INFO:tasks.workunit.client.1.smithi103.stdout:6/4: getdents . 0 2024-09-18T21:12:29.686 INFO:tasks.workunit.client.1.smithi103.stdout:6/5: dread - no filename 2024-09-18T21:12:29.686 INFO:tasks.workunit.client.1.smithi103.stdout:6/6: rmdir - no directory 2024-09-18T21:12:29.686 INFO:tasks.workunit.client.1.smithi103.stdout:6/7: dwrite - no filename 2024-09-18T21:12:29.688 INFO:tasks.workunit.client.1.smithi103.stdout:8/0: write - no filename 2024-09-18T21:12:29.688 INFO:tasks.workunit.client.1.smithi103.stdout:8/1: dread - no filename 2024-09-18T21:12:29.692 INFO:tasks.workunit.client.1.smithi103.stdout:3/10: mkdir d1 0 2024-09-18T21:12:29.692 INFO:tasks.workunit.client.1.smithi103.stdout:3/11: dwrite - no filename 2024-09-18T21:12:29.693 INFO:tasks.workunit.client.1.smithi103.stdout:3/12: dwrite - no filename 2024-09-18T21:12:29.693 INFO:tasks.workunit.client.1.smithi103.stdout:3/13: write - no filename 2024-09-18T21:12:29.696 INFO:tasks.workunit.client.1.smithi103.stdout:7/10: symlink l0 0 2024-09-18T21:12:29.697 INFO:tasks.workunit.client.1.smithi103.stdout:9/0: stat - no entries 2024-09-18T21:12:29.697 INFO:tasks.workunit.client.1.smithi103.stdout:9/1: dwrite - no filename 2024-09-18T21:12:29.697 INFO:tasks.workunit.client.1.smithi103.stdout:9/2: fsync - no filename 2024-09-18T21:12:29.700 INFO:tasks.workunit.client.1.smithi103.stdout:6/8: creat f0 x:0 0 0 2024-09-18T21:12:29.700 INFO:tasks.workunit.client.1.smithi103.stdout:4/3: dwrite f1 [0,4194304] 0 2024-09-18T21:12:29.702 INFO:tasks.workunit.client.1.smithi103.stdout:7/11: mkdir d1 0 2024-09-18T21:12:29.702 INFO:tasks.workunit.client.1.smithi103.stdout:7/12: dwrite - no filename 2024-09-18T21:12:29.705 INFO:tasks.workunit.client.1.smithi103.stdout:8/2: mknod c0 0 2024-09-18T21:12:29.706 INFO:tasks.workunit.client.1.smithi103.stdout:3/14: mkdir d1/d2 0 2024-09-18T21:12:29.706 INFO:tasks.workunit.client.1.smithi103.stdout:3/15: write - no filename 2024-09-18T21:12:29.709 INFO:tasks.workunit.client.1.smithi103.stdout:6/9: dwrite f0 [0,4194304] 0 2024-09-18T21:12:29.710 INFO:tasks.workunit.client.1.smithi103.stdout:6/10: write f0 [568352,106014] 0 2024-09-18T21:12:29.711 INFO:tasks.workunit.client.1.smithi103.stdout:9/3: creat f0 x:0 0 0 2024-09-18T21:12:29.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:29 smithi077 ceph-mon[27689]: from='mgr.? 172.21.15.77:0/2358004800' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T21:12:29.713 INFO:tasks.workunit.client.1.smithi103.stdout:8/3: creat f1 x:0 0 0 2024-09-18T21:12:29.714 INFO:tasks.workunit.client.1.smithi103.stdout:3/16: symlink d1/l3 0 2024-09-18T21:12:29.714 INFO:tasks.workunit.client.1.smithi103.stdout:3/17: fdatasync - no filename 2024-09-18T21:12:29.715 INFO:tasks.workunit.client.1.smithi103.stdout:3/18: chown d1/d2 94977 1 2024-09-18T21:12:29.724 INFO:tasks.workunit.client.1.smithi103.stdout:8/4: creat f2 x:0 0 0 2024-09-18T21:12:29.725 INFO:tasks.workunit.client.1.smithi103.stdout:3/19: symlink d1/l4 0 2024-09-18T21:12:29.725 INFO:tasks.workunit.client.1.smithi103.stdout:7/13: link l0 d1/l2 0 2024-09-18T21:12:29.727 INFO:tasks.workunit.client.1.smithi103.stdout:6/11: link f0 f1 0 2024-09-18T21:12:29.728 INFO:tasks.workunit.client.1.smithi103.stdout:9/4: link f0 f1 0 2024-09-18T21:12:29.729 INFO:tasks.workunit.client.1.smithi103.stdout:9/5: read - f1 zero size 2024-09-18T21:12:29.730 INFO:tasks.workunit.client.1.smithi103.stdout:8/5: symlink l3 0 2024-09-18T21:12:29.730 INFO:tasks.workunit.client.1.smithi103.stdout:8/6: fdatasync f1 0 2024-09-18T21:12:29.734 INFO:tasks.workunit.client.1.smithi103.stdout:6/12: mkdir d2 0 2024-09-18T21:12:29.737 INFO:tasks.workunit.client.1.smithi103.stdout:9/6: symlink l2 0 2024-09-18T21:12:29.739 INFO:tasks.workunit.client.1.smithi103.stdout:8/7: mkdir d4 0 2024-09-18T21:12:29.740 INFO:tasks.workunit.client.1.smithi103.stdout:8/8: write f1 [623868,95501] 0 2024-09-18T21:12:29.740 INFO:tasks.workunit.client.1.smithi103.stdout:3/20: creat d1/d2/f5 x:0 0 0 2024-09-18T21:12:29.740 INFO:tasks.workunit.client.1.smithi103.stdout:8/9: stat f1 0 2024-09-18T21:12:29.741 INFO:tasks.workunit.client.1.smithi103.stdout:7/14: rename d1/l2 to d1/l3 0 2024-09-18T21:12:29.743 INFO:tasks.workunit.client.1.smithi103.stdout:6/13: unlink f1 0 2024-09-18T21:12:29.745 INFO:tasks.workunit.client.1.smithi103.stdout:3/21: mknod d1/c6 0 2024-09-18T21:12:29.745 INFO:tasks.workunit.client.1.smithi103.stdout:3/22: truncate d1/d2/f5 1015867 0 2024-09-18T21:12:29.747 INFO:tasks.workunit.client.1.smithi103.stdout:7/15: mknod d1/c4 0 2024-09-18T21:12:29.750 INFO:tasks.workunit.client.1.smithi103.stdout:3/23: symlink d1/d2/l7 0 2024-09-18T21:12:29.751 INFO:tasks.workunit.client.1.smithi103.stdout:8/10: mknod d4/c5 0 2024-09-18T21:12:29.752 INFO:tasks.workunit.client.1.smithi103.stdout:7/16: symlink d1/l5 0 2024-09-18T21:12:29.752 INFO:tasks.workunit.client.1.smithi103.stdout:7/17: truncate - no filename 2024-09-18T21:12:29.752 INFO:tasks.workunit.client.1.smithi103.stdout:7/18: fdatasync - no filename 2024-09-18T21:12:29.752 INFO:tasks.workunit.client.1.smithi103.stdout:7/19: dwrite - no filename 2024-09-18T21:12:29.753 INFO:tasks.workunit.client.1.smithi103.stdout:6/14: mkdir d2/d3 0 2024-09-18T21:12:29.755 INFO:tasks.workunit.client.1.smithi103.stdout:3/24: creat d1/d2/f8 x:0 0 0 2024-09-18T21:12:29.756 INFO:tasks.workunit.client.1.smithi103.stdout:8/11: mkdir d4/d6 0 2024-09-18T21:12:29.759 INFO:tasks.workunit.client.1.smithi103.stdout:3/25: creat d1/f9 x:0 0 0 2024-09-18T21:12:29.760 INFO:tasks.workunit.client.1.smithi103.stdout:8/12: rename l3 to d4/d6/l7 0 2024-09-18T21:12:29.761 INFO:tasks.workunit.client.1.smithi103.stdout:6/15: getdents d2/d3 0 2024-09-18T21:12:29.763 INFO:tasks.workunit.client.1.smithi103.stdout:3/26: mkdir d1/da 0 2024-09-18T21:12:29.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:29 smithi103 ceph-mon[34827]: Standby manager daemon smithi077.utkpjg started 2024-09-18T21:12:29.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:29 smithi103 ceph-mon[34827]: from='mgr.? 172.21.15.77:0/2358004800' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi077.utkpjg/crt"}]: dispatch 2024-09-18T21:12:29.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:29 smithi103 ceph-mon[34827]: from='mgr.? 172.21.15.77:0/2358004800' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T21:12:29.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:29 smithi103 ceph-mon[34827]: from='mgr.? 172.21.15.77:0/2358004800' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi077.utkpjg/key"}]: dispatch 2024-09-18T21:12:29.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:29 smithi103 ceph-mon[34827]: from='mgr.? 172.21.15.77:0/2358004800' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T21:12:29.764 INFO:tasks.workunit.client.1.smithi103.stdout:8/13: rename f1 to d4/d6/f8 0 2024-09-18T21:12:29.765 INFO:tasks.workunit.client.1.smithi103.stdout:6/16: stat f0 0 2024-09-18T21:12:29.765 INFO:tasks.workunit.client.1.smithi103.stdout:6/17: read f0 [2088958,128584] 0 2024-09-18T21:12:29.767 INFO:tasks.workunit.client.1.smithi103.stdout:3/27: rename d1/d2/f5 to d1/d2/fb 0 2024-09-18T21:12:29.768 INFO:tasks.workunit.client.1.smithi103.stdout:8/14: symlink d4/l9 0 2024-09-18T21:12:29.771 INFO:tasks.workunit.client.1.smithi103.stdout:8/15: rename d4/c5 to d4/d6/ca 0 2024-09-18T21:12:29.772 INFO:tasks.workunit.client.1.smithi103.stdout:6/18: mkdir d2/d3/d4 0 2024-09-18T21:12:29.774 INFO:tasks.workunit.client.1.smithi103.stdout:8/16: creat d4/d6/fb x:0 0 0 2024-09-18T21:12:29.775 INFO:tasks.workunit.client.1.smithi103.stdout:8/17: dread - d4/d6/fb zero size 2024-09-18T21:12:29.776 INFO:tasks.workunit.client.1.smithi103.stdout:6/19: mkdir d2/d3/d5 0 2024-09-18T21:12:29.777 INFO:tasks.workunit.client.1.smithi103.stdout:8/18: mkdir d4/d6/dc 0 2024-09-18T21:12:29.778 INFO:tasks.workunit.client.1.smithi103.stdout:6/20: unlink f0 0 2024-09-18T21:12:29.778 INFO:tasks.workunit.client.1.smithi103.stdout:6/21: dread - no filename 2024-09-18T21:12:29.780 INFO:tasks.workunit.client.1.smithi103.stdout:8/19: mknod d4/d6/dc/cd 0 2024-09-18T21:12:29.784 INFO:tasks.workunit.client.1.smithi103.stdout:6/22: rmdir d2/d3/d5 0 2024-09-18T21:12:29.786 INFO:tasks.workunit.client.1.smithi103.stdout:6/23: creat d2/f6 x:0 0 0 2024-09-18T21:12:29.786 INFO:tasks.workunit.client.1.smithi103.stdout:6/24: fdatasync d2/f6 0 2024-09-18T21:12:29.788 INFO:tasks.workunit.client.1.smithi103.stdout:6/25: symlink d2/d3/l7 0 2024-09-18T21:12:29.794 INFO:tasks.workunit.client.1.smithi103.stdout:6/26: dwrite d2/f6 [0,4194304] 0 2024-09-18T21:12:29.923 INFO:tasks.workunit.client.1.smithi103.stdout:6/27: rmdir d2/d3 39 2024-09-18T21:12:30.074 INFO:tasks.workunit.client.1.smithi103.stdout:0/17: rmdir d1 39 2024-09-18T21:12:30.075 INFO:tasks.workunit.client.1.smithi103.stdout:2/10: chown c2 54 1 2024-09-18T21:12:30.075 INFO:tasks.workunit.client.1.smithi103.stdout:2/11: chown c2 64526 1 2024-09-18T21:12:30.077 INFO:tasks.workunit.client.1.smithi103.stdout:0/18: unlink l0 0 2024-09-18T21:12:30.079 INFO:tasks.workunit.client.1.smithi103.stdout:2/12: mkdir d3 0 2024-09-18T21:12:30.079 INFO:tasks.workunit.client.1.smithi103.stdout:2/13: read - no filename 2024-09-18T21:12:30.079 INFO:tasks.workunit.client.1.smithi103.stdout:2/14: chown c2 315 1 2024-09-18T21:12:30.083 INFO:tasks.workunit.client.1.smithi103.stdout:2/15: symlink d3/l4 0 2024-09-18T21:12:30.087 INFO:tasks.workunit.client.1.smithi103.stdout:0/19: getdents d1 0 2024-09-18T21:12:30.087 INFO:tasks.workunit.client.1.smithi103.stdout:0/20: dread - d1/f2 zero size 2024-09-18T21:12:30.091 INFO:tasks.workunit.client.1.smithi103.stdout:0/21: dread d1/f4 [0,4194304] 0 2024-09-18T21:12:30.098 INFO:tasks.workunit.client.1.smithi103.stdout:0/22: dwrite d1/f2 [0,4194304] 0 2024-09-18T21:12:30.102 INFO:tasks.workunit.client.1.smithi103.stdout:0/23: mkdir d1/d5 0 2024-09-18T21:12:30.106 INFO:tasks.workunit.client.1.smithi103.stdout:0/24: creat d1/d5/f6 x:0 0 0 2024-09-18T21:12:30.109 INFO:tasks.workunit.client.1.smithi103.stdout:0/25: symlink d1/d5/l7 0 2024-09-18T21:12:30.117 INFO:tasks.workunit.client.1.smithi103.stdout:0/26: dwrite d1/f4 [0,4194304] 0 2024-09-18T21:12:30.186 INFO:tasks.workunit.client.1.smithi103.stdout:4/4: rename f1 to f2 0 2024-09-18T21:12:30.187 INFO:tasks.workunit.client.1.smithi103.stdout:4/5: write f2 [2045962,15623] 0 2024-09-18T21:12:30.251 INFO:tasks.workunit.client.1.smithi103.stdout:4/6: link f2 f3 0 2024-09-18T21:12:30.253 INFO:tasks.workunit.client.1.smithi103.stdout:4/7: mknod c4 0 2024-09-18T21:12:30.255 INFO:tasks.workunit.client.1.smithi103.stdout:4/8: creat f5 x:0 0 0 2024-09-18T21:12:30.256 INFO:tasks.workunit.client.1.smithi103.stdout:4/9: creat f6 x:0 0 0 2024-09-18T21:12:30.258 INFO:tasks.workunit.client.1.smithi103.stdout:4/10: rename c4 to c7 0 2024-09-18T21:12:30.258 INFO:tasks.workunit.client.1.smithi103.stdout:4/11: readlink - no filename 2024-09-18T21:12:30.259 INFO:tasks.workunit.client.1.smithi103.stdout:4/12: creat f8 x:0 0 0 2024-09-18T21:12:30.262 INFO:tasks.workunit.client.1.smithi103.stdout:4/13: dread f2 [0,4194304] 0 2024-09-18T21:12:30.263 INFO:tasks.workunit.client.1.smithi103.stdout:4/14: chown f6 1828256 1 2024-09-18T21:12:30.263 INFO:tasks.workunit.client.1.smithi103.stdout:4/15: chown f5 7756378 1 2024-09-18T21:12:30.263 INFO:tasks.workunit.client.1.smithi103.stdout:4/16: dread - f6 zero size 2024-09-18T21:12:30.265 INFO:tasks.workunit.client.1.smithi103.stdout:4/17: mkdir d9 0 2024-09-18T21:12:30.269 INFO:tasks.workunit.client.1.smithi103.stdout:4/18: dread f3 [0,4194304] 0 2024-09-18T21:12:30.271 INFO:tasks.workunit.client.1.smithi103.stdout:4/19: creat d9/fa x:0 0 0 2024-09-18T21:12:30.272 INFO:tasks.workunit.client.1.smithi103.stdout:4/20: dread - d9/fa zero size 2024-09-18T21:12:30.272 INFO:tasks.workunit.client.1.smithi103.stdout:9/7: getdents . 0 2024-09-18T21:12:30.274 INFO:tasks.workunit.client.1.smithi103.stdout:9/8: symlink l3 0 2024-09-18T21:12:30.275 INFO:tasks.workunit.client.1.smithi103.stdout:4/21: dread f3 [0,4194304] 0 2024-09-18T21:12:30.276 INFO:tasks.workunit.client.1.smithi103.stdout:4/22: read - d9/fa zero size 2024-09-18T21:12:30.282 INFO:tasks.workunit.client.1.smithi103.stdout:7/20: link d1/l3 d1/l6 0 2024-09-18T21:12:30.283 INFO:tasks.workunit.client.1.smithi103.stdout:4/23: dwrite f5 [0,4194304] 0 2024-09-18T21:12:30.284 INFO:tasks.workunit.client.1.smithi103.stdout:6/28: stat d2/d3/l7 0 2024-09-18T21:12:30.285 INFO:tasks.workunit.client.1.smithi103.stdout:7/21: creat d1/f7 x:0 0 0 2024-09-18T21:12:30.287 INFO:tasks.workunit.client.1.smithi103.stdout:6/29: mkdir d2/d3/d8 0 2024-09-18T21:12:30.290 INFO:tasks.workunit.client.1.smithi103.stdout:7/22: unlink d1/l5 0 2024-09-18T21:12:30.291 INFO:tasks.workunit.client.1.smithi103.stdout:6/30: creat d2/d3/f9 x:0 0 0 2024-09-18T21:12:30.293 INFO:tasks.workunit.client.1.smithi103.stdout:6/31: write d2/f6 [2613955,130429] 0 2024-09-18T21:12:30.298 INFO:tasks.workunit.client.1.smithi103.stdout:7/23: dwrite d1/f7 [0,4194304] 0 2024-09-18T21:12:30.299 INFO:tasks.workunit.client.1.smithi103.stdout:6/32: fdatasync d2/f6 0 2024-09-18T21:12:30.306 INFO:tasks.workunit.client.1.smithi103.stdout:7/24: link l0 d1/l8 0 2024-09-18T21:12:30.310 INFO:tasks.workunit.client.1.smithi103.stdout:8/20: rename d4/d6/dc to d4/de 0 2024-09-18T21:12:30.311 INFO:tasks.workunit.client.1.smithi103.stdout:8/21: chown d4/d6 23479689 1 2024-09-18T21:12:30.312 INFO:tasks.workunit.client.1.smithi103.stdout:7/25: dwrite d1/f7 [0,4194304] 0 2024-09-18T21:12:30.313 INFO:tasks.workunit.client.1.smithi103.stdout:0/27: rename d1/f2 to d1/d5/f8 0 2024-09-18T21:12:30.318 INFO:tasks.workunit.client.1.smithi103.stdout:7/26: symlink d1/l9 0 2024-09-18T21:12:30.320 INFO:tasks.workunit.client.1.smithi103.stdout:8/22: dwrite f2 [0,4194304] 0 2024-09-18T21:12:30.321 INFO:tasks.workunit.client.1.smithi103.stdout:0/28: mkdir d1/d9 0 2024-09-18T21:12:30.326 INFO:tasks.workunit.client.1.smithi103.stdout:7/27: stat l0 0 2024-09-18T21:12:30.328 INFO:tasks.workunit.client.1.smithi103.stdout:8/23: dwrite d4/d6/fb [0,4194304] 0 2024-09-18T21:12:30.333 INFO:tasks.workunit.client.1.smithi103.stdout:8/24: creat d4/ff x:0 0 0 2024-09-18T21:12:30.333 INFO:tasks.workunit.client.1.smithi103.stdout:8/25: chown d4/l9 365523 1 2024-09-18T21:12:30.335 INFO:tasks.workunit.client.1.smithi103.stdout:8/26: readlink d4/d6/l7 0 2024-09-18T21:12:30.444 INFO:tasks.workunit.client.1.smithi103.stdout:4/24: rename f2 to d9/fb 0 2024-09-18T21:12:30.444 INFO:tasks.workunit.client.1.smithi103.stdout:8/27: rename d4 to d4/d6/d10 22 2024-09-18T21:12:30.444 INFO:tasks.workunit.client.1.smithi103.stdout:4/25: stat f5 0 2024-09-18T21:12:30.444 INFO:tasks.workunit.client.1.smithi103.stdout:4/26: readlink - no filename 2024-09-18T21:12:30.445 INFO:tasks.workunit.client.1.smithi103.stdout:8/28: stat d4/d6/f8 0 2024-09-18T21:12:30.449 INFO:tasks.workunit.client.1.smithi103.stdout:4/27: dwrite f8 [0,4194304] 0 2024-09-18T21:12:30.470 INFO:tasks.workunit.client.1.smithi103.stdout:9/9: dwrite f1 [0,4194304] 0 2024-09-18T21:12:30.471 INFO:tasks.workunit.client.1.smithi103.stdout:6/33: fsync d2/d3/f9 0 2024-09-18T21:12:30.477 INFO:tasks.workunit.client.1.smithi103.stdout:9/10: dread f1 [0,4194304] 0 2024-09-18T21:12:30.478 INFO:tasks.workunit.client.1.smithi103.stdout:9/11: read f0 [2780348,44575] 0 2024-09-18T21:12:30.480 INFO:tasks.workunit.client.1.smithi103.stdout:7/28: dwrite d1/f7 [4194304,4194304] 0 2024-09-18T21:12:30.487 INFO:tasks.workunit.client.1.smithi103.stdout:0/29: truncate d1/d5/f8 220395 0 2024-09-18T21:12:30.701 INFO:tasks.workunit.client.1.smithi103.stdout:4/28: write f3 [2702108,79107] 0 2024-09-18T21:12:30.703 INFO:tasks.workunit.client.1.smithi103.stdout:9/12: unlink l2 0 2024-09-18T21:12:30.705 INFO:tasks.workunit.client.1.smithi103.stdout:4/29: dread d9/fb [0,4194304] 0 2024-09-18T21:12:30.707 INFO:tasks.workunit.client.1.smithi103.stdout:6/34: mknod d2/d3/d8/ca 0 2024-09-18T21:12:30.707 INFO:tasks.workunit.client.1.smithi103.stdout:8/29: rmdir d4 39 2024-09-18T21:12:30.708 INFO:tasks.workunit.client.1.smithi103.stdout:6/35: chown d2/f6 35309791 1 2024-09-18T21:12:30.708 INFO:tasks.workunit.client.1.smithi103.stdout:6/36: fdatasync d2/d3/f9 0 2024-09-18T21:12:30.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:30 smithi077 ceph-mon[27689]: pgmap v6: 65 pgs: 65 active+clean; 193 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.6 MiB/s wr, 174 op/s 2024-09-18T21:12:30.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:30 smithi077 ceph-mon[27689]: mgrmap e24: smithi103.zjztqc(active, since 6s), standbys: smithi077.utkpjg 2024-09-18T21:12:30.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:30 smithi077 ceph-mon[27689]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "mgr metadata", "who": "smithi077.utkpjg", "id": "smithi077.utkpjg"}]: dispatch 2024-09-18T21:12:30.713 INFO:tasks.workunit.client.1.smithi103.stdout:4/30: write d9/fb [4694858,34432] 0 2024-09-18T21:12:30.713 INFO:tasks.workunit.client.1.smithi103.stdout:8/30: fsync d4/ff 0 2024-09-18T21:12:30.716 INFO:tasks.workunit.client.1.smithi103.stdout:8/31: creat d4/de/f11 x:0 0 0 2024-09-18T21:12:30.718 INFO:tasks.workunit.client.1.smithi103.stdout:6/37: creat d2/fb x:0 0 0 2024-09-18T21:12:30.720 INFO:tasks.workunit.client.1.smithi103.stdout:8/32: symlink d4/de/l12 0 2024-09-18T21:12:30.720 INFO:tasks.workunit.client.1.smithi103.stdout:4/31: dwrite d9/fa [0,4194304] 0 2024-09-18T21:12:30.721 INFO:tasks.workunit.client.1.smithi103.stdout:8/33: chown d4/d6/l7 392841 1 2024-09-18T21:12:30.721 INFO:tasks.workunit.client.1.smithi103.stdout:4/32: write d9/fa [2114281,32977] 0 2024-09-18T21:12:30.721 INFO:tasks.workunit.client.1.smithi103.stdout:8/34: fsync f2 0 2024-09-18T21:12:30.722 INFO:tasks.workunit.client.1.smithi103.stdout:6/38: mknod d2/d3/d8/cc 0 2024-09-18T21:12:30.726 INFO:tasks.workunit.client.1.smithi103.stdout:8/35: dread f2 [0,4194304] 0 2024-09-18T21:12:30.727 INFO:tasks.workunit.client.1.smithi103.stdout:6/39: dread d2/f6 [0,4194304] 0 2024-09-18T21:12:30.728 INFO:tasks.workunit.client.1.smithi103.stdout:6/40: write d2/fb [826890,48907] 0 2024-09-18T21:12:30.730 INFO:tasks.workunit.client.1.smithi103.stdout:8/36: symlink d4/de/l13 0 2024-09-18T21:12:30.732 INFO:tasks.workunit.client.1.smithi103.stdout:6/41: mknod d2/d3/d4/cd 0 2024-09-18T21:12:30.733 INFO:tasks.workunit.client.1.smithi103.stdout:8/37: dread f2 [0,4194304] 0 2024-09-18T21:12:30.734 INFO:tasks.workunit.client.1.smithi103.stdout:6/42: symlink d2/le 0 2024-09-18T21:12:30.737 INFO:tasks.workunit.client.1.smithi103.stdout:8/38: dread d4/d6/fb [0,4194304] 0 2024-09-18T21:12:30.739 INFO:tasks.workunit.client.1.smithi103.stdout:6/43: truncate d2/f6 3332554 0 2024-09-18T21:12:30.741 INFO:tasks.workunit.client.1.smithi103.stdout:8/39: dread d4/d6/f8 [0,4194304] 0 2024-09-18T21:12:30.742 INFO:tasks.workunit.client.1.smithi103.stdout:8/40: creat d4/de/f14 x:0 0 0 2024-09-18T21:12:30.745 INFO:tasks.workunit.client.1.smithi103.stdout:8/41: mknod d4/d6/c15 0 2024-09-18T21:12:30.748 INFO:tasks.workunit.client.1.smithi103.stdout:8/42: rename d4/de/f14 to d4/de/f16 0 2024-09-18T21:12:30.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:30 smithi103 ceph-mon[34827]: pgmap v6: 65 pgs: 65 active+clean; 193 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.6 MiB/s wr, 174 op/s 2024-09-18T21:12:30.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:30 smithi103 ceph-mon[34827]: mgrmap e24: smithi103.zjztqc(active, since 6s), standbys: smithi077.utkpjg 2024-09-18T21:12:30.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:30 smithi103 ceph-mon[34827]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "mgr metadata", "who": "smithi077.utkpjg", "id": "smithi077.utkpjg"}]: dispatch 2024-09-18T21:12:30.778 INFO:tasks.workunit.client.1.smithi103.stdout:0/30: dread d1/d5/f8 [0,4194304] 0 2024-09-18T21:12:30.784 INFO:tasks.workunit.client.1.smithi103.stdout:0/31: dwrite d1/d5/f6 [0,4194304] 0 2024-09-18T21:12:30.785 INFO:tasks.workunit.client.1.smithi103.stdout:0/32: chown d1/d5 19585967 1 2024-09-18T21:12:30.792 INFO:tasks.workunit.client.1.smithi103.stdout:0/33: dwrite d1/f4 [0,4194304] 0 2024-09-18T21:12:30.797 INFO:tasks.workunit.client.1.smithi103.stdout:0/34: link d1/d5/f6 d1/fa 0 2024-09-18T21:12:30.925 INFO:tasks.workunit.client.1.smithi103.stdout:9/13: truncate f1 1507920 0 2024-09-18T21:12:30.935 INFO:tasks.workunit.client.1.smithi103.stdout:6/44: getdents d2/d3/d4 0 2024-09-18T21:12:30.937 INFO:tasks.workunit.client.1.smithi103.stdout:6/45: mkdir d2/d3/d8/df 0 2024-09-18T21:12:30.954 INFO:tasks.workunit.client.1.smithi103.stdout:0/35: truncate d1/d5/f6 3601012 0 2024-09-18T21:12:30.969 INFO:tasks.workunit.client.1.smithi103.stdout:6/46: rmdir d2 39 2024-09-18T21:12:30.970 INFO:tasks.workunit.client.1.smithi103.stdout:6/47: fsync d2/d3/f9 0 2024-09-18T21:12:30.971 INFO:tasks.workunit.client.1.smithi103.stdout:6/48: write d2/d3/f9 [500275,68706] 0 2024-09-18T21:12:30.973 INFO:tasks.workunit.client.1.smithi103.stdout:6/49: creat d2/d3/d8/f10 x:0 0 0 2024-09-18T21:12:30.976 INFO:tasks.workunit.client.1.smithi103.stdout:6/50: creat d2/d3/d8/df/f11 x:0 0 0 2024-09-18T21:12:30.977 INFO:tasks.workunit.client.1.smithi103.stdout:0/36: write d1/d5/f8 [209599,44251] 0 2024-09-18T21:12:30.998 INFO:tasks.workunit.client.1.smithi103.stdout:6/51: creat d2/f12 x:0 0 0 2024-09-18T21:12:30.998 INFO:tasks.workunit.client.1.smithi103.stdout:9/14: write f0 [2439006,44365] 0 2024-09-18T21:12:31.000 INFO:tasks.workunit.client.1.smithi103.stdout:9/15: creat f4 x:0 0 0 2024-09-18T21:12:31.002 INFO:tasks.workunit.client.1.smithi103.stdout:0/37: getdents d1/d5 0 2024-09-18T21:12:31.003 INFO:tasks.workunit.client.1.smithi103.stdout:9/16: creat f5 x:0 0 0 2024-09-18T21:12:31.004 INFO:tasks.workunit.client.1.smithi103.stdout:9/17: dread - f5 zero size 2024-09-18T21:12:31.005 INFO:tasks.workunit.client.1.smithi103.stdout:0/38: mknod d1/d5/cb 0 2024-09-18T21:12:31.009 INFO:tasks.workunit.client.1.smithi103.stdout:6/52: rename d2/f6 to d2/f13 0 2024-09-18T21:12:31.012 INFO:tasks.workunit.client.1.smithi103.stdout:0/39: link d1/d5/f6 d1/d5/fc 0 2024-09-18T21:12:31.015 INFO:tasks.workunit.client.1.smithi103.stdout:0/40: write d1/fa [367782,121263] 0 2024-09-18T21:12:31.016 INFO:tasks.workunit.client.1.smithi103.stdout:9/18: fsync f4 0 2024-09-18T21:12:31.019 INFO:tasks.workunit.client.1.smithi103.stdout:0/41: creat d1/fd x:0 0 0 2024-09-18T21:12:31.019 INFO:tasks.workunit.client.1.smithi103.stdout:9/19: dread f0 [0,4194304] 0 2024-09-18T21:12:31.019 INFO:tasks.workunit.client.1.smithi103.stdout:9/20: rmdir - no directory 2024-09-18T21:12:31.022 INFO:tasks.workunit.client.1.smithi103.stdout:0/42: mkdir d1/d5/de 0 2024-09-18T21:12:31.025 INFO:tasks.workunit.client.1.smithi103.stdout:9/21: dwrite f4 [0,4194304] 0 2024-09-18T21:12:31.025 INFO:tasks.workunit.client.1.smithi103.stdout:9/22: dread - f5 zero size 2024-09-18T21:12:31.027 INFO:tasks.workunit.client.1.smithi103.stdout:0/43: rmdir d1/d5 39 2024-09-18T21:12:31.030 INFO:tasks.workunit.client.1.smithi103.stdout:9/23: symlink l6 0 2024-09-18T21:12:31.033 INFO:tasks.workunit.client.1.smithi103.stdout:6/53: write d2/f13 [696947,116975] 0 2024-09-18T21:12:31.036 INFO:tasks.workunit.client.1.smithi103.stdout:6/54: rename d2/d3/d4 to d2/d3/d4/d14 22 2024-09-18T21:12:31.038 INFO:tasks.workunit.client.1.smithi103.stdout:0/44: dwrite d1/d5/f6 [0,4194304] 0 2024-09-18T21:12:31.038 INFO:tasks.workunit.client.1.smithi103.stdout:6/55: creat d2/d3/d4/f15 x:0 0 0 2024-09-18T21:12:31.039 INFO:tasks.workunit.client.1.smithi103.stdout:6/56: dread - d2/f12 zero size 2024-09-18T21:12:31.040 INFO:tasks.workunit.client.1.smithi103.stdout:6/57: fdatasync d2/d3/d8/df/f11 0 2024-09-18T21:12:31.040 INFO:tasks.workunit.client.1.smithi103.stdout:6/58: dread - d2/d3/d8/f10 zero size 2024-09-18T21:12:31.042 INFO:tasks.workunit.client.1.smithi103.stdout:6/59: write d2/d3/d8/f10 [1036604,41881] 0 2024-09-18T21:12:31.043 INFO:tasks.workunit.client.1.smithi103.stdout:0/45: mknod d1/d9/cf 0 2024-09-18T21:12:31.047 INFO:tasks.workunit.client.1.smithi103.stdout:0/46: symlink d1/d5/de/l10 0 2024-09-18T21:12:31.049 INFO:tasks.workunit.client.1.smithi103.stdout:0/47: chown d1/d5/f8 5067 1 2024-09-18T21:12:31.049 INFO:tasks.workunit.client.1.smithi103.stdout:6/60: dwrite d2/d3/f9 [0,4194304] 0 2024-09-18T21:12:31.050 INFO:tasks.workunit.client.1.smithi103.stdout:6/61: readlink d2/le 0 2024-09-18T21:12:31.053 INFO:tasks.workunit.client.1.smithi103.stdout:6/62: stat d2/d3/d8/df/f11 0 2024-09-18T21:12:31.053 INFO:tasks.workunit.client.1.smithi103.stdout:0/48: unlink d1/d5/cb 0 2024-09-18T21:12:31.054 INFO:tasks.workunit.client.1.smithi103.stdout:0/49: stat d1/d5/fc 0 2024-09-18T21:12:31.055 INFO:tasks.workunit.client.1.smithi103.stdout:6/63: read - d2/d3/d4/f15 zero size 2024-09-18T21:12:31.055 INFO:tasks.workunit.client.1.smithi103.stdout:0/50: stat d1/fd 0 2024-09-18T21:12:31.056 INFO:tasks.workunit.client.1.smithi103.stdout:0/51: chown d1/d9 1113514 1 2024-09-18T21:12:31.056 INFO:tasks.workunit.client.1.smithi103.stdout:9/24: dwrite f0 [0,4194304] 0 2024-09-18T21:12:31.057 INFO:tasks.workunit.client.1.smithi103.stdout:9/25: readlink l3 0 2024-09-18T21:12:31.058 INFO:tasks.workunit.client.1.smithi103.stdout:0/52: write d1/f4 [4866542,109935] 0 2024-09-18T21:12:31.066 INFO:tasks.workunit.client.1.smithi103.stdout:6/64: dwrite d2/d3/d8/f10 [0,4194304] 0 2024-09-18T21:12:31.067 INFO:tasks.workunit.client.1.smithi103.stdout:6/65: dread - d2/f12 zero size 2024-09-18T21:12:31.067 INFO:tasks.workunit.client.1.smithi103.stdout:0/53: dread d1/fa [0,4194304] 0 2024-09-18T21:12:31.068 INFO:tasks.workunit.client.1.smithi103.stdout:0/54: chown d1/d9/cf 1 1 2024-09-18T21:12:31.070 INFO:tasks.workunit.client.1.smithi103.stdout:6/66: dread d2/fb [0,4194304] 0 2024-09-18T21:12:31.070 INFO:tasks.workunit.client.1.smithi103.stdout:0/55: mknod d1/d5/c11 0 2024-09-18T21:12:31.077 INFO:tasks.workunit.client.1.smithi103.stdout:0/56: rename d1/d5/f8 to d1/f12 0 2024-09-18T21:12:31.081 INFO:tasks.workunit.client.1.smithi103.stdout:6/67: rename d2/d3/d4/cd to d2/d3/c16 0 2024-09-18T21:12:31.082 INFO:tasks.workunit.client.1.smithi103.stdout:0/57: mkdir d1/d9/d13 0 2024-09-18T21:12:31.087 INFO:tasks.workunit.client.1.smithi103.stdout:6/68: dwrite d2/d3/d8/df/f11 [0,4194304] 0 2024-09-18T21:12:31.089 INFO:tasks.workunit.client.1.smithi103.stdout:0/58: creat d1/d9/d13/f14 x:0 0 0 2024-09-18T21:12:31.089 INFO:tasks.workunit.client.1.smithi103.stdout:0/59: write d1/fd [843195,56410] 0 2024-09-18T21:12:31.092 INFO:tasks.workunit.client.1.smithi103.stdout:6/69: rename d2/d3/f9 to d2/d3/d8/df/f17 0 2024-09-18T21:12:31.095 INFO:tasks.workunit.client.1.smithi103.stdout:0/60: symlink d1/d5/de/l15 0 2024-09-18T21:12:31.099 INFO:tasks.workunit.client.1.smithi103.stdout:0/61: fsync d1/d5/fc 0 2024-09-18T21:12:31.101 INFO:tasks.workunit.client.1.smithi103.stdout:0/62: unlink d1/d9/cf 0 2024-09-18T21:12:31.102 INFO:tasks.workunit.client.1.smithi103.stdout:0/63: readlink d1/d5/de/l15 0 2024-09-18T21:12:31.103 INFO:tasks.workunit.client.1.smithi103.stdout:6/70: creat d2/f18 x:0 0 0 2024-09-18T21:12:31.104 INFO:tasks.workunit.client.1.smithi103.stdout:0/64: creat d1/d5/f16 x:0 0 0 2024-09-18T21:12:31.105 INFO:tasks.workunit.client.1.smithi103.stdout:0/65: write d1/d5/fc [3141146,37886] 0 2024-09-18T21:12:31.106 INFO:tasks.workunit.client.1.smithi103.stdout:6/71: rename d2/f13 to d2/d3/f19 0 2024-09-18T21:12:31.113 INFO:tasks.workunit.client.1.smithi103.stdout:9/26: truncate f0 1495224 0 2024-09-18T21:12:31.115 INFO:tasks.workunit.client.1.smithi103.stdout:0/66: link d1/d5/f6 d1/f17 0 2024-09-18T21:12:31.121 INFO:tasks.workunit.client.1.smithi103.stdout:0/67: creat d1/f18 x:0 0 0 2024-09-18T21:12:31.121 INFO:tasks.workunit.client.1.smithi103.stdout:0/68: chown d1/d5/l7 152949 1 2024-09-18T21:12:31.121 INFO:tasks.workunit.client.1.smithi103.stdout:0/69: write d1/f18 [354378,72253] 0 2024-09-18T21:12:31.139 INFO:tasks.workunit.client.1.smithi103.stdout:0/70: getdents d1/d9/d13 0 2024-09-18T21:12:31.155 INFO:tasks.workunit.client.1.smithi103.stdout:6/72: truncate d2/fb 303630 0 2024-09-18T21:12:31.159 INFO:tasks.workunit.client.1.smithi103.stdout:0/71: truncate d1/f17 4370780 0 2024-09-18T21:12:31.161 INFO:tasks.workunit.client.1.smithi103.stdout:6/73: creat d2/f1a x:0 0 0 2024-09-18T21:12:31.162 INFO:tasks.workunit.client.1.smithi103.stdout:0/72: write d1/f12 [164420,82682] 0 2024-09-18T21:12:31.163 INFO:tasks.workunit.client.1.smithi103.stdout:6/74: symlink d2/d3/d4/l1b 0 2024-09-18T21:12:31.165 INFO:tasks.workunit.client.1.smithi103.stdout:0/73: mkdir d1/d5/de/d19 0 2024-09-18T21:12:31.169 INFO:tasks.workunit.client.1.smithi103.stdout:6/75: link d2/f12 d2/d3/f1c 0 2024-09-18T21:12:31.170 INFO:tasks.workunit.client.1.smithi103.stdout:6/76: fsync d2/d3/d8/f10 0 2024-09-18T21:12:31.174 INFO:tasks.workunit.client.1.smithi103.stdout:6/77: dread d2/d3/d8/df/f11 [0,4194304] 0 2024-09-18T21:12:31.215 INFO:tasks.workunit.client.1.smithi103.stdout:6/78: mknod d2/d3/d8/df/c1d 0 2024-09-18T21:12:31.223 INFO:tasks.workunit.client.1.smithi103.stdout:6/79: dwrite d2/d3/d8/df/f17 [4194304,4194304] 0 2024-09-18T21:12:31.234 INFO:tasks.workunit.client.1.smithi103.stdout:6/80: dwrite d2/f12 [0,4194304] 0 2024-09-18T21:12:31.242 INFO:tasks.workunit.client.1.smithi103.stdout:6/81: dwrite d2/d3/d8/df/f17 [0,4194304] 0 2024-09-18T21:12:31.250 INFO:tasks.workunit.client.1.smithi103.stdout:6/82: link d2/d3/d8/ca d2/c1e 0 2024-09-18T21:12:31.253 INFO:tasks.workunit.client.1.smithi103.stdout:6/83: rmdir d2/d3/d4 39 2024-09-18T21:12:31.255 INFO:tasks.workunit.client.1.smithi103.stdout:6/84: creat d2/d3/d8/df/f1f x:0 0 0 2024-09-18T21:12:31.259 INFO:tasks.workunit.client.1.smithi103.stdout:6/85: creat d2/d3/d8/f20 x:0 0 0 2024-09-18T21:12:31.262 INFO:tasks.workunit.client.1.smithi103.stdout:6/86: dread d2/d3/f1c [0,4194304] 0 2024-09-18T21:12:31.268 INFO:tasks.workunit.client.1.smithi103.stdout:6/87: rmdir d2/d3/d4 39 2024-09-18T21:12:31.272 INFO:tasks.workunit.client.1.smithi103.stdout:6/88: symlink d2/d3/l21 0 2024-09-18T21:12:31.275 INFO:tasks.workunit.client.1.smithi103.stdout:0/74: dwrite d1/fa [0,4194304] 0 2024-09-18T21:12:31.280 INFO:tasks.workunit.client.1.smithi103.stdout:6/89: rename d2/f1a to d2/f22 0 2024-09-18T21:12:31.282 INFO:tasks.workunit.client.1.smithi103.stdout:0/75: dwrite d1/f12 [0,4194304] 0 2024-09-18T21:12:31.290 INFO:tasks.workunit.client.1.smithi103.stdout:0/76: dwrite d1/f18 [0,4194304] 0 2024-09-18T21:12:31.292 INFO:tasks.workunit.client.1.smithi103.stdout:6/90: link d2/d3/d8/cc d2/d3/c23 0 2024-09-18T21:12:31.293 INFO:tasks.workunit.client.1.smithi103.stdout:0/77: symlink d1/d5/l1a 0 2024-09-18T21:12:31.297 INFO:tasks.workunit.client.1.smithi103.stdout:6/91: unlink d2/d3/c16 0 2024-09-18T21:12:31.298 INFO:tasks.workunit.client.1.smithi103.stdout:0/78: dread d1/fa [0,4194304] 0 2024-09-18T21:12:31.306 INFO:tasks.workunit.client.1.smithi103.stdout:0/79: dwrite d1/f18 [0,4194304] 0 2024-09-18T21:12:31.311 INFO:tasks.workunit.client.1.smithi103.stdout:0/80: dwrite d1/f4 [0,4194304] 0 2024-09-18T21:12:31.335 INFO:tasks.workunit.client.1.smithi103.stdout:6/92: dwrite d2/f12 [0,4194304] 0 2024-09-18T21:12:31.379 INFO:tasks.workunit.client.1.smithi103.stdout:6/93: chown d2/c1e 1687169 1 2024-09-18T21:12:31.381 INFO:tasks.workunit.client.1.smithi103.stdout:6/94: mkdir d2/d24 0 2024-09-18T21:12:31.621 INFO:tasks.workunit.client.1.smithi103.stdout:6/95: dwrite d2/fb [0,4194304] 0 2024-09-18T21:12:31.734 INFO:tasks.workunit.client.1.smithi103.stdout:6/96: getdents d2/d3/d8 0 2024-09-18T21:12:31.741 INFO:tasks.workunit.client.1.smithi103.stdout:6/97: dwrite d2/d3/d4/f15 [0,4194304] 0 2024-09-18T21:12:31.742 INFO:tasks.workunit.client.1.smithi103.stdout:6/98: chown d2/d3/d8/ca 55966117 1 2024-09-18T21:12:31.746 INFO:tasks.workunit.client.1.smithi103.stdout:6/99: dread d2/d3/d8/df/f17 [4194304,4194304] 0 2024-09-18T21:12:31.749 INFO:tasks.workunit.client.1.smithi103.stdout:6/100: getdents d2/d24 0 2024-09-18T21:12:32.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:32 smithi077 ceph-mon[27689]: pgmap v7: 65 pgs: 65 active+clean; 199 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 2.6 MiB/s wr, 241 op/s 2024-09-18T21:12:32.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:32 smithi103 ceph-mon[34827]: pgmap v7: 65 pgs: 65 active+clean; 199 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 2.6 MiB/s wr, 241 op/s 2024-09-18T21:12:34.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:34 smithi077 ceph-mon[27689]: pgmap v8: 65 pgs: 65 active+clean; 199 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 2.1 MiB/s wr, 188 op/s 2024-09-18T21:12:34.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:34 smithi103 ceph-mon[34827]: pgmap v8: 65 pgs: 65 active+clean; 199 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 2.1 MiB/s wr, 188 op/s 2024-09-18T21:12:35.973 INFO:tasks.workunit.client.0.smithi077.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-18T21:12:35.977 INFO:tasks.workunit.client.0.smithi077.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-18T21:12:35.977 INFO:tasks.workunit.client.0.smithi077.stderr:+ make 2024-09-18T21:12:36.076 INFO:tasks.workunit.client.0.smithi077.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-18T21:12:36.624 INFO:tasks.workunit.client.0.smithi077.stderr:++ readlink -f fsstress 2024-09-18T21:12:36.625 INFO:tasks.workunit.client.0.smithi077.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-18T21:12:36.626 INFO:tasks.workunit.client.0.smithi077.stderr:+ popd 2024-09-18T21:12:36.626 INFO:tasks.workunit.client.0.smithi077.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-18T21:12:36.627 INFO:tasks.workunit.client.0.smithi077.stderr:+ popd 2024-09-18T21:12:36.627 INFO:tasks.workunit.client.0.smithi077.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-18T21:12:36.627 INFO:tasks.workunit.client.0.smithi077.stderr:++ mktemp -d -p . 2024-09-18T21:12:36.629 INFO:tasks.workunit.client.0.smithi077.stderr:+ T=./tmp.tJqcfsZOrz 2024-09-18T21:12:36.629 INFO:tasks.workunit.client.0.smithi077.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.tJqcfsZOrz -l 1 -n 1000 -p 10 -v 2024-09-18T21:12:36.632 INFO:tasks.workunit.client.0.smithi077.stdout:seed = 1726145987 2024-09-18T21:12:36.635 INFO:tasks.workunit.client.0.smithi077.stdout:0/0: dwrite - no filename 2024-09-18T21:12:36.635 INFO:tasks.workunit.client.0.smithi077.stdout:0/1: chown . 810 1 2024-09-18T21:12:36.636 INFO:tasks.workunit.client.0.smithi077.stdout:1/0: dread - no filename 2024-09-18T21:12:36.636 INFO:tasks.workunit.client.0.smithi077.stdout:0/2: creat f0 x:0 0 0 2024-09-18T21:12:36.637 INFO:tasks.workunit.client.0.smithi077.stdout:0/3: fdatasync f0 0 2024-09-18T21:12:36.637 INFO:tasks.workunit.client.0.smithi077.stdout:2/0: dread - no filename 2024-09-18T21:12:36.639 INFO:tasks.workunit.client.0.smithi077.stdout:0/4: symlink l1 0 2024-09-18T21:12:36.639 INFO:tasks.workunit.client.0.smithi077.stdout:3/0: write - no filename 2024-09-18T21:12:36.639 INFO:tasks.workunit.client.0.smithi077.stdout:3/1: readlink - no filename 2024-09-18T21:12:36.639 INFO:tasks.workunit.client.0.smithi077.stdout:0/5: chown f0 15628786 1 2024-09-18T21:12:36.639 INFO:tasks.workunit.client.0.smithi077.stdout:0/6: stat f0 0 2024-09-18T21:12:36.640 INFO:tasks.workunit.client.0.smithi077.stdout:0/7: chown f0 1058641506 1 2024-09-18T21:12:36.640 INFO:tasks.workunit.client.0.smithi077.stdout:3/2: mknod c0 0 2024-09-18T21:12:36.641 INFO:tasks.workunit.client.0.smithi077.stdout:3/3: write - no filename 2024-09-18T21:12:36.641 INFO:tasks.workunit.client.0.smithi077.stdout:0/8: dread - f0 zero size 2024-09-18T21:12:36.642 INFO:tasks.workunit.client.0.smithi077.stdout:4/0: symlink l0 0 2024-09-18T21:12:36.642 INFO:tasks.workunit.client.0.smithi077.stdout:4/1: write - no filename 2024-09-18T21:12:36.643 INFO:tasks.workunit.client.0.smithi077.stdout:3/4: symlink l1 0 2024-09-18T21:12:36.643 INFO:tasks.workunit.client.0.smithi077.stdout:3/5: rmdir - no directory 2024-09-18T21:12:36.643 INFO:tasks.workunit.client.0.smithi077.stdout:5/0: write - no filename 2024-09-18T21:12:36.643 INFO:tasks.workunit.client.0.smithi077.stdout:5/1: dwrite - no filename 2024-09-18T21:12:36.643 INFO:tasks.workunit.client.0.smithi077.stdout:4/2: symlink l1 0 2024-09-18T21:12:36.645 INFO:tasks.workunit.client.0.smithi077.stdout:5/2: mkdir d0 0 2024-09-18T21:12:36.645 INFO:tasks.workunit.client.0.smithi077.stdout:5/3: chown d0 0 1 2024-09-18T21:12:36.645 INFO:tasks.workunit.client.0.smithi077.stdout:4/3: symlink l2 0 2024-09-18T21:12:36.647 INFO:tasks.workunit.client.0.smithi077.stdout:7/0: write - no filename 2024-09-18T21:12:36.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:36 smithi077 ceph-mon[27689]: pgmap v9: 65 pgs: 65 active+clean; 301 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 231 KiB/s rd, 16 MiB/s wr, 277 op/s 2024-09-18T21:12:36.747 INFO:tasks.workunit.client.0.smithi077.stdout:4/4: mkdir d3 0 2024-09-18T21:12:36.747 INFO:tasks.workunit.client.0.smithi077.stdout:4/5: stat l1 0 2024-09-18T21:12:36.748 INFO:tasks.workunit.client.0.smithi077.stdout:4/6: truncate - no filename 2024-09-18T21:12:36.748 INFO:tasks.workunit.client.0.smithi077.stdout:4/7: write - no filename 2024-09-18T21:12:36.748 INFO:tasks.workunit.client.0.smithi077.stdout:0/9: dwrite f0 [0,4194304] 0 2024-09-18T21:12:36.748 INFO:tasks.workunit.client.0.smithi077.stdout:0/10: write f0 [3367574,80878] 0 2024-09-18T21:12:36.749 INFO:tasks.workunit.client.0.smithi077.stdout:0/11: chown l1 7978 1 2024-09-18T21:12:36.750 INFO:tasks.workunit.client.0.smithi077.stdout:6/0: symlink l0 0 2024-09-18T21:12:36.750 INFO:tasks.workunit.client.0.smithi077.stdout:6/1: write - no filename 2024-09-18T21:12:36.750 INFO:tasks.workunit.client.0.smithi077.stdout:6/2: chown l0 235 1 2024-09-18T21:12:36.751 INFO:tasks.workunit.client.0.smithi077.stdout:6/3: read - no filename 2024-09-18T21:12:36.754 INFO:tasks.workunit.client.0.smithi077.stdout:8/0: truncate - no filename 2024-09-18T21:12:36.757 INFO:tasks.workunit.client.0.smithi077.stdout:5/4: symlink d0/l1 0 2024-09-18T21:12:36.758 INFO:tasks.workunit.client.0.smithi077.stdout:5/5: dwrite - no filename 2024-09-18T21:12:36.759 INFO:tasks.workunit.client.0.smithi077.stdout:6/4: symlink l1 0 2024-09-18T21:12:36.759 INFO:tasks.workunit.client.0.smithi077.stdout:6/5: dwrite - no filename 2024-09-18T21:12:36.759 INFO:tasks.workunit.client.0.smithi077.stdout:6/6: chown l0 6802976 1 2024-09-18T21:12:36.759 INFO:tasks.workunit.client.0.smithi077.stdout:6/7: dread - no filename 2024-09-18T21:12:36.759 INFO:tasks.workunit.client.0.smithi077.stdout:6/8: write - no filename 2024-09-18T21:12:36.759 INFO:tasks.workunit.client.0.smithi077.stdout:6/9: write - no filename 2024-09-18T21:12:36.760 INFO:tasks.workunit.client.0.smithi077.stdout:9/0: dwrite - no filename 2024-09-18T21:12:36.760 INFO:tasks.workunit.client.0.smithi077.stdout:9/1: dwrite - no filename 2024-09-18T21:12:36.760 INFO:tasks.workunit.client.0.smithi077.stdout:9/2: dread - no filename 2024-09-18T21:12:36.761 INFO:tasks.workunit.client.0.smithi077.stdout:7/1: creat f0 x:0 0 0 2024-09-18T21:12:36.762 INFO:tasks.workunit.client.0.smithi077.stdout:4/8: symlink d3/l4 0 2024-09-18T21:12:36.763 INFO:tasks.workunit.client.0.smithi077.stdout:4/9: fdatasync - no filename 2024-09-18T21:12:36.763 INFO:tasks.workunit.client.0.smithi077.stdout:4/10: fsync - no filename 2024-09-18T21:12:36.763 INFO:tasks.workunit.client.0.smithi077.stdout:4/11: fdatasync - no filename 2024-09-18T21:12:36.763 INFO:tasks.workunit.client.0.smithi077.stdout:7/2: chown f0 885 1 2024-09-18T21:12:36.763 INFO:tasks.workunit.client.0.smithi077.stdout:4/12: readlink l0 0 2024-09-18T21:12:36.763 INFO:tasks.workunit.client.0.smithi077.stdout:4/13: dwrite - no filename 2024-09-18T21:12:36.763 INFO:tasks.workunit.client.0.smithi077.stdout:4/14: read - no filename 2024-09-18T21:12:36.763 INFO:tasks.workunit.client.0.smithi077.stdout:7/3: chown f0 924 1 2024-09-18T21:12:36.763 INFO:tasks.workunit.client.0.smithi077.stdout:4/15: chown l1 1202 1 2024-09-18T21:12:36.763 INFO:tasks.workunit.client.0.smithi077.stdout:4/16: dwrite - no filename 2024-09-18T21:12:36.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:36 smithi103 ceph-mon[34827]: pgmap v9: 65 pgs: 65 active+clean; 301 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 231 KiB/s rd, 16 MiB/s wr, 277 op/s 2024-09-18T21:12:36.764 INFO:tasks.workunit.client.0.smithi077.stdout:5/6: creat d0/f2 x:0 0 0 2024-09-18T21:12:36.764 INFO:tasks.workunit.client.0.smithi077.stdout:7/4: write f0 [921692,80443] 0 2024-09-18T21:12:36.764 INFO:tasks.workunit.client.0.smithi077.stdout:6/10: mknod c2 0 2024-09-18T21:12:36.765 INFO:tasks.workunit.client.0.smithi077.stdout:5/7: write d0/f2 [786693,63960] 0 2024-09-18T21:12:36.766 INFO:tasks.workunit.client.0.smithi077.stdout:4/17: creat d3/f5 x:0 0 0 2024-09-18T21:12:36.768 INFO:tasks.workunit.client.0.smithi077.stdout:9/3: symlink l0 0 2024-09-18T21:12:36.768 INFO:tasks.workunit.client.0.smithi077.stdout:9/4: dwrite - no filename 2024-09-18T21:12:36.768 INFO:tasks.workunit.client.0.smithi077.stdout:0/12: fdatasync f0 0 2024-09-18T21:12:36.769 INFO:tasks.workunit.client.0.smithi077.stdout:6/11: rename l0 to l3 0 2024-09-18T21:12:36.770 INFO:tasks.workunit.client.0.smithi077.stdout:5/8: write d0/f2 [50785,42879] 0 2024-09-18T21:12:36.771 INFO:tasks.workunit.client.0.smithi077.stdout:9/5: mkdir d1 0 2024-09-18T21:12:36.771 INFO:tasks.workunit.client.0.smithi077.stdout:9/6: write - no filename 2024-09-18T21:12:36.771 INFO:tasks.workunit.client.0.smithi077.stdout:4/18: truncate d3/f5 433780 0 2024-09-18T21:12:36.775 INFO:tasks.workunit.client.0.smithi077.stdout:4/19: read d3/f5 [381550,81291] 0 2024-09-18T21:12:36.777 INFO:tasks.workunit.client.0.smithi077.stdout:7/5: dwrite f0 [0,4194304] 0 2024-09-18T21:12:36.777 INFO:tasks.workunit.client.0.smithi077.stdout:7/6: stat f0 0 2024-09-18T21:12:36.778 INFO:tasks.workunit.client.0.smithi077.stdout:7/7: chown f0 975964721 1 2024-09-18T21:12:36.779 INFO:tasks.workunit.client.0.smithi077.stdout:9/7: mkdir d1/d2 0 2024-09-18T21:12:36.779 INFO:tasks.workunit.client.0.smithi077.stdout:0/13: dread f0 [0,4194304] 0 2024-09-18T21:12:36.781 INFO:tasks.workunit.client.0.smithi077.stdout:4/20: rename l2 to d3/l6 0 2024-09-18T21:12:36.782 INFO:tasks.workunit.client.0.smithi077.stdout:7/8: creat f1 x:0 0 0 2024-09-18T21:12:36.784 INFO:tasks.workunit.client.0.smithi077.stdout:3/6: getdents . 0 2024-09-18T21:12:36.784 INFO:tasks.workunit.client.0.smithi077.stdout:3/7: dread - no filename 2024-09-18T21:12:36.784 INFO:tasks.workunit.client.0.smithi077.stdout:3/8: write - no filename 2024-09-18T21:12:36.784 INFO:tasks.workunit.client.0.smithi077.stdout:3/9: write - no filename 2024-09-18T21:12:36.785 INFO:tasks.workunit.client.0.smithi077.stdout:0/14: rename l1 to l2 0 2024-09-18T21:12:36.787 INFO:tasks.workunit.client.0.smithi077.stdout:7/9: symlink l2 0 2024-09-18T21:12:36.787 INFO:tasks.workunit.client.0.smithi077.stdout:7/10: read - f1 zero size 2024-09-18T21:12:36.788 INFO:tasks.workunit.client.0.smithi077.stdout:3/10: symlink l2 0 2024-09-18T21:12:36.789 INFO:tasks.workunit.client.0.smithi077.stdout:0/15: creat f3 x:0 0 0 2024-09-18T21:12:36.792 INFO:tasks.workunit.client.0.smithi077.stdout:3/11: creat f3 x:0 0 0 2024-09-18T21:12:36.793 INFO:tasks.workunit.client.0.smithi077.stdout:9/8: rmdir d1/d2 0 2024-09-18T21:12:36.793 INFO:tasks.workunit.client.0.smithi077.stdout:9/9: read - no filename 2024-09-18T21:12:36.793 INFO:tasks.workunit.client.0.smithi077.stdout:9/10: dwrite - no filename 2024-09-18T21:12:36.795 INFO:tasks.workunit.client.0.smithi077.stdout:3/12: chown c0 21649564 1 2024-09-18T21:12:36.797 INFO:tasks.workunit.client.0.smithi077.stdout:9/11: creat d1/f3 x:0 0 0 2024-09-18T21:12:36.797 INFO:tasks.workunit.client.0.smithi077.stdout:5/9: fsync d0/f2 0 2024-09-18T21:12:36.798 INFO:tasks.workunit.client.0.smithi077.stdout:3/13: unlink l1 0 2024-09-18T21:12:36.798 INFO:tasks.workunit.client.0.smithi077.stdout:3/14: rmdir - no directory 2024-09-18T21:12:36.799 INFO:tasks.workunit.client.0.smithi077.stdout:4/21: fsync d3/f5 0 2024-09-18T21:12:36.800 INFO:tasks.workunit.client.0.smithi077.stdout:5/10: fsync d0/f2 0 2024-09-18T21:12:36.801 INFO:tasks.workunit.client.0.smithi077.stdout:6/12: getdents . 0 2024-09-18T21:12:36.801 INFO:tasks.workunit.client.0.smithi077.stdout:6/13: dwrite - no filename 2024-09-18T21:12:36.801 INFO:tasks.workunit.client.0.smithi077.stdout:6/14: dwrite - no filename 2024-09-18T21:12:36.801 INFO:tasks.workunit.client.0.smithi077.stdout:6/15: dwrite - no filename 2024-09-18T21:12:36.801 INFO:tasks.workunit.client.0.smithi077.stdout:7/11: dwrite f1 [0,4194304] 0 2024-09-18T21:12:36.802 INFO:tasks.workunit.client.0.smithi077.stdout:9/12: rename l0 to d1/l4 0 2024-09-18T21:12:36.802 INFO:tasks.workunit.client.0.smithi077.stdout:0/16: dwrite f0 [0,4194304] 0 2024-09-18T21:12:36.802 INFO:tasks.workunit.client.0.smithi077.stdout:5/11: chown d0 63561024 1 2024-09-18T21:12:36.805 INFO:tasks.workunit.client.0.smithi077.stdout:9/13: read - d1/f3 zero size 2024-09-18T21:12:36.806 INFO:tasks.workunit.client.0.smithi077.stdout:3/15: creat f4 x:0 0 0 2024-09-18T21:12:36.806 INFO:tasks.workunit.client.0.smithi077.stdout:3/16: stat f4 0 2024-09-18T21:12:36.806 INFO:tasks.workunit.client.0.smithi077.stdout:4/22: dread d3/f5 [0,4194304] 0 2024-09-18T21:12:36.807 INFO:tasks.workunit.client.0.smithi077.stdout:5/12: truncate d0/f2 1249004 0 2024-09-18T21:12:36.809 INFO:tasks.workunit.client.0.smithi077.stdout:3/17: dread - f3 zero size 2024-09-18T21:12:36.810 INFO:tasks.workunit.client.0.smithi077.stdout:6/16: rename c2 to c4 0 2024-09-18T21:12:36.811 INFO:tasks.workunit.client.0.smithi077.stdout:3/18: read - f4 zero size 2024-09-18T21:12:36.812 INFO:tasks.workunit.client.0.smithi077.stdout:9/14: truncate d1/f3 411991 0 2024-09-18T21:12:36.812 INFO:tasks.workunit.client.0.smithi077.stdout:4/23: mkdir d3/d7 0 2024-09-18T21:12:36.816 INFO:tasks.workunit.client.0.smithi077.stdout:3/19: write f3 [547935,128579] 0 2024-09-18T21:12:36.817 INFO:tasks.workunit.client.0.smithi077.stdout:5/13: symlink d0/l3 0 2024-09-18T21:12:36.818 INFO:tasks.workunit.client.0.smithi077.stdout:9/15: read d1/f3 [186622,100434] 0 2024-09-18T21:12:36.820 INFO:tasks.workunit.client.0.smithi077.stdout:3/20: write f3 [751742,73966] 0 2024-09-18T21:12:36.820 INFO:tasks.workunit.client.0.smithi077.stdout:4/24: symlink d3/d7/l8 0 2024-09-18T21:12:36.822 INFO:tasks.workunit.client.0.smithi077.stdout:5/14: unlink d0/l3 0 2024-09-18T21:12:36.822 INFO:tasks.workunit.client.0.smithi077.stdout:7/12: dwrite f0 [0,4194304] 0 2024-09-18T21:12:36.823 INFO:tasks.workunit.client.0.smithi077.stdout:0/17: dwrite f3 [0,4194304] 0 2024-09-18T21:12:36.824 INFO:tasks.workunit.client.0.smithi077.stdout:3/21: truncate f4 809531 0 2024-09-18T21:12:36.826 INFO:tasks.workunit.client.0.smithi077.stdout:5/15: write d0/f2 [979889,22414] 0 2024-09-18T21:12:36.826 INFO:tasks.workunit.client.0.smithi077.stdout:9/16: dread d1/f3 [0,4194304] 0 2024-09-18T21:12:36.829 INFO:tasks.workunit.client.0.smithi077.stdout:0/18: creat f4 x:0 0 0 2024-09-18T21:12:36.829 INFO:tasks.workunit.client.0.smithi077.stdout:0/19: rmdir - no directory 2024-09-18T21:12:36.831 INFO:tasks.workunit.client.0.smithi077.stdout:7/13: link f0 f3 0 2024-09-18T21:12:36.832 INFO:tasks.workunit.client.0.smithi077.stdout:6/17: getdents . 0 2024-09-18T21:12:36.833 INFO:tasks.workunit.client.0.smithi077.stdout:6/18: chown c4 3405 1 2024-09-18T21:12:36.833 INFO:tasks.workunit.client.0.smithi077.stdout:6/19: fdatasync - no filename 2024-09-18T21:12:36.834 INFO:tasks.workunit.client.0.smithi077.stdout:6/20: write - no filename 2024-09-18T21:12:36.835 INFO:tasks.workunit.client.0.smithi077.stdout:5/16: mknod d0/c4 0 2024-09-18T21:12:36.837 INFO:tasks.workunit.client.0.smithi077.stdout:3/22: dwrite f3 [0,4194304] 0 2024-09-18T21:12:36.837 INFO:tasks.workunit.client.0.smithi077.stdout:3/23: chown f4 55 1 2024-09-18T21:12:36.838 INFO:tasks.workunit.client.0.smithi077.stdout:0/20: creat f5 x:0 0 0 2024-09-18T21:12:36.839 INFO:tasks.workunit.client.0.smithi077.stdout:0/21: truncate f0 4982005 0 2024-09-18T21:12:36.840 INFO:tasks.workunit.client.0.smithi077.stdout:7/14: symlink l4 0 2024-09-18T21:12:36.842 INFO:tasks.workunit.client.0.smithi077.stdout:6/21: symlink l5 0 2024-09-18T21:12:36.842 INFO:tasks.workunit.client.0.smithi077.stdout:6/22: rmdir - no directory 2024-09-18T21:12:36.842 INFO:tasks.workunit.client.0.smithi077.stdout:6/23: dwrite - no filename 2024-09-18T21:12:36.842 INFO:tasks.workunit.client.0.smithi077.stdout:6/24: truncate - no filename 2024-09-18T21:12:36.843 INFO:tasks.workunit.client.0.smithi077.stdout:5/17: dread d0/f2 [0,4194304] 0 2024-09-18T21:12:36.843 INFO:tasks.workunit.client.0.smithi077.stdout:9/17: rename d1/l4 to d1/l5 0 2024-09-18T21:12:36.845 INFO:tasks.workunit.client.0.smithi077.stdout:4/25: link d3/d7/l8 d3/l9 0 2024-09-18T21:12:36.846 INFO:tasks.workunit.client.0.smithi077.stdout:0/22: mknod c6 0 2024-09-18T21:12:36.848 INFO:tasks.workunit.client.0.smithi077.stdout:0/23: truncate f5 712497 0 2024-09-18T21:12:36.848 INFO:tasks.workunit.client.0.smithi077.stdout:6/25: creat f6 x:0 0 0 2024-09-18T21:12:36.849 INFO:tasks.workunit.client.0.smithi077.stdout:3/24: dwrite f3 [0,4194304] 0 2024-09-18T21:12:36.852 INFO:tasks.workunit.client.0.smithi077.stdout:6/26: mkdir d7 0 2024-09-18T21:12:36.854 INFO:tasks.workunit.client.0.smithi077.stdout:3/25: dread f4 [0,4194304] 0 2024-09-18T21:12:36.856 INFO:tasks.workunit.client.0.smithi077.stdout:7/15: fsync f0 0 2024-09-18T21:12:36.860 INFO:tasks.workunit.client.0.smithi077.stdout:3/26: write f3 [1267239,103354] 0 2024-09-18T21:12:36.860 INFO:tasks.workunit.client.0.smithi077.stdout:6/27: creat d7/f8 x:0 0 0 2024-09-18T21:12:36.860 INFO:tasks.workunit.client.0.smithi077.stdout:0/24: dread f0 [0,4194304] 0 2024-09-18T21:12:36.861 INFO:tasks.workunit.client.0.smithi077.stdout:6/28: readlink l3 0 2024-09-18T21:12:36.862 INFO:tasks.workunit.client.0.smithi077.stdout:7/16: creat f5 x:0 0 0 2024-09-18T21:12:36.866 INFO:tasks.workunit.client.0.smithi077.stdout:5/18: dwrite d0/f2 [0,4194304] 0 2024-09-18T21:12:36.866 INFO:tasks.workunit.client.0.smithi077.stdout:7/17: chown f3 19946 1 2024-09-18T21:12:36.867 INFO:tasks.workunit.client.0.smithi077.stdout:6/29: rename d7/f8 to d7/f9 0 2024-09-18T21:12:36.870 INFO:tasks.workunit.client.0.smithi077.stdout:7/18: creat f6 x:0 0 0 2024-09-18T21:12:36.872 INFO:tasks.workunit.client.0.smithi077.stdout:7/19: truncate f5 283645 0 2024-09-18T21:12:36.872 INFO:tasks.workunit.client.0.smithi077.stdout:5/19: mkdir d0/d5 0 2024-09-18T21:12:36.874 INFO:tasks.workunit.client.0.smithi077.stdout:6/30: fdatasync d7/f9 0 2024-09-18T21:12:36.876 INFO:tasks.workunit.client.0.smithi077.stdout:3/27: dwrite f4 [0,4194304] 0 2024-09-18T21:12:36.877 INFO:tasks.workunit.client.0.smithi077.stdout:7/20: symlink l7 0 2024-09-18T21:12:36.877 INFO:tasks.workunit.client.0.smithi077.stdout:0/25: dwrite f0 [0,4194304] 0 2024-09-18T21:12:36.879 INFO:tasks.workunit.client.0.smithi077.stdout:6/31: write d7/f9 [262006,92569] 0 2024-09-18T21:12:36.879 INFO:tasks.workunit.client.0.smithi077.stdout:0/26: write f3 [1279005,16629] 0 2024-09-18T21:12:36.880 INFO:tasks.workunit.client.0.smithi077.stdout:6/32: chown c4 934208 1 2024-09-18T21:12:36.885 INFO:tasks.workunit.client.0.smithi077.stdout:0/27: mknod c7 0 2024-09-18T21:12:36.887 INFO:tasks.workunit.client.0.smithi077.stdout:3/28: link f4 f5 0 2024-09-18T21:12:36.889 INFO:tasks.workunit.client.0.smithi077.stdout:0/28: write f0 [3605861,65951] 0 2024-09-18T21:12:36.889 INFO:tasks.workunit.client.0.smithi077.stdout:5/20: getdents d0 0 2024-09-18T21:12:36.890 INFO:tasks.workunit.client.0.smithi077.stdout:7/21: dread f1 [0,4194304] 0 2024-09-18T21:12:36.891 INFO:tasks.workunit.client.0.smithi077.stdout:5/21: chown d0/c4 30238821 1 2024-09-18T21:12:36.896 INFO:tasks.workunit.client.0.smithi077.stdout:7/22: mknod c8 0 2024-09-18T21:12:36.896 INFO:tasks.workunit.client.0.smithi077.stdout:7/23: symlink l9 0 2024-09-18T21:12:36.896 INFO:tasks.workunit.client.0.smithi077.stdout:6/33: dwrite f6 [0,4194304] 0 2024-09-18T21:12:36.901 INFO:tasks.workunit.client.0.smithi077.stdout:7/24: write f3 [1971981,35042] 0 2024-09-18T21:12:36.905 INFO:tasks.workunit.client.0.smithi077.stdout:0/29: dwrite f4 [0,4194304] 0 2024-09-18T21:12:36.905 INFO:tasks.workunit.client.0.smithi077.stdout:5/22: dread d0/f2 [0,4194304] 0 2024-09-18T21:12:36.907 INFO:tasks.workunit.client.0.smithi077.stdout:6/34: dread d7/f9 [0,4194304] 0 2024-09-18T21:12:36.907 INFO:tasks.workunit.client.0.smithi077.stdout:7/25: rename f6 to fa 0 2024-09-18T21:12:36.908 INFO:tasks.workunit.client.0.smithi077.stdout:5/23: mkdir d0/d6 0 2024-09-18T21:12:36.908 INFO:tasks.workunit.client.0.smithi077.stdout:0/30: mkdir d8 0 2024-09-18T21:12:36.910 INFO:tasks.workunit.client.0.smithi077.stdout:6/35: creat d7/fa x:0 0 0 2024-09-18T21:12:36.911 INFO:tasks.workunit.client.0.smithi077.stdout:5/24: write d0/f2 [3918449,125686] 0 2024-09-18T21:12:36.911 INFO:tasks.workunit.client.0.smithi077.stdout:6/36: write d7/f9 [272415,71808] 0 2024-09-18T21:12:36.913 INFO:tasks.workunit.client.0.smithi077.stdout:6/37: truncate d7/f9 552420 0 2024-09-18T21:12:36.914 INFO:tasks.workunit.client.0.smithi077.stdout:5/25: creat d0/d5/f7 x:0 0 0 2024-09-18T21:12:36.914 INFO:tasks.workunit.client.0.smithi077.stdout:5/26: write d0/f2 [3969557,34476] 0 2024-09-18T21:12:36.915 INFO:tasks.workunit.client.0.smithi077.stdout:6/38: symlink d7/lb 0 2024-09-18T21:12:36.917 INFO:tasks.workunit.client.0.smithi077.stdout:7/26: fsync fa 0 2024-09-18T21:12:36.918 INFO:tasks.workunit.client.0.smithi077.stdout:5/27: creat d0/d5/f8 x:0 0 0 2024-09-18T21:12:36.919 INFO:tasks.workunit.client.0.smithi077.stdout:6/39: creat d7/fc x:0 0 0 2024-09-18T21:12:36.920 INFO:tasks.workunit.client.0.smithi077.stdout:5/28: truncate d0/d5/f8 719614 0 2024-09-18T21:12:36.921 INFO:tasks.workunit.client.0.smithi077.stdout:6/40: mknod d7/cd 0 2024-09-18T21:12:36.922 INFO:tasks.workunit.client.0.smithi077.stdout:6/41: fdatasync d7/f9 0 2024-09-18T21:12:36.923 INFO:tasks.workunit.client.0.smithi077.stdout:0/31: fsync f4 0 2024-09-18T21:12:36.925 INFO:tasks.workunit.client.0.smithi077.stdout:6/42: creat d7/fe x:0 0 0 2024-09-18T21:12:36.927 INFO:tasks.workunit.client.0.smithi077.stdout:0/32: mkdir d8/d9 0 2024-09-18T21:12:36.929 INFO:tasks.workunit.client.0.smithi077.stdout:6/43: mkdir d7/df 0 2024-09-18T21:12:36.930 INFO:tasks.workunit.client.0.smithi077.stdout:0/33: chown c7 432062549 1 2024-09-18T21:12:36.932 INFO:tasks.workunit.client.0.smithi077.stdout:7/27: dwrite f1 [4194304,4194304] 0 2024-09-18T21:12:36.932 INFO:tasks.workunit.client.0.smithi077.stdout:5/29: dwrite d0/d5/f8 [0,4194304] 0 2024-09-18T21:12:36.933 INFO:tasks.workunit.client.0.smithi077.stdout:0/34: rmdir d8 39 2024-09-18T21:12:36.934 INFO:tasks.workunit.client.0.smithi077.stdout:0/35: fdatasync f0 0 2024-09-18T21:12:36.938 INFO:tasks.workunit.client.0.smithi077.stdout:7/28: dread f0 [0,4194304] 0 2024-09-18T21:12:36.939 INFO:tasks.workunit.client.0.smithi077.stdout:7/29: chown f5 91759790 1 2024-09-18T21:12:36.941 INFO:tasks.workunit.client.0.smithi077.stdout:0/36: link c6 d8/ca 0 2024-09-18T21:12:36.943 INFO:tasks.workunit.client.0.smithi077.stdout:7/30: dread f3 [0,4194304] 0 2024-09-18T21:12:36.943 INFO:tasks.workunit.client.0.smithi077.stdout:0/37: creat d8/fb x:0 0 0 2024-09-18T21:12:36.944 INFO:tasks.workunit.client.0.smithi077.stdout:6/44: getdents d7 0 2024-09-18T21:12:36.945 INFO:tasks.workunit.client.0.smithi077.stdout:7/31: creat fb x:0 0 0 2024-09-18T21:12:36.946 INFO:tasks.workunit.client.0.smithi077.stdout:6/45: write d7/f9 [325557,88788] 0 2024-09-18T21:12:36.947 INFO:tasks.workunit.client.0.smithi077.stdout:7/32: creat fc x:0 0 0 2024-09-18T21:12:36.947 INFO:tasks.workunit.client.0.smithi077.stdout:7/33: truncate fb 254195 0 2024-09-18T21:12:36.949 INFO:tasks.workunit.client.0.smithi077.stdout:0/38: link f3 d8/d9/fc 0 2024-09-18T21:12:36.950 INFO:tasks.workunit.client.0.smithi077.stdout:6/46: unlink d7/f9 0 2024-09-18T21:12:36.950 INFO:tasks.workunit.client.0.smithi077.stdout:6/47: dread - d7/fa zero size 2024-09-18T21:12:36.953 INFO:tasks.workunit.client.0.smithi077.stdout:6/48: link d7/cd d7/df/c10 0 2024-09-18T21:12:36.954 INFO:tasks.workunit.client.0.smithi077.stdout:6/49: chown d7/fe 42039 1 2024-09-18T21:12:36.956 INFO:tasks.workunit.client.0.smithi077.stdout:6/50: mkdir d7/df/d11 0 2024-09-18T21:12:36.956 INFO:tasks.workunit.client.0.smithi077.stdout:5/30: fsync d0/d5/f8 0 2024-09-18T21:12:36.957 INFO:tasks.workunit.client.0.smithi077.stdout:0/39: dwrite d8/d9/fc [0,4194304] 0 2024-09-18T21:12:36.959 INFO:tasks.workunit.client.0.smithi077.stdout:6/51: mknod d7/df/c12 0 2024-09-18T21:12:36.961 INFO:tasks.workunit.client.0.smithi077.stdout:5/31: symlink d0/d5/l9 0 2024-09-18T21:12:36.962 INFO:tasks.workunit.client.0.smithi077.stdout:6/52: symlink d7/l13 0 2024-09-18T21:12:36.963 INFO:tasks.workunit.client.0.smithi077.stdout:5/32: fdatasync d0/d5/f7 0 2024-09-18T21:12:36.965 INFO:tasks.workunit.client.0.smithi077.stdout:6/53: creat d7/df/f14 x:0 0 0 2024-09-18T21:12:36.966 INFO:tasks.workunit.client.0.smithi077.stdout:5/33: write d0/d5/f8 [3722449,109159] 0 2024-09-18T21:12:36.967 INFO:tasks.workunit.client.0.smithi077.stdout:0/40: dwrite d8/fb [0,4194304] 0 2024-09-18T21:12:36.967 INFO:tasks.workunit.client.0.smithi077.stdout:5/34: stat d0/l1 0 2024-09-18T21:12:36.968 INFO:tasks.workunit.client.0.smithi077.stdout:5/35: read - d0/d5/f7 zero size 2024-09-18T21:12:36.971 INFO:tasks.workunit.client.0.smithi077.stdout:5/36: symlink d0/d5/la 0 2024-09-18T21:12:36.974 INFO:tasks.workunit.client.0.smithi077.stdout:5/37: dread - d0/d5/f7 zero size 2024-09-18T21:12:36.976 INFO:tasks.workunit.client.0.smithi077.stdout:0/41: dread f3 [0,4194304] 0 2024-09-18T21:12:36.977 INFO:tasks.workunit.client.0.smithi077.stdout:0/42: chown c7 239918447 1 2024-09-18T21:12:36.977 INFO:tasks.workunit.client.0.smithi077.stdout:6/54: dwrite d7/fc [0,4194304] 0 2024-09-18T21:12:36.978 INFO:tasks.workunit.client.0.smithi077.stdout:0/43: fsync f4 0 2024-09-18T21:12:36.978 INFO:tasks.workunit.client.0.smithi077.stdout:6/55: chown d7/df/d11 45 1 2024-09-18T21:12:36.979 INFO:tasks.workunit.client.0.smithi077.stdout:6/56: write f6 [239915,105299] 0 2024-09-18T21:12:36.980 INFO:tasks.workunit.client.0.smithi077.stdout:5/38: creat d0/d6/fb x:0 0 0 2024-09-18T21:12:36.982 INFO:tasks.workunit.client.0.smithi077.stdout:5/39: fsync d0/f2 0 2024-09-18T21:12:36.983 INFO:tasks.workunit.client.0.smithi077.stdout:6/57: unlink f6 0 2024-09-18T21:12:36.985 INFO:tasks.workunit.client.0.smithi077.stdout:0/44: mkdir d8/d9/dd 0 2024-09-18T21:12:36.987 INFO:tasks.workunit.client.0.smithi077.stdout:0/45: symlink d8/le 0 2024-09-18T21:12:36.989 INFO:tasks.workunit.client.0.smithi077.stdout:0/46: write f5 [1420250,83293] 0 2024-09-18T21:12:36.990 INFO:tasks.workunit.client.0.smithi077.stdout:5/40: link d0/d5/l9 d0/d6/lc 0 2024-09-18T21:12:36.992 INFO:tasks.workunit.client.0.smithi077.stdout:0/47: mknod d8/d9/cf 0 2024-09-18T21:12:36.992 INFO:tasks.workunit.client.0.smithi077.stdout:5/41: dread - d0/d6/fb zero size 2024-09-18T21:12:36.993 INFO:tasks.workunit.client.0.smithi077.stdout:6/58: dwrite d7/df/f14 [0,4194304] 0 2024-09-18T21:12:36.994 INFO:tasks.workunit.client.0.smithi077.stdout:0/48: write d8/fb [2819222,102163] 0 2024-09-18T21:12:36.998 INFO:tasks.workunit.client.0.smithi077.stdout:6/59: unlink d7/df/c10 0 2024-09-18T21:12:37.000 INFO:tasks.workunit.client.0.smithi077.stdout:0/49: rmdir d8/d9/dd 0 2024-09-18T21:12:37.002 INFO:tasks.workunit.client.0.smithi077.stdout:0/50: write d8/fb [4933680,111158] 0 2024-09-18T21:12:37.003 INFO:tasks.workunit.client.0.smithi077.stdout:0/51: fdatasync f5 0 2024-09-18T21:12:37.006 INFO:tasks.workunit.client.0.smithi077.stdout:5/42: dwrite d0/d6/fb [0,4194304] 0 2024-09-18T21:12:37.007 INFO:tasks.workunit.client.0.smithi077.stdout:0/52: mknod d8/c10 0 2024-09-18T21:12:37.007 INFO:tasks.workunit.client.0.smithi077.stdout:0/53: read f4 [647659,99163] 0 2024-09-18T21:12:37.011 INFO:tasks.workunit.client.0.smithi077.stdout:0/54: truncate f0 4878984 0 2024-09-18T21:12:37.013 INFO:tasks.workunit.client.0.smithi077.stdout:0/55: rmdir d8/d9 39 2024-09-18T21:12:37.014 INFO:tasks.workunit.client.0.smithi077.stdout:0/56: truncate f5 2049462 0 2024-09-18T21:12:37.014 INFO:tasks.workunit.client.0.smithi077.stdout:0/57: fdatasync f3 0 2024-09-18T21:12:37.015 INFO:tasks.workunit.client.0.smithi077.stdout:6/60: truncate d7/fc 895521 0 2024-09-18T21:12:37.016 INFO:tasks.workunit.client.0.smithi077.stdout:6/61: write d7/fa [467024,67674] 0 2024-09-18T21:12:37.022 INFO:tasks.workunit.client.0.smithi077.stdout:6/62: dwrite d7/fa [0,4194304] 0 2024-09-18T21:12:37.023 INFO:tasks.workunit.client.0.smithi077.stdout:6/63: truncate d7/fe 282167 0 2024-09-18T21:12:37.023 INFO:tasks.workunit.client.0.smithi077.stdout:5/43: fsync d0/d6/fb 0 2024-09-18T21:12:37.026 INFO:tasks.workunit.client.0.smithi077.stdout:6/64: rename d7/fa to d7/df/f15 0 2024-09-18T21:12:37.027 INFO:tasks.workunit.client.0.smithi077.stdout:5/44: mkdir d0/d6/dd 0 2024-09-18T21:12:37.030 INFO:tasks.workunit.client.0.smithi077.stdout:5/45: creat d0/d6/dd/fe x:0 0 0 2024-09-18T21:12:37.031 INFO:tasks.workunit.client.0.smithi077.stdout:6/65: dread d7/df/f14 [0,4194304] 0 2024-09-18T21:12:37.031 INFO:tasks.workunit.client.0.smithi077.stdout:6/66: stat l3 0 2024-09-18T21:12:37.031 INFO:tasks.workunit.client.0.smithi077.stdout:5/46: readlink d0/d5/l9 0 2024-09-18T21:12:37.032 INFO:tasks.workunit.client.0.smithi077.stdout:5/47: mkdir d0/df 0 2024-09-18T21:12:37.040 INFO:tasks.workunit.client.0.smithi077.stdout:5/48: dwrite d0/d5/f7 [0,4194304] 0 2024-09-18T21:12:37.044 INFO:tasks.workunit.client.0.smithi077.stdout:5/49: rename d0/d5 to d0/df/d10 0 2024-09-18T21:12:37.046 INFO:tasks.workunit.client.0.smithi077.stdout:5/50: creat d0/d6/dd/f11 x:0 0 0 2024-09-18T21:12:37.055 INFO:tasks.workunit.client.0.smithi077.stdout:5/51: truncate d0/df/d10/f8 2871802 0 2024-09-18T21:12:38.699 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:38 smithi077 ceph-mon[27689]: pgmap v10: 65 pgs: 65 active+clean; 301 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 211 KiB/s rd, 14 MiB/s wr, 253 op/s 2024-09-18T21:12:38.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:38 smithi103 ceph-mon[34827]: pgmap v10: 65 pgs: 65 active+clean; 301 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 211 KiB/s rd, 14 MiB/s wr, 253 op/s 2024-09-18T21:12:38.897 INFO:tasks.workunit.client.0.smithi077.stdout:1/1: sync 2024-09-18T21:12:38.897 INFO:tasks.workunit.client.0.smithi077.stdout:1/2: truncate - no filename 2024-09-18T21:12:38.898 INFO:tasks.workunit.client.0.smithi077.stdout:1/3: getdents . 0 2024-09-18T21:12:38.898 INFO:tasks.workunit.client.0.smithi077.stdout:1/4: dwrite - no filename 2024-09-18T21:12:38.898 INFO:tasks.workunit.client.0.smithi077.stdout:1/5: write - no filename 2024-09-18T21:12:38.898 INFO:tasks.workunit.client.0.smithi077.stdout:1/6: dwrite - no filename 2024-09-18T21:12:38.898 INFO:tasks.workunit.client.0.smithi077.stdout:1/7: chown . 12349628 1 2024-09-18T21:12:38.898 INFO:tasks.workunit.client.0.smithi077.stdout:1/8: truncate - no filename 2024-09-18T21:12:38.899 INFO:tasks.workunit.client.0.smithi077.stdout:1/9: mknod c0 0 2024-09-18T21:12:38.900 INFO:tasks.workunit.client.0.smithi077.stdout:1/10: creat f1 x:0 0 0 2024-09-18T21:12:38.901 INFO:tasks.workunit.client.0.smithi077.stdout:1/11: mknod c2 0 2024-09-18T21:12:38.902 INFO:tasks.workunit.client.0.smithi077.stdout:1/12: mkdir d3 0 2024-09-18T21:12:38.904 INFO:tasks.workunit.client.0.smithi077.stdout:1/13: creat d3/f4 x:0 0 0 2024-09-18T21:12:38.957 INFO:tasks.workunit.client.0.smithi077.stdout:5/52: sync 2024-09-18T21:12:38.957 INFO:tasks.workunit.client.0.smithi077.stdout:3/29: sync 2024-09-18T21:12:38.957 INFO:tasks.workunit.client.0.smithi077.stdout:2/1: sync 2024-09-18T21:12:38.957 INFO:tasks.workunit.client.0.smithi077.stdout:8/1: sync 2024-09-18T21:12:38.957 INFO:tasks.workunit.client.0.smithi077.stdout:4/26: sync 2024-09-18T21:12:38.957 INFO:tasks.workunit.client.0.smithi077.stdout:8/2: fsync - no filename 2024-09-18T21:12:38.958 INFO:tasks.workunit.client.0.smithi077.stdout:6/67: sync 2024-09-18T21:12:38.958 INFO:tasks.workunit.client.0.smithi077.stdout:9/18: sync 2024-09-18T21:12:38.958 INFO:tasks.workunit.client.0.smithi077.stdout:7/34: sync 2024-09-18T21:12:38.958 INFO:tasks.workunit.client.0.smithi077.stdout:0/58: sync 2024-09-18T21:12:38.958 INFO:tasks.workunit.client.0.smithi077.stdout:8/3: chown . 198 1 2024-09-18T21:12:38.958 INFO:tasks.workunit.client.0.smithi077.stdout:8/4: dwrite - no filename 2024-09-18T21:12:38.958 INFO:tasks.workunit.client.0.smithi077.stdout:8/5: dwrite - no filename 2024-09-18T21:12:38.958 INFO:tasks.workunit.client.0.smithi077.stdout:8/6: dwrite - no filename 2024-09-18T21:12:38.958 INFO:tasks.workunit.client.0.smithi077.stdout:9/19: chown d1 23658315 1 2024-09-18T21:12:38.959 INFO:tasks.workunit.client.0.smithi077.stdout:3/30: write f4 [4440401,3081] 0 2024-09-18T21:12:38.960 INFO:tasks.workunit.client.0.smithi077.stdout:3/31: read f5 [2137534,71543] 0 2024-09-18T21:12:38.961 INFO:tasks.workunit.client.0.smithi077.stdout:2/2: mknod c0 0 2024-09-18T21:12:38.961 INFO:tasks.workunit.client.0.smithi077.stdout:2/3: dwrite - no filename 2024-09-18T21:12:38.961 INFO:tasks.workunit.client.0.smithi077.stdout:2/4: chown c0 1309371913 1 2024-09-18T21:12:38.962 INFO:tasks.workunit.client.0.smithi077.stdout:4/27: creat d3/fa x:0 0 0 2024-09-18T21:12:38.963 INFO:tasks.workunit.client.0.smithi077.stdout:4/28: write d3/f5 [649185,45423] 0 2024-09-18T21:12:38.964 INFO:tasks.workunit.client.0.smithi077.stdout:7/35: rename f3 to fd 0 2024-09-18T21:12:38.964 INFO:tasks.workunit.client.0.smithi077.stdout:4/29: read d3/f5 [686581,71418] 0 2024-09-18T21:12:38.965 INFO:tasks.workunit.client.0.smithi077.stdout:5/53: mkdir d0/d6/d12 0 2024-09-18T21:12:38.966 INFO:tasks.workunit.client.0.smithi077.stdout:9/20: rmdir d1 39 2024-09-18T21:12:38.970 INFO:tasks.workunit.client.0.smithi077.stdout:0/59: creat d8/d9/f11 x:0 0 0 2024-09-18T21:12:38.972 INFO:tasks.workunit.client.0.smithi077.stdout:3/32: symlink l6 0 2024-09-18T21:12:38.972 INFO:tasks.workunit.client.0.smithi077.stdout:8/7: creat f0 x:0 0 0 2024-09-18T21:12:38.973 INFO:tasks.workunit.client.0.smithi077.stdout:3/33: readlink l2 0 2024-09-18T21:12:38.973 INFO:tasks.workunit.client.0.smithi077.stdout:2/5: mkdir d1 0 2024-09-18T21:12:38.976 INFO:tasks.workunit.client.0.smithi077.stdout:7/36: unlink f0 0 2024-09-18T21:12:38.979 INFO:tasks.workunit.client.0.smithi077.stdout:4/30: dwrite d3/f5 [0,4194304] 0 2024-09-18T21:12:38.979 INFO:tasks.workunit.client.0.smithi077.stdout:7/37: fsync f5 0 2024-09-18T21:12:38.981 INFO:tasks.workunit.client.0.smithi077.stdout:5/54: dwrite d0/d6/dd/f11 [0,4194304] 0 2024-09-18T21:12:38.983 INFO:tasks.workunit.client.0.smithi077.stdout:3/34: creat f7 x:0 0 0 2024-09-18T21:12:38.987 INFO:tasks.workunit.client.0.smithi077.stdout:7/38: symlink le 0 2024-09-18T21:12:38.989 INFO:tasks.workunit.client.0.smithi077.stdout:6/68: dwrite d7/df/f15 [0,4194304] 0 2024-09-18T21:12:38.990 INFO:tasks.workunit.client.0.smithi077.stdout:3/35: symlink l8 0 2024-09-18T21:12:38.991 INFO:tasks.workunit.client.0.smithi077.stdout:2/6: mknod d1/c2 0 2024-09-18T21:12:38.991 INFO:tasks.workunit.client.0.smithi077.stdout:2/7: truncate - no filename 2024-09-18T21:12:38.991 INFO:tasks.workunit.client.0.smithi077.stdout:3/36: readlink l6 0 2024-09-18T21:12:38.993 INFO:tasks.workunit.client.0.smithi077.stdout:9/21: truncate d1/f3 795924 0 2024-09-18T21:12:38.994 INFO:tasks.workunit.client.0.smithi077.stdout:3/37: chown f3 53450 1 2024-09-18T21:12:38.994 INFO:tasks.workunit.client.0.smithi077.stdout:8/8: dwrite f0 [0,4194304] 0 2024-09-18T21:12:38.995 INFO:tasks.workunit.client.0.smithi077.stdout:3/38: dread - f7 zero size 2024-09-18T21:12:38.996 INFO:tasks.workunit.client.0.smithi077.stdout:2/8: creat d1/f3 x:0 0 0 2024-09-18T21:12:38.997 INFO:tasks.workunit.client.0.smithi077.stdout:4/31: dread d3/f5 [0,4194304] 0 2024-09-18T21:12:38.999 INFO:tasks.workunit.client.0.smithi077.stdout:2/9: truncate d1/f3 911747 0 2024-09-18T21:12:39.000 INFO:tasks.workunit.client.0.smithi077.stdout:2/10: read d1/f3 [251301,36426] 0 2024-09-18T21:12:39.001 INFO:tasks.workunit.client.0.smithi077.stdout:8/9: creat f1 x:0 0 0 2024-09-18T21:12:39.002 INFO:tasks.workunit.client.0.smithi077.stdout:0/60: getdents d8 0 2024-09-18T21:12:39.002 INFO:tasks.workunit.client.0.smithi077.stdout:8/10: truncate f1 526711 0 2024-09-18T21:12:39.004 INFO:tasks.workunit.client.0.smithi077.stdout:3/39: creat f9 x:0 0 0 2024-09-18T21:12:39.005 INFO:tasks.workunit.client.0.smithi077.stdout:6/69: creat d7/df/d11/f16 x:0 0 0 2024-09-18T21:12:39.006 INFO:tasks.workunit.client.0.smithi077.stdout:5/55: rmdir d0/d6/d12 0 2024-09-18T21:12:39.007 INFO:tasks.workunit.client.0.smithi077.stdout:4/32: creat d3/fb x:0 0 0 2024-09-18T21:12:39.010 INFO:tasks.workunit.client.0.smithi077.stdout:2/11: mkdir d1/d4 0 2024-09-18T21:12:39.012 INFO:tasks.workunit.client.0.smithi077.stdout:7/39: link c8 cf 0 2024-09-18T21:12:39.013 INFO:tasks.workunit.client.0.smithi077.stdout:3/40: creat fa x:0 0 0 2024-09-18T21:12:39.014 INFO:tasks.workunit.client.0.smithi077.stdout:6/70: symlink d7/df/l17 0 2024-09-18T21:12:39.016 INFO:tasks.workunit.client.0.smithi077.stdout:4/33: mkdir d3/dc 0 2024-09-18T21:12:39.016 INFO:tasks.workunit.client.0.smithi077.stdout:6/71: truncate d7/df/d11/f16 721302 0 2024-09-18T21:12:39.019 INFO:tasks.workunit.client.0.smithi077.stdout:6/72: write d7/df/d11/f16 [488079,88394] 0 2024-09-18T21:12:39.021 INFO:tasks.workunit.client.0.smithi077.stdout:2/12: write d1/f3 [1329096,82630] 0 2024-09-18T21:12:39.022 INFO:tasks.workunit.client.0.smithi077.stdout:6/73: chown l5 0 1 2024-09-18T21:12:39.024 INFO:tasks.workunit.client.0.smithi077.stdout:7/40: creat f10 x:0 0 0 2024-09-18T21:12:39.024 INFO:tasks.workunit.client.0.smithi077.stdout:3/41: dwrite f3 [0,4194304] 0 2024-09-18T21:12:39.027 INFO:tasks.workunit.client.0.smithi077.stdout:7/41: symlink l11 0 2024-09-18T21:12:39.027 INFO:tasks.workunit.client.0.smithi077.stdout:2/13: mkdir d1/d4/d5 0 2024-09-18T21:12:39.031 INFO:tasks.workunit.client.0.smithi077.stdout:3/42: write f4 [2552321,49615] 0 2024-09-18T21:12:39.031 INFO:tasks.workunit.client.0.smithi077.stdout:4/34: dwrite d3/fb [0,4194304] 0 2024-09-18T21:12:39.032 INFO:tasks.workunit.client.0.smithi077.stdout:7/42: mkdir d12 0 2024-09-18T21:12:39.041 INFO:tasks.workunit.client.0.smithi077.stdout:3/43: mkdir db 0 2024-09-18T21:12:39.044 INFO:tasks.workunit.client.0.smithi077.stdout:6/74: dwrite d7/df/d11/f16 [0,4194304] 0 2024-09-18T21:12:39.047 INFO:tasks.workunit.client.0.smithi077.stdout:7/43: symlink d12/l13 0 2024-09-18T21:12:39.050 INFO:tasks.workunit.client.0.smithi077.stdout:3/44: symlink db/lc 0 2024-09-18T21:12:39.050 INFO:tasks.workunit.client.0.smithi077.stdout:2/14: dwrite d1/f3 [0,4194304] 0 2024-09-18T21:12:39.053 INFO:tasks.workunit.client.0.smithi077.stdout:3/45: symlink db/ld 0 2024-09-18T21:12:39.054 INFO:tasks.workunit.client.0.smithi077.stdout:6/75: dread d7/df/f15 [0,4194304] 0 2024-09-18T21:12:39.059 INFO:tasks.workunit.client.0.smithi077.stdout:3/46: rename l2 to db/le 0 2024-09-18T21:12:39.061 INFO:tasks.workunit.client.0.smithi077.stdout:6/76: creat d7/df/d11/f18 x:0 0 0 2024-09-18T21:12:39.061 INFO:tasks.workunit.client.0.smithi077.stdout:6/77: readlink l3 0 2024-09-18T21:12:39.062 INFO:tasks.workunit.client.0.smithi077.stdout:6/78: read d7/df/f14 [1495743,57156] 0 2024-09-18T21:12:39.066 INFO:tasks.workunit.client.0.smithi077.stdout:6/79: dread d7/df/d11/f16 [0,4194304] 0 2024-09-18T21:12:39.084 INFO:tasks.workunit.client.0.smithi077.stdout:1/14: rmdir d3 39 2024-09-18T21:12:39.086 INFO:tasks.workunit.client.0.smithi077.stdout:1/15: creat d3/f5 x:0 0 0 2024-09-18T21:12:39.087 INFO:tasks.workunit.client.0.smithi077.stdout:1/16: dread - f1 zero size 2024-09-18T21:12:39.091 INFO:tasks.workunit.client.0.smithi077.stdout:1/17: rename d3/f5 to d3/f6 0 2024-09-18T21:12:39.093 INFO:tasks.workunit.client.0.smithi077.stdout:7/44: write fd [24101,25835] 0 2024-09-18T21:12:39.094 INFO:tasks.workunit.client.0.smithi077.stdout:7/45: chown l7 3527129 1 2024-09-18T21:12:39.095 INFO:tasks.workunit.client.0.smithi077.stdout:7/46: fdatasync fa 0 2024-09-18T21:12:39.096 INFO:tasks.workunit.client.0.smithi077.stdout:1/18: write d3/f6 [16245,31777] 0 2024-09-18T21:12:39.097 INFO:tasks.workunit.client.0.smithi077.stdout:5/56: dwrite d0/df/d10/f8 [0,4194304] 0 2024-09-18T21:12:39.100 INFO:tasks.workunit.client.0.smithi077.stdout:1/19: symlink d3/l7 0 2024-09-18T21:12:39.100 INFO:tasks.workunit.client.0.smithi077.stdout:1/20: chown d3 317903 1 2024-09-18T21:12:39.101 INFO:tasks.workunit.client.0.smithi077.stdout:1/21: truncate d3/f4 564569 0 2024-09-18T21:12:39.101 INFO:tasks.workunit.client.0.smithi077.stdout:5/57: unlink d0/df/d10/l9 0 2024-09-18T21:12:39.102 INFO:tasks.workunit.client.0.smithi077.stdout:5/58: symlink d0/l13 0 2024-09-18T21:12:39.103 INFO:tasks.workunit.client.0.smithi077.stdout:1/22: mkdir d3/d8 0 2024-09-18T21:12:39.110 INFO:tasks.workunit.client.0.smithi077.stdout:5/59: dwrite d0/f2 [0,4194304] 0 2024-09-18T21:12:39.111 INFO:tasks.workunit.client.0.smithi077.stdout:2/15: getdents d1 0 2024-09-18T21:12:39.114 INFO:tasks.workunit.client.0.smithi077.stdout:2/16: creat d1/f6 x:0 0 0 2024-09-18T21:12:39.115 INFO:tasks.workunit.client.0.smithi077.stdout:0/61: truncate f5 976830 0 2024-09-18T21:12:39.117 INFO:tasks.workunit.client.0.smithi077.stdout:8/11: truncate f0 2681686 0 2024-09-18T21:12:39.118 INFO:tasks.workunit.client.0.smithi077.stdout:5/60: dwrite d0/df/d10/f7 [0,4194304] 0 2024-09-18T21:12:39.118 INFO:tasks.workunit.client.0.smithi077.stdout:0/62: symlink d8/d9/l12 0 2024-09-18T21:12:39.119 INFO:tasks.workunit.client.0.smithi077.stdout:0/63: read f4 [3264798,73805] 0 2024-09-18T21:12:39.119 INFO:tasks.workunit.client.0.smithi077.stdout:5/61: chown d0/d6/dd/fe 412951 1 2024-09-18T21:12:39.120 INFO:tasks.workunit.client.0.smithi077.stdout:2/17: creat d1/d4/d5/f7 x:0 0 0 2024-09-18T21:12:39.122 INFO:tasks.workunit.client.0.smithi077.stdout:2/18: dread - d1/f6 zero size 2024-09-18T21:12:39.122 INFO:tasks.workunit.client.0.smithi077.stdout:2/19: write d1/f3 [3523679,9865] 0 2024-09-18T21:12:39.123 INFO:tasks.workunit.client.0.smithi077.stdout:8/12: mkdir d2 0 2024-09-18T21:12:39.125 INFO:tasks.workunit.client.0.smithi077.stdout:0/64: creat d8/f13 x:0 0 0 2024-09-18T21:12:39.127 INFO:tasks.workunit.client.0.smithi077.stdout:5/62: mknod d0/d6/c14 0 2024-09-18T21:12:39.130 INFO:tasks.workunit.client.0.smithi077.stdout:2/20: creat d1/d4/f8 x:0 0 0 2024-09-18T21:12:39.133 INFO:tasks.workunit.client.0.smithi077.stdout:8/13: dwrite f1 [0,4194304] 0 2024-09-18T21:12:39.136 INFO:tasks.workunit.client.0.smithi077.stdout:5/63: fdatasync d0/df/d10/f7 0 2024-09-18T21:12:39.138 INFO:tasks.workunit.client.0.smithi077.stdout:7/47: mknod d12/c14 0 2024-09-18T21:12:39.139 INFO:tasks.workunit.client.0.smithi077.stdout:4/35: dwrite d3/fb [4194304,4194304] 0 2024-09-18T21:12:39.140 INFO:tasks.workunit.client.0.smithi077.stdout:3/47: stat db/le 0 2024-09-18T21:12:39.140 INFO:tasks.workunit.client.0.smithi077.stdout:2/21: mkdir d1/d4/d9 0 2024-09-18T21:12:39.141 INFO:tasks.workunit.client.0.smithi077.stdout:6/80: fsync d7/df/d11/f18 0 2024-09-18T21:12:39.144 INFO:tasks.workunit.client.0.smithi077.stdout:2/22: dread - d1/d4/d5/f7 zero size 2024-09-18T21:12:39.144 INFO:tasks.workunit.client.0.smithi077.stdout:8/14: fdatasync f0 0 2024-09-18T21:12:39.146 INFO:tasks.workunit.client.0.smithi077.stdout:1/23: rename d3/f6 to d3/f9 0 2024-09-18T21:12:39.153 INFO:tasks.workunit.client.0.smithi077.stdout:9/22: write d1/f3 [1008078,120075] 0 2024-09-18T21:12:39.154 INFO:tasks.workunit.client.0.smithi077.stdout:3/48: dwrite f5 [0,4194304] 0 2024-09-18T21:12:39.157 INFO:tasks.workunit.client.0.smithi077.stdout:4/36: unlink d3/l9 0 2024-09-18T21:12:39.161 INFO:tasks.workunit.client.0.smithi077.stdout:8/15: dwrite f1 [0,4194304] 0 2024-09-18T21:12:39.161 INFO:tasks.workunit.client.0.smithi077.stdout:2/23: mknod d1/d4/d9/ca 0 2024-09-18T21:12:39.162 INFO:tasks.workunit.client.0.smithi077.stdout:1/24: symlink d3/d8/la 0 2024-09-18T21:12:39.165 INFO:tasks.workunit.client.0.smithi077.stdout:4/37: fsync d3/f5 0 2024-09-18T21:12:39.166 INFO:tasks.workunit.client.0.smithi077.stdout:1/25: truncate f1 518247 0 2024-09-18T21:12:39.169 INFO:tasks.workunit.client.0.smithi077.stdout:3/49: dwrite fa [0,4194304] 0 2024-09-18T21:12:39.171 INFO:tasks.workunit.client.0.smithi077.stdout:2/24: creat d1/d4/d9/fb x:0 0 0 2024-09-18T21:12:39.172 INFO:tasks.workunit.client.0.smithi077.stdout:2/25: fsync d1/f3 0 2024-09-18T21:12:39.173 INFO:tasks.workunit.client.0.smithi077.stdout:9/23: rename d1/l5 to d1/l6 0 2024-09-18T21:12:39.199 INFO:tasks.workunit.client.0.smithi077.stdout:4/38: creat d3/d7/fd x:0 0 0 2024-09-18T21:12:39.200 INFO:tasks.workunit.client.0.smithi077.stdout:1/26: creat d3/fb x:0 0 0 2024-09-18T21:12:39.200 INFO:tasks.workunit.client.0.smithi077.stdout:7/48: getdents d12 0 2024-09-18T21:12:39.201 INFO:tasks.workunit.client.0.smithi077.stdout:8/16: mknod d2/c3 0 2024-09-18T21:12:39.202 INFO:tasks.workunit.client.0.smithi077.stdout:8/17: chown d2 512 1 2024-09-18T21:12:39.202 INFO:tasks.workunit.client.0.smithi077.stdout:3/50: dwrite f7 [0,4194304] 0 2024-09-18T21:12:39.203 INFO:tasks.workunit.client.0.smithi077.stdout:8/18: rename d2 to d2/d4 22 2024-09-18T21:12:39.203 INFO:tasks.workunit.client.0.smithi077.stdout:5/64: truncate d0/f2 2333263 0 2024-09-18T21:12:39.203 INFO:tasks.workunit.client.0.smithi077.stdout:2/26: symlink d1/lc 0 2024-09-18T21:12:39.203 INFO:tasks.workunit.client.0.smithi077.stdout:3/51: write f3 [4626392,10836] 0 2024-09-18T21:12:39.204 INFO:tasks.workunit.client.0.smithi077.stdout:9/24: mknod d1/c7 0 2024-09-18T21:12:39.207 INFO:tasks.workunit.client.0.smithi077.stdout:9/25: dread d1/f3 [0,4194304] 0 2024-09-18T21:12:39.347 INFO:tasks.workunit.client.0.smithi077.stdout:7/49: symlink d12/l15 0 2024-09-18T21:12:39.347 INFO:tasks.workunit.client.0.smithi077.stdout:1/27: mknod d3/d8/cc 0 2024-09-18T21:12:39.347 INFO:tasks.workunit.client.0.smithi077.stdout:1/28: fsync d3/f4 0 2024-09-18T21:12:39.348 INFO:tasks.workunit.client.0.smithi077.stdout:0/65: creat d8/f14 x:0 0 0 2024-09-18T21:12:39.348 INFO:tasks.workunit.client.0.smithi077.stdout:0/66: stat c7 0 2024-09-18T21:12:39.349 INFO:tasks.workunit.client.0.smithi077.stdout:8/19: mkdir d2/d5 0 2024-09-18T21:12:39.349 INFO:tasks.workunit.client.0.smithi077.stdout:8/20: chown d2/d5 6038154 1 2024-09-18T21:12:39.351 INFO:tasks.workunit.client.0.smithi077.stdout:2/27: rmdir d1/d4 39 2024-09-18T21:12:39.352 INFO:tasks.workunit.client.0.smithi077.stdout:8/21: dread f0 [0,4194304] 0 2024-09-18T21:12:39.353 INFO:tasks.workunit.client.0.smithi077.stdout:3/52: creat db/ff x:0 0 0 2024-09-18T21:12:39.355 INFO:tasks.workunit.client.0.smithi077.stdout:7/50: write f10 [251699,96603] 0 2024-09-18T21:12:39.357 INFO:tasks.workunit.client.0.smithi077.stdout:1/29: rename d3/fb to d3/fd 0 2024-09-18T21:12:39.360 INFO:tasks.workunit.client.0.smithi077.stdout:3/53: creat db/f10 x:0 0 0 2024-09-18T21:12:39.360 INFO:tasks.workunit.client.0.smithi077.stdout:1/30: dread d3/f4 [0,4194304] 0 2024-09-18T21:12:39.362 INFO:tasks.workunit.client.0.smithi077.stdout:7/51: dread - fc zero size 2024-09-18T21:12:39.363 INFO:tasks.workunit.client.0.smithi077.stdout:5/65: mknod d0/d6/c15 0 2024-09-18T21:12:39.365 INFO:tasks.workunit.client.0.smithi077.stdout:8/22: mkdir d2/d5/d6 0 2024-09-18T21:12:39.367 INFO:tasks.workunit.client.0.smithi077.stdout:4/39: getdents d3/d7 0 2024-09-18T21:12:39.368 INFO:tasks.workunit.client.0.smithi077.stdout:7/52: mknod d12/c16 0 2024-09-18T21:12:39.371 INFO:tasks.workunit.client.0.smithi077.stdout:8/23: unlink f0 0 2024-09-18T21:12:39.372 INFO:tasks.workunit.client.0.smithi077.stdout:9/26: getdents d1 0 2024-09-18T21:12:39.374 INFO:tasks.workunit.client.0.smithi077.stdout:7/53: symlink d12/l17 0 2024-09-18T21:12:39.375 INFO:tasks.workunit.client.0.smithi077.stdout:8/24: dread f1 [0,4194304] 0 2024-09-18T21:12:39.376 INFO:tasks.workunit.client.0.smithi077.stdout:4/40: getdents d3/dc 0 2024-09-18T21:12:39.376 INFO:tasks.workunit.client.0.smithi077.stdout:4/41: chown d3 40 1 2024-09-18T21:12:39.378 INFO:tasks.workunit.client.0.smithi077.stdout:7/54: write fb [1053714,44817] 0 2024-09-18T21:12:39.378 INFO:tasks.workunit.client.0.smithi077.stdout:2/28: getdents d1/d4/d9 0 2024-09-18T21:12:39.382 INFO:tasks.workunit.client.0.smithi077.stdout:4/42: mknod d3/d7/ce 0 2024-09-18T21:12:39.384 INFO:tasks.workunit.client.0.smithi077.stdout:4/43: symlink d3/d7/lf 0 2024-09-18T21:12:39.385 INFO:tasks.workunit.client.0.smithi077.stdout:4/44: write d3/f5 [4333097,83986] 0 2024-09-18T21:12:39.386 INFO:tasks.workunit.client.0.smithi077.stdout:7/55: rename l4 to d12/l18 0 2024-09-18T21:12:39.386 INFO:tasks.workunit.client.0.smithi077.stdout:4/45: read - d3/fa zero size 2024-09-18T21:12:39.387 INFO:tasks.workunit.client.0.smithi077.stdout:4/46: truncate d3/fa 940373 0 2024-09-18T21:12:39.388 INFO:tasks.workunit.client.0.smithi077.stdout:2/29: creat d1/fd x:0 0 0 2024-09-18T21:12:39.389 INFO:tasks.workunit.client.0.smithi077.stdout:2/30: chown d1/d4/d9 54 1 2024-09-18T21:12:39.389 INFO:tasks.workunit.client.0.smithi077.stdout:7/56: mknod d12/c19 0 2024-09-18T21:12:39.391 INFO:tasks.workunit.client.0.smithi077.stdout:7/57: dread - fc zero size 2024-09-18T21:12:39.391 INFO:tasks.workunit.client.0.smithi077.stdout:4/47: symlink d3/dc/l10 0 2024-09-18T21:12:39.392 INFO:tasks.workunit.client.0.smithi077.stdout:4/48: write d3/d7/fd [11429,35966] 0 2024-09-18T21:12:39.394 INFO:tasks.workunit.client.0.smithi077.stdout:4/49: write d3/fa [760050,38898] 0 2024-09-18T21:12:39.396 INFO:tasks.workunit.client.0.smithi077.stdout:4/50: creat d3/d7/f11 x:0 0 0 2024-09-18T21:12:39.397 INFO:tasks.workunit.client.0.smithi077.stdout:4/51: rename d3 to d3/d12 22 2024-09-18T21:12:39.399 INFO:tasks.workunit.client.0.smithi077.stdout:7/58: dwrite f1 [0,4194304] 0 2024-09-18T21:12:39.399 INFO:tasks.workunit.client.0.smithi077.stdout:4/52: creat d3/d7/f13 x:0 0 0 2024-09-18T21:12:39.401 INFO:tasks.workunit.client.0.smithi077.stdout:7/59: mknod d12/c1a 0 2024-09-18T21:12:39.403 INFO:tasks.workunit.client.0.smithi077.stdout:4/53: mknod d3/d7/c14 0 2024-09-18T21:12:39.405 INFO:tasks.workunit.client.0.smithi077.stdout:4/54: mknod d3/c15 0 2024-09-18T21:12:39.405 INFO:tasks.workunit.client.0.smithi077.stdout:7/60: read f5 [143951,40287] 0 2024-09-18T21:12:39.408 INFO:tasks.workunit.client.0.smithi077.stdout:7/61: creat d12/f1b x:0 0 0 2024-09-18T21:12:39.413 INFO:tasks.workunit.client.0.smithi077.stdout:4/55: dwrite d3/f5 [0,4194304] 0 2024-09-18T21:12:39.414 INFO:tasks.workunit.client.0.smithi077.stdout:4/56: write d3/d7/f13 [844139,6777] 0 2024-09-18T21:12:39.415 INFO:tasks.workunit.client.0.smithi077.stdout:4/57: write d3/f5 [5051407,92589] 0 2024-09-18T21:12:39.417 INFO:tasks.workunit.client.0.smithi077.stdout:4/58: chown d3/d7/f11 63046641 1 2024-09-18T21:12:39.523 INFO:tasks.workunit.client.0.smithi077.stdout:0/67: rmdir d8 39 2024-09-18T21:12:39.525 INFO:tasks.workunit.client.0.smithi077.stdout:0/68: write d8/f14 [838012,100178] 0 2024-09-18T21:12:39.525 INFO:tasks.workunit.client.0.smithi077.stdout:8/25: getdents d2 0 2024-09-18T21:12:39.527 INFO:tasks.workunit.client.0.smithi077.stdout:8/26: symlink d2/l7 0 2024-09-18T21:12:39.531 INFO:tasks.workunit.client.0.smithi077.stdout:1/31: rmdir d3 39 2024-09-18T21:12:39.532 INFO:tasks.workunit.client.0.smithi077.stdout:5/66: truncate d0/f2 2528093 0 2024-09-18T21:12:39.533 INFO:tasks.workunit.client.0.smithi077.stdout:9/27: truncate d1/f3 353589 0 2024-09-18T21:12:39.534 INFO:tasks.workunit.client.0.smithi077.stdout:9/28: stat d1/l6 0 2024-09-18T21:12:39.535 INFO:tasks.workunit.client.0.smithi077.stdout:1/32: read - d3/fd zero size 2024-09-18T21:12:39.535 INFO:tasks.workunit.client.0.smithi077.stdout:9/29: stat d1/l6 0 2024-09-18T21:12:39.535 INFO:tasks.workunit.client.0.smithi077.stdout:5/67: mknod d0/df/c16 0 2024-09-18T21:12:39.537 INFO:tasks.workunit.client.0.smithi077.stdout:8/27: dwrite f1 [0,4194304] 0 2024-09-18T21:12:39.539 INFO:tasks.workunit.client.0.smithi077.stdout:1/33: mkdir d3/d8/de 0 2024-09-18T21:12:39.541 INFO:tasks.workunit.client.0.smithi077.stdout:9/30: rename d1/c7 to d1/c8 0 2024-09-18T21:12:39.547 INFO:tasks.workunit.client.0.smithi077.stdout:5/68: symlink d0/d6/l17 0 2024-09-18T21:12:39.550 INFO:tasks.workunit.client.0.smithi077.stdout:5/69: creat d0/f18 x:0 0 0 2024-09-18T21:12:39.551 INFO:tasks.workunit.client.0.smithi077.stdout:1/34: rmdir d3/d8/de 0 2024-09-18T21:12:39.555 INFO:tasks.workunit.client.0.smithi077.stdout:1/35: rename f1 to d3/ff 0 2024-09-18T21:12:39.555 INFO:tasks.workunit.client.0.smithi077.stdout:4/59: fsync d3/d7/f13 0 2024-09-18T21:12:39.560 INFO:tasks.workunit.client.0.smithi077.stdout:4/60: link d3/d7/fd d3/dc/f16 0 2024-09-18T21:12:39.560 INFO:tasks.workunit.client.0.smithi077.stdout:4/61: chown l1 1533943 1 2024-09-18T21:12:39.563 INFO:tasks.workunit.client.0.smithi077.stdout:8/28: dwrite f1 [0,4194304] 0 2024-09-18T21:12:39.566 INFO:tasks.workunit.client.0.smithi077.stdout:9/31: chown d1/c8 18 1 2024-09-18T21:12:39.571 INFO:tasks.workunit.client.0.smithi077.stdout:9/32: mknod d1/c9 0 2024-09-18T21:12:39.572 INFO:tasks.workunit.client.0.smithi077.stdout:0/69: dwrite f5 [0,4194304] 0 2024-09-18T21:12:39.575 INFO:tasks.workunit.client.0.smithi077.stdout:1/36: write d3/f9 [202050,30825] 0 2024-09-18T21:12:39.578 INFO:tasks.workunit.client.0.smithi077.stdout:8/29: dread f1 [0,4194304] 0 2024-09-18T21:12:39.579 INFO:tasks.workunit.client.0.smithi077.stdout:4/62: dwrite d3/d7/f11 [0,4194304] 0 2024-09-18T21:12:39.581 INFO:tasks.workunit.client.0.smithi077.stdout:5/70: creat d0/d6/dd/f19 x:0 0 0 2024-09-18T21:12:39.584 INFO:tasks.workunit.client.0.smithi077.stdout:4/63: mkdir d3/d17 0 2024-09-18T21:12:39.586 INFO:tasks.workunit.client.0.smithi077.stdout:0/70: rename f4 to d8/d9/f15 0 2024-09-18T21:12:39.590 INFO:tasks.workunit.client.0.smithi077.stdout:1/37: link d3/fd d3/f10 0 2024-09-18T21:12:39.590 INFO:tasks.workunit.client.0.smithi077.stdout:1/38: chown d3/f4 7 1 2024-09-18T21:12:39.591 INFO:tasks.workunit.client.0.smithi077.stdout:9/33: write d1/f3 [328301,22966] 0 2024-09-18T21:12:39.593 INFO:tasks.workunit.client.0.smithi077.stdout:4/64: unlink d3/d7/l8 0 2024-09-18T21:12:39.594 INFO:tasks.workunit.client.0.smithi077.stdout:8/30: fdatasync f1 0 2024-09-18T21:12:39.595 INFO:tasks.workunit.client.0.smithi077.stdout:4/65: chown l0 913 1 2024-09-18T21:12:39.596 INFO:tasks.workunit.client.0.smithi077.stdout:0/71: creat d8/f16 x:0 0 0 2024-09-18T21:12:39.597 INFO:tasks.workunit.client.0.smithi077.stdout:9/34: fdatasync d1/f3 0 2024-09-18T21:12:39.599 INFO:tasks.workunit.client.0.smithi077.stdout:8/31: unlink d2/l7 0 2024-09-18T21:12:39.600 INFO:tasks.workunit.client.0.smithi077.stdout:5/71: fsync d0/d6/dd/f19 0 2024-09-18T21:12:39.602 INFO:tasks.workunit.client.0.smithi077.stdout:1/39: dwrite d3/f4 [0,4194304] 0 2024-09-18T21:12:39.604 INFO:tasks.workunit.client.0.smithi077.stdout:9/35: rename d1/c9 to d1/ca 0 2024-09-18T21:12:39.607 INFO:tasks.workunit.client.0.smithi077.stdout:4/66: truncate d3/d7/f13 731952 0 2024-09-18T21:12:39.609 INFO:tasks.workunit.client.0.smithi077.stdout:0/72: creat d8/f17 x:0 0 0 2024-09-18T21:12:39.609 INFO:tasks.workunit.client.0.smithi077.stdout:4/67: stat d3/f5 0 2024-09-18T21:12:39.609 INFO:tasks.workunit.client.0.smithi077.stdout:5/72: symlink d0/df/l1a 0 2024-09-18T21:12:39.610 INFO:tasks.workunit.client.0.smithi077.stdout:1/40: symlink d3/d8/l11 0 2024-09-18T21:12:39.611 INFO:tasks.workunit.client.0.smithi077.stdout:0/73: dread - d8/f13 zero size 2024-09-18T21:12:39.612 INFO:tasks.workunit.client.0.smithi077.stdout:8/32: creat d2/d5/d6/f8 x:0 0 0 2024-09-18T21:12:39.613 INFO:tasks.workunit.client.0.smithi077.stdout:4/68: chown d3/d7/f13 51 1 2024-09-18T21:12:39.614 INFO:tasks.workunit.client.0.smithi077.stdout:5/73: chown d0/df/d10/f8 32729132 1 2024-09-18T21:12:39.617 INFO:tasks.workunit.client.0.smithi077.stdout:9/36: dwrite d1/f3 [0,4194304] 0 2024-09-18T21:12:39.617 INFO:tasks.workunit.client.0.smithi077.stdout:8/33: mknod d2/c9 0 2024-09-18T21:12:39.617 INFO:tasks.workunit.client.0.smithi077.stdout:5/74: chown d0/df/d10/f8 163 1 2024-09-18T21:12:39.619 INFO:tasks.workunit.client.0.smithi077.stdout:4/69: creat d3/f18 x:0 0 0 2024-09-18T21:12:39.624 INFO:tasks.workunit.client.0.smithi077.stdout:4/70: write d3/d7/f11 [2479165,45236] 0 2024-09-18T21:12:39.624 INFO:tasks.workunit.client.0.smithi077.stdout:9/37: creat d1/fb x:0 0 0 2024-09-18T21:12:39.626 INFO:tasks.workunit.client.0.smithi077.stdout:0/74: rmdir d8 39 2024-09-18T21:12:39.629 INFO:tasks.workunit.client.0.smithi077.stdout:4/71: mknod d3/d7/c19 0 2024-09-18T21:12:39.630 INFO:tasks.workunit.client.0.smithi077.stdout:8/34: dwrite f1 [0,4194304] 0 2024-09-18T21:12:39.631 INFO:tasks.workunit.client.0.smithi077.stdout:5/75: dread d0/f2 [0,4194304] 0 2024-09-18T21:12:39.631 INFO:tasks.workunit.client.0.smithi077.stdout:1/41: getdents d3 0 2024-09-18T21:12:39.633 INFO:tasks.workunit.client.0.smithi077.stdout:4/72: read d3/d7/f11 [941676,29233] 0 2024-09-18T21:12:39.633 INFO:tasks.workunit.client.0.smithi077.stdout:5/76: stat d0/l1 0 2024-09-18T21:12:39.634 INFO:tasks.workunit.client.0.smithi077.stdout:0/75: truncate d8/f13 521326 0 2024-09-18T21:12:39.634 INFO:tasks.workunit.client.0.smithi077.stdout:1/42: truncate d3/ff 617897 0 2024-09-18T21:12:39.636 INFO:tasks.workunit.client.0.smithi077.stdout:8/35: write d2/d5/d6/f8 [966032,74160] 0 2024-09-18T21:12:39.638 INFO:tasks.workunit.client.0.smithi077.stdout:9/38: dread d1/f3 [0,4194304] 0 2024-09-18T21:12:39.641 INFO:tasks.workunit.client.0.smithi077.stdout:9/39: chown d1/fb 1109587339 1 2024-09-18T21:12:39.642 INFO:tasks.workunit.client.0.smithi077.stdout:0/76: dread d8/f14 [0,4194304] 0 2024-09-18T21:12:39.645 INFO:tasks.workunit.client.0.smithi077.stdout:0/77: truncate d8/f17 894182 0 2024-09-18T21:12:39.645 INFO:tasks.workunit.client.0.smithi077.stdout:8/36: link d2/d5/d6/f8 d2/d5/fa 0 2024-09-18T21:12:39.646 INFO:tasks.workunit.client.0.smithi077.stdout:9/40: mknod d1/cc 0 2024-09-18T21:12:39.646 INFO:tasks.workunit.client.0.smithi077.stdout:1/43: dwrite d3/f9 [0,4194304] 0 2024-09-18T21:12:39.648 INFO:tasks.workunit.client.0.smithi077.stdout:8/37: symlink d2/lb 0 2024-09-18T21:12:39.649 INFO:tasks.workunit.client.0.smithi077.stdout:0/78: creat d8/d9/f18 x:0 0 0 2024-09-18T21:12:39.650 INFO:tasks.workunit.client.0.smithi077.stdout:9/41: mkdir d1/dd 0 2024-09-18T21:12:39.652 INFO:tasks.workunit.client.0.smithi077.stdout:8/38: symlink d2/d5/d6/lc 0 2024-09-18T21:12:39.653 INFO:tasks.workunit.client.0.smithi077.stdout:1/44: dread d3/f4 [0,4194304] 0 2024-09-18T21:12:39.655 INFO:tasks.workunit.client.0.smithi077.stdout:0/79: dread d8/d9/f15 [0,4194304] 0 2024-09-18T21:12:39.657 INFO:tasks.workunit.client.0.smithi077.stdout:1/45: link d3/d8/cc d3/d8/c12 0 2024-09-18T21:12:39.657 INFO:tasks.workunit.client.0.smithi077.stdout:8/39: dread f1 [0,4194304] 0 2024-09-18T21:12:39.658 INFO:tasks.workunit.client.0.smithi077.stdout:0/80: creat d8/f19 x:0 0 0 2024-09-18T21:12:39.659 INFO:tasks.workunit.client.0.smithi077.stdout:1/46: mkdir d3/d8/d13 0 2024-09-18T21:12:39.660 INFO:tasks.workunit.client.0.smithi077.stdout:8/40: symlink d2/d5/ld 0 2024-09-18T21:12:39.662 INFO:tasks.workunit.client.0.smithi077.stdout:8/41: unlink d2/d5/fa 0 2024-09-18T21:12:39.663 INFO:tasks.workunit.client.0.smithi077.stdout:0/81: unlink d8/le 0 2024-09-18T21:12:39.665 INFO:tasks.workunit.client.0.smithi077.stdout:0/82: write d8/f14 [1148456,26811] 0 2024-09-18T21:12:39.667 INFO:tasks.workunit.client.0.smithi077.stdout:0/83: mkdir d8/d1a 0 2024-09-18T21:12:39.668 INFO:tasks.workunit.client.0.smithi077.stdout:0/84: stat d8/c10 0 2024-09-18T21:12:39.669 INFO:tasks.workunit.client.0.smithi077.stdout:0/85: creat d8/d9/f1b x:0 0 0 2024-09-18T21:12:39.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:39 smithi077 ceph-mon[27689]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:12:39.722 INFO:tasks.workunit.client.0.smithi077.stdout:8/42: rmdir d2/d5/d6 39 2024-09-18T21:12:39.726 INFO:tasks.workunit.client.0.smithi077.stdout:4/73: dwrite d3/dc/f16 [0,4194304] 0 2024-09-18T21:12:39.728 INFO:tasks.workunit.client.0.smithi077.stdout:4/74: fsync d3/d7/f11 0 2024-09-18T21:12:39.734 INFO:tasks.workunit.client.0.smithi077.stdout:8/43: write d2/d5/d6/f8 [347480,90109] 0 2024-09-18T21:12:39.736 INFO:tasks.workunit.client.0.smithi077.stdout:1/47: dwrite d3/fd [0,4194304] 0 2024-09-18T21:12:39.737 INFO:tasks.workunit.client.0.smithi077.stdout:4/75: dread d3/f5 [0,4194304] 0 2024-09-18T21:12:39.739 INFO:tasks.workunit.client.0.smithi077.stdout:8/44: mknod d2/d5/ce 0 2024-09-18T21:12:39.742 INFO:tasks.workunit.client.0.smithi077.stdout:4/76: rename d3/d7/fd to d3/d7/f1a 0 2024-09-18T21:12:39.744 INFO:tasks.workunit.client.0.smithi077.stdout:4/77: fsync d3/fa 0 2024-09-18T21:12:39.745 INFO:tasks.workunit.client.0.smithi077.stdout:8/45: mkdir d2/d5/df 0 2024-09-18T21:12:39.749 INFO:tasks.workunit.client.0.smithi077.stdout:4/78: write d3/dc/f16 [1669034,59764] 0 2024-09-18T21:12:39.749 INFO:tasks.workunit.client.0.smithi077.stdout:8/46: write d2/d5/d6/f8 [422059,61929] 0 2024-09-18T21:12:39.750 INFO:tasks.workunit.client.0.smithi077.stdout:1/48: dwrite d3/ff [0,4194304] 0 2024-09-18T21:12:39.753 INFO:tasks.workunit.client.0.smithi077.stdout:8/47: write d2/d5/d6/f8 [980009,128814] 0 2024-09-18T21:12:39.755 INFO:tasks.workunit.client.0.smithi077.stdout:1/49: rename d3/f4 to d3/d8/d13/f14 0 2024-09-18T21:12:39.756 INFO:tasks.workunit.client.0.smithi077.stdout:1/50: chown c2 9329048 1 2024-09-18T21:12:39.757 INFO:tasks.workunit.client.0.smithi077.stdout:4/79: fsync d3/d7/f13 0 2024-09-18T21:12:39.760 INFO:tasks.workunit.client.0.smithi077.stdout:4/80: creat d3/dc/f1b x:0 0 0 2024-09-18T21:12:39.762 INFO:tasks.workunit.client.0.smithi077.stdout:1/51: fsync d3/d8/d13/f14 0 2024-09-18T21:12:39.763 INFO:tasks.workunit.client.0.smithi077.stdout:1/52: fdatasync d3/d8/d13/f14 0 2024-09-18T21:12:39.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:39 smithi103 ceph-mon[34827]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:12:39.768 INFO:tasks.workunit.client.0.smithi077.stdout:4/81: dwrite d3/f5 [0,4194304] 0 2024-09-18T21:12:39.770 INFO:tasks.workunit.client.0.smithi077.stdout:1/53: dwrite d3/f10 [0,4194304] 0 2024-09-18T21:12:39.771 INFO:tasks.workunit.client.0.smithi077.stdout:4/82: creat d3/dc/f1c x:0 0 0 2024-09-18T21:12:39.773 INFO:tasks.workunit.client.0.smithi077.stdout:1/54: read d3/f10 [815842,104433] 0 2024-09-18T21:12:39.790 INFO:tasks.workunit.client.0.smithi077.stdout:4/83: truncate d3/d7/f1a 2623592 0 2024-09-18T21:12:39.790 INFO:tasks.workunit.client.0.smithi077.stdout:1/55: fdatasync d3/fd 0 2024-09-18T21:12:39.792 INFO:tasks.workunit.client.0.smithi077.stdout:1/56: mknod d3/d8/d13/c15 0 2024-09-18T21:12:39.795 INFO:tasks.workunit.client.0.smithi077.stdout:1/57: creat d3/d8/f16 x:0 0 0 2024-09-18T21:12:39.795 INFO:tasks.workunit.client.0.smithi077.stdout:4/84: link d3/l4 d3/l1d 0 2024-09-18T21:12:39.795 INFO:tasks.workunit.client.0.smithi077.stdout:1/58: chown d3/l7 82501905 1 2024-09-18T21:12:39.796 INFO:tasks.workunit.client.0.smithi077.stdout:4/85: symlink d3/d7/l1e 0 2024-09-18T21:12:39.798 INFO:tasks.workunit.client.0.smithi077.stdout:4/86: creat d3/f1f x:0 0 0 2024-09-18T21:12:39.798 INFO:tasks.workunit.client.0.smithi077.stdout:4/87: stat d3/fa 0 2024-09-18T21:12:39.798 INFO:tasks.workunit.client.0.smithi077.stdout:4/88: chown d3/dc/f1b 78790 1 2024-09-18T21:12:39.799 INFO:tasks.workunit.client.0.smithi077.stdout:1/59: link d3/f9 d3/d8/f17 0 2024-09-18T21:12:39.800 INFO:tasks.workunit.client.0.smithi077.stdout:4/89: mkdir d3/dc/d20 0 2024-09-18T21:12:39.802 INFO:tasks.workunit.client.0.smithi077.stdout:1/60: mkdir d3/d8/d13/d18 0 2024-09-18T21:12:39.803 INFO:tasks.workunit.client.0.smithi077.stdout:1/61: mknod d3/d8/d13/c19 0 2024-09-18T21:12:39.804 INFO:tasks.workunit.client.0.smithi077.stdout:1/62: write d3/d8/d13/f14 [2155440,75477] 0 2024-09-18T21:12:39.807 INFO:tasks.workunit.client.0.smithi077.stdout:6/81: sync 2024-09-18T21:12:39.807 INFO:tasks.workunit.client.0.smithi077.stdout:6/82: chown l3 114834144 1 2024-09-18T21:12:39.809 INFO:tasks.workunit.client.0.smithi077.stdout:6/83: creat d7/df/d11/f19 x:0 0 0 2024-09-18T21:12:39.810 INFO:tasks.workunit.client.0.smithi077.stdout:6/84: mknod d7/c1a 0 2024-09-18T21:12:39.812 INFO:tasks.workunit.client.0.smithi077.stdout:6/85: creat d7/df/f1b x:0 0 0 2024-09-18T21:12:39.812 INFO:tasks.workunit.client.0.smithi077.stdout:6/86: stat d7/df/d11/f16 0 2024-09-18T21:12:39.813 INFO:tasks.workunit.client.0.smithi077.stdout:6/87: write d7/df/f1b [757802,128581] 0 2024-09-18T21:12:39.815 INFO:tasks.workunit.client.0.smithi077.stdout:6/88: creat d7/f1c x:0 0 0 2024-09-18T21:12:39.816 INFO:tasks.workunit.client.0.smithi077.stdout:6/89: write d7/df/f15 [126530,39973] 0 2024-09-18T21:12:39.818 INFO:tasks.workunit.client.0.smithi077.stdout:6/90: mkdir d7/df/d11/d1d 0 2024-09-18T21:12:39.822 INFO:tasks.workunit.client.0.smithi077.stdout:6/91: link d7/df/f1b d7/df/f1e 0 2024-09-18T21:12:39.823 INFO:tasks.workunit.client.0.smithi077.stdout:6/92: write d7/df/f15 [4385254,29042] 0 2024-09-18T21:12:39.824 INFO:tasks.workunit.client.0.smithi077.stdout:6/93: write d7/df/d11/f18 [487440,12927] 0 2024-09-18T21:12:39.824 INFO:tasks.workunit.client.0.smithi077.stdout:6/94: chown l5 15 1 2024-09-18T21:12:39.828 INFO:tasks.workunit.client.0.smithi077.stdout:6/95: link d7/fc d7/f1f 0 2024-09-18T21:12:39.828 INFO:tasks.workunit.client.0.smithi077.stdout:6/96: stat l1 0 2024-09-18T21:12:39.838 INFO:tasks.workunit.client.0.smithi077.stdout:6/97: write d7/df/d11/f16 [4828448,115945] 0 2024-09-18T21:12:39.839 INFO:tasks.workunit.client.0.smithi077.stdout:6/98: fdatasync d7/fe 0 2024-09-18T21:12:39.841 INFO:tasks.workunit.client.0.smithi077.stdout:6/99: link l1 d7/df/d11/d1d/l20 0 2024-09-18T21:12:39.842 INFO:tasks.workunit.client.0.smithi077.stdout:6/100: fdatasync d7/df/f1e 0 2024-09-18T21:12:39.844 INFO:tasks.workunit.client.0.smithi077.stdout:6/101: symlink d7/df/d11/d1d/l21 0 2024-09-18T21:12:39.845 INFO:tasks.workunit.client.0.smithi077.stdout:6/102: write d7/df/d11/f18 [1226257,110370] 0 2024-09-18T21:12:39.846 INFO:tasks.workunit.client.0.smithi077.stdout:6/103: chown d7/fc 46 1 2024-09-18T21:12:39.847 INFO:tasks.workunit.client.0.smithi077.stdout:6/104: write d7/f1c [871823,90803] 0 2024-09-18T21:12:39.850 INFO:tasks.workunit.client.0.smithi077.stdout:6/105: link d7/f1c d7/df/d11/d1d/f22 0 2024-09-18T21:12:39.851 INFO:tasks.workunit.client.0.smithi077.stdout:6/106: write d7/df/f15 [2488208,68607] 0 2024-09-18T21:12:39.854 INFO:tasks.workunit.client.0.smithi077.stdout:6/107: write d7/df/f1e [1656952,93180] 0 2024-09-18T21:12:39.855 INFO:tasks.workunit.client.0.smithi077.stdout:6/108: chown l1 808587 1 2024-09-18T21:12:39.856 INFO:tasks.workunit.client.0.smithi077.stdout:6/109: creat d7/f23 x:0 0 0 2024-09-18T21:12:39.857 INFO:tasks.workunit.client.0.smithi077.stdout:6/110: fsync d7/df/d11/f16 0 2024-09-18T21:12:39.857 INFO:tasks.workunit.client.0.smithi077.stdout:6/111: readlink l5 0 2024-09-18T21:12:39.860 INFO:tasks.workunit.client.0.smithi077.stdout:6/112: link d7/df/d11/d1d/l21 d7/df/d11/l24 0 2024-09-18T21:12:39.860 INFO:tasks.workunit.client.0.smithi077.stdout:6/113: fdatasync d7/df/d11/f19 0 2024-09-18T21:12:39.864 INFO:tasks.workunit.client.0.smithi077.stdout:6/114: getdents d7 0 2024-09-18T21:12:39.866 INFO:tasks.workunit.client.0.smithi077.stdout:6/115: truncate d7/df/d11/d1d/f22 289547 0 2024-09-18T21:12:39.872 INFO:tasks.workunit.client.0.smithi077.stdout:6/116: dwrite d7/df/f1b [0,4194304] 0 2024-09-18T21:12:39.873 INFO:tasks.workunit.client.0.smithi077.stdout:6/117: write d7/df/d11/f19 [578070,16436] 0 2024-09-18T21:12:40.143 INFO:tasks.workunit.client.0.smithi077.stdout:3/54: sync 2024-09-18T21:12:40.144 INFO:tasks.workunit.client.0.smithi077.stdout:3/55: mknod db/c11 0 2024-09-18T21:12:40.150 INFO:tasks.workunit.client.0.smithi077.stdout:3/56: dwrite f3 [0,4194304] 0 2024-09-18T21:12:40.153 INFO:tasks.workunit.client.0.smithi077.stdout:3/57: mknod db/c12 0 2024-09-18T21:12:40.153 INFO:tasks.workunit.client.0.smithi077.stdout:3/58: read - f9 zero size 2024-09-18T21:12:40.160 INFO:tasks.workunit.client.0.smithi077.stdout:3/59: dwrite f9 [0,4194304] 0 2024-09-18T21:12:40.167 INFO:tasks.workunit.client.0.smithi077.stdout:3/60: truncate f7 2017704 0 2024-09-18T21:12:40.172 INFO:tasks.workunit.client.0.smithi077.stdout:3/61: dwrite f4 [0,4194304] 0 2024-09-18T21:12:40.183 INFO:tasks.workunit.client.0.smithi077.stdout:3/62: unlink f7 0 2024-09-18T21:12:40.183 INFO:tasks.workunit.client.0.smithi077.stdout:3/63: fsync db/ff 0 2024-09-18T21:12:40.248 INFO:tasks.workunit.client.0.smithi077.stdout:2/31: sync 2024-09-18T21:12:40.286 INFO:tasks.workunit.client.0.smithi077.stdout:1/63: sync 2024-09-18T21:12:40.286 INFO:tasks.workunit.client.0.smithi077.stdout:5/77: sync 2024-09-18T21:12:40.286 INFO:tasks.workunit.client.0.smithi077.stdout:8/48: sync 2024-09-18T21:12:40.286 INFO:tasks.workunit.client.0.smithi077.stdout:7/62: sync 2024-09-18T21:12:40.286 INFO:tasks.workunit.client.0.smithi077.stdout:4/90: sync 2024-09-18T21:12:40.286 INFO:tasks.workunit.client.0.smithi077.stdout:6/118: sync 2024-09-18T21:12:40.286 INFO:tasks.workunit.client.0.smithi077.stdout:0/86: sync 2024-09-18T21:12:40.286 INFO:tasks.workunit.client.0.smithi077.stdout:9/42: sync 2024-09-18T21:12:40.286 INFO:tasks.workunit.client.0.smithi077.stdout:3/64: sync 2024-09-18T21:12:40.287 INFO:tasks.workunit.client.0.smithi077.stdout:3/65: chown db/le 1738 1 2024-09-18T21:12:40.293 INFO:tasks.workunit.client.0.smithi077.stdout:1/64: dread d3/f9 [0,4194304] 0 2024-09-18T21:12:40.293 INFO:tasks.workunit.client.0.smithi077.stdout:9/43: dread d1/f3 [0,4194304] 0 2024-09-18T21:12:40.293 INFO:tasks.workunit.client.0.smithi077.stdout:0/87: dwrite d8/f16 [0,4194304] 0 2024-09-18T21:12:40.295 INFO:tasks.workunit.client.0.smithi077.stdout:9/44: write d1/fb [946930,100571] 0 2024-09-18T21:12:40.303 INFO:tasks.workunit.client.0.smithi077.stdout:9/45: dread d1/fb [0,4194304] 0 2024-09-18T21:12:40.305 INFO:tasks.workunit.client.0.smithi077.stdout:0/88: dwrite d8/d9/f11 [0,4194304] 0 2024-09-18T21:12:40.305 INFO:tasks.workunit.client.0.smithi077.stdout:9/46: write d1/fb [2083429,18834] 0 2024-09-18T21:12:40.306 INFO:tasks.workunit.client.0.smithi077.stdout:0/89: readlink d8/d9/l12 0 2024-09-18T21:12:40.346 INFO:tasks.workunit.client.0.smithi077.stdout:6/119: unlink d7/fe 0 2024-09-18T21:12:40.346 INFO:tasks.workunit.client.0.smithi077.stdout:7/63: write f10 [1131061,105418] 0 2024-09-18T21:12:40.347 INFO:tasks.workunit.client.0.smithi077.stdout:3/66: unlink db/lc 0 2024-09-18T21:12:40.350 INFO:tasks.workunit.client.0.smithi077.stdout:9/47: write d1/f3 [719631,77984] 0 2024-09-18T21:12:40.356 INFO:tasks.workunit.client.0.smithi077.stdout:1/65: creat d3/d8/d13/d18/f1a x:0 0 0 2024-09-18T21:12:40.357 INFO:tasks.workunit.client.0.smithi077.stdout:6/120: mkdir d7/df/d11/d25 0 2024-09-18T21:12:40.358 INFO:tasks.workunit.client.0.smithi077.stdout:3/67: creat db/f13 x:0 0 0 2024-09-18T21:12:40.360 INFO:tasks.workunit.client.0.smithi077.stdout:7/64: dread fb [0,4194304] 0 2024-09-18T21:12:40.360 INFO:tasks.workunit.client.0.smithi077.stdout:3/68: write f4 [132788,118158] 0 2024-09-18T21:12:40.361 INFO:tasks.workunit.client.0.smithi077.stdout:7/65: write fc [953091,40821] 0 2024-09-18T21:12:40.361 INFO:tasks.workunit.client.0.smithi077.stdout:2/32: creat d1/fe x:0 0 0 2024-09-18T21:12:40.363 INFO:tasks.workunit.client.0.smithi077.stdout:9/48: rename d1/l6 to d1/dd/le 0 2024-09-18T21:12:40.364 INFO:tasks.workunit.client.0.smithi077.stdout:8/49: link d2/lb d2/d5/d6/l10 0 2024-09-18T21:12:40.367 INFO:tasks.workunit.client.0.smithi077.stdout:8/50: dread f1 [0,4194304] 0 2024-09-18T21:12:40.368 INFO:tasks.workunit.client.0.smithi077.stdout:8/51: stat d2/d5/df 0 2024-09-18T21:12:40.368 INFO:tasks.workunit.client.0.smithi077.stdout:0/90: creat d8/f1c x:0 0 0 2024-09-18T21:12:40.369 INFO:tasks.workunit.client.0.smithi077.stdout:3/69: mkdir db/d14 0 2024-09-18T21:12:40.369 INFO:tasks.workunit.client.0.smithi077.stdout:3/70: chown l8 396 1 2024-09-18T21:12:40.370 INFO:tasks.workunit.client.0.smithi077.stdout:7/66: dread - fa zero size 2024-09-18T21:12:40.372 INFO:tasks.workunit.client.0.smithi077.stdout:2/33: rename d1/fe to d1/d4/ff 0 2024-09-18T21:12:40.373 INFO:tasks.workunit.client.0.smithi077.stdout:9/49: mkdir d1/df 0 2024-09-18T21:12:40.373 INFO:tasks.workunit.client.0.smithi077.stdout:3/71: dread f4 [0,4194304] 0 2024-09-18T21:12:40.375 INFO:tasks.workunit.client.0.smithi077.stdout:9/50: write d1/f3 [2535072,73554] 0 2024-09-18T21:12:40.376 INFO:tasks.workunit.client.0.smithi077.stdout:6/121: creat d7/df/d11/d25/f26 x:0 0 0 2024-09-18T21:12:40.381 INFO:tasks.workunit.client.0.smithi077.stdout:6/122: dread d7/f1f [0,4194304] 0 2024-09-18T21:12:40.382 INFO:tasks.workunit.client.0.smithi077.stdout:2/34: dwrite d1/fd [0,4194304] 0 2024-09-18T21:12:40.384 INFO:tasks.workunit.client.0.smithi077.stdout:8/52: mknod d2/d5/c11 0 2024-09-18T21:12:40.384 INFO:tasks.workunit.client.0.smithi077.stdout:2/35: dread - d1/d4/d9/fb zero size 2024-09-18T21:12:40.385 INFO:tasks.workunit.client.0.smithi077.stdout:2/36: readlink d1/lc 0 2024-09-18T21:12:40.385 INFO:tasks.workunit.client.0.smithi077.stdout:0/91: mkdir d8/d1d 0 2024-09-18T21:12:40.386 INFO:tasks.workunit.client.0.smithi077.stdout:2/37: truncate d1/d4/f8 168483 0 2024-09-18T21:12:40.387 INFO:tasks.workunit.client.0.smithi077.stdout:2/38: readlink d1/lc 0 2024-09-18T21:12:40.391 INFO:tasks.workunit.client.0.smithi077.stdout:2/39: dread d1/f3 [0,4194304] 0 2024-09-18T21:12:40.392 INFO:tasks.workunit.client.0.smithi077.stdout:2/40: write d1/f6 [629683,81540] 0 2024-09-18T21:12:40.393 INFO:tasks.workunit.client.0.smithi077.stdout:2/41: write d1/d4/d5/f7 [283751,18052] 0 2024-09-18T21:12:40.393 INFO:tasks.workunit.client.0.smithi077.stdout:6/123: mknod d7/df/d11/d25/c27 0 2024-09-18T21:12:40.395 INFO:tasks.workunit.client.0.smithi077.stdout:0/92: symlink d8/d9/l1e 0 2024-09-18T21:12:40.397 INFO:tasks.workunit.client.0.smithi077.stdout:3/72: link db/le db/d14/l15 0 2024-09-18T21:12:40.397 INFO:tasks.workunit.client.0.smithi077.stdout:3/73: readlink db/ld 0 2024-09-18T21:12:40.398 INFO:tasks.workunit.client.0.smithi077.stdout:3/74: fdatasync fa 0 2024-09-18T21:12:40.398 INFO:tasks.workunit.client.0.smithi077.stdout:8/53: symlink d2/d5/l12 0 2024-09-18T21:12:40.399 INFO:tasks.workunit.client.0.smithi077.stdout:6/124: creat d7/df/f28 x:0 0 0 2024-09-18T21:12:40.399 INFO:tasks.workunit.client.0.smithi077.stdout:0/93: dread d8/f16 [0,4194304] 0 2024-09-18T21:12:40.400 INFO:tasks.workunit.client.0.smithi077.stdout:2/42: creat d1/d4/f10 x:0 0 0 2024-09-18T21:12:40.401 INFO:tasks.workunit.client.0.smithi077.stdout:2/43: truncate d1/f6 1011270 0 2024-09-18T21:12:40.402 INFO:tasks.workunit.client.0.smithi077.stdout:7/67: link l7 d12/l1c 0 2024-09-18T21:12:40.403 INFO:tasks.workunit.client.0.smithi077.stdout:2/44: write d1/d4/d5/f7 [762363,16194] 0 2024-09-18T21:12:40.403 INFO:tasks.workunit.client.0.smithi077.stdout:7/68: chown d12/f1b 1588 1 2024-09-18T21:12:40.409 INFO:tasks.workunit.client.0.smithi077.stdout:3/75: chown db/d14/l15 328 1 2024-09-18T21:12:40.409 INFO:tasks.workunit.client.0.smithi077.stdout:8/54: chown d2/d5/d6/l10 114 1 2024-09-18T21:12:40.411 INFO:tasks.workunit.client.0.smithi077.stdout:0/94: mknod d8/d1a/c1f 0 2024-09-18T21:12:40.412 INFO:tasks.workunit.client.0.smithi077.stdout:0/95: truncate d8/f17 1633303 0 2024-09-18T21:12:40.415 INFO:tasks.workunit.client.0.smithi077.stdout:2/45: rename d1/f3 to d1/f11 0 2024-09-18T21:12:40.415 INFO:tasks.workunit.client.0.smithi077.stdout:3/76: dread f3 [0,4194304] 0 2024-09-18T21:12:40.417 INFO:tasks.workunit.client.0.smithi077.stdout:8/55: dread f1 [0,4194304] 0 2024-09-18T21:12:40.419 INFO:tasks.workunit.client.0.smithi077.stdout:3/77: creat db/f16 x:0 0 0 2024-09-18T21:12:40.421 INFO:tasks.workunit.client.0.smithi077.stdout:2/46: dread d1/d4/d5/f7 [0,4194304] 0 2024-09-18T21:12:40.421 INFO:tasks.workunit.client.0.smithi077.stdout:8/56: write f1 [2258839,38626] 0 2024-09-18T21:12:40.422 INFO:tasks.workunit.client.0.smithi077.stdout:2/47: stat d1/d4 0 2024-09-18T21:12:40.423 INFO:tasks.workunit.client.0.smithi077.stdout:3/78: creat db/d14/f17 x:0 0 0 2024-09-18T21:12:40.424 INFO:tasks.workunit.client.0.smithi077.stdout:2/48: fdatasync d1/fd 0 2024-09-18T21:12:40.425 INFO:tasks.workunit.client.0.smithi077.stdout:8/57: write d2/d5/d6/f8 [1069482,76137] 0 2024-09-18T21:12:40.425 INFO:tasks.workunit.client.0.smithi077.stdout:0/96: dwrite d8/fb [0,4194304] 0 2024-09-18T21:12:40.427 INFO:tasks.workunit.client.0.smithi077.stdout:3/79: creat db/d14/f18 x:0 0 0 2024-09-18T21:12:40.429 INFO:tasks.workunit.client.0.smithi077.stdout:3/80: dread - db/ff zero size 2024-09-18T21:12:40.431 INFO:tasks.workunit.client.0.smithi077.stdout:0/97: truncate f3 533157 0 2024-09-18T21:12:40.432 INFO:tasks.workunit.client.0.smithi077.stdout:3/81: creat db/f19 x:0 0 0 2024-09-18T21:12:40.434 INFO:tasks.workunit.client.0.smithi077.stdout:8/58: dread d2/d5/d6/f8 [0,4194304] 0 2024-09-18T21:12:40.434 INFO:tasks.workunit.client.0.smithi077.stdout:3/82: chown db/ff 85 1 2024-09-18T21:12:40.436 INFO:tasks.workunit.client.0.smithi077.stdout:2/49: dwrite d1/d4/f10 [0,4194304] 0 2024-09-18T21:12:40.437 INFO:tasks.workunit.client.0.smithi077.stdout:3/83: dread - db/f10 zero size 2024-09-18T21:12:40.438 INFO:tasks.workunit.client.0.smithi077.stdout:0/98: rename f0 to d8/d1a/f20 0 2024-09-18T21:12:40.438 INFO:tasks.workunit.client.0.smithi077.stdout:2/50: rename d1/d4 to d1/d4/d9/d12 22 2024-09-18T21:12:40.438 INFO:tasks.workunit.client.0.smithi077.stdout:0/99: chown d8/d9/f11 133065415 1 2024-09-18T21:12:40.439 INFO:tasks.workunit.client.0.smithi077.stdout:8/59: mknod d2/d5/d6/c13 0 2024-09-18T21:12:40.440 INFO:tasks.workunit.client.0.smithi077.stdout:8/60: truncate f1 5016866 0 2024-09-18T21:12:40.442 INFO:tasks.workunit.client.0.smithi077.stdout:2/51: symlink d1/d4/d5/l13 0 2024-09-18T21:12:40.445 INFO:tasks.workunit.client.0.smithi077.stdout:0/100: mknod d8/d1d/c21 0 2024-09-18T21:12:40.446 INFO:tasks.workunit.client.0.smithi077.stdout:2/52: mknod d1/d4/d5/c14 0 2024-09-18T21:12:40.446 INFO:tasks.workunit.client.0.smithi077.stdout:3/84: dread f4 [0,4194304] 0 2024-09-18T21:12:40.450 INFO:tasks.workunit.client.0.smithi077.stdout:0/101: creat d8/d1d/f22 x:0 0 0 2024-09-18T21:12:40.450 INFO:tasks.workunit.client.0.smithi077.stdout:8/61: dwrite f1 [4194304,4194304] 0 2024-09-18T21:12:40.451 INFO:tasks.workunit.client.0.smithi077.stdout:2/53: dread d1/d4/f8 [0,4194304] 0 2024-09-18T21:12:40.452 INFO:tasks.workunit.client.0.smithi077.stdout:3/85: creat db/f1a x:0 0 0 2024-09-18T21:12:40.453 INFO:tasks.workunit.client.0.smithi077.stdout:3/86: dread - db/f19 zero size 2024-09-18T21:12:40.455 INFO:tasks.workunit.client.0.smithi077.stdout:8/62: creat d2/d5/d6/f14 x:0 0 0 2024-09-18T21:12:40.456 INFO:tasks.workunit.client.0.smithi077.stdout:8/63: readlink d2/d5/ld 0 2024-09-18T21:12:40.459 INFO:tasks.workunit.client.0.smithi077.stdout:0/102: creat d8/f23 x:0 0 0 2024-09-18T21:12:40.462 INFO:tasks.workunit.client.0.smithi077.stdout:0/103: mknod d8/d9/c24 0 2024-09-18T21:12:40.463 INFO:tasks.workunit.client.0.smithi077.stdout:8/64: link d2/c3 d2/d5/c15 0 2024-09-18T21:12:40.465 INFO:tasks.workunit.client.0.smithi077.stdout:2/54: dwrite d1/d4/f8 [0,4194304] 0 2024-09-18T21:12:40.466 INFO:tasks.workunit.client.0.smithi077.stdout:8/65: write d2/d5/d6/f14 [754884,59812] 0 2024-09-18T21:12:40.466 INFO:tasks.workunit.client.0.smithi077.stdout:2/55: write d1/d4/f8 [933669,20432] 0 2024-09-18T21:12:40.472 INFO:tasks.workunit.client.0.smithi077.stdout:8/66: creat d2/d5/f16 x:0 0 0 2024-09-18T21:12:40.477 INFO:tasks.workunit.client.0.smithi077.stdout:0/104: dwrite d8/f16 [0,4194304] 0 2024-09-18T21:12:40.479 INFO:tasks.workunit.client.0.smithi077.stdout:0/105: chown d8/f16 42 1 2024-09-18T21:12:40.480 INFO:tasks.workunit.client.0.smithi077.stdout:8/67: rename d2/d5/l12 to d2/d5/l17 0 2024-09-18T21:12:40.484 INFO:tasks.workunit.client.0.smithi077.stdout:0/106: creat d8/d1a/f25 x:0 0 0 2024-09-18T21:12:40.484 INFO:tasks.workunit.client.0.smithi077.stdout:2/56: dwrite d1/d4/d5/f7 [0,4194304] 0 2024-09-18T21:12:40.486 INFO:tasks.workunit.client.0.smithi077.stdout:8/68: mkdir d2/d5/df/d18 0 2024-09-18T21:12:40.488 INFO:tasks.workunit.client.0.smithi077.stdout:2/57: rename d1/d4/f10 to d1/d4/f15 0 2024-09-18T21:12:40.492 INFO:tasks.workunit.client.0.smithi077.stdout:8/69: dread f1 [0,4194304] 0 2024-09-18T21:12:40.495 INFO:tasks.workunit.client.0.smithi077.stdout:8/70: write f1 [8806980,108901] 0 2024-09-18T21:12:40.498 INFO:tasks.workunit.client.0.smithi077.stdout:2/58: dwrite d1/f6 [0,4194304] 0 2024-09-18T21:12:40.500 INFO:tasks.workunit.client.0.smithi077.stdout:8/71: creat d2/f19 x:0 0 0 2024-09-18T21:12:40.503 INFO:tasks.workunit.client.0.smithi077.stdout:8/72: dread d2/d5/d6/f8 [0,4194304] 0 2024-09-18T21:12:40.505 INFO:tasks.workunit.client.0.smithi077.stdout:8/73: creat d2/d5/d6/f1a x:0 0 0 2024-09-18T21:12:40.507 INFO:tasks.workunit.client.0.smithi077.stdout:8/74: creat d2/d5/df/f1b x:0 0 0 2024-09-18T21:12:40.509 INFO:tasks.workunit.client.0.smithi077.stdout:8/75: symlink d2/d5/d6/l1c 0 2024-09-18T21:12:40.512 INFO:tasks.workunit.client.0.smithi077.stdout:8/76: rename d2/c9 to d2/c1d 0 2024-09-18T21:12:40.573 INFO:tasks.workunit.client.0.smithi077.stdout:8/77: stat d2/d5/df/d18 0 2024-09-18T21:12:40.573 INFO:tasks.workunit.client.0.smithi077.stdout:1/66: getdents d3/d8/d13/d18 0 2024-09-18T21:12:40.573 INFO:tasks.workunit.client.0.smithi077.stdout:9/51: readlink d1/dd/le 0 2024-09-18T21:12:40.573 INFO:tasks.workunit.client.0.smithi077.stdout:4/91: dwrite d3/d7/f13 [0,4194304] 0 2024-09-18T21:12:40.573 INFO:tasks.workunit.client.0.smithi077.stdout:1/67: link d3/d8/l11 d3/d8/d13/d18/l1b 0 2024-09-18T21:12:40.573 INFO:tasks.workunit.client.0.smithi077.stdout:9/52: link d1/ca d1/c10 0 2024-09-18T21:12:40.573 INFO:tasks.workunit.client.0.smithi077.stdout:9/53: readlink d1/dd/le 0 2024-09-18T21:12:40.573 INFO:tasks.workunit.client.0.smithi077.stdout:6/125: rmdir d7/df/d11/d25 39 2024-09-18T21:12:40.573 INFO:tasks.workunit.client.0.smithi077.stdout:7/69: rmdir d12 39 2024-09-18T21:12:40.573 INFO:tasks.workunit.client.0.smithi077.stdout:1/68: dwrite d3/d8/d13/d18/f1a [0,4194304] 0 2024-09-18T21:12:40.573 INFO:tasks.workunit.client.0.smithi077.stdout:9/54: dread d1/f3 [0,4194304] 0 2024-09-18T21:12:40.574 INFO:tasks.workunit.client.0.smithi077.stdout:7/70: truncate fd 4563864 0 2024-09-18T21:12:40.574 INFO:tasks.workunit.client.0.smithi077.stdout:6/126: dread d7/df/d11/d1d/f22 [0,4194304] 0 2024-09-18T21:12:40.574 INFO:tasks.workunit.client.0.smithi077.stdout:1/69: creat d3/d8/f1c x:0 0 0 2024-09-18T21:12:40.574 INFO:tasks.workunit.client.0.smithi077.stdout:9/55: rmdir d1/dd 39 2024-09-18T21:12:40.574 INFO:tasks.workunit.client.0.smithi077.stdout:1/70: unlink d3/fd 0 2024-09-18T21:12:40.574 INFO:tasks.workunit.client.0.smithi077.stdout:6/127: symlink d7/df/l29 0 2024-09-18T21:12:40.574 INFO:tasks.workunit.client.0.smithi077.stdout:0/107: rename d8/d9 to d8/d26 0 2024-09-18T21:12:40.575 INFO:tasks.workunit.client.0.smithi077.stdout:2/59: getdents d1/d4 0 2024-09-18T21:12:40.577 INFO:tasks.workunit.client.0.smithi077.stdout:8/78: rmdir d2/d5/df 39 2024-09-18T21:12:40.579 INFO:tasks.workunit.client.0.smithi077.stdout:2/60: creat d1/d4/d9/f16 x:0 0 0 2024-09-18T21:12:40.581 INFO:tasks.workunit.client.0.smithi077.stdout:0/108: dwrite d8/f23 [0,4194304] 0 2024-09-18T21:12:40.585 INFO:tasks.workunit.client.0.smithi077.stdout:0/109: symlink d8/d1a/l27 0 2024-09-18T21:12:40.585 INFO:tasks.workunit.client.0.smithi077.stdout:4/92: truncate d3/f5 297678 0 2024-09-18T21:12:40.586 INFO:tasks.workunit.client.0.smithi077.stdout:0/110: stat d8/d1a/f25 0 2024-09-18T21:12:40.586 INFO:tasks.workunit.client.0.smithi077.stdout:4/93: stat d3/d17 0 2024-09-18T21:12:40.587 INFO:tasks.workunit.client.0.smithi077.stdout:8/79: rename d2/d5/c15 to d2/d5/df/d18/c1e 0 2024-09-18T21:12:40.589 INFO:tasks.workunit.client.0.smithi077.stdout:0/111: write d8/d26/f1b [820738,35020] 0 2024-09-18T21:12:40.590 INFO:tasks.workunit.client.0.smithi077.stdout:4/94: mknod d3/d7/c21 0 2024-09-18T21:12:40.591 INFO:tasks.workunit.client.0.smithi077.stdout:2/61: dwrite d1/d4/ff [0,4194304] 0 2024-09-18T21:12:40.593 INFO:tasks.workunit.client.0.smithi077.stdout:9/56: write d1/fb [2762463,3666] 0 2024-09-18T21:12:40.595 INFO:tasks.workunit.client.0.smithi077.stdout:0/112: creat d8/d26/f28 x:0 0 0 2024-09-18T21:12:40.596 INFO:tasks.workunit.client.0.smithi077.stdout:4/95: unlink l0 0 2024-09-18T21:12:40.597 INFO:tasks.workunit.client.0.smithi077.stdout:6/128: write d7/fc [879341,86256] 0 2024-09-18T21:12:40.599 INFO:tasks.workunit.client.0.smithi077.stdout:6/129: dread d7/f1c [0,4194304] 0 2024-09-18T21:12:40.600 INFO:tasks.workunit.client.0.smithi077.stdout:2/62: creat d1/d4/d5/f17 x:0 0 0 2024-09-18T21:12:40.602 INFO:tasks.workunit.client.0.smithi077.stdout:4/96: symlink d3/l22 0 2024-09-18T21:12:40.602 INFO:tasks.workunit.client.0.smithi077.stdout:1/71: dwrite d3/f9 [0,4194304] 0 2024-09-18T21:12:40.645 INFO:tasks.workunit.client.0.smithi077.stdout:5/78: sync 2024-09-18T21:12:40.647 INFO:tasks.workunit.client.0.smithi077.stdout:8/80: link d2/d5/d6/f1a d2/d5/d6/f1f 0 2024-09-18T21:12:40.647 INFO:tasks.workunit.client.0.smithi077.stdout:8/81: chown d2/d5/d6 30 1 2024-09-18T21:12:40.650 INFO:tasks.workunit.client.0.smithi077.stdout:6/130: creat d7/df/f2a x:0 0 0 2024-09-18T21:12:40.653 INFO:tasks.workunit.client.0.smithi077.stdout:2/63: write d1/f11 [2160393,106691] 0 2024-09-18T21:12:40.655 INFO:tasks.workunit.client.0.smithi077.stdout:7/71: write fd [1101646,27259] 0 2024-09-18T21:12:40.657 INFO:tasks.workunit.client.0.smithi077.stdout:5/79: creat d0/df/d10/f1b x:0 0 0 2024-09-18T21:12:40.659 INFO:tasks.workunit.client.0.smithi077.stdout:4/97: getdents d3/d17 0 2024-09-18T21:12:40.661 INFO:tasks.workunit.client.0.smithi077.stdout:5/80: truncate d0/f2 3438340 0 2024-09-18T21:12:40.662 INFO:tasks.workunit.client.0.smithi077.stdout:0/113: fsync d8/d26/f1b 0 2024-09-18T21:12:40.663 INFO:tasks.workunit.client.0.smithi077.stdout:6/131: link d7/f1f d7/df/d11/d25/f2b 0 2024-09-18T21:12:40.664 INFO:tasks.workunit.client.0.smithi077.stdout:2/64: creat d1/f18 x:0 0 0 2024-09-18T21:12:40.665 INFO:tasks.workunit.client.0.smithi077.stdout:6/132: creat d7/f2c x:0 0 0 2024-09-18T21:12:40.666 INFO:tasks.workunit.client.0.smithi077.stdout:6/133: stat d7/f1c 0 2024-09-18T21:12:40.667 INFO:tasks.workunit.client.0.smithi077.stdout:2/65: unlink d1/d4/d5/f17 0 2024-09-18T21:12:40.667 INFO:tasks.workunit.client.0.smithi077.stdout:5/81: dread d0/df/d10/f7 [0,4194304] 0 2024-09-18T21:12:40.672 INFO:tasks.workunit.client.0.smithi077.stdout:2/66: fsync d1/d4/f15 0 2024-09-18T21:12:40.673 INFO:tasks.workunit.client.0.smithi077.stdout:0/114: dwrite d8/d1a/f25 [0,4194304] 0 2024-09-18T21:12:40.673 INFO:tasks.workunit.client.0.smithi077.stdout:2/67: stat c0 0 2024-09-18T21:12:40.674 INFO:tasks.workunit.client.0.smithi077.stdout:1/72: chown d3/f9 19497 1 2024-09-18T21:12:40.674 INFO:tasks.workunit.client.0.smithi077.stdout:2/68: fdatasync d1/f11 0 2024-09-18T21:12:40.675 INFO:tasks.workunit.client.0.smithi077.stdout:2/69: fdatasync d1/d4/f15 0 2024-09-18T21:12:40.676 INFO:tasks.workunit.client.0.smithi077.stdout:5/82: creat d0/df/f1c x:0 0 0 2024-09-18T21:12:40.677 INFO:tasks.workunit.client.0.smithi077.stdout:9/57: truncate d1/fb 222213 0 2024-09-18T21:12:40.678 INFO:tasks.workunit.client.0.smithi077.stdout:6/134: rename d7/df/d11/d1d/f22 to d7/f2d 0 2024-09-18T21:12:40.680 INFO:tasks.workunit.client.0.smithi077.stdout:0/115: symlink d8/d26/l29 0 2024-09-18T21:12:40.680 INFO:tasks.workunit.client.0.smithi077.stdout:0/116: stat d8/f17 0 2024-09-18T21:12:40.681 INFO:tasks.workunit.client.0.smithi077.stdout:0/117: write d8/d1d/f22 [1008353,53598] 0 2024-09-18T21:12:40.686 INFO:tasks.workunit.client.0.smithi077.stdout:5/83: rename d0/c4 to d0/d6/dd/c1d 0 2024-09-18T21:12:40.688 INFO:tasks.workunit.client.0.smithi077.stdout:6/135: creat d7/df/d11/d1d/f2e x:0 0 0 2024-09-18T21:12:40.691 INFO:tasks.workunit.client.0.smithi077.stdout:7/72: dwrite fb [0,4194304] 0 2024-09-18T21:12:40.691 INFO:tasks.workunit.client.0.smithi077.stdout:0/118: symlink d8/d26/l2a 0 2024-09-18T21:12:40.694 INFO:tasks.workunit.client.0.smithi077.stdout:7/73: write f10 [1275844,23258] 0 2024-09-18T21:12:40.697 INFO:tasks.workunit.client.0.smithi077.stdout:6/136: dread d7/df/f1b [0,4194304] 0 2024-09-18T21:12:40.698 INFO:tasks.workunit.client.0.smithi077.stdout:1/73: chown d3/d8/d13/d18/l1b 80151 1 2024-09-18T21:12:40.698 INFO:tasks.workunit.client.0.smithi077.stdout:0/119: creat d8/d1d/f2b x:0 0 0 2024-09-18T21:12:40.699 INFO:tasks.workunit.client.0.smithi077.stdout:2/70: creat d1/f19 x:0 0 0 2024-09-18T21:12:40.703 INFO:tasks.workunit.client.0.smithi077.stdout:5/84: link d0/d6/dd/f11 d0/d6/dd/f1e 0 2024-09-18T21:12:40.706 INFO:tasks.workunit.client.0.smithi077.stdout:6/137: unlink d7/df/d11/f18 0 2024-09-18T21:12:40.707 INFO:tasks.workunit.client.0.smithi077.stdout:1/74: dwrite d3/d8/f1c [0,4194304] 0 2024-09-18T21:12:40.707 INFO:tasks.workunit.client.0.smithi077.stdout:6/138: chown d7/df/f2a 11430771 1 2024-09-18T21:12:40.709 INFO:tasks.workunit.client.0.smithi077.stdout:6/139: write d7/f2c [320828,127771] 0 2024-09-18T21:12:40.709 INFO:tasks.workunit.client.0.smithi077.stdout:2/71: mkdir d1/d4/d5/d1a 0 2024-09-18T21:12:40.710 INFO:tasks.workunit.client.0.smithi077.stdout:7/74: mknod d12/c1d 0 2024-09-18T21:12:40.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:40 smithi077 ceph-mon[27689]: pgmap v11: 65 pgs: 65 active+clean; 361 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail; 212 KiB/s rd, 22 MiB/s wr, 295 op/s 2024-09-18T21:12:40.713 INFO:tasks.workunit.client.0.smithi077.stdout:5/85: symlink d0/l1f 0 2024-09-18T21:12:40.716 INFO:tasks.workunit.client.0.smithi077.stdout:1/75: creat d3/d8/d13/d18/f1d x:0 0 0 2024-09-18T21:12:40.717 INFO:tasks.workunit.client.0.smithi077.stdout:9/58: getdents d1/dd 0 2024-09-18T21:12:40.719 INFO:tasks.workunit.client.0.smithi077.stdout:7/75: mknod d12/c1e 0 2024-09-18T21:12:40.721 INFO:tasks.workunit.client.0.smithi077.stdout:0/120: creat d8/f2c x:0 0 0 2024-09-18T21:12:40.725 INFO:tasks.workunit.client.0.smithi077.stdout:1/76: unlink d3/d8/la 0 2024-09-18T21:12:40.726 INFO:tasks.workunit.client.0.smithi077.stdout:9/59: write d1/f3 [3145250,55608] 0 2024-09-18T21:12:40.727 INFO:tasks.workunit.client.0.smithi077.stdout:6/140: dwrite d7/df/f2a [0,4194304] 0 2024-09-18T21:12:40.727 INFO:tasks.workunit.client.0.smithi077.stdout:2/72: dwrite d1/f11 [4194304,4194304] 0 2024-09-18T21:12:40.728 INFO:tasks.workunit.client.0.smithi077.stdout:7/76: creat d12/f1f x:0 0 0 2024-09-18T21:12:40.730 INFO:tasks.workunit.client.0.smithi077.stdout:9/60: truncate d1/fb 943254 0 2024-09-18T21:12:40.733 INFO:tasks.workunit.client.0.smithi077.stdout:5/86: write d0/d6/dd/f11 [549560,21421] 0 2024-09-18T21:12:40.736 INFO:tasks.workunit.client.0.smithi077.stdout:7/77: symlink d12/l20 0 2024-09-18T21:12:40.736 INFO:tasks.workunit.client.0.smithi077.stdout:7/78: fdatasync f10 0 2024-09-18T21:12:40.740 INFO:tasks.workunit.client.0.smithi077.stdout:1/77: mkdir d3/d1e 0 2024-09-18T21:12:40.740 INFO:tasks.workunit.client.0.smithi077.stdout:0/121: dread d8/fb [0,4194304] 0 2024-09-18T21:12:40.741 INFO:tasks.workunit.client.0.smithi077.stdout:9/61: dread d1/fb [0,4194304] 0 2024-09-18T21:12:40.743 INFO:tasks.workunit.client.0.smithi077.stdout:0/122: chown d8/d26/l12 4 1 2024-09-18T21:12:40.745 INFO:tasks.workunit.client.0.smithi077.stdout:0/123: chown d8/f14 19966 1 2024-09-18T21:12:40.745 INFO:tasks.workunit.client.0.smithi077.stdout:1/78: creat d3/d8/d13/f1f x:0 0 0 2024-09-18T21:12:40.745 INFO:tasks.workunit.client.0.smithi077.stdout:7/79: dread f10 [0,4194304] 0 2024-09-18T21:12:40.746 INFO:tasks.workunit.client.0.smithi077.stdout:9/62: mkdir d1/dd/d11 0 2024-09-18T21:12:40.748 INFO:tasks.workunit.client.0.smithi077.stdout:2/73: truncate d1/d4/f15 3626623 0 2024-09-18T21:12:40.748 INFO:tasks.workunit.client.0.smithi077.stdout:5/87: symlink d0/d6/l20 0 2024-09-18T21:12:40.749 INFO:tasks.workunit.client.0.smithi077.stdout:0/124: chown d8/d26/l29 68433206 1 2024-09-18T21:12:40.750 INFO:tasks.workunit.client.0.smithi077.stdout:7/80: mknod d12/c21 0 2024-09-18T21:12:40.751 INFO:tasks.workunit.client.0.smithi077.stdout:1/79: chown d3/d8/d13/f1f 3678 1 2024-09-18T21:12:40.751 INFO:tasks.workunit.client.0.smithi077.stdout:0/125: dread - d8/f19 zero size 2024-09-18T21:12:40.755 INFO:tasks.workunit.client.0.smithi077.stdout:1/80: truncate d3/d8/f16 399714 0 2024-09-18T21:12:40.756 INFO:tasks.workunit.client.0.smithi077.stdout:0/126: fdatasync d8/f23 0 2024-09-18T21:12:40.756 INFO:tasks.workunit.client.0.smithi077.stdout:7/81: mkdir d12/d22 0 2024-09-18T21:12:40.757 INFO:tasks.workunit.client.0.smithi077.stdout:6/141: dwrite d7/df/d11/d25/f2b [0,4194304] 0 2024-09-18T21:12:40.757 INFO:tasks.workunit.client.0.smithi077.stdout:2/74: symlink d1/l1b 0 2024-09-18T21:12:40.758 INFO:tasks.workunit.client.0.smithi077.stdout:5/88: fsync d0/d6/dd/f11 0 2024-09-18T21:12:40.759 INFO:tasks.workunit.client.0.smithi077.stdout:9/63: link d1/f3 d1/df/f12 0 2024-09-18T21:12:40.759 INFO:tasks.workunit.client.0.smithi077.stdout:2/75: stat d1/d4 0 2024-09-18T21:12:40.760 INFO:tasks.workunit.client.0.smithi077.stdout:7/82: truncate fa 1009037 0 2024-09-18T21:12:40.762 INFO:tasks.workunit.client.0.smithi077.stdout:7/83: read f1 [367564,28563] 0 2024-09-18T21:12:40.762 INFO:tasks.workunit.client.0.smithi077.stdout:2/76: chown d1/lc 56 1 2024-09-18T21:12:40.762 INFO:tasks.workunit.client.0.smithi077.stdout:7/84: write f10 [1652822,126324] 0 2024-09-18T21:12:40.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:40 smithi103 ceph-mon[34827]: pgmap v11: 65 pgs: 65 active+clean; 361 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail; 212 KiB/s rd, 22 MiB/s wr, 295 op/s 2024-09-18T21:12:40.765 INFO:tasks.workunit.client.0.smithi077.stdout:1/81: mknod d3/d8/d13/d18/c20 0 2024-09-18T21:12:40.766 INFO:tasks.workunit.client.0.smithi077.stdout:1/82: stat d3/d8/d13/c19 0 2024-09-18T21:12:40.768 INFO:tasks.workunit.client.0.smithi077.stdout:1/83: read d3/d8/f17 [1098946,111930] 0 2024-09-18T21:12:40.769 INFO:tasks.workunit.client.0.smithi077.stdout:7/85: mknod d12/c23 0 2024-09-18T21:12:40.771 INFO:tasks.workunit.client.0.smithi077.stdout:2/77: dread d1/d4/ff [0,4194304] 0 2024-09-18T21:12:40.772 INFO:tasks.workunit.client.0.smithi077.stdout:6/142: symlink d7/df/d11/l2f 0 2024-09-18T21:12:40.772 INFO:tasks.workunit.client.0.smithi077.stdout:7/86: dread f5 [0,4194304] 0 2024-09-18T21:12:40.772 INFO:tasks.workunit.client.0.smithi077.stdout:2/78: chown d1/f6 147446769 1 2024-09-18T21:12:40.774 INFO:tasks.workunit.client.0.smithi077.stdout:5/89: mknod d0/d6/c21 0 2024-09-18T21:12:40.777 INFO:tasks.workunit.client.0.smithi077.stdout:1/84: rmdir d3 39 2024-09-18T21:12:40.779 INFO:tasks.workunit.client.0.smithi077.stdout:0/127: link d8/f14 d8/f2d 0 2024-09-18T21:12:40.780 INFO:tasks.workunit.client.0.smithi077.stdout:9/64: dwrite d1/f3 [0,4194304] 0 2024-09-18T21:12:40.781 INFO:tasks.workunit.client.0.smithi077.stdout:7/87: dread fb [0,4194304] 0 2024-09-18T21:12:40.783 INFO:tasks.workunit.client.0.smithi077.stdout:0/128: write d8/d26/f11 [2719263,58843] 0 2024-09-18T21:12:40.783 INFO:tasks.workunit.client.0.smithi077.stdout:5/90: creat d0/df/f22 x:0 0 0 2024-09-18T21:12:40.784 INFO:tasks.workunit.client.0.smithi077.stdout:2/79: dwrite d1/d4/d9/fb [0,4194304] 0 2024-09-18T21:12:40.787 INFO:tasks.workunit.client.0.smithi077.stdout:2/80: dread - d1/f19 zero size 2024-09-18T21:12:40.788 INFO:tasks.workunit.client.0.smithi077.stdout:6/143: mknod d7/df/d11/c30 0 2024-09-18T21:12:40.789 INFO:tasks.workunit.client.0.smithi077.stdout:5/91: write d0/d6/dd/f11 [4780712,96987] 0 2024-09-18T21:12:40.792 INFO:tasks.workunit.client.0.smithi077.stdout:7/88: creat d12/f24 x:0 0 0 2024-09-18T21:12:40.792 INFO:tasks.workunit.client.0.smithi077.stdout:9/65: symlink d1/df/l13 0 2024-09-18T21:12:40.797 INFO:tasks.workunit.client.0.smithi077.stdout:6/144: mkdir d7/df/d11/d1d/d31 0 2024-09-18T21:12:40.798 INFO:tasks.workunit.client.0.smithi077.stdout:5/92: symlink d0/df/d10/l23 0 2024-09-18T21:12:40.799 INFO:tasks.workunit.client.0.smithi077.stdout:9/66: write d1/f3 [1067939,94538] 0 2024-09-18T21:12:40.802 INFO:tasks.workunit.client.0.smithi077.stdout:6/145: creat d7/df/f32 x:0 0 0 2024-09-18T21:12:40.803 INFO:tasks.workunit.client.0.smithi077.stdout:1/85: dwrite d3/d8/f16 [0,4194304] 0 2024-09-18T21:12:40.803 INFO:tasks.workunit.client.0.smithi077.stdout:0/129: dwrite d8/d26/f28 [0,4194304] 0 2024-09-18T21:12:40.803 INFO:tasks.workunit.client.0.smithi077.stdout:7/89: rename d12/f1b to d12/f25 0 2024-09-18T21:12:40.805 INFO:tasks.workunit.client.0.smithi077.stdout:2/81: getdents d1/d4 0 2024-09-18T21:12:40.806 INFO:tasks.workunit.client.0.smithi077.stdout:5/93: creat d0/d6/dd/f24 x:0 0 0 2024-09-18T21:12:40.807 INFO:tasks.workunit.client.0.smithi077.stdout:7/90: dread - d12/f1f zero size 2024-09-18T21:12:40.807 INFO:tasks.workunit.client.0.smithi077.stdout:9/67: dread d1/fb [0,4194304] 0 2024-09-18T21:12:40.809 INFO:tasks.workunit.client.0.smithi077.stdout:6/146: mknod d7/c33 0 2024-09-18T21:12:40.812 INFO:tasks.workunit.client.0.smithi077.stdout:7/91: creat d12/f26 x:0 0 0 2024-09-18T21:12:40.814 INFO:tasks.workunit.client.0.smithi077.stdout:5/94: creat d0/df/f25 x:0 0 0 2024-09-18T21:12:40.814 INFO:tasks.workunit.client.0.smithi077.stdout:1/86: symlink d3/d1e/l21 0 2024-09-18T21:12:40.815 INFO:tasks.workunit.client.0.smithi077.stdout:6/147: unlink d7/df/l17 0 2024-09-18T21:12:40.816 INFO:tasks.workunit.client.0.smithi077.stdout:9/68: creat d1/dd/f14 x:0 0 0 2024-09-18T21:12:40.819 INFO:tasks.workunit.client.0.smithi077.stdout:5/95: creat d0/df/d10/f26 x:0 0 0 2024-09-18T21:12:40.819 INFO:tasks.workunit.client.0.smithi077.stdout:7/92: getdents d12/d22 0 2024-09-18T21:12:40.819 INFO:tasks.workunit.client.0.smithi077.stdout:6/148: creat d7/df/d11/d1d/f34 x:0 0 0 2024-09-18T21:12:40.820 INFO:tasks.workunit.client.0.smithi077.stdout:2/82: dwrite d1/d4/d9/fb [0,4194304] 0 2024-09-18T21:12:40.820 INFO:tasks.workunit.client.0.smithi077.stdout:6/149: stat d7/df/c12 0 2024-09-18T21:12:40.822 INFO:tasks.workunit.client.0.smithi077.stdout:9/69: mkdir d1/dd/d11/d15 0 2024-09-18T21:12:40.824 INFO:tasks.workunit.client.0.smithi077.stdout:5/96: creat d0/df/f27 x:0 0 0 2024-09-18T21:12:40.825 INFO:tasks.workunit.client.0.smithi077.stdout:7/93: dread fd [0,4194304] 0 2024-09-18T21:12:40.827 INFO:tasks.workunit.client.0.smithi077.stdout:6/150: symlink d7/df/d11/d1d/d31/l35 0 2024-09-18T21:12:40.829 INFO:tasks.workunit.client.0.smithi077.stdout:6/151: dread - d7/df/d11/d25/f26 zero size 2024-09-18T21:12:40.830 INFO:tasks.workunit.client.0.smithi077.stdout:2/83: creat d1/f1c x:0 0 0 2024-09-18T21:12:40.831 INFO:tasks.workunit.client.0.smithi077.stdout:9/70: creat d1/f16 x:0 0 0 2024-09-18T21:12:40.833 INFO:tasks.workunit.client.0.smithi077.stdout:6/152: dread - d7/df/d11/d1d/f2e zero size 2024-09-18T21:12:40.835 INFO:tasks.workunit.client.0.smithi077.stdout:2/84: unlink d1/d4/ff 0 2024-09-18T21:12:40.836 INFO:tasks.workunit.client.0.smithi077.stdout:5/97: dwrite d0/df/f27 [0,4194304] 0 2024-09-18T21:12:40.837 INFO:tasks.workunit.client.0.smithi077.stdout:9/71: creat d1/dd/f17 x:0 0 0 2024-09-18T21:12:40.838 INFO:tasks.workunit.client.0.smithi077.stdout:2/85: dread - d1/f19 zero size 2024-09-18T21:12:40.840 INFO:tasks.workunit.client.0.smithi077.stdout:1/87: write d3/f9 [3678493,52309] 0 2024-09-18T21:12:40.840 INFO:tasks.workunit.client.0.smithi077.stdout:2/86: fdatasync d1/f19 0 2024-09-18T21:12:40.842 INFO:tasks.workunit.client.0.smithi077.stdout:0/130: dwrite f3 [0,4194304] 0 2024-09-18T21:12:40.844 INFO:tasks.workunit.client.0.smithi077.stdout:9/72: creat d1/df/f18 x:0 0 0 2024-09-18T21:12:40.849 INFO:tasks.workunit.client.0.smithi077.stdout:7/94: truncate fb 1160254 0 2024-09-18T21:12:40.852 INFO:tasks.workunit.client.0.smithi077.stdout:5/98: dread d0/f2 [0,4194304] 0 2024-09-18T21:12:40.856 INFO:tasks.workunit.client.0.smithi077.stdout:7/95: creat d12/d22/f27 x:0 0 0 2024-09-18T21:12:40.857 INFO:tasks.workunit.client.0.smithi077.stdout:2/87: dwrite d1/f18 [0,4194304] 0 2024-09-18T21:12:40.858 INFO:tasks.workunit.client.0.smithi077.stdout:0/131: dwrite f3 [0,4194304] 0 2024-09-18T21:12:40.860 INFO:tasks.workunit.client.0.smithi077.stdout:9/73: dread d1/f3 [0,4194304] 0 2024-09-18T21:12:40.862 INFO:tasks.workunit.client.0.smithi077.stdout:9/74: stat d1/dd/d11 0 2024-09-18T21:12:40.867 INFO:tasks.workunit.client.0.smithi077.stdout:7/96: dread fb [0,4194304] 0 2024-09-18T21:12:40.869 INFO:tasks.workunit.client.0.smithi077.stdout:9/75: truncate d1/f16 642052 0 2024-09-18T21:12:40.870 INFO:tasks.workunit.client.0.smithi077.stdout:0/132: link d8/f13 d8/f2e 0 2024-09-18T21:12:40.870 INFO:tasks.workunit.client.0.smithi077.stdout:5/99: dwrite d0/df/f27 [0,4194304] 0 2024-09-18T21:12:40.874 INFO:tasks.workunit.client.0.smithi077.stdout:2/88: dread d1/f11 [4194304,4194304] 0 2024-09-18T21:12:40.874 INFO:tasks.workunit.client.0.smithi077.stdout:9/76: write d1/dd/f17 [13590,21693] 0 2024-09-18T21:12:40.877 INFO:tasks.workunit.client.0.smithi077.stdout:5/100: rename d0/l1f to d0/df/l28 0 2024-09-18T21:12:40.879 INFO:tasks.workunit.client.0.smithi077.stdout:1/88: dwrite d3/f10 [4194304,4194304] 0 2024-09-18T21:12:40.885 INFO:tasks.workunit.client.0.smithi077.stdout:7/97: dwrite d12/d22/f27 [0,4194304] 0 2024-09-18T21:12:40.886 INFO:tasks.workunit.client.0.smithi077.stdout:1/89: mkdir d3/d8/d13/d18/d22 0 2024-09-18T21:12:40.898 INFO:tasks.workunit.client.0.smithi077.stdout:7/98: rename d12/d22/f27 to d12/d22/f28 0 2024-09-18T21:12:40.899 INFO:tasks.workunit.client.0.smithi077.stdout:2/89: dwrite d1/d4/d9/f16 [0,4194304] 0 2024-09-18T21:12:40.901 INFO:tasks.workunit.client.0.smithi077.stdout:9/77: dwrite d1/df/f18 [0,4194304] 0 2024-09-18T21:12:40.903 INFO:tasks.workunit.client.0.smithi077.stdout:5/101: dwrite d0/f18 [0,4194304] 0 2024-09-18T21:12:40.905 INFO:tasks.workunit.client.0.smithi077.stdout:1/90: rename d3/d8/d13/d18/f1d to d3/f23 0 2024-09-18T21:12:40.906 INFO:tasks.workunit.client.0.smithi077.stdout:9/78: readlink d1/dd/le 0 2024-09-18T21:12:40.907 INFO:tasks.workunit.client.0.smithi077.stdout:2/90: write d1/d4/f8 [2736499,89700] 0 2024-09-18T21:12:40.912 INFO:tasks.workunit.client.0.smithi077.stdout:1/91: chown d3/f23 6064 1 2024-09-18T21:12:40.913 INFO:tasks.workunit.client.0.smithi077.stdout:7/99: mkdir d12/d22/d29 0 2024-09-18T21:12:40.913 INFO:tasks.workunit.client.0.smithi077.stdout:9/79: fsync d1/dd/f17 0 2024-09-18T21:12:40.916 INFO:tasks.workunit.client.0.smithi077.stdout:0/133: write d8/d1a/f20 [3410987,18501] 0 2024-09-18T21:12:40.916 INFO:tasks.workunit.client.0.smithi077.stdout:1/92: rename c2 to d3/d1e/c24 0 2024-09-18T21:12:40.918 INFO:tasks.workunit.client.0.smithi077.stdout:9/80: dread - d1/dd/f14 zero size 2024-09-18T21:12:40.919 INFO:tasks.workunit.client.0.smithi077.stdout:1/93: write d3/f9 [22056,125356] 0 2024-09-18T21:12:40.922 INFO:tasks.workunit.client.0.smithi077.stdout:7/100: mkdir d12/d22/d29/d2a 0 2024-09-18T21:12:40.922 INFO:tasks.workunit.client.0.smithi077.stdout:5/102: dwrite d0/df/d10/f1b [0,4194304] 0 2024-09-18T21:12:40.923 INFO:tasks.workunit.client.0.smithi077.stdout:1/94: chown d3/f10 472781 1 2024-09-18T21:12:40.923 INFO:tasks.workunit.client.0.smithi077.stdout:2/91: dread d1/d4/d5/f7 [0,4194304] 0 2024-09-18T21:12:40.924 INFO:tasks.workunit.client.0.smithi077.stdout:0/134: creat d8/f2f x:0 0 0 2024-09-18T21:12:40.925 INFO:tasks.workunit.client.0.smithi077.stdout:1/95: stat d3/d8/d13/c15 0 2024-09-18T21:12:40.925 INFO:tasks.workunit.client.0.smithi077.stdout:5/103: rmdir d0/d6/dd 39 2024-09-18T21:12:40.933 INFO:tasks.workunit.client.0.smithi077.stdout:0/135: rename d8/d26/fc to d8/f30 0 2024-09-18T21:12:40.933 INFO:tasks.workunit.client.0.smithi077.stdout:1/96: dwrite d3/d8/f16 [0,4194304] 0 2024-09-18T21:12:40.936 INFO:tasks.workunit.client.0.smithi077.stdout:7/101: link d12/l17 d12/d22/d29/d2a/l2b 0 2024-09-18T21:12:40.936 INFO:tasks.workunit.client.0.smithi077.stdout:7/102: fdatasync d12/f24 0 2024-09-18T21:12:40.940 INFO:tasks.workunit.client.0.smithi077.stdout:1/97: dread d3/d8/f16 [0,4194304] 0 2024-09-18T21:12:40.940 INFO:tasks.workunit.client.0.smithi077.stdout:1/98: fsync d3/f9 0 2024-09-18T21:12:40.942 INFO:tasks.workunit.client.0.smithi077.stdout:0/136: rename d8/f2e to d8/d1a/f31 0 2024-09-18T21:12:40.942 INFO:tasks.workunit.client.0.smithi077.stdout:1/99: write d3/d8/d13/f14 [1317545,72398] 0 2024-09-18T21:12:40.946 INFO:tasks.workunit.client.0.smithi077.stdout:7/103: mknod d12/d22/d29/c2c 0 2024-09-18T21:12:40.947 INFO:tasks.workunit.client.0.smithi077.stdout:2/92: getdents d1/d4/d9 0 2024-09-18T21:12:40.949 INFO:tasks.workunit.client.0.smithi077.stdout:1/100: dread d3/d8/f17 [0,4194304] 0 2024-09-18T21:12:40.950 INFO:tasks.workunit.client.0.smithi077.stdout:7/104: dread fb [0,4194304] 0 2024-09-18T21:12:40.950 INFO:tasks.workunit.client.0.smithi077.stdout:2/93: write d1/d4/d9/fb [3178618,3464] 0 2024-09-18T21:12:40.950 INFO:tasks.workunit.client.0.smithi077.stdout:5/104: truncate d0/df/d10/f1b 1184802 0 2024-09-18T21:12:40.951 INFO:tasks.workunit.client.0.smithi077.stdout:2/94: fsync d1/fd 0 2024-09-18T21:12:40.951 INFO:tasks.workunit.client.0.smithi077.stdout:1/101: dread - d3/d8/d13/f1f zero size 2024-09-18T21:12:40.952 INFO:tasks.workunit.client.0.smithi077.stdout:0/137: rename d8/f2c to d8/d26/f32 0 2024-09-18T21:12:40.953 INFO:tasks.workunit.client.0.smithi077.stdout:2/95: stat d1/c2 0 2024-09-18T21:12:40.953 INFO:tasks.workunit.client.0.smithi077.stdout:7/105: fdatasync d12/d22/f28 0 2024-09-18T21:12:40.954 INFO:tasks.workunit.client.0.smithi077.stdout:0/138: fdatasync d8/d26/f32 0 2024-09-18T21:12:40.954 INFO:tasks.workunit.client.0.smithi077.stdout:1/102: mknod d3/d8/d13/d18/c25 0 2024-09-18T21:12:40.956 INFO:tasks.workunit.client.0.smithi077.stdout:7/106: fdatasync d12/f25 0 2024-09-18T21:12:40.958 INFO:tasks.workunit.client.0.smithi077.stdout:1/103: write d3/d8/d13/f14 [1212363,65902] 0 2024-09-18T21:12:40.959 INFO:tasks.workunit.client.0.smithi077.stdout:7/107: mkdir d12/d22/d2d 0 2024-09-18T21:12:40.962 INFO:tasks.workunit.client.0.smithi077.stdout:2/96: rename d1/d4/d9/f16 to d1/f1d 0 2024-09-18T21:12:40.962 INFO:tasks.workunit.client.0.smithi077.stdout:7/108: chown d12/d22/d29/c2c 10740 1 2024-09-18T21:12:40.963 INFO:tasks.workunit.client.0.smithi077.stdout:5/105: dwrite d0/df/d10/f7 [0,4194304] 0 2024-09-18T21:12:40.969 INFO:tasks.workunit.client.0.smithi077.stdout:0/139: dwrite d8/f23 [0,4194304] 0 2024-09-18T21:12:40.969 INFO:tasks.workunit.client.0.smithi077.stdout:2/97: write d1/d4/d9/fb [1207847,68241] 0 2024-09-18T21:12:40.971 INFO:tasks.workunit.client.0.smithi077.stdout:7/109: rmdir d12/d22/d29 39 2024-09-18T21:12:40.971 INFO:tasks.workunit.client.0.smithi077.stdout:2/98: dread - d1/f1c zero size 2024-09-18T21:12:40.972 INFO:tasks.workunit.client.0.smithi077.stdout:2/99: stat d1/f1d 0 2024-09-18T21:12:40.974 INFO:tasks.workunit.client.0.smithi077.stdout:1/104: dread d3/d8/f17 [0,4194304] 0 2024-09-18T21:12:40.975 INFO:tasks.workunit.client.0.smithi077.stdout:7/110: dread fa [0,4194304] 0 2024-09-18T21:12:40.976 INFO:tasks.workunit.client.0.smithi077.stdout:2/100: creat d1/d4/d9/f1e x:0 0 0 2024-09-18T21:12:40.976 INFO:tasks.workunit.client.0.smithi077.stdout:1/105: chown d3/d8/f16 4005129 1 2024-09-18T21:12:40.977 INFO:tasks.workunit.client.0.smithi077.stdout:0/140: unlink d8/ca 0 2024-09-18T21:12:40.977 INFO:tasks.workunit.client.0.smithi077.stdout:2/101: dread - d1/d4/d9/f1e zero size 2024-09-18T21:12:40.978 INFO:tasks.workunit.client.0.smithi077.stdout:0/141: truncate d8/d1d/f22 1099158 0 2024-09-18T21:12:40.979 INFO:tasks.workunit.client.0.smithi077.stdout:5/106: rename d0/l1 to d0/d6/l29 0 2024-09-18T21:12:40.980 INFO:tasks.workunit.client.0.smithi077.stdout:7/111: rename d12/l15 to d12/l2e 0 2024-09-18T21:12:40.980 INFO:tasks.workunit.client.0.smithi077.stdout:0/142: chown d8/c10 0 1 2024-09-18T21:12:40.983 INFO:tasks.workunit.client.0.smithi077.stdout:7/112: readlink l9 0 2024-09-18T21:12:40.984 INFO:tasks.workunit.client.0.smithi077.stdout:5/107: chown d0/d6/c14 1 1 2024-09-18T21:12:40.984 INFO:tasks.workunit.client.0.smithi077.stdout:0/143: mknod d8/d1a/c33 0 2024-09-18T21:12:40.987 INFO:tasks.workunit.client.0.smithi077.stdout:7/113: dread fb [0,4194304] 0 2024-09-18T21:12:40.988 INFO:tasks.workunit.client.0.smithi077.stdout:2/102: dwrite d1/d4/d9/f1e [0,4194304] 0 2024-09-18T21:12:40.988 INFO:tasks.workunit.client.0.smithi077.stdout:0/144: truncate d8/f14 1587532 0 2024-09-18T21:12:40.988 INFO:tasks.workunit.client.0.smithi077.stdout:7/114: readlink l9 0 2024-09-18T21:12:40.990 INFO:tasks.workunit.client.0.smithi077.stdout:1/106: dread d3/d8/d13/d18/f1a [0,4194304] 0 2024-09-18T21:12:40.996 INFO:tasks.workunit.client.0.smithi077.stdout:2/103: rename d1/lc to d1/d4/d5/l1f 0 2024-09-18T21:12:40.998 INFO:tasks.workunit.client.0.smithi077.stdout:1/107: creat d3/d8/d13/f26 x:0 0 0 2024-09-18T21:12:40.999 INFO:tasks.workunit.client.0.smithi077.stdout:1/108: chown d3/d8/f1c 21989841 1 2024-09-18T21:12:41.001 INFO:tasks.workunit.client.0.smithi077.stdout:7/115: symlink d12/d22/d2d/l2f 0 2024-09-18T21:12:41.002 INFO:tasks.workunit.client.0.smithi077.stdout:5/108: link d0/df/c16 d0/df/d10/c2a 0 2024-09-18T21:12:41.003 INFO:tasks.workunit.client.0.smithi077.stdout:2/104: mkdir d1/d20 0 2024-09-18T21:12:41.005 INFO:tasks.workunit.client.0.smithi077.stdout:0/145: getdents d8/d26 0 2024-09-18T21:12:41.008 INFO:tasks.workunit.client.0.smithi077.stdout:2/105: symlink d1/d4/l21 0 2024-09-18T21:12:41.008 INFO:tasks.workunit.client.0.smithi077.stdout:0/146: readlink d8/d26/l2a 0 2024-09-18T21:12:41.009 INFO:tasks.workunit.client.0.smithi077.stdout:1/109: dwrite d3/d8/f1c [0,4194304] 0 2024-09-18T21:12:41.010 INFO:tasks.workunit.client.0.smithi077.stdout:5/109: truncate d0/d6/dd/f24 228795 0 2024-09-18T21:12:41.013 INFO:tasks.workunit.client.0.smithi077.stdout:1/110: unlink d3/f9 0 2024-09-18T21:12:41.013 INFO:tasks.workunit.client.0.smithi077.stdout:7/116: dwrite fb [0,4194304] 0 2024-09-18T21:12:41.014 INFO:tasks.workunit.client.0.smithi077.stdout:5/110: rmdir d0/df 39 2024-09-18T21:12:41.016 INFO:tasks.workunit.client.0.smithi077.stdout:0/147: getdents d8/d26 0 2024-09-18T21:12:41.016 INFO:tasks.workunit.client.0.smithi077.stdout:2/106: dread d1/d4/d5/f7 [0,4194304] 0 2024-09-18T21:12:41.022 INFO:tasks.workunit.client.0.smithi077.stdout:7/117: symlink d12/d22/d29/l30 0 2024-09-18T21:12:41.023 INFO:tasks.workunit.client.0.smithi077.stdout:3/87: sync 2024-09-18T21:12:41.023 INFO:tasks.workunit.client.0.smithi077.stdout:5/111: write d0/df/d10/f26 [40991,47174] 0 2024-09-18T21:12:41.025 INFO:tasks.workunit.client.0.smithi077.stdout:3/88: chown db/f13 21 1 2024-09-18T21:12:41.025 INFO:tasks.workunit.client.0.smithi077.stdout:0/148: unlink d8/d26/l12 0 2024-09-18T21:12:41.027 INFO:tasks.workunit.client.0.smithi077.stdout:5/112: creat d0/df/f2b x:0 0 0 2024-09-18T21:12:41.029 INFO:tasks.workunit.client.0.smithi077.stdout:2/107: dwrite d1/d4/d9/f1e [4194304,4194304] 0 2024-09-18T21:12:41.031 INFO:tasks.workunit.client.0.smithi077.stdout:5/113: fsync d0/df/d10/f7 0 2024-09-18T21:12:41.031 INFO:tasks.workunit.client.0.smithi077.stdout:0/149: rmdir d8/d1d 39 2024-09-18T21:12:41.037 INFO:tasks.workunit.client.0.smithi077.stdout:2/108: chown d1/d4/f15 38788885 1 2024-09-18T21:12:41.038 INFO:tasks.workunit.client.0.smithi077.stdout:5/114: dread - d0/d6/dd/fe zero size 2024-09-18T21:12:41.040 INFO:tasks.workunit.client.0.smithi077.stdout:3/89: dwrite db/f1a [0,4194304] 0 2024-09-18T21:12:41.041 INFO:tasks.workunit.client.0.smithi077.stdout:5/115: truncate d0/f18 4585877 0 2024-09-18T21:12:41.041 INFO:tasks.workunit.client.0.smithi077.stdout:3/90: chown db/d14 4 1 2024-09-18T21:12:41.041 INFO:tasks.workunit.client.0.smithi077.stdout:7/118: dwrite fd [0,4194304] 0 2024-09-18T21:12:41.043 INFO:tasks.workunit.client.0.smithi077.stdout:5/116: write d0/d6/dd/fe [23727,47474] 0 2024-09-18T21:12:41.044 INFO:tasks.workunit.client.0.smithi077.stdout:0/150: link d8/f2d d8/d26/f34 0 2024-09-18T21:12:41.045 INFO:tasks.workunit.client.0.smithi077.stdout:0/151: dread - d8/f19 zero size 2024-09-18T21:12:41.045 INFO:tasks.workunit.client.0.smithi077.stdout:0/152: readlink d8/d26/l2a 0 2024-09-18T21:12:41.051 INFO:tasks.workunit.client.0.smithi077.stdout:5/117: fdatasync d0/df/d10/f1b 0 2024-09-18T21:12:41.051 INFO:tasks.workunit.client.0.smithi077.stdout:0/153: mkdir d8/d1a/d35 0 2024-09-18T21:12:41.065 INFO:tasks.workunit.client.0.smithi077.stdout:7/119: write fa [1860314,5453] 0 2024-09-18T21:12:41.067 INFO:tasks.workunit.client.0.smithi077.stdout:2/109: truncate d1/f1d 2711238 0 2024-09-18T21:12:41.068 INFO:tasks.workunit.client.0.smithi077.stdout:3/91: dwrite f4 [4194304,4194304] 0 2024-09-18T21:12:41.068 INFO:tasks.workunit.client.0.smithi077.stdout:7/120: mkdir d12/d31 0 2024-09-18T21:12:41.070 INFO:tasks.workunit.client.0.smithi077.stdout:3/92: rmdir db 39 2024-09-18T21:12:41.073 INFO:tasks.workunit.client.0.smithi077.stdout:2/110: rename d1/d4/f15 to d1/d4/f22 0 2024-09-18T21:12:41.076 INFO:tasks.workunit.client.0.smithi077.stdout:0/154: dwrite d8/f14 [0,4194304] 0 2024-09-18T21:12:41.077 INFO:tasks.workunit.client.0.smithi077.stdout:5/118: dread d0/d6/fb [0,4194304] 0 2024-09-18T21:12:41.078 INFO:tasks.workunit.client.0.smithi077.stdout:7/121: rename fd to d12/d22/d29/d2a/f32 0 2024-09-18T21:12:41.080 INFO:tasks.workunit.client.0.smithi077.stdout:7/122: write d12/f25 [1014961,25929] 0 2024-09-18T21:12:41.082 INFO:tasks.workunit.client.0.smithi077.stdout:0/155: rmdir d8/d1a 39 2024-09-18T21:12:41.083 INFO:tasks.workunit.client.0.smithi077.stdout:5/119: symlink d0/df/l2c 0 2024-09-18T21:12:41.085 INFO:tasks.workunit.client.0.smithi077.stdout:3/93: rename db/c12 to db/d14/c1b 0 2024-09-18T21:12:41.086 INFO:tasks.workunit.client.0.smithi077.stdout:2/111: symlink d1/l23 0 2024-09-18T21:12:41.087 INFO:tasks.workunit.client.0.smithi077.stdout:0/156: dread d8/f2d [0,4194304] 0 2024-09-18T21:12:41.088 INFO:tasks.workunit.client.0.smithi077.stdout:3/94: readlink db/d14/l15 0 2024-09-18T21:12:41.090 INFO:tasks.workunit.client.0.smithi077.stdout:2/112: mkdir d1/d4/d9/d24 0 2024-09-18T21:12:41.090 INFO:tasks.workunit.client.0.smithi077.stdout:3/95: rmdir db/d14 39 2024-09-18T21:12:41.095 INFO:tasks.workunit.client.0.smithi077.stdout:0/157: link d8/d26/f11 d8/f36 0 2024-09-18T21:12:41.095 INFO:tasks.workunit.client.0.smithi077.stdout:2/113: dread d1/d4/d5/f7 [0,4194304] 0 2024-09-18T21:12:41.097 INFO:tasks.workunit.client.0.smithi077.stdout:2/114: write d1/f1c [460299,51238] 0 2024-09-18T21:12:41.097 INFO:tasks.workunit.client.0.smithi077.stdout:3/96: dwrite f4 [4194304,4194304] 0 2024-09-18T21:12:41.098 INFO:tasks.workunit.client.0.smithi077.stdout:7/123: rename d12/d22/d29 to d12/d31/d33 0 2024-09-18T21:12:41.099 INFO:tasks.workunit.client.0.smithi077.stdout:2/115: readlink d1/d4/l21 0 2024-09-18T21:12:41.100 INFO:tasks.workunit.client.0.smithi077.stdout:0/158: mkdir d8/d37 0 2024-09-18T21:12:41.102 INFO:tasks.workunit.client.0.smithi077.stdout:2/116: write d1/d4/d5/f7 [4508815,55557] 0 2024-09-18T21:12:41.104 INFO:tasks.workunit.client.0.smithi077.stdout:0/159: creat d8/d26/f38 x:0 0 0 2024-09-18T21:12:41.104 INFO:tasks.workunit.client.0.smithi077.stdout:2/117: stat d1/d4/d5/l13 0 2024-09-18T21:12:41.105 INFO:tasks.workunit.client.0.smithi077.stdout:0/160: truncate f3 5096263 0 2024-09-18T21:12:41.108 INFO:tasks.workunit.client.0.smithi077.stdout:3/97: dwrite db/f16 [0,4194304] 0 2024-09-18T21:12:41.108 INFO:tasks.workunit.client.0.smithi077.stdout:2/118: dread d1/f1c [0,4194304] 0 2024-09-18T21:12:41.109 INFO:tasks.workunit.client.0.smithi077.stdout:3/98: readlink l6 0 2024-09-18T21:12:41.109 INFO:tasks.workunit.client.0.smithi077.stdout:2/119: chown d1/f1c 16583566 1 2024-09-18T21:12:41.110 INFO:tasks.workunit.client.0.smithi077.stdout:2/120: write d1/f18 [4059057,67120] 0 2024-09-18T21:12:41.111 INFO:tasks.workunit.client.0.smithi077.stdout:2/121: chown d1 634404 1 2024-09-18T21:12:41.114 INFO:tasks.workunit.client.0.smithi077.stdout:7/124: rmdir d12/d22 39 2024-09-18T21:12:41.115 INFO:tasks.workunit.client.0.smithi077.stdout:7/125: chown f1 72466 1 2024-09-18T21:12:41.116 INFO:tasks.workunit.client.0.smithi077.stdout:2/122: truncate d1/f1d 1952673 0 2024-09-18T21:12:41.117 INFO:tasks.workunit.client.0.smithi077.stdout:2/123: chown c0 314400271 1 2024-09-18T21:12:41.119 INFO:tasks.workunit.client.0.smithi077.stdout:3/99: dwrite db/f19 [0,4194304] 0 2024-09-18T21:12:41.122 INFO:tasks.workunit.client.0.smithi077.stdout:3/100: dread - db/d14/f17 zero size 2024-09-18T21:12:41.122 INFO:tasks.workunit.client.0.smithi077.stdout:7/126: getdents d12/d31/d33 0 2024-09-18T21:12:41.124 INFO:tasks.workunit.client.0.smithi077.stdout:3/101: write db/f19 [4434020,106571] 0 2024-09-18T21:12:41.126 INFO:tasks.workunit.client.0.smithi077.stdout:3/102: rmdir db/d14 39 2024-09-18T21:12:41.128 INFO:tasks.workunit.client.0.smithi077.stdout:2/124: dwrite d1/f1c [0,4194304] 0 2024-09-18T21:12:41.128 INFO:tasks.workunit.client.1.smithi103.stdout:1/2: sync 2024-09-18T21:12:41.132 INFO:tasks.workunit.client.1.smithi103.stdout:1/3: mknod d0/c1 0 2024-09-18T21:12:41.133 INFO:tasks.workunit.client.0.smithi077.stdout:3/103: dread db/f1a [0,4194304] 0 2024-09-18T21:12:41.135 INFO:tasks.workunit.client.1.smithi103.stdout:1/4: mkdir d0/d2 0 2024-09-18T21:12:41.135 INFO:tasks.workunit.client.0.smithi077.stdout:2/125: dwrite d1/f18 [0,4194304] 0 2024-09-18T21:12:41.137 INFO:tasks.workunit.client.1.smithi103.stdout:1/5: mkdir d0/d3 0 2024-09-18T21:12:41.137 INFO:tasks.workunit.client.1.smithi103.stdout:1/6: readlink - no filename 2024-09-18T21:12:41.137 INFO:tasks.workunit.client.1.smithi103.stdout:1/7: readlink - no filename 2024-09-18T21:12:41.137 INFO:tasks.workunit.client.1.smithi103.stdout:1/8: dread - no filename 2024-09-18T21:12:41.138 INFO:tasks.workunit.client.0.smithi077.stdout:3/104: symlink db/l1c 0 2024-09-18T21:12:41.141 INFO:tasks.workunit.client.1.smithi103.stdout:1/9: mknod d0/c4 0 2024-09-18T21:12:41.141 INFO:tasks.workunit.client.1.smithi103.stdout:1/10: fdatasync - no filename 2024-09-18T21:12:41.141 INFO:tasks.workunit.client.1.smithi103.stdout:1/11: truncate - no filename 2024-09-18T21:12:41.141 INFO:tasks.workunit.client.1.smithi103.stdout:1/12: fsync - no filename 2024-09-18T21:12:41.142 INFO:tasks.workunit.client.0.smithi077.stdout:3/105: creat db/d14/f1d x:0 0 0 2024-09-18T21:12:41.143 INFO:tasks.workunit.client.0.smithi077.stdout:2/126: rename d1/f6 to d1/f25 0 2024-09-18T21:12:41.144 INFO:tasks.workunit.client.1.smithi103.stdout:1/13: symlink d0/d2/l5 0 2024-09-18T21:12:41.144 INFO:tasks.workunit.client.1.smithi103.stdout:1/14: truncate - no filename 2024-09-18T21:12:41.144 INFO:tasks.workunit.client.0.smithi077.stdout:2/127: write d1/f18 [1105676,34675] 0 2024-09-18T21:12:41.144 INFO:tasks.workunit.client.1.smithi103.stdout:1/15: chown d0/c1 2640156 1 2024-09-18T21:12:41.145 INFO:tasks.workunit.client.1.smithi103.stdout:1/16: chown d0/c4 12 1 2024-09-18T21:12:41.145 INFO:tasks.workunit.client.1.smithi103.stdout:1/17: write - no filename 2024-09-18T21:12:41.145 INFO:tasks.workunit.client.0.smithi077.stdout:2/128: write d1/d4/f8 [845229,97122] 0 2024-09-18T21:12:41.177 INFO:tasks.workunit.client.0.smithi077.stdout:2/129: mknod d1/d4/d9/c26 0 2024-09-18T21:12:41.179 INFO:tasks.workunit.client.1.smithi103.stdout:1/18: creat d0/d3/f6 x:0 0 0 2024-09-18T21:12:41.180 INFO:tasks.workunit.client.0.smithi077.stdout:2/130: creat d1/d4/d9/d24/f27 x:0 0 0 2024-09-18T21:12:41.185 INFO:tasks.workunit.client.0.smithi077.stdout:2/131: dwrite d1/f18 [0,4194304] 0 2024-09-18T21:12:41.203 INFO:tasks.workunit.client.1.smithi103.stdout:1/19: creat d0/f7 x:0 0 0 2024-09-18T21:12:41.204 INFO:tasks.workunit.client.1.smithi103.stdout:1/20: symlink d0/d3/l8 0 2024-09-18T21:12:41.205 INFO:tasks.workunit.client.0.smithi077.stdout:2/132: mknod d1/d4/d5/d1a/c28 0 2024-09-18T21:12:41.206 INFO:tasks.workunit.client.1.smithi103.stdout:1/21: mkdir d0/d2/d9 0 2024-09-18T21:12:41.208 INFO:tasks.workunit.client.1.smithi103.stdout:1/22: unlink d0/d3/f6 0 2024-09-18T21:12:41.208 INFO:tasks.workunit.client.1.smithi103.stdout:1/23: fdatasync d0/f7 0 2024-09-18T21:12:41.209 INFO:tasks.workunit.client.1.smithi103.stdout:1/24: write d0/f7 [53219,123825] 0 2024-09-18T21:12:41.211 INFO:tasks.workunit.client.0.smithi077.stdout:2/133: dwrite d1/f18 [0,4194304] 0 2024-09-18T21:12:41.212 INFO:tasks.workunit.client.0.smithi077.stdout:2/134: dread - d1/d4/d9/d24/f27 zero size 2024-09-18T21:12:41.212 INFO:tasks.workunit.client.1.smithi103.stdout:1/25: link d0/c4 d0/ca 0 2024-09-18T21:12:41.213 INFO:tasks.workunit.client.1.smithi103.stdout:1/26: dread d0/f7 [0,4194304] 0 2024-09-18T21:12:41.214 INFO:tasks.workunit.client.0.smithi077.stdout:2/135: mknod d1/d4/d5/d1a/c29 0 2024-09-18T21:12:41.216 INFO:tasks.workunit.client.1.smithi103.stdout:1/27: creat d0/d2/fb x:0 0 0 2024-09-18T21:12:41.216 INFO:tasks.workunit.client.1.smithi103.stdout:1/28: chown d0/c1 27158759 1 2024-09-18T21:12:41.217 INFO:tasks.workunit.client.1.smithi103.stdout:1/29: write d0/d2/fb [167733,124053] 0 2024-09-18T21:12:41.217 INFO:tasks.workunit.client.1.smithi103.stdout:1/30: readlink d0/d3/l8 0 2024-09-18T21:12:41.218 INFO:tasks.workunit.client.1.smithi103.stdout:1/31: chown d0/d3/l8 5 1 2024-09-18T21:12:41.220 INFO:tasks.workunit.client.1.smithi103.stdout:1/32: write d0/f7 [982192,694] 0 2024-09-18T21:12:41.224 INFO:tasks.workunit.client.1.smithi103.stdout:1/33: mkdir d0/d2/d9/dc 0 2024-09-18T21:12:41.225 INFO:tasks.workunit.client.1.smithi103.stdout:1/34: truncate d0/d2/fb 415577 0 2024-09-18T21:12:41.225 INFO:tasks.workunit.client.1.smithi103.stdout:1/35: stat d0/c1 0 2024-09-18T21:12:41.228 INFO:tasks.workunit.client.1.smithi103.stdout:1/36: dread d0/f7 [0,4194304] 0 2024-09-18T21:12:41.228 INFO:tasks.workunit.client.1.smithi103.stdout:1/37: chown d0/d2 3899594 1 2024-09-18T21:12:41.230 INFO:tasks.workunit.client.1.smithi103.stdout:1/38: creat d0/d3/fd x:0 0 0 2024-09-18T21:12:41.232 INFO:tasks.workunit.client.1.smithi103.stdout:1/39: symlink d0/le 0 2024-09-18T21:12:41.243 INFO:tasks.workunit.client.1.smithi103.stdout:0/81: sync 2024-09-18T21:12:41.243 INFO:tasks.workunit.client.1.smithi103.stdout:7/29: sync 2024-09-18T21:12:41.243 INFO:tasks.workunit.client.1.smithi103.stdout:2/16: sync 2024-09-18T21:12:41.243 INFO:tasks.workunit.client.1.smithi103.stdout:3/28: sync 2024-09-18T21:12:41.244 INFO:tasks.workunit.client.1.smithi103.stdout:9/27: sync 2024-09-18T21:12:41.244 INFO:tasks.workunit.client.1.smithi103.stdout:5/0: sync 2024-09-18T21:12:41.244 INFO:tasks.workunit.client.1.smithi103.stdout:4/33: sync 2024-09-18T21:12:41.244 INFO:tasks.workunit.client.1.smithi103.stdout:6/101: sync 2024-09-18T21:12:41.244 INFO:tasks.workunit.client.1.smithi103.stdout:8/43: sync 2024-09-18T21:12:41.245 INFO:tasks.workunit.client.1.smithi103.stdout:2/17: rmdir d3 39 2024-09-18T21:12:41.246 INFO:tasks.workunit.client.1.smithi103.stdout:9/28: mknod c7 0 2024-09-18T21:12:41.248 INFO:tasks.workunit.client.1.smithi103.stdout:5/1: creat f0 x:0 0 0 2024-09-18T21:12:41.248 INFO:tasks.workunit.client.1.smithi103.stdout:5/2: write f0 [284585,19921] 0 2024-09-18T21:12:41.253 INFO:tasks.workunit.client.1.smithi103.stdout:4/34: rename f8 to d9/fc 0 2024-09-18T21:12:41.255 INFO:tasks.workunit.client.1.smithi103.stdout:0/82: truncate d1/fd 781234 0 2024-09-18T21:12:41.255 INFO:tasks.workunit.client.1.smithi103.stdout:0/83: stat d1/d5 0 2024-09-18T21:12:41.258 INFO:tasks.workunit.client.1.smithi103.stdout:9/29: truncate f5 807863 0 2024-09-18T21:12:41.258 INFO:tasks.workunit.client.1.smithi103.stdout:6/102: dread d2/d3/d8/df/f17 [4194304,4194304] 0 2024-09-18T21:12:41.260 INFO:tasks.workunit.client.1.smithi103.stdout:5/3: rename f0 to f1 0 2024-09-18T21:12:41.264 INFO:tasks.workunit.client.1.smithi103.stdout:4/35: creat d9/fd x:0 0 0 2024-09-18T21:12:41.265 INFO:tasks.workunit.client.1.smithi103.stdout:0/84: creat d1/d9/d13/f1b x:0 0 0 2024-09-18T21:12:41.267 INFO:tasks.workunit.client.1.smithi103.stdout:2/18: mkdir d3/d5 0 2024-09-18T21:12:41.267 INFO:tasks.workunit.client.1.smithi103.stdout:2/19: dread - no filename 2024-09-18T21:12:41.267 INFO:tasks.workunit.client.1.smithi103.stdout:2/20: fdatasync - no filename 2024-09-18T21:12:41.268 INFO:tasks.workunit.client.1.smithi103.stdout:9/30: rename f0 to f8 0 2024-09-18T21:12:41.272 INFO:tasks.workunit.client.1.smithi103.stdout:5/4: mkdir d2 0 2024-09-18T21:12:41.273 INFO:tasks.workunit.client.1.smithi103.stdout:4/36: dread - f6 zero size 2024-09-18T21:12:41.276 INFO:tasks.workunit.client.1.smithi103.stdout:9/31: symlink l9 0 2024-09-18T21:12:41.278 INFO:tasks.workunit.client.1.smithi103.stdout:5/5: fdatasync f1 0 2024-09-18T21:12:41.278 INFO:tasks.workunit.client.1.smithi103.stdout:5/6: rename d2 to d2/d3 22 2024-09-18T21:12:41.279 INFO:tasks.workunit.client.1.smithi103.stdout:4/37: mknod d9/ce 0 2024-09-18T21:12:41.281 INFO:tasks.workunit.client.1.smithi103.stdout:2/21: creat d3/d5/f6 x:0 0 0 2024-09-18T21:12:41.281 INFO:tasks.workunit.client.1.smithi103.stdout:2/22: readlink d3/l4 0 2024-09-18T21:12:41.282 INFO:tasks.workunit.client.1.smithi103.stdout:9/32: write f1 [1021449,23682] 0 2024-09-18T21:12:41.286 INFO:tasks.workunit.client.1.smithi103.stdout:2/23: creat d3/f7 x:0 0 0 2024-09-18T21:12:41.286 INFO:tasks.workunit.client.1.smithi103.stdout:2/24: chown d3/f7 901 1 2024-09-18T21:12:41.287 INFO:tasks.workunit.client.1.smithi103.stdout:2/25: read - d3/f7 zero size 2024-09-18T21:12:41.287 INFO:tasks.workunit.client.1.smithi103.stdout:2/26: write d3/f7 [582852,76653] 0 2024-09-18T21:12:41.288 INFO:tasks.workunit.client.1.smithi103.stdout:2/27: write d3/f7 [1009231,23950] 0 2024-09-18T21:12:41.292 INFO:tasks.workunit.client.1.smithi103.stdout:5/7: rmdir d2 0 2024-09-18T21:12:41.294 INFO:tasks.workunit.client.1.smithi103.stdout:5/8: dread f1 [0,4194304] 0 2024-09-18T21:12:41.296 INFO:tasks.workunit.client.1.smithi103.stdout:2/28: creat d3/f8 x:0 0 0 2024-09-18T21:12:41.297 INFO:tasks.workunit.client.1.smithi103.stdout:2/29: write d3/f7 [693186,21306] 0 2024-09-18T21:12:41.298 INFO:tasks.workunit.client.1.smithi103.stdout:5/9: mknod c4 0 2024-09-18T21:12:41.299 INFO:tasks.workunit.client.1.smithi103.stdout:5/10: dread f1 [0,4194304] 0 2024-09-18T21:12:41.299 INFO:tasks.workunit.client.1.smithi103.stdout:5/11: chown f1 107819338 1 2024-09-18T21:12:41.319 INFO:tasks.workunit.client.0.smithi077.stdout:2/136: dwrite d1/fd [0,4194304] 0 2024-09-18T21:12:41.324 INFO:tasks.workunit.client.1.smithi103.stdout:7/30: write d1/f7 [201216,112973] 0 2024-09-18T21:12:41.326 INFO:tasks.workunit.client.1.smithi103.stdout:2/30: rename d3/f7 to d3/f9 0 2024-09-18T21:12:41.327 INFO:tasks.workunit.client.1.smithi103.stdout:5/12: mknod c5 0 2024-09-18T21:12:41.328 INFO:tasks.workunit.client.0.smithi077.stdout:2/137: dwrite d1/d4/d9/f1e [8388608,4194304] 0 2024-09-18T21:12:41.328 INFO:tasks.workunit.client.1.smithi103.stdout:8/44: write d4/ff [669536,127240] 0 2024-09-18T21:12:41.328 INFO:tasks.workunit.client.1.smithi103.stdout:5/13: chown c5 28617336 1 2024-09-18T21:12:41.328 INFO:tasks.workunit.client.1.smithi103.stdout:5/14: stat c4 0 2024-09-18T21:12:41.329 INFO:tasks.workunit.client.1.smithi103.stdout:3/29: write d1/f9 [892902,112917] 0 2024-09-18T21:12:41.330 INFO:tasks.workunit.client.1.smithi103.stdout:7/31: rmdir d1 39 2024-09-18T21:12:41.333 INFO:tasks.workunit.client.1.smithi103.stdout:2/31: creat d3/d5/fa x:0 0 0 2024-09-18T21:12:41.335 INFO:tasks.workunit.client.1.smithi103.stdout:8/45: symlink d4/l17 0 2024-09-18T21:12:41.337 INFO:tasks.workunit.client.1.smithi103.stdout:5/15: rename c5 to c6 0 2024-09-18T21:12:41.338 INFO:tasks.workunit.client.1.smithi103.stdout:3/30: dread - d1/d2/f8 zero size 2024-09-18T21:12:41.339 INFO:tasks.workunit.client.1.smithi103.stdout:3/31: dread - d1/d2/f8 zero size 2024-09-18T21:12:41.340 INFO:tasks.workunit.client.1.smithi103.stdout:7/32: fdatasync d1/f7 0 2024-09-18T21:12:41.341 INFO:tasks.workunit.client.1.smithi103.stdout:2/32: creat d3/d5/fb x:0 0 0 2024-09-18T21:12:41.342 INFO:tasks.workunit.client.1.smithi103.stdout:8/46: rename d4/d6/c15 to d4/d6/c18 0 2024-09-18T21:12:41.344 INFO:tasks.workunit.client.1.smithi103.stdout:5/16: mknod c7 0 2024-09-18T21:12:41.346 INFO:tasks.workunit.client.1.smithi103.stdout:3/32: creat d1/fc x:0 0 0 2024-09-18T21:12:41.347 INFO:tasks.workunit.client.1.smithi103.stdout:3/33: fdatasync d1/fc 0 2024-09-18T21:12:41.347 INFO:tasks.workunit.client.1.smithi103.stdout:8/47: dread d4/ff [0,4194304] 0 2024-09-18T21:12:41.348 INFO:tasks.workunit.client.1.smithi103.stdout:7/33: creat d1/fa x:0 0 0 2024-09-18T21:12:41.349 INFO:tasks.workunit.client.1.smithi103.stdout:2/33: symlink d3/lc 0 2024-09-18T21:12:41.353 INFO:tasks.workunit.client.1.smithi103.stdout:5/17: creat f8 x:0 0 0 2024-09-18T21:12:41.354 INFO:tasks.workunit.client.1.smithi103.stdout:6/103: dwrite d2/d3/d8/f20 [0,4194304] 0 2024-09-18T21:12:41.356 INFO:tasks.workunit.client.1.smithi103.stdout:3/34: rename l0 to d1/da/ld 0 2024-09-18T21:12:41.358 INFO:tasks.workunit.client.1.smithi103.stdout:3/35: stat d1/d2/fb 0 2024-09-18T21:12:41.361 INFO:tasks.workunit.client.1.smithi103.stdout:5/18: rename c7 to c9 0 2024-09-18T21:12:41.363 INFO:tasks.workunit.client.1.smithi103.stdout:0/85: dwrite d1/fa [0,4194304] 0 2024-09-18T21:12:41.366 INFO:tasks.workunit.client.1.smithi103.stdout:6/104: unlink d2/d3/f1c 0 2024-09-18T21:12:41.366 INFO:tasks.workunit.client.1.smithi103.stdout:7/34: dwrite d1/f7 [4194304,4194304] 0 2024-09-18T21:12:41.367 INFO:tasks.workunit.client.1.smithi103.stdout:9/33: truncate f8 400426 0 2024-09-18T21:12:41.370 INFO:tasks.workunit.client.1.smithi103.stdout:7/35: fdatasync d1/fa 0 2024-09-18T21:12:41.374 INFO:tasks.workunit.client.1.smithi103.stdout:1/40: sync 2024-09-18T21:12:41.377 INFO:tasks.workunit.client.1.smithi103.stdout:4/38: dwrite d9/fb [0,4194304] 0 2024-09-18T21:12:41.380 INFO:tasks.workunit.client.1.smithi103.stdout:4/39: write d9/fd [615687,6165] 0 2024-09-18T21:12:41.382 INFO:tasks.workunit.client.1.smithi103.stdout:4/40: stat d9/fb 0 2024-09-18T21:12:41.383 INFO:tasks.workunit.client.1.smithi103.stdout:0/86: dwrite d1/d5/f6 [0,4194304] 0 2024-09-18T21:12:41.384 INFO:tasks.workunit.client.1.smithi103.stdout:1/41: creat d0/ff x:0 0 0 2024-09-18T21:12:41.388 INFO:tasks.workunit.client.1.smithi103.stdout:6/105: dread d2/fb [0,4194304] 0 2024-09-18T21:12:41.389 INFO:tasks.workunit.client.1.smithi103.stdout:1/42: read d0/f7 [203042,3387] 0 2024-09-18T21:12:41.391 INFO:tasks.workunit.client.1.smithi103.stdout:4/41: read d9/fc [1408398,113750] 0 2024-09-18T21:12:41.392 INFO:tasks.workunit.client.1.smithi103.stdout:7/36: dwrite d1/fa [0,4194304] 0 2024-09-18T21:12:41.394 INFO:tasks.workunit.client.1.smithi103.stdout:1/43: fdatasync d0/ff 0 2024-09-18T21:12:41.397 INFO:tasks.workunit.client.1.smithi103.stdout:7/37: truncate d1/fa 4506262 0 2024-09-18T21:12:41.398 INFO:tasks.workunit.client.1.smithi103.stdout:4/42: symlink d9/lf 0 2024-09-18T21:12:41.399 INFO:tasks.workunit.client.1.smithi103.stdout:1/44: mkdir d0/d2/d9/d10 0 2024-09-18T21:12:41.401 INFO:tasks.workunit.client.1.smithi103.stdout:7/38: readlink l0 0 2024-09-18T21:12:41.403 INFO:tasks.workunit.client.1.smithi103.stdout:4/43: mknod d9/c10 0 2024-09-18T21:12:41.405 INFO:tasks.workunit.client.1.smithi103.stdout:4/44: dread - f6 zero size 2024-09-18T21:12:41.405 INFO:tasks.workunit.client.1.smithi103.stdout:0/87: dwrite d1/d5/f6 [0,4194304] 0 2024-09-18T21:12:41.407 INFO:tasks.workunit.client.1.smithi103.stdout:6/106: dwrite d2/d3/f19 [0,4194304] 0 2024-09-18T21:12:41.407 INFO:tasks.workunit.client.1.smithi103.stdout:6/107: chown d2/d24 969682 1 2024-09-18T21:12:41.410 INFO:tasks.workunit.client.1.smithi103.stdout:4/45: dread f3 [4194304,4194304] 0 2024-09-18T21:12:41.413 INFO:tasks.workunit.client.1.smithi103.stdout:0/88: creat d1/d5/f1c x:0 0 0 2024-09-18T21:12:41.416 INFO:tasks.workunit.client.1.smithi103.stdout:6/108: unlink d2/d3/d8/df/f1f 0 2024-09-18T21:12:41.416 INFO:tasks.workunit.client.1.smithi103.stdout:6/109: stat d2/f18 0 2024-09-18T21:12:41.421 INFO:tasks.workunit.client.1.smithi103.stdout:4/46: creat d9/f11 x:0 0 0 2024-09-18T21:12:41.422 INFO:tasks.workunit.client.1.smithi103.stdout:0/89: symlink d1/d5/de/l1d 0 2024-09-18T21:12:41.430 INFO:tasks.workunit.client.1.smithi103.stdout:6/110: dread d2/f12 [0,4194304] 0 2024-09-18T21:12:41.430 INFO:tasks.workunit.client.1.smithi103.stdout:0/90: mkdir d1/d5/de/d19/d1e 0 2024-09-18T21:12:41.432 INFO:tasks.workunit.client.1.smithi103.stdout:4/47: link f6 d9/f12 0 2024-09-18T21:12:41.437 INFO:tasks.workunit.client.1.smithi103.stdout:4/48: rename d9/c10 to d9/c13 0 2024-09-18T21:12:41.439 INFO:tasks.workunit.client.1.smithi103.stdout:0/91: creat d1/d5/de/d19/d1e/f1f x:0 0 0 2024-09-18T21:12:41.440 INFO:tasks.workunit.client.1.smithi103.stdout:6/111: dread d2/f12 [0,4194304] 0 2024-09-18T21:12:41.440 INFO:tasks.workunit.client.1.smithi103.stdout:7/39: rmdir d1 39 2024-09-18T21:12:41.441 INFO:tasks.workunit.client.1.smithi103.stdout:2/34: rmdir d3 39 2024-09-18T21:12:41.442 INFO:tasks.workunit.client.1.smithi103.stdout:0/92: read - d1/d5/f16 zero size 2024-09-18T21:12:41.443 INFO:tasks.workunit.client.1.smithi103.stdout:7/40: fdatasync d1/f7 0 2024-09-18T21:12:41.443 INFO:tasks.workunit.client.1.smithi103.stdout:7/41: fdatasync d1/fa 0 2024-09-18T21:12:41.444 INFO:tasks.workunit.client.1.smithi103.stdout:7/42: write d1/f7 [9665,1878] 0 2024-09-18T21:12:41.444 INFO:tasks.workunit.client.1.smithi103.stdout:6/112: rmdir d2/d3/d4 39 2024-09-18T21:12:41.445 INFO:tasks.workunit.client.1.smithi103.stdout:7/43: chown d1/c4 4209 1 2024-09-18T21:12:41.445 INFO:tasks.workunit.client.1.smithi103.stdout:8/48: write d4/d6/f8 [870623,22672] 0 2024-09-18T21:12:41.446 INFO:tasks.workunit.client.1.smithi103.stdout:7/44: write d1/f7 [8667723,4980] 0 2024-09-18T21:12:41.447 INFO:tasks.workunit.client.1.smithi103.stdout:3/36: readlink d1/da/ld 0 2024-09-18T21:12:41.449 INFO:tasks.workunit.client.1.smithi103.stdout:3/37: dread d1/d2/fb [0,4194304] 0 2024-09-18T21:12:41.451 INFO:tasks.workunit.client.1.smithi103.stdout:3/38: dread d1/d2/fb [0,4194304] 0 2024-09-18T21:12:41.451 INFO:tasks.workunit.client.1.smithi103.stdout:3/39: truncate d1/fc 408431 0 2024-09-18T21:12:41.452 INFO:tasks.workunit.client.1.smithi103.stdout:3/40: fdatasync d1/fc 0 2024-09-18T21:12:41.453 INFO:tasks.workunit.client.1.smithi103.stdout:3/41: read d1/f9 [635545,3328] 0 2024-09-18T21:12:41.454 INFO:tasks.workunit.client.1.smithi103.stdout:3/42: stat d1/da 0 2024-09-18T21:12:41.456 INFO:tasks.workunit.client.1.smithi103.stdout:8/49: rename d4/l17 to d4/de/l19 0 2024-09-18T21:12:41.458 INFO:tasks.workunit.client.1.smithi103.stdout:7/45: mknod d1/cb 0 2024-09-18T21:12:41.458 INFO:tasks.workunit.client.1.smithi103.stdout:8/50: dread d4/d6/f8 [0,4194304] 0 2024-09-18T21:12:41.459 INFO:tasks.workunit.client.1.smithi103.stdout:2/35: rename d3/d5/fa to d3/d5/fd 0 2024-09-18T21:12:41.464 INFO:tasks.workunit.client.1.smithi103.stdout:5/19: chown c9 228 1 2024-09-18T21:12:41.468 INFO:tasks.workunit.client.1.smithi103.stdout:7/46: unlink d1/l6 0 2024-09-18T21:12:41.477 INFO:tasks.workunit.client.1.smithi103.stdout:5/20: mknod ca 0 2024-09-18T21:12:41.479 INFO:tasks.workunit.client.1.smithi103.stdout:7/47: creat d1/fc x:0 0 0 2024-09-18T21:12:41.482 INFO:tasks.workunit.client.1.smithi103.stdout:2/36: link d3/f9 d3/d5/fe 0 2024-09-18T21:12:41.483 INFO:tasks.workunit.client.1.smithi103.stdout:5/21: creat fb x:0 0 0 2024-09-18T21:12:41.485 INFO:tasks.workunit.client.1.smithi103.stdout:7/48: mknod d1/cd 0 2024-09-18T21:12:41.485 INFO:tasks.workunit.client.1.smithi103.stdout:7/49: read d1/f7 [1468929,16674] 0 2024-09-18T21:12:41.485 INFO:tasks.workunit.client.1.smithi103.stdout:7/50: dread - d1/fc zero size 2024-09-18T21:12:41.486 INFO:tasks.workunit.client.1.smithi103.stdout:2/37: creat d3/ff x:0 0 0 2024-09-18T21:12:41.487 INFO:tasks.workunit.client.1.smithi103.stdout:5/22: symlink lc 0 2024-09-18T21:12:41.488 INFO:tasks.workunit.client.1.smithi103.stdout:5/23: truncate f8 783672 0 2024-09-18T21:12:41.488 INFO:tasks.workunit.client.1.smithi103.stdout:5/24: stat c9 0 2024-09-18T21:12:41.491 INFO:tasks.workunit.client.1.smithi103.stdout:2/38: symlink d3/l10 0 2024-09-18T21:12:41.496 INFO:tasks.workunit.client.1.smithi103.stdout:1/45: truncate d0/f7 654853 0 2024-09-18T21:12:41.497 INFO:tasks.workunit.client.1.smithi103.stdout:2/39: rename d3/d5/fb to d3/d5/f11 0 2024-09-18T21:12:41.501 INFO:tasks.workunit.client.1.smithi103.stdout:1/46: mkdir d0/d11 0 2024-09-18T21:12:41.505 INFO:tasks.workunit.client.1.smithi103.stdout:1/47: unlink d0/d3/fd 0 2024-09-18T21:12:41.508 INFO:tasks.workunit.client.1.smithi103.stdout:2/40: dwrite d3/d5/f11 [0,4194304] 0 2024-09-18T21:12:41.513 INFO:tasks.workunit.client.1.smithi103.stdout:2/41: creat d3/d5/f12 x:0 0 0 2024-09-18T21:12:41.514 INFO:tasks.workunit.client.1.smithi103.stdout:1/48: link d0/d3/l8 d0/d11/l12 0 2024-09-18T21:12:41.515 INFO:tasks.workunit.client.1.smithi103.stdout:1/49: fdatasync d0/d2/fb 0 2024-09-18T21:12:41.516 INFO:tasks.workunit.client.1.smithi103.stdout:2/42: symlink d3/d5/l13 0 2024-09-18T21:12:41.517 INFO:tasks.workunit.client.1.smithi103.stdout:2/43: write d3/d5/f6 [408554,76061] 0 2024-09-18T21:12:41.517 INFO:tasks.workunit.client.1.smithi103.stdout:0/93: dread d1/fd [0,4194304] 0 2024-09-18T21:12:41.518 INFO:tasks.workunit.client.1.smithi103.stdout:0/94: readlink d1/d5/l7 0 2024-09-18T21:12:41.518 INFO:tasks.workunit.client.1.smithi103.stdout:2/44: truncate d3/d5/f6 891815 0 2024-09-18T21:12:41.522 INFO:tasks.workunit.client.0.smithi077.stdout:8/82: sync 2024-09-18T21:12:41.523 INFO:tasks.workunit.client.1.smithi103.stdout:0/95: creat d1/d5/de/f20 x:0 0 0 2024-09-18T21:12:41.525 INFO:tasks.workunit.client.1.smithi103.stdout:2/45: dwrite d3/d5/f6 [0,4194304] 0 2024-09-18T21:12:41.526 INFO:tasks.workunit.client.1.smithi103.stdout:0/96: chown d1/d5/l1a 311622368 1 2024-09-18T21:12:41.528 INFO:tasks.workunit.client.1.smithi103.stdout:0/97: chown d1/d5/de/l10 287 1 2024-09-18T21:12:41.528 INFO:tasks.workunit.client.1.smithi103.stdout:4/49: dwrite f5 [0,4194304] 0 2024-09-18T21:12:41.529 INFO:tasks.workunit.client.0.smithi077.stdout:8/83: dwrite d2/d5/d6/f14 [0,4194304] 0 2024-09-18T21:12:41.532 INFO:tasks.workunit.client.1.smithi103.stdout:4/50: dread d9/fd [0,4194304] 0 2024-09-18T21:12:41.532 INFO:tasks.workunit.client.1.smithi103.stdout:2/46: rename d3/lc to d3/d5/l14 0 2024-09-18T21:12:41.533 INFO:tasks.workunit.client.1.smithi103.stdout:2/47: chown d3/ff 1452175 1 2024-09-18T21:12:41.534 INFO:tasks.workunit.client.1.smithi103.stdout:7/51: truncate d1/fa 2864232 0 2024-09-18T21:12:41.535 INFO:tasks.workunit.client.1.smithi103.stdout:0/98: truncate d1/f18 790219 0 2024-09-18T21:12:41.543 INFO:tasks.workunit.client.1.smithi103.stdout:2/48: write d3/f9 [1467277,704] 0 2024-09-18T21:12:41.544 INFO:tasks.workunit.client.1.smithi103.stdout:2/49: chown d3/d5/f6 1132016088 1 2024-09-18T21:12:41.545 INFO:tasks.workunit.client.1.smithi103.stdout:7/52: creat d1/fe x:0 0 0 2024-09-18T21:12:41.546 INFO:tasks.workunit.client.1.smithi103.stdout:3/43: truncate d1/fc 176865 0 2024-09-18T21:12:41.553 INFO:tasks.workunit.client.1.smithi103.stdout:2/50: creat d3/f15 x:0 0 0 2024-09-18T21:12:41.554 INFO:tasks.workunit.client.1.smithi103.stdout:7/53: dwrite d1/fe [0,4194304] 0 2024-09-18T21:12:41.555 INFO:tasks.workunit.client.1.smithi103.stdout:9/34: dwrite f1 [0,4194304] 0 2024-09-18T21:12:41.556 INFO:tasks.workunit.client.1.smithi103.stdout:8/51: write f2 [1039433,44032] 0 2024-09-18T21:12:41.556 INFO:tasks.workunit.client.1.smithi103.stdout:8/52: readlink d4/de/l12 0 2024-09-18T21:12:41.564 INFO:tasks.workunit.client.1.smithi103.stdout:0/99: link d1/d9/d13/f14 d1/d5/de/d19/d1e/f21 0 2024-09-18T21:12:41.565 INFO:tasks.workunit.client.0.smithi077.stdout:6/153: sync 2024-09-18T21:12:41.565 INFO:tasks.workunit.client.0.smithi077.stdout:4/98: sync 2024-09-18T21:12:41.566 INFO:tasks.workunit.client.1.smithi103.stdout:7/54: chown l0 13 1 2024-09-18T21:12:41.566 INFO:tasks.workunit.client.1.smithi103.stdout:7/55: write d1/fc [1040120,22245] 0 2024-09-18T21:12:41.567 INFO:tasks.workunit.client.0.smithi077.stdout:4/99: truncate d3/dc/f1c 4173 0 2024-09-18T21:12:41.569 INFO:tasks.workunit.client.1.smithi103.stdout:9/35: creat fa x:0 0 0 2024-09-18T21:12:41.569 INFO:tasks.workunit.client.1.smithi103.stdout:9/36: truncate fa 560011 0 2024-09-18T21:12:41.572 INFO:tasks.workunit.client.1.smithi103.stdout:8/53: creat d4/d6/f1a x:0 0 0 2024-09-18T21:12:41.575 INFO:tasks.workunit.client.1.smithi103.stdout:4/51: getdents d9 0 2024-09-18T21:12:41.577 INFO:tasks.workunit.client.1.smithi103.stdout:0/100: mkdir d1/d5/de/d22 0 2024-09-18T21:12:41.578 INFO:tasks.workunit.client.1.smithi103.stdout:0/101: readlink d1/d5/l7 0 2024-09-18T21:12:41.581 INFO:tasks.workunit.client.1.smithi103.stdout:7/56: mkdir d1/df 0 2024-09-18T21:12:41.581 INFO:tasks.workunit.client.1.smithi103.stdout:7/57: write d1/fc [807902,56558] 0 2024-09-18T21:12:41.586 INFO:tasks.workunit.client.1.smithi103.stdout:9/37: symlink lb 0 2024-09-18T21:12:41.587 INFO:tasks.workunit.client.1.smithi103.stdout:8/54: truncate d4/ff 736703 0 2024-09-18T21:12:41.587 INFO:tasks.workunit.client.1.smithi103.stdout:8/55: stat d4/de 0 2024-09-18T21:12:41.590 INFO:tasks.workunit.client.0.smithi077.stdout:4/100: dread d3/fb [4194304,4194304] 0 2024-09-18T21:12:41.592 INFO:tasks.workunit.client.1.smithi103.stdout:7/58: mknod d1/c10 0 2024-09-18T21:12:41.593 INFO:tasks.workunit.client.1.smithi103.stdout:4/52: dwrite d9/fb [4194304,4194304] 0 2024-09-18T21:12:41.596 INFO:tasks.workunit.client.1.smithi103.stdout:0/102: mknod d1/d5/de/d22/c23 0 2024-09-18T21:12:41.597 INFO:tasks.workunit.client.1.smithi103.stdout:5/25: truncate f8 678025 0 2024-09-18T21:12:41.597 INFO:tasks.workunit.client.1.smithi103.stdout:5/26: readlink lc 0 2024-09-18T21:12:41.601 INFO:tasks.workunit.client.1.smithi103.stdout:4/53: creat d9/f14 x:0 0 0 2024-09-18T21:12:41.607 INFO:tasks.workunit.client.1.smithi103.stdout:0/103: mkdir d1/d5/de/d24 0 2024-09-18T21:12:41.608 INFO:tasks.workunit.client.1.smithi103.stdout:7/59: mknod d1/df/c11 0 2024-09-18T21:12:41.620 INFO:tasks.workunit.client.1.smithi103.stdout:7/60: truncate d1/fa 3899309 0 2024-09-18T21:12:41.624 INFO:tasks.workunit.client.1.smithi103.stdout:7/61: dread d1/fe [0,4194304] 0 2024-09-18T21:12:41.627 INFO:tasks.workunit.client.1.smithi103.stdout:7/62: creat d1/f12 x:0 0 0 2024-09-18T21:12:41.630 INFO:tasks.workunit.client.1.smithi103.stdout:7/63: rename d1/f7 to d1/f13 0 2024-09-18T21:12:41.631 INFO:tasks.workunit.client.1.smithi103.stdout:7/64: truncate d1/f12 742629 0 2024-09-18T21:12:41.631 INFO:tasks.workunit.client.1.smithi103.stdout:7/65: write d1/f12 [866377,76808] 0 2024-09-18T21:12:41.632 INFO:tasks.workunit.client.1.smithi103.stdout:7/66: write d1/fc [1091032,4517] 0 2024-09-18T21:12:41.638 INFO:tasks.workunit.client.1.smithi103.stdout:7/67: dwrite d1/f12 [0,4194304] 0 2024-09-18T21:12:41.644 INFO:tasks.workunit.client.1.smithi103.stdout:3/44: truncate d1/d2/fb 272257 0 2024-09-18T21:12:41.644 INFO:tasks.workunit.client.1.smithi103.stdout:7/68: dread d1/fe [0,4194304] 0 2024-09-18T21:12:41.648 INFO:tasks.workunit.client.1.smithi103.stdout:3/45: symlink d1/da/le 0 2024-09-18T21:12:41.650 INFO:tasks.workunit.client.1.smithi103.stdout:7/69: dwrite d1/f12 [0,4194304] 0 2024-09-18T21:12:41.651 INFO:tasks.workunit.client.1.smithi103.stdout:3/46: rmdir d1/da 39 2024-09-18T21:12:41.651 INFO:tasks.workunit.client.1.smithi103.stdout:2/51: truncate d3/f9 1226035 0 2024-09-18T21:12:41.656 INFO:tasks.workunit.client.1.smithi103.stdout:2/52: creat d3/f16 x:0 0 0 2024-09-18T21:12:41.657 INFO:tasks.workunit.client.1.smithi103.stdout:2/53: fdatasync d3/ff 0 2024-09-18T21:12:41.658 INFO:tasks.workunit.client.1.smithi103.stdout:3/47: mkdir d1/da/df 0 2024-09-18T21:12:41.661 INFO:tasks.workunit.client.1.smithi103.stdout:1/50: write d0/f7 [1660316,26485] 0 2024-09-18T21:12:41.666 INFO:tasks.workunit.client.1.smithi103.stdout:5/27: dread f8 [0,4194304] 0 2024-09-18T21:12:41.667 INFO:tasks.workunit.client.1.smithi103.stdout:1/51: readlink d0/d11/l12 0 2024-09-18T21:12:41.669 INFO:tasks.workunit.client.1.smithi103.stdout:9/38: truncate f8 4047745 0 2024-09-18T21:12:41.670 INFO:tasks.workunit.client.1.smithi103.stdout:5/28: symlink ld 0 2024-09-18T21:12:41.673 INFO:tasks.workunit.client.1.smithi103.stdout:5/29: mkdir de 0 2024-09-18T21:12:41.675 INFO:tasks.workunit.client.1.smithi103.stdout:1/52: symlink d0/d11/l13 0 2024-09-18T21:12:41.676 INFO:tasks.workunit.client.1.smithi103.stdout:0/104: write d1/d5/f16 [28453,101889] 0 2024-09-18T21:12:41.677 INFO:tasks.workunit.client.1.smithi103.stdout:1/53: truncate d0/ff 87781 0 2024-09-18T21:12:41.678 INFO:tasks.workunit.client.1.smithi103.stdout:0/105: fsync d1/fa 0 2024-09-18T21:12:41.679 INFO:tasks.workunit.client.1.smithi103.stdout:4/54: dwrite d9/fc [0,4194304] 0 2024-09-18T21:12:41.679 INFO:tasks.workunit.client.1.smithi103.stdout:5/30: creat de/ff x:0 0 0 2024-09-18T21:12:41.682 INFO:tasks.workunit.client.1.smithi103.stdout:1/54: mknod d0/d2/c14 0 2024-09-18T21:12:41.683 INFO:tasks.workunit.client.1.smithi103.stdout:6/113: sync 2024-09-18T21:12:41.683 INFO:tasks.workunit.client.1.smithi103.stdout:1/55: stat d0/d2/l5 0 2024-09-18T21:12:41.691 INFO:tasks.workunit.client.1.smithi103.stdout:4/55: rename c7 to d9/c15 0 2024-09-18T21:12:41.694 INFO:tasks.workunit.client.1.smithi103.stdout:0/106: truncate d1/d5/de/d19/d1e/f21 789542 0 2024-09-18T21:12:41.698 INFO:tasks.workunit.client.1.smithi103.stdout:1/56: creat d0/d2/d9/dc/f15 x:0 0 0 2024-09-18T21:12:41.698 INFO:tasks.workunit.client.1.smithi103.stdout:1/57: stat d0/d2 0 2024-09-18T21:12:41.699 INFO:tasks.workunit.client.1.smithi103.stdout:0/107: dwrite d1/f17 [0,4194304] 0 2024-09-18T21:12:41.700 INFO:tasks.workunit.client.1.smithi103.stdout:0/108: chown d1/fd 4479800 1 2024-09-18T21:12:41.701 INFO:tasks.workunit.client.1.smithi103.stdout:4/56: rename d9/ce to d9/c16 0 2024-09-18T21:12:41.703 INFO:tasks.workunit.client.1.smithi103.stdout:1/58: mkdir d0/d11/d16 0 2024-09-18T21:12:41.703 INFO:tasks.workunit.client.1.smithi103.stdout:7/70: dread d1/f13 [0,4194304] 0 2024-09-18T21:12:41.707 INFO:tasks.workunit.client.1.smithi103.stdout:4/57: read - f6 zero size 2024-09-18T21:12:41.710 INFO:tasks.workunit.client.1.smithi103.stdout:1/59: dwrite d0/d2/fb [0,4194304] 0 2024-09-18T21:12:41.711 INFO:tasks.workunit.client.1.smithi103.stdout:6/114: rename d2/d3/l21 to d2/l25 0 2024-09-18T21:12:41.713 INFO:tasks.workunit.client.1.smithi103.stdout:4/58: dread d9/fc [0,4194304] 0 2024-09-18T21:12:41.716 INFO:tasks.workunit.client.1.smithi103.stdout:8/56: sync 2024-09-18T21:12:41.717 INFO:tasks.workunit.client.1.smithi103.stdout:6/115: dread d2/d3/f19 [0,4194304] 0 2024-09-18T21:12:41.721 INFO:tasks.workunit.client.1.smithi103.stdout:1/60: symlink d0/d11/l17 0 2024-09-18T21:12:41.725 INFO:tasks.workunit.client.0.smithi077.stdout:8/84: dwrite d2/d5/d6/f8 [0,4194304] 0 2024-09-18T21:12:41.727 INFO:tasks.workunit.client.1.smithi103.stdout:4/59: symlink d9/l17 0 2024-09-18T21:12:41.728 INFO:tasks.workunit.client.1.smithi103.stdout:4/60: stat d9/f11 0 2024-09-18T21:12:41.730 INFO:tasks.workunit.client.1.smithi103.stdout:2/54: dwrite d3/f9 [0,4194304] 0 2024-09-18T21:12:41.733 INFO:tasks.workunit.client.1.smithi103.stdout:6/116: mknod d2/d3/d8/c26 0 2024-09-18T21:12:41.734 INFO:tasks.workunit.client.0.smithi077.stdout:8/85: mkdir d2/d5/df/d20 0 2024-09-18T21:12:41.735 INFO:tasks.workunit.client.0.smithi077.stdout:8/86: read d2/d5/d6/f8 [3544239,45526] 0 2024-09-18T21:12:41.739 INFO:tasks.workunit.client.1.smithi103.stdout:3/48: write d1/fc [1021933,43647] 0 2024-09-18T21:12:41.741 INFO:tasks.workunit.client.1.smithi103.stdout:0/109: getdents d1 0 2024-09-18T21:12:41.742 INFO:tasks.workunit.client.1.smithi103.stdout:4/61: dwrite d9/f11 [0,4194304] 0 2024-09-18T21:12:41.746 INFO:tasks.workunit.client.0.smithi077.stdout:8/87: getdents d2/d5/df/d18 0 2024-09-18T21:12:41.751 INFO:tasks.workunit.client.1.smithi103.stdout:3/49: fdatasync d1/f9 0 2024-09-18T21:12:41.751 INFO:tasks.workunit.client.1.smithi103.stdout:2/55: fdatasync d3/d5/fe 0 2024-09-18T21:12:41.752 INFO:tasks.workunit.client.1.smithi103.stdout:3/50: chown d1/da 168 1 2024-09-18T21:12:41.753 INFO:tasks.workunit.client.1.smithi103.stdout:0/110: mknod d1/d9/d13/c25 0 2024-09-18T21:12:41.753 INFO:tasks.workunit.client.1.smithi103.stdout:2/56: read d3/d5/fe [1857085,84145] 0 2024-09-18T21:12:41.753 INFO:tasks.workunit.client.1.smithi103.stdout:4/62: truncate f6 27805 0 2024-09-18T21:12:41.753 INFO:tasks.workunit.client.1.smithi103.stdout:2/57: chown d3/l4 11530 1 2024-09-18T21:12:41.754 INFO:tasks.workunit.client.1.smithi103.stdout:2/58: readlink d3/l10 0 2024-09-18T21:12:41.754 INFO:tasks.workunit.client.1.smithi103.stdout:2/59: fsync d3/ff 0 2024-09-18T21:12:41.755 INFO:tasks.workunit.client.1.smithi103.stdout:0/111: dread d1/d5/f16 [0,4194304] 0 2024-09-18T21:12:41.755 INFO:tasks.workunit.client.1.smithi103.stdout:6/117: creat d2/d24/f27 x:0 0 0 2024-09-18T21:12:41.756 INFO:tasks.workunit.client.1.smithi103.stdout:1/61: link d0/d3/l8 d0/d11/l18 0 2024-09-18T21:12:41.760 INFO:tasks.workunit.client.1.smithi103.stdout:0/112: mkdir d1/d5/d26 0 2024-09-18T21:12:41.761 INFO:tasks.workunit.client.1.smithi103.stdout:0/113: truncate d1/d5/de/d19/d1e/f1f 736850 0 2024-09-18T21:12:41.761 INFO:tasks.workunit.client.1.smithi103.stdout:2/60: rename d3/d5/fd to d3/d5/f17 0 2024-09-18T21:12:41.769 INFO:tasks.workunit.client.1.smithi103.stdout:5/31: dwrite f8 [0,4194304] 0 2024-09-18T21:12:41.771 INFO:tasks.workunit.client.1.smithi103.stdout:6/118: dwrite d2/d3/f19 [0,4194304] 0 2024-09-18T21:12:41.771 INFO:tasks.workunit.client.1.smithi103.stdout:2/61: link d3/d5/fe d3/d5/f18 0 2024-09-18T21:12:41.772 INFO:tasks.workunit.client.1.smithi103.stdout:3/51: getdents d1 0 2024-09-18T21:12:41.773 INFO:tasks.workunit.client.1.smithi103.stdout:2/62: dread - d3/ff zero size 2024-09-18T21:12:41.773 INFO:tasks.workunit.client.1.smithi103.stdout:6/119: chown d2/d3/d8 77 1 2024-09-18T21:12:41.773 INFO:tasks.workunit.client.1.smithi103.stdout:5/32: symlink de/l10 0 2024-09-18T21:12:41.774 INFO:tasks.workunit.client.1.smithi103.stdout:0/114: getdents d1/d5/de/d22 0 2024-09-18T21:12:41.775 INFO:tasks.workunit.client.1.smithi103.stdout:0/115: chown d1/l3 2703 1 2024-09-18T21:12:41.781 INFO:tasks.workunit.client.1.smithi103.stdout:0/116: rename d1/d5/l1a to d1/l27 0 2024-09-18T21:12:41.784 INFO:tasks.workunit.client.1.smithi103.stdout:6/120: creat d2/f28 x:0 0 0 2024-09-18T21:12:41.785 INFO:tasks.workunit.client.1.smithi103.stdout:3/52: link d1/l4 d1/da/l10 0 2024-09-18T21:12:41.785 INFO:tasks.workunit.client.1.smithi103.stdout:3/53: chown d1 740 1 2024-09-18T21:12:41.790 INFO:tasks.workunit.client.1.smithi103.stdout:8/57: write d4/de/f11 [459040,123300] 0 2024-09-18T21:12:41.793 INFO:tasks.workunit.client.1.smithi103.stdout:8/58: mknod d4/c1b 0 2024-09-18T21:12:41.793 INFO:tasks.workunit.client.0.smithi077.stdout:8/88: rmdir d2/d5 39 2024-09-18T21:12:41.794 INFO:tasks.workunit.client.1.smithi103.stdout:7/71: dwrite d1/fa [0,4194304] 0 2024-09-18T21:12:41.795 INFO:tasks.workunit.client.1.smithi103.stdout:8/59: creat d4/de/f1c x:0 0 0 2024-09-18T21:12:41.797 INFO:tasks.workunit.client.0.smithi077.stdout:2/138: dwrite d1/d4/f22 [4194304,4194304] 0 2024-09-18T21:12:41.798 INFO:tasks.workunit.client.0.smithi077.stdout:4/101: dwrite d3/f5 [0,4194304] 0 2024-09-18T21:12:41.798 INFO:tasks.workunit.client.1.smithi103.stdout:7/72: creat d1/df/f14 x:0 0 0 2024-09-18T21:12:41.799 INFO:tasks.workunit.client.1.smithi103.stdout:8/60: creat d4/d6/f1d x:0 0 0 2024-09-18T21:12:41.799 INFO:tasks.workunit.client.0.smithi077.stdout:8/89: truncate d2/d5/d6/f1a 544673 0 2024-09-18T21:12:41.800 INFO:tasks.workunit.client.0.smithi077.stdout:4/102: dread - d3/f1f zero size 2024-09-18T21:12:41.803 INFO:tasks.workunit.client.0.smithi077.stdout:4/103: chown d3/d7/f13 6 1 2024-09-18T21:12:41.803 INFO:tasks.workunit.client.0.smithi077.stdout:0/161: sync 2024-09-18T21:12:41.803 INFO:tasks.workunit.client.0.smithi077.stdout:7/127: sync 2024-09-18T21:12:41.804 INFO:tasks.workunit.client.0.smithi077.stdout:5/120: sync 2024-09-18T21:12:41.804 INFO:tasks.workunit.client.0.smithi077.stdout:1/111: sync 2024-09-18T21:12:41.804 INFO:tasks.workunit.client.0.smithi077.stdout:9/81: sync 2024-09-18T21:12:41.804 INFO:tasks.workunit.client.0.smithi077.stdout:3/106: sync 2024-09-18T21:12:41.804 INFO:tasks.workunit.client.1.smithi103.stdout:8/61: creat d4/de/f1e x:0 0 0 2024-09-18T21:12:41.804 INFO:tasks.workunit.client.1.smithi103.stdout:9/39: write f8 [3908679,63602] 0 2024-09-18T21:12:41.805 INFO:tasks.workunit.client.1.smithi103.stdout:8/62: truncate d4/d6/f1d 221886 0 2024-09-18T21:12:41.806 INFO:tasks.workunit.client.1.smithi103.stdout:8/63: chown d4/de 0 1 2024-09-18T21:12:41.808 INFO:tasks.workunit.client.0.smithi077.stdout:3/107: chown f5 36522427 1 2024-09-18T21:12:41.810 INFO:tasks.workunit.client.0.smithi077.stdout:9/82: dread d1/f16 [0,4194304] 0 2024-09-18T21:12:41.812 INFO:tasks.workunit.client.1.smithi103.stdout:4/63: truncate f6 3526 0 2024-09-18T21:12:41.813 INFO:tasks.workunit.client.0.smithi077.stdout:2/139: dwrite d1/d4/f8 [4194304,4194304] 0 2024-09-18T21:12:41.816 INFO:tasks.workunit.client.0.smithi077.stdout:2/140: chown d1/d4/d5/f7 1433 1 2024-09-18T21:12:41.818 INFO:tasks.workunit.client.0.smithi077.stdout:4/104: creat d3/d7/f23 x:0 0 0 2024-09-18T21:12:41.820 INFO:tasks.workunit.client.0.smithi077.stdout:2/141: write d1/d4/d9/fb [2437366,109620] 0 2024-09-18T21:12:41.820 INFO:tasks.workunit.client.0.smithi077.stdout:7/128: dwrite d12/f1f [0,4194304] 0 2024-09-18T21:12:41.821 INFO:tasks.workunit.client.1.smithi103.stdout:8/64: unlink d4/d6/c18 0 2024-09-18T21:12:41.821 INFO:tasks.workunit.client.0.smithi077.stdout:4/105: read - d3/f18 zero size 2024-09-18T21:12:41.821 INFO:tasks.workunit.client.1.smithi103.stdout:8/65: stat d4/d6/f1a 0 2024-09-18T21:12:41.822 INFO:tasks.workunit.client.0.smithi077.stdout:6/154: sync 2024-09-18T21:12:41.823 INFO:tasks.workunit.client.0.smithi077.stdout:1/112: stat d3/d8/f1c 0 2024-09-18T21:12:41.825 INFO:tasks.workunit.client.1.smithi103.stdout:8/66: read d4/ff [625627,128856] 0 2024-09-18T21:12:41.826 INFO:tasks.workunit.client.1.smithi103.stdout:8/67: chown d4 127163104 1 2024-09-18T21:12:41.826 INFO:tasks.workunit.client.0.smithi077.stdout:4/106: dread d3/d7/f13 [0,4194304] 0 2024-09-18T21:12:41.827 INFO:tasks.workunit.client.0.smithi077.stdout:3/108: rename f9 to db/d14/f1e 0 2024-09-18T21:12:41.827 INFO:tasks.workunit.client.0.smithi077.stdout:9/83: rename d1 to d1/dd/d11/d19 22 2024-09-18T21:12:41.828 INFO:tasks.workunit.client.0.smithi077.stdout:4/107: stat d3/d7/c14 0 2024-09-18T21:12:41.828 INFO:tasks.workunit.client.0.smithi077.stdout:5/121: mknod d0/d6/c2d 0 2024-09-18T21:12:41.829 INFO:tasks.workunit.client.0.smithi077.stdout:4/108: fdatasync d3/dc/f1c 0 2024-09-18T21:12:41.830 INFO:tasks.workunit.client.1.smithi103.stdout:5/33: getdents de 0 2024-09-18T21:12:41.833 INFO:tasks.workunit.client.0.smithi077.stdout:9/84: dread d1/df/f12 [0,4194304] 0 2024-09-18T21:12:41.834 INFO:tasks.workunit.client.0.smithi077.stdout:0/162: mkdir d8/d1a/d39 0 2024-09-18T21:12:41.837 INFO:tasks.workunit.client.0.smithi077.stdout:4/109: dwrite d3/d7/f23 [0,4194304] 0 2024-09-18T21:12:41.840 INFO:tasks.workunit.client.0.smithi077.stdout:6/155: readlink d7/df/d11/l24 0 2024-09-18T21:12:41.841 INFO:tasks.workunit.client.0.smithi077.stdout:6/156: chown d7/df/f14 109794809 1 2024-09-18T21:12:41.843 INFO:tasks.workunit.client.0.smithi077.stdout:6/157: write d7/df/d11/d1d/f34 [387602,12903] 0 2024-09-18T21:12:41.844 INFO:tasks.workunit.client.0.smithi077.stdout:3/109: mknod db/d14/c1f 0 2024-09-18T21:12:41.847 INFO:tasks.workunit.client.0.smithi077.stdout:8/90: write d2/d5/d6/f1f [1586393,117985] 0 2024-09-18T21:12:41.847 INFO:tasks.workunit.client.0.smithi077.stdout:9/85: mkdir d1/dd/d1a 0 2024-09-18T21:12:41.853 INFO:tasks.workunit.client.0.smithi077.stdout:1/113: write d3/d8/f16 [391409,38215] 0 2024-09-18T21:12:41.855 INFO:tasks.workunit.client.0.smithi077.stdout:6/158: creat d7/df/f36 x:0 0 0 2024-09-18T21:12:41.856 INFO:tasks.workunit.client.0.smithi077.stdout:3/110: creat db/d14/f20 x:0 0 0 2024-09-18T21:12:41.857 INFO:tasks.workunit.client.0.smithi077.stdout:6/159: fdatasync d7/df/d11/d1d/f2e 0 2024-09-18T21:12:41.858 INFO:tasks.workunit.client.0.smithi077.stdout:0/163: dread d8/f36 [0,4194304] 0 2024-09-18T21:12:41.858 INFO:tasks.workunit.client.0.smithi077.stdout:8/91: creat d2/d5/d6/f21 x:0 0 0 2024-09-18T21:12:41.860 INFO:tasks.workunit.client.0.smithi077.stdout:2/142: creat d1/f2a x:0 0 0 2024-09-18T21:12:41.862 INFO:tasks.workunit.client.0.smithi077.stdout:1/114: fsync d3/d8/d13/f1f 0 2024-09-18T21:12:41.863 INFO:tasks.workunit.client.0.smithi077.stdout:5/122: creat d0/f2e x:0 0 0 2024-09-18T21:12:41.864 INFO:tasks.workunit.client.1.smithi103.stdout:7/73: getdents d1/df 0 2024-09-18T21:12:41.864 INFO:tasks.workunit.client.0.smithi077.stdout:3/111: symlink db/d14/l21 0 2024-09-18T21:12:41.865 INFO:tasks.workunit.client.1.smithi103.stdout:8/68: dwrite d4/de/f11 [0,4194304] 0 2024-09-18T21:12:41.866 INFO:tasks.workunit.client.1.smithi103.stdout:9/40: write f5 [1055919,1441] 0 2024-09-18T21:12:41.867 INFO:tasks.workunit.client.0.smithi077.stdout:9/86: dwrite d1/f3 [0,4194304] 0 2024-09-18T21:12:41.868 INFO:tasks.workunit.client.1.smithi103.stdout:8/69: dread - d4/de/f16 zero size 2024-09-18T21:12:41.868 INFO:tasks.workunit.client.1.smithi103.stdout:9/41: chown c7 295355874 1 2024-09-18T21:12:41.869 INFO:tasks.workunit.client.0.smithi077.stdout:0/164: dread - d8/d1d/f2b zero size 2024-09-18T21:12:41.869 INFO:tasks.workunit.client.0.smithi077.stdout:9/87: write d1/f3 [380145,1623] 0 2024-09-18T21:12:41.869 INFO:tasks.workunit.client.1.smithi103.stdout:9/42: write f5 [722447,50682] 0 2024-09-18T21:12:41.870 INFO:tasks.workunit.client.1.smithi103.stdout:6/121: dwrite d2/d3/d8/df/f11 [0,4194304] 0 2024-09-18T21:12:41.870 INFO:tasks.workunit.client.1.smithi103.stdout:3/54: truncate d1/d2/fb 848694 0 2024-09-18T21:12:41.871 INFO:tasks.workunit.client.0.smithi077.stdout:2/143: dread d1/d4/f22 [4194304,4194304] 0 2024-09-18T21:12:41.872 INFO:tasks.workunit.client.1.smithi103.stdout:9/43: dread fa [0,4194304] 0 2024-09-18T21:12:41.873 INFO:tasks.workunit.client.1.smithi103.stdout:0/117: dread d1/d5/f6 [0,4194304] 0 2024-09-18T21:12:41.874 INFO:tasks.workunit.client.1.smithi103.stdout:9/44: chown f5 44062120 1 2024-09-18T21:12:41.874 INFO:tasks.workunit.client.0.smithi077.stdout:6/160: symlink d7/l37 0 2024-09-18T21:12:41.874 INFO:tasks.workunit.client.1.smithi103.stdout:9/45: write f1 [503033,26307] 0 2024-09-18T21:12:41.875 INFO:tasks.workunit.client.0.smithi077.stdout:7/129: truncate d12/d31/d33/d2a/f32 591054 0 2024-09-18T21:12:41.876 INFO:tasks.workunit.client.1.smithi103.stdout:0/118: rename d1/d5/de/d22 to d1/d5/de/d22/d28 22 2024-09-18T21:12:41.876 INFO:tasks.workunit.client.0.smithi077.stdout:2/144: read d1/d4/f22 [2179213,82144] 0 2024-09-18T21:12:41.876 INFO:tasks.workunit.client.1.smithi103.stdout:6/122: dread d2/fb [0,4194304] 0 2024-09-18T21:12:41.877 INFO:tasks.workunit.client.0.smithi077.stdout:7/130: write d12/f1f [4528460,109097] 0 2024-09-18T21:12:41.877 INFO:tasks.workunit.client.1.smithi103.stdout:6/123: write d2/f28 [430722,49263] 0 2024-09-18T21:12:41.879 INFO:tasks.workunit.client.0.smithi077.stdout:3/112: mkdir db/d14/d22 0 2024-09-18T21:12:41.881 INFO:tasks.workunit.client.1.smithi103.stdout:7/74: creat d1/f15 x:0 0 0 2024-09-18T21:12:41.882 INFO:tasks.workunit.client.1.smithi103.stdout:5/34: getdents de 0 2024-09-18T21:12:41.883 INFO:tasks.workunit.client.1.smithi103.stdout:6/124: dread d2/fb [0,4194304] 0 2024-09-18T21:12:41.884 INFO:tasks.workunit.client.0.smithi077.stdout:5/123: dwrite d0/f2e [0,4194304] 0 2024-09-18T21:12:41.887 INFO:tasks.workunit.client.1.smithi103.stdout:7/75: dread d1/f12 [0,4194304] 0 2024-09-18T21:12:41.889 INFO:tasks.workunit.client.0.smithi077.stdout:1/115: dwrite d3/ff [0,4194304] 0 2024-09-18T21:12:41.890 INFO:tasks.workunit.client.1.smithi103.stdout:9/46: dread f4 [0,4194304] 0 2024-09-18T21:12:41.894 INFO:tasks.workunit.client.0.smithi077.stdout:7/131: read d12/d22/f28 [3332367,7521] 0 2024-09-18T21:12:41.895 INFO:tasks.workunit.client.0.smithi077.stdout:4/110: dwrite d3/fb [0,4194304] 0 2024-09-18T21:12:41.899 INFO:tasks.workunit.client.0.smithi077.stdout:4/111: dread - d3/dc/f1b zero size 2024-09-18T21:12:41.900 INFO:tasks.workunit.client.1.smithi103.stdout:5/35: mkdir de/d11 0 2024-09-18T21:12:41.903 INFO:tasks.workunit.client.0.smithi077.stdout:2/145: mkdir d1/d4/d2b 0 2024-09-18T21:12:41.904 INFO:tasks.workunit.client.0.smithi077.stdout:2/146: write d1/d4/d9/fb [166946,97198] 0 2024-09-18T21:12:41.906 INFO:tasks.workunit.client.0.smithi077.stdout:2/147: read d1/d4/f8 [4874114,2828] 0 2024-09-18T21:12:41.906 INFO:tasks.workunit.client.0.smithi077.stdout:3/113: symlink db/d14/l23 0 2024-09-18T21:12:41.908 INFO:tasks.workunit.client.1.smithi103.stdout:3/55: fsync d1/d2/fb 0 2024-09-18T21:12:41.908 INFO:tasks.workunit.client.0.smithi077.stdout:3/114: write db/d14/f20 [550635,22186] 0 2024-09-18T21:12:41.912 INFO:tasks.workunit.client.0.smithi077.stdout:9/88: unlink d1/ca 0 2024-09-18T21:12:41.913 INFO:tasks.workunit.client.1.smithi103.stdout:9/47: creat fc x:0 0 0 2024-09-18T21:12:41.916 INFO:tasks.workunit.client.0.smithi077.stdout:5/124: mknod d0/df/d10/c2f 0 2024-09-18T21:12:41.918 INFO:tasks.workunit.client.0.smithi077.stdout:1/116: rmdir d3 39 2024-09-18T21:12:41.921 INFO:tasks.workunit.client.1.smithi103.stdout:0/119: rename d1/d5/de/f20 to d1/f29 0 2024-09-18T21:12:41.922 INFO:tasks.workunit.client.0.smithi077.stdout:7/132: symlink d12/d31/l34 0 2024-09-18T21:12:41.926 INFO:tasks.workunit.client.1.smithi103.stdout:3/56: unlink d1/f9 0 2024-09-18T21:12:41.927 INFO:tasks.workunit.client.1.smithi103.stdout:8/70: dwrite d4/d6/f8 [0,4194304] 0 2024-09-18T21:12:41.927 INFO:tasks.workunit.client.0.smithi077.stdout:8/92: truncate d2/d5/d6/f1a 1113141 0 2024-09-18T21:12:41.930 INFO:tasks.workunit.client.0.smithi077.stdout:2/148: rmdir d1/d4/d9/d24 39 2024-09-18T21:12:41.930 INFO:tasks.workunit.client.1.smithi103.stdout:5/36: creat de/d11/f12 x:0 0 0 2024-09-18T21:12:41.933 INFO:tasks.workunit.client.1.smithi103.stdout:6/125: rename d2/f18 to d2/d3/d8/f29 0 2024-09-18T21:12:41.935 INFO:tasks.workunit.client.0.smithi077.stdout:0/165: write d8/f13 [1434003,43008] 0 2024-09-18T21:12:41.937 INFO:tasks.workunit.client.1.smithi103.stdout:8/71: dwrite d4/de/f1e [0,4194304] 0 2024-09-18T21:12:41.939 INFO:tasks.workunit.client.0.smithi077.stdout:5/125: creat d0/d6/dd/f30 x:0 0 0 2024-09-18T21:12:41.940 INFO:tasks.workunit.client.0.smithi077.stdout:9/89: rmdir d1 39 2024-09-18T21:12:41.942 INFO:tasks.workunit.client.1.smithi103.stdout:5/37: mknod de/c13 0 2024-09-18T21:12:41.942 INFO:tasks.workunit.client.1.smithi103.stdout:5/38: readlink lc 0 2024-09-18T21:12:41.943 INFO:tasks.workunit.client.1.smithi103.stdout:5/39: readlink ld 0 2024-09-18T21:12:41.943 INFO:tasks.workunit.client.1.smithi103.stdout:5/40: dread - de/d11/f12 zero size 2024-09-18T21:12:41.943 INFO:tasks.workunit.client.1.smithi103.stdout:5/41: dread - de/ff zero size 2024-09-18T21:12:41.944 INFO:tasks.workunit.client.0.smithi077.stdout:7/133: symlink d12/d31/d33/l35 0 2024-09-18T21:12:41.945 INFO:tasks.workunit.client.1.smithi103.stdout:0/120: mknod d1/d5/de/d22/c2a 0 2024-09-18T21:12:41.945 INFO:tasks.workunit.client.1.smithi103.stdout:0/121: readlink d1/d5/de/l15 0 2024-09-18T21:12:41.946 INFO:tasks.workunit.client.1.smithi103.stdout:0/122: stat d1/d5/de/l15 0 2024-09-18T21:12:41.948 INFO:tasks.workunit.client.0.smithi077.stdout:7/134: dread d12/d22/f28 [0,4194304] 0 2024-09-18T21:12:41.950 INFO:tasks.workunit.client.0.smithi077.stdout:7/135: dread fa [0,4194304] 0 2024-09-18T21:12:41.950 INFO:tasks.workunit.client.0.smithi077.stdout:8/93: rename d2/d5/df to d2/d5/d6/d22 0 2024-09-18T21:12:41.954 INFO:tasks.workunit.client.1.smithi103.stdout:9/48: write f4 [3083611,108271] 0 2024-09-18T21:12:41.954 INFO:tasks.workunit.client.1.smithi103.stdout:7/76: rename d1/c10 to d1/df/c16 0 2024-09-18T21:12:41.954 INFO:tasks.workunit.client.0.smithi077.stdout:8/94: dread d2/d5/d6/f8 [0,4194304] 0 2024-09-18T21:12:41.955 INFO:tasks.workunit.client.0.smithi077.stdout:8/95: dread - d2/d5/d6/d22/f1b zero size 2024-09-18T21:12:41.956 INFO:tasks.workunit.client.1.smithi103.stdout:7/77: write d1/df/f14 [822378,8219] 0 2024-09-18T21:12:41.958 INFO:tasks.workunit.client.1.smithi103.stdout:1/62: sync 2024-09-18T21:12:41.959 INFO:tasks.workunit.client.0.smithi077.stdout:6/161: link d7/f1c d7/df/d11/d1d/f38 0 2024-09-18T21:12:41.961 INFO:tasks.workunit.client.1.smithi103.stdout:3/57: write d1/fc [1984769,28333] 0 2024-09-18T21:12:41.961 INFO:tasks.workunit.client.1.smithi103.stdout:9/49: dwrite f1 [0,4194304] 0 2024-09-18T21:12:41.962 INFO:tasks.workunit.client.0.smithi077.stdout:5/126: symlink d0/d6/dd/l31 0 2024-09-18T21:12:41.966 INFO:tasks.workunit.client.0.smithi077.stdout:4/112: dwrite d3/dc/f16 [0,4194304] 0 2024-09-18T21:12:41.968 INFO:tasks.workunit.client.1.smithi103.stdout:0/123: chown d1/d9/d13/f14 8 1 2024-09-18T21:12:41.970 INFO:tasks.workunit.client.1.smithi103.stdout:9/50: symlink ld 0 2024-09-18T21:12:41.971 INFO:tasks.workunit.client.0.smithi077.stdout:7/136: creat d12/d31/d33/f36 x:0 0 0 2024-09-18T21:12:41.972 INFO:tasks.workunit.client.0.smithi077.stdout:2/149: mkdir d1/d20/d2c 0 2024-09-18T21:12:41.973 INFO:tasks.workunit.client.0.smithi077.stdout:2/150: stat d1/d4/d2b 0 2024-09-18T21:12:41.975 INFO:tasks.workunit.client.1.smithi103.stdout:1/63: mkdir d0/d11/d16/d19 0 2024-09-18T21:12:41.975 INFO:tasks.workunit.client.0.smithi077.stdout:6/162: rmdir d7 39 2024-09-18T21:12:41.977 INFO:tasks.workunit.client.1.smithi103.stdout:6/126: dwrite d2/fb [0,4194304] 0 2024-09-18T21:12:41.977 INFO:tasks.workunit.client.1.smithi103.stdout:7/78: dread d1/f12 [0,4194304] 0 2024-09-18T21:12:41.977 INFO:tasks.workunit.client.1.smithi103.stdout:3/58: dread d1/fc [0,4194304] 0 2024-09-18T21:12:41.978 INFO:tasks.workunit.client.1.smithi103.stdout:1/64: stat d0/d2/l5 0 2024-09-18T21:12:41.980 INFO:tasks.workunit.client.1.smithi103.stdout:5/42: dwrite f8 [4194304,4194304] 0 2024-09-18T21:12:41.981 INFO:tasks.workunit.client.0.smithi077.stdout:1/117: mknod d3/d8/c27 0 2024-09-18T21:12:41.981 INFO:tasks.workunit.client.0.smithi077.stdout:1/118: write d3/d8/d13/f1f [661553,122505] 0 2024-09-18T21:12:41.981 INFO:tasks.workunit.client.1.smithi103.stdout:5/43: stat c9 0 2024-09-18T21:12:41.981 INFO:tasks.workunit.client.0.smithi077.stdout:1/119: chown d3/d1e 2 1 2024-09-18T21:12:41.982 INFO:tasks.workunit.client.0.smithi077.stdout:1/120: dread - d3/f23 zero size 2024-09-18T21:12:41.982 INFO:tasks.workunit.client.1.smithi103.stdout:5/44: read f8 [6582868,63960] 0 2024-09-18T21:12:41.988 INFO:tasks.workunit.client.1.smithi103.stdout:6/127: dread d2/fb [0,4194304] 0 2024-09-18T21:12:41.988 INFO:tasks.workunit.client.1.smithi103.stdout:7/79: dread d1/fc [0,4194304] 0 2024-09-18T21:12:41.992 INFO:tasks.workunit.client.1.smithi103.stdout:5/45: dwrite fb [0,4194304] 0 2024-09-18T21:12:41.993 INFO:tasks.workunit.client.1.smithi103.stdout:5/46: fsync f1 0 2024-09-18T21:12:41.993 INFO:tasks.workunit.client.1.smithi103.stdout:5/47: dread - de/ff zero size 2024-09-18T21:12:41.994 INFO:tasks.workunit.client.1.smithi103.stdout:5/48: chown de 0 1 2024-09-18T21:12:41.995 INFO:tasks.workunit.client.0.smithi077.stdout:5/127: write d0/f2 [541630,53947] 0 2024-09-18T21:12:41.996 INFO:tasks.workunit.client.0.smithi077.stdout:3/115: getdents db/d14 0 2024-09-18T21:12:41.999 INFO:tasks.workunit.client.0.smithi077.stdout:5/128: rename d0 to d0/df/d10/d32 22 2024-09-18T21:12:42.001 INFO:tasks.workunit.client.1.smithi103.stdout:5/49: dwrite de/ff [0,4194304] 0 2024-09-18T21:12:42.001 INFO:tasks.workunit.client.0.smithi077.stdout:2/151: dwrite d1/d4/f8 [4194304,4194304] 0 2024-09-18T21:12:42.003 INFO:tasks.workunit.client.0.smithi077.stdout:0/166: creat d8/f3a x:0 0 0 2024-09-18T21:12:42.004 INFO:tasks.workunit.client.0.smithi077.stdout:0/167: chown d8/d26/f38 3536710 1 2024-09-18T21:12:42.004 INFO:tasks.workunit.client.1.smithi103.stdout:9/51: getdents . 0 2024-09-18T21:12:42.005 INFO:tasks.workunit.client.1.smithi103.stdout:3/59: symlink d1/l11 0 2024-09-18T21:12:42.008 INFO:tasks.workunit.client.1.smithi103.stdout:7/80: creat d1/f17 x:0 0 0 2024-09-18T21:12:42.008 INFO:tasks.workunit.client.1.smithi103.stdout:5/50: dread f8 [4194304,4194304] 0 2024-09-18T21:12:42.009 INFO:tasks.workunit.client.0.smithi077.stdout:8/96: write d2/d5/d6/f1a [1591372,52209] 0 2024-09-18T21:12:42.010 INFO:tasks.workunit.client.1.smithi103.stdout:5/51: dread f1 [0,4194304] 0 2024-09-18T21:12:42.012 INFO:tasks.workunit.client.0.smithi077.stdout:1/121: dread d3/d8/f17 [0,4194304] 0 2024-09-18T21:12:42.013 INFO:tasks.workunit.client.1.smithi103.stdout:9/52: symlink le 0 2024-09-18T21:12:42.014 INFO:tasks.workunit.client.1.smithi103.stdout:9/53: fdatasync f4 0 2024-09-18T21:12:42.015 INFO:tasks.workunit.client.0.smithi077.stdout:9/90: getdents d1/dd/d11/d15 0 2024-09-18T21:12:42.015 INFO:tasks.workunit.client.1.smithi103.stdout:7/81: creat d1/df/f18 x:0 0 0 2024-09-18T21:12:42.016 INFO:tasks.workunit.client.1.smithi103.stdout:5/52: write f8 [8705504,1883] 0 2024-09-18T21:12:42.017 INFO:tasks.workunit.client.1.smithi103.stdout:5/53: chown de/l10 5662874 1 2024-09-18T21:12:42.018 INFO:tasks.workunit.client.0.smithi077.stdout:2/152: creat d1/d20/d2c/f2d x:0 0 0 2024-09-18T21:12:42.019 INFO:tasks.workunit.client.1.smithi103.stdout:9/54: creat ff x:0 0 0 2024-09-18T21:12:42.019 INFO:tasks.workunit.client.1.smithi103.stdout:9/55: rmdir - no directory 2024-09-18T21:12:42.020 INFO:tasks.workunit.client.1.smithi103.stdout:5/54: dread de/ff [0,4194304] 0 2024-09-18T21:12:42.020 INFO:tasks.workunit.client.1.smithi103.stdout:5/55: stat c4 0 2024-09-18T21:12:42.020 INFO:tasks.workunit.client.1.smithi103.stdout:5/56: readlink ld 0 2024-09-18T21:12:42.021 INFO:tasks.workunit.client.0.smithi077.stdout:0/168: mkdir d8/d1a/d39/d3b 0 2024-09-18T21:12:42.022 INFO:tasks.workunit.client.0.smithi077.stdout:0/169: chown d8/d1a/c1f 1963 1 2024-09-18T21:12:42.022 INFO:tasks.workunit.client.0.smithi077.stdout:0/170: write d8/f17 [1770158,5486] 0 2024-09-18T21:12:42.025 INFO:tasks.workunit.client.0.smithi077.stdout:3/116: creat db/f24 x:0 0 0 2024-09-18T21:12:42.026 INFO:tasks.workunit.client.0.smithi077.stdout:5/129: link d0/df/l1a d0/d6/dd/l33 0 2024-09-18T21:12:42.027 INFO:tasks.workunit.client.1.smithi103.stdout:9/56: dwrite f5 [0,4194304] 0 2024-09-18T21:12:42.027 INFO:tasks.workunit.client.1.smithi103.stdout:5/57: mkdir de/d14 0 2024-09-18T21:12:42.029 INFO:tasks.workunit.client.0.smithi077.stdout:2/153: rename d1/d4/d2b to d1/d4/d5/d1a/d2e 0 2024-09-18T21:12:42.029 INFO:tasks.workunit.client.0.smithi077.stdout:6/163: link l5 d7/l39 0 2024-09-18T21:12:42.031 INFO:tasks.workunit.client.0.smithi077.stdout:6/164: readlink d7/l13 0 2024-09-18T21:12:42.032 INFO:tasks.workunit.client.0.smithi077.stdout:6/165: chown d7/f23 236830100 1 2024-09-18T21:12:42.034 INFO:tasks.workunit.client.0.smithi077.stdout:0/171: creat d8/d1a/d39/f3c x:0 0 0 2024-09-18T21:12:42.035 INFO:tasks.workunit.client.1.smithi103.stdout:3/60: rename d1/d2/l7 to d1/l12 0 2024-09-18T21:12:42.036 INFO:tasks.workunit.client.0.smithi077.stdout:3/117: dwrite db/f13 [0,4194304] 0 2024-09-18T21:12:42.036 INFO:tasks.workunit.client.1.smithi103.stdout:5/58: mkdir de/d11/d15 0 2024-09-18T21:12:42.037 INFO:tasks.workunit.client.1.smithi103.stdout:9/57: dread f1 [0,4194304] 0 2024-09-18T21:12:42.037 INFO:tasks.workunit.client.0.smithi077.stdout:3/118: chown f5 2067010 1 2024-09-18T21:12:42.037 INFO:tasks.workunit.client.1.smithi103.stdout:5/59: write f1 [1119571,118674] 0 2024-09-18T21:12:42.038 INFO:tasks.workunit.client.0.smithi077.stdout:3/119: chown db/d14/f20 48 1 2024-09-18T21:12:42.038 INFO:tasks.workunit.client.0.smithi077.stdout:7/137: link cf d12/d22/c37 0 2024-09-18T21:12:42.039 INFO:tasks.workunit.client.1.smithi103.stdout:6/128: write d2/d3/d8/df/f17 [9327250,111253] 0 2024-09-18T21:12:42.041 INFO:tasks.workunit.client.1.smithi103.stdout:5/60: dread fb [0,4194304] 0 2024-09-18T21:12:42.043 INFO:tasks.workunit.client.1.smithi103.stdout:9/58: creat f10 x:0 0 0 2024-09-18T21:12:42.047 INFO:tasks.workunit.client.0.smithi077.stdout:0/172: mkdir d8/d1d/d3d 0 2024-09-18T21:12:42.049 INFO:tasks.workunit.client.0.smithi077.stdout:9/91: creat d1/dd/d1a/f1b x:0 0 0 2024-09-18T21:12:42.049 INFO:tasks.workunit.client.1.smithi103.stdout:7/82: write d1/f12 [4293793,34224] 0 2024-09-18T21:12:42.050 INFO:tasks.workunit.client.1.smithi103.stdout:5/61: dwrite f1 [0,4194304] 0 2024-09-18T21:12:42.052 INFO:tasks.workunit.client.1.smithi103.stdout:7/83: dread - d1/df/f18 zero size 2024-09-18T21:12:42.053 INFO:tasks.workunit.client.0.smithi077.stdout:7/138: creat d12/d22/d2d/f38 x:0 0 0 2024-09-18T21:12:42.053 INFO:tasks.workunit.client.1.smithi103.stdout:9/59: dwrite f5 [0,4194304] 0 2024-09-18T21:12:42.054 INFO:tasks.workunit.client.1.smithi103.stdout:3/61: creat d1/f13 x:0 0 0 2024-09-18T21:12:42.055 INFO:tasks.workunit.client.1.smithi103.stdout:9/60: chown f4 3851181 1 2024-09-18T21:12:42.055 INFO:tasks.workunit.client.0.smithi077.stdout:3/120: mknod db/d14/d22/c25 0 2024-09-18T21:12:42.056 INFO:tasks.workunit.client.0.smithi077.stdout:9/92: mkdir d1/dd/d11/d1c 0 2024-09-18T21:12:42.056 INFO:tasks.workunit.client.0.smithi077.stdout:5/130: link d0/df/l1a d0/df/d10/l34 0 2024-09-18T21:12:42.057 INFO:tasks.workunit.client.1.smithi103.stdout:6/129: dwrite d2/f22 [0,4194304] 0 2024-09-18T21:12:42.058 INFO:tasks.workunit.client.0.smithi077.stdout:6/166: link l3 d7/l3a 0 2024-09-18T21:12:42.059 INFO:tasks.workunit.client.1.smithi103.stdout:3/62: stat d1/l4 0 2024-09-18T21:12:42.059 INFO:tasks.workunit.client.0.smithi077.stdout:6/167: fdatasync d7/fc 0 2024-09-18T21:12:42.062 INFO:tasks.workunit.client.0.smithi077.stdout:7/139: mkdir d12/d22/d39 0 2024-09-18T21:12:42.063 INFO:tasks.workunit.client.0.smithi077.stdout:7/140: truncate f5 970075 0 2024-09-18T21:12:42.064 INFO:tasks.workunit.client.0.smithi077.stdout:9/93: mknod d1/df/c1d 0 2024-09-18T21:12:42.065 INFO:tasks.workunit.client.1.smithi103.stdout:7/84: dwrite d1/f15 [0,4194304] 0 2024-09-18T21:12:42.065 INFO:tasks.workunit.client.1.smithi103.stdout:6/130: dread - d2/d3/d8/f29 zero size 2024-09-18T21:12:42.066 INFO:tasks.workunit.client.0.smithi077.stdout:7/141: chown d12/d31/d33/l35 46427 1 2024-09-18T21:12:42.066 INFO:tasks.workunit.client.1.smithi103.stdout:9/61: dwrite f4 [0,4194304] 0 2024-09-18T21:12:42.069 INFO:tasks.workunit.client.1.smithi103.stdout:7/85: creat d1/df/f19 x:0 0 0 2024-09-18T21:12:42.069 INFO:tasks.workunit.client.0.smithi077.stdout:6/168: link d7/df/d11/l2f d7/df/l3b 0 2024-09-18T21:12:42.069 INFO:tasks.workunit.client.0.smithi077.stdout:5/131: dwrite d0/d6/dd/f30 [0,4194304] 0 2024-09-18T21:12:42.070 INFO:tasks.workunit.client.1.smithi103.stdout:4/64: sync 2024-09-18T21:12:42.070 INFO:tasks.workunit.client.1.smithi103.stdout:2/63: sync 2024-09-18T21:12:42.070 INFO:tasks.workunit.client.1.smithi103.stdout:6/131: dread d2/d3/d8/f20 [0,4194304] 0 2024-09-18T21:12:42.072 INFO:tasks.workunit.client.0.smithi077.stdout:5/132: stat d0/df/f25 0 2024-09-18T21:12:42.074 INFO:tasks.workunit.client.0.smithi077.stdout:7/142: creat d12/d22/d2d/f3a x:0 0 0 2024-09-18T21:12:42.074 INFO:tasks.workunit.client.0.smithi077.stdout:6/169: read - d7/df/d11/d25/f26 zero size 2024-09-18T21:12:42.076 INFO:tasks.workunit.client.0.smithi077.stdout:5/133: creat d0/d6/dd/f35 x:0 0 0 2024-09-18T21:12:42.077 INFO:tasks.workunit.client.0.smithi077.stdout:6/170: chown d7/df/f15 271 1 2024-09-18T21:12:42.081 INFO:tasks.workunit.client.0.smithi077.stdout:6/171: mkdir d7/df/d11/d1d/d3c 0 2024-09-18T21:12:42.081 INFO:tasks.workunit.client.1.smithi103.stdout:3/63: link d1/d2/fb d1/da/df/f14 0 2024-09-18T21:12:42.083 INFO:tasks.workunit.client.1.smithi103.stdout:9/62: link lb l11 0 2024-09-18T21:12:42.084 INFO:tasks.workunit.client.1.smithi103.stdout:7/86: dwrite d1/fa [0,4194304] 0 2024-09-18T21:12:42.084 INFO:tasks.workunit.client.0.smithi077.stdout:7/143: creat d12/d22/d39/f3b x:0 0 0 2024-09-18T21:12:42.086 INFO:tasks.workunit.client.0.smithi077.stdout:5/134: mkdir d0/d36 0 2024-09-18T21:12:42.087 INFO:tasks.workunit.client.0.smithi077.stdout:6/172: mknod d7/c3d 0 2024-09-18T21:12:42.088 INFO:tasks.workunit.client.1.smithi103.stdout:9/63: write f4 [3290182,978] 0 2024-09-18T21:12:42.088 INFO:tasks.workunit.client.0.smithi077.stdout:6/173: write d7/df/f28 [323109,60989] 0 2024-09-18T21:12:42.088 INFO:tasks.workunit.client.1.smithi103.stdout:6/132: truncate d2/d3/d8/f29 646810 0 2024-09-18T21:12:42.089 INFO:tasks.workunit.client.1.smithi103.stdout:9/64: write fc [239870,45662] 0 2024-09-18T21:12:42.090 INFO:tasks.workunit.client.0.smithi077.stdout:6/174: chown d7/df 0 1 2024-09-18T21:12:42.093 INFO:tasks.workunit.client.1.smithi103.stdout:3/64: chown d1/l3 3796358 1 2024-09-18T21:12:42.094 INFO:tasks.workunit.client.1.smithi103.stdout:6/133: write d2/f28 [663865,11437] 0 2024-09-18T21:12:42.095 INFO:tasks.workunit.client.1.smithi103.stdout:4/65: dread d9/fb [4194304,4194304] 0 2024-09-18T21:12:42.096 INFO:tasks.workunit.client.0.smithi077.stdout:7/144: dwrite d12/f24 [0,4194304] 0 2024-09-18T21:12:42.097 INFO:tasks.workunit.client.1.smithi103.stdout:4/66: stat d9/fc 0 2024-09-18T21:12:42.097 INFO:tasks.workunit.client.0.smithi077.stdout:6/175: truncate d7/f2d 456454 0 2024-09-18T21:12:42.098 INFO:tasks.workunit.client.1.smithi103.stdout:4/67: write d9/f11 [2685279,79635] 0 2024-09-18T21:12:42.099 INFO:tasks.workunit.client.1.smithi103.stdout:7/87: dwrite d1/f12 [4194304,4194304] 0 2024-09-18T21:12:42.100 INFO:tasks.workunit.client.0.smithi077.stdout:6/176: write d7/df/f2a [3985352,63197] 0 2024-09-18T21:12:42.106 INFO:tasks.workunit.client.0.smithi077.stdout:5/135: creat d0/f37 x:0 0 0 2024-09-18T21:12:42.107 INFO:tasks.workunit.client.0.smithi077.stdout:5/136: read - d0/df/f25 zero size 2024-09-18T21:12:42.108 INFO:tasks.workunit.client.0.smithi077.stdout:5/137: rename d0/d6 to d0/d6/dd/d38 22 2024-09-18T21:12:42.110 INFO:tasks.workunit.client.1.smithi103.stdout:4/68: creat d9/f18 x:0 0 0 2024-09-18T21:12:42.112 INFO:tasks.workunit.client.1.smithi103.stdout:9/65: dwrite f5 [4194304,4194304] 0 2024-09-18T21:12:42.112 INFO:tasks.workunit.client.0.smithi077.stdout:7/145: symlink d12/l3c 0 2024-09-18T21:12:42.114 INFO:tasks.workunit.client.0.smithi077.stdout:6/177: mkdir d7/df/d11/d3e 0 2024-09-18T21:12:42.118 INFO:tasks.workunit.client.0.smithi077.stdout:0/173: truncate f3 3090937 0 2024-09-18T21:12:42.119 INFO:tasks.workunit.client.0.smithi077.stdout:0/174: stat d8/d26/f28 0 2024-09-18T21:12:42.119 INFO:tasks.workunit.client.0.smithi077.stdout:5/138: dwrite d0/d6/dd/fe [0,4194304] 0 2024-09-18T21:12:42.120 INFO:tasks.workunit.client.1.smithi103.stdout:6/134: fsync d2/f12 0 2024-09-18T21:12:42.122 INFO:tasks.workunit.client.0.smithi077.stdout:7/146: creat d12/d31/d33/d2a/f3d x:0 0 0 2024-09-18T21:12:42.124 INFO:tasks.workunit.client.1.smithi103.stdout:3/65: read d1/da/df/f14 [385965,122405] 0 2024-09-18T21:12:42.124 INFO:tasks.workunit.client.1.smithi103.stdout:4/69: rename d9/fb to d9/f19 0 2024-09-18T21:12:42.125 INFO:tasks.workunit.client.0.smithi077.stdout:6/178: creat d7/df/d11/d1d/d31/f3f x:0 0 0 2024-09-18T21:12:42.129 INFO:tasks.workunit.client.0.smithi077.stdout:5/139: symlink d0/df/d10/l39 0 2024-09-18T21:12:42.130 INFO:tasks.workunit.client.0.smithi077.stdout:5/140: chown d0/d6/c15 4 1 2024-09-18T21:12:42.131 INFO:tasks.workunit.client.0.smithi077.stdout:7/147: mknod d12/d22/d39/c3e 0 2024-09-18T21:12:42.133 INFO:tasks.workunit.client.1.smithi103.stdout:6/135: dwrite d2/d24/f27 [0,4194304] 0 2024-09-18T21:12:42.134 INFO:tasks.workunit.client.1.smithi103.stdout:6/136: write d2/f22 [2167970,72263] 0 2024-09-18T21:12:42.135 INFO:tasks.workunit.client.1.smithi103.stdout:4/70: fsync d9/fc 0 2024-09-18T21:12:42.136 INFO:tasks.workunit.client.0.smithi077.stdout:0/175: creat d8/d1a/d35/f3e x:0 0 0 2024-09-18T21:12:42.136 INFO:tasks.workunit.client.0.smithi077.stdout:9/94: truncate d1/df/f18 2860284 0 2024-09-18T21:12:42.138 INFO:tasks.workunit.client.0.smithi077.stdout:0/176: truncate d8/d26/f38 389162 0 2024-09-18T21:12:42.141 INFO:tasks.workunit.client.0.smithi077.stdout:7/148: rename d12/c23 to d12/d22/d2d/c3f 0 2024-09-18T21:12:42.143 INFO:tasks.workunit.client.0.smithi077.stdout:6/179: getdents d7/df/d11/d3e 0 2024-09-18T21:12:42.146 INFO:tasks.workunit.client.0.smithi077.stdout:0/177: dread d8/f17 [0,4194304] 0 2024-09-18T21:12:42.146 INFO:tasks.workunit.client.0.smithi077.stdout:0/178: chown d8/d1a/f20 246065 1 2024-09-18T21:12:42.147 INFO:tasks.workunit.client.0.smithi077.stdout:0/179: truncate d8/d26/f32 411751 0 2024-09-18T21:12:42.148 INFO:tasks.workunit.client.1.smithi103.stdout:2/64: dwrite d3/d5/fe [0,4194304] 0 2024-09-18T21:12:42.149 INFO:tasks.workunit.client.0.smithi077.stdout:0/180: write d8/d1a/f25 [3809879,64333] 0 2024-09-18T21:12:42.149 INFO:tasks.workunit.client.1.smithi103.stdout:6/137: rename d2/fb to d2/d3/d8/f2a 0 2024-09-18T21:12:42.153 INFO:tasks.workunit.client.0.smithi077.stdout:7/149: symlink d12/d31/l40 0 2024-09-18T21:12:42.155 INFO:tasks.workunit.client.1.smithi103.stdout:2/65: symlink d3/l19 0 2024-09-18T21:12:42.155 INFO:tasks.workunit.client.1.smithi103.stdout:2/66: chown d3/ff 2 1 2024-09-18T21:12:42.156 INFO:tasks.workunit.client.1.smithi103.stdout:6/138: readlink d2/l25 0 2024-09-18T21:12:42.158 INFO:tasks.workunit.client.1.smithi103.stdout:6/139: stat d2/l25 0 2024-09-18T21:12:42.163 INFO:tasks.workunit.client.1.smithi103.stdout:2/67: dread d3/d5/f6 [0,4194304] 0 2024-09-18T21:12:42.163 INFO:tasks.workunit.client.1.smithi103.stdout:7/88: dwrite d1/f13 [0,4194304] 0 2024-09-18T21:12:42.163 INFO:tasks.workunit.client.1.smithi103.stdout:2/68: chown d3/d5 40843 1 2024-09-18T21:12:42.165 INFO:tasks.workunit.client.1.smithi103.stdout:6/140: write d2/d3/d8/f2a [1305929,83939] 0 2024-09-18T21:12:42.165 INFO:tasks.workunit.client.0.smithi077.stdout:7/150: rename fc to d12/d31/f41 0 2024-09-18T21:12:42.167 INFO:tasks.workunit.client.0.smithi077.stdout:6/180: mknod d7/df/d11/c40 0 2024-09-18T21:12:42.167 INFO:tasks.workunit.client.0.smithi077.stdout:7/151: dread - d12/d31/d33/f36 zero size 2024-09-18T21:12:42.168 INFO:tasks.workunit.client.0.smithi077.stdout:7/152: fdatasync f5 0 2024-09-18T21:12:42.169 INFO:tasks.workunit.client.1.smithi103.stdout:2/69: unlink d3/f15 0 2024-09-18T21:12:42.170 INFO:tasks.workunit.client.1.smithi103.stdout:9/66: dwrite fa [0,4194304] 0 2024-09-18T21:12:42.171 INFO:tasks.workunit.client.1.smithi103.stdout:7/89: dread d1/f12 [0,4194304] 0 2024-09-18T21:12:42.171 INFO:tasks.workunit.client.1.smithi103.stdout:2/70: write d3/d5/f11 [2767252,10817] 0 2024-09-18T21:12:42.175 INFO:tasks.workunit.client.1.smithi103.stdout:2/71: dread d3/d5/f6 [0,4194304] 0 2024-09-18T21:12:42.181 INFO:tasks.workunit.client.1.smithi103.stdout:2/72: dread d3/d5/fe [0,4194304] 0 2024-09-18T21:12:42.182 INFO:tasks.workunit.client.0.smithi077.stdout:5/141: truncate d0/f2e 451938 0 2024-09-18T21:12:42.184 INFO:tasks.workunit.client.1.smithi103.stdout:2/73: write d3/f9 [4442105,98813] 0 2024-09-18T21:12:42.185 INFO:tasks.workunit.client.1.smithi103.stdout:3/66: dwrite d1/d2/fb [0,4194304] 0 2024-09-18T21:12:42.185 INFO:tasks.workunit.client.1.smithi103.stdout:9/67: creat f12 x:0 0 0 2024-09-18T21:12:42.186 INFO:tasks.workunit.client.0.smithi077.stdout:0/181: rmdir d8/d1d/d3d 0 2024-09-18T21:12:42.187 INFO:tasks.workunit.client.0.smithi077.stdout:0/182: stat d8/d1a/d39 0 2024-09-18T21:12:42.188 INFO:tasks.workunit.client.1.smithi103.stdout:7/90: symlink d1/l1a 0 2024-09-18T21:12:42.189 INFO:tasks.workunit.client.0.smithi077.stdout:0/183: fsync d8/d1d/f22 0 2024-09-18T21:12:42.190 INFO:tasks.workunit.client.0.smithi077.stdout:5/142: dwrite d0/df/d10/f26 [0,4194304] 0 2024-09-18T21:12:42.191 INFO:tasks.workunit.client.0.smithi077.stdout:0/184: write d8/d26/f32 [932670,3614] 0 2024-09-18T21:12:42.194 INFO:tasks.workunit.client.0.smithi077.stdout:0/185: truncate d8/d1a/d35/f3e 953360 0 2024-09-18T21:12:42.198 INFO:tasks.workunit.client.1.smithi103.stdout:2/74: mknod d3/c1a 0 2024-09-18T21:12:42.201 INFO:tasks.workunit.client.1.smithi103.stdout:6/141: write d2/d3/d8/f10 [1606901,28738] 0 2024-09-18T21:12:42.201 INFO:tasks.workunit.client.1.smithi103.stdout:9/68: creat f13 x:0 0 0 2024-09-18T21:12:42.201 INFO:tasks.workunit.client.1.smithi103.stdout:3/67: creat d1/da/f15 x:0 0 0 2024-09-18T21:12:42.204 INFO:tasks.workunit.client.0.smithi077.stdout:9/95: dwrite d1/df/f18 [0,4194304] 0 2024-09-18T21:12:42.204 INFO:tasks.workunit.client.0.smithi077.stdout:5/143: creat d0/d6/dd/f3a x:0 0 0 2024-09-18T21:12:42.208 INFO:tasks.workunit.client.1.smithi103.stdout:2/75: dread d3/d5/f6 [0,4194304] 0 2024-09-18T21:12:42.208 INFO:tasks.workunit.client.0.smithi077.stdout:0/186: rename d8/f1c to d8/d37/f3f 0 2024-09-18T21:12:42.210 INFO:tasks.workunit.client.0.smithi077.stdout:5/144: dread d0/f2 [0,4194304] 0 2024-09-18T21:12:42.211 INFO:tasks.workunit.client.0.smithi077.stdout:7/153: link d12/d31/d33/l35 d12/d31/d33/l42 0 2024-09-18T21:12:42.212 INFO:tasks.workunit.client.0.smithi077.stdout:7/154: read - d12/d22/d2d/f38 zero size 2024-09-18T21:12:42.212 INFO:tasks.workunit.client.0.smithi077.stdout:7/155: stat d12/c1e 0 2024-09-18T21:12:42.213 INFO:tasks.workunit.client.1.smithi103.stdout:9/69: dwrite f12 [0,4194304] 0 2024-09-18T21:12:42.214 INFO:tasks.workunit.client.0.smithi077.stdout:6/181: write d7/f2d [636670,46025] 0 2024-09-18T21:12:42.214 INFO:tasks.workunit.client.1.smithi103.stdout:6/142: dwrite d2/f28 [0,4194304] 0 2024-09-18T21:12:42.215 INFO:tasks.workunit.client.0.smithi077.stdout:6/182: chown d7/df/f14 38359942 1 2024-09-18T21:12:42.218 INFO:tasks.workunit.client.1.smithi103.stdout:3/68: dread d1/fc [0,4194304] 0 2024-09-18T21:12:42.219 INFO:tasks.workunit.client.0.smithi077.stdout:9/96: rename d1/dd/f17 to d1/df/f1e 0 2024-09-18T21:12:42.221 INFO:tasks.workunit.client.1.smithi103.stdout:9/70: write f8 [562874,74485] 0 2024-09-18T21:12:42.222 INFO:tasks.workunit.client.1.smithi103.stdout:9/71: write fa [3141733,107588] 0 2024-09-18T21:12:42.224 INFO:tasks.workunit.client.0.smithi077.stdout:7/156: readlink d12/l18 0 2024-09-18T21:12:42.228 INFO:tasks.workunit.client.0.smithi077.stdout:6/183: symlink d7/df/d11/d1d/l41 0 2024-09-18T21:12:42.229 INFO:tasks.workunit.client.1.smithi103.stdout:3/69: fdatasync d1/fc 0 2024-09-18T21:12:42.229 INFO:tasks.workunit.client.1.smithi103.stdout:9/72: fdatasync f8 0 2024-09-18T21:12:42.229 INFO:tasks.workunit.client.0.smithi077.stdout:6/184: fsync d7/df/d11/d25/f2b 0 2024-09-18T21:12:42.230 INFO:tasks.workunit.client.1.smithi103.stdout:3/70: chown d1/l11 12882 1 2024-09-18T21:12:42.232 INFO:tasks.workunit.client.0.smithi077.stdout:9/97: chown d1/f3 166 1 2024-09-18T21:12:42.234 INFO:tasks.workunit.client.0.smithi077.stdout:0/187: rename d8/f36 to d8/d1a/d39/d3b/f40 0 2024-09-18T21:12:42.236 INFO:tasks.workunit.client.0.smithi077.stdout:5/145: mkdir d0/d6/d3b 0 2024-09-18T21:12:42.236 INFO:tasks.workunit.client.0.smithi077.stdout:5/146: write d0/df/f22 [380059,78351] 0 2024-09-18T21:12:42.237 INFO:tasks.workunit.client.1.smithi103.stdout:9/73: symlink l14 0 2024-09-18T21:12:42.240 INFO:tasks.workunit.client.1.smithi103.stdout:7/91: dwrite d1/fe [4194304,4194304] 0 2024-09-18T21:12:42.240 INFO:tasks.workunit.client.1.smithi103.stdout:6/143: write d2/f12 [2473351,74479] 0 2024-09-18T21:12:42.241 INFO:tasks.workunit.client.1.smithi103.stdout:2/76: getdents d3 0 2024-09-18T21:12:42.243 INFO:tasks.workunit.client.0.smithi077.stdout:6/185: rename d7/df/d11/d1d/d3c to d7/df/d11/d3e/d42 0 2024-09-18T21:12:42.244 INFO:tasks.workunit.client.1.smithi103.stdout:7/92: readlink d1/l1a 0 2024-09-18T21:12:42.246 INFO:tasks.workunit.client.1.smithi103.stdout:3/71: dwrite d1/da/f15 [0,4194304] 0 2024-09-18T21:12:42.249 INFO:tasks.workunit.client.1.smithi103.stdout:7/93: read d1/f12 [333092,69558] 0 2024-09-18T21:12:42.249 INFO:tasks.workunit.client.1.smithi103.stdout:1/65: sync 2024-09-18T21:12:42.249 INFO:tasks.workunit.client.1.smithi103.stdout:8/72: sync 2024-09-18T21:12:42.249 INFO:tasks.workunit.client.1.smithi103.stdout:0/124: sync 2024-09-18T21:12:42.250 INFO:tasks.workunit.client.1.smithi103.stdout:3/72: write d1/d2/fb [1037500,118674] 0 2024-09-18T21:12:42.251 INFO:tasks.workunit.client.1.smithi103.stdout:9/74: link fa f15 0 2024-09-18T21:12:42.251 INFO:tasks.workunit.client.1.smithi103.stdout:9/75: rmdir - no directory 2024-09-18T21:12:42.252 INFO:tasks.workunit.client.0.smithi077.stdout:0/188: rename d8/d1d/c21 to d8/d1a/c41 0 2024-09-18T21:12:42.257 INFO:tasks.workunit.client.0.smithi077.stdout:9/98: link d1/fb d1/dd/f1f 0 2024-09-18T21:12:42.258 INFO:tasks.workunit.client.1.smithi103.stdout:3/73: write d1/f13 [84793,82840] 0 2024-09-18T21:12:42.259 INFO:tasks.workunit.client.1.smithi103.stdout:1/66: creat d0/d3/f1a x:0 0 0 2024-09-18T21:12:42.261 INFO:tasks.workunit.client.1.smithi103.stdout:2/77: dwrite d3/f8 [0,4194304] 0 2024-09-18T21:12:42.261 INFO:tasks.workunit.client.0.smithi077.stdout:7/157: getdents d12/d22 0 2024-09-18T21:12:42.262 INFO:tasks.workunit.client.0.smithi077.stdout:7/158: stat d12/d22/d2d 0 2024-09-18T21:12:42.263 INFO:tasks.workunit.client.0.smithi077.stdout:0/189: dwrite d8/d1a/f25 [0,4194304] 0 2024-09-18T21:12:42.263 INFO:tasks.workunit.client.1.smithi103.stdout:6/144: rename d2/d3/d4/f15 to d2/d3/d4/f2b 0 2024-09-18T21:12:42.266 INFO:tasks.workunit.client.0.smithi077.stdout:5/147: truncate d0/f18 1950540 0 2024-09-18T21:12:42.267 INFO:tasks.workunit.client.1.smithi103.stdout:6/145: read d2/d3/d8/f20 [1486495,126446] 0 2024-09-18T21:12:42.267 INFO:tasks.workunit.client.1.smithi103.stdout:6/146: fsync d2/f28 0 2024-09-18T21:12:42.268 INFO:tasks.workunit.client.0.smithi077.stdout:9/99: dwrite d1/df/f18 [0,4194304] 0 2024-09-18T21:12:42.270 INFO:tasks.workunit.client.0.smithi077.stdout:5/148: read d0/d6/dd/f24 [33312,72352] 0 2024-09-18T21:12:42.270 INFO:tasks.workunit.client.0.smithi077.stdout:6/186: rename d7/cd to d7/df/c43 0 2024-09-18T21:12:42.270 INFO:tasks.workunit.client.1.smithi103.stdout:0/125: creat d1/d9/f2b x:0 0 0 2024-09-18T21:12:42.271 INFO:tasks.workunit.client.1.smithi103.stdout:8/73: symlink d4/d6/l1f 0 2024-09-18T21:12:42.272 INFO:tasks.workunit.client.0.smithi077.stdout:7/159: creat d12/d22/d2d/f43 x:0 0 0 2024-09-18T21:12:42.272 INFO:tasks.workunit.client.0.smithi077.stdout:9/100: chown d1/df/f12 12818892 1 2024-09-18T21:12:42.274 INFO:tasks.workunit.client.0.smithi077.stdout:6/187: rmdir d7/df/d11/d25 39 2024-09-18T21:12:42.275 INFO:tasks.workunit.client.0.smithi077.stdout:9/101: stat d1/f3 0 2024-09-18T21:12:42.275 INFO:tasks.workunit.client.0.smithi077.stdout:7/160: write d12/f26 [613704,91357] 0 2024-09-18T21:12:42.277 INFO:tasks.workunit.client.0.smithi077.stdout:9/102: stat d1/dd/d1a 0 2024-09-18T21:12:42.279 INFO:tasks.workunit.client.0.smithi077.stdout:7/161: rmdir d12/d31 39 2024-09-18T21:12:42.282 INFO:tasks.workunit.client.1.smithi103.stdout:8/74: dwrite d4/d6/f1a [0,4194304] 0 2024-09-18T21:12:42.284 INFO:tasks.workunit.client.1.smithi103.stdout:9/76: write f15 [2226567,47852] 0 2024-09-18T21:12:42.285 INFO:tasks.workunit.client.1.smithi103.stdout:1/67: getdents d0/d11/d16/d19 0 2024-09-18T21:12:42.285 INFO:tasks.workunit.client.1.smithi103.stdout:9/77: fdatasync f8 0 2024-09-18T21:12:42.287 INFO:tasks.workunit.client.0.smithi077.stdout:7/162: mknod d12/d22/d39/c44 0 2024-09-18T21:12:42.287 INFO:tasks.workunit.client.1.smithi103.stdout:3/74: truncate d1/fc 1110828 0 2024-09-18T21:12:42.289 INFO:tasks.workunit.client.1.smithi103.stdout:3/75: readlink d1/da/le 0 2024-09-18T21:12:42.290 INFO:tasks.workunit.client.0.smithi077.stdout:0/190: dread d8/d1a/f20 [0,4194304] 0 2024-09-18T21:12:42.295 INFO:tasks.workunit.client.1.smithi103.stdout:8/75: dwrite d4/de/f1c [0,4194304] 0 2024-09-18T21:12:42.297 INFO:tasks.workunit.client.1.smithi103.stdout:1/68: symlink d0/d3/l1b 0 2024-09-18T21:12:42.298 INFO:tasks.workunit.client.1.smithi103.stdout:9/78: symlink l16 0 2024-09-18T21:12:42.299 INFO:tasks.workunit.client.0.smithi077.stdout:5/149: truncate d0/d6/dd/f1e 1186059 0 2024-09-18T21:12:42.299 INFO:tasks.workunit.client.1.smithi103.stdout:5/62: sync 2024-09-18T21:12:42.299 INFO:tasks.workunit.client.1.smithi103.stdout:4/71: sync 2024-09-18T21:12:42.301 INFO:tasks.workunit.client.1.smithi103.stdout:2/78: link d3/f9 d3/f1b 0 2024-09-18T21:12:42.301 INFO:tasks.workunit.client.1.smithi103.stdout:5/63: read - de/d11/f12 zero size 2024-09-18T21:12:42.301 INFO:tasks.workunit.client.0.smithi077.stdout:0/191: dread d8/d1a/d39/d3b/f40 [0,4194304] 0 2024-09-18T21:12:42.303 INFO:tasks.workunit.client.0.smithi077.stdout:6/188: getdents d7/df/d11/d3e 0 2024-09-18T21:12:42.304 INFO:tasks.workunit.client.1.smithi103.stdout:2/79: write d3/ff [227363,44986] 0 2024-09-18T21:12:42.304 INFO:tasks.workunit.client.1.smithi103.stdout:3/76: stat d1/c6 0 2024-09-18T21:12:42.306 INFO:tasks.workunit.client.1.smithi103.stdout:0/126: dwrite d1/d5/de/d19/d1e/f21 [0,4194304] 0 2024-09-18T21:12:42.306 INFO:tasks.workunit.client.0.smithi077.stdout:9/103: rename d1/cc to d1/c20 0 2024-09-18T21:12:42.308 INFO:tasks.workunit.client.1.smithi103.stdout:0/127: fsync d1/d9/d13/f1b 0 2024-09-18T21:12:42.308 INFO:tasks.workunit.client.0.smithi077.stdout:7/163: rename d12/d22/d2d/f43 to d12/f45 0 2024-09-18T21:12:42.310 INFO:tasks.workunit.client.1.smithi103.stdout:6/147: link d2/d3/d8/df/c1d d2/d3/d8/df/c2c 0 2024-09-18T21:12:42.313 INFO:tasks.workunit.client.0.smithi077.stdout:5/150: unlink d0/df/d10/f1b 0 2024-09-18T21:12:42.314 INFO:tasks.workunit.client.1.smithi103.stdout:7/94: getdents d1/df 0 2024-09-18T21:12:42.315 INFO:tasks.workunit.client.0.smithi077.stdout:0/192: fsync d8/fb 0 2024-09-18T21:12:42.320 INFO:tasks.workunit.client.1.smithi103.stdout:1/69: symlink d0/d11/d16/l1c 0 2024-09-18T21:12:42.321 INFO:tasks.workunit.client.1.smithi103.stdout:1/70: write d0/d2/fb [2538705,96489] 0 2024-09-18T21:12:42.322 INFO:tasks.workunit.client.0.smithi077.stdout:6/189: rename d7/df/d11/d1d/f34 to d7/df/d11/d1d/f44 0 2024-09-18T21:12:42.323 INFO:tasks.workunit.client.0.smithi077.stdout:9/104: chown d1/c8 4849 1 2024-09-18T21:12:42.324 INFO:tasks.workunit.client.1.smithi103.stdout:4/72: mkdir d9/d1a 0 2024-09-18T21:12:42.325 INFO:tasks.workunit.client.0.smithi077.stdout:6/190: truncate d7/df/d11/d1d/d31/f3f 389469 0 2024-09-18T21:12:42.327 INFO:tasks.workunit.client.0.smithi077.stdout:7/164: rename d12/l3c to d12/d22/l46 0 2024-09-18T21:12:42.328 INFO:tasks.workunit.client.1.smithi103.stdout:5/64: creat de/f16 x:0 0 0 2024-09-18T21:12:42.329 INFO:tasks.workunit.client.1.smithi103.stdout:2/80: fdatasync d3/d5/f6 0 2024-09-18T21:12:42.331 INFO:tasks.workunit.client.1.smithi103.stdout:0/128: mknod d1/d9/d13/c2c 0 2024-09-18T21:12:42.331 INFO:tasks.workunit.client.0.smithi077.stdout:9/105: creat d1/df/f21 x:0 0 0 2024-09-18T21:12:42.334 INFO:tasks.workunit.client.1.smithi103.stdout:7/95: creat d1/f1b x:0 0 0 2024-09-18T21:12:42.338 INFO:tasks.workunit.client.0.smithi077.stdout:0/193: rename d8/d1d/f22 to d8/d1a/f42 0 2024-09-18T21:12:42.342 INFO:tasks.workunit.client.0.smithi077.stdout:7/165: dwrite d12/d31/d33/d2a/f3d [0,4194304] 0 2024-09-18T21:12:42.343 INFO:tasks.workunit.client.0.smithi077.stdout:7/166: dread - d12/d31/d33/f36 zero size 2024-09-18T21:12:42.344 INFO:tasks.workunit.client.0.smithi077.stdout:7/167: write d12/f1f [5436644,5911] 0 2024-09-18T21:12:42.344 INFO:tasks.workunit.client.1.smithi103.stdout:5/65: creat de/d11/f17 x:0 0 0 2024-09-18T21:12:42.345 INFO:tasks.workunit.client.0.smithi077.stdout:5/151: creat d0/d6/f3c x:0 0 0 2024-09-18T21:12:42.346 INFO:tasks.workunit.client.0.smithi077.stdout:5/152: write d0/f37 [860892,93555] 0 2024-09-18T21:12:42.346 INFO:tasks.workunit.client.0.smithi077.stdout:6/191: creat d7/df/d11/f45 x:0 0 0 2024-09-18T21:12:42.347 INFO:tasks.workunit.client.0.smithi077.stdout:6/192: readlink d7/df/d11/d1d/l21 0 2024-09-18T21:12:42.347 INFO:tasks.workunit.client.0.smithi077.stdout:6/193: write d7/fc [1530640,26832] 0 2024-09-18T21:12:42.348 INFO:tasks.workunit.client.1.smithi103.stdout:3/77: dwrite d1/d2/f8 [0,4194304] 0 2024-09-18T21:12:42.349 INFO:tasks.workunit.client.0.smithi077.stdout:6/194: write d7/fc [2760582,7303] 0 2024-09-18T21:12:42.351 INFO:tasks.workunit.client.0.smithi077.stdout:7/168: mknod d12/d31/c47 0 2024-09-18T21:12:42.351 INFO:tasks.workunit.client.1.smithi103.stdout:4/73: dwrite d9/f19 [0,4194304] 0 2024-09-18T21:12:42.352 INFO:tasks.workunit.client.1.smithi103.stdout:0/129: unlink d1/d5/l7 0 2024-09-18T21:12:42.353 INFO:tasks.workunit.client.0.smithi077.stdout:5/153: mkdir d0/df/d3d 0 2024-09-18T21:12:42.353 INFO:tasks.workunit.client.0.smithi077.stdout:5/154: dread - d0/df/f2b zero size 2024-09-18T21:12:42.354 INFO:tasks.workunit.client.1.smithi103.stdout:4/74: chown d9/f14 166 1 2024-09-18T21:12:42.357 INFO:tasks.workunit.client.0.smithi077.stdout:6/195: unlink d7/df/d11/d25/c27 0 2024-09-18T21:12:42.358 INFO:tasks.workunit.client.1.smithi103.stdout:3/78: write d1/da/df/f14 [3014029,80749] 0 2024-09-18T21:12:42.359 INFO:tasks.workunit.client.0.smithi077.stdout:6/196: fsync d7/df/f28 0 2024-09-18T21:12:42.360 INFO:tasks.workunit.client.1.smithi103.stdout:8/76: getdents d4/d6 0 2024-09-18T21:12:42.361 INFO:tasks.workunit.client.1.smithi103.stdout:7/96: getdents d1/df 0 2024-09-18T21:12:42.363 INFO:tasks.workunit.client.1.smithi103.stdout:9/79: getdents . 0 2024-09-18T21:12:42.364 INFO:tasks.workunit.client.0.smithi077.stdout:6/197: dread d7/df/d11/d1d/d31/f3f [0,4194304] 0 2024-09-18T21:12:42.365 INFO:tasks.workunit.client.0.smithi077.stdout:5/155: dwrite d0/d6/dd/f35 [0,4194304] 0 2024-09-18T21:12:42.366 INFO:tasks.workunit.client.1.smithi103.stdout:5/66: dwrite de/f16 [0,4194304] 0 2024-09-18T21:12:42.367 INFO:tasks.workunit.client.1.smithi103.stdout:1/71: getdents d0/d11 0 2024-09-18T21:12:42.369 INFO:tasks.workunit.client.1.smithi103.stdout:8/77: dread d4/ff [0,4194304] 0 2024-09-18T21:12:42.370 INFO:tasks.workunit.client.1.smithi103.stdout:2/81: dread d3/f9 [0,4194304] 0 2024-09-18T21:12:42.370 INFO:tasks.workunit.client.1.smithi103.stdout:1/72: chown d0/f7 324820 1 2024-09-18T21:12:42.373 INFO:tasks.workunit.client.1.smithi103.stdout:9/80: creat f17 x:0 0 0 2024-09-18T21:12:42.374 INFO:tasks.workunit.client.1.smithi103.stdout:9/81: dread - f17 zero size 2024-09-18T21:12:42.374 INFO:tasks.workunit.client.0.smithi077.stdout:6/198: mknod d7/df/d11/d1d/c46 0 2024-09-18T21:12:42.375 INFO:tasks.workunit.client.0.smithi077.stdout:0/194: write d8/f30 [2427722,34972] 0 2024-09-18T21:12:42.375 INFO:tasks.workunit.client.1.smithi103.stdout:3/79: dwrite d1/d2/fb [0,4194304] 0 2024-09-18T21:12:42.375 INFO:tasks.workunit.client.1.smithi103.stdout:9/82: stat f5 0 2024-09-18T21:12:42.377 INFO:tasks.workunit.client.1.smithi103.stdout:9/83: dread - ff zero size 2024-09-18T21:12:42.379 INFO:tasks.workunit.client.1.smithi103.stdout:7/97: creat d1/f1c x:0 0 0 2024-09-18T21:12:42.380 INFO:tasks.workunit.client.0.smithi077.stdout:5/156: dwrite d0/d6/fb [0,4194304] 0 2024-09-18T21:12:42.381 INFO:tasks.workunit.client.0.smithi077.stdout:6/199: creat d7/df/d11/d25/f47 x:0 0 0 2024-09-18T21:12:42.381 INFO:tasks.workunit.client.0.smithi077.stdout:7/169: dwrite d12/d31/d33/d2a/f3d [4194304,4194304] 0 2024-09-18T21:12:42.381 INFO:tasks.workunit.client.0.smithi077.stdout:7/170: stat fb 0 2024-09-18T21:12:42.386 INFO:tasks.workunit.client.1.smithi103.stdout:2/82: mknod d3/c1c 0 2024-09-18T21:12:42.389 INFO:tasks.workunit.client.1.smithi103.stdout:8/78: dread d4/d6/f8 [0,4194304] 0 2024-09-18T21:12:42.389 INFO:tasks.workunit.client.1.smithi103.stdout:9/84: write f15 [1586731,32134] 0 2024-09-18T21:12:42.390 INFO:tasks.workunit.client.1.smithi103.stdout:3/80: creat d1/da/f16 x:0 0 0 2024-09-18T21:12:42.391 INFO:tasks.workunit.client.0.smithi077.stdout:5/157: mknod d0/df/d3d/c3e 0 2024-09-18T21:12:42.392 INFO:tasks.workunit.client.0.smithi077.stdout:7/171: dread - d12/d22/d2d/f38 zero size 2024-09-18T21:12:42.392 INFO:tasks.workunit.client.1.smithi103.stdout:5/67: creat de/d14/f18 x:0 0 0 2024-09-18T21:12:42.393 INFO:tasks.workunit.client.0.smithi077.stdout:0/195: link d8/d1a/c1f d8/d1a/c43 0 2024-09-18T21:12:42.393 INFO:tasks.workunit.client.1.smithi103.stdout:6/148: dwrite d2/d3/d8/f29 [0,4194304] 0 2024-09-18T21:12:42.393 INFO:tasks.workunit.client.1.smithi103.stdout:7/98: mkdir d1/df/d1d 0 2024-09-18T21:12:42.393 INFO:tasks.workunit.client.0.smithi077.stdout:7/172: dread - d12/d22/d2d/f38 zero size 2024-09-18T21:12:42.394 INFO:tasks.workunit.client.1.smithi103.stdout:1/73: dwrite d0/d3/f1a [0,4194304] 0 2024-09-18T21:12:42.394 INFO:tasks.workunit.client.0.smithi077.stdout:5/158: unlink d0/df/d10/f8 0 2024-09-18T21:12:42.396 INFO:tasks.workunit.client.1.smithi103.stdout:0/130: getdents d1/d5/de 0 2024-09-18T21:12:42.396 INFO:tasks.workunit.client.0.smithi077.stdout:0/196: unlink c7 0 2024-09-18T21:12:42.397 INFO:tasks.workunit.client.0.smithi077.stdout:0/197: chown d8/d26/c24 0 1 2024-09-18T21:12:42.399 INFO:tasks.workunit.client.1.smithi103.stdout:1/74: chown d0/d3/f1a 976353 1 2024-09-18T21:12:42.400 INFO:tasks.workunit.client.1.smithi103.stdout:2/83: creat d3/f1d x:0 0 0 2024-09-18T21:12:42.400 INFO:tasks.workunit.client.0.smithi077.stdout:7/173: creat d12/d31/f48 x:0 0 0 2024-09-18T21:12:42.401 INFO:tasks.workunit.client.1.smithi103.stdout:0/131: stat d1/f29 0 2024-09-18T21:12:42.402 INFO:tasks.workunit.client.1.smithi103.stdout:9/85: mkdir d18 0 2024-09-18T21:12:42.403 INFO:tasks.workunit.client.0.smithi077.stdout:0/198: unlink d8/f16 0 2024-09-18T21:12:42.406 INFO:tasks.workunit.client.1.smithi103.stdout:6/149: fsync d2/d3/d8/f20 0 2024-09-18T21:12:42.408 INFO:tasks.workunit.client.0.smithi077.stdout:7/174: mkdir d12/d31/d49 0 2024-09-18T21:12:42.408 INFO:tasks.workunit.client.1.smithi103.stdout:0/132: chown d1/d9/d13/f1b 55168 1 2024-09-18T21:12:42.408 INFO:tasks.workunit.client.1.smithi103.stdout:1/75: mknod d0/c1d 0 2024-09-18T21:12:42.408 INFO:tasks.workunit.client.1.smithi103.stdout:6/150: chown d2/f12 25 1 2024-09-18T21:12:42.409 INFO:tasks.workunit.client.1.smithi103.stdout:8/79: dwrite d4/de/f1c [0,4194304] 0 2024-09-18T21:12:42.410 INFO:tasks.workunit.client.1.smithi103.stdout:3/81: dwrite d1/da/df/f14 [0,4194304] 0 2024-09-18T21:12:42.411 INFO:tasks.workunit.client.1.smithi103.stdout:8/80: chown d4/d6/f1a 137514 1 2024-09-18T21:12:42.413 INFO:tasks.workunit.client.1.smithi103.stdout:3/82: write d1/da/df/f14 [785926,77536] 0 2024-09-18T21:12:42.414 INFO:tasks.workunit.client.1.smithi103.stdout:5/68: fsync de/f16 0 2024-09-18T21:12:42.414 INFO:tasks.workunit.client.1.smithi103.stdout:3/83: fdatasync d1/d2/f8 0 2024-09-18T21:12:42.415 INFO:tasks.workunit.client.1.smithi103.stdout:5/69: fdatasync f1 0 2024-09-18T21:12:42.415 INFO:tasks.workunit.client.1.smithi103.stdout:5/70: stat f1 0 2024-09-18T21:12:42.468 INFO:tasks.workunit.client.0.smithi077.stdout:0/199: rename d8/d1a/d39/d3b/f40 to d8/d1a/d39/d3b/f44 0 2024-09-18T21:12:42.468 INFO:tasks.workunit.client.0.smithi077.stdout:4/113: sync 2024-09-18T21:12:42.469 INFO:tasks.workunit.client.1.smithi103.stdout:7/99: rename d1/df/f19 to d1/df/d1d/f1e 0 2024-09-18T21:12:42.470 INFO:tasks.workunit.client.1.smithi103.stdout:2/84: creat d3/f1e x:0 0 0 2024-09-18T21:12:42.471 INFO:tasks.workunit.client.0.smithi077.stdout:7/175: fdatasync d12/d22/f28 0 2024-09-18T21:12:42.474 INFO:tasks.workunit.client.1.smithi103.stdout:7/100: dwrite d1/fa [0,4194304] 0 2024-09-18T21:12:42.475 INFO:tasks.workunit.client.0.smithi077.stdout:0/200: dwrite d8/d1a/d39/f3c [0,4194304] 0 2024-09-18T21:12:42.475 INFO:tasks.workunit.client.0.smithi077.stdout:4/114: dwrite d3/f5 [0,4194304] 0 2024-09-18T21:12:42.478 INFO:tasks.workunit.client.1.smithi103.stdout:7/101: dread d1/fa [0,4194304] 0 2024-09-18T21:12:42.491 INFO:tasks.workunit.client.0.smithi077.stdout:5/159: rename d0/df/c16 to d0/d6/c3f 0 2024-09-18T21:12:42.494 INFO:tasks.workunit.client.1.smithi103.stdout:8/81: write d4/d6/f8 [4616895,9835] 0 2024-09-18T21:12:42.494 INFO:tasks.workunit.client.0.smithi077.stdout:7/176: creat d12/d31/f4a x:0 0 0 2024-09-18T21:12:42.496 INFO:tasks.workunit.client.0.smithi077.stdout:0/201: write d8/d1a/f20 [4919529,53331] 0 2024-09-18T21:12:42.498 INFO:tasks.workunit.client.0.smithi077.stdout:0/202: read d8/d26/f32 [869360,16002] 0 2024-09-18T21:12:42.499 INFO:tasks.workunit.client.0.smithi077.stdout:4/115: unlink d3/d7/f13 0 2024-09-18T21:12:42.502 INFO:tasks.workunit.client.1.smithi103.stdout:4/75: sync 2024-09-18T21:12:42.502 INFO:tasks.workunit.client.1.smithi103.stdout:4/76: readlink d9/l17 0 2024-09-18T21:12:42.507 INFO:tasks.workunit.client.0.smithi077.stdout:4/116: dwrite d3/fa [0,4194304] 0 2024-09-18T21:12:42.507 INFO:tasks.workunit.client.0.smithi077.stdout:5/160: mkdir d0/d6/d40 0 2024-09-18T21:12:42.509 INFO:tasks.workunit.client.1.smithi103.stdout:6/151: dread d2/d3/d4/f2b [0,4194304] 0 2024-09-18T21:12:42.510 INFO:tasks.workunit.client.1.smithi103.stdout:6/152: write d2/f22 [4201936,77030] 0 2024-09-18T21:12:42.510 INFO:tasks.workunit.client.1.smithi103.stdout:5/71: rename f1 to de/d11/f19 0 2024-09-18T21:12:42.510 INFO:tasks.workunit.client.0.smithi077.stdout:7/177: dwrite d12/d31/f41 [0,4194304] 0 2024-09-18T21:12:42.511 INFO:tasks.workunit.client.1.smithi103.stdout:5/72: chown de/ff 166191 1 2024-09-18T21:12:42.513 INFO:tasks.workunit.client.0.smithi077.stdout:7/178: write d12/d31/d33/d2a/f3d [2058424,2609] 0 2024-09-18T21:12:42.516 INFO:tasks.workunit.client.0.smithi077.stdout:7/179: readlink d12/l20 0 2024-09-18T21:12:42.518 INFO:tasks.workunit.client.0.smithi077.stdout:7/180: write d12/d31/f41 [2704576,44773] 0 2024-09-18T21:12:42.520 INFO:tasks.workunit.client.1.smithi103.stdout:2/85: symlink d3/l1f 0 2024-09-18T21:12:42.522 INFO:tasks.workunit.client.1.smithi103.stdout:9/86: symlink d18/l19 0 2024-09-18T21:12:42.525 INFO:tasks.workunit.client.1.smithi103.stdout:7/102: mkdir d1/df/d1d/d1f 0 2024-09-18T21:12:42.526 INFO:tasks.workunit.client.0.smithi077.stdout:4/117: mkdir d3/dc/d24 0 2024-09-18T21:12:42.527 INFO:tasks.workunit.client.0.smithi077.stdout:4/118: write d3/fa [2379927,9818] 0 2024-09-18T21:12:42.528 INFO:tasks.workunit.client.0.smithi077.stdout:4/119: stat d3 0 2024-09-18T21:12:42.529 INFO:tasks.workunit.client.0.smithi077.stdout:4/120: chown d3/dc/f16 30192092 1 2024-09-18T21:12:42.532 INFO:tasks.workunit.client.1.smithi103.stdout:1/76: mknod d0/d11/d16/d19/c1e 0 2024-09-18T21:12:42.532 INFO:tasks.workunit.client.1.smithi103.stdout:1/77: readlink d0/le 0 2024-09-18T21:12:42.533 INFO:tasks.workunit.client.1.smithi103.stdout:1/78: write d0/d2/d9/dc/f15 [870466,69624] 0 2024-09-18T21:12:42.533 INFO:tasks.workunit.client.1.smithi103.stdout:8/82: mknod d4/de/c20 0 2024-09-18T21:12:42.534 INFO:tasks.workunit.client.0.smithi077.stdout:7/181: symlink d12/d22/d2d/l4b 0 2024-09-18T21:12:42.535 INFO:tasks.workunit.client.0.smithi077.stdout:7/182: dread - d12/d31/f48 zero size 2024-09-18T21:12:42.536 INFO:tasks.workunit.client.0.smithi077.stdout:0/203: truncate f3 333173 0 2024-09-18T21:12:42.537 INFO:tasks.workunit.client.0.smithi077.stdout:0/204: read - d8/f2f zero size 2024-09-18T21:12:42.538 INFO:tasks.workunit.client.0.smithi077.stdout:5/161: symlink d0/d36/l41 0 2024-09-18T21:12:42.540 INFO:tasks.workunit.client.0.smithi077.stdout:4/121: creat d3/dc/f25 x:0 0 0 2024-09-18T21:12:42.541 INFO:tasks.workunit.client.0.smithi077.stdout:4/122: write d3/dc/f25 [637928,4774] 0 2024-09-18T21:12:42.541 INFO:tasks.workunit.client.1.smithi103.stdout:6/153: creat d2/d3/d8/f2d x:0 0 0 2024-09-18T21:12:42.543 INFO:tasks.workunit.client.0.smithi077.stdout:7/183: truncate d12/d22/d39/f3b 385349 0 2024-09-18T21:12:42.543 INFO:tasks.workunit.client.1.smithi103.stdout:5/73: mkdir de/d14/d1a 0 2024-09-18T21:12:42.544 INFO:tasks.workunit.client.1.smithi103.stdout:5/74: write de/f16 [3269046,62542] 0 2024-09-18T21:12:42.544 INFO:tasks.workunit.client.0.smithi077.stdout:0/205: mknod d8/d26/c45 0 2024-09-18T21:12:42.544 INFO:tasks.workunit.client.0.smithi077.stdout:7/184: truncate d12/d22/d39/f3b 1180755 0 2024-09-18T21:12:42.545 INFO:tasks.workunit.client.0.smithi077.stdout:0/206: chown d8/d37/f3f 345864195 1 2024-09-18T21:12:42.549 INFO:tasks.workunit.client.1.smithi103.stdout:9/87: unlink f10 0 2024-09-18T21:12:42.550 INFO:tasks.workunit.client.0.smithi077.stdout:7/185: dwrite d12/f24 [4194304,4194304] 0 2024-09-18T21:12:42.552 INFO:tasks.workunit.client.0.smithi077.stdout:7/186: fdatasync d12/d22/d39/f3b 0 2024-09-18T21:12:42.553 INFO:tasks.workunit.client.0.smithi077.stdout:0/207: symlink d8/d1a/d39/l46 0 2024-09-18T21:12:42.554 INFO:tasks.workunit.client.0.smithi077.stdout:7/187: write d12/f1f [3203511,78091] 0 2024-09-18T21:12:42.554 INFO:tasks.workunit.client.0.smithi077.stdout:5/162: fsync d0/d6/dd/f11 0 2024-09-18T21:12:42.556 INFO:tasks.workunit.client.1.smithi103.stdout:0/133: rmdir d1/d5/d26 0 2024-09-18T21:12:42.557 INFO:tasks.workunit.client.0.smithi077.stdout:7/188: dread f5 [0,4194304] 0 2024-09-18T21:12:42.558 INFO:tasks.workunit.client.0.smithi077.stdout:7/189: dread - d12/d31/f4a zero size 2024-09-18T21:12:42.558 INFO:tasks.workunit.client.1.smithi103.stdout:8/83: mknod d4/d6/c21 0 2024-09-18T21:12:42.560 INFO:tasks.workunit.client.1.smithi103.stdout:1/79: symlink d0/d11/d16/d19/l1f 0 2024-09-18T21:12:42.561 INFO:tasks.workunit.client.1.smithi103.stdout:2/86: write d3/d5/f18 [2187856,6949] 0 2024-09-18T21:12:42.561 INFO:tasks.workunit.client.0.smithi077.stdout:0/208: read d8/f17 [1317589,32876] 0 2024-09-18T21:12:42.562 INFO:tasks.workunit.client.1.smithi103.stdout:3/84: link d1/da/le d1/da/l17 0 2024-09-18T21:12:42.563 INFO:tasks.workunit.client.0.smithi077.stdout:0/209: fdatasync d8/d26/f18 0 2024-09-18T21:12:42.563 INFO:tasks.workunit.client.0.smithi077.stdout:7/190: dread fb [0,4194304] 0 2024-09-18T21:12:42.565 INFO:tasks.workunit.client.1.smithi103.stdout:6/154: creat d2/d3/d4/f2e x:0 0 0 2024-09-18T21:12:42.565 INFO:tasks.workunit.client.1.smithi103.stdout:3/85: dread d1/da/f15 [0,4194304] 0 2024-09-18T21:12:42.566 INFO:tasks.workunit.client.0.smithi077.stdout:5/163: mknod d0/df/d10/c42 0 2024-09-18T21:12:42.567 INFO:tasks.workunit.client.1.smithi103.stdout:5/75: write de/ff [200017,67267] 0 2024-09-18T21:12:42.567 INFO:tasks.workunit.client.0.smithi077.stdout:7/191: fdatasync d12/f24 0 2024-09-18T21:12:42.568 INFO:tasks.workunit.client.1.smithi103.stdout:5/76: write de/ff [3897938,20708] 0 2024-09-18T21:12:42.569 INFO:tasks.workunit.client.0.smithi077.stdout:0/210: dwrite d8/fb [0,4194304] 0 2024-09-18T21:12:42.571 INFO:tasks.workunit.client.1.smithi103.stdout:9/88: rename f15 to d18/f1a 0 2024-09-18T21:12:42.571 INFO:tasks.workunit.client.0.smithi077.stdout:0/211: chown d8/d26/l1e 72313401 1 2024-09-18T21:12:42.573 INFO:tasks.workunit.client.1.smithi103.stdout:7/103: link d1/df/f14 d1/df/f20 0 2024-09-18T21:12:42.574 INFO:tasks.workunit.client.1.smithi103.stdout:9/89: dread f5 [4194304,4194304] 0 2024-09-18T21:12:42.575 INFO:tasks.workunit.client.0.smithi077.stdout:7/192: symlink d12/d31/l4c 0 2024-09-18T21:12:42.575 INFO:tasks.workunit.client.1.smithi103.stdout:9/90: write ff [656802,60228] 0 2024-09-18T21:12:42.576 INFO:tasks.workunit.client.1.smithi103.stdout:8/84: truncate d4/d6/fb 544192 0 2024-09-18T21:12:42.576 INFO:tasks.workunit.client.1.smithi103.stdout:9/91: write f4 [2260257,79603] 0 2024-09-18T21:12:42.578 INFO:tasks.workunit.client.1.smithi103.stdout:8/85: dread d4/d6/f1d [0,4194304] 0 2024-09-18T21:12:42.580 INFO:tasks.workunit.client.0.smithi077.stdout:7/193: fdatasync f1 0 2024-09-18T21:12:42.580 INFO:tasks.workunit.client.1.smithi103.stdout:8/86: dread d4/d6/f1d [0,4194304] 0 2024-09-18T21:12:42.581 INFO:tasks.workunit.client.0.smithi077.stdout:7/194: write d12/d22/d39/f3b [1905736,1109] 0 2024-09-18T21:12:42.582 INFO:tasks.workunit.client.1.smithi103.stdout:3/86: mkdir d1/d2/d18 0 2024-09-18T21:12:42.583 INFO:tasks.workunit.client.0.smithi077.stdout:5/164: getdents d0/df/d3d 0 2024-09-18T21:12:42.583 INFO:tasks.workunit.client.1.smithi103.stdout:3/87: write d1/da/df/f14 [3973138,111366] 0 2024-09-18T21:12:42.586 INFO:tasks.workunit.client.0.smithi077.stdout:7/195: mknod d12/d22/c4d 0 2024-09-18T21:12:42.587 INFO:tasks.workunit.client.0.smithi077.stdout:7/196: dread - d12/d22/d2d/f3a zero size 2024-09-18T21:12:42.589 INFO:tasks.workunit.client.1.smithi103.stdout:9/92: creat d18/f1b x:0 0 0 2024-09-18T21:12:42.589 INFO:tasks.workunit.client.0.smithi077.stdout:7/197: mknod d12/d31/c4e 0 2024-09-18T21:12:42.590 INFO:tasks.workunit.client.1.smithi103.stdout:9/93: dread - f17 zero size 2024-09-18T21:12:42.590 INFO:tasks.workunit.client.0.smithi077.stdout:5/165: getdents d0/d36 0 2024-09-18T21:12:42.591 INFO:tasks.workunit.client.1.smithi103.stdout:3/88: dwrite d1/da/df/f14 [4194304,4194304] 0 2024-09-18T21:12:42.591 INFO:tasks.workunit.client.1.smithi103.stdout:1/80: link d0/f7 d0/d3/f20 0 2024-09-18T21:12:42.593 INFO:tasks.workunit.client.1.smithi103.stdout:8/87: mknod d4/de/c22 0 2024-09-18T21:12:42.593 INFO:tasks.workunit.client.1.smithi103.stdout:3/89: dread d1/f13 [0,4194304] 0 2024-09-18T21:12:42.595 INFO:tasks.workunit.client.0.smithi077.stdout:7/198: creat d12/d31/d33/d2a/f4f x:0 0 0 2024-09-18T21:12:42.596 INFO:tasks.workunit.client.0.smithi077.stdout:7/199: chown d12/f45 14132 1 2024-09-18T21:12:42.600 INFO:tasks.workunit.client.0.smithi077.stdout:5/166: mkdir d0/d43 0 2024-09-18T21:12:42.602 INFO:tasks.workunit.client.0.smithi077.stdout:7/200: readlink d12/d31/d33/l35 0 2024-09-18T21:12:42.603 INFO:tasks.workunit.client.1.smithi103.stdout:5/77: symlink de/d14/d1a/l1b 0 2024-09-18T21:12:42.603 INFO:tasks.workunit.client.0.smithi077.stdout:0/212: truncate d8/f14 2901529 0 2024-09-18T21:12:42.604 INFO:tasks.workunit.client.0.smithi077.stdout:5/167: creat d0/df/d10/f44 x:0 0 0 2024-09-18T21:12:42.606 INFO:tasks.workunit.client.0.smithi077.stdout:7/201: dread d12/f26 [0,4194304] 0 2024-09-18T21:12:42.606 INFO:tasks.workunit.client.0.smithi077.stdout:7/202: chown d12/d31 112931 1 2024-09-18T21:12:42.607 INFO:tasks.workunit.client.0.smithi077.stdout:0/213: creat d8/d1a/d35/f47 x:0 0 0 2024-09-18T21:12:42.611 INFO:tasks.workunit.client.0.smithi077.stdout:7/203: rename d12/c1e to d12/d31/c50 0 2024-09-18T21:12:42.613 INFO:tasks.workunit.client.1.smithi103.stdout:7/104: dwrite d1/fa [4194304,4194304] 0 2024-09-18T21:12:42.614 INFO:tasks.workunit.client.1.smithi103.stdout:9/94: symlink d18/l1c 0 2024-09-18T21:12:42.615 INFO:tasks.workunit.client.1.smithi103.stdout:0/134: dwrite d1/fa [0,4194304] 0 2024-09-18T21:12:42.615 INFO:tasks.workunit.client.1.smithi103.stdout:9/95: readlink d18/l19 0 2024-09-18T21:12:42.615 INFO:tasks.workunit.client.0.smithi077.stdout:0/214: rename d8/d1a/f31 to d8/d37/f48 0 2024-09-18T21:12:42.616 INFO:tasks.workunit.client.1.smithi103.stdout:0/135: chown d1/d9/d13 686 1 2024-09-18T21:12:42.618 INFO:tasks.workunit.client.1.smithi103.stdout:1/81: stat d0/d11/l12 0 2024-09-18T21:12:42.621 INFO:tasks.workunit.client.1.smithi103.stdout:8/88: mknod d4/c23 0 2024-09-18T21:12:42.623 INFO:tasks.workunit.client.1.smithi103.stdout:6/155: link d2/d3/f19 d2/d3/f2f 0 2024-09-18T21:12:42.625 INFO:tasks.workunit.client.1.smithi103.stdout:8/89: dread d4/d6/f8 [0,4194304] 0 2024-09-18T21:12:42.625 INFO:tasks.workunit.client.0.smithi077.stdout:0/215: symlink d8/d1d/l49 0 2024-09-18T21:12:42.625 INFO:tasks.workunit.client.0.smithi077.stdout:0/216: dread - d8/f19 zero size 2024-09-18T21:12:42.626 INFO:tasks.workunit.client.1.smithi103.stdout:8/90: write d4/d6/f1a [2177215,48870] 0 2024-09-18T21:12:42.627 INFO:tasks.workunit.client.1.smithi103.stdout:5/78: creat de/f1c x:0 0 0 2024-09-18T21:12:42.627 INFO:tasks.workunit.client.0.smithi077.stdout:0/217: truncate d8/d26/f38 1029259 0 2024-09-18T21:12:42.628 INFO:tasks.workunit.client.0.smithi077.stdout:7/204: rename d12/d22/c37 to d12/d31/d49/c51 0 2024-09-18T21:12:42.630 INFO:tasks.workunit.client.1.smithi103.stdout:2/87: getdents d3 0 2024-09-18T21:12:42.630 INFO:tasks.workunit.client.1.smithi103.stdout:2/88: dread - d3/d5/f17 zero size 2024-09-18T21:12:42.632 INFO:tasks.workunit.client.0.smithi077.stdout:0/218: write d8/d37/f3f [400438,115140] 0 2024-09-18T21:12:42.633 INFO:tasks.workunit.client.1.smithi103.stdout:7/105: creat d1/f21 x:0 0 0 2024-09-18T21:12:42.633 INFO:tasks.workunit.client.0.smithi077.stdout:0/219: read d8/d1a/f20 [1255987,14039] 0 2024-09-18T21:12:42.633 INFO:tasks.workunit.client.1.smithi103.stdout:7/106: chown d1/df/d1d 754888004 1 2024-09-18T21:12:42.634 INFO:tasks.workunit.client.0.smithi077.stdout:7/205: symlink d12/d22/d39/l52 0 2024-09-18T21:12:42.635 INFO:tasks.workunit.client.1.smithi103.stdout:9/96: symlink d18/l1d 0 2024-09-18T21:12:42.636 INFO:tasks.workunit.client.0.smithi077.stdout:5/168: write d0/f2e [534865,79257] 0 2024-09-18T21:12:42.638 INFO:tasks.workunit.client.1.smithi103.stdout:0/136: chown d1/f4 2622216 1 2024-09-18T21:12:42.638 INFO:tasks.workunit.client.0.smithi077.stdout:0/220: dread d8/d1a/f25 [0,4194304] 0 2024-09-18T21:12:42.639 INFO:tasks.workunit.client.0.smithi077.stdout:0/221: write d8/d26/f28 [2196106,26005] 0 2024-09-18T21:12:42.642 INFO:tasks.workunit.client.0.smithi077.stdout:7/206: rmdir d12/d31/d33 39 2024-09-18T21:12:42.642 INFO:tasks.workunit.client.0.smithi077.stdout:7/207: readlink d12/l20 0 2024-09-18T21:12:42.644 INFO:tasks.workunit.client.1.smithi103.stdout:1/82: symlink d0/d3/l21 0 2024-09-18T21:12:42.645 INFO:tasks.workunit.client.0.smithi077.stdout:5/169: creat d0/df/d10/f45 x:0 0 0 2024-09-18T21:12:42.647 INFO:tasks.workunit.client.0.smithi077.stdout:8/97: sync 2024-09-18T21:12:42.647 INFO:tasks.workunit.client.0.smithi077.stdout:1/122: sync 2024-09-18T21:12:42.652 INFO:tasks.workunit.client.0.smithi077.stdout:0/222: symlink d8/d1a/d39/d3b/l4a 0 2024-09-18T21:12:42.653 INFO:tasks.workunit.client.1.smithi103.stdout:8/91: mknod d4/d6/c24 0 2024-09-18T21:12:42.653 INFO:tasks.workunit.client.1.smithi103.stdout:8/92: chown d4/de/f11 5560732 1 2024-09-18T21:12:42.654 INFO:tasks.workunit.client.0.smithi077.stdout:0/223: truncate d8/d1d/f2b 899808 0 2024-09-18T21:12:42.656 INFO:tasks.workunit.client.1.smithi103.stdout:2/89: stat d3/d5/l14 0 2024-09-18T21:12:42.657 INFO:tasks.workunit.client.0.smithi077.stdout:5/170: mknod d0/d6/dd/c46 0 2024-09-18T21:12:42.657 INFO:tasks.workunit.client.1.smithi103.stdout:7/107: rmdir d1 39 2024-09-18T21:12:42.659 INFO:tasks.workunit.client.1.smithi103.stdout:9/97: fdatasync d18/f1a 0 2024-09-18T21:12:42.659 INFO:tasks.workunit.client.1.smithi103.stdout:9/98: stat d18/l19 0 2024-09-18T21:12:42.660 INFO:tasks.workunit.client.1.smithi103.stdout:0/137: symlink d1/d9/l2d 0 2024-09-18T21:12:42.660 INFO:tasks.workunit.client.1.smithi103.stdout:6/156: write d2/d3/d4/f2b [1801256,36075] 0 2024-09-18T21:12:42.661 INFO:tasks.workunit.client.0.smithi077.stdout:0/224: creat d8/d1a/f4b x:0 0 0 2024-09-18T21:12:42.664 INFO:tasks.workunit.client.0.smithi077.stdout:0/225: dread d8/d1a/d35/f3e [0,4194304] 0 2024-09-18T21:12:42.665 INFO:tasks.workunit.client.0.smithi077.stdout:5/171: mkdir d0/df/d10/d47 0 2024-09-18T21:12:42.666 INFO:tasks.workunit.client.0.smithi077.stdout:8/98: mknod d2/d5/c23 0 2024-09-18T21:12:42.666 INFO:tasks.workunit.client.0.smithi077.stdout:1/123: write d3/d8/f17 [2534786,85836] 0 2024-09-18T21:12:42.669 INFO:tasks.workunit.client.1.smithi103.stdout:2/90: creat d3/f20 x:0 0 0 2024-09-18T21:12:42.669 INFO:tasks.workunit.client.0.smithi077.stdout:7/208: fdatasync d12/d31/d33/d2a/f32 0 2024-09-18T21:12:42.669 INFO:tasks.workunit.client.1.smithi103.stdout:2/91: dread - d3/d5/f17 zero size 2024-09-18T21:12:42.670 INFO:tasks.workunit.client.0.smithi077.stdout:0/226: fdatasync d8/d26/f15 0 2024-09-18T21:12:42.671 INFO:tasks.workunit.client.1.smithi103.stdout:9/99: symlink d18/l1e 0 2024-09-18T21:12:42.674 INFO:tasks.workunit.client.1.smithi103.stdout:0/138: rename d1/d5/de/l1d to d1/d5/de/d19/d1e/l2e 0 2024-09-18T21:12:42.676 INFO:tasks.workunit.client.1.smithi103.stdout:5/79: link c9 de/d14/c1d 0 2024-09-18T21:12:42.677 INFO:tasks.workunit.client.0.smithi077.stdout:7/209: symlink d12/d22/d2d/l53 0 2024-09-18T21:12:42.678 INFO:tasks.workunit.client.1.smithi103.stdout:1/83: truncate d0/d2/d9/dc/f15 599048 0 2024-09-18T21:12:42.679 INFO:tasks.workunit.client.1.smithi103.stdout:7/108: dwrite d1/f17 [0,4194304] 0 2024-09-18T21:12:42.679 INFO:tasks.workunit.client.0.smithi077.stdout:8/99: creat d2/d5/d6/d22/d20/f24 x:0 0 0 2024-09-18T21:12:42.680 INFO:tasks.workunit.client.1.smithi103.stdout:2/92: dwrite d3/ff [0,4194304] 0 2024-09-18T21:12:42.680 INFO:tasks.workunit.client.1.smithi103.stdout:7/109: readlink l0 0 2024-09-18T21:12:42.680 INFO:tasks.workunit.client.0.smithi077.stdout:8/100: chown d2/d5/c11 14 1 2024-09-18T21:12:42.681 INFO:tasks.workunit.client.0.smithi077.stdout:1/124: symlink d3/d8/d13/d18/d22/l28 0 2024-09-18T21:12:42.681 INFO:tasks.workunit.client.0.smithi077.stdout:7/210: readlink l2 0 2024-09-18T21:12:42.682 INFO:tasks.workunit.client.1.smithi103.stdout:9/100: dread f4 [0,4194304] 0 2024-09-18T21:12:42.685 INFO:tasks.workunit.client.0.smithi077.stdout:8/101: dread d2/d5/d6/f14 [0,4194304] 0 2024-09-18T21:12:42.686 INFO:tasks.workunit.client.0.smithi077.stdout:1/125: creat d3/d8/d13/d18/f29 x:0 0 0 2024-09-18T21:12:42.689 INFO:tasks.workunit.client.1.smithi103.stdout:2/93: rmdir d3/d5 39 2024-09-18T21:12:42.691 INFO:tasks.workunit.client.1.smithi103.stdout:0/139: dread d1/d5/de/d19/d1e/f21 [0,4194304] 0 2024-09-18T21:12:42.694 INFO:tasks.workunit.client.1.smithi103.stdout:9/101: mkdir d18/d1f 0 2024-09-18T21:12:42.694 INFO:tasks.workunit.client.1.smithi103.stdout:5/80: dwrite de/f1c [0,4194304] 0 2024-09-18T21:12:42.695 INFO:tasks.workunit.client.1.smithi103.stdout:1/84: dread d0/d3/f1a [0,4194304] 0 2024-09-18T21:12:42.696 INFO:tasks.workunit.client.1.smithi103.stdout:7/110: dwrite d1/fa [4194304,4194304] 0 2024-09-18T21:12:42.698 INFO:tasks.workunit.client.1.smithi103.stdout:8/93: getdents d4/d6 0 2024-09-18T21:12:42.699 INFO:tasks.workunit.client.0.smithi077.stdout:5/172: dwrite d0/f18 [0,4194304] 0 2024-09-18T21:12:42.701 INFO:tasks.workunit.client.1.smithi103.stdout:1/85: dread d0/d3/f1a [0,4194304] 0 2024-09-18T21:12:42.703 INFO:tasks.workunit.client.0.smithi077.stdout:8/102: dwrite d2/d5/d6/f14 [0,4194304] 0 2024-09-18T21:12:42.706 INFO:tasks.workunit.client.0.smithi077.stdout:7/211: getdents d12/d22/d39 0 2024-09-18T21:12:42.707 INFO:tasks.workunit.client.0.smithi077.stdout:7/212: readlink d12/d22/d2d/l4b 0 2024-09-18T21:12:42.712 INFO:tasks.workunit.client.1.smithi103.stdout:9/102: rename f5 to d18/f20 0 2024-09-18T21:12:42.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:42 smithi077 ceph-mon[27689]: pgmap v12: 65 pgs: 65 active+clean; 413 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 304 KiB/s rd, 27 MiB/s wr, 249 op/s 2024-09-18T21:12:42.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:42 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:12:42.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:42 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:12:42.713 INFO:tasks.workunit.client.1.smithi103.stdout:5/81: rename de/d14/d1a/l1b to de/d14/d1a/l1e 0 2024-09-18T21:12:42.716 INFO:tasks.workunit.client.1.smithi103.stdout:0/140: dread d1/f17 [0,4194304] 0 2024-09-18T21:12:42.717 INFO:tasks.workunit.client.0.smithi077.stdout:8/103: mkdir d2/d5/d25 0 2024-09-18T21:12:42.717 INFO:tasks.workunit.client.1.smithi103.stdout:8/94: creat d4/d6/f25 x:0 0 0 2024-09-18T21:12:42.717 INFO:tasks.workunit.client.0.smithi077.stdout:1/126: truncate d3/d8/d13/f1f 612205 0 2024-09-18T21:12:42.718 INFO:tasks.workunit.client.1.smithi103.stdout:1/86: creat d0/d2/d9/dc/f22 x:0 0 0 2024-09-18T21:12:42.719 INFO:tasks.workunit.client.0.smithi077.stdout:8/104: truncate d2/d5/d6/f14 5014871 0 2024-09-18T21:12:42.720 INFO:tasks.workunit.client.0.smithi077.stdout:8/105: truncate d2/f19 193655 0 2024-09-18T21:12:42.720 INFO:tasks.workunit.client.0.smithi077.stdout:8/106: chown d2/d5/d6 5593 1 2024-09-18T21:12:42.721 INFO:tasks.workunit.client.0.smithi077.stdout:5/173: creat d0/d6/f48 x:0 0 0 2024-09-18T21:12:42.722 INFO:tasks.workunit.client.0.smithi077.stdout:5/174: read - d0/d6/dd/f19 zero size 2024-09-18T21:12:42.725 INFO:tasks.workunit.client.1.smithi103.stdout:0/141: mknod d1/d5/de/d22/c2f 0 2024-09-18T21:12:42.725 INFO:tasks.workunit.client.1.smithi103.stdout:2/94: dwrite d3/d5/f17 [0,4194304] 0 2024-09-18T21:12:42.726 INFO:tasks.workunit.client.0.smithi077.stdout:5/175: readlink d0/df/l28 0 2024-09-18T21:12:42.728 INFO:tasks.workunit.client.0.smithi077.stdout:8/107: dwrite d2/d5/d6/f1f [0,4194304] 0 2024-09-18T21:12:42.728 INFO:tasks.workunit.client.0.smithi077.stdout:1/127: creat d3/f2a x:0 0 0 2024-09-18T21:12:42.730 INFO:tasks.workunit.client.1.smithi103.stdout:1/87: creat d0/d2/d9/f23 x:0 0 0 2024-09-18T21:12:42.733 INFO:tasks.workunit.client.0.smithi077.stdout:7/213: write f1 [8608478,11407] 0 2024-09-18T21:12:42.736 INFO:tasks.workunit.client.1.smithi103.stdout:8/95: rename d4/d6 to d4/d26 0 2024-09-18T21:12:42.740 INFO:tasks.workunit.client.0.smithi077.stdout:5/176: dwrite d0/f37 [0,4194304] 0 2024-09-18T21:12:42.742 INFO:tasks.workunit.client.1.smithi103.stdout:8/96: dwrite d4/de/f1e [0,4194304] 0 2024-09-18T21:12:42.742 INFO:tasks.workunit.client.1.smithi103.stdout:8/97: chown d4/de/f1c 1340 1 2024-09-18T21:12:42.744 INFO:tasks.workunit.client.0.smithi077.stdout:8/108: dwrite d2/d5/f16 [0,4194304] 0 2024-09-18T21:12:42.745 INFO:tasks.workunit.client.0.smithi077.stdout:5/177: mkdir d0/d36/d49 0 2024-09-18T21:12:42.746 INFO:tasks.workunit.client.0.smithi077.stdout:1/128: dwrite d3/d8/f1c [4194304,4194304] 0 2024-09-18T21:12:42.748 INFO:tasks.workunit.client.0.smithi077.stdout:5/178: read - d0/df/f2b zero size 2024-09-18T21:12:42.748 INFO:tasks.workunit.client.0.smithi077.stdout:7/214: dread fa [0,4194304] 0 2024-09-18T21:12:42.752 INFO:tasks.workunit.client.1.smithi103.stdout:1/88: symlink d0/d11/l24 0 2024-09-18T21:12:42.752 INFO:tasks.workunit.client.0.smithi077.stdout:5/179: write d0/d6/dd/f3a [622392,41073] 0 2024-09-18T21:12:42.754 INFO:tasks.workunit.client.0.smithi077.stdout:5/180: write d0/df/f22 [867900,91410] 0 2024-09-18T21:12:42.757 INFO:tasks.workunit.client.1.smithi103.stdout:5/82: dwrite fb [4194304,4194304] 0 2024-09-18T21:12:42.758 INFO:tasks.workunit.client.1.smithi103.stdout:5/83: truncate fb 8406836 0 2024-09-18T21:12:42.758 INFO:tasks.workunit.client.0.smithi077.stdout:8/109: dread d2/d5/f16 [0,4194304] 0 2024-09-18T21:12:42.761 INFO:tasks.workunit.client.0.smithi077.stdout:1/129: dwrite d3/f10 [0,4194304] 0 2024-09-18T21:12:42.761 INFO:tasks.workunit.client.1.smithi103.stdout:8/98: rename d4/de/c22 to d4/de/c27 0 2024-09-18T21:12:42.762 INFO:tasks.workunit.client.1.smithi103.stdout:0/142: dwrite d1/f17 [0,4194304] 0 2024-09-18T21:12:42.762 INFO:tasks.workunit.client.1.smithi103.stdout:1/89: dread - d0/d2/d9/f23 zero size 2024-09-18T21:12:42.762 INFO:tasks.workunit.client.1.smithi103.stdout:7/111: getdents d1/df 0 2024-09-18T21:12:42.763 INFO:tasks.workunit.client.0.smithi077.stdout:5/181: rmdir d0/d6 39 2024-09-18T21:12:42.763 INFO:tasks.workunit.client.0.smithi077.stdout:5/182: stat d0/df/d10/l23 0 2024-09-18T21:12:42.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:42 smithi103 ceph-mon[34827]: pgmap v12: 65 pgs: 65 active+clean; 413 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 304 KiB/s rd, 27 MiB/s wr, 249 op/s 2024-09-18T21:12:42.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:42 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:12:42.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:42 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:12:42.765 INFO:tasks.workunit.client.1.smithi103.stdout:1/90: truncate d0/d2/d9/f23 847616 0 2024-09-18T21:12:42.765 INFO:tasks.workunit.client.1.smithi103.stdout:5/84: rmdir de 39 2024-09-18T21:12:42.767 INFO:tasks.workunit.client.1.smithi103.stdout:1/91: chown d0/d11/d16/d19/l1f 0 1 2024-09-18T21:12:42.769 INFO:tasks.workunit.client.0.smithi077.stdout:5/183: dread d0/f18 [0,4194304] 0 2024-09-18T21:12:42.772 INFO:tasks.workunit.client.1.smithi103.stdout:8/99: mknod d4/c28 0 2024-09-18T21:12:42.773 INFO:tasks.workunit.client.0.smithi077.stdout:8/110: mkdir d2/d5/d6/d22/d26 0 2024-09-18T21:12:42.776 INFO:tasks.workunit.client.1.smithi103.stdout:2/95: link d3/d5/f6 d3/f21 0 2024-09-18T21:12:42.778 INFO:tasks.workunit.client.1.smithi103.stdout:7/112: rename d1/fc to d1/df/f22 0 2024-09-18T21:12:42.778 INFO:tasks.workunit.client.1.smithi103.stdout:7/113: readlink d1/l8 0 2024-09-18T21:12:42.779 INFO:tasks.workunit.client.0.smithi077.stdout:7/215: creat d12/d31/f54 x:0 0 0 2024-09-18T21:12:42.780 INFO:tasks.workunit.client.1.smithi103.stdout:2/96: dread d3/f1b [0,4194304] 0 2024-09-18T21:12:42.780 INFO:tasks.workunit.client.1.smithi103.stdout:0/143: mknod d1/d9/d13/c30 0 2024-09-18T21:12:42.780 INFO:tasks.workunit.client.1.smithi103.stdout:5/85: truncate de/d11/f12 105075 0 2024-09-18T21:12:42.781 INFO:tasks.workunit.client.1.smithi103.stdout:5/86: chown de/d11 948 1 2024-09-18T21:12:42.783 INFO:tasks.workunit.client.0.smithi077.stdout:5/184: dread d0/f2 [0,4194304] 0 2024-09-18T21:12:42.785 INFO:tasks.workunit.client.1.smithi103.stdout:7/114: symlink d1/df/d1d/l23 0 2024-09-18T21:12:42.786 INFO:tasks.workunit.client.0.smithi077.stdout:8/111: mkdir d2/d27 0 2024-09-18T21:12:42.787 INFO:tasks.workunit.client.1.smithi103.stdout:5/87: mkdir de/d1f 0 2024-09-18T21:12:42.788 INFO:tasks.workunit.client.1.smithi103.stdout:5/88: readlink ld 0 2024-09-18T21:12:42.789 INFO:tasks.workunit.client.1.smithi103.stdout:8/100: dwrite d4/de/f16 [0,4194304] 0 2024-09-18T21:12:42.789 INFO:tasks.workunit.client.0.smithi077.stdout:8/112: rename d2/d5/ld to d2/d5/d6/l28 0 2024-09-18T21:12:42.790 INFO:tasks.workunit.client.0.smithi077.stdout:8/113: write d2/f19 [289883,35467] 0 2024-09-18T21:12:42.791 INFO:tasks.workunit.client.1.smithi103.stdout:7/115: fdatasync d1/df/d1d/f1e 0 2024-09-18T21:12:42.791 INFO:tasks.workunit.client.0.smithi077.stdout:5/185: dread d0/d6/fb [0,4194304] 0 2024-09-18T21:12:42.795 INFO:tasks.workunit.client.0.smithi077.stdout:8/114: mkdir d2/d27/d29 0 2024-09-18T21:12:42.796 INFO:tasks.workunit.client.0.smithi077.stdout:5/186: mknod d0/d43/c4a 0 2024-09-18T21:12:42.796 INFO:tasks.workunit.client.0.smithi077.stdout:8/115: truncate d2/d5/f16 4269886 0 2024-09-18T21:12:42.796 INFO:tasks.workunit.client.1.smithi103.stdout:2/97: creat d3/f22 x:0 0 0 2024-09-18T21:12:42.797 INFO:tasks.workunit.client.0.smithi077.stdout:5/187: stat d0/df/f2b 0 2024-09-18T21:12:42.797 INFO:tasks.workunit.client.1.smithi103.stdout:5/89: creat de/d11/d15/f20 x:0 0 0 2024-09-18T21:12:42.798 INFO:tasks.workunit.client.0.smithi077.stdout:8/116: write d2/d5/d6/f1f [1992494,35215] 0 2024-09-18T21:12:42.800 INFO:tasks.workunit.client.0.smithi077.stdout:5/188: mkdir d0/df/d10/d4b 0 2024-09-18T21:12:42.801 INFO:tasks.workunit.client.1.smithi103.stdout:2/98: fdatasync d3/d5/f18 0 2024-09-18T21:12:42.802 INFO:tasks.workunit.client.1.smithi103.stdout:2/99: chown d3/l10 675 1 2024-09-18T21:12:42.802 INFO:tasks.workunit.client.1.smithi103.stdout:5/90: symlink de/d1f/l21 0 2024-09-18T21:12:42.805 INFO:tasks.workunit.client.1.smithi103.stdout:5/91: creat de/d14/f22 x:0 0 0 2024-09-18T21:12:42.805 INFO:tasks.workunit.client.1.smithi103.stdout:1/92: dread d0/d2/fb [0,4194304] 0 2024-09-18T21:12:42.806 INFO:tasks.workunit.client.0.smithi077.stdout:8/117: dwrite d2/d5/d6/f21 [0,4194304] 0 2024-09-18T21:12:42.806 INFO:tasks.workunit.client.1.smithi103.stdout:1/93: readlink d0/le 0 2024-09-18T21:12:42.807 INFO:tasks.workunit.client.0.smithi077.stdout:5/189: dread d0/d6/dd/f35 [0,4194304] 0 2024-09-18T21:12:42.808 INFO:tasks.workunit.client.0.smithi077.stdout:5/190: write d0/f37 [4114702,12289] 0 2024-09-18T21:12:42.810 INFO:tasks.workunit.client.0.smithi077.stdout:5/191: symlink d0/d6/d3b/l4c 0 2024-09-18T21:12:42.813 INFO:tasks.workunit.client.0.smithi077.stdout:5/192: rename d0/d6/dd/l33 to d0/df/d10/d4b/l4d 0 2024-09-18T21:12:42.814 INFO:tasks.workunit.client.1.smithi103.stdout:5/92: dwrite de/f16 [0,4194304] 0 2024-09-18T21:12:42.815 INFO:tasks.workunit.client.0.smithi077.stdout:5/193: creat d0/d6/d3b/f4e x:0 0 0 2024-09-18T21:12:42.816 INFO:tasks.workunit.client.0.smithi077.stdout:8/118: fdatasync d2/f19 0 2024-09-18T21:12:42.817 INFO:tasks.workunit.client.1.smithi103.stdout:5/93: fsync de/d11/f17 0 2024-09-18T21:12:42.817 INFO:tasks.workunit.client.0.smithi077.stdout:8/119: write d2/d5/d6/f14 [1824602,116135] 0 2024-09-18T21:12:42.817 INFO:tasks.workunit.client.1.smithi103.stdout:1/94: dwrite d0/d2/fb [0,4194304] 0 2024-09-18T21:12:42.819 INFO:tasks.workunit.client.0.smithi077.stdout:8/120: mkdir d2/d5/d25/d2a 0 2024-09-18T21:12:42.821 INFO:tasks.workunit.client.0.smithi077.stdout:8/121: mknod d2/d5/d6/c2b 0 2024-09-18T21:12:42.821 INFO:tasks.workunit.client.0.smithi077.stdout:5/194: read d0/d6/dd/f11 [5373,113698] 0 2024-09-18T21:12:42.824 INFO:tasks.workunit.client.0.smithi077.stdout:5/195: read d0/df/d10/f7 [3659529,29523] 0 2024-09-18T21:12:42.825 INFO:tasks.workunit.client.1.smithi103.stdout:5/94: rename de/d11/d15/f20 to de/d1f/f23 0 2024-09-18T21:12:42.825 INFO:tasks.workunit.client.1.smithi103.stdout:2/100: truncate d3/d5/f6 3280402 0 2024-09-18T21:12:42.827 INFO:tasks.workunit.client.0.smithi077.stdout:8/122: rmdir d2/d5/d6/d22/d20 39 2024-09-18T21:12:42.830 INFO:tasks.workunit.client.1.smithi103.stdout:5/95: dwrite de/f1c [4194304,4194304] 0 2024-09-18T21:12:42.831 INFO:tasks.workunit.client.0.smithi077.stdout:8/123: creat d2/d5/d6/f2c x:0 0 0 2024-09-18T21:12:42.833 INFO:tasks.workunit.client.0.smithi077.stdout:5/196: mknod d0/d6/c4f 0 2024-09-18T21:12:42.833 INFO:tasks.workunit.client.0.smithi077.stdout:5/197: chown d0/d6/dd/f11 11 1 2024-09-18T21:12:42.834 INFO:tasks.workunit.client.0.smithi077.stdout:2/154: sync 2024-09-18T21:12:42.835 INFO:tasks.workunit.client.0.smithi077.stdout:8/124: mknod d2/d5/d6/d22/d26/c2d 0 2024-09-18T21:12:42.835 INFO:tasks.workunit.client.1.smithi103.stdout:5/96: dread fb [4194304,4194304] 0 2024-09-18T21:12:42.836 INFO:tasks.workunit.client.0.smithi077.stdout:2/155: creat d1/d4/f2f x:0 0 0 2024-09-18T21:12:42.837 INFO:tasks.workunit.client.1.smithi103.stdout:2/101: mkdir d3/d23 0 2024-09-18T21:12:42.839 INFO:tasks.workunit.client.0.smithi077.stdout:5/198: truncate d0/f18 4347011 0 2024-09-18T21:12:42.841 INFO:tasks.workunit.client.0.smithi077.stdout:8/125: mknod d2/d27/d29/c2e 0 2024-09-18T21:12:42.847 INFO:tasks.workunit.client.0.smithi077.stdout:7/216: dwrite fa [0,4194304] 0 2024-09-18T21:12:42.847 INFO:tasks.workunit.client.0.smithi077.stdout:2/156: creat d1/d4/d9/f30 x:0 0 0 2024-09-18T21:12:42.848 INFO:tasks.workunit.client.0.smithi077.stdout:2/157: chown d1 1215059 1 2024-09-18T21:12:42.848 INFO:tasks.workunit.client.0.smithi077.stdout:5/199: dwrite d0/df/d10/f26 [0,4194304] 0 2024-09-18T21:12:42.849 INFO:tasks.workunit.client.1.smithi103.stdout:8/101: write d4/ff [1518030,22344] 0 2024-09-18T21:12:42.850 INFO:tasks.workunit.client.0.smithi077.stdout:5/200: fsync d0/d6/f48 0 2024-09-18T21:12:42.851 INFO:tasks.workunit.client.0.smithi077.stdout:5/201: stat d0/d6/fb 0 2024-09-18T21:12:42.851 INFO:tasks.workunit.client.0.smithi077.stdout:8/126: dread d2/d5/d6/f1a [0,4194304] 0 2024-09-18T21:12:42.852 INFO:tasks.workunit.client.0.smithi077.stdout:8/127: chown d2/d5/c11 30 1 2024-09-18T21:12:42.853 INFO:tasks.workunit.client.1.smithi103.stdout:2/102: rmdir d3/d23 0 2024-09-18T21:12:42.861 INFO:tasks.workunit.client.1.smithi103.stdout:7/116: dwrite d1/df/f14 [0,4194304] 0 2024-09-18T21:12:42.861 INFO:tasks.workunit.client.0.smithi077.stdout:2/158: mknod d1/d4/d9/d24/c31 0 2024-09-18T21:12:42.863 INFO:tasks.workunit.client.1.smithi103.stdout:2/103: link d3/l19 d3/d5/l24 0 2024-09-18T21:12:42.865 INFO:tasks.workunit.client.0.smithi077.stdout:7/217: creat d12/f55 x:0 0 0 2024-09-18T21:12:42.868 INFO:tasks.workunit.client.0.smithi077.stdout:5/202: rename d0/f2e to d0/d6/f50 0 2024-09-18T21:12:42.869 INFO:tasks.workunit.client.1.smithi103.stdout:8/102: getdents d4/de 0 2024-09-18T21:12:42.869 INFO:tasks.workunit.client.1.smithi103.stdout:8/103: chown d4/d26/f25 342754247 1 2024-09-18T21:12:42.870 INFO:tasks.workunit.client.0.smithi077.stdout:7/218: write d12/f45 [714421,34697] 0 2024-09-18T21:12:42.870 INFO:tasks.workunit.client.1.smithi103.stdout:8/104: readlink d4/de/l12 0 2024-09-18T21:12:42.871 INFO:tasks.workunit.client.1.smithi103.stdout:2/104: mkdir d3/d5/d25 0 2024-09-18T21:12:42.871 INFO:tasks.workunit.client.1.smithi103.stdout:1/95: write d0/f7 [975778,54940] 0 2024-09-18T21:12:42.873 INFO:tasks.workunit.client.1.smithi103.stdout:1/96: write d0/d3/f20 [816395,85982] 0 2024-09-18T21:12:42.874 INFO:tasks.workunit.client.0.smithi077.stdout:7/219: dread d12/f24 [0,4194304] 0 2024-09-18T21:12:42.875 INFO:tasks.workunit.client.1.smithi103.stdout:1/97: write d0/d2/d9/dc/f22 [1803,55039] 0 2024-09-18T21:12:42.875 INFO:tasks.workunit.client.0.smithi077.stdout:5/203: creat d0/d6/dd/f51 x:0 0 0 2024-09-18T21:12:42.879 INFO:tasks.workunit.client.0.smithi077.stdout:5/204: dread d0/d6/dd/f30 [0,4194304] 0 2024-09-18T21:12:42.880 INFO:tasks.workunit.client.0.smithi077.stdout:5/205: read - d0/d6/f3c zero size 2024-09-18T21:12:42.882 INFO:tasks.workunit.client.1.smithi103.stdout:5/97: truncate fb 5436627 0 2024-09-18T21:12:42.884 INFO:tasks.workunit.client.1.smithi103.stdout:1/98: creat d0/d2/d9/d10/f25 x:0 0 0 2024-09-18T21:12:42.885 INFO:tasks.workunit.client.0.smithi077.stdout:5/206: creat d0/df/f52 x:0 0 0 2024-09-18T21:12:42.885 INFO:tasks.workunit.client.0.smithi077.stdout:5/207: chown d0/d6/c4f 163649122 1 2024-09-18T21:12:42.886 INFO:tasks.workunit.client.1.smithi103.stdout:5/98: creat de/d1f/f24 x:0 0 0 2024-09-18T21:12:42.889 INFO:tasks.workunit.client.0.smithi077.stdout:7/220: rename d12/d22/d2d to d12/d56 0 2024-09-18T21:12:42.890 INFO:tasks.workunit.client.1.smithi103.stdout:2/105: rename d3/c1a to d3/c26 0 2024-09-18T21:12:42.892 INFO:tasks.workunit.client.1.smithi103.stdout:1/99: chown d0/c4 34941007 1 2024-09-18T21:12:42.893 INFO:tasks.workunit.client.1.smithi103.stdout:1/100: fdatasync d0/f7 0 2024-09-18T21:12:42.894 INFO:tasks.workunit.client.0.smithi077.stdout:7/221: rename d12/d31/f4a to d12/d22/d39/f57 0 2024-09-18T21:12:42.895 INFO:tasks.workunit.client.1.smithi103.stdout:2/106: creat d3/d5/f27 x:0 0 0 2024-09-18T21:12:42.896 INFO:tasks.workunit.client.1.smithi103.stdout:7/117: dwrite d1/f12 [4194304,4194304] 0 2024-09-18T21:12:42.896 INFO:tasks.workunit.client.1.smithi103.stdout:2/107: chown c2 4607 1 2024-09-18T21:12:42.896 INFO:tasks.workunit.client.1.smithi103.stdout:7/118: chown d1/df/d1d 10875 1 2024-09-18T21:12:42.897 INFO:tasks.workunit.client.1.smithi103.stdout:8/105: write d4/d26/f8 [3154910,119102] 0 2024-09-18T21:12:42.900 INFO:tasks.workunit.client.1.smithi103.stdout:1/101: mknod d0/d2/d9/c26 0 2024-09-18T21:12:42.902 INFO:tasks.workunit.client.0.smithi077.stdout:7/222: dread d12/d22/d39/f3b [0,4194304] 0 2024-09-18T21:12:42.904 INFO:tasks.workunit.client.1.smithi103.stdout:8/106: mknod d4/d26/c29 0 2024-09-18T21:12:42.904 INFO:tasks.workunit.client.1.smithi103.stdout:1/102: dread d0/d2/d9/dc/f22 [0,4194304] 0 2024-09-18T21:12:42.905 INFO:tasks.workunit.client.1.smithi103.stdout:7/119: dwrite d1/df/f20 [0,4194304] 0 2024-09-18T21:12:42.906 INFO:tasks.workunit.client.0.smithi077.stdout:5/208: write d0/d6/dd/fe [5076310,28321] 0 2024-09-18T21:12:42.909 INFO:tasks.workunit.client.0.smithi077.stdout:7/223: symlink d12/d22/l58 0 2024-09-18T21:12:42.910 INFO:tasks.workunit.client.1.smithi103.stdout:2/108: rmdir d3/d5 39 2024-09-18T21:12:42.910 INFO:tasks.workunit.client.0.smithi077.stdout:7/224: chown d12/f25 464735140 1 2024-09-18T21:12:42.911 INFO:tasks.workunit.client.1.smithi103.stdout:1/103: mknod d0/d3/c27 0 2024-09-18T21:12:42.912 INFO:tasks.workunit.client.1.smithi103.stdout:4/77: sync 2024-09-18T21:12:42.912 INFO:tasks.workunit.client.1.smithi103.stdout:3/90: sync 2024-09-18T21:12:42.912 INFO:tasks.workunit.client.0.smithi077.stdout:7/225: truncate d12/d31/d33/d2a/f4f 1002626 0 2024-09-18T21:12:42.912 INFO:tasks.workunit.client.0.smithi077.stdout:5/209: mknod d0/d6/dd/c53 0 2024-09-18T21:12:42.913 INFO:tasks.workunit.client.1.smithi103.stdout:3/91: readlink d1/da/le 0 2024-09-18T21:12:42.913 INFO:tasks.workunit.client.0.smithi077.stdout:7/226: fdatasync d12/f1f 0 2024-09-18T21:12:42.914 INFO:tasks.workunit.client.0.smithi077.stdout:7/227: chown d12/l18 66904138 1 2024-09-18T21:12:42.915 INFO:tasks.workunit.client.1.smithi103.stdout:5/99: write fb [494304,120016] 0 2024-09-18T21:12:42.915 INFO:tasks.workunit.client.1.smithi103.stdout:4/78: read d9/fa [3054557,61284] 0 2024-09-18T21:12:42.916 INFO:tasks.workunit.client.1.smithi103.stdout:4/79: fsync d9/f19 0 2024-09-18T21:12:42.916 INFO:tasks.workunit.client.1.smithi103.stdout:2/109: stat d3/d5 0 2024-09-18T21:12:42.917 INFO:tasks.workunit.client.1.smithi103.stdout:2/110: write d3/ff [1426113,82762] 0 2024-09-18T21:12:42.917 INFO:tasks.workunit.client.0.smithi077.stdout:5/210: rename d0/df/d10/la to d0/d6/d40/l54 0 2024-09-18T21:12:42.919 INFO:tasks.workunit.client.1.smithi103.stdout:1/104: unlink d0/d3/l21 0 2024-09-18T21:12:42.921 INFO:tasks.workunit.client.0.smithi077.stdout:7/228: dwrite d12/d56/f3a [0,4194304] 0 2024-09-18T21:12:42.923 INFO:tasks.workunit.client.0.smithi077.stdout:7/229: dread f5 [0,4194304] 0 2024-09-18T21:12:42.923 INFO:tasks.workunit.client.1.smithi103.stdout:7/120: creat d1/df/d1d/d1f/f24 x:0 0 0 2024-09-18T21:12:42.923 INFO:tasks.workunit.client.0.smithi077.stdout:5/211: creat d0/d6/d3b/f55 x:0 0 0 2024-09-18T21:12:42.925 INFO:tasks.workunit.client.1.smithi103.stdout:4/80: dwrite d9/f19 [0,4194304] 0 2024-09-18T21:12:42.926 INFO:tasks.workunit.client.0.smithi077.stdout:7/230: dread d12/d31/d33/d2a/f4f [0,4194304] 0 2024-09-18T21:12:42.927 INFO:tasks.workunit.client.0.smithi077.stdout:5/212: rmdir d0/d6/d40 39 2024-09-18T21:12:42.928 INFO:tasks.workunit.client.1.smithi103.stdout:2/111: creat d3/d5/f28 x:0 0 0 2024-09-18T21:12:42.928 INFO:tasks.workunit.client.1.smithi103.stdout:3/92: dread d1/da/f15 [0,4194304] 0 2024-09-18T21:12:42.930 INFO:tasks.workunit.client.0.smithi077.stdout:7/231: mkdir d12/d22/d59 0 2024-09-18T21:12:42.931 INFO:tasks.workunit.client.1.smithi103.stdout:7/121: creat d1/df/f25 x:0 0 0 2024-09-18T21:12:42.931 INFO:tasks.workunit.client.1.smithi103.stdout:4/81: write d9/f18 [456324,14362] 0 2024-09-18T21:12:42.931 INFO:tasks.workunit.client.1.smithi103.stdout:8/107: dwrite d4/de/f11 [4194304,4194304] 0 2024-09-18T21:12:42.931 INFO:tasks.workunit.client.0.smithi077.stdout:7/232: write d12/f55 [1015419,28708] 0 2024-09-18T21:12:42.933 INFO:tasks.workunit.client.1.smithi103.stdout:4/82: rename d9 to d9/d1a/d1b 22 2024-09-18T21:12:42.934 INFO:tasks.workunit.client.0.smithi077.stdout:5/213: getdents d0/d6/dd 0 2024-09-18T21:12:42.934 INFO:tasks.workunit.client.1.smithi103.stdout:3/93: dread d1/f13 [0,4194304] 0 2024-09-18T21:12:42.935 INFO:tasks.workunit.client.1.smithi103.stdout:2/112: creat d3/d5/d25/f29 x:0 0 0 2024-09-18T21:12:42.935 INFO:tasks.workunit.client.0.smithi077.stdout:7/233: mkdir d12/d22/d59/d5a 0 2024-09-18T21:12:42.936 INFO:tasks.workunit.client.1.smithi103.stdout:4/83: mkdir d9/d1c 0 2024-09-18T21:12:42.942 INFO:tasks.workunit.client.1.smithi103.stdout:8/108: dwrite d4/de/f11 [4194304,4194304] 0 2024-09-18T21:12:42.944 INFO:tasks.workunit.client.1.smithi103.stdout:1/105: write d0/d2/d9/dc/f22 [777018,64269] 0 2024-09-18T21:12:42.944 INFO:tasks.workunit.client.1.smithi103.stdout:7/122: dwrite d1/f1c [0,4194304] 0 2024-09-18T21:12:42.949 INFO:tasks.workunit.client.0.smithi077.stdout:5/214: rename d0/d6/d40/l54 to d0/df/d10/d4b/l56 0 2024-09-18T21:12:42.950 INFO:tasks.workunit.client.1.smithi103.stdout:2/113: mknod d3/c2a 0 2024-09-18T21:12:42.951 INFO:tasks.workunit.client.0.smithi077.stdout:7/234: getdents d12 0 2024-09-18T21:12:42.952 INFO:tasks.workunit.client.0.smithi077.stdout:7/235: readlink d12/d31/d33/l30 0 2024-09-18T21:12:42.953 INFO:tasks.workunit.client.0.smithi077.stdout:5/215: getdents d0/df/d10/d47 0 2024-09-18T21:12:42.953 INFO:tasks.workunit.client.1.smithi103.stdout:5/100: fdatasync fb 0 2024-09-18T21:12:42.953 INFO:tasks.workunit.client.1.smithi103.stdout:4/84: mkdir d9/d1a/d1d 0 2024-09-18T21:12:42.953 INFO:tasks.workunit.client.1.smithi103.stdout:9/103: sync 2024-09-18T21:12:42.953 INFO:tasks.workunit.client.1.smithi103.stdout:6/157: sync 2024-09-18T21:12:42.953 INFO:tasks.workunit.client.1.smithi103.stdout:0/144: sync 2024-09-18T21:12:42.954 INFO:tasks.workunit.client.0.smithi077.stdout:7/236: write d12/f25 [1960623,67199] 0 2024-09-18T21:12:42.954 INFO:tasks.workunit.client.0.smithi077.stdout:5/216: chown d0/df/f1c 675238 1 2024-09-18T21:12:42.956 INFO:tasks.workunit.client.1.smithi103.stdout:4/85: stat d9 0 2024-09-18T21:12:42.957 INFO:tasks.workunit.client.1.smithi103.stdout:2/114: symlink d3/d5/l2b 0 2024-09-18T21:12:42.958 INFO:tasks.workunit.client.1.smithi103.stdout:8/109: dwrite f2 [0,4194304] 0 2024-09-18T21:12:42.959 INFO:tasks.workunit.client.0.smithi077.stdout:5/217: symlink d0/d36/d49/l57 0 2024-09-18T21:12:42.959 INFO:tasks.workunit.client.1.smithi103.stdout:3/94: write d1/f13 [899582,4168] 0 2024-09-18T21:12:42.960 INFO:tasks.workunit.client.1.smithi103.stdout:1/106: dwrite d0/f7 [0,4194304] 0 2024-09-18T21:12:42.962 INFO:tasks.workunit.client.0.smithi077.stdout:5/218: creat d0/df/d10/d47/f58 x:0 0 0 2024-09-18T21:12:42.962 INFO:tasks.workunit.client.1.smithi103.stdout:8/110: write d4/d26/f25 [926143,21084] 0 2024-09-18T21:12:42.963 INFO:tasks.workunit.client.1.smithi103.stdout:6/158: chown d2/d3/d8/cc 69568036 1 2024-09-18T21:12:42.966 INFO:tasks.workunit.client.1.smithi103.stdout:6/159: stat d2/d3/d8/c26 0 2024-09-18T21:12:42.967 INFO:tasks.workunit.client.1.smithi103.stdout:6/160: chown d2/c1e 1783229 1 2024-09-18T21:12:42.967 INFO:tasks.workunit.client.1.smithi103.stdout:5/101: symlink de/d14/d1a/l25 0 2024-09-18T21:12:42.967 INFO:tasks.workunit.client.1.smithi103.stdout:4/86: creat d9/d1a/f1e x:0 0 0 2024-09-18T21:12:42.970 INFO:tasks.workunit.client.1.smithi103.stdout:2/115: mkdir d3/d5/d2c 0 2024-09-18T21:12:42.972 INFO:tasks.workunit.client.1.smithi103.stdout:2/116: readlink d3/d5/l14 0 2024-09-18T21:12:42.973 INFO:tasks.workunit.client.1.smithi103.stdout:0/145: fsync d1/fd 0 2024-09-18T21:12:42.974 INFO:tasks.workunit.client.1.smithi103.stdout:9/104: creat d18/d1f/f21 x:0 0 0 2024-09-18T21:12:42.976 INFO:tasks.workunit.client.1.smithi103.stdout:1/107: creat d0/d2/d9/dc/f28 x:0 0 0 2024-09-18T21:12:42.976 INFO:tasks.workunit.client.1.smithi103.stdout:3/95: creat d1/da/df/f19 x:0 0 0 2024-09-18T21:12:42.977 INFO:tasks.workunit.client.1.smithi103.stdout:9/105: read - d18/f1b zero size 2024-09-18T21:12:42.977 INFO:tasks.workunit.client.1.smithi103.stdout:4/87: rename d9/d1a/d1d to d9/d1f 0 2024-09-18T21:12:42.978 INFO:tasks.workunit.client.1.smithi103.stdout:8/111: dwrite d4/ff [0,4194304] 0 2024-09-18T21:12:42.978 INFO:tasks.workunit.client.1.smithi103.stdout:2/117: mknod d3/d5/c2d 0 2024-09-18T21:12:42.979 INFO:tasks.workunit.client.1.smithi103.stdout:6/161: mknod d2/d3/c30 0 2024-09-18T21:12:42.979 INFO:tasks.workunit.client.1.smithi103.stdout:9/106: readlink ld 0 2024-09-18T21:12:42.980 INFO:tasks.workunit.client.1.smithi103.stdout:0/146: unlink d1/l27 0 2024-09-18T21:12:42.981 INFO:tasks.workunit.client.1.smithi103.stdout:5/102: dread de/ff [0,4194304] 0 2024-09-18T21:12:42.982 INFO:tasks.workunit.client.1.smithi103.stdout:3/96: symlink d1/d2/l1a 0 2024-09-18T21:12:42.983 INFO:tasks.workunit.client.1.smithi103.stdout:6/162: read d2/d3/d8/df/f11 [3010682,13759] 0 2024-09-18T21:12:42.985 INFO:tasks.workunit.client.1.smithi103.stdout:0/147: creat d1/d5/f31 x:0 0 0 2024-09-18T21:12:42.985 INFO:tasks.workunit.client.1.smithi103.stdout:2/118: readlink d3/l19 0 2024-09-18T21:12:42.986 INFO:tasks.workunit.client.1.smithi103.stdout:3/97: chown d1/da/le 519976766 1 2024-09-18T21:12:42.986 INFO:tasks.workunit.client.1.smithi103.stdout:9/107: truncate d18/f1a 1626711 0 2024-09-18T21:12:42.988 INFO:tasks.workunit.client.1.smithi103.stdout:0/148: unlink d1/d5/f1c 0 2024-09-18T21:12:42.989 INFO:tasks.workunit.client.1.smithi103.stdout:8/112: symlink d4/d26/l2a 0 2024-09-18T21:12:42.990 INFO:tasks.workunit.client.1.smithi103.stdout:9/108: creat d18/f22 x:0 0 0 2024-09-18T21:12:42.990 INFO:tasks.workunit.client.1.smithi103.stdout:5/103: dread de/ff [0,4194304] 0 2024-09-18T21:12:42.990 INFO:tasks.workunit.client.1.smithi103.stdout:8/113: read d4/d26/f8 [1071080,73168] 0 2024-09-18T21:12:42.992 INFO:tasks.workunit.client.1.smithi103.stdout:9/109: chown d18/l1d 56 1 2024-09-18T21:12:42.992 INFO:tasks.workunit.client.1.smithi103.stdout:5/104: chown de/ff 4 1 2024-09-18T21:12:42.993 INFO:tasks.workunit.client.1.smithi103.stdout:0/149: rename d1/d5/f16 to d1/d5/de/d24/f32 0 2024-09-18T21:12:42.993 INFO:tasks.workunit.client.1.smithi103.stdout:9/110: dread - d18/d1f/f21 zero size 2024-09-18T21:12:42.993 INFO:tasks.workunit.client.0.smithi077.stdout:7/237: dread d12/f25 [0,4194304] 0 2024-09-18T21:12:42.994 INFO:tasks.workunit.client.1.smithi103.stdout:2/119: link c2 d3/d5/d25/c2e 0 2024-09-18T21:12:42.996 INFO:tasks.workunit.client.1.smithi103.stdout:0/150: rmdir d1/d5/de/d24 39 2024-09-18T21:12:42.997 INFO:tasks.workunit.client.1.smithi103.stdout:5/105: read f8 [1478442,91837] 0 2024-09-18T21:12:42.998 INFO:tasks.workunit.client.1.smithi103.stdout:0/151: chown d1/f12 0 1 2024-09-18T21:12:42.998 INFO:tasks.workunit.client.1.smithi103.stdout:5/106: fsync de/d14/f18 0 2024-09-18T21:12:42.999 INFO:tasks.workunit.client.0.smithi077.stdout:7/238: dwrite f5 [0,4194304] 0 2024-09-18T21:12:43.001 INFO:tasks.workunit.client.1.smithi103.stdout:8/114: getdents d4 0 2024-09-18T21:12:43.002 INFO:tasks.workunit.client.1.smithi103.stdout:3/98: dread d1/f13 [0,4194304] 0 2024-09-18T21:12:43.003 INFO:tasks.workunit.client.0.smithi077.stdout:7/239: dread d12/f45 [0,4194304] 0 2024-09-18T21:12:43.003 INFO:tasks.workunit.client.1.smithi103.stdout:5/107: link de/d14/d1a/l25 de/d14/d1a/l26 0 2024-09-18T21:12:43.004 INFO:tasks.workunit.client.0.smithi077.stdout:7/240: fdatasync d12/d31/f54 0 2024-09-18T21:12:43.008 INFO:tasks.workunit.client.0.smithi077.stdout:7/241: rename l7 to d12/d22/d59/l5b 0 2024-09-18T21:12:43.009 INFO:tasks.workunit.client.1.smithi103.stdout:3/99: link d1/l4 d1/da/df/l1b 0 2024-09-18T21:12:43.010 INFO:tasks.workunit.client.0.smithi077.stdout:7/242: creat d12/d31/d49/f5c x:0 0 0 2024-09-18T21:12:43.010 INFO:tasks.workunit.client.1.smithi103.stdout:1/108: fdatasync d0/d3/f20 0 2024-09-18T21:12:43.012 INFO:tasks.workunit.client.0.smithi077.stdout:7/243: mkdir d12/d22/d59/d5d 0 2024-09-18T21:12:43.014 INFO:tasks.workunit.client.1.smithi103.stdout:1/109: creat d0/d3/f29 x:0 0 0 2024-09-18T21:12:43.014 INFO:tasks.workunit.client.1.smithi103.stdout:5/108: dwrite de/f1c [4194304,4194304] 0 2024-09-18T21:12:43.015 INFO:tasks.workunit.client.1.smithi103.stdout:3/100: rename d1/c6 to d1/da/df/c1c 0 2024-09-18T21:12:43.016 INFO:tasks.workunit.client.0.smithi077.stdout:5/219: write d0/d6/dd/f11 [1230265,126990] 0 2024-09-18T21:12:43.016 INFO:tasks.workunit.client.1.smithi103.stdout:1/110: stat d0/d11/d16/d19/c1e 0 2024-09-18T21:12:43.019 INFO:tasks.workunit.client.1.smithi103.stdout:5/109: mkdir de/d1f/d27 0 2024-09-18T21:12:43.020 INFO:tasks.workunit.client.0.smithi077.stdout:7/244: dwrite d12/d22/f28 [0,4194304] 0 2024-09-18T21:12:43.024 INFO:tasks.workunit.client.1.smithi103.stdout:5/110: stat de/d11/d15 0 2024-09-18T21:12:43.024 INFO:tasks.workunit.client.1.smithi103.stdout:6/163: dread d2/d3/d8/f2a [0,4194304] 0 2024-09-18T21:12:43.024 INFO:tasks.workunit.client.0.smithi077.stdout:7/245: readlink d12/d31/d33/l42 0 2024-09-18T21:12:43.024 INFO:tasks.workunit.client.0.smithi077.stdout:7/246: stat d12/d22/d59/d5d 0 2024-09-18T21:12:43.025 INFO:tasks.workunit.client.0.smithi077.stdout:5/220: dwrite d0/d6/dd/f11 [0,4194304] 0 2024-09-18T21:12:43.026 INFO:tasks.workunit.client.1.smithi103.stdout:7/123: dwrite d1/df/f22 [0,4194304] 0 2024-09-18T21:12:43.026 INFO:tasks.workunit.client.1.smithi103.stdout:1/111: creat d0/d2/d9/d10/f2a x:0 0 0 2024-09-18T21:12:43.026 INFO:tasks.workunit.client.1.smithi103.stdout:4/88: dread d9/fa [0,4194304] 0 2024-09-18T21:12:43.026 INFO:tasks.workunit.client.0.smithi077.stdout:3/121: sync 2024-09-18T21:12:43.027 INFO:tasks.workunit.client.0.smithi077.stdout:5/221: truncate d0/d6/f3c 940878 0 2024-09-18T21:12:43.027 INFO:tasks.workunit.client.0.smithi077.stdout:7/247: unlink d12/d56/f38 0 2024-09-18T21:12:43.027 INFO:tasks.workunit.client.0.smithi077.stdout:3/122: fdatasync fa 0 2024-09-18T21:12:43.028 INFO:tasks.workunit.client.0.smithi077.stdout:7/248: write f1 [7969131,18271] 0 2024-09-18T21:12:43.029 INFO:tasks.workunit.client.1.smithi103.stdout:4/89: write d9/f19 [5323531,6882] 0 2024-09-18T21:12:43.030 INFO:tasks.workunit.client.1.smithi103.stdout:8/115: dread d4/de/f11 [0,4194304] 0 2024-09-18T21:12:43.031 INFO:tasks.workunit.client.1.smithi103.stdout:3/101: dread d1/da/df/f14 [4194304,4194304] 0 2024-09-18T21:12:43.032 INFO:tasks.workunit.client.1.smithi103.stdout:5/111: symlink de/d11/l28 0 2024-09-18T21:12:43.034 INFO:tasks.workunit.client.1.smithi103.stdout:7/124: creat d1/df/d1d/f26 x:0 0 0 2024-09-18T21:12:43.034 INFO:tasks.workunit.client.1.smithi103.stdout:8/116: stat d4/d26/ca 0 2024-09-18T21:12:43.035 INFO:tasks.workunit.client.0.smithi077.stdout:3/123: dread db/f1a [0,4194304] 0 2024-09-18T21:12:43.036 INFO:tasks.workunit.client.1.smithi103.stdout:7/125: write d1/df/d1d/f1e [563675,111742] 0 2024-09-18T21:12:43.036 INFO:tasks.workunit.client.0.smithi077.stdout:5/222: dwrite d0/d6/d3b/f4e [0,4194304] 0 2024-09-18T21:12:43.036 INFO:tasks.workunit.client.0.smithi077.stdout:3/124: chown db/d14/d22/c25 5451743 1 2024-09-18T21:12:43.037 INFO:tasks.workunit.client.0.smithi077.stdout:5/223: fdatasync d0/f37 0 2024-09-18T21:12:43.038 INFO:tasks.workunit.client.1.smithi103.stdout:1/112: mkdir d0/d2/d2b 0 2024-09-18T21:12:43.040 INFO:tasks.workunit.client.1.smithi103.stdout:6/164: mknod d2/c31 0 2024-09-18T21:12:43.042 INFO:tasks.workunit.client.1.smithi103.stdout:1/113: dread d0/ff [0,4194304] 0 2024-09-18T21:12:43.046 INFO:tasks.workunit.client.1.smithi103.stdout:2/120: truncate d3/f8 1677598 0 2024-09-18T21:12:43.047 INFO:tasks.workunit.client.1.smithi103.stdout:2/121: chown d3/l19 6460 1 2024-09-18T21:12:43.049 INFO:tasks.workunit.client.0.smithi077.stdout:5/224: symlink d0/d6/d3b/l59 0 2024-09-18T21:12:43.049 INFO:tasks.workunit.client.0.smithi077.stdout:5/225: chown d0/d36/d49 351509 1 2024-09-18T21:12:43.050 INFO:tasks.workunit.client.0.smithi077.stdout:5/226: read d0/d6/f3c [34421,78258] 0 2024-09-18T21:12:43.051 INFO:tasks.workunit.client.0.smithi077.stdout:7/249: creat d12/d22/f5e x:0 0 0 2024-09-18T21:12:43.052 INFO:tasks.workunit.client.1.smithi103.stdout:8/117: rmdir d4/de 39 2024-09-18T21:12:43.052 INFO:tasks.workunit.client.0.smithi077.stdout:5/227: chown d0/d6/dd/f24 1778111 1 2024-09-18T21:12:43.055 INFO:tasks.workunit.client.1.smithi103.stdout:7/126: creat d1/f27 x:0 0 0 2024-09-18T21:12:43.056 INFO:tasks.workunit.client.1.smithi103.stdout:7/127: write d1/f21 [470543,98919] 0 2024-09-18T21:12:43.057 INFO:tasks.workunit.client.1.smithi103.stdout:8/118: dwrite d4/d26/f1a [0,4194304] 0 2024-09-18T21:12:43.059 INFO:tasks.workunit.client.0.smithi077.stdout:7/250: dwrite d12/d31/f41 [4194304,4194304] 0 2024-09-18T21:12:43.060 INFO:tasks.workunit.client.0.smithi077.stdout:5/228: dwrite d0/d6/dd/f3a [0,4194304] 0 2024-09-18T21:12:43.067 INFO:tasks.workunit.client.0.smithi077.stdout:3/125: rename db/l1c to db/l26 0 2024-09-18T21:12:43.068 INFO:tasks.workunit.client.0.smithi077.stdout:3/126: write db/f24 [205594,25560] 0 2024-09-18T21:12:43.068 INFO:tasks.workunit.client.1.smithi103.stdout:2/122: mkdir d3/d5/d2f 0 2024-09-18T21:12:43.072 INFO:tasks.workunit.client.1.smithi103.stdout:4/90: link f5 d9/d1f/f20 0 2024-09-18T21:12:43.074 INFO:tasks.workunit.client.0.smithi077.stdout:7/251: symlink d12/d31/d33/d2a/l5f 0 2024-09-18T21:12:43.075 INFO:tasks.workunit.client.1.smithi103.stdout:9/111: write d18/f1a [179366,72292] 0 2024-09-18T21:12:43.076 INFO:tasks.workunit.client.0.smithi077.stdout:5/229: symlink d0/d36/d49/l5a 0 2024-09-18T21:12:43.077 INFO:tasks.workunit.client.0.smithi077.stdout:3/127: dwrite db/ff [0,4194304] 0 2024-09-18T21:12:43.077 INFO:tasks.workunit.client.1.smithi103.stdout:7/128: dread d1/fe [0,4194304] 0 2024-09-18T21:12:43.077 INFO:tasks.workunit.client.0.smithi077.stdout:7/252: truncate d12/d22/f5e 294349 0 2024-09-18T21:12:43.082 INFO:tasks.workunit.client.1.smithi103.stdout:8/119: fsync d4/d26/f1d 0 2024-09-18T21:12:43.084 INFO:tasks.workunit.client.0.smithi077.stdout:3/128: dwrite db/ff [0,4194304] 0 2024-09-18T21:12:43.087 INFO:tasks.workunit.client.1.smithi103.stdout:8/120: dread d4/d26/f8 [0,4194304] 0 2024-09-18T21:12:43.088 INFO:tasks.workunit.client.0.smithi077.stdout:3/129: mknod db/d14/d22/c27 0 2024-09-18T21:12:43.089 INFO:tasks.workunit.client.1.smithi103.stdout:4/91: mkdir d9/d1a/d21 0 2024-09-18T21:12:43.089 INFO:tasks.workunit.client.1.smithi103.stdout:4/92: chown d9/l17 20 1 2024-09-18T21:12:43.090 INFO:tasks.workunit.client.1.smithi103.stdout:4/93: chown d9/f11 128055 1 2024-09-18T21:12:43.091 INFO:tasks.workunit.client.1.smithi103.stdout:9/112: mkdir d18/d23 0 2024-09-18T21:12:43.092 INFO:tasks.workunit.client.1.smithi103.stdout:5/112: rmdir de/d1f/d27 0 2024-09-18T21:12:43.093 INFO:tasks.workunit.client.1.smithi103.stdout:7/129: mknod d1/c28 0 2024-09-18T21:12:43.094 INFO:tasks.workunit.client.1.smithi103.stdout:6/165: link d2/l25 d2/d3/d4/l32 0 2024-09-18T21:12:43.095 INFO:tasks.workunit.client.0.smithi077.stdout:3/130: creat db/f28 x:0 0 0 2024-09-18T21:12:43.097 INFO:tasks.workunit.client.1.smithi103.stdout:4/94: symlink d9/d1a/l22 0 2024-09-18T21:12:43.097 INFO:tasks.workunit.client.1.smithi103.stdout:8/121: chown d4/de/c27 90942 1 2024-09-18T21:12:43.097 INFO:tasks.workunit.client.1.smithi103.stdout:9/113: creat d18/f24 x:0 0 0 2024-09-18T21:12:43.098 INFO:tasks.workunit.client.1.smithi103.stdout:7/130: mkdir d1/df/d1d/d29 0 2024-09-18T21:12:43.099 INFO:tasks.workunit.client.0.smithi077.stdout:3/131: creat db/f29 x:0 0 0 2024-09-18T21:12:43.099 INFO:tasks.workunit.client.1.smithi103.stdout:0/152: dwrite d1/d5/de/d24/f32 [0,4194304] 0 2024-09-18T21:12:43.100 INFO:tasks.workunit.client.1.smithi103.stdout:9/114: write d18/d1f/f21 [555314,108402] 0 2024-09-18T21:12:43.100 INFO:tasks.workunit.client.1.smithi103.stdout:7/131: stat d1/df/f14 0 2024-09-18T21:12:43.101 INFO:tasks.workunit.client.1.smithi103.stdout:2/123: link d3/d5/l13 d3/d5/d2c/l30 0 2024-09-18T21:12:43.101 INFO:tasks.workunit.client.1.smithi103.stdout:9/115: truncate d18/f22 917444 0 2024-09-18T21:12:43.101 INFO:tasks.workunit.client.1.smithi103.stdout:6/166: symlink d2/d3/d4/l33 0 2024-09-18T21:12:43.102 INFO:tasks.workunit.client.1.smithi103.stdout:8/122: fdatasync d4/d26/f1a 0 2024-09-18T21:12:43.102 INFO:tasks.workunit.client.1.smithi103.stdout:0/153: creat d1/d9/f33 x:0 0 0 2024-09-18T21:12:43.103 INFO:tasks.workunit.client.1.smithi103.stdout:7/132: symlink d1/df/l2a 0 2024-09-18T21:12:43.104 INFO:tasks.workunit.client.1.smithi103.stdout:7/133: dread - d1/f27 zero size 2024-09-18T21:12:43.105 INFO:tasks.workunit.client.1.smithi103.stdout:9/116: creat d18/f25 x:0 0 0 2024-09-18T21:12:43.106 INFO:tasks.workunit.client.0.smithi077.stdout:3/132: dwrite fa [0,4194304] 0 2024-09-18T21:12:43.108 INFO:tasks.workunit.client.1.smithi103.stdout:8/123: dread d4/ff [0,4194304] 0 2024-09-18T21:12:43.108 INFO:tasks.workunit.client.1.smithi103.stdout:0/154: mkdir d1/d5/de/d19/d1e/d34 0 2024-09-18T21:12:43.110 INFO:tasks.workunit.client.1.smithi103.stdout:0/155: truncate d1/d9/d13/f1b 177683 0 2024-09-18T21:12:43.111 INFO:tasks.workunit.client.1.smithi103.stdout:7/134: unlink d1/df/d1d/d1f/f24 0 2024-09-18T21:12:43.111 INFO:tasks.workunit.client.1.smithi103.stdout:0/156: write d1/d9/f33 [562453,66631] 0 2024-09-18T21:12:43.112 INFO:tasks.workunit.client.1.smithi103.stdout:7/135: fdatasync d1/f13 0 2024-09-18T21:12:43.113 INFO:tasks.workunit.client.1.smithi103.stdout:6/167: creat d2/f34 x:0 0 0 2024-09-18T21:12:43.114 INFO:tasks.workunit.client.1.smithi103.stdout:8/124: symlink d4/de/l2b 0 2024-09-18T21:12:43.116 INFO:tasks.workunit.client.1.smithi103.stdout:0/157: symlink d1/d5/de/d24/l35 0 2024-09-18T21:12:43.120 INFO:tasks.workunit.client.1.smithi103.stdout:6/168: rename d2/d3/d4/l1b to d2/d24/l35 0 2024-09-18T21:12:43.121 INFO:tasks.workunit.client.1.smithi103.stdout:0/158: dread d1/d5/de/d19/d1e/f21 [0,4194304] 0 2024-09-18T21:12:43.121 INFO:tasks.workunit.client.1.smithi103.stdout:6/169: fdatasync d2/d3/d8/df/f17 0 2024-09-18T21:12:43.121 INFO:tasks.workunit.client.1.smithi103.stdout:8/125: mkdir d4/d2c 0 2024-09-18T21:12:43.123 INFO:tasks.workunit.client.1.smithi103.stdout:8/126: fsync d4/d26/fb 0 2024-09-18T21:12:43.125 INFO:tasks.workunit.client.1.smithi103.stdout:6/170: dread d2/f28 [0,4194304] 0 2024-09-18T21:12:43.125 INFO:tasks.workunit.client.1.smithi103.stdout:6/171: stat d2/d3/d8 0 2024-09-18T21:12:43.127 INFO:tasks.workunit.client.1.smithi103.stdout:8/127: dread d4/d26/f8 [0,4194304] 0 2024-09-18T21:12:43.127 INFO:tasks.workunit.client.0.smithi077.stdout:5/230: truncate d0/d6/dd/f11 2741092 0 2024-09-18T21:12:43.128 INFO:tasks.workunit.client.0.smithi077.stdout:7/253: dwrite d12/d31/d33/d2a/f4f [0,4194304] 0 2024-09-18T21:12:43.128 INFO:tasks.workunit.client.1.smithi103.stdout:8/128: read d4/de/f1e [3001210,28860] 0 2024-09-18T21:12:43.129 INFO:tasks.workunit.client.1.smithi103.stdout:8/129: chown d4/d26/c29 3121 1 2024-09-18T21:12:43.129 INFO:tasks.workunit.client.1.smithi103.stdout:5/113: rmdir de/d1f 39 2024-09-18T21:12:43.130 INFO:tasks.workunit.client.1.smithi103.stdout:6/172: mknod d2/c36 0 2024-09-18T21:12:43.131 INFO:tasks.workunit.client.1.smithi103.stdout:7/136: truncate d1/fe 5761485 0 2024-09-18T21:12:43.132 INFO:tasks.workunit.client.0.smithi077.stdout:5/231: symlink d0/d43/l5b 0 2024-09-18T21:12:43.133 INFO:tasks.workunit.client.0.smithi077.stdout:7/254: dread d12/d22/f5e [0,4194304] 0 2024-09-18T21:12:43.135 INFO:tasks.workunit.client.0.smithi077.stdout:5/232: mkdir d0/df/d10/d5c 0 2024-09-18T21:12:43.137 INFO:tasks.workunit.client.1.smithi103.stdout:5/114: dwrite de/d11/f12 [0,4194304] 0 2024-09-18T21:12:43.138 INFO:tasks.workunit.client.1.smithi103.stdout:8/130: mkdir d4/d2d 0 2024-09-18T21:12:43.139 INFO:tasks.workunit.client.0.smithi077.stdout:5/233: mkdir d0/d6/dd/d5d 0 2024-09-18T21:12:43.141 INFO:tasks.workunit.client.1.smithi103.stdout:7/137: rename d1/df/f25 to d1/df/d1d/f2b 0 2024-09-18T21:12:43.142 INFO:tasks.workunit.client.0.smithi077.stdout:9/106: sync 2024-09-18T21:12:43.142 INFO:tasks.workunit.client.0.smithi077.stdout:9/107: readlink d1/dd/le 0 2024-09-18T21:12:43.143 INFO:tasks.workunit.client.1.smithi103.stdout:7/138: stat d1/df/f20 0 2024-09-18T21:12:43.143 INFO:tasks.workunit.client.1.smithi103.stdout:4/95: write f6 [978962,117823] 0 2024-09-18T21:12:43.144 INFO:tasks.workunit.client.0.smithi077.stdout:9/108: write d1/dd/f14 [99404,121984] 0 2024-09-18T21:12:43.145 INFO:tasks.workunit.client.1.smithi103.stdout:9/117: getdents d18 0 2024-09-18T21:12:43.146 INFO:tasks.workunit.client.0.smithi077.stdout:3/133: truncate f4 1957454 0 2024-09-18T21:12:43.147 INFO:tasks.workunit.client.1.smithi103.stdout:8/131: dwrite d4/d26/f25 [0,4194304] 0 2024-09-18T21:12:43.148 INFO:tasks.workunit.client.1.smithi103.stdout:5/115: write de/d1f/f24 [373929,54724] 0 2024-09-18T21:12:43.148 INFO:tasks.workunit.client.0.smithi077.stdout:5/234: symlink d0/df/d10/d5c/l5e 0 2024-09-18T21:12:43.151 INFO:tasks.workunit.client.0.smithi077.stdout:7/255: getdents d12/d31/d49 0 2024-09-18T21:12:43.153 INFO:tasks.workunit.client.1.smithi103.stdout:7/139: mknod d1/c2c 0 2024-09-18T21:12:43.154 INFO:tasks.workunit.client.1.smithi103.stdout:4/96: creat d9/f23 x:0 0 0 2024-09-18T21:12:43.155 INFO:tasks.workunit.client.0.smithi077.stdout:5/235: creat d0/df/f5f x:0 0 0 2024-09-18T21:12:43.158 INFO:tasks.workunit.client.0.smithi077.stdout:9/109: symlink d1/l22 0 2024-09-18T21:12:43.159 INFO:tasks.workunit.client.1.smithi103.stdout:9/118: rename d18/l19 to d18/d23/l26 0 2024-09-18T21:12:43.159 INFO:tasks.workunit.client.1.smithi103.stdout:9/119: fdatasync d18/f1a 0 2024-09-18T21:12:43.160 INFO:tasks.workunit.client.1.smithi103.stdout:9/120: fsync f1 0 2024-09-18T21:12:43.161 INFO:tasks.workunit.client.0.smithi077.stdout:7/256: write d12/d22/d39/f57 [76829,83597] 0 2024-09-18T21:12:43.163 INFO:tasks.workunit.client.1.smithi103.stdout:5/116: creat de/d11/f29 x:0 0 0 2024-09-18T21:12:43.165 INFO:tasks.workunit.client.1.smithi103.stdout:7/140: creat d1/df/d1d/d1f/f2d x:0 0 0 2024-09-18T21:12:43.166 INFO:tasks.workunit.client.0.smithi077.stdout:7/257: symlink d12/d31/d49/l60 0 2024-09-18T21:12:43.167 INFO:tasks.workunit.client.1.smithi103.stdout:6/173: link d2/d3/l7 d2/l37 0 2024-09-18T21:12:43.168 INFO:tasks.workunit.client.0.smithi077.stdout:3/134: rename db/d14/d22/c27 to db/c2a 0 2024-09-18T21:12:43.169 INFO:tasks.workunit.client.0.smithi077.stdout:3/135: write db/d14/f1d [749509,102729] 0 2024-09-18T21:12:43.170 INFO:tasks.workunit.client.0.smithi077.stdout:9/110: link d1/dd/d1a/f1b d1/dd/d1a/f23 0 2024-09-18T21:12:43.173 INFO:tasks.workunit.client.1.smithi103.stdout:9/121: symlink d18/l27 0 2024-09-18T21:12:43.174 INFO:tasks.workunit.client.0.smithi077.stdout:9/111: dread d1/df/f18 [0,4194304] 0 2024-09-18T21:12:43.174 INFO:tasks.workunit.client.1.smithi103.stdout:9/122: write ff [1677660,114003] 0 2024-09-18T21:12:43.174 INFO:tasks.workunit.client.0.smithi077.stdout:9/112: fsync d1/df/f18 0 2024-09-18T21:12:43.175 INFO:tasks.workunit.client.1.smithi103.stdout:8/132: symlink d4/d2d/l2e 0 2024-09-18T21:12:43.176 INFO:tasks.workunit.client.0.smithi077.stdout:3/136: symlink db/d14/d22/l2b 0 2024-09-18T21:12:43.177 INFO:tasks.workunit.client.1.smithi103.stdout:5/117: rmdir de 39 2024-09-18T21:12:43.180 INFO:tasks.workunit.client.1.smithi103.stdout:7/141: mkdir d1/df/d1d/d1f/d2e 0 2024-09-18T21:12:43.181 INFO:tasks.workunit.client.1.smithi103.stdout:6/174: mkdir d2/d24/d38 0 2024-09-18T21:12:43.184 INFO:tasks.workunit.client.0.smithi077.stdout:3/137: creat db/d14/d22/f2c x:0 0 0 2024-09-18T21:12:43.186 INFO:tasks.workunit.client.1.smithi103.stdout:8/133: mkdir d4/de/d2f 0 2024-09-18T21:12:43.187 INFO:tasks.workunit.client.0.smithi077.stdout:7/258: creat d12/d31/f61 x:0 0 0 2024-09-18T21:12:43.188 INFO:tasks.workunit.client.0.smithi077.stdout:9/113: getdents d1/dd/d11/d1c 0 2024-09-18T21:12:43.190 INFO:tasks.workunit.client.1.smithi103.stdout:2/124: dwrite d3/f8 [0,4194304] 0 2024-09-18T21:12:43.191 INFO:tasks.workunit.client.1.smithi103.stdout:2/125: chown d3/d5/l2b 0 1 2024-09-18T21:12:43.192 INFO:tasks.workunit.client.1.smithi103.stdout:8/134: dread d4/de/f16 [0,4194304] 0 2024-09-18T21:12:43.193 INFO:tasks.workunit.client.1.smithi103.stdout:8/135: chown d4/c28 2509 1 2024-09-18T21:12:43.195 INFO:tasks.workunit.client.0.smithi077.stdout:3/138: mknod db/c2d 0 2024-09-18T21:12:43.198 INFO:tasks.workunit.client.1.smithi103.stdout:5/118: creat de/d1f/f2a x:0 0 0 2024-09-18T21:12:43.202 INFO:tasks.workunit.client.1.smithi103.stdout:2/126: creat d3/d5/d2c/f31 x:0 0 0 2024-09-18T21:12:43.202 INFO:tasks.workunit.client.1.smithi103.stdout:6/175: getdents d2/d3/d8/df 0 2024-09-18T21:12:43.203 INFO:tasks.workunit.client.1.smithi103.stdout:5/119: creat de/f2b x:0 0 0 2024-09-18T21:12:43.204 INFO:tasks.workunit.client.1.smithi103.stdout:6/176: chown d2/d3/d8/df/c2c 0 1 2024-09-18T21:12:43.204 INFO:tasks.workunit.client.1.smithi103.stdout:5/120: fsync de/d11/f17 0 2024-09-18T21:12:43.204 INFO:tasks.workunit.client.1.smithi103.stdout:2/127: mkdir d3/d5/d2f/d32 0 2024-09-18T21:12:43.208 INFO:tasks.workunit.client.1.smithi103.stdout:2/128: rename d3/d5/f6 to d3/d5/d25/f33 0 2024-09-18T21:12:43.208 INFO:tasks.workunit.client.1.smithi103.stdout:5/121: getdents de/d11 0 2024-09-18T21:12:43.209 INFO:tasks.workunit.client.1.smithi103.stdout:2/129: chown d3/d5/d2f/d32 1 1 2024-09-18T21:12:43.211 INFO:tasks.workunit.client.1.smithi103.stdout:5/122: creat de/d14/d1a/f2c x:0 0 0 2024-09-18T21:12:43.211 INFO:tasks.workunit.client.1.smithi103.stdout:6/177: dwrite d2/d3/d8/f20 [0,4194304] 0 2024-09-18T21:12:43.211 INFO:tasks.workunit.client.1.smithi103.stdout:2/130: readlink d3/d5/d2c/l30 0 2024-09-18T21:12:43.214 INFO:tasks.workunit.client.1.smithi103.stdout:5/123: mkdir de/d2d 0 2024-09-18T21:12:43.218 INFO:tasks.workunit.client.1.smithi103.stdout:7/142: rmdir d1/df/d1d/d1f 39 2024-09-18T21:12:43.220 INFO:tasks.workunit.client.1.smithi103.stdout:7/143: truncate d1/f17 4566477 0 2024-09-18T21:12:43.221 INFO:tasks.workunit.client.1.smithi103.stdout:5/124: dwrite de/f1c [4194304,4194304] 0 2024-09-18T21:12:43.222 INFO:tasks.workunit.client.1.smithi103.stdout:8/136: getdents d4/de 0 2024-09-18T21:12:43.223 INFO:tasks.workunit.client.0.smithi077.stdout:7/259: getdents d12/d31 0 2024-09-18T21:12:43.224 INFO:tasks.workunit.client.1.smithi103.stdout:8/137: symlink d4/d26/l30 0 2024-09-18T21:12:43.225 INFO:tasks.workunit.client.1.smithi103.stdout:9/123: truncate f12 2862582 0 2024-09-18T21:12:43.226 INFO:tasks.workunit.client.0.smithi077.stdout:7/260: mkdir d12/d22/d59/d5d/d62 0 2024-09-18T21:12:43.228 INFO:tasks.workunit.client.1.smithi103.stdout:8/138: creat d4/d2c/f31 x:0 0 0 2024-09-18T21:12:43.228 INFO:tasks.workunit.client.0.smithi077.stdout:7/261: creat d12/d22/f63 x:0 0 0 2024-09-18T21:12:43.229 INFO:tasks.workunit.client.1.smithi103.stdout:7/144: dwrite d1/f12 [4194304,4194304] 0 2024-09-18T21:12:43.229 INFO:tasks.workunit.client.1.smithi103.stdout:7/145: readlink d1/l1a 0 2024-09-18T21:12:43.230 INFO:tasks.workunit.client.1.smithi103.stdout:7/146: dread - d1/f1b zero size 2024-09-18T21:12:43.231 INFO:tasks.workunit.client.1.smithi103.stdout:5/125: dwrite de/ff [0,4194304] 0 2024-09-18T21:12:43.231 INFO:tasks.workunit.client.1.smithi103.stdout:8/139: rename d4/d2d/l2e to d4/de/l32 0 2024-09-18T21:12:43.232 INFO:tasks.workunit.client.1.smithi103.stdout:7/147: write d1/df/f14 [501755,96975] 0 2024-09-18T21:12:43.233 INFO:tasks.workunit.client.1.smithi103.stdout:5/126: creat de/d11/d15/f2e x:0 0 0 2024-09-18T21:12:43.233 INFO:tasks.workunit.client.1.smithi103.stdout:7/148: write d1/f13 [7177048,85870] 0 2024-09-18T21:12:43.233 INFO:tasks.workunit.client.1.smithi103.stdout:8/140: write d4/de/f11 [6275651,63722] 0 2024-09-18T21:12:43.235 INFO:tasks.workunit.client.1.smithi103.stdout:5/127: creat de/d11/f2f x:0 0 0 2024-09-18T21:12:43.238 INFO:tasks.workunit.client.1.smithi103.stdout:8/141: unlink d4/d26/l7 0 2024-09-18T21:12:43.238 INFO:tasks.workunit.client.1.smithi103.stdout:7/149: mkdir d1/df/d1d/d29/d2f 0 2024-09-18T21:12:43.239 INFO:tasks.workunit.client.1.smithi103.stdout:7/150: rename d1 to d1/d30 22 2024-09-18T21:12:43.241 INFO:tasks.workunit.client.1.smithi103.stdout:7/151: write d1/f12 [4077791,60594] 0 2024-09-18T21:12:43.242 INFO:tasks.workunit.client.1.smithi103.stdout:5/128: dwrite de/d11/f17 [0,4194304] 0 2024-09-18T21:12:43.244 INFO:tasks.workunit.client.1.smithi103.stdout:5/129: dread - de/d14/f22 zero size 2024-09-18T21:12:43.247 INFO:tasks.workunit.client.1.smithi103.stdout:8/142: dwrite d4/de/f11 [4194304,4194304] 0 2024-09-18T21:12:43.249 INFO:tasks.workunit.client.1.smithi103.stdout:5/130: link ca de/d2d/c30 0 2024-09-18T21:12:43.253 INFO:tasks.workunit.client.1.smithi103.stdout:7/152: dwrite d1/f27 [0,4194304] 0 2024-09-18T21:12:43.256 INFO:tasks.workunit.client.1.smithi103.stdout:7/153: write d1/df/d1d/f26 [557486,44994] 0 2024-09-18T21:12:43.266 INFO:tasks.workunit.client.0.smithi077.stdout:9/114: write d1/dd/d1a/f23 [688016,108074] 0 2024-09-18T21:12:43.267 INFO:tasks.workunit.client.0.smithi077.stdout:3/139: rmdir db 39 2024-09-18T21:12:43.269 INFO:tasks.workunit.client.1.smithi103.stdout:7/154: dwrite d1/f27 [0,4194304] 0 2024-09-18T21:12:43.272 INFO:tasks.workunit.client.1.smithi103.stdout:8/143: rmdir d4/de/d2f 0 2024-09-18T21:12:43.273 INFO:tasks.workunit.client.0.smithi077.stdout:3/140: creat db/f2e x:0 0 0 2024-09-18T21:12:43.274 INFO:tasks.workunit.client.1.smithi103.stdout:2/131: getdents d3/d5/d2f 0 2024-09-18T21:12:43.275 INFO:tasks.workunit.client.1.smithi103.stdout:2/132: fsync d3/d5/f28 0 2024-09-18T21:12:43.276 INFO:tasks.workunit.client.0.smithi077.stdout:3/141: unlink db/f19 0 2024-09-18T21:12:43.277 INFO:tasks.workunit.client.1.smithi103.stdout:2/133: stat d3/f22 0 2024-09-18T21:12:43.277 INFO:tasks.workunit.client.1.smithi103.stdout:5/131: creat de/f31 x:0 0 0 2024-09-18T21:12:43.280 INFO:tasks.workunit.client.1.smithi103.stdout:8/144: creat d4/d2d/f33 x:0 0 0 2024-09-18T21:12:43.282 INFO:tasks.workunit.client.0.smithi077.stdout:3/142: read f5 [612399,96226] 0 2024-09-18T21:12:43.282 INFO:tasks.workunit.client.0.smithi077.stdout:3/143: truncate fa 4979501 0 2024-09-18T21:12:43.283 INFO:tasks.workunit.client.1.smithi103.stdout:5/132: stat de/ff 0 2024-09-18T21:12:43.284 INFO:tasks.workunit.client.1.smithi103.stdout:5/133: stat lc 0 2024-09-18T21:12:43.284 INFO:tasks.workunit.client.1.smithi103.stdout:2/134: creat d3/d5/d2f/f34 x:0 0 0 2024-09-18T21:12:43.285 INFO:tasks.workunit.client.1.smithi103.stdout:8/145: symlink d4/d26/l34 0 2024-09-18T21:12:43.288 INFO:tasks.workunit.client.1.smithi103.stdout:2/135: truncate d3/d5/d2c/f31 4657 0 2024-09-18T21:12:43.289 INFO:tasks.workunit.client.1.smithi103.stdout:7/155: dwrite d1/df/d1d/d1f/f2d [0,4194304] 0 2024-09-18T21:12:43.289 INFO:tasks.workunit.client.1.smithi103.stdout:8/146: rename d4/l9 to d4/de/l35 0 2024-09-18T21:12:43.292 INFO:tasks.workunit.client.1.smithi103.stdout:2/136: creat d3/d5/f35 x:0 0 0 2024-09-18T21:12:43.294 INFO:tasks.workunit.client.1.smithi103.stdout:2/137: creat d3/d5/f36 x:0 0 0 2024-09-18T21:12:43.299 INFO:tasks.workunit.client.1.smithi103.stdout:7/156: dwrite d1/df/f18 [0,4194304] 0 2024-09-18T21:12:43.301 INFO:tasks.workunit.client.1.smithi103.stdout:7/157: readlink l0 0 2024-09-18T21:12:43.307 INFO:tasks.workunit.client.1.smithi103.stdout:6/178: dread d2/f22 [0,4194304] 0 2024-09-18T21:12:43.309 INFO:tasks.workunit.client.1.smithi103.stdout:2/138: dwrite d3/d5/d25/f29 [0,4194304] 0 2024-09-18T21:12:43.310 INFO:tasks.workunit.client.1.smithi103.stdout:7/158: dread d1/df/d1d/d1f/f2d [0,4194304] 0 2024-09-18T21:12:43.311 INFO:tasks.workunit.client.1.smithi103.stdout:9/124: dread f1 [0,4194304] 0 2024-09-18T21:12:43.311 INFO:tasks.workunit.client.1.smithi103.stdout:7/159: stat d1/c2c 0 2024-09-18T21:12:43.312 INFO:tasks.workunit.client.1.smithi103.stdout:6/179: mknod d2/d3/d4/c39 0 2024-09-18T21:12:43.313 INFO:tasks.workunit.client.1.smithi103.stdout:3/102: sync 2024-09-18T21:12:43.313 INFO:tasks.workunit.client.1.smithi103.stdout:9/125: truncate d18/f24 311839 0 2024-09-18T21:12:43.317 INFO:tasks.workunit.client.1.smithi103.stdout:7/160: rename d1/l3 to d1/df/l31 0 2024-09-18T21:12:43.318 INFO:tasks.workunit.client.1.smithi103.stdout:6/180: mknod d2/d3/d8/c3a 0 2024-09-18T21:12:43.320 INFO:tasks.workunit.client.1.smithi103.stdout:3/103: symlink d1/da/l1d 0 2024-09-18T21:12:43.321 INFO:tasks.workunit.client.1.smithi103.stdout:3/104: truncate d1/d2/f8 5105891 0 2024-09-18T21:12:43.324 INFO:tasks.workunit.client.1.smithi103.stdout:7/161: fsync d1/fe 0 2024-09-18T21:12:43.325 INFO:tasks.workunit.client.1.smithi103.stdout:3/105: fsync d1/f13 0 2024-09-18T21:12:43.326 INFO:tasks.workunit.client.1.smithi103.stdout:5/134: dread f8 [0,4194304] 0 2024-09-18T21:12:43.327 INFO:tasks.workunit.client.1.smithi103.stdout:7/162: write d1/fa [1103540,57776] 0 2024-09-18T21:12:43.327 INFO:tasks.workunit.client.0.smithi077.stdout:3/144: write f5 [444249,121277] 0 2024-09-18T21:12:43.329 INFO:tasks.workunit.client.0.smithi077.stdout:9/115: dwrite d1/fb [0,4194304] 0 2024-09-18T21:12:43.329 INFO:tasks.workunit.client.1.smithi103.stdout:6/181: dwrite d2/f34 [0,4194304] 0 2024-09-18T21:12:43.330 INFO:tasks.workunit.client.0.smithi077.stdout:4/123: sync 2024-09-18T21:12:43.331 INFO:tasks.workunit.client.0.smithi077.stdout:6/200: sync 2024-09-18T21:12:43.331 INFO:tasks.workunit.client.0.smithi077.stdout:0/227: sync 2024-09-18T21:12:43.331 INFO:tasks.workunit.client.0.smithi077.stdout:1/130: sync 2024-09-18T21:12:43.331 INFO:tasks.workunit.client.0.smithi077.stdout:2/159: sync 2024-09-18T21:12:43.331 INFO:tasks.workunit.client.0.smithi077.stdout:8/128: sync 2024-09-18T21:12:43.334 INFO:tasks.workunit.client.0.smithi077.stdout:4/124: write d3/d7/f1a [594375,77501] 0 2024-09-18T21:12:43.336 INFO:tasks.workunit.client.1.smithi103.stdout:2/139: dread d3/f21 [0,4194304] 0 2024-09-18T21:12:43.337 INFO:tasks.workunit.client.0.smithi077.stdout:3/145: rename db/d14/f1e to db/d14/d22/f2f 0 2024-09-18T21:12:43.338 INFO:tasks.workunit.client.0.smithi077.stdout:3/146: write fa [4189269,3485] 0 2024-09-18T21:12:43.338 INFO:tasks.workunit.client.1.smithi103.stdout:2/140: fsync d3/d5/d25/f29 0 2024-09-18T21:12:43.338 INFO:tasks.workunit.client.1.smithi103.stdout:5/135: creat de/d14/f32 x:0 0 0 2024-09-18T21:12:43.339 INFO:tasks.workunit.client.1.smithi103.stdout:8/147: truncate d4/d26/f25 1728233 0 2024-09-18T21:12:43.340 INFO:tasks.workunit.client.1.smithi103.stdout:5/136: write de/d14/f22 [476799,102310] 0 2024-09-18T21:12:43.342 INFO:tasks.workunit.client.1.smithi103.stdout:7/163: mknod d1/df/c32 0 2024-09-18T21:12:43.342 INFO:tasks.workunit.client.1.smithi103.stdout:5/137: chown de/d11/f17 2061883 1 2024-09-18T21:12:43.342 INFO:tasks.workunit.client.1.smithi103.stdout:5/138: dread - de/d14/d1a/f2c zero size 2024-09-18T21:12:43.343 INFO:tasks.workunit.client.0.smithi077.stdout:2/160: stat d1/f1d 0 2024-09-18T21:12:43.343 INFO:tasks.workunit.client.1.smithi103.stdout:7/164: fdatasync d1/df/f20 0 2024-09-18T21:12:43.344 INFO:tasks.workunit.client.1.smithi103.stdout:6/182: chown d2/l25 1 1 2024-09-18T21:12:43.344 INFO:tasks.workunit.client.1.smithi103.stdout:5/139: write de/d11/f29 [708504,24143] 0 2024-09-18T21:12:43.345 INFO:tasks.workunit.client.1.smithi103.stdout:5/140: dread - de/d1f/f2a zero size 2024-09-18T21:12:43.347 INFO:tasks.workunit.client.0.smithi077.stdout:9/116: dwrite d1/df/f1e [0,4194304] 0 2024-09-18T21:12:43.348 INFO:tasks.workunit.client.0.smithi077.stdout:1/131: creat d3/d8/d13/f2b x:0 0 0 2024-09-18T21:12:43.350 INFO:tasks.workunit.client.1.smithi103.stdout:9/126: truncate f4 2651476 0 2024-09-18T21:12:43.351 INFO:tasks.workunit.client.1.smithi103.stdout:9/127: chown d18/f20 6813 1 2024-09-18T21:12:43.351 INFO:tasks.workunit.client.1.smithi103.stdout:8/148: creat d4/d2c/f36 x:0 0 0 2024-09-18T21:12:43.353 INFO:tasks.workunit.client.1.smithi103.stdout:2/141: creat d3/d5/d25/f37 x:0 0 0 2024-09-18T21:12:43.354 INFO:tasks.workunit.client.0.smithi077.stdout:6/201: symlink d7/df/d11/d1d/l48 0 2024-09-18T21:12:43.356 INFO:tasks.workunit.client.0.smithi077.stdout:0/228: dread d8/d1a/d39/d3b/f44 [0,4194304] 0 2024-09-18T21:12:43.357 INFO:tasks.workunit.client.0.smithi077.stdout:4/125: creat d3/f26 x:0 0 0 2024-09-18T21:12:43.358 INFO:tasks.workunit.client.1.smithi103.stdout:7/165: write d1/df/d1d/f2b [27645,118471] 0 2024-09-18T21:12:43.361 INFO:tasks.workunit.client.0.smithi077.stdout:6/202: dread d7/f2c [0,4194304] 0 2024-09-18T21:12:43.363 INFO:tasks.workunit.client.0.smithi077.stdout:3/147: rename db/f24 to db/d14/d22/f30 0 2024-09-18T21:12:43.364 INFO:tasks.workunit.client.0.smithi077.stdout:4/126: dwrite d3/dc/f16 [0,4194304] 0 2024-09-18T21:12:43.365 INFO:tasks.workunit.client.1.smithi103.stdout:5/141: rename de/d14/d1a to de/d14/d33 0 2024-09-18T21:12:43.366 INFO:tasks.workunit.client.0.smithi077.stdout:2/161: symlink d1/d20/l32 0 2024-09-18T21:12:43.370 INFO:tasks.workunit.client.1.smithi103.stdout:9/128: stat d18/d23/l26 0 2024-09-18T21:12:43.372 INFO:tasks.workunit.client.0.smithi077.stdout:3/148: dwrite db/d14/d22/f2c [0,4194304] 0 2024-09-18T21:12:43.372 INFO:tasks.workunit.client.1.smithi103.stdout:3/106: dwrite d1/fc [0,4194304] 0 2024-09-18T21:12:43.373 INFO:tasks.workunit.client.1.smithi103.stdout:8/149: write d4/ff [3546133,3508] 0 2024-09-18T21:12:43.375 INFO:tasks.workunit.client.1.smithi103.stdout:3/107: dread d1/f13 [0,4194304] 0 2024-09-18T21:12:43.376 INFO:tasks.workunit.client.1.smithi103.stdout:6/183: getdents d2/d3/d8/df 0 2024-09-18T21:12:43.377 INFO:tasks.workunit.client.0.smithi077.stdout:0/229: write d8/f13 [2200082,71304] 0 2024-09-18T21:12:43.378 INFO:tasks.workunit.client.1.smithi103.stdout:6/184: dread - d2/d3/d4/f2e zero size 2024-09-18T21:12:43.380 INFO:tasks.workunit.client.1.smithi103.stdout:9/129: dwrite f8 [0,4194304] 0 2024-09-18T21:12:43.381 INFO:tasks.workunit.client.1.smithi103.stdout:0/159: sync 2024-09-18T21:12:43.381 INFO:tasks.workunit.client.1.smithi103.stdout:1/114: sync 2024-09-18T21:12:43.381 INFO:tasks.workunit.client.1.smithi103.stdout:4/97: sync 2024-09-18T21:12:43.381 INFO:tasks.workunit.client.1.smithi103.stdout:9/130: readlink d18/l1d 0 2024-09-18T21:12:43.382 INFO:tasks.workunit.client.1.smithi103.stdout:0/160: fsync d1/d5/fc 0 2024-09-18T21:12:43.383 INFO:tasks.workunit.client.1.smithi103.stdout:2/142: link d3/d5/f36 d3/d5/f38 0 2024-09-18T21:12:43.385 INFO:tasks.workunit.client.1.smithi103.stdout:7/166: mkdir d1/df/d1d/d29/d2f/d33 0 2024-09-18T21:12:43.387 INFO:tasks.workunit.client.1.smithi103.stdout:8/150: creat d4/d2c/f37 x:0 0 0 2024-09-18T21:12:43.388 INFO:tasks.workunit.client.1.smithi103.stdout:3/108: rmdir d1/da 39 2024-09-18T21:12:43.388 INFO:tasks.workunit.client.1.smithi103.stdout:2/143: read - d3/d5/d2f/f34 zero size 2024-09-18T21:12:43.389 INFO:tasks.workunit.client.1.smithi103.stdout:5/142: rename de/d14/d33/l1e to de/d1f/l34 0 2024-09-18T21:12:43.391 INFO:tasks.workunit.client.0.smithi077.stdout:3/149: mknod db/d14/c31 0 2024-09-18T21:12:43.392 INFO:tasks.workunit.client.0.smithi077.stdout:3/150: write f4 [811880,120446] 0 2024-09-18T21:12:43.392 INFO:tasks.workunit.client.0.smithi077.stdout:4/127: fsync d3/dc/f16 0 2024-09-18T21:12:43.393 INFO:tasks.workunit.client.1.smithi103.stdout:2/144: write d3/d5/fe [4128463,2359] 0 2024-09-18T21:12:43.393 INFO:tasks.workunit.client.0.smithi077.stdout:4/128: chown d3/d7/ce 3 1 2024-09-18T21:12:43.393 INFO:tasks.workunit.client.0.smithi077.stdout:4/129: chown d3/d17 127 1 2024-09-18T21:12:43.394 INFO:tasks.workunit.client.1.smithi103.stdout:1/115: mknod d0/d2/d9/c2c 0 2024-09-18T21:12:43.395 INFO:tasks.workunit.client.0.smithi077.stdout:0/230: mknod d8/d1a/d39/c4c 0 2024-09-18T21:12:43.396 INFO:tasks.workunit.client.0.smithi077.stdout:0/231: write d8/d26/f28 [1270623,88236] 0 2024-09-18T21:12:43.397 INFO:tasks.workunit.client.1.smithi103.stdout:9/131: dwrite f8 [0,4194304] 0 2024-09-18T21:12:43.397 INFO:tasks.workunit.client.1.smithi103.stdout:6/185: getdents d2/d24/d38 0 2024-09-18T21:12:43.397 INFO:tasks.workunit.client.0.smithi077.stdout:0/232: chown d8/d37/f48 907 1 2024-09-18T21:12:43.400 INFO:tasks.workunit.client.1.smithi103.stdout:4/98: rename d9/f19 to d9/d1a/f24 0 2024-09-18T21:12:43.401 INFO:tasks.workunit.client.0.smithi077.stdout:3/151: mkdir db/d14/d32 0 2024-09-18T21:12:43.402 INFO:tasks.workunit.client.1.smithi103.stdout:5/143: mknod de/d1f/c35 0 2024-09-18T21:12:43.402 INFO:tasks.workunit.client.1.smithi103.stdout:5/144: stat c4 0 2024-09-18T21:12:43.403 INFO:tasks.workunit.client.0.smithi077.stdout:4/130: rename d3/dc/f25 to d3/dc/d20/f27 0 2024-09-18T21:12:43.403 INFO:tasks.workunit.client.0.smithi077.stdout:4/131: chown d3 56 1 2024-09-18T21:12:43.404 INFO:tasks.workunit.client.1.smithi103.stdout:0/161: truncate d1/f18 1116885 0 2024-09-18T21:12:43.405 INFO:tasks.workunit.client.1.smithi103.stdout:2/145: mknod d3/d5/d25/c39 0 2024-09-18T21:12:43.406 INFO:tasks.workunit.client.1.smithi103.stdout:5/145: read de/d11/f19 [1385377,25085] 0 2024-09-18T21:12:43.406 INFO:tasks.workunit.client.0.smithi077.stdout:0/233: dread d8/d26/f1b [0,4194304] 0 2024-09-18T21:12:43.407 INFO:tasks.workunit.client.0.smithi077.stdout:2/162: link d1/d4/d9/d24/c31 d1/d20/c33 0 2024-09-18T21:12:43.407 INFO:tasks.workunit.client.1.smithi103.stdout:7/167: symlink d1/df/d1d/d1f/d2e/l34 0 2024-09-18T21:12:43.407 INFO:tasks.workunit.client.1.smithi103.stdout:8/151: dwrite d4/ff [0,4194304] 0 2024-09-18T21:12:43.407 INFO:tasks.workunit.client.1.smithi103.stdout:1/116: dread d0/d2/d9/dc/f22 [0,4194304] 0 2024-09-18T21:12:43.408 INFO:tasks.workunit.client.0.smithi077.stdout:8/129: link d2/lb d2/d5/d6/d22/l2f 0 2024-09-18T21:12:43.408 INFO:tasks.workunit.client.0.smithi077.stdout:8/130: fdatasync f1 0 2024-09-18T21:12:43.409 INFO:tasks.workunit.client.1.smithi103.stdout:7/168: chown d1/cd 206 1 2024-09-18T21:12:43.411 INFO:tasks.workunit.client.1.smithi103.stdout:6/186: creat d2/d24/f3b x:0 0 0 2024-09-18T21:12:43.413 INFO:tasks.workunit.client.1.smithi103.stdout:4/99: creat d9/f25 x:0 0 0 2024-09-18T21:12:43.413 INFO:tasks.workunit.client.0.smithi077.stdout:3/152: unlink db/d14/d22/f2c 0 2024-09-18T21:12:43.414 INFO:tasks.workunit.client.0.smithi077.stdout:4/132: unlink d3/d7/c19 0 2024-09-18T21:12:43.415 INFO:tasks.workunit.client.1.smithi103.stdout:4/100: dread - d9/f23 zero size 2024-09-18T21:12:43.416 INFO:tasks.workunit.client.0.smithi077.stdout:6/203: getdents d7/df/d11 0 2024-09-18T21:12:43.416 INFO:tasks.workunit.client.0.smithi077.stdout:6/204: fsync d7/f2d 0 2024-09-18T21:12:43.417 INFO:tasks.workunit.client.1.smithi103.stdout:6/187: readlink d2/d3/d4/l32 0 2024-09-18T21:12:43.417 INFO:tasks.workunit.client.1.smithi103.stdout:9/132: dwrite f17 [0,4194304] 0 2024-09-18T21:12:43.418 INFO:tasks.workunit.client.0.smithi077.stdout:9/117: truncate d1/fb 2713178 0 2024-09-18T21:12:43.419 INFO:tasks.workunit.client.0.smithi077.stdout:9/118: write d1/dd/d1a/f1b [1667946,93474] 0 2024-09-18T21:12:43.420 INFO:tasks.workunit.client.0.smithi077.stdout:9/119: fdatasync d1/df/f1e 0 2024-09-18T21:12:43.420 INFO:tasks.workunit.client.1.smithi103.stdout:2/146: symlink d3/d5/d2c/l3a 0 2024-09-18T21:12:43.421 INFO:tasks.workunit.client.0.smithi077.stdout:9/120: chown d1/dd/le 49973498 1 2024-09-18T21:12:43.421 INFO:tasks.workunit.client.0.smithi077.stdout:1/132: truncate d3/d8/d13/f14 1240998 0 2024-09-18T21:12:43.422 INFO:tasks.workunit.client.1.smithi103.stdout:1/117: creat d0/d11/f2d x:0 0 0 2024-09-18T21:12:43.424 INFO:tasks.workunit.client.1.smithi103.stdout:4/101: dread f6 [0,4194304] 0 2024-09-18T21:12:43.425 INFO:tasks.workunit.client.0.smithi077.stdout:3/153: mknod db/d14/d22/c33 0 2024-09-18T21:12:43.426 INFO:tasks.workunit.client.1.smithi103.stdout:7/169: symlink d1/df/d1d/d29/d2f/l35 0 2024-09-18T21:12:43.427 INFO:tasks.workunit.client.0.smithi077.stdout:4/133: rename d3/f18 to d3/d17/f28 0 2024-09-18T21:12:43.429 INFO:tasks.workunit.client.1.smithi103.stdout:3/109: rename d1/da/df/l1b to d1/da/l1e 0 2024-09-18T21:12:43.432 INFO:tasks.workunit.client.1.smithi103.stdout:7/170: dread - d1/f1b zero size 2024-09-18T21:12:43.432 INFO:tasks.workunit.client.1.smithi103.stdout:9/133: dwrite f17 [0,4194304] 0 2024-09-18T21:12:43.433 INFO:tasks.workunit.client.0.smithi077.stdout:6/205: mkdir d7/df/d11/d1d/d49 0 2024-09-18T21:12:43.433 INFO:tasks.workunit.client.0.smithi077.stdout:4/134: dread d3/dc/d20/f27 [0,4194304] 0 2024-09-18T21:12:43.434 INFO:tasks.workunit.client.1.smithi103.stdout:1/118: symlink d0/d2/d9/d10/l2e 0 2024-09-18T21:12:43.435 INFO:tasks.workunit.client.0.smithi077.stdout:0/234: link d8/f23 d8/d1a/d35/f4d 0 2024-09-18T21:12:43.437 INFO:tasks.workunit.client.0.smithi077.stdout:6/206: dwrite d7/df/d11/d25/f26 [0,4194304] 0 2024-09-18T21:12:43.437 INFO:tasks.workunit.client.1.smithi103.stdout:2/147: mknod d3/d5/d2f/c3b 0 2024-09-18T21:12:43.438 INFO:tasks.workunit.client.1.smithi103.stdout:2/148: dread - d3/d5/f35 zero size 2024-09-18T21:12:43.438 INFO:tasks.workunit.client.0.smithi077.stdout:9/121: mknod d1/dd/d11/c24 0 2024-09-18T21:12:43.439 INFO:tasks.workunit.client.0.smithi077.stdout:8/131: symlink d2/d5/d6/d22/d20/l30 0 2024-09-18T21:12:43.439 INFO:tasks.workunit.client.0.smithi077.stdout:9/122: chown d1/dd/d1a/f23 0 1 2024-09-18T21:12:43.440 INFO:tasks.workunit.client.0.smithi077.stdout:3/154: creat db/d14/f34 x:0 0 0 2024-09-18T21:12:43.441 INFO:tasks.workunit.client.1.smithi103.stdout:0/162: creat d1/f36 x:0 0 0 2024-09-18T21:12:43.442 INFO:tasks.workunit.client.1.smithi103.stdout:0/163: stat d1/d5/de/l10 0 2024-09-18T21:12:43.442 INFO:tasks.workunit.client.0.smithi077.stdout:5/236: sync 2024-09-18T21:12:43.446 INFO:tasks.workunit.client.0.smithi077.stdout:8/132: dread d2/f19 [0,4194304] 0 2024-09-18T21:12:43.446 INFO:tasks.workunit.client.0.smithi077.stdout:1/133: rename d3/d8/d13/d18/f29 to d3/d8/d13/d18/d22/f2c 0 2024-09-18T21:12:43.447 INFO:tasks.workunit.client.0.smithi077.stdout:8/133: readlink d2/d5/d6/l1c 0 2024-09-18T21:12:43.447 INFO:tasks.workunit.client.1.smithi103.stdout:9/134: dread f4 [0,4194304] 0 2024-09-18T21:12:43.447 INFO:tasks.workunit.client.1.smithi103.stdout:9/135: stat l14 0 2024-09-18T21:12:43.448 INFO:tasks.workunit.client.0.smithi077.stdout:4/135: creat d3/dc/d20/f29 x:0 0 0 2024-09-18T21:12:43.450 INFO:tasks.workunit.client.1.smithi103.stdout:5/146: rmdir de/d1f 39 2024-09-18T21:12:43.452 INFO:tasks.workunit.client.0.smithi077.stdout:6/207: symlink d7/df/d11/d3e/l4a 0 2024-09-18T21:12:43.452 INFO:tasks.workunit.client.0.smithi077.stdout:6/208: stat d7/df/f2a 0 2024-09-18T21:12:43.455 INFO:tasks.workunit.client.1.smithi103.stdout:0/164: write d1/f29 [546409,25332] 0 2024-09-18T21:12:43.455 INFO:tasks.workunit.client.0.smithi077.stdout:5/237: creat d0/df/d10/d4b/f60 x:0 0 0 2024-09-18T21:12:43.456 INFO:tasks.workunit.client.0.smithi077.stdout:5/238: dread - d0/df/d10/f45 zero size 2024-09-18T21:12:43.457 INFO:tasks.workunit.client.1.smithi103.stdout:0/165: read d1/f12 [2303888,59206] 0 2024-09-18T21:12:43.457 INFO:tasks.workunit.client.1.smithi103.stdout:9/136: creat d18/d1f/f28 x:0 0 0 2024-09-18T21:12:43.458 INFO:tasks.workunit.client.1.smithi103.stdout:9/137: write f17 [1253993,127356] 0 2024-09-18T21:12:43.459 INFO:tasks.workunit.client.0.smithi077.stdout:1/134: stat d3/d8/cc 0 2024-09-18T21:12:43.459 INFO:tasks.workunit.client.1.smithi103.stdout:0/166: chown d1/d5/de/d22/c2a 6181 1 2024-09-18T21:12:43.461 INFO:tasks.workunit.client.1.smithi103.stdout:7/171: rename l0 to d1/df/d1d/d1f/d2e/l36 0 2024-09-18T21:12:43.466 INFO:tasks.workunit.client.0.smithi077.stdout:2/163: dwrite d1/f1d [0,4194304] 0 2024-09-18T21:12:43.466 INFO:tasks.workunit.client.0.smithi077.stdout:9/123: creat d1/dd/d11/d1c/f25 x:0 0 0 2024-09-18T21:12:43.468 INFO:tasks.workunit.client.1.smithi103.stdout:7/172: dwrite d1/f21 [0,4194304] 0 2024-09-18T21:12:43.468 INFO:tasks.workunit.client.0.smithi077.stdout:0/235: dread d8/f23 [0,4194304] 0 2024-09-18T21:12:43.468 INFO:tasks.workunit.client.0.smithi077.stdout:6/209: mknod d7/df/d11/d1d/c4b 0 2024-09-18T21:12:43.472 INFO:tasks.workunit.client.0.smithi077.stdout:5/239: mknod d0/d6/dd/c61 0 2024-09-18T21:12:43.473 INFO:tasks.workunit.client.0.smithi077.stdout:0/236: dread d8/fb [0,4194304] 0 2024-09-18T21:12:43.474 INFO:tasks.workunit.client.1.smithi103.stdout:8/152: dwrite d4/de/f16 [4194304,4194304] 0 2024-09-18T21:12:43.474 INFO:tasks.workunit.client.0.smithi077.stdout:1/135: creat d3/d1e/f2d x:0 0 0 2024-09-18T21:12:43.475 INFO:tasks.workunit.client.1.smithi103.stdout:7/173: dread d1/df/f14 [0,4194304] 0 2024-09-18T21:12:43.477 INFO:tasks.workunit.client.1.smithi103.stdout:7/174: write d1/df/d1d/f26 [176995,94969] 0 2024-09-18T21:12:43.478 INFO:tasks.workunit.client.1.smithi103.stdout:7/175: dread d1/df/d1d/f2b [0,4194304] 0 2024-09-18T21:12:43.479 INFO:tasks.workunit.client.1.smithi103.stdout:9/138: rename d18/d23 to d18/d29 0 2024-09-18T21:12:43.484 INFO:tasks.workunit.client.1.smithi103.stdout:0/167: rename d1/fa to d1/d9/d13/f37 0 2024-09-18T21:12:43.486 INFO:tasks.workunit.client.1.smithi103.stdout:4/102: write d9/fc [2604740,112569] 0 2024-09-18T21:12:43.489 INFO:tasks.workunit.client.0.smithi077.stdout:2/164: rename d1/f18 to d1/d4/d5/d1a/d2e/f34 0 2024-09-18T21:12:43.490 INFO:tasks.workunit.client.1.smithi103.stdout:2/149: link d3/l19 d3/d5/d2f/d32/l3c 0 2024-09-18T21:12:43.491 INFO:tasks.workunit.client.0.smithi077.stdout:6/210: rmdir d7/df/d11/d1d 39 2024-09-18T21:12:43.493 INFO:tasks.workunit.client.0.smithi077.stdout:3/155: creat db/f35 x:0 0 0 2024-09-18T21:12:43.493 INFO:tasks.workunit.client.1.smithi103.stdout:3/110: write d1/da/f15 [1652961,72350] 0 2024-09-18T21:12:43.494 INFO:tasks.workunit.client.0.smithi077.stdout:3/156: truncate db/f2e 139535 0 2024-09-18T21:12:43.495 INFO:tasks.workunit.client.1.smithi103.stdout:8/153: mknod d4/de/c38 0 2024-09-18T21:12:43.495 INFO:tasks.workunit.client.1.smithi103.stdout:3/111: write d1/fc [2335302,18368] 0 2024-09-18T21:12:43.498 INFO:tasks.workunit.client.0.smithi077.stdout:1/136: stat d3/d8/c12 0 2024-09-18T21:12:43.498 INFO:tasks.workunit.client.1.smithi103.stdout:3/112: fdatasync d1/fc 0 2024-09-18T21:12:43.498 INFO:tasks.workunit.client.0.smithi077.stdout:7/262: sync 2024-09-18T21:12:43.500 INFO:tasks.workunit.client.1.smithi103.stdout:7/176: rename d1/f27 to d1/df/d1d/d1f/d2e/f37 0 2024-09-18T21:12:43.502 INFO:tasks.workunit.client.1.smithi103.stdout:5/147: creat de/f36 x:0 0 0 2024-09-18T21:12:43.504 INFO:tasks.workunit.client.1.smithi103.stdout:1/119: write d0/d2/d9/dc/f15 [324146,117757] 0 2024-09-18T21:12:43.504 INFO:tasks.workunit.client.0.smithi077.stdout:7/263: dwrite d12/f1f [0,4194304] 0 2024-09-18T21:12:43.508 INFO:tasks.workunit.client.0.smithi077.stdout:2/165: creat d1/d20/d2c/f35 x:0 0 0 2024-09-18T21:12:43.511 INFO:tasks.workunit.client.1.smithi103.stdout:8/154: mkdir d4/d2c/d39 0 2024-09-18T21:12:43.512 INFO:tasks.workunit.client.0.smithi077.stdout:7/264: dwrite d12/d31/d49/f5c [0,4194304] 0 2024-09-18T21:12:43.513 INFO:tasks.workunit.client.0.smithi077.stdout:3/157: mkdir db/d14/d22/d36 0 2024-09-18T21:12:43.514 INFO:tasks.workunit.client.0.smithi077.stdout:7/265: write d12/d31/d33/d2a/f3d [1517247,113273] 0 2024-09-18T21:12:43.515 INFO:tasks.workunit.client.0.smithi077.stdout:7/266: dread - d12/d31/f48 zero size 2024-09-18T21:12:43.517 INFO:tasks.workunit.client.0.smithi077.stdout:7/267: write d12/d31/d49/f5c [180349,77852] 0 2024-09-18T21:12:43.517 INFO:tasks.workunit.client.0.smithi077.stdout:5/240: mknod d0/d6/dd/d5d/c62 0 2024-09-18T21:12:43.519 INFO:tasks.workunit.client.0.smithi077.stdout:5/241: truncate d0/d6/dd/f19 858299 0 2024-09-18T21:12:43.520 INFO:tasks.workunit.client.0.smithi077.stdout:5/242: readlink d0/d36/l41 0 2024-09-18T21:12:43.521 INFO:tasks.workunit.client.1.smithi103.stdout:0/168: rename d1/f17 to d1/d5/de/d24/f38 0 2024-09-18T21:12:43.522 INFO:tasks.workunit.client.0.smithi077.stdout:7/268: dread d12/d31/d33/d2a/f3d [0,4194304] 0 2024-09-18T21:12:43.522 INFO:tasks.workunit.client.1.smithi103.stdout:0/169: fdatasync d1/d5/de/d19/d1e/f1f 0 2024-09-18T21:12:43.523 INFO:tasks.workunit.client.0.smithi077.stdout:7/269: dread - d12/d31/f48 zero size 2024-09-18T21:12:43.523 INFO:tasks.workunit.client.0.smithi077.stdout:8/134: getdents d2/d5/d6/d22/d20 0 2024-09-18T21:12:43.524 INFO:tasks.workunit.client.0.smithi077.stdout:8/135: chown d2/d5/c11 87862214 1 2024-09-18T21:12:43.524 INFO:tasks.workunit.client.1.smithi103.stdout:5/148: truncate de/d1f/f23 748633 0 2024-09-18T21:12:43.525 INFO:tasks.workunit.client.0.smithi077.stdout:4/136: getdents d3/dc/d20 0 2024-09-18T21:12:43.525 INFO:tasks.workunit.client.1.smithi103.stdout:5/149: chown de/d1f/c35 59069 1 2024-09-18T21:12:43.526 INFO:tasks.workunit.client.1.smithi103.stdout:4/103: creat d9/d1a/d21/f26 x:0 0 0 2024-09-18T21:12:43.529 INFO:tasks.workunit.client.1.smithi103.stdout:5/150: dread de/f1c [4194304,4194304] 0 2024-09-18T21:12:43.530 INFO:tasks.workunit.client.0.smithi077.stdout:2/166: symlink d1/d4/d5/d1a/l36 0 2024-09-18T21:12:43.532 INFO:tasks.workunit.client.0.smithi077.stdout:6/211: chown d7/df/d11/d1d/l20 491675879 1 2024-09-18T21:12:43.536 INFO:tasks.workunit.client.1.smithi103.stdout:0/170: symlink d1/d5/de/d19/d1e/l39 0 2024-09-18T21:12:43.538 INFO:tasks.workunit.client.1.smithi103.stdout:0/171: dread d1/d5/de/d19/d1e/f1f [0,4194304] 0 2024-09-18T21:12:43.539 INFO:tasks.workunit.client.1.smithi103.stdout:0/172: read - d1/d5/f31 zero size 2024-09-18T21:12:43.542 INFO:tasks.workunit.client.1.smithi103.stdout:1/120: link d0/d11/f2d d0/d2/d9/f2f 0 2024-09-18T21:12:43.542 INFO:tasks.workunit.client.1.smithi103.stdout:3/113: truncate d1/d2/f8 392592 0 2024-09-18T21:12:43.543 INFO:tasks.workunit.client.1.smithi103.stdout:3/114: chown d1/fc 5784 1 2024-09-18T21:12:43.543 INFO:tasks.workunit.client.0.smithi077.stdout:5/243: symlink d0/d43/l63 0 2024-09-18T21:12:43.544 INFO:tasks.workunit.client.1.smithi103.stdout:8/155: symlink d4/d2c/d39/l3a 0 2024-09-18T21:12:43.545 INFO:tasks.workunit.client.1.smithi103.stdout:5/151: rmdir de/d11/d15 39 2024-09-18T21:12:43.546 INFO:tasks.workunit.client.0.smithi077.stdout:7/270: truncate d12/d31/d33/d2a/f32 1194275 0 2024-09-18T21:12:43.547 INFO:tasks.workunit.client.0.smithi077.stdout:7/271: fdatasync d12/d31/d49/f5c 0 2024-09-18T21:12:43.548 INFO:tasks.workunit.client.1.smithi103.stdout:3/115: dwrite d1/da/f16 [0,4194304] 0 2024-09-18T21:12:43.549 INFO:tasks.workunit.client.1.smithi103.stdout:3/116: chown d1/da/df/f19 1891037554 1 2024-09-18T21:12:43.551 INFO:tasks.workunit.client.0.smithi077.stdout:2/167: rename d1/f25 to d1/d4/d5/d1a/d2e/f37 0 2024-09-18T21:12:43.552 INFO:tasks.workunit.client.1.smithi103.stdout:4/104: mknod d9/d1c/c27 0 2024-09-18T21:12:43.553 INFO:tasks.workunit.client.0.smithi077.stdout:2/168: read - d1/d4/d9/d24/f27 zero size 2024-09-18T21:12:43.555 INFO:tasks.workunit.client.1.smithi103.stdout:1/121: mknod d0/d3/c30 0 2024-09-18T21:12:43.556 INFO:tasks.workunit.client.1.smithi103.stdout:1/122: fsync d0/d2/d9/d10/f25 0 2024-09-18T21:12:43.557 INFO:tasks.workunit.client.0.smithi077.stdout:3/158: creat db/d14/d32/f37 x:0 0 0 2024-09-18T21:12:43.558 INFO:tasks.workunit.client.0.smithi077.stdout:9/124: dwrite d1/fb [0,4194304] 0 2024-09-18T21:12:43.559 INFO:tasks.workunit.client.0.smithi077.stdout:6/212: dread d7/df/d11/d1d/d31/f3f [0,4194304] 0 2024-09-18T21:12:43.559 INFO:tasks.workunit.client.1.smithi103.stdout:8/156: unlink d4/de/cd 0 2024-09-18T21:12:43.559 INFO:tasks.workunit.client.0.smithi077.stdout:7/272: dwrite d12/d31/f48 [0,4194304] 0 2024-09-18T21:12:43.561 INFO:tasks.workunit.client.0.smithi077.stdout:6/213: write d7/fc [3322135,3514] 0 2024-09-18T21:12:43.563 INFO:tasks.workunit.client.0.smithi077.stdout:6/214: write d7/df/f28 [715765,115738] 0 2024-09-18T21:12:43.566 INFO:tasks.workunit.client.0.smithi077.stdout:0/237: getdents d8/d1a/d35 0 2024-09-18T21:12:43.567 INFO:tasks.workunit.client.0.smithi077.stdout:0/238: write d8/d26/f1b [513187,77219] 0 2024-09-18T21:12:43.568 INFO:tasks.workunit.client.0.smithi077.stdout:5/244: mkdir d0/d6/d3b/d64 0 2024-09-18T21:12:43.568 INFO:tasks.workunit.client.1.smithi103.stdout:5/152: rmdir de/d2d 39 2024-09-18T21:12:43.568 INFO:tasks.workunit.client.0.smithi077.stdout:5/245: stat d0/d6/dd/l31 0 2024-09-18T21:12:43.569 INFO:tasks.workunit.client.0.smithi077.stdout:5/246: dread - d0/df/f25 zero size 2024-09-18T21:12:43.569 INFO:tasks.workunit.client.1.smithi103.stdout:5/153: write fb [1527022,76730] 0 2024-09-18T21:12:43.570 INFO:tasks.workunit.client.0.smithi077.stdout:1/137: creat d3/f2e x:0 0 0 2024-09-18T21:12:43.571 INFO:tasks.workunit.client.0.smithi077.stdout:5/247: write d0/df/d10/d4b/f60 [205748,87178] 0 2024-09-18T21:12:43.571 INFO:tasks.workunit.client.1.smithi103.stdout:7/177: getdents d1/df/d1d/d1f/d2e 0 2024-09-18T21:12:43.572 INFO:tasks.workunit.client.0.smithi077.stdout:5/248: dread - d0/df/f1c zero size 2024-09-18T21:12:43.573 INFO:tasks.workunit.client.1.smithi103.stdout:4/105: mknod d9/d1a/c28 0 2024-09-18T21:12:43.573 INFO:tasks.workunit.client.0.smithi077.stdout:5/249: dread - d0/df/d10/d47/f58 zero size 2024-09-18T21:12:43.575 INFO:tasks.workunit.client.1.smithi103.stdout:8/157: creat d4/de/f3b x:0 0 0 2024-09-18T21:12:43.576 INFO:tasks.workunit.client.0.smithi077.stdout:2/169: mknod d1/d20/d2c/c38 0 2024-09-18T21:12:43.578 INFO:tasks.workunit.client.1.smithi103.stdout:2/150: rename d3/d5/d25/c2e to d3/c3d 0 2024-09-18T21:12:43.579 INFO:tasks.workunit.client.0.smithi077.stdout:5/250: dwrite d0/df/f22 [0,4194304] 0 2024-09-18T21:12:43.580 INFO:tasks.workunit.client.0.smithi077.stdout:9/125: mkdir d1/dd/d11/d26 0 2024-09-18T21:12:43.581 INFO:tasks.workunit.client.1.smithi103.stdout:7/178: mknod d1/df/d1d/d1f/c38 0 2024-09-18T21:12:43.581 INFO:tasks.workunit.client.1.smithi103.stdout:8/158: dwrite d4/d2c/f31 [0,4194304] 0 2024-09-18T21:12:43.583 INFO:tasks.workunit.client.0.smithi077.stdout:6/215: write d7/df/d11/d25/f26 [3161694,118613] 0 2024-09-18T21:12:43.583 INFO:tasks.workunit.client.0.smithi077.stdout:0/239: fsync d8/d1a/d35/f3e 0 2024-09-18T21:12:43.584 INFO:tasks.workunit.client.0.smithi077.stdout:6/216: read d7/df/d11/d1d/d31/f3f [30754,6312] 0 2024-09-18T21:12:43.584 INFO:tasks.workunit.client.0.smithi077.stdout:1/138: fsync d3/d8/d13/d18/f1a 0 2024-09-18T21:12:43.588 INFO:tasks.workunit.client.1.smithi103.stdout:3/117: rename d1/l11 to d1/da/l1f 0 2024-09-18T21:12:43.588 INFO:tasks.workunit.client.1.smithi103.stdout:2/151: unlink d3/d5/c2d 0 2024-09-18T21:12:43.589 INFO:tasks.workunit.client.1.smithi103.stdout:4/106: rename d9 to d9/d1a/d21/d29 22 2024-09-18T21:12:43.591 INFO:tasks.workunit.client.1.smithi103.stdout:4/107: write d9/fc [4387309,118542] 0 2024-09-18T21:12:43.591 INFO:tasks.workunit.client.1.smithi103.stdout:4/108: chown d9/d1a 8200571 1 2024-09-18T21:12:43.592 INFO:tasks.workunit.client.1.smithi103.stdout:4/109: write d9/d1a/f1e [349620,115432] 0 2024-09-18T21:12:43.592 INFO:tasks.workunit.client.0.smithi077.stdout:1/139: dwrite d3/d8/d13/d18/f1a [0,4194304] 0 2024-09-18T21:12:43.592 INFO:tasks.workunit.client.0.smithi077.stdout:9/126: mkdir d1/df/d27 0 2024-09-18T21:12:43.595 INFO:tasks.workunit.client.0.smithi077.stdout:9/127: write d1/dd/d1a/f1b [113673,86036] 0 2024-09-18T21:12:43.601 INFO:tasks.workunit.client.0.smithi077.stdout:0/240: mkdir d8/d1a/d39/d3b/d4e 0 2024-09-18T21:12:43.602 INFO:tasks.workunit.client.0.smithi077.stdout:6/217: mkdir d7/df/d11/d1d/d4c 0 2024-09-18T21:12:43.604 INFO:tasks.workunit.client.0.smithi077.stdout:8/136: getdents d2/d5/d6/d22/d26 0 2024-09-18T21:12:43.605 INFO:tasks.workunit.client.0.smithi077.stdout:7/273: creat d12/d22/f64 x:0 0 0 2024-09-18T21:12:43.610 INFO:tasks.workunit.client.0.smithi077.stdout:9/128: symlink d1/dd/d11/l28 0 2024-09-18T21:12:43.612 INFO:tasks.workunit.client.0.smithi077.stdout:0/241: symlink d8/d1a/d35/l4f 0 2024-09-18T21:12:43.613 INFO:tasks.workunit.client.0.smithi077.stdout:0/242: write d8/d1a/f4b [53837,103256] 0 2024-09-18T21:12:43.615 INFO:tasks.workunit.client.0.smithi077.stdout:2/170: link d1/d4/d5/f7 d1/f39 0 2024-09-18T21:12:43.621 INFO:tasks.workunit.client.0.smithi077.stdout:6/218: dread d7/f1f [0,4194304] 0 2024-09-18T21:12:43.623 INFO:tasks.workunit.client.0.smithi077.stdout:5/251: write d0/d6/dd/f1e [1351617,80152] 0 2024-09-18T21:12:43.625 INFO:tasks.workunit.client.0.smithi077.stdout:0/243: fdatasync d8/f14 0 2024-09-18T21:12:43.625 INFO:tasks.workunit.client.0.smithi077.stdout:7/274: creat d12/d22/f65 x:0 0 0 2024-09-18T21:12:43.626 INFO:tasks.workunit.client.0.smithi077.stdout:6/219: fsync d7/df/f14 0 2024-09-18T21:12:43.628 INFO:tasks.workunit.client.0.smithi077.stdout:9/129: dread d1/df/f12 [0,4194304] 0 2024-09-18T21:12:43.628 INFO:tasks.workunit.client.0.smithi077.stdout:1/140: getdents d3 0 2024-09-18T21:12:43.629 INFO:tasks.workunit.client.0.smithi077.stdout:0/244: creat d8/d37/f50 x:0 0 0 2024-09-18T21:12:43.630 INFO:tasks.workunit.client.0.smithi077.stdout:6/220: readlink d7/l39 0 2024-09-18T21:12:43.631 INFO:tasks.workunit.client.0.smithi077.stdout:0/245: chown d8/d1d 3008113 1 2024-09-18T21:12:43.631 INFO:tasks.workunit.client.0.smithi077.stdout:7/275: truncate d12/d31/f48 5119644 0 2024-09-18T21:12:43.634 INFO:tasks.workunit.client.0.smithi077.stdout:0/246: read d8/d26/f11 [1589231,104357] 0 2024-09-18T21:12:43.636 INFO:tasks.workunit.client.0.smithi077.stdout:7/276: write d12/f1f [3194124,4729] 0 2024-09-18T21:12:43.636 INFO:tasks.workunit.client.0.smithi077.stdout:5/252: dwrite d0/d6/d3b/f4e [0,4194304] 0 2024-09-18T21:12:43.636 INFO:tasks.workunit.client.0.smithi077.stdout:6/221: symlink d7/df/d11/d25/l4d 0 2024-09-18T21:12:43.640 INFO:tasks.workunit.client.0.smithi077.stdout:5/253: stat d0/d6/dd 0 2024-09-18T21:12:43.640 INFO:tasks.workunit.client.0.smithi077.stdout:2/171: dread d1/d4/d5/f7 [0,4194304] 0 2024-09-18T21:12:43.642 INFO:tasks.workunit.client.1.smithi103.stdout:2/152: unlink d3/d5/f17 0 2024-09-18T21:12:43.642 INFO:tasks.workunit.client.1.smithi103.stdout:1/123: getdents d0 0 2024-09-18T21:12:43.642 INFO:tasks.workunit.client.1.smithi103.stdout:8/159: rename d4/d26/c21 to d4/d2c/d39/c3c 0 2024-09-18T21:12:43.643 INFO:tasks.workunit.client.1.smithi103.stdout:4/110: creat d9/d1f/f2a x:0 0 0 2024-09-18T21:12:43.643 INFO:tasks.workunit.client.0.smithi077.stdout:0/247: chown l2 347472433 1 2024-09-18T21:12:43.644 INFO:tasks.workunit.client.0.smithi077.stdout:5/254: stat d0/d6/dd/c1d 0 2024-09-18T21:12:43.644 INFO:tasks.workunit.client.0.smithi077.stdout:9/130: dwrite d1/dd/d1a/f1b [0,4194304] 0 2024-09-18T21:12:43.645 INFO:tasks.workunit.client.0.smithi077.stdout:6/222: symlink d7/df/l4e 0 2024-09-18T21:12:43.645 INFO:tasks.workunit.client.1.smithi103.stdout:7/179: truncate d1/df/d1d/f26 489079 0 2024-09-18T21:12:43.645 INFO:tasks.workunit.client.1.smithi103.stdout:2/153: write d3/f1b [808148,108006] 0 2024-09-18T21:12:43.646 INFO:tasks.workunit.client.1.smithi103.stdout:5/154: link de/d14/c1d de/d11/d15/c37 0 2024-09-18T21:12:43.646 INFO:tasks.workunit.client.0.smithi077.stdout:7/277: dread d12/f26 [0,4194304] 0 2024-09-18T21:12:43.647 INFO:tasks.workunit.client.0.smithi077.stdout:2/172: creat d1/d4/d5/f3a x:0 0 0 2024-09-18T21:12:43.647 INFO:tasks.workunit.client.1.smithi103.stdout:8/160: mkdir d4/d2d/d3d 0 2024-09-18T21:12:43.648 INFO:tasks.workunit.client.1.smithi103.stdout:2/154: write d3/f8 [961010,15088] 0 2024-09-18T21:12:43.648 INFO:tasks.workunit.client.1.smithi103.stdout:7/180: write d1/f12 [3202302,105568] 0 2024-09-18T21:12:43.649 INFO:tasks.workunit.client.1.smithi103.stdout:3/118: dread d1/d2/f8 [0,4194304] 0 2024-09-18T21:12:43.650 INFO:tasks.workunit.client.1.smithi103.stdout:4/111: write d9/d1a/f24 [3784034,96330] 0 2024-09-18T21:12:43.651 INFO:tasks.workunit.client.0.smithi077.stdout:0/248: truncate d8/d1a/d35/f47 678246 0 2024-09-18T21:12:43.653 INFO:tasks.workunit.client.0.smithi077.stdout:7/278: mknod d12/c66 0 2024-09-18T21:12:43.657 INFO:tasks.workunit.client.0.smithi077.stdout:9/131: symlink d1/dd/d11/l29 0 2024-09-18T21:12:43.657 INFO:tasks.workunit.client.1.smithi103.stdout:1/124: mknod d0/d2/d2b/c31 0 2024-09-18T21:12:43.658 INFO:tasks.workunit.client.0.smithi077.stdout:1/141: dread d3/f10 [4194304,4194304] 0 2024-09-18T21:12:43.658 INFO:tasks.workunit.client.0.smithi077.stdout:6/223: dwrite d7/df/d11/d1d/f2e [0,4194304] 0 2024-09-18T21:12:43.658 INFO:tasks.workunit.client.0.smithi077.stdout:0/249: creat d8/d1a/f51 x:0 0 0 2024-09-18T21:12:43.659 INFO:tasks.workunit.client.1.smithi103.stdout:1/125: write d0/d3/f20 [5070087,32211] 0 2024-09-18T21:12:43.659 INFO:tasks.workunit.client.1.smithi103.stdout:8/161: creat d4/d2c/d39/f3e x:0 0 0 2024-09-18T21:12:43.661 INFO:tasks.workunit.client.1.smithi103.stdout:2/155: creat d3/d5/d2c/f3e x:0 0 0 2024-09-18T21:12:43.661 INFO:tasks.workunit.client.1.smithi103.stdout:2/156: chown d3/d5/d25/f33 2064830096 1 2024-09-18T21:12:43.662 INFO:tasks.workunit.client.1.smithi103.stdout:3/119: mkdir d1/da/df/d20 0 2024-09-18T21:12:43.665 INFO:tasks.workunit.client.0.smithi077.stdout:5/255: dwrite d0/d6/dd/f30 [0,4194304] 0 2024-09-18T21:12:43.665 INFO:tasks.workunit.client.0.smithi077.stdout:9/132: symlink d1/dd/d1a/l2a 0 2024-09-18T21:12:43.666 INFO:tasks.workunit.client.1.smithi103.stdout:5/155: symlink de/l38 0 2024-09-18T21:12:43.666 INFO:tasks.workunit.client.1.smithi103.stdout:1/126: symlink d0/l32 0 2024-09-18T21:12:43.668 INFO:tasks.workunit.client.1.smithi103.stdout:2/157: dwrite d3/d5/fe [0,4194304] 0 2024-09-18T21:12:43.669 INFO:tasks.workunit.client.1.smithi103.stdout:8/162: mknod d4/d2c/c3f 0 2024-09-18T21:12:43.671 INFO:tasks.workunit.client.1.smithi103.stdout:1/127: write d0/d2/d9/f23 [665292,117506] 0 2024-09-18T21:12:43.671 INFO:tasks.workunit.client.0.smithi077.stdout:1/142: symlink d3/d8/d13/d18/d22/l2f 0 2024-09-18T21:12:43.672 INFO:tasks.workunit.client.0.smithi077.stdout:6/224: truncate d7/df/d11/f45 633303 0 2024-09-18T21:12:43.673 INFO:tasks.workunit.client.0.smithi077.stdout:9/133: dread d1/dd/d1a/f23 [0,4194304] 0 2024-09-18T21:12:43.675 INFO:tasks.workunit.client.1.smithi103.stdout:1/128: fdatasync d0/d2/d9/dc/f15 0 2024-09-18T21:12:43.675 INFO:tasks.workunit.client.1.smithi103.stdout:3/120: rmdir d1/da 39 2024-09-18T21:12:43.678 INFO:tasks.workunit.client.1.smithi103.stdout:5/156: dwrite fb [0,4194304] 0 2024-09-18T21:12:43.679 INFO:tasks.workunit.client.0.smithi077.stdout:2/173: dread d1/d4/d9/f1e [4194304,4194304] 0 2024-09-18T21:12:43.679 INFO:tasks.workunit.client.0.smithi077.stdout:5/256: rename d0/d6/dd/fe to d0/df/d10/d4b/f65 0 2024-09-18T21:12:43.680 INFO:tasks.workunit.client.1.smithi103.stdout:1/129: read - d0/d2/d9/d10/f2a zero size 2024-09-18T21:12:43.680 INFO:tasks.workunit.client.1.smithi103.stdout:3/121: dread d1/f13 [0,4194304] 0 2024-09-18T21:12:43.680 INFO:tasks.workunit.client.1.smithi103.stdout:7/181: dread d1/f15 [0,4194304] 0 2024-09-18T21:12:43.681 INFO:tasks.workunit.client.1.smithi103.stdout:1/130: chown d0/d2/c14 155 1 2024-09-18T21:12:43.682 INFO:tasks.workunit.client.1.smithi103.stdout:7/182: write d1/df/f20 [3684402,102919] 0 2024-09-18T21:12:43.682 INFO:tasks.workunit.client.0.smithi077.stdout:6/225: dwrite d7/df/f36 [0,4194304] 0 2024-09-18T21:12:43.682 INFO:tasks.workunit.client.0.smithi077.stdout:0/250: creat d8/d1a/d39/d3b/d4e/f52 x:0 0 0 2024-09-18T21:12:43.683 INFO:tasks.workunit.client.0.smithi077.stdout:6/226: dread - d7/df/f32 zero size 2024-09-18T21:12:43.684 INFO:tasks.workunit.client.1.smithi103.stdout:5/157: dread de/d1f/f23 [0,4194304] 0 2024-09-18T21:12:43.684 INFO:tasks.workunit.client.1.smithi103.stdout:1/131: write d0/d3/f29 [316608,98290] 0 2024-09-18T21:12:43.684 INFO:tasks.workunit.client.1.smithi103.stdout:5/158: dread - de/d14/f18 zero size 2024-09-18T21:12:43.685 INFO:tasks.workunit.client.0.smithi077.stdout:1/143: unlink d3/d8/f16 0 2024-09-18T21:12:43.686 INFO:tasks.workunit.client.1.smithi103.stdout:2/158: mknod d3/d5/d2c/c3f 0 2024-09-18T21:12:43.688 INFO:tasks.workunit.client.1.smithi103.stdout:2/159: write d3/f1d [218139,10312] 0 2024-09-18T21:12:43.692 INFO:tasks.workunit.client.1.smithi103.stdout:2/160: dread d3/f21 [0,4194304] 0 2024-09-18T21:12:43.695 INFO:tasks.workunit.client.0.smithi077.stdout:5/257: read d0/f18 [3104038,110334] 0 2024-09-18T21:12:43.697 INFO:tasks.workunit.client.0.smithi077.stdout:6/227: write d7/df/d11/d25/f2b [1523406,118322] 0 2024-09-18T21:12:43.699 INFO:tasks.workunit.client.0.smithi077.stdout:7/279: truncate d12/f45 480815 0 2024-09-18T21:12:43.700 INFO:tasks.workunit.client.1.smithi103.stdout:4/112: dwrite d9/d1f/f20 [4194304,4194304] 0 2024-09-18T21:12:43.700 INFO:tasks.workunit.client.1.smithi103.stdout:1/132: mknod d0/d2/d2b/c33 0 2024-09-18T21:12:43.701 INFO:tasks.workunit.client.1.smithi103.stdout:5/159: rmdir de/d14/d33 39 2024-09-18T21:12:43.701 INFO:tasks.workunit.client.1.smithi103.stdout:4/113: write d9/f25 [1009197,6116] 0 2024-09-18T21:12:43.702 INFO:tasks.workunit.client.0.smithi077.stdout:1/144: creat d3/d8/d13/d18/d22/f30 x:0 0 0 2024-09-18T21:12:43.702 INFO:tasks.workunit.client.0.smithi077.stdout:1/145: stat d3/f2a 0 2024-09-18T21:12:43.703 INFO:tasks.workunit.client.1.smithi103.stdout:5/160: truncate de/d11/f29 1725323 0 2024-09-18T21:12:43.704 INFO:tasks.workunit.client.0.smithi077.stdout:5/258: readlink d0/df/d10/d4b/l4d 0 2024-09-18T21:12:43.705 INFO:tasks.workunit.client.1.smithi103.stdout:3/122: mknod d1/d2/d18/c21 0 2024-09-18T21:12:43.708 INFO:tasks.workunit.client.0.smithi077.stdout:7/280: rmdir d12/d31 39 2024-09-18T21:12:43.708 INFO:tasks.workunit.client.0.smithi077.stdout:7/281: readlink d12/l18 0 2024-09-18T21:12:43.711 INFO:tasks.workunit.client.0.smithi077.stdout:0/251: truncate d8/d1a/d35/f4d 1614496 0 2024-09-18T21:12:43.712 INFO:tasks.workunit.client.0.smithi077.stdout:0/252: truncate d8/d1a/d35/f47 1563048 0 2024-09-18T21:12:43.713 INFO:tasks.workunit.client.1.smithi103.stdout:1/133: creat d0/d11/d16/d19/f34 x:0 0 0 2024-09-18T21:12:43.713 INFO:tasks.workunit.client.0.smithi077.stdout:1/146: write d3/f10 [7234375,66412] 0 2024-09-18T21:12:43.714 INFO:tasks.workunit.client.1.smithi103.stdout:4/114: mkdir d9/d1a/d2b 0 2024-09-18T21:12:43.715 INFO:tasks.workunit.client.0.smithi077.stdout:5/259: symlink d0/d6/dd/d5d/l66 0 2024-09-18T21:12:43.716 INFO:tasks.workunit.client.1.smithi103.stdout:2/161: unlink d3/d5/d2f/d32/l3c 0 2024-09-18T21:12:43.717 INFO:tasks.workunit.client.0.smithi077.stdout:6/228: getdents d7/df/d11/d1d/d49 0 2024-09-18T21:12:43.717 INFO:tasks.workunit.client.1.smithi103.stdout:8/163: write d4/de/f1e [4717772,64490] 0 2024-09-18T21:12:43.718 INFO:tasks.workunit.client.1.smithi103.stdout:8/164: chown d4/de/c38 9122 1 2024-09-18T21:12:43.720 INFO:tasks.workunit.client.0.smithi077.stdout:0/253: rmdir d8/d37 39 2024-09-18T21:12:43.722 INFO:tasks.workunit.client.1.smithi103.stdout:1/134: rename d0/d2/d9/f23 to d0/d11/f35 0 2024-09-18T21:12:43.722 INFO:tasks.workunit.client.1.smithi103.stdout:6/188: sync 2024-09-18T21:12:43.724 INFO:tasks.workunit.client.0.smithi077.stdout:1/147: creat d3/d1e/f31 x:0 0 0 2024-09-18T21:12:43.724 INFO:tasks.workunit.client.1.smithi103.stdout:8/165: dwrite d4/d2c/d39/f3e [0,4194304] 0 2024-09-18T21:12:43.725 INFO:tasks.workunit.client.1.smithi103.stdout:8/166: chown d4/ff 109903 1 2024-09-18T21:12:43.726 INFO:tasks.workunit.client.1.smithi103.stdout:8/167: chown d4/de/l19 58136522 1 2024-09-18T21:12:43.727 INFO:tasks.workunit.client.1.smithi103.stdout:4/115: fsync d9/f12 0 2024-09-18T21:12:43.727 INFO:tasks.workunit.client.0.smithi077.stdout:5/260: dread d0/d6/f3c [0,4194304] 0 2024-09-18T21:12:43.727 INFO:tasks.workunit.client.1.smithi103.stdout:7/183: truncate d1/f1c 487332 0 2024-09-18T21:12:43.729 INFO:tasks.workunit.client.0.smithi077.stdout:2/174: truncate d1/d4/d5/d1a/d2e/f37 933871 0 2024-09-18T21:12:43.730 INFO:tasks.workunit.client.0.smithi077.stdout:5/261: truncate d0/df/f52 784219 0 2024-09-18T21:12:43.733 INFO:tasks.workunit.client.0.smithi077.stdout:7/282: creat d12/d22/d59/d5a/f67 x:0 0 0 2024-09-18T21:12:43.733 INFO:tasks.workunit.client.0.smithi077.stdout:5/262: read d0/d6/dd/f3a [1793807,38610] 0 2024-09-18T21:12:43.734 INFO:tasks.workunit.client.0.smithi077.stdout:1/148: dwrite d3/d8/d13/d18/f1a [0,4194304] 0 2024-09-18T21:12:43.735 INFO:tasks.workunit.client.0.smithi077.stdout:6/229: dread d7/df/f15 [0,4194304] 0 2024-09-18T21:12:43.736 INFO:tasks.workunit.client.0.smithi077.stdout:7/283: write d12/f1f [5077946,73476] 0 2024-09-18T21:12:43.736 INFO:tasks.workunit.client.1.smithi103.stdout:3/123: creat d1/da/f22 x:0 0 0 2024-09-18T21:12:43.737 INFO:tasks.workunit.client.1.smithi103.stdout:3/124: chown d1/fc 6868 1 2024-09-18T21:12:43.737 INFO:tasks.workunit.client.0.smithi077.stdout:5/263: write d0/d6/dd/f19 [1021728,70088] 0 2024-09-18T21:12:43.740 INFO:tasks.workunit.client.1.smithi103.stdout:2/162: rmdir d3/d5 39 2024-09-18T21:12:43.741 INFO:tasks.workunit.client.0.smithi077.stdout:2/175: dread d1/f39 [0,4194304] 0 2024-09-18T21:12:43.741 INFO:tasks.workunit.client.0.smithi077.stdout:5/264: dread d0/d6/dd/f24 [0,4194304] 0 2024-09-18T21:12:43.747 INFO:tasks.workunit.client.1.smithi103.stdout:1/135: dread d0/d3/f1a [0,4194304] 0 2024-09-18T21:12:43.747 INFO:tasks.workunit.client.1.smithi103.stdout:4/116: fsync d9/fa 0 2024-09-18T21:12:43.748 INFO:tasks.workunit.client.0.smithi077.stdout:1/149: mkdir d3/d1e/d32 0 2024-09-18T21:12:43.749 INFO:tasks.workunit.client.1.smithi103.stdout:1/136: fsync d0/d2/d9/d10/f25 0 2024-09-18T21:12:43.751 INFO:tasks.workunit.client.1.smithi103.stdout:5/161: creat de/d14/f39 x:0 0 0 2024-09-18T21:12:43.754 INFO:tasks.workunit.client.1.smithi103.stdout:5/162: dread de/d11/f12 [0,4194304] 0 2024-09-18T21:12:43.755 INFO:tasks.workunit.client.0.smithi077.stdout:0/254: dwrite d8/f2d [0,4194304] 0 2024-09-18T21:12:43.755 INFO:tasks.workunit.client.0.smithi077.stdout:5/265: rmdir d0 39 2024-09-18T21:12:43.757 INFO:tasks.workunit.client.1.smithi103.stdout:6/189: symlink d2/l3c 0 2024-09-18T21:12:43.759 INFO:tasks.workunit.client.0.smithi077.stdout:2/176: rename d1/d4/d5/l13 to d1/d4/d9/d24/l3b 0 2024-09-18T21:12:43.759 INFO:tasks.workunit.client.1.smithi103.stdout:6/190: write d2/d3/d8/df/f17 [2335868,94296] 0 2024-09-18T21:12:43.760 INFO:tasks.workunit.client.0.smithi077.stdout:2/177: write d1/d4/f2f [329136,36201] 0 2024-09-18T21:12:43.761 INFO:tasks.workunit.client.0.smithi077.stdout:2/178: dread - d1/d4/d9/f30 zero size 2024-09-18T21:12:43.761 INFO:tasks.workunit.client.1.smithi103.stdout:6/191: write d2/d3/d8/f20 [1739890,4222] 0 2024-09-18T21:12:43.762 INFO:tasks.workunit.client.1.smithi103.stdout:5/163: dwrite de/d14/f22 [0,4194304] 0 2024-09-18T21:12:43.765 INFO:tasks.workunit.client.1.smithi103.stdout:4/117: rename d9/fd to d9/f2c 0 2024-09-18T21:12:43.765 INFO:tasks.workunit.client.1.smithi103.stdout:4/118: readlink d9/l17 0 2024-09-18T21:12:43.768 INFO:tasks.workunit.client.1.smithi103.stdout:6/192: read d2/d3/d8/df/f17 [6810901,109638] 0 2024-09-18T21:12:43.770 INFO:tasks.workunit.client.1.smithi103.stdout:1/137: mkdir d0/d2/d9/dc/d36 0 2024-09-18T21:12:43.771 INFO:tasks.workunit.client.1.smithi103.stdout:6/193: dread - d2/d3/d4/f2e zero size 2024-09-18T21:12:43.774 INFO:tasks.workunit.client.1.smithi103.stdout:4/119: dwrite d9/d1a/d21/f26 [0,4194304] 0 2024-09-18T21:12:43.774 INFO:tasks.workunit.client.0.smithi077.stdout:6/230: link d7/l13 d7/df/d11/d3e/l4f 0 2024-09-18T21:12:43.775 INFO:tasks.workunit.client.1.smithi103.stdout:4/120: chown f5 92226 1 2024-09-18T21:12:43.776 INFO:tasks.workunit.client.0.smithi077.stdout:7/284: getdents d12/d22/d59/d5d 0 2024-09-18T21:12:43.777 INFO:tasks.workunit.client.0.smithi077.stdout:0/255: dread d8/d26/f32 [0,4194304] 0 2024-09-18T21:12:43.778 INFO:tasks.workunit.client.0.smithi077.stdout:6/231: mkdir d7/df/d11/d1d/d50 0 2024-09-18T21:12:43.779 INFO:tasks.workunit.client.0.smithi077.stdout:0/256: stat d8/f17 0 2024-09-18T21:12:43.779 INFO:tasks.workunit.client.0.smithi077.stdout:7/285: dread d12/d22/d39/f57 [0,4194304] 0 2024-09-18T21:12:43.780 INFO:tasks.workunit.client.0.smithi077.stdout:0/257: write d8/d26/f18 [105125,89244] 0 2024-09-18T21:12:43.781 INFO:tasks.workunit.client.1.smithi103.stdout:1/138: unlink d0/d11/l13 0 2024-09-18T21:12:43.783 INFO:tasks.workunit.client.1.smithi103.stdout:3/125: rmdir d1/da/df/d20 0 2024-09-18T21:12:43.784 INFO:tasks.workunit.client.0.smithi077.stdout:1/150: dread d3/d8/d13/f14 [0,4194304] 0 2024-09-18T21:12:43.788 INFO:tasks.workunit.client.0.smithi077.stdout:0/258: unlink d8/d1a/f25 0 2024-09-18T21:12:43.789 INFO:tasks.workunit.client.0.smithi077.stdout:6/232: dwrite d7/f2d [0,4194304] 0 2024-09-18T21:12:43.789 INFO:tasks.workunit.client.1.smithi103.stdout:4/121: symlink d9/d1a/d21/l2d 0 2024-09-18T21:12:43.791 INFO:tasks.workunit.client.0.smithi077.stdout:6/233: write d7/df/d11/d25/f47 [497491,103942] 0 2024-09-18T21:12:43.795 INFO:tasks.workunit.client.0.smithi077.stdout:1/151: creat d3/d1e/f33 x:0 0 0 2024-09-18T21:12:43.796 INFO:tasks.workunit.client.1.smithi103.stdout:5/164: rmdir de/d14/d33 39 2024-09-18T21:12:43.796 INFO:tasks.workunit.client.1.smithi103.stdout:5/165: dread - de/d14/f32 zero size 2024-09-18T21:12:43.798 INFO:tasks.workunit.client.0.smithi077.stdout:2/179: dread d1/d4/d5/d1a/d2e/f34 [0,4194304] 0 2024-09-18T21:12:43.798 INFO:tasks.workunit.client.0.smithi077.stdout:0/259: truncate d8/d26/f32 217814 0 2024-09-18T21:12:43.799 INFO:tasks.workunit.client.1.smithi103.stdout:3/126: readlink d1/l12 0 2024-09-18T21:12:43.799 INFO:tasks.workunit.client.1.smithi103.stdout:7/184: truncate d1/fa 1745412 0 2024-09-18T21:12:43.801 INFO:tasks.workunit.client.0.smithi077.stdout:0/260: truncate d8/d1a/d39/d3b/d4e/f52 866465 0 2024-09-18T21:12:43.801 INFO:tasks.workunit.client.0.smithi077.stdout:6/234: creat d7/df/d11/d3e/f51 x:0 0 0 2024-09-18T21:12:43.802 INFO:tasks.workunit.client.1.smithi103.stdout:6/194: getdents d2/d3/d8/df 0 2024-09-18T21:12:43.804 INFO:tasks.workunit.client.1.smithi103.stdout:4/122: dread f6 [0,4194304] 0 2024-09-18T21:12:43.805 INFO:tasks.workunit.client.0.smithi077.stdout:2/180: dwrite d1/fd [0,4194304] 0 2024-09-18T21:12:43.805 INFO:tasks.workunit.client.1.smithi103.stdout:5/166: write de/d1f/f23 [1362687,109784] 0 2024-09-18T21:12:43.807 INFO:tasks.workunit.client.0.smithi077.stdout:6/235: dread d7/f1f [0,4194304] 0 2024-09-18T21:12:43.809 INFO:tasks.workunit.client.1.smithi103.stdout:4/123: dwrite d9/f11 [0,4194304] 0 2024-09-18T21:12:43.810 INFO:tasks.workunit.client.1.smithi103.stdout:4/124: chown d9/d1a/d21/l2d 0 1 2024-09-18T21:12:43.813 INFO:tasks.workunit.client.1.smithi103.stdout:2/163: getdents d3/d5/d2c 0 2024-09-18T21:12:43.814 INFO:tasks.workunit.client.1.smithi103.stdout:4/125: dread d9/f18 [0,4194304] 0 2024-09-18T21:12:43.814 INFO:tasks.workunit.client.1.smithi103.stdout:6/195: mknod d2/d3/d8/c3d 0 2024-09-18T21:12:43.815 INFO:tasks.workunit.client.1.smithi103.stdout:2/164: truncate d3/d5/f27 277463 0 2024-09-18T21:12:43.815 INFO:tasks.workunit.client.0.smithi077.stdout:2/181: read d1/d4/d5/d1a/d2e/f37 [696084,93332] 0 2024-09-18T21:12:43.819 INFO:tasks.workunit.client.0.smithi077.stdout:1/152: link d3/d8/c27 d3/d8/c34 0 2024-09-18T21:12:43.821 INFO:tasks.workunit.client.1.smithi103.stdout:3/127: mkdir d1/d23 0 2024-09-18T21:12:43.823 INFO:tasks.workunit.client.0.smithi077.stdout:7/286: dwrite d12/d22/f5e [0,4194304] 0 2024-09-18T21:12:43.825 INFO:tasks.workunit.client.1.smithi103.stdout:1/139: write d0/ff [180329,4635] 0 2024-09-18T21:12:43.825 INFO:tasks.workunit.client.0.smithi077.stdout:6/236: symlink d7/df/d11/d1d/d49/l52 0 2024-09-18T21:12:43.826 INFO:tasks.workunit.client.1.smithi103.stdout:7/185: mkdir d1/df/d1d/d29/d2f/d33/d39 0 2024-09-18T21:12:43.827 INFO:tasks.workunit.client.1.smithi103.stdout:7/186: read d1/df/f18 [585581,74175] 0 2024-09-18T21:12:43.828 INFO:tasks.workunit.client.1.smithi103.stdout:7/187: read d1/df/d1d/f1e [262477,15999] 0 2024-09-18T21:12:43.829 INFO:tasks.workunit.client.0.smithi077.stdout:2/182: dwrite d1/d4/d5/f7 [0,4194304] 0 2024-09-18T21:12:43.829 INFO:tasks.workunit.client.1.smithi103.stdout:7/188: chown d1/df/d1d/d29 9876962 1 2024-09-18T21:12:43.831 INFO:tasks.workunit.client.1.smithi103.stdout:4/126: mkdir d9/d2e 0 2024-09-18T21:12:43.831 INFO:tasks.workunit.client.0.smithi077.stdout:1/153: creat d3/d1e/f35 x:0 0 0 2024-09-18T21:12:43.832 INFO:tasks.workunit.client.1.smithi103.stdout:2/165: rmdir d3/d5/d2f 39 2024-09-18T21:12:43.832 INFO:tasks.workunit.client.0.smithi077.stdout:1/154: stat d3/d1e/f31 0 2024-09-18T21:12:43.832 INFO:tasks.workunit.client.0.smithi077.stdout:0/261: dread d8/d1a/d39/f3c [0,4194304] 0 2024-09-18T21:12:43.833 INFO:tasks.workunit.client.0.smithi077.stdout:7/287: mkdir d12/d22/d39/d68 0 2024-09-18T21:12:43.836 INFO:tasks.workunit.client.0.smithi077.stdout:6/237: write d7/f1f [950807,84809] 0 2024-09-18T21:12:43.836 INFO:tasks.workunit.client.0.smithi077.stdout:2/183: mknod d1/d4/d9/d24/c3c 0 2024-09-18T21:12:43.841 INFO:tasks.workunit.client.0.smithi077.stdout:6/238: dread d7/f2d [0,4194304] 0 2024-09-18T21:12:43.842 INFO:tasks.workunit.client.1.smithi103.stdout:1/140: rename d0/d2/d9/d10/f2a to d0/f37 0 2024-09-18T21:12:43.842 INFO:tasks.workunit.client.0.smithi077.stdout:6/239: read d7/df/d11/d25/f47 [512435,98919] 0 2024-09-18T21:12:43.843 INFO:tasks.workunit.client.1.smithi103.stdout:1/141: readlink d0/l32 0 2024-09-18T21:12:43.843 INFO:tasks.workunit.client.1.smithi103.stdout:3/128: dwrite d1/da/df/f14 [0,4194304] 0 2024-09-18T21:12:43.843 INFO:tasks.workunit.client.0.smithi077.stdout:6/240: stat d7/c1a 0 2024-09-18T21:12:43.844 INFO:tasks.workunit.client.1.smithi103.stdout:1/142: dread - d0/d11/f2d zero size 2024-09-18T21:12:43.844 INFO:tasks.workunit.client.0.smithi077.stdout:7/288: write d12/d31/d33/d2a/f4f [3551857,41597] 0 2024-09-18T21:12:43.846 INFO:tasks.workunit.client.0.smithi077.stdout:2/184: mknod d1/d4/d5/d1a/d2e/c3d 0 2024-09-18T21:12:43.846 INFO:tasks.workunit.client.0.smithi077.stdout:2/185: fdatasync d1/f2a 0 2024-09-18T21:12:43.847 INFO:tasks.workunit.client.1.smithi103.stdout:4/127: mknod d9/d1c/c2f 0 2024-09-18T21:12:43.849 INFO:tasks.workunit.client.1.smithi103.stdout:2/166: rmdir d3/d5/d25 39 2024-09-18T21:12:43.849 INFO:tasks.workunit.client.1.smithi103.stdout:2/167: chown d3/d5 1445044 1 2024-09-18T21:12:43.850 INFO:tasks.workunit.client.1.smithi103.stdout:6/196: mknod d2/d24/d38/c3e 0 2024-09-18T21:12:43.852 INFO:tasks.workunit.client.1.smithi103.stdout:1/143: dwrite d0/d2/d9/d10/f25 [0,4194304] 0 2024-09-18T21:12:43.853 INFO:tasks.workunit.client.0.smithi077.stdout:6/241: creat d7/df/d11/d1d/f53 x:0 0 0 2024-09-18T21:12:43.855 INFO:tasks.workunit.client.0.smithi077.stdout:7/289: creat d12/d22/d59/d5a/f69 x:0 0 0 2024-09-18T21:12:43.856 INFO:tasks.workunit.client.0.smithi077.stdout:2/186: symlink d1/d4/d5/d1a/l3e 0 2024-09-18T21:12:43.856 INFO:tasks.workunit.client.0.smithi077.stdout:7/290: fdatasync d12/d31/d33/d2a/f4f 0 2024-09-18T21:12:43.857 INFO:tasks.workunit.client.0.smithi077.stdout:2/187: chown d1/d4 0 1 2024-09-18T21:12:43.858 INFO:tasks.workunit.client.0.smithi077.stdout:1/155: link d3/d8/c12 d3/d1e/d32/c36 0 2024-09-18T21:12:43.858 INFO:tasks.workunit.client.0.smithi077.stdout:4/137: sync 2024-09-18T21:12:43.861 INFO:tasks.workunit.client.1.smithi103.stdout:4/128: creat d9/d1f/f30 x:0 0 0 2024-09-18T21:12:43.861 INFO:tasks.workunit.client.0.smithi077.stdout:4/138: write d3/dc/f1c [535313,108820] 0 2024-09-18T21:12:43.861 INFO:tasks.workunit.client.0.smithi077.stdout:6/242: fdatasync d7/f1c 0 2024-09-18T21:12:43.862 INFO:tasks.workunit.client.1.smithi103.stdout:6/197: dwrite d2/d3/d4/f2b [4194304,4194304] 0 2024-09-18T21:12:43.863 INFO:tasks.workunit.client.1.smithi103.stdout:4/129: stat d9/d1f/f30 0 2024-09-18T21:12:43.863 INFO:tasks.workunit.client.1.smithi103.stdout:1/144: dwrite d0/d2/fb [0,4194304] 0 2024-09-18T21:12:43.864 INFO:tasks.workunit.client.0.smithi077.stdout:7/291: symlink d12/d22/d59/l6a 0 2024-09-18T21:12:43.864 INFO:tasks.workunit.client.0.smithi077.stdout:6/243: fsync d7/df/d11/d25/f2b 0 2024-09-18T21:12:43.865 INFO:tasks.workunit.client.1.smithi103.stdout:1/145: chown d0/d11/d16/d19/f34 115 1 2024-09-18T21:12:43.866 INFO:tasks.workunit.client.1.smithi103.stdout:5/167: getdents de/d11 0 2024-09-18T21:12:43.866 INFO:tasks.workunit.client.1.smithi103.stdout:5/168: readlink de/l10 0 2024-09-18T21:12:43.867 INFO:tasks.workunit.client.0.smithi077.stdout:4/139: read d3/d7/f23 [1538513,15673] 0 2024-09-18T21:12:43.868 INFO:tasks.workunit.client.0.smithi077.stdout:2/188: dwrite d1/d20/d2c/f35 [0,4194304] 0 2024-09-18T21:12:43.869 INFO:tasks.workunit.client.1.smithi103.stdout:7/189: rename d1/fa to d1/df/d1d/d29/d2f/d33/f3a 0 2024-09-18T21:12:43.870 INFO:tasks.workunit.client.0.smithi077.stdout:2/189: stat d1/d20/d2c/f35 0 2024-09-18T21:12:43.876 INFO:tasks.workunit.client.1.smithi103.stdout:1/146: dwrite d0/d3/f29 [0,4194304] 0 2024-09-18T21:12:43.877 INFO:tasks.workunit.client.1.smithi103.stdout:4/130: unlink d9/f12 0 2024-09-18T21:12:43.878 INFO:tasks.workunit.client.1.smithi103.stdout:4/131: chown f5 10 1 2024-09-18T21:12:43.878 INFO:tasks.workunit.client.1.smithi103.stdout:4/132: readlink d9/l17 0 2024-09-18T21:12:43.879 INFO:tasks.workunit.client.1.smithi103.stdout:4/133: dread - d9/d1f/f30 zero size 2024-09-18T21:12:43.882 INFO:tasks.workunit.client.0.smithi077.stdout:4/140: creat d3/dc/d20/f2a x:0 0 0 2024-09-18T21:12:43.885 INFO:tasks.workunit.client.0.smithi077.stdout:2/190: creat d1/d20/f3f x:0 0 0 2024-09-18T21:12:43.886 INFO:tasks.workunit.client.0.smithi077.stdout:4/141: write d3/dc/f1b [351659,55569] 0 2024-09-18T21:12:43.886 INFO:tasks.workunit.client.0.smithi077.stdout:0/262: dwrite d8/f23 [0,4194304] 0 2024-09-18T21:12:43.887 INFO:tasks.workunit.client.0.smithi077.stdout:4/142: fsync d3/d7/f1a 0 2024-09-18T21:12:43.892 INFO:tasks.workunit.client.1.smithi103.stdout:3/129: rename d1/fc to d1/f24 0 2024-09-18T21:12:43.893 INFO:tasks.workunit.client.0.smithi077.stdout:1/156: getdents d3/d8/d13/d18/d22 0 2024-09-18T21:12:43.894 INFO:tasks.workunit.client.1.smithi103.stdout:3/130: write d1/da/f15 [4439941,93848] 0 2024-09-18T21:12:43.894 INFO:tasks.workunit.client.1.smithi103.stdout:1/147: mknod d0/d2/c38 0 2024-09-18T21:12:43.895 INFO:tasks.workunit.client.1.smithi103.stdout:1/148: rename d0/d11/d16 to d0/d11/d16/d39 22 2024-09-18T21:12:43.895 INFO:tasks.workunit.client.1.smithi103.stdout:3/131: dread d1/f13 [0,4194304] 0 2024-09-18T21:12:43.896 INFO:tasks.workunit.client.1.smithi103.stdout:4/134: mkdir d9/d1f/d31 0 2024-09-18T21:12:43.897 INFO:tasks.workunit.client.0.smithi077.stdout:4/143: dwrite d3/dc/f1b [0,4194304] 0 2024-09-18T21:12:43.897 INFO:tasks.workunit.client.0.smithi077.stdout:4/144: write d3/dc/f1c [962393,5017] 0 2024-09-18T21:12:43.898 INFO:tasks.workunit.client.0.smithi077.stdout:2/191: mkdir d1/d4/d5/d1a/d2e/d40 0 2024-09-18T21:12:43.899 INFO:tasks.workunit.client.0.smithi077.stdout:4/145: write d3/dc/f1c [144517,121252] 0 2024-09-18T21:12:43.901 INFO:tasks.workunit.client.0.smithi077.stdout:4/146: read - d3/dc/d20/f29 zero size 2024-09-18T21:12:43.901 INFO:tasks.workunit.client.1.smithi103.stdout:5/169: symlink de/d14/l3a 0 2024-09-18T21:12:43.902 INFO:tasks.workunit.client.1.smithi103.stdout:1/149: dwrite d0/d2/d9/dc/f15 [0,4194304] 0 2024-09-18T21:12:43.903 INFO:tasks.workunit.client.1.smithi103.stdout:7/190: getdents d1/df/d1d/d1f/d2e 0 2024-09-18T21:12:43.903 INFO:tasks.workunit.client.1.smithi103.stdout:0/173: sync 2024-09-18T21:12:43.903 INFO:tasks.workunit.client.1.smithi103.stdout:9/139: sync 2024-09-18T21:12:43.904 INFO:tasks.workunit.client.1.smithi103.stdout:9/140: fsync d18/f1b 0 2024-09-18T21:12:43.904 INFO:tasks.workunit.client.0.smithi077.stdout:1/157: unlink d3/d1e/f2d 0 2024-09-18T21:12:43.906 INFO:tasks.workunit.client.0.smithi077.stdout:0/263: rename d8/d26/l1e to d8/d37/l53 0 2024-09-18T21:12:43.907 INFO:tasks.workunit.client.0.smithi077.stdout:1/158: dread - d3/f2e zero size 2024-09-18T21:12:43.908 INFO:tasks.workunit.client.0.smithi077.stdout:7/292: getdents d12/d31 0 2024-09-18T21:12:43.909 INFO:tasks.workunit.client.1.smithi103.stdout:4/135: dread d9/f18 [0,4194304] 0 2024-09-18T21:12:43.910 INFO:tasks.workunit.client.0.smithi077.stdout:4/147: dwrite d3/d7/f1a [0,4194304] 0 2024-09-18T21:12:43.910 INFO:tasks.workunit.client.0.smithi077.stdout:1/159: dread - d3/d1e/f35 zero size 2024-09-18T21:12:43.910 INFO:tasks.workunit.client.1.smithi103.stdout:4/136: truncate d9/f23 562944 0 2024-09-18T21:12:43.911 INFO:tasks.workunit.client.1.smithi103.stdout:1/150: write d0/f37 [205958,103483] 0 2024-09-18T21:12:43.912 INFO:tasks.workunit.client.0.smithi077.stdout:1/160: read - d3/d8/d13/d18/d22/f2c zero size 2024-09-18T21:12:43.912 INFO:tasks.workunit.client.0.smithi077.stdout:7/293: chown d12/d22/d59/l6a 29 1 2024-09-18T21:12:43.913 INFO:tasks.workunit.client.1.smithi103.stdout:7/191: symlink d1/df/l3b 0 2024-09-18T21:12:43.913 INFO:tasks.workunit.client.1.smithi103.stdout:1/151: stat d0/d3/f29 0 2024-09-18T21:12:43.913 INFO:tasks.workunit.client.0.smithi077.stdout:0/264: truncate d8/d1a/d39/d3b/d4e/f52 1549647 0 2024-09-18T21:12:43.913 INFO:tasks.workunit.client.0.smithi077.stdout:7/294: chown d12/d31/d33/d2a/f4f 7092 1 2024-09-18T21:12:43.914 INFO:tasks.workunit.client.0.smithi077.stdout:4/148: write d3/d7/f23 [3363424,119371] 0 2024-09-18T21:12:43.915 INFO:tasks.workunit.client.1.smithi103.stdout:9/141: creat d18/d29/f2a x:0 0 0 2024-09-18T21:12:43.915 INFO:tasks.workunit.client.1.smithi103.stdout:9/142: stat l16 0 2024-09-18T21:12:43.916 INFO:tasks.workunit.client.1.smithi103.stdout:3/132: mkdir d1/d23/d25 0 2024-09-18T21:12:43.916 INFO:tasks.workunit.client.0.smithi077.stdout:1/161: creat d3/d1e/d32/f37 x:0 0 0 2024-09-18T21:12:43.918 INFO:tasks.workunit.client.0.smithi077.stdout:0/265: write d8/d1a/d39/f3c [1332424,3055] 0 2024-09-18T21:12:43.918 INFO:tasks.workunit.client.1.smithi103.stdout:4/137: creat d9/f32 x:0 0 0 2024-09-18T21:12:43.919 INFO:tasks.workunit.client.0.smithi077.stdout:4/149: creat d3/f2b x:0 0 0 2024-09-18T21:12:43.919 INFO:tasks.workunit.client.0.smithi077.stdout:1/162: write d3/d8/d13/d18/d22/f30 [183513,131069] 0 2024-09-18T21:12:43.920 INFO:tasks.workunit.client.1.smithi103.stdout:0/174: symlink d1/d5/de/l3a 0 2024-09-18T21:12:43.921 INFO:tasks.workunit.client.1.smithi103.stdout:7/192: dread d1/df/d1d/d1f/d2e/f37 [0,4194304] 0 2024-09-18T21:12:43.922 INFO:tasks.workunit.client.1.smithi103.stdout:1/152: mkdir d0/d2/d2b/d3a 0 2024-09-18T21:12:43.923 INFO:tasks.workunit.client.0.smithi077.stdout:1/163: fsync d3/f2a 0 2024-09-18T21:12:43.924 INFO:tasks.workunit.client.1.smithi103.stdout:3/133: fdatasync d1/d2/f8 0 2024-09-18T21:12:43.927 INFO:tasks.workunit.client.1.smithi103.stdout:3/134: write d1/da/f15 [4911039,104430] 0 2024-09-18T21:12:43.927 INFO:tasks.workunit.client.0.smithi077.stdout:7/295: rename d12/d31/d33/d2a/l2b to d12/d31/d33/d2a/l6b 0 2024-09-18T21:12:43.929 INFO:tasks.workunit.client.0.smithi077.stdout:0/266: dwrite d8/d1a/d39/d3b/d4e/f52 [0,4194304] 0 2024-09-18T21:12:43.929 INFO:tasks.workunit.client.1.smithi103.stdout:9/143: dwrite f1 [4194304,4194304] 0 2024-09-18T21:12:43.929 INFO:tasks.workunit.client.1.smithi103.stdout:4/138: dread f5 [4194304,4194304] 0 2024-09-18T21:12:43.930 INFO:tasks.workunit.client.1.smithi103.stdout:3/135: stat d1/da/f16 0 2024-09-18T21:12:43.930 INFO:tasks.workunit.client.0.smithi077.stdout:4/150: mknod d3/d17/c2c 0 2024-09-18T21:12:43.930 INFO:tasks.workunit.client.0.smithi077.stdout:0/267: stat d8/d1a/d35/f47 0 2024-09-18T21:12:43.931 INFO:tasks.workunit.client.0.smithi077.stdout:4/151: chown d3/f1f 0 1 2024-09-18T21:12:43.931 INFO:tasks.workunit.client.1.smithi103.stdout:2/168: truncate d3/d5/f11 1054165 0 2024-09-18T21:12:43.932 INFO:tasks.workunit.client.1.smithi103.stdout:8/168: sync 2024-09-18T21:12:43.933 INFO:tasks.workunit.client.1.smithi103.stdout:9/144: write d18/f1b [243944,24646] 0 2024-09-18T21:12:43.933 INFO:tasks.workunit.client.0.smithi077.stdout:1/164: mkdir d3/d38 0 2024-09-18T21:12:43.934 INFO:tasks.workunit.client.1.smithi103.stdout:4/139: chown d9/d1c/c2f 7 1 2024-09-18T21:12:43.936 INFO:tasks.workunit.client.0.smithi077.stdout:2/192: rename d1/d20 to d1/d4/d5/d1a/d2e/d41 0 2024-09-18T21:12:43.936 INFO:tasks.workunit.client.1.smithi103.stdout:9/145: read f1 [2508152,130727] 0 2024-09-18T21:12:43.937 INFO:tasks.workunit.client.0.smithi077.stdout:2/193: dread - d1/d4/d5/d1a/d2e/d41/f3f zero size 2024-09-18T21:12:43.938 INFO:tasks.workunit.client.1.smithi103.stdout:1/153: symlink d0/d2/d9/dc/l3b 0 2024-09-18T21:12:43.938 INFO:tasks.workunit.client.1.smithi103.stdout:5/170: dread de/d11/f19 [0,4194304] 0 2024-09-18T21:12:43.939 INFO:tasks.workunit.client.1.smithi103.stdout:9/146: dread - d18/d1f/f28 zero size 2024-09-18T21:12:43.940 INFO:tasks.workunit.client.1.smithi103.stdout:8/169: fsync d4/d2c/f31 0 2024-09-18T21:12:43.941 INFO:tasks.workunit.client.1.smithi103.stdout:6/198: dwrite d2/d3/f19 [0,4194304] 0 2024-09-18T21:12:43.942 INFO:tasks.workunit.client.1.smithi103.stdout:9/147: dread - d18/f25 zero size 2024-09-18T21:12:43.943 INFO:tasks.workunit.client.0.smithi077.stdout:7/296: rename d12/d31/d49 to d12/d31/d33/d2a/d6c 0 2024-09-18T21:12:43.944 INFO:tasks.workunit.client.0.smithi077.stdout:7/297: chown d12/c19 16597489 1 2024-09-18T21:12:43.945 INFO:tasks.workunit.client.1.smithi103.stdout:3/136: creat d1/d2/f26 x:0 0 0 2024-09-18T21:12:43.950 INFO:tasks.workunit.client.0.smithi077.stdout:4/152: rename d3/dc/l10 to d3/l2d 0 2024-09-18T21:12:43.950 INFO:tasks.workunit.client.1.smithi103.stdout:3/137: write d1/da/f22 [240332,84288] 0 2024-09-18T21:12:43.951 INFO:tasks.workunit.client.1.smithi103.stdout:4/140: dwrite d9/f14 [0,4194304] 0 2024-09-18T21:12:43.953 INFO:tasks.workunit.client.1.smithi103.stdout:4/141: chown d9/d1c 199 1 2024-09-18T21:12:43.955 INFO:tasks.workunit.client.0.smithi077.stdout:4/153: symlink d3/dc/l2e 0 2024-09-18T21:12:43.957 INFO:tasks.workunit.client.1.smithi103.stdout:8/170: dwrite d4/de/f16 [8388608,4194304] 0 2024-09-18T21:12:43.957 INFO:tasks.workunit.client.0.smithi077.stdout:7/298: creat d12/d22/d59/d5d/d62/f6d x:0 0 0 2024-09-18T21:12:43.958 INFO:tasks.workunit.client.1.smithi103.stdout:6/199: dwrite d2/d24/f3b [0,4194304] 0 2024-09-18T21:12:43.959 INFO:tasks.workunit.client.0.smithi077.stdout:7/299: truncate d12/d22/d39/f3b 2917022 0 2024-09-18T21:12:43.960 INFO:tasks.workunit.client.1.smithi103.stdout:5/171: mkdir de/d1f/d3b 0 2024-09-18T21:12:43.960 INFO:tasks.workunit.client.0.smithi077.stdout:2/194: creat d1/f42 x:0 0 0 2024-09-18T21:12:43.962 INFO:tasks.workunit.client.0.smithi077.stdout:4/154: fdatasync d3/d17/f28 0 2024-09-18T21:12:43.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:43 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:12:43.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:43 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:12:43.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:43 smithi077 ceph-mon[27689]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:12:43.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:43 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:12:43.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:43 smithi077 ceph-mon[27689]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:12:43.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:43 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:12:43.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:43 smithi077 ceph-mon[27689]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:12:43.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:43 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:12:43.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:43 smithi077 ceph-mon[27689]: Adjusting osd_memory_target on smithi077 to 1557M 2024-09-18T21:12:43.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:43 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:12:43.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:43 smithi077 ceph-mon[27689]: pgmap v13: 65 pgs: 65 active+clean; 413 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 287 KiB/s rd, 27 MiB/s wr, 181 op/s 2024-09-18T21:12:43.963 INFO:tasks.workunit.client.0.smithi077.stdout:4/155: chown d3/dc/d24 671652943 1 2024-09-18T21:12:43.965 INFO:tasks.workunit.client.1.smithi103.stdout:8/171: dread d4/d2c/f31 [0,4194304] 0 2024-09-18T21:12:43.965 INFO:tasks.workunit.client.1.smithi103.stdout:5/172: dread de/d1f/f24 [0,4194304] 0 2024-09-18T21:12:43.967 INFO:tasks.workunit.client.1.smithi103.stdout:8/172: truncate d4/d2c/f37 246496 0 2024-09-18T21:12:43.967 INFO:tasks.workunit.client.0.smithi077.stdout:7/300: dwrite fa [0,4194304] 0 2024-09-18T21:12:43.970 INFO:tasks.workunit.client.0.smithi077.stdout:2/195: creat d1/d4/d5/d1a/d2e/f43 x:0 0 0 2024-09-18T21:12:43.972 INFO:tasks.workunit.client.1.smithi103.stdout:9/148: symlink d18/l2b 0 2024-09-18T21:12:43.973 INFO:tasks.workunit.client.1.smithi103.stdout:2/169: mkdir d3/d5/d25/d40 0 2024-09-18T21:12:43.973 INFO:tasks.workunit.client.1.smithi103.stdout:9/149: stat f1 0 2024-09-18T21:12:43.974 INFO:tasks.workunit.client.1.smithi103.stdout:9/150: fsync d18/d29/f2a 0 2024-09-18T21:12:43.976 INFO:tasks.workunit.client.0.smithi077.stdout:4/156: dwrite d3/dc/d20/f2a [0,4194304] 0 2024-09-18T21:12:43.978 INFO:tasks.workunit.client.0.smithi077.stdout:7/301: rename d12/d22/l58 to d12/d31/l6e 0 2024-09-18T21:12:43.982 INFO:tasks.workunit.client.0.smithi077.stdout:0/268: dwrite d8/fb [4194304,4194304] 0 2024-09-18T21:12:43.984 INFO:tasks.workunit.client.1.smithi103.stdout:7/193: rmdir d1/df/d1d/d29/d2f/d33/d39 0 2024-09-18T21:12:43.984 INFO:tasks.workunit.client.1.smithi103.stdout:7/194: readlink d1/df/l3b 0 2024-09-18T21:12:43.986 INFO:tasks.workunit.client.1.smithi103.stdout:7/195: stat d1/df/f22 0 2024-09-18T21:12:43.987 INFO:tasks.workunit.client.1.smithi103.stdout:4/142: creat d9/d1a/d21/f33 x:0 0 0 2024-09-18T21:12:43.989 INFO:tasks.workunit.client.1.smithi103.stdout:4/143: write d9/f23 [197380,40460] 0 2024-09-18T21:12:43.989 INFO:tasks.workunit.client.0.smithi077.stdout:7/302: unlink d12/c1a 0 2024-09-18T21:12:43.990 INFO:tasks.workunit.client.1.smithi103.stdout:0/175: truncate d1/d9/d13/f14 380625 0 2024-09-18T21:12:43.990 INFO:tasks.workunit.client.1.smithi103.stdout:4/144: fdatasync d9/f11 0 2024-09-18T21:12:43.991 INFO:tasks.workunit.client.1.smithi103.stdout:1/154: mknod d0/d2/d9/dc/d36/c3c 0 2024-09-18T21:12:43.992 INFO:tasks.workunit.client.0.smithi077.stdout:2/196: link d1/fd d1/d4/d5/d1a/d2e/d40/f44 0 2024-09-18T21:12:43.992 INFO:tasks.workunit.client.1.smithi103.stdout:7/196: dread d1/df/f20 [0,4194304] 0 2024-09-18T21:12:43.994 INFO:tasks.workunit.client.0.smithi077.stdout:0/269: creat d8/d26/f54 x:0 0 0 2024-09-18T21:12:43.996 INFO:tasks.workunit.client.0.smithi077.stdout:1/165: symlink d3/d8/d13/l39 0 2024-09-18T21:12:43.997 INFO:tasks.workunit.client.1.smithi103.stdout:4/145: dwrite d9/d1a/d21/f33 [0,4194304] 0 2024-09-18T21:12:43.998 INFO:tasks.workunit.client.0.smithi077.stdout:0/270: dread d8/f2d [0,4194304] 0 2024-09-18T21:12:43.998 INFO:tasks.workunit.client.1.smithi103.stdout:8/173: rename d4/d26/l30 to d4/d2c/d39/l40 0 2024-09-18T21:12:43.998 INFO:tasks.workunit.client.0.smithi077.stdout:0/271: readlink d8/d1d/l49 0 2024-09-18T21:12:43.999 INFO:tasks.workunit.client.1.smithi103.stdout:8/174: truncate d4/d2c/f37 775919 0 2024-09-18T21:12:44.000 INFO:tasks.workunit.client.1.smithi103.stdout:3/138: symlink d1/l27 0 2024-09-18T21:12:44.001 INFO:tasks.workunit.client.1.smithi103.stdout:8/175: stat d4/de/c38 0 2024-09-18T21:12:44.002 INFO:tasks.workunit.client.1.smithi103.stdout:3/139: fdatasync d1/da/f15 0 2024-09-18T21:12:44.002 INFO:tasks.workunit.client.1.smithi103.stdout:3/140: stat d1/d2 0 2024-09-18T21:12:44.005 INFO:tasks.workunit.client.1.smithi103.stdout:6/200: symlink d2/l3f 0 2024-09-18T21:12:44.005 INFO:tasks.workunit.client.1.smithi103.stdout:6/201: chown d2/d24/d38 2635950 1 2024-09-18T21:12:44.007 INFO:tasks.workunit.client.0.smithi077.stdout:1/166: read - d3/f2a zero size 2024-09-18T21:12:44.007 INFO:tasks.workunit.client.1.smithi103.stdout:1/155: creat d0/d2/f3d x:0 0 0 2024-09-18T21:12:44.008 INFO:tasks.workunit.client.1.smithi103.stdout:0/176: creat d1/d5/de/d22/f3b x:0 0 0 2024-09-18T21:12:44.011 INFO:tasks.workunit.client.0.smithi077.stdout:1/167: truncate d3/f23 1014638 0 2024-09-18T21:12:44.011 INFO:tasks.workunit.client.0.smithi077.stdout:0/272: unlink d8/f30 0 2024-09-18T21:12:44.013 INFO:tasks.workunit.client.0.smithi077.stdout:0/273: write d8/d1a/f4b [357670,13723] 0 2024-09-18T21:12:44.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:43 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:12:44.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:43 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:12:44.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:43 smithi103 ceph-mon[34827]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:12:44.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:43 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:12:44.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:43 smithi103 ceph-mon[34827]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:12:44.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:43 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:12:44.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:43 smithi103 ceph-mon[34827]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:12:44.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:43 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:12:44.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:43 smithi103 ceph-mon[34827]: Adjusting osd_memory_target on smithi077 to 1557M 2024-09-18T21:12:44.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:43 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:12:44.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:43 smithi103 ceph-mon[34827]: pgmap v13: 65 pgs: 65 active+clean; 413 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 287 KiB/s rd, 27 MiB/s wr, 181 op/s 2024-09-18T21:12:44.014 INFO:tasks.workunit.client.1.smithi103.stdout:4/146: mknod d9/c34 0 2024-09-18T21:12:44.015 INFO:tasks.workunit.client.1.smithi103.stdout:4/147: write d9/d1f/f30 [1009852,34068] 0 2024-09-18T21:12:44.016 INFO:tasks.workunit.client.1.smithi103.stdout:2/170: rename d3/d5/l13 to d3/d5/d25/l41 0 2024-09-18T21:12:44.017 INFO:tasks.workunit.client.1.smithi103.stdout:2/171: fsync d3/f9 0 2024-09-18T21:12:44.018 INFO:tasks.workunit.client.1.smithi103.stdout:2/172: write d3/f8 [609509,34236] 0 2024-09-18T21:12:44.018 INFO:tasks.workunit.client.0.smithi077.stdout:7/303: dread fb [0,4194304] 0 2024-09-18T21:12:44.020 INFO:tasks.workunit.client.0.smithi077.stdout:0/274: creat d8/d1d/f55 x:0 0 0 2024-09-18T21:12:44.021 INFO:tasks.workunit.client.0.smithi077.stdout:0/275: write d8/d1a/f51 [477665,97257] 0 2024-09-18T21:12:44.021 INFO:tasks.workunit.client.0.smithi077.stdout:0/276: fdatasync d8/f19 0 2024-09-18T21:12:44.022 INFO:tasks.workunit.client.0.smithi077.stdout:1/168: mknod d3/c3a 0 2024-09-18T21:12:44.024 INFO:tasks.workunit.client.0.smithi077.stdout:7/304: mknod d12/d22/d59/d5d/d62/c6f 0 2024-09-18T21:12:44.025 INFO:tasks.workunit.client.1.smithi103.stdout:3/141: write d1/f24 [2592539,81432] 0 2024-09-18T21:12:44.026 INFO:tasks.workunit.client.0.smithi077.stdout:4/157: truncate d3/dc/f16 1003981 0 2024-09-18T21:12:44.029 INFO:tasks.workunit.client.1.smithi103.stdout:6/202: symlink d2/d3/d4/l40 0 2024-09-18T21:12:44.029 INFO:tasks.workunit.client.1.smithi103.stdout:6/203: write d2/f34 [5185907,88505] 0 2024-09-18T21:12:44.030 INFO:tasks.workunit.client.1.smithi103.stdout:1/156: mknod d0/d2/d9/dc/c3e 0 2024-09-18T21:12:44.031 INFO:tasks.workunit.client.1.smithi103.stdout:6/204: write d2/d3/d4/f2b [8509309,115751] 0 2024-09-18T21:12:44.031 INFO:tasks.workunit.client.1.smithi103.stdout:1/157: fsync d0/f7 0 2024-09-18T21:12:44.031 INFO:tasks.workunit.client.0.smithi077.stdout:7/305: creat d12/d22/d59/d5a/f70 x:0 0 0 2024-09-18T21:12:44.032 INFO:tasks.workunit.client.0.smithi077.stdout:4/158: mknod d3/d7/c2f 0 2024-09-18T21:12:44.034 INFO:tasks.workunit.client.0.smithi077.stdout:1/169: creat d3/d1e/f3b x:0 0 0 2024-09-18T21:12:44.036 INFO:tasks.workunit.client.0.smithi077.stdout:2/197: dwrite d1/d4/f22 [0,4194304] 0 2024-09-18T21:12:44.036 INFO:tasks.workunit.client.0.smithi077.stdout:7/306: dread d12/d22/d39/f57 [0,4194304] 0 2024-09-18T21:12:44.036 INFO:tasks.workunit.client.1.smithi103.stdout:7/197: write d1/fe [4798295,106771] 0 2024-09-18T21:12:44.037 INFO:tasks.workunit.client.0.smithi077.stdout:4/159: mknod d3/c30 0 2024-09-18T21:12:44.038 INFO:tasks.workunit.client.0.smithi077.stdout:4/160: write d3/f26 [302257,116652] 0 2024-09-18T21:12:44.040 INFO:tasks.workunit.client.1.smithi103.stdout:4/148: dwrite f5 [4194304,4194304] 0 2024-09-18T21:12:44.040 INFO:tasks.workunit.client.0.smithi077.stdout:4/161: write d3/dc/d20/f2a [3294552,44799] 0 2024-09-18T21:12:44.041 INFO:tasks.workunit.client.1.smithi103.stdout:9/151: rename d18/l2b to d18/d29/l2c 0 2024-09-18T21:12:44.044 INFO:tasks.workunit.client.0.smithi077.stdout:7/307: mknod d12/d22/d59/d5d/c71 0 2024-09-18T21:12:44.044 INFO:tasks.workunit.client.0.smithi077.stdout:7/308: write d12/d22/f65 [718921,98016] 0 2024-09-18T21:12:44.046 INFO:tasks.workunit.client.0.smithi077.stdout:7/309: truncate d12/d22/d59/d5a/f70 570831 0 2024-09-18T21:12:44.047 INFO:tasks.workunit.client.1.smithi103.stdout:3/142: symlink d1/d2/d18/l28 0 2024-09-18T21:12:44.047 INFO:tasks.workunit.client.0.smithi077.stdout:0/277: rmdir d8 39 2024-09-18T21:12:44.049 INFO:tasks.workunit.client.1.smithi103.stdout:3/143: write d1/da/f22 [464587,28543] 0 2024-09-18T21:12:44.050 INFO:tasks.workunit.client.0.smithi077.stdout:1/170: unlink d3/d8/d13/d18/c20 0 2024-09-18T21:12:44.051 INFO:tasks.workunit.client.1.smithi103.stdout:3/144: fdatasync d1/d2/fb 0 2024-09-18T21:12:44.053 INFO:tasks.workunit.client.1.smithi103.stdout:4/149: dwrite d9/f32 [0,4194304] 0 2024-09-18T21:12:44.054 INFO:tasks.workunit.client.1.smithi103.stdout:9/152: dwrite fa [0,4194304] 0 2024-09-18T21:12:44.054 INFO:tasks.workunit.client.1.smithi103.stdout:3/145: fsync d1/f24 0 2024-09-18T21:12:44.056 INFO:tasks.workunit.client.0.smithi077.stdout:7/310: rmdir d12/d31/d33/d2a 39 2024-09-18T21:12:44.056 INFO:tasks.workunit.client.0.smithi077.stdout:7/311: stat f10 0 2024-09-18T21:12:44.057 INFO:tasks.workunit.client.0.smithi077.stdout:7/312: chown d12/d22/c4d 5115560 1 2024-09-18T21:12:44.057 INFO:tasks.workunit.client.1.smithi103.stdout:1/158: fdatasync d0/d11/f2d 0 2024-09-18T21:12:44.058 INFO:tasks.workunit.client.0.smithi077.stdout:7/313: chown d12/d22/f28 12 1 2024-09-18T21:12:44.059 INFO:tasks.workunit.client.1.smithi103.stdout:1/159: write d0/d2/fb [4458468,40901] 0 2024-09-18T21:12:44.060 INFO:tasks.workunit.client.1.smithi103.stdout:4/150: dread f5 [4194304,4194304] 0 2024-09-18T21:12:44.062 INFO:tasks.workunit.client.0.smithi077.stdout:1/171: creat d3/d1e/d32/f3c x:0 0 0 2024-09-18T21:12:44.063 INFO:tasks.workunit.client.1.smithi103.stdout:6/205: symlink d2/d3/d4/l41 0 2024-09-18T21:12:44.063 INFO:tasks.workunit.client.1.smithi103.stdout:5/173: getdents de 0 2024-09-18T21:12:44.065 INFO:tasks.workunit.client.0.smithi077.stdout:3/159: sync 2024-09-18T21:12:44.065 INFO:tasks.workunit.client.1.smithi103.stdout:8/176: rename d4/de/l13 to d4/d2d/d3d/l41 0 2024-09-18T21:12:44.067 INFO:tasks.workunit.client.0.smithi077.stdout:7/314: rename d12/d22/d39 to d12/d22/d59/d72 0 2024-09-18T21:12:44.067 INFO:tasks.workunit.client.0.smithi077.stdout:0/278: rmdir d8/d37 39 2024-09-18T21:12:44.068 INFO:tasks.workunit.client.0.smithi077.stdout:7/315: read f1 [8408776,28489] 0 2024-09-18T21:12:44.069 INFO:tasks.workunit.client.1.smithi103.stdout:2/173: symlink d3/d5/l42 0 2024-09-18T21:12:44.069 INFO:tasks.workunit.client.1.smithi103.stdout:7/198: dwrite d1/f15 [4194304,4194304] 0 2024-09-18T21:12:44.069 INFO:tasks.workunit.client.0.smithi077.stdout:1/172: mkdir d3/d8/d13/d18/d22/d3d 0 2024-09-18T21:12:44.070 INFO:tasks.workunit.client.0.smithi077.stdout:3/160: dread fa [0,4194304] 0 2024-09-18T21:12:44.070 INFO:tasks.workunit.client.1.smithi103.stdout:2/174: read d3/d5/f18 [2905439,49087] 0 2024-09-18T21:12:44.071 INFO:tasks.workunit.client.1.smithi103.stdout:7/199: write d1/f17 [1550040,48283] 0 2024-09-18T21:12:44.074 INFO:tasks.workunit.client.0.smithi077.stdout:2/198: getdents d1/d4/d5/d1a 0 2024-09-18T21:12:44.076 INFO:tasks.workunit.client.0.smithi077.stdout:0/279: dwrite d8/d1d/f2b [0,4194304] 0 2024-09-18T21:12:44.079 INFO:tasks.workunit.client.1.smithi103.stdout:7/200: dwrite d1/f1b [0,4194304] 0 2024-09-18T21:12:44.084 INFO:tasks.workunit.client.0.smithi077.stdout:1/173: mkdir d3/d1e/d32/d3e 0 2024-09-18T21:12:44.085 INFO:tasks.workunit.client.0.smithi077.stdout:4/162: link d3/l6 d3/dc/d24/l31 0 2024-09-18T21:12:44.085 INFO:tasks.workunit.client.1.smithi103.stdout:9/153: creat d18/d29/f2d x:0 0 0 2024-09-18T21:12:44.085 INFO:tasks.workunit.client.0.smithi077.stdout:4/163: fdatasync d3/f26 0 2024-09-18T21:12:44.086 INFO:tasks.workunit.client.0.smithi077.stdout:1/174: truncate d3/d8/d13/d18/f1a 4386864 0 2024-09-18T21:12:44.087 INFO:tasks.workunit.client.1.smithi103.stdout:3/146: creat d1/d2/d18/f29 x:0 0 0 2024-09-18T21:12:44.087 INFO:tasks.workunit.client.0.smithi077.stdout:4/164: write d3/f2b [18438,39710] 0 2024-09-18T21:12:44.087 INFO:tasks.workunit.client.0.smithi077.stdout:3/161: creat db/d14/d32/f38 x:0 0 0 2024-09-18T21:12:44.088 INFO:tasks.workunit.client.1.smithi103.stdout:3/147: chown d1/d2/f26 11169 1 2024-09-18T21:12:44.088 INFO:tasks.workunit.client.1.smithi103.stdout:3/148: chown d1/da/ld 401 1 2024-09-18T21:12:44.090 INFO:tasks.workunit.client.1.smithi103.stdout:1/160: mknod d0/d2/c3f 0 2024-09-18T21:12:44.092 INFO:tasks.workunit.client.0.smithi077.stdout:2/199: write d1/d4/d5/d1a/d2e/f34 [949961,111365] 0 2024-09-18T21:12:44.093 INFO:tasks.workunit.client.1.smithi103.stdout:6/206: readlink d2/l37 0 2024-09-18T21:12:44.094 INFO:tasks.workunit.client.0.smithi077.stdout:3/162: dread db/d14/f1d [0,4194304] 0 2024-09-18T21:12:44.096 INFO:tasks.workunit.client.0.smithi077.stdout:3/163: stat db/d14/d22/f2f 0 2024-09-18T21:12:44.096 INFO:tasks.workunit.client.0.smithi077.stdout:4/165: dwrite d3/f5 [0,4194304] 0 2024-09-18T21:12:44.099 INFO:tasks.workunit.client.1.smithi103.stdout:8/177: mkdir d4/d2d/d3d/d42 0 2024-09-18T21:12:44.100 INFO:tasks.workunit.client.1.smithi103.stdout:8/178: write d4/de/f16 [12458615,109860] 0 2024-09-18T21:12:44.104 INFO:tasks.workunit.client.0.smithi077.stdout:1/175: symlink d3/d8/d13/d18/l3f 0 2024-09-18T21:12:44.106 INFO:tasks.workunit.client.1.smithi103.stdout:0/177: getdents d1/d9 0 2024-09-18T21:12:44.107 INFO:tasks.workunit.client.1.smithi103.stdout:9/154: rename d18/f25 to d18/d1f/f2e 0 2024-09-18T21:12:44.108 INFO:tasks.workunit.client.1.smithi103.stdout:8/179: dwrite d4/d26/f1a [4194304,4194304] 0 2024-09-18T21:12:44.109 INFO:tasks.workunit.client.1.smithi103.stdout:3/149: creat d1/d23/f2a x:0 0 0 2024-09-18T21:12:44.109 INFO:tasks.workunit.client.0.smithi077.stdout:7/316: creat d12/f73 x:0 0 0 2024-09-18T21:12:44.110 INFO:tasks.workunit.client.0.smithi077.stdout:7/317: write fa [523027,92234] 0 2024-09-18T21:12:44.110 INFO:tasks.workunit.client.1.smithi103.stdout:1/161: fsync d0/d11/f35 0 2024-09-18T21:12:44.113 INFO:tasks.workunit.client.1.smithi103.stdout:6/207: creat d2/d3/d8/f42 x:0 0 0 2024-09-18T21:12:44.115 INFO:tasks.workunit.client.1.smithi103.stdout:5/174: mkdir de/d1f/d3b/d3c 0 2024-09-18T21:12:44.115 INFO:tasks.workunit.client.1.smithi103.stdout:1/162: dread d0/d3/f1a [0,4194304] 0 2024-09-18T21:12:44.116 INFO:tasks.workunit.client.1.smithi103.stdout:1/163: fdatasync d0/d3/f20 0 2024-09-18T21:12:44.117 INFO:tasks.workunit.client.0.smithi077.stdout:2/200: unlink d1/d4/d5/d1a/d2e/d41/c33 0 2024-09-18T21:12:44.118 INFO:tasks.workunit.client.0.smithi077.stdout:3/164: mkdir db/d14/d22/d36/d39 0 2024-09-18T21:12:44.122 INFO:tasks.workunit.client.1.smithi103.stdout:9/155: mkdir d18/d1f/d2f 0 2024-09-18T21:12:44.123 INFO:tasks.workunit.client.1.smithi103.stdout:8/180: creat d4/de/f43 x:0 0 0 2024-09-18T21:12:44.124 INFO:tasks.workunit.client.1.smithi103.stdout:0/178: dread d1/d5/de/d19/d1e/f21 [0,4194304] 0 2024-09-18T21:12:44.125 INFO:tasks.workunit.client.0.smithi077.stdout:1/176: symlink d3/d8/l40 0 2024-09-18T21:12:44.125 INFO:tasks.workunit.client.0.smithi077.stdout:1/177: dread - d3/d1e/f31 zero size 2024-09-18T21:12:44.126 INFO:tasks.workunit.client.0.smithi077.stdout:0/280: getdents d8/d1d 0 2024-09-18T21:12:44.128 INFO:tasks.workunit.client.0.smithi077.stdout:2/201: unlink d1/d4/d5/d1a/d2e/d41/d2c/f2d 0 2024-09-18T21:12:44.130 INFO:tasks.workunit.client.0.smithi077.stdout:2/202: write d1/d4/f22 [3335583,109839] 0 2024-09-18T21:12:44.130 INFO:tasks.workunit.client.1.smithi103.stdout:1/164: mknod d0/d3/c40 0 2024-09-18T21:12:44.130 INFO:tasks.workunit.client.1.smithi103.stdout:9/156: dwrite d18/d1f/f28 [0,4194304] 0 2024-09-18T21:12:44.130 INFO:tasks.workunit.client.0.smithi077.stdout:3/165: readlink db/l26 0 2024-09-18T21:12:44.131 INFO:tasks.workunit.client.0.smithi077.stdout:3/166: chown db/c2d 19111 1 2024-09-18T21:12:44.131 INFO:tasks.workunit.client.1.smithi103.stdout:9/157: chown d18/d29/l26 692588 1 2024-09-18T21:12:44.132 INFO:tasks.workunit.client.1.smithi103.stdout:8/181: mkdir d4/d2d/d44 0 2024-09-18T21:12:44.133 INFO:tasks.workunit.client.1.smithi103.stdout:3/150: symlink d1/l2b 0 2024-09-18T21:12:44.136 INFO:tasks.workunit.client.1.smithi103.stdout:4/151: getdents d9/d1f 0 2024-09-18T21:12:44.136 INFO:tasks.workunit.client.0.smithi077.stdout:0/281: mkdir d8/d1a/d39/d56 0 2024-09-18T21:12:44.136 INFO:tasks.workunit.client.1.smithi103.stdout:4/152: chown d9/d2e 46500 1 2024-09-18T21:12:44.137 INFO:tasks.workunit.client.1.smithi103.stdout:6/208: dread d2/f28 [0,4194304] 0 2024-09-18T21:12:44.138 INFO:tasks.workunit.client.0.smithi077.stdout:4/166: truncate d3/f5 2776642 0 2024-09-18T21:12:44.141 INFO:tasks.workunit.client.0.smithi077.stdout:0/282: dwrite f5 [0,4194304] 0 2024-09-18T21:12:44.142 INFO:tasks.workunit.client.1.smithi103.stdout:5/175: write de/d1f/f24 [367586,23040] 0 2024-09-18T21:12:44.143 INFO:tasks.workunit.client.1.smithi103.stdout:9/158: rename l9 to d18/l30 0 2024-09-18T21:12:44.144 INFO:tasks.workunit.client.0.smithi077.stdout:3/167: mkdir db/d14/d32/d3a 0 2024-09-18T21:12:44.145 INFO:tasks.workunit.client.1.smithi103.stdout:8/182: write d4/d26/f8 [3608448,13397] 0 2024-09-18T21:12:44.145 INFO:tasks.workunit.client.0.smithi077.stdout:3/168: fdatasync f5 0 2024-09-18T21:12:44.146 INFO:tasks.workunit.client.0.smithi077.stdout:3/169: write db/f2e [28053,22876] 0 2024-09-18T21:12:44.147 INFO:tasks.workunit.client.1.smithi103.stdout:8/183: truncate d4/d26/f1a 8921595 0 2024-09-18T21:12:44.148 INFO:tasks.workunit.client.1.smithi103.stdout:6/209: unlink d2/d3/d8/c3d 0 2024-09-18T21:12:44.149 INFO:tasks.workunit.client.1.smithi103.stdout:5/176: dwrite de/d1f/f23 [0,4194304] 0 2024-09-18T21:12:44.149 INFO:tasks.workunit.client.0.smithi077.stdout:2/203: symlink d1/d4/d5/d1a/d2e/d40/l45 0 2024-09-18T21:12:44.151 INFO:tasks.workunit.client.0.smithi077.stdout:9/134: sync 2024-09-18T21:12:44.151 INFO:tasks.workunit.client.0.smithi077.stdout:8/137: sync 2024-09-18T21:12:44.151 INFO:tasks.workunit.client.1.smithi103.stdout:5/177: dread - de/d14/f18 zero size 2024-09-18T21:12:44.151 INFO:tasks.workunit.client.0.smithi077.stdout:0/283: unlink d8/fb 0 2024-09-18T21:12:44.156 INFO:tasks.workunit.client.1.smithi103.stdout:4/153: creat d9/d1a/d2b/f35 x:0 0 0 2024-09-18T21:12:44.158 INFO:tasks.workunit.client.1.smithi103.stdout:6/210: dwrite d2/d3/d8/f2d [0,4194304] 0 2024-09-18T21:12:44.159 INFO:tasks.workunit.client.1.smithi103.stdout:8/184: symlink d4/d2c/l45 0 2024-09-18T21:12:44.159 INFO:tasks.workunit.client.1.smithi103.stdout:8/185: fsync d4/d2d/f33 0 2024-09-18T21:12:44.160 INFO:tasks.workunit.client.1.smithi103.stdout:9/159: creat d18/d1f/d2f/f31 x:0 0 0 2024-09-18T21:12:44.162 INFO:tasks.workunit.client.0.smithi077.stdout:3/170: dread db/d14/f1d [0,4194304] 0 2024-09-18T21:12:44.162 INFO:tasks.workunit.client.1.smithi103.stdout:8/186: write d4/d2c/f31 [1242923,130115] 0 2024-09-18T21:12:44.162 INFO:tasks.workunit.client.0.smithi077.stdout:3/171: chown db/f13 5 1 2024-09-18T21:12:44.163 INFO:tasks.workunit.client.1.smithi103.stdout:5/178: symlink de/d11/d15/l3d 0 2024-09-18T21:12:44.163 INFO:tasks.workunit.client.1.smithi103.stdout:9/160: write d18/d1f/d2f/f31 [923179,77462] 0 2024-09-18T21:12:44.167 INFO:tasks.workunit.client.1.smithi103.stdout:3/151: link d1/d2/l1a d1/da/df/l2c 0 2024-09-18T21:12:44.169 INFO:tasks.workunit.client.1.smithi103.stdout:6/211: mkdir d2/d3/d4/d43 0 2024-09-18T21:12:44.169 INFO:tasks.workunit.client.1.smithi103.stdout:1/165: dwrite d0/d2/d9/f2f [0,4194304] 0 2024-09-18T21:12:44.170 INFO:tasks.workunit.client.1.smithi103.stdout:3/152: truncate d1/f24 4406853 0 2024-09-18T21:12:44.172 INFO:tasks.workunit.client.1.smithi103.stdout:6/212: chown d2/d3/d4/d43 408484 1 2024-09-18T21:12:44.172 INFO:tasks.workunit.client.0.smithi077.stdout:8/138: fdatasync d2/d5/d6/f8 0 2024-09-18T21:12:44.173 INFO:tasks.workunit.client.0.smithi077.stdout:8/139: write d2/d5/d6/d22/d20/f24 [505756,124959] 0 2024-09-18T21:12:44.175 INFO:tasks.workunit.client.0.smithi077.stdout:7/318: getdents d12/d31/d33/d2a 0 2024-09-18T21:12:44.177 INFO:tasks.workunit.client.1.smithi103.stdout:8/187: dwrite d4/d26/f1a [0,4194304] 0 2024-09-18T21:12:44.178 INFO:tasks.workunit.client.0.smithi077.stdout:1/178: getdents d3/d8/d13/d18/d22 0 2024-09-18T21:12:44.180 INFO:tasks.workunit.client.0.smithi077.stdout:7/319: dread d12/f1f [0,4194304] 0 2024-09-18T21:12:44.180 INFO:tasks.workunit.client.1.smithi103.stdout:5/179: rename de/d11 to de/d3e 0 2024-09-18T21:12:44.181 INFO:tasks.workunit.client.0.smithi077.stdout:4/167: truncate d3/fb 6848465 0 2024-09-18T21:12:44.182 INFO:tasks.workunit.client.1.smithi103.stdout:8/188: read f2 [1354348,127551] 0 2024-09-18T21:12:44.183 INFO:tasks.workunit.client.1.smithi103.stdout:3/153: dwrite d1/da/df/f14 [4194304,4194304] 0 2024-09-18T21:12:44.185 INFO:tasks.workunit.client.1.smithi103.stdout:1/166: creat d0/d2/d2b/f41 x:0 0 0 2024-09-18T21:12:44.185 INFO:tasks.workunit.client.1.smithi103.stdout:6/213: dwrite d2/d24/f3b [0,4194304] 0 2024-09-18T21:12:44.188 INFO:tasks.workunit.client.0.smithi077.stdout:0/284: rmdir d8/d37 39 2024-09-18T21:12:44.189 INFO:tasks.workunit.client.1.smithi103.stdout:4/154: truncate d9/f14 845932 0 2024-09-18T21:12:44.193 INFO:tasks.workunit.client.1.smithi103.stdout:5/180: stat de/ff 0 2024-09-18T21:12:44.195 INFO:tasks.workunit.client.0.smithi077.stdout:1/179: mknod d3/d1e/d32/c41 0 2024-09-18T21:12:44.196 INFO:tasks.workunit.client.1.smithi103.stdout:3/154: mknod d1/d2/d18/c2d 0 2024-09-18T21:12:44.199 INFO:tasks.workunit.client.0.smithi077.stdout:3/172: mkdir db/d14/d32/d3a/d3b 0 2024-09-18T21:12:44.200 INFO:tasks.workunit.client.0.smithi077.stdout:4/168: mkdir d3/dc/d32 0 2024-09-18T21:12:44.200 INFO:tasks.workunit.client.0.smithi077.stdout:3/173: chown f4 8119 1 2024-09-18T21:12:44.201 INFO:tasks.workunit.client.0.smithi077.stdout:8/140: dread d2/d5/d6/f21 [0,4194304] 0 2024-09-18T21:12:44.201 INFO:tasks.workunit.client.0.smithi077.stdout:7/320: read f1 [3312726,48579] 0 2024-09-18T21:12:44.203 INFO:tasks.workunit.client.1.smithi103.stdout:3/155: dwrite d1/d2/f26 [0,4194304] 0 2024-09-18T21:12:44.205 INFO:tasks.workunit.client.1.smithi103.stdout:4/155: symlink d9/d1c/l36 0 2024-09-18T21:12:44.205 INFO:tasks.workunit.client.0.smithi077.stdout:2/204: truncate d1/d4/d9/fb 478034 0 2024-09-18T21:12:44.210 INFO:tasks.workunit.client.1.smithi103.stdout:9/161: truncate d18/d1f/f21 225843 0 2024-09-18T21:12:44.213 INFO:tasks.workunit.client.0.smithi077.stdout:3/174: write db/d14/d22/f30 [1082519,4006] 0 2024-09-18T21:12:44.214 INFO:tasks.workunit.client.1.smithi103.stdout:1/167: mkdir d0/d2/d2b/d3a/d42 0 2024-09-18T21:12:44.214 INFO:tasks.workunit.client.1.smithi103.stdout:3/156: dwrite d1/da/f22 [0,4194304] 0 2024-09-18T21:12:44.214 INFO:tasks.workunit.client.1.smithi103.stdout:8/189: write d4/d26/fb [327773,121765] 0 2024-09-18T21:12:44.215 INFO:tasks.workunit.client.0.smithi077.stdout:9/135: getdents d1/dd 0 2024-09-18T21:12:44.217 INFO:tasks.workunit.client.1.smithi103.stdout:4/156: dwrite d9/d1a/f1e [0,4194304] 0 2024-09-18T21:12:44.219 INFO:tasks.workunit.client.1.smithi103.stdout:4/157: readlink d9/lf 0 2024-09-18T21:12:44.221 INFO:tasks.workunit.client.0.smithi077.stdout:3/175: dwrite db/d14/f18 [0,4194304] 0 2024-09-18T21:12:44.221 INFO:tasks.workunit.client.1.smithi103.stdout:4/158: write d9/fc [3765229,82993] 0 2024-09-18T21:12:44.222 INFO:tasks.workunit.client.1.smithi103.stdout:3/157: fsync d1/d2/fb 0 2024-09-18T21:12:44.222 INFO:tasks.workunit.client.0.smithi077.stdout:9/136: dread d1/df/f12 [0,4194304] 0 2024-09-18T21:12:44.222 INFO:tasks.workunit.client.0.smithi077.stdout:3/176: chown f4 2013577 1 2024-09-18T21:12:44.225 INFO:tasks.workunit.client.1.smithi103.stdout:5/181: readlink de/d1f/l34 0 2024-09-18T21:12:44.226 INFO:tasks.workunit.client.1.smithi103.stdout:3/158: truncate d1/d2/d18/f29 238443 0 2024-09-18T21:12:44.227 INFO:tasks.workunit.client.1.smithi103.stdout:8/190: creat d4/de/f46 x:0 0 0 2024-09-18T21:12:44.230 INFO:tasks.workunit.client.0.smithi077.stdout:1/180: dwrite d3/d8/d13/f14 [0,4194304] 0 2024-09-18T21:12:44.233 INFO:tasks.workunit.client.0.smithi077.stdout:7/321: rename d12/d31/c4e to d12/d22/c74 0 2024-09-18T21:12:44.234 INFO:tasks.workunit.client.0.smithi077.stdout:8/141: getdents d2/d27 0 2024-09-18T21:12:44.235 INFO:tasks.workunit.client.0.smithi077.stdout:7/322: write d12/d22/f65 [655180,33087] 0 2024-09-18T21:12:44.236 INFO:tasks.workunit.client.0.smithi077.stdout:9/137: dread d1/dd/d1a/f23 [0,4194304] 0 2024-09-18T21:12:44.236 INFO:tasks.workunit.client.0.smithi077.stdout:1/181: creat d3/d1e/d32/f42 x:0 0 0 2024-09-18T21:12:44.238 INFO:tasks.workunit.client.0.smithi077.stdout:2/205: rename d1/d4/d9/ca to d1/d4/d5/d1a/d2e/c46 0 2024-09-18T21:12:44.239 INFO:tasks.workunit.client.1.smithi103.stdout:4/159: fsync d9/f14 0 2024-09-18T21:12:44.240 INFO:tasks.workunit.client.0.smithi077.stdout:2/206: write d1/d4/d5/d1a/d2e/d41/f3f [233653,107573] 0 2024-09-18T21:12:44.241 INFO:tasks.workunit.client.0.smithi077.stdout:8/142: write d2/d5/d6/f21 [174738,125976] 0 2024-09-18T21:12:44.243 INFO:tasks.workunit.client.0.smithi077.stdout:1/182: dread - d3/f2a zero size 2024-09-18T21:12:44.244 INFO:tasks.workunit.client.1.smithi103.stdout:1/168: getdents d0/d2 0 2024-09-18T21:12:44.245 INFO:tasks.workunit.client.0.smithi077.stdout:1/183: write d3/d1e/f3b [292876,68646] 0 2024-09-18T21:12:44.247 INFO:tasks.workunit.client.0.smithi077.stdout:2/207: creat d1/d4/d5/d1a/d2e/d41/d2c/f47 x:0 0 0 2024-09-18T21:12:44.247 INFO:tasks.workunit.client.1.smithi103.stdout:5/182: mknod de/d14/c3f 0 2024-09-18T21:12:44.248 INFO:tasks.workunit.client.0.smithi077.stdout:8/143: rmdir d2/d5/d6/d22 39 2024-09-18T21:12:44.248 INFO:tasks.workunit.client.1.smithi103.stdout:5/183: write de/ff [4536246,92484] 0 2024-09-18T21:12:44.248 INFO:tasks.workunit.client.0.smithi077.stdout:2/208: chown d1/f2a 56 1 2024-09-18T21:12:44.249 INFO:tasks.workunit.client.0.smithi077.stdout:9/138: dwrite d1/df/f12 [0,4194304] 0 2024-09-18T21:12:44.252 INFO:tasks.workunit.client.1.smithi103.stdout:8/191: getdents d4/d2d/d3d 0 2024-09-18T21:12:44.253 INFO:tasks.workunit.client.1.smithi103.stdout:9/162: dread d18/f20 [4194304,4194304] 0 2024-09-18T21:12:44.254 INFO:tasks.workunit.client.1.smithi103.stdout:8/192: truncate d4/d2c/f36 801393 0 2024-09-18T21:12:44.254 INFO:tasks.workunit.client.1.smithi103.stdout:8/193: chown d4/d2d/d3d 25911159 1 2024-09-18T21:12:44.256 INFO:tasks.workunit.client.0.smithi077.stdout:9/139: symlink d1/dd/d11/d1c/l2b 0 2024-09-18T21:12:44.257 INFO:tasks.workunit.client.0.smithi077.stdout:2/209: dwrite d1/d4/d5/d1a/d2e/d41/f3f [0,4194304] 0 2024-09-18T21:12:44.258 INFO:tasks.workunit.client.1.smithi103.stdout:5/184: chown de/d14/d33/l26 3972 1 2024-09-18T21:12:44.260 INFO:tasks.workunit.client.1.smithi103.stdout:3/159: dread d1/f24 [0,4194304] 0 2024-09-18T21:12:44.260 INFO:tasks.workunit.client.0.smithi077.stdout:1/184: rename d3/d8/c27 to d3/d1e/d32/c43 0 2024-09-18T21:12:44.262 INFO:tasks.workunit.client.1.smithi103.stdout:6/214: truncate d2/d3/f2f 439481 0 2024-09-18T21:12:44.263 INFO:tasks.workunit.client.1.smithi103.stdout:1/169: link d0/d3/c27 d0/d2/d2b/d3a/c43 0 2024-09-18T21:12:44.263 INFO:tasks.workunit.client.0.smithi077.stdout:2/210: dread d1/fd [0,4194304] 0 2024-09-18T21:12:44.264 INFO:tasks.workunit.client.1.smithi103.stdout:3/160: truncate d1/da/df/f19 994805 0 2024-09-18T21:12:44.264 INFO:tasks.workunit.client.1.smithi103.stdout:6/215: stat d2/d3/d4 0 2024-09-18T21:12:44.265 INFO:tasks.workunit.client.0.smithi077.stdout:2/211: write d1/d4/d5/d1a/d2e/f43 [533734,81042] 0 2024-09-18T21:12:44.267 INFO:tasks.workunit.client.0.smithi077.stdout:1/185: creat d3/d1e/d32/f44 x:0 0 0 2024-09-18T21:12:44.268 INFO:tasks.workunit.client.0.smithi077.stdout:3/177: fsync db/d14/f18 0 2024-09-18T21:12:44.268 INFO:tasks.workunit.client.0.smithi077.stdout:1/186: write d3/d1e/d32/f44 [384288,56921] 0 2024-09-18T21:12:44.269 INFO:tasks.workunit.client.1.smithi103.stdout:5/185: dwrite fb [4194304,4194304] 0 2024-09-18T21:12:44.270 INFO:tasks.workunit.client.0.smithi077.stdout:8/144: creat d2/f31 x:0 0 0 2024-09-18T21:12:44.270 INFO:tasks.workunit.client.0.smithi077.stdout:3/178: write db/d14/f18 [282089,103035] 0 2024-09-18T21:12:44.272 INFO:tasks.workunit.client.1.smithi103.stdout:9/163: dread f8 [4194304,4194304] 0 2024-09-18T21:12:44.275 INFO:tasks.workunit.client.1.smithi103.stdout:4/160: dread d9/d1f/f20 [0,4194304] 0 2024-09-18T21:12:44.276 INFO:tasks.workunit.client.1.smithi103.stdout:1/170: dread d0/d2/d9/dc/f15 [0,4194304] 0 2024-09-18T21:12:44.277 INFO:tasks.workunit.client.1.smithi103.stdout:4/161: write d9/d1a/d21/f26 [1589246,4101] 0 2024-09-18T21:12:44.277 INFO:tasks.workunit.client.0.smithi077.stdout:2/212: mknod d1/d4/d5/c48 0 2024-09-18T21:12:44.281 INFO:tasks.workunit.client.0.smithi077.stdout:3/179: rename l8 to db/d14/d32/d3a/d3b/l3c 0 2024-09-18T21:12:44.282 INFO:tasks.workunit.client.0.smithi077.stdout:7/323: write d12/f45 [1228887,11919] 0 2024-09-18T21:12:44.284 INFO:tasks.workunit.client.1.smithi103.stdout:9/164: mknod d18/d1f/d2f/c32 0 2024-09-18T21:12:44.285 INFO:tasks.workunit.client.0.smithi077.stdout:2/213: mkdir d1/d4/d5/d1a/d49 0 2024-09-18T21:12:44.286 INFO:tasks.workunit.client.1.smithi103.stdout:6/216: mkdir d2/d3/d4/d43/d44 0 2024-09-18T21:12:44.287 INFO:tasks.workunit.client.0.smithi077.stdout:2/214: chown d1/d4/d5/d1a/d2e/d41/d2c/f35 51083 1 2024-09-18T21:12:44.287 INFO:tasks.workunit.client.1.smithi103.stdout:9/165: dread d18/d1f/d2f/f31 [0,4194304] 0 2024-09-18T21:12:44.288 INFO:tasks.workunit.client.0.smithi077.stdout:8/145: creat d2/d5/d6/d22/d26/f32 x:0 0 0 2024-09-18T21:12:44.288 INFO:tasks.workunit.client.0.smithi077.stdout:2/215: dread - d1/d4/d5/d1a/d2e/d41/d2c/f47 zero size 2024-09-18T21:12:44.289 INFO:tasks.workunit.client.0.smithi077.stdout:2/216: read d1/fd [1823254,15271] 0 2024-09-18T21:12:44.292 INFO:tasks.workunit.client.0.smithi077.stdout:7/324: dread d12/d22/d59/d72/f3b [0,4194304] 0 2024-09-18T21:12:44.294 INFO:tasks.workunit.client.0.smithi077.stdout:7/325: write d12/d31/d33/f36 [924477,71280] 0 2024-09-18T21:12:44.294 INFO:tasks.workunit.client.0.smithi077.stdout:1/187: rename d3/d8/d13/d18/d22/l28 to d3/d8/d13/d18/d22/d3d/l45 0 2024-09-18T21:12:44.296 INFO:tasks.workunit.client.1.smithi103.stdout:8/194: truncate d4/d26/f1a 4360698 0 2024-09-18T21:12:44.296 INFO:tasks.workunit.client.1.smithi103.stdout:4/162: dread f6 [0,4194304] 0 2024-09-18T21:12:44.297 INFO:tasks.workunit.client.1.smithi103.stdout:1/171: creat d0/d2/d9/d10/f44 x:0 0 0 2024-09-18T21:12:44.298 INFO:tasks.workunit.client.1.smithi103.stdout:1/172: chown d0/l32 0 1 2024-09-18T21:12:44.298 INFO:tasks.workunit.client.0.smithi077.stdout:3/180: dwrite f3 [0,4194304] 0 2024-09-18T21:12:44.299 INFO:tasks.workunit.client.1.smithi103.stdout:3/161: creat d1/f2e x:0 0 0 2024-09-18T21:12:44.302 INFO:tasks.workunit.client.1.smithi103.stdout:5/186: rename ca to de/d14/d33/c40 0 2024-09-18T21:12:44.302 INFO:tasks.workunit.client.1.smithi103.stdout:9/166: dread f4 [0,4194304] 0 2024-09-18T21:12:44.305 INFO:tasks.workunit.client.0.smithi077.stdout:9/140: dwrite d1/f16 [0,4194304] 0 2024-09-18T21:12:44.305 INFO:tasks.workunit.client.1.smithi103.stdout:9/167: dread - d18/d1f/f2e zero size 2024-09-18T21:12:44.306 INFO:tasks.workunit.client.1.smithi103.stdout:6/217: creat d2/d3/d4/d43/f45 x:0 0 0 2024-09-18T21:12:44.307 INFO:tasks.workunit.client.0.smithi077.stdout:1/188: creat d3/d8/d13/d18/f46 x:0 0 0 2024-09-18T21:12:44.308 INFO:tasks.workunit.client.0.smithi077.stdout:1/189: chown d3 794473 1 2024-09-18T21:12:44.309 INFO:tasks.workunit.client.1.smithi103.stdout:9/168: read d18/f22 [360042,116366] 0 2024-09-18T21:12:44.309 INFO:tasks.workunit.client.1.smithi103.stdout:1/173: dwrite d0/d11/f2d [4194304,4194304] 0 2024-09-18T21:12:44.310 INFO:tasks.workunit.client.0.smithi077.stdout:8/146: mknod d2/d5/d6/c33 0 2024-09-18T21:12:44.310 INFO:tasks.workunit.client.1.smithi103.stdout:3/162: dwrite d1/d2/fb [4194304,4194304] 0 2024-09-18T21:12:44.310 INFO:tasks.workunit.client.1.smithi103.stdout:6/218: write d2/d3/d4/d43/f45 [941524,57638] 0 2024-09-18T21:12:44.310 INFO:tasks.workunit.client.1.smithi103.stdout:1/174: stat d0/d11 0 2024-09-18T21:12:44.313 INFO:tasks.workunit.client.1.smithi103.stdout:4/163: mknod d9/d1c/c37 0 2024-09-18T21:12:44.313 INFO:tasks.workunit.client.0.smithi077.stdout:3/181: dread db/f1a [0,4194304] 0 2024-09-18T21:12:44.318 INFO:tasks.workunit.client.0.smithi077.stdout:7/326: creat d12/d22/d59/d72/d68/f75 x:0 0 0 2024-09-18T21:12:44.320 INFO:tasks.workunit.client.1.smithi103.stdout:5/187: mknod de/d3e/c41 0 2024-09-18T21:12:44.326 INFO:tasks.workunit.client.1.smithi103.stdout:9/169: mknod d18/d1f/c33 0 2024-09-18T21:12:44.326 INFO:tasks.workunit.client.0.smithi077.stdout:3/182: symlink db/d14/d32/d3a/d3b/l3d 0 2024-09-18T21:12:44.327 INFO:tasks.workunit.client.1.smithi103.stdout:1/175: symlink d0/d2/d9/l45 0 2024-09-18T21:12:44.327 INFO:tasks.workunit.client.0.smithi077.stdout:7/327: creat d12/d22/d59/d72/d68/f76 x:0 0 0 2024-09-18T21:12:44.327 INFO:tasks.workunit.client.0.smithi077.stdout:8/147: write d2/d5/d6/f1f [477312,67534] 0 2024-09-18T21:12:44.329 INFO:tasks.workunit.client.0.smithi077.stdout:8/148: write d2/d5/d6/d22/f1b [865310,18498] 0 2024-09-18T21:12:44.331 INFO:tasks.workunit.client.0.smithi077.stdout:7/328: mkdir d12/d31/d77 0 2024-09-18T21:12:44.332 INFO:tasks.workunit.client.1.smithi103.stdout:9/170: mknod d18/d1f/c34 0 2024-09-18T21:12:44.332 INFO:tasks.workunit.client.0.smithi077.stdout:3/183: fdatasync db/d14/d22/f2f 0 2024-09-18T21:12:44.333 INFO:tasks.workunit.client.1.smithi103.stdout:1/176: rmdir d0/d2/d2b 39 2024-09-18T21:12:44.335 INFO:tasks.workunit.client.0.smithi077.stdout:1/190: creat d3/d8/f47 x:0 0 0 2024-09-18T21:12:44.336 INFO:tasks.workunit.client.0.smithi077.stdout:1/191: dread - d3/d8/d13/d18/d22/f2c zero size 2024-09-18T21:12:44.337 INFO:tasks.workunit.client.0.smithi077.stdout:1/192: write d3/d8/f17 [2652392,22742] 0 2024-09-18T21:12:44.337 INFO:tasks.workunit.client.0.smithi077.stdout:8/149: rename d2/d5/d6/c33 to d2/d27/d29/c34 0 2024-09-18T21:12:44.338 INFO:tasks.workunit.client.0.smithi077.stdout:8/150: truncate d2/d5/f16 4384132 0 2024-09-18T21:12:44.341 INFO:tasks.workunit.client.1.smithi103.stdout:1/177: mknod d0/d11/d16/c46 0 2024-09-18T21:12:44.341 INFO:tasks.workunit.client.0.smithi077.stdout:3/184: creat db/d14/d32/d3a/f3e x:0 0 0 2024-09-18T21:12:44.344 INFO:tasks.workunit.client.1.smithi103.stdout:6/219: dread d2/f12 [0,4194304] 0 2024-09-18T21:12:44.345 INFO:tasks.workunit.client.1.smithi103.stdout:3/163: dread d1/da/f15 [0,4194304] 0 2024-09-18T21:12:44.345 INFO:tasks.workunit.client.0.smithi077.stdout:8/151: mkdir d2/d5/d6/d22/d20/d35 0 2024-09-18T21:12:44.345 INFO:tasks.workunit.client.0.smithi077.stdout:7/329: dread d12/d31/d33/d2a/f32 [0,4194304] 0 2024-09-18T21:12:44.345 INFO:tasks.workunit.client.0.smithi077.stdout:2/217: write d1/d4/d9/fb [292700,114606] 0 2024-09-18T21:12:44.345 INFO:tasks.workunit.client.0.smithi077.stdout:7/330: chown d12/f25 421 1 2024-09-18T21:12:44.346 INFO:tasks.workunit.client.1.smithi103.stdout:1/178: rename d0/d2/d9/dc/c3e to d0/d11/d16/d19/c47 0 2024-09-18T21:12:44.347 INFO:tasks.workunit.client.0.smithi077.stdout:7/331: dread - d12/d22/d59/d5d/d62/f6d zero size 2024-09-18T21:12:44.347 INFO:tasks.workunit.client.0.smithi077.stdout:3/185: unlink db/f1a 0 2024-09-18T21:12:44.349 INFO:tasks.workunit.client.0.smithi077.stdout:8/152: dread d2/d5/d6/f21 [0,4194304] 0 2024-09-18T21:12:44.349 INFO:tasks.workunit.client.1.smithi103.stdout:3/164: dwrite d1/da/df/f14 [4194304,4194304] 0 2024-09-18T21:12:44.350 INFO:tasks.workunit.client.1.smithi103.stdout:3/165: stat d1/d2/d18/f29 0 2024-09-18T21:12:44.351 INFO:tasks.workunit.client.1.smithi103.stdout:6/220: symlink d2/d24/d38/l46 0 2024-09-18T21:12:44.351 INFO:tasks.workunit.client.1.smithi103.stdout:3/166: stat d1/f13 0 2024-09-18T21:12:44.352 INFO:tasks.workunit.client.1.smithi103.stdout:8/195: truncate d4/d2c/f37 619996 0 2024-09-18T21:12:44.353 INFO:tasks.workunit.client.1.smithi103.stdout:3/167: write d1/d2/d18/f29 [175910,118231] 0 2024-09-18T21:12:44.353 INFO:tasks.workunit.client.1.smithi103.stdout:8/196: fsync d4/de/f1e 0 2024-09-18T21:12:44.353 INFO:tasks.workunit.client.0.smithi077.stdout:3/186: dwrite db/d14/f20 [0,4194304] 0 2024-09-18T21:12:44.356 INFO:tasks.workunit.client.0.smithi077.stdout:6/244: sync 2024-09-18T21:12:44.356 INFO:tasks.workunit.client.0.smithi077.stdout:5/266: sync 2024-09-18T21:12:44.357 INFO:tasks.workunit.client.1.smithi103.stdout:3/168: dread d1/d2/d18/f29 [0,4194304] 0 2024-09-18T21:12:44.357 INFO:tasks.workunit.client.0.smithi077.stdout:2/218: creat d1/d4/d5/d1a/f4a x:0 0 0 2024-09-18T21:12:44.358 INFO:tasks.workunit.client.1.smithi103.stdout:6/221: creat d2/d3/d8/f47 x:0 0 0 2024-09-18T21:12:44.358 INFO:tasks.workunit.client.0.smithi077.stdout:2/219: truncate d1/f19 187078 0 2024-09-18T21:12:44.359 INFO:tasks.workunit.client.0.smithi077.stdout:9/141: truncate d1/dd/f1f 42743 0 2024-09-18T21:12:44.359 INFO:tasks.workunit.client.0.smithi077.stdout:2/220: write d1/d4/d5/f7 [2765746,14091] 0 2024-09-18T21:12:44.360 INFO:tasks.workunit.client.1.smithi103.stdout:8/197: dwrite d4/d2c/d39/f3e [4194304,4194304] 0 2024-09-18T21:12:44.361 INFO:tasks.workunit.client.1.smithi103.stdout:4/164: write f6 [971455,97949] 0 2024-09-18T21:12:44.365 INFO:tasks.workunit.client.1.smithi103.stdout:1/179: creat d0/d2/d2b/f48 x:0 0 0 2024-09-18T21:12:44.367 INFO:tasks.workunit.client.1.smithi103.stdout:1/180: write d0/d3/f20 [3895967,96824] 0 2024-09-18T21:12:44.368 INFO:tasks.workunit.client.1.smithi103.stdout:3/169: dwrite d1/d2/d18/f29 [0,4194304] 0 2024-09-18T21:12:44.370 INFO:tasks.workunit.client.1.smithi103.stdout:1/181: dread - d0/d2/f3d zero size 2024-09-18T21:12:44.372 INFO:tasks.workunit.client.0.smithi077.stdout:6/245: symlink d7/df/l54 0 2024-09-18T21:12:44.372 INFO:tasks.workunit.client.1.smithi103.stdout:1/182: write d0/f7 [5044023,29702] 0 2024-09-18T21:12:44.374 INFO:tasks.workunit.client.1.smithi103.stdout:4/165: mkdir d9/d38 0 2024-09-18T21:12:44.377 INFO:tasks.workunit.client.1.smithi103.stdout:8/198: symlink d4/d26/l47 0 2024-09-18T21:12:44.377 INFO:tasks.workunit.client.1.smithi103.stdout:9/171: dwrite f4 [0,4194304] 0 2024-09-18T21:12:44.379 INFO:tasks.workunit.client.0.smithi077.stdout:1/193: truncate d3/d8/d13/f14 3231195 0 2024-09-18T21:12:44.379 INFO:tasks.workunit.client.1.smithi103.stdout:9/172: readlink d18/l1e 0 2024-09-18T21:12:44.380 INFO:tasks.workunit.client.0.smithi077.stdout:9/142: symlink d1/dd/d1a/l2c 0 2024-09-18T21:12:44.380 INFO:tasks.workunit.client.0.smithi077.stdout:9/143: stat d1/f16 0 2024-09-18T21:12:44.381 INFO:tasks.workunit.client.1.smithi103.stdout:3/170: creat d1/d2/d18/f2f x:0 0 0 2024-09-18T21:12:44.382 INFO:tasks.workunit.client.0.smithi077.stdout:2/221: chown d1/d4/d9/d24/l3b 59696611 1 2024-09-18T21:12:44.382 INFO:tasks.workunit.client.1.smithi103.stdout:1/183: dwrite d0/f7 [0,4194304] 0 2024-09-18T21:12:44.382 INFO:tasks.workunit.client.0.smithi077.stdout:8/153: mkdir d2/d36 0 2024-09-18T21:12:44.384 INFO:tasks.workunit.client.0.smithi077.stdout:8/154: read - d2/d5/d6/d22/d26/f32 zero size 2024-09-18T21:12:44.385 INFO:tasks.workunit.client.0.smithi077.stdout:8/155: stat d2/d5/d6/f14 0 2024-09-18T21:12:44.385 INFO:tasks.workunit.client.1.smithi103.stdout:8/199: dwrite d4/de/f16 [0,4194304] 0 2024-09-18T21:12:44.386 INFO:tasks.workunit.client.0.smithi077.stdout:8/156: truncate f1 9396013 0 2024-09-18T21:12:44.386 INFO:tasks.workunit.client.1.smithi103.stdout:8/200: fsync d4/d2d/f33 0 2024-09-18T21:12:44.386 INFO:tasks.workunit.client.1.smithi103.stdout:4/166: unlink d9/d1f/f30 0 2024-09-18T21:12:44.387 INFO:tasks.workunit.client.0.smithi077.stdout:6/246: mkdir d7/df/d11/d1d/d49/d55 0 2024-09-18T21:12:44.388 INFO:tasks.workunit.client.0.smithi077.stdout:6/247: stat d7/df/d11/d1d/d31 0 2024-09-18T21:12:44.388 INFO:tasks.workunit.client.1.smithi103.stdout:1/184: dwrite d0/d3/f29 [0,4194304] 0 2024-09-18T21:12:44.389 INFO:tasks.workunit.client.0.smithi077.stdout:7/332: creat d12/f78 x:0 0 0 2024-09-18T21:12:44.390 INFO:tasks.workunit.client.0.smithi077.stdout:7/333: write d12/f78 [929200,30033] 0 2024-09-18T21:12:44.391 INFO:tasks.workunit.client.0.smithi077.stdout:1/194: symlink d3/d8/d13/d18/l48 0 2024-09-18T21:12:44.393 INFO:tasks.workunit.client.1.smithi103.stdout:3/171: mkdir d1/d2/d18/d30 0 2024-09-18T21:12:44.394 INFO:tasks.workunit.client.0.smithi077.stdout:9/144: unlink d1/f3 0 2024-09-18T21:12:44.396 INFO:tasks.workunit.client.1.smithi103.stdout:8/201: dwrite d4/de/f43 [0,4194304] 0 2024-09-18T21:12:44.398 INFO:tasks.workunit.client.1.smithi103.stdout:6/222: creat d2/d3/f48 x:0 0 0 2024-09-18T21:12:44.398 INFO:tasks.workunit.client.1.smithi103.stdout:3/172: write d1/da/f15 [4507002,34183] 0 2024-09-18T21:12:44.402 INFO:tasks.workunit.client.1.smithi103.stdout:6/223: fdatasync d2/d3/d8/f2d 0 2024-09-18T21:12:44.402 INFO:tasks.workunit.client.1.smithi103.stdout:1/185: dread d0/d3/f29 [0,4194304] 0 2024-09-18T21:12:44.402 INFO:tasks.workunit.client.0.smithi077.stdout:5/267: mkdir d0/d6/d3b/d64/d67 0 2024-09-18T21:12:44.403 INFO:tasks.workunit.client.0.smithi077.stdout:5/268: fsync d0/df/f25 0 2024-09-18T21:12:44.404 INFO:tasks.workunit.client.1.smithi103.stdout:4/167: truncate d9/fa 2159576 0 2024-09-18T21:12:44.404 INFO:tasks.workunit.client.0.smithi077.stdout:8/157: unlink d2/d5/d6/f8 0 2024-09-18T21:12:44.408 INFO:tasks.workunit.client.0.smithi077.stdout:7/334: rmdir d12/d22/d59/d5d 39 2024-09-18T21:12:44.408 INFO:tasks.workunit.client.1.smithi103.stdout:8/202: dwrite d4/de/f1e [0,4194304] 0 2024-09-18T21:12:44.409 INFO:tasks.workunit.client.1.smithi103.stdout:8/203: chown d4/d26/l34 585252947 1 2024-09-18T21:12:44.410 INFO:tasks.workunit.client.0.smithi077.stdout:2/222: rmdir d1/d4/d5/d1a 39 2024-09-18T21:12:44.412 INFO:tasks.workunit.client.0.smithi077.stdout:6/248: dwrite d7/df/d11/f16 [0,4194304] 0 2024-09-18T21:12:44.415 INFO:tasks.workunit.client.0.smithi077.stdout:1/195: dread d3/d8/d13/f1f [0,4194304] 0 2024-09-18T21:12:44.416 INFO:tasks.workunit.client.0.smithi077.stdout:2/223: dread d1/fd [0,4194304] 0 2024-09-18T21:12:44.416 INFO:tasks.workunit.client.0.smithi077.stdout:9/145: unlink d1/c8 0 2024-09-18T21:12:44.417 INFO:tasks.workunit.client.0.smithi077.stdout:3/187: link db/d14/c31 db/c3f 0 2024-09-18T21:12:44.419 INFO:tasks.workunit.client.0.smithi077.stdout:3/188: readlink db/d14/d32/d3a/d3b/l3d 0 2024-09-18T21:12:44.421 INFO:tasks.workunit.client.1.smithi103.stdout:4/168: creat d9/d1c/f39 x:0 0 0 2024-09-18T21:12:44.422 INFO:tasks.workunit.client.0.smithi077.stdout:9/146: dread d1/dd/d1a/f23 [0,4194304] 0 2024-09-18T21:12:44.423 INFO:tasks.workunit.client.0.smithi077.stdout:9/147: stat d1/dd/d1a/f23 0 2024-09-18T21:12:44.424 INFO:tasks.workunit.client.0.smithi077.stdout:5/269: creat d0/df/d10/d47/f68 x:0 0 0 2024-09-18T21:12:44.426 INFO:tasks.workunit.client.0.smithi077.stdout:5/270: write d0/df/f22 [3965103,20997] 0 2024-09-18T21:12:44.426 INFO:tasks.workunit.client.1.smithi103.stdout:1/186: dread d0/d2/d9/dc/f22 [0,4194304] 0 2024-09-18T21:12:44.427 INFO:tasks.workunit.client.1.smithi103.stdout:1/187: write d0/ff [696858,120705] 0 2024-09-18T21:12:44.428 INFO:tasks.workunit.client.1.smithi103.stdout:1/188: read - d0/d2/d2b/f41 zero size 2024-09-18T21:12:44.429 INFO:tasks.workunit.client.0.smithi077.stdout:3/189: dwrite db/d14/d22/f2f [0,4194304] 0 2024-09-18T21:12:44.429 INFO:tasks.workunit.client.0.smithi077.stdout:3/190: fdatasync db/f13 0 2024-09-18T21:12:44.432 INFO:tasks.workunit.client.1.smithi103.stdout:1/189: write d0/d3/f20 [2894487,1017] 0 2024-09-18T21:12:44.432 INFO:tasks.workunit.client.1.smithi103.stdout:3/173: creat d1/f31 x:0 0 0 2024-09-18T21:12:44.432 INFO:tasks.workunit.client.0.smithi077.stdout:5/271: dread d0/df/f52 [0,4194304] 0 2024-09-18T21:12:44.432 INFO:tasks.workunit.client.0.smithi077.stdout:3/191: dread db/d14/f1d [0,4194304] 0 2024-09-18T21:12:44.433 INFO:tasks.workunit.client.1.smithi103.stdout:3/174: dread - d1/f31 zero size 2024-09-18T21:12:44.433 INFO:tasks.workunit.client.0.smithi077.stdout:5/272: write d0/df/f52 [544441,83003] 0 2024-09-18T21:12:44.434 INFO:tasks.workunit.client.0.smithi077.stdout:1/196: chown d3/d1e/c24 798824141 1 2024-09-18T21:12:44.434 INFO:tasks.workunit.client.1.smithi103.stdout:3/175: read d1/d2/d18/f29 [3697769,53704] 0 2024-09-18T21:12:44.435 INFO:tasks.workunit.client.0.smithi077.stdout:5/273: chown d0/df/d10/l23 7573 1 2024-09-18T21:12:44.437 INFO:tasks.workunit.client.1.smithi103.stdout:4/169: symlink d9/d1f/d31/l3a 0 2024-09-18T21:12:44.438 INFO:tasks.workunit.client.0.smithi077.stdout:8/158: getdents d2/d5/d6/d22/d18 0 2024-09-18T21:12:44.438 INFO:tasks.workunit.client.0.smithi077.stdout:5/274: fsync d0/df/d10/d47/f58 0 2024-09-18T21:12:44.439 INFO:tasks.workunit.client.0.smithi077.stdout:2/224: write d1/d4/d5/d1a/d2e/d41/f3f [3206089,45637] 0 2024-09-18T21:12:44.440 INFO:tasks.workunit.client.0.smithi077.stdout:8/159: write f1 [9815417,96874] 0 2024-09-18T21:12:44.442 INFO:tasks.workunit.client.0.smithi077.stdout:3/192: dwrite db/d14/f18 [4194304,4194304] 0 2024-09-18T21:12:44.443 INFO:tasks.workunit.client.1.smithi103.stdout:9/173: dwrite f1 [0,4194304] 0 2024-09-18T21:12:44.443 INFO:tasks.workunit.client.1.smithi103.stdout:8/204: link d4/d26/c29 d4/d2d/d3d/c48 0 2024-09-18T21:12:44.444 INFO:tasks.workunit.client.0.smithi077.stdout:9/148: truncate d1/dd/d1a/f23 2076679 0 2024-09-18T21:12:44.452 INFO:tasks.workunit.client.1.smithi103.stdout:4/170: dwrite d9/d1a/f1e [0,4194304] 0 2024-09-18T21:12:44.455 INFO:tasks.workunit.client.1.smithi103.stdout:9/174: rmdir d18/d29 39 2024-09-18T21:12:44.458 INFO:tasks.workunit.client.1.smithi103.stdout:8/205: dwrite d4/de/f11 [0,4194304] 0 2024-09-18T21:12:44.459 INFO:tasks.workunit.client.1.smithi103.stdout:3/176: dread d1/f24 [0,4194304] 0 2024-09-18T21:12:44.462 INFO:tasks.workunit.client.1.smithi103.stdout:4/171: creat d9/d1f/f3b x:0 0 0 2024-09-18T21:12:44.462 INFO:tasks.workunit.client.0.smithi077.stdout:8/160: rmdir d2/d27/d29 39 2024-09-18T21:12:44.463 INFO:tasks.workunit.client.1.smithi103.stdout:4/172: write d9/d1f/f3b [864293,92340] 0 2024-09-18T21:12:44.463 INFO:tasks.workunit.client.0.smithi077.stdout:1/197: dwrite d3/ff [0,4194304] 0 2024-09-18T21:12:44.464 INFO:tasks.workunit.client.1.smithi103.stdout:4/173: write d9/fc [3648019,50014] 0 2024-09-18T21:12:44.465 INFO:tasks.workunit.client.1.smithi103.stdout:4/174: truncate d9/d1c/f39 532344 0 2024-09-18T21:12:44.466 INFO:tasks.workunit.client.0.smithi077.stdout:2/225: rmdir d1/d4/d5/d1a/d2e/d40 39 2024-09-18T21:12:44.471 INFO:tasks.workunit.client.1.smithi103.stdout:4/175: dread d9/f2c [0,4194304] 0 2024-09-18T21:12:44.472 INFO:tasks.workunit.client.1.smithi103.stdout:4/176: chown d9 119 1 2024-09-18T21:12:44.472 INFO:tasks.workunit.client.1.smithi103.stdout:3/177: chown d1/da/df/l2c 70 1 2024-09-18T21:12:44.473 INFO:tasks.workunit.client.1.smithi103.stdout:3/178: chown d1/da/f22 731 1 2024-09-18T21:12:44.474 INFO:tasks.workunit.client.1.smithi103.stdout:1/190: getdents d0/d11/d16/d19 0 2024-09-18T21:12:44.475 INFO:tasks.workunit.client.0.smithi077.stdout:2/226: dwrite d1/f42 [0,4194304] 0 2024-09-18T21:12:44.477 INFO:tasks.workunit.client.0.smithi077.stdout:3/193: fsync db/d14/f18 0 2024-09-18T21:12:44.477 INFO:tasks.workunit.client.0.smithi077.stdout:3/194: fdatasync db/f35 0 2024-09-18T21:12:44.477 INFO:tasks.workunit.client.1.smithi103.stdout:4/177: dread f5 [4194304,4194304] 0 2024-09-18T21:12:44.482 INFO:tasks.workunit.client.0.smithi077.stdout:6/249: creat d7/df/d11/f56 x:0 0 0 2024-09-18T21:12:44.486 INFO:tasks.workunit.client.0.smithi077.stdout:7/335: getdents d12/d31/d33/d2a/d6c 0 2024-09-18T21:12:44.487 INFO:tasks.workunit.client.1.smithi103.stdout:1/191: symlink d0/d11/d16/l49 0 2024-09-18T21:12:44.487 INFO:tasks.workunit.client.0.smithi077.stdout:8/161: mknod d2/d5/d6/d22/d18/c37 0 2024-09-18T21:12:44.488 INFO:tasks.workunit.client.0.smithi077.stdout:8/162: dread - d2/d5/d6/f2c zero size 2024-09-18T21:12:44.492 INFO:tasks.workunit.client.0.smithi077.stdout:2/227: symlink d1/d4/d9/d24/l4b 0 2024-09-18T21:12:44.493 INFO:tasks.workunit.client.1.smithi103.stdout:9/175: rename lb to d18/l35 0 2024-09-18T21:12:44.493 INFO:tasks.workunit.client.1.smithi103.stdout:1/192: dwrite d0/d2/d9/f2f [4194304,4194304] 0 2024-09-18T21:12:44.496 INFO:tasks.workunit.client.0.smithi077.stdout:8/163: unlink d2/d5/d6/c2b 0 2024-09-18T21:12:44.496 INFO:tasks.workunit.client.0.smithi077.stdout:5/275: link d0/d36/d49/l5a d0/df/d10/l69 0 2024-09-18T21:12:44.497 INFO:tasks.workunit.client.0.smithi077.stdout:5/276: write d0/d6/dd/f51 [957112,71190] 0 2024-09-18T21:12:44.498 INFO:tasks.workunit.client.0.smithi077.stdout:2/228: rename d1/d4/d9/d24/f27 to d1/d4/d5/d1a/f4c 0 2024-09-18T21:12:44.499 INFO:tasks.workunit.client.1.smithi103.stdout:8/206: dread d4/de/f1c [0,4194304] 0 2024-09-18T21:12:44.500 INFO:tasks.workunit.client.1.smithi103.stdout:8/207: read - d4/de/f46 zero size 2024-09-18T21:12:44.504 INFO:tasks.workunit.client.0.smithi077.stdout:8/164: rmdir d2/d5 39 2024-09-18T21:12:44.505 INFO:tasks.workunit.client.1.smithi103.stdout:8/208: dread d4/d2c/f31 [0,4194304] 0 2024-09-18T21:12:44.508 INFO:tasks.workunit.client.0.smithi077.stdout:6/250: creat d7/df/d11/f57 x:0 0 0 2024-09-18T21:12:44.508 INFO:tasks.workunit.client.0.smithi077.stdout:6/251: chown d7/df/d11/d25/f2b 11488 1 2024-09-18T21:12:44.509 INFO:tasks.workunit.client.1.smithi103.stdout:1/193: rename d0/d11/l18 to d0/d2/l4a 0 2024-09-18T21:12:44.510 INFO:tasks.workunit.client.1.smithi103.stdout:4/178: dwrite f5 [4194304,4194304] 0 2024-09-18T21:12:44.510 INFO:tasks.workunit.client.1.smithi103.stdout:1/194: fsync d0/d2/f3d 0 2024-09-18T21:12:44.511 INFO:tasks.workunit.client.0.smithi077.stdout:7/336: creat d12/d22/d59/f79 x:0 0 0 2024-09-18T21:12:44.512 INFO:tasks.workunit.client.1.smithi103.stdout:1/195: fdatasync d0/d2/d9/d10/f25 0 2024-09-18T21:12:44.514 INFO:tasks.workunit.client.0.smithi077.stdout:2/229: symlink d1/d4/d5/d1a/d49/l4d 0 2024-09-18T21:12:44.515 INFO:tasks.workunit.client.0.smithi077.stdout:2/230: dread - d1/f2a zero size 2024-09-18T21:12:44.516 INFO:tasks.workunit.client.0.smithi077.stdout:2/231: chown d1/f2a 2647 1 2024-09-18T21:12:44.517 INFO:tasks.workunit.client.0.smithi077.stdout:3/195: write fa [5672925,46644] 0 2024-09-18T21:12:44.518 INFO:tasks.workunit.client.1.smithi103.stdout:4/179: dread d9/f25 [0,4194304] 0 2024-09-18T21:12:44.518 INFO:tasks.workunit.client.0.smithi077.stdout:3/196: read - db/d14/d32/f37 zero size 2024-09-18T21:12:44.520 INFO:tasks.workunit.client.1.smithi103.stdout:1/196: dwrite d0/f7 [0,4194304] 0 2024-09-18T21:12:44.521 INFO:tasks.workunit.client.0.smithi077.stdout:6/252: creat d7/df/f58 x:0 0 0 2024-09-18T21:12:44.521 INFO:tasks.workunit.client.0.smithi077.stdout:8/165: dwrite d2/d5/d6/f1f [4194304,4194304] 0 2024-09-18T21:12:44.521 INFO:tasks.workunit.client.1.smithi103.stdout:1/197: fdatasync d0/d11/f35 0 2024-09-18T21:12:44.522 INFO:tasks.workunit.client.1.smithi103.stdout:9/176: write f12 [402024,106635] 0 2024-09-18T21:12:44.523 INFO:tasks.workunit.client.1.smithi103.stdout:1/198: write d0/d2/d2b/f48 [102320,32336] 0 2024-09-18T21:12:44.524 INFO:tasks.workunit.client.1.smithi103.stdout:4/180: dread d9/d1a/f1e [0,4194304] 0 2024-09-18T21:12:44.524 INFO:tasks.workunit.client.0.smithi077.stdout:2/232: symlink d1/d4/d9/d24/l4e 0 2024-09-18T21:12:44.525 INFO:tasks.workunit.client.1.smithi103.stdout:1/199: read d0/d2/d9/d10/f25 [1973363,3403] 0 2024-09-18T21:12:44.525 INFO:tasks.workunit.client.1.smithi103.stdout:4/181: write d9/f23 [889039,89925] 0 2024-09-18T21:12:44.526 INFO:tasks.workunit.client.1.smithi103.stdout:9/177: rename d18 to d18/d29/d36 22 2024-09-18T21:12:44.526 INFO:tasks.workunit.client.0.smithi077.stdout:3/197: creat db/d14/f40 x:0 0 0 2024-09-18T21:12:44.527 INFO:tasks.workunit.client.0.smithi077.stdout:3/198: dread - db/d14/d32/f37 zero size 2024-09-18T21:12:44.527 INFO:tasks.workunit.client.0.smithi077.stdout:3/199: readlink l6 0 2024-09-18T21:12:44.530 INFO:tasks.workunit.client.1.smithi103.stdout:4/182: dread d9/d1f/f20 [0,4194304] 0 2024-09-18T21:12:44.531 INFO:tasks.workunit.client.1.smithi103.stdout:4/183: chown d9/d1a/d21/l2d 87 1 2024-09-18T21:12:44.532 INFO:tasks.workunit.client.1.smithi103.stdout:4/184: write d9/f11 [4661726,92115] 0 2024-09-18T21:12:44.532 INFO:tasks.workunit.client.0.smithi077.stdout:7/337: mkdir d12/d22/d59/d5d/d7a 0 2024-09-18T21:12:44.533 INFO:tasks.workunit.client.0.smithi077.stdout:3/200: dread db/d14/d22/f2f [0,4194304] 0 2024-09-18T21:12:44.536 INFO:tasks.workunit.client.1.smithi103.stdout:8/209: write d4/d2c/f37 [1553958,110151] 0 2024-09-18T21:12:44.536 INFO:tasks.workunit.client.0.smithi077.stdout:5/277: truncate d0/df/d10/d4b/f65 3273509 0 2024-09-18T21:12:44.537 INFO:tasks.workunit.client.0.smithi077.stdout:5/278: readlink d0/df/d10/l34 0 2024-09-18T21:12:44.537 INFO:tasks.workunit.client.1.smithi103.stdout:9/178: symlink d18/d29/l37 0 2024-09-18T21:12:44.538 INFO:tasks.workunit.client.0.smithi077.stdout:5/279: write d0/df/d10/f7 [1630102,125136] 0 2024-09-18T21:12:44.538 INFO:tasks.workunit.client.1.smithi103.stdout:4/185: mknod d9/c3c 0 2024-09-18T21:12:44.539 INFO:tasks.workunit.client.0.smithi077.stdout:5/280: read d0/d6/dd/f24 [176823,80906] 0 2024-09-18T21:12:44.541 INFO:tasks.workunit.client.0.smithi077.stdout:8/166: rename d2/d5/d6/f1a to d2/d27/d29/f38 0 2024-09-18T21:12:44.542 INFO:tasks.workunit.client.1.smithi103.stdout:8/210: dwrite d4/d26/f8 [0,4194304] 0 2024-09-18T21:12:44.543 INFO:tasks.workunit.client.1.smithi103.stdout:4/186: dread d9/d1f/f3b [0,4194304] 0 2024-09-18T21:12:44.543 INFO:tasks.workunit.client.0.smithi077.stdout:6/253: link d7/df/f15 d7/df/d11/d1d/d49/d55/f59 0 2024-09-18T21:12:44.545 INFO:tasks.workunit.client.0.smithi077.stdout:2/233: mkdir d1/d4/d9/d4f 0 2024-09-18T21:12:44.549 INFO:tasks.workunit.client.1.smithi103.stdout:2/175: sync 2024-09-18T21:12:44.550 INFO:tasks.workunit.client.1.smithi103.stdout:8/211: mknod d4/d2d/d3d/c49 0 2024-09-18T21:12:44.550 INFO:tasks.workunit.client.1.smithi103.stdout:1/200: write d0/d2/d9/dc/f22 [1073549,5573] 0 2024-09-18T21:12:44.551 INFO:tasks.workunit.client.0.smithi077.stdout:5/281: symlink d0/d6/dd/l6a 0 2024-09-18T21:12:44.551 INFO:tasks.workunit.client.1.smithi103.stdout:1/201: chown d0/f7 25121 1 2024-09-18T21:12:44.552 INFO:tasks.workunit.client.1.smithi103.stdout:1/202: chown d0/d2/d9/dc/f22 15 1 2024-09-18T21:12:44.552 INFO:tasks.workunit.client.1.smithi103.stdout:1/203: truncate d0/d11/f2d 9361250 0 2024-09-18T21:12:44.553 INFO:tasks.workunit.client.1.smithi103.stdout:4/187: rename d9/f32 to d9/d1f/d31/f3d 0 2024-09-18T21:12:44.553 INFO:tasks.workunit.client.1.smithi103.stdout:1/204: truncate d0/f37 1061093 0 2024-09-18T21:12:44.556 INFO:tasks.workunit.client.0.smithi077.stdout:8/167: dread f1 [4194304,4194304] 0 2024-09-18T21:12:44.556 INFO:tasks.workunit.client.0.smithi077.stdout:6/254: unlink d7/df/d11/d25/l4d 0 2024-09-18T21:12:44.557 INFO:tasks.workunit.client.0.smithi077.stdout:6/255: chown d7/df/f32 86 1 2024-09-18T21:12:44.559 INFO:tasks.workunit.client.0.smithi077.stdout:2/234: symlink d1/d4/d5/d1a/d2e/d41/d2c/l50 0 2024-09-18T21:12:44.560 INFO:tasks.workunit.client.1.smithi103.stdout:8/212: mkdir d4/de/d4a 0 2024-09-18T21:12:44.564 INFO:tasks.workunit.client.0.smithi077.stdout:6/256: dwrite d7/df/f2a [4194304,4194304] 0 2024-09-18T21:12:44.565 INFO:tasks.workunit.client.1.smithi103.stdout:8/213: dwrite d4/de/f43 [0,4194304] 0 2024-09-18T21:12:44.566 INFO:tasks.workunit.client.1.smithi103.stdout:8/214: dread - d4/de/f3b zero size 2024-09-18T21:12:44.566 INFO:tasks.workunit.client.0.smithi077.stdout:6/257: dread - d7/df/f32 zero size 2024-09-18T21:12:44.566 INFO:tasks.workunit.client.0.smithi077.stdout:2/235: dwrite d1/d4/d5/f3a [0,4194304] 0 2024-09-18T21:12:44.567 INFO:tasks.workunit.client.0.smithi077.stdout:6/258: write d7/df/f2a [7719439,34885] 0 2024-09-18T21:12:44.567 INFO:tasks.workunit.client.0.smithi077.stdout:2/236: chown d1/d4/d5/d1a/d49 47 1 2024-09-18T21:12:44.574 INFO:tasks.workunit.client.0.smithi077.stdout:2/237: dread d1/fd [0,4194304] 0 2024-09-18T21:12:44.575 INFO:tasks.workunit.client.0.smithi077.stdout:6/259: dwrite d7/f1f [0,4194304] 0 2024-09-18T21:12:44.575 INFO:tasks.workunit.client.0.smithi077.stdout:2/238: readlink d1/d4/d5/d1a/l3e 0 2024-09-18T21:12:44.576 INFO:tasks.workunit.client.0.smithi077.stdout:2/239: stat d1/c2 0 2024-09-18T21:12:44.581 INFO:tasks.workunit.client.0.smithi077.stdout:6/260: dread d7/df/d11/f45 [0,4194304] 0 2024-09-18T21:12:44.582 INFO:tasks.workunit.client.1.smithi103.stdout:1/205: creat d0/d3/f4b x:0 0 0 2024-09-18T21:12:44.583 INFO:tasks.workunit.client.1.smithi103.stdout:1/206: write d0/d11/f35 [1121379,119704] 0 2024-09-18T21:12:44.584 INFO:tasks.workunit.client.0.smithi077.stdout:8/168: creat d2/d5/d6/d22/d26/f39 x:0 0 0 2024-09-18T21:12:44.587 INFO:tasks.workunit.client.1.smithi103.stdout:2/176: rename d3/d5/d2f/f34 to d3/d5/d2c/f43 0 2024-09-18T21:12:44.588 INFO:tasks.workunit.client.1.smithi103.stdout:2/177: write d3/d5/fe [5042034,127111] 0 2024-09-18T21:12:44.588 INFO:tasks.workunit.client.1.smithi103.stdout:2/178: chown d3 2484 1 2024-09-18T21:12:44.590 INFO:tasks.workunit.client.1.smithi103.stdout:2/179: truncate d3/d5/d2c/f3e 832117 0 2024-09-18T21:12:44.591 INFO:tasks.workunit.client.1.smithi103.stdout:4/188: link f3 d9/d1a/f3e 0 2024-09-18T21:12:44.592 INFO:tasks.workunit.client.1.smithi103.stdout:2/180: write d3/d5/d2c/f31 [485198,2500] 0 2024-09-18T21:12:44.592 INFO:tasks.workunit.client.1.smithi103.stdout:4/189: chown d9/lf 787 1 2024-09-18T21:12:44.593 INFO:tasks.workunit.client.1.smithi103.stdout:1/207: creat d0/d3/f4c x:0 0 0 2024-09-18T21:12:44.594 INFO:tasks.workunit.client.1.smithi103.stdout:1/208: fdatasync d0/d3/f20 0 2024-09-18T21:12:44.595 INFO:tasks.workunit.client.1.smithi103.stdout:9/179: dwrite d18/d1f/f21 [0,4194304] 0 2024-09-18T21:12:44.596 INFO:tasks.workunit.client.0.smithi077.stdout:7/338: getdents d12/d31 0 2024-09-18T21:12:44.597 INFO:tasks.workunit.client.0.smithi077.stdout:6/261: creat d7/df/d11/d1d/d31/f5a x:0 0 0 2024-09-18T21:12:44.597 INFO:tasks.workunit.client.0.smithi077.stdout:6/262: dread - d7/f23 zero size 2024-09-18T21:12:44.603 INFO:tasks.workunit.client.1.smithi103.stdout:9/180: dwrite fa [0,4194304] 0 2024-09-18T21:12:44.604 INFO:tasks.workunit.client.1.smithi103.stdout:1/209: mkdir d0/d11/d16/d19/d4d 0 2024-09-18T21:12:44.605 INFO:tasks.workunit.client.1.smithi103.stdout:9/181: fdatasync f12 0 2024-09-18T21:12:44.608 INFO:tasks.workunit.client.0.smithi077.stdout:6/263: creat d7/df/d11/d25/f5b x:0 0 0 2024-09-18T21:12:44.608 INFO:tasks.workunit.client.0.smithi077.stdout:6/264: dread - d7/f23 zero size 2024-09-18T21:12:44.609 INFO:tasks.workunit.client.1.smithi103.stdout:1/210: dread d0/d3/f1a [0,4194304] 0 2024-09-18T21:12:44.609 INFO:tasks.workunit.client.1.smithi103.stdout:2/181: symlink d3/l44 0 2024-09-18T21:12:44.610 INFO:tasks.workunit.client.0.smithi077.stdout:6/265: write d7/df/d11/d25/f5b [496150,125694] 0 2024-09-18T21:12:44.610 INFO:tasks.workunit.client.1.smithi103.stdout:4/190: creat d9/d2e/f3f x:0 0 0 2024-09-18T21:12:44.610 INFO:tasks.workunit.client.0.smithi077.stdout:6/266: stat l5 0 2024-09-18T21:12:44.611 INFO:tasks.workunit.client.1.smithi103.stdout:4/191: chown d9/d1a/l22 217004124 1 2024-09-18T21:12:44.614 INFO:tasks.workunit.client.1.smithi103.stdout:8/215: getdents d4/d2d/d3d 0 2024-09-18T21:12:44.615 INFO:tasks.workunit.client.1.smithi103.stdout:8/216: chown d4/d26/l2a 1667 1 2024-09-18T21:12:44.615 INFO:tasks.workunit.client.1.smithi103.stdout:8/217: chown d4/de/f3b 8861 1 2024-09-18T21:12:44.616 INFO:tasks.workunit.client.1.smithi103.stdout:1/211: write d0/d3/f1a [4176979,104062] 0 2024-09-18T21:12:44.617 INFO:tasks.workunit.client.0.smithi077.stdout:6/267: mkdir d7/df/d11/d1d/d5c 0 2024-09-18T21:12:44.617 INFO:tasks.workunit.client.1.smithi103.stdout:8/218: write d4/d2c/f36 [314180,74704] 0 2024-09-18T21:12:44.618 INFO:tasks.workunit.client.1.smithi103.stdout:2/182: creat d3/d5/d25/f45 x:0 0 0 2024-09-18T21:12:44.619 INFO:tasks.workunit.client.0.smithi077.stdout:7/339: creat d12/d22/f7b x:0 0 0 2024-09-18T21:12:44.621 INFO:tasks.workunit.client.1.smithi103.stdout:4/192: unlink d9/d1a/d21/f26 0 2024-09-18T21:12:44.621 INFO:tasks.workunit.client.1.smithi103.stdout:1/212: dread d0/d11/f2d [4194304,4194304] 0 2024-09-18T21:12:44.621 INFO:tasks.workunit.client.0.smithi077.stdout:8/169: link d2/d5/d6/d22/d26/c2d d2/d5/d6/c3a 0 2024-09-18T21:12:44.622 INFO:tasks.workunit.client.0.smithi077.stdout:8/170: stat d2/d5/d6/d22 0 2024-09-18T21:12:44.624 INFO:tasks.workunit.client.0.smithi077.stdout:6/268: read d7/f2c [178644,74493] 0 2024-09-18T21:12:44.624 INFO:tasks.workunit.client.0.smithi077.stdout:2/240: dwrite d1/d4/d5/d1a/d2e/d40/f44 [0,4194304] 0 2024-09-18T21:12:44.626 INFO:tasks.workunit.client.1.smithi103.stdout:1/213: dwrite d0/d2/d2b/f48 [0,4194304] 0 2024-09-18T21:12:44.626 INFO:tasks.workunit.client.0.smithi077.stdout:6/269: chown d7/df/d11/d1d/l48 639 1 2024-09-18T21:12:44.628 INFO:tasks.workunit.client.0.smithi077.stdout:8/171: mknod d2/d5/d6/d22/d20/c3b 0 2024-09-18T21:12:44.629 INFO:tasks.workunit.client.1.smithi103.stdout:4/193: creat d9/d2e/f40 x:0 0 0 2024-09-18T21:12:44.629 INFO:tasks.workunit.client.0.smithi077.stdout:8/172: write d2/f31 [565231,98512] 0 2024-09-18T21:12:44.631 INFO:tasks.workunit.client.0.smithi077.stdout:6/270: chown d7/df/d11/f19 83 1 2024-09-18T21:12:44.632 INFO:tasks.workunit.client.0.smithi077.stdout:2/241: unlink d1/d4/d9/d24/c31 0 2024-09-18T21:12:44.635 INFO:tasks.workunit.client.1.smithi103.stdout:9/182: getdents d18/d29 0 2024-09-18T21:12:44.635 INFO:tasks.workunit.client.0.smithi077.stdout:6/271: truncate d7/df/d11/d25/f47 192883 0 2024-09-18T21:12:44.636 INFO:tasks.workunit.client.0.smithi077.stdout:6/272: chown d7/df/f14 25404517 1 2024-09-18T21:12:44.636 INFO:tasks.workunit.client.1.smithi103.stdout:4/194: dwrite f6 [0,4194304] 0 2024-09-18T21:12:44.638 INFO:tasks.workunit.client.0.smithi077.stdout:8/173: creat d2/d5/d6/d22/f3c x:0 0 0 2024-09-18T21:12:44.638 INFO:tasks.workunit.client.1.smithi103.stdout:4/195: truncate d9/d1c/f39 1173174 0 2024-09-18T21:12:44.639 INFO:tasks.workunit.client.0.smithi077.stdout:6/273: readlink d7/df/d11/l24 0 2024-09-18T21:12:44.640 INFO:tasks.workunit.client.0.smithi077.stdout:6/274: fdatasync d7/f1f 0 2024-09-18T21:12:44.640 INFO:tasks.workunit.client.0.smithi077.stdout:8/174: rename d2/d5/d6/d22/d18 to d2/d5/d6/d22/d18/d3d 22 2024-09-18T21:12:44.641 INFO:tasks.workunit.client.0.smithi077.stdout:5/282: dread d0/df/d10/d4b/f65 [0,4194304] 0 2024-09-18T21:12:44.641 INFO:tasks.workunit.client.1.smithi103.stdout:1/214: rename d0/d2/d2b/f48 to d0/d2/f4e 0 2024-09-18T21:12:44.642 INFO:tasks.workunit.client.0.smithi077.stdout:5/283: fdatasync d0/f37 0 2024-09-18T21:12:44.642 INFO:tasks.workunit.client.0.smithi077.stdout:8/175: fdatasync d2/d5/d6/d22/f3c 0 2024-09-18T21:12:44.643 INFO:tasks.workunit.client.1.smithi103.stdout:1/215: read - d0/d11/d16/d19/f34 zero size 2024-09-18T21:12:44.643 INFO:tasks.workunit.client.1.smithi103.stdout:7/201: sync 2024-09-18T21:12:44.643 INFO:tasks.workunit.client.1.smithi103.stdout:5/188: sync 2024-09-18T21:12:44.644 INFO:tasks.workunit.client.0.smithi077.stdout:2/242: rename d1/d4/d9/f30 to d1/d4/d9/f51 0 2024-09-18T21:12:44.645 INFO:tasks.workunit.client.0.smithi077.stdout:6/275: fsync d7/df/d11/d1d/f44 0 2024-09-18T21:12:44.645 INFO:tasks.workunit.client.1.smithi103.stdout:7/202: chown d1/df/d1d/d1f/f2d 762699 1 2024-09-18T21:12:44.645 INFO:tasks.workunit.client.0.smithi077.stdout:6/276: fsync d7/df/f14 0 2024-09-18T21:12:44.646 INFO:tasks.workunit.client.1.smithi103.stdout:9/183: creat d18/f38 x:0 0 0 2024-09-18T21:12:44.646 INFO:tasks.workunit.client.0.smithi077.stdout:6/277: read d7/f2c [115631,104650] 0 2024-09-18T21:12:44.647 INFO:tasks.workunit.client.0.smithi077.stdout:8/176: fdatasync d2/d5/d6/f1f 0 2024-09-18T21:12:44.647 INFO:tasks.workunit.client.1.smithi103.stdout:1/216: readlink d0/d2/l4a 0 2024-09-18T21:12:44.649 INFO:tasks.workunit.client.1.smithi103.stdout:9/184: chown d18/d29/l37 29861454 1 2024-09-18T21:12:44.649 INFO:tasks.workunit.client.0.smithi077.stdout:2/243: getdents d1/d4/d5 0 2024-09-18T21:12:44.650 INFO:tasks.workunit.client.0.smithi077.stdout:2/244: fdatasync d1/f42 0 2024-09-18T21:12:44.650 INFO:tasks.workunit.client.1.smithi103.stdout:1/217: write d0/d11/f35 [2037511,89187] 0 2024-09-18T21:12:44.650 INFO:tasks.workunit.client.0.smithi077.stdout:8/177: mkdir d2/d5/d6/d22/d20/d3e 0 2024-09-18T21:12:44.651 INFO:tasks.workunit.client.1.smithi103.stdout:9/185: fsync d18/f24 0 2024-09-18T21:12:44.651 INFO:tasks.workunit.client.0.smithi077.stdout:2/245: stat d1/f42 0 2024-09-18T21:12:44.652 INFO:tasks.workunit.client.1.smithi103.stdout:0/179: sync 2024-09-18T21:12:44.652 INFO:tasks.workunit.client.0.smithi077.stdout:6/278: dread d7/f1f [0,4194304] 0 2024-09-18T21:12:44.654 INFO:tasks.workunit.client.1.smithi103.stdout:4/196: dwrite d9/f25 [0,4194304] 0 2024-09-18T21:12:44.654 INFO:tasks.workunit.client.1.smithi103.stdout:0/180: stat d1/d9/f33 0 2024-09-18T21:12:44.654 INFO:tasks.workunit.client.1.smithi103.stdout:5/189: dwrite de/d14/f39 [0,4194304] 0 2024-09-18T21:12:44.655 INFO:tasks.workunit.client.1.smithi103.stdout:4/197: chown f5 113927559 1 2024-09-18T21:12:44.656 INFO:tasks.workunit.client.1.smithi103.stdout:9/186: rmdir d18/d1f/d2f 39 2024-09-18T21:12:44.656 INFO:tasks.workunit.client.1.smithi103.stdout:0/181: readlink d1/d5/de/d19/d1e/l39 0 2024-09-18T21:12:44.658 INFO:tasks.workunit.client.1.smithi103.stdout:7/203: link d1/df/c11 d1/df/d1d/d29/d2f/d33/c3c 0 2024-09-18T21:12:44.659 INFO:tasks.workunit.client.0.smithi077.stdout:8/178: dwrite d2/f19 [0,4194304] 0 2024-09-18T21:12:44.660 INFO:tasks.workunit.client.0.smithi077.stdout:6/279: dwrite d7/f1f [4194304,4194304] 0 2024-09-18T21:12:44.662 INFO:tasks.workunit.client.1.smithi103.stdout:1/218: mknod d0/d2/d2b/d3a/d42/c4f 0 2024-09-18T21:12:44.663 INFO:tasks.workunit.client.1.smithi103.stdout:0/182: mkdir d1/d5/de/d22/d3c 0 2024-09-18T21:12:44.664 INFO:tasks.workunit.client.0.smithi077.stdout:8/179: unlink d2/d5/d6/f1f 0 2024-09-18T21:12:44.665 INFO:tasks.workunit.client.1.smithi103.stdout:4/198: truncate d9/d1f/f20 2472658 0 2024-09-18T21:12:44.665 INFO:tasks.workunit.client.0.smithi077.stdout:8/180: write d2/d5/d6/f14 [1854787,77619] 0 2024-09-18T21:12:44.666 INFO:tasks.workunit.client.0.smithi077.stdout:6/280: creat d7/df/d11/d1d/f5d x:0 0 0 2024-09-18T21:12:44.670 INFO:tasks.workunit.client.1.smithi103.stdout:7/204: chown d1/df/d1d/d29/d2f/d33/c3c 98 1 2024-09-18T21:12:44.670 INFO:tasks.workunit.client.1.smithi103.stdout:9/187: dwrite d18/f24 [0,4194304] 0 2024-09-18T21:12:44.672 INFO:tasks.workunit.client.0.smithi077.stdout:8/181: chown d2/d5/d6/c3a 107748704 1 2024-09-18T21:12:44.674 INFO:tasks.workunit.client.1.smithi103.stdout:4/199: mkdir d9/d1a/d41 0 2024-09-18T21:12:44.674 INFO:tasks.workunit.client.1.smithi103.stdout:2/183: getdents d3/d5/d25 0 2024-09-18T21:12:44.677 INFO:tasks.workunit.client.1.smithi103.stdout:0/183: creat d1/d9/d13/f3d x:0 0 0 2024-09-18T21:12:44.678 INFO:tasks.workunit.client.0.smithi077.stdout:8/182: creat d2/d27/d29/f3f x:0 0 0 2024-09-18T21:12:44.679 INFO:tasks.workunit.client.1.smithi103.stdout:1/219: dread d0/d11/f35 [0,4194304] 0 2024-09-18T21:12:44.680 INFO:tasks.workunit.client.1.smithi103.stdout:1/220: write d0/d11/d16/d19/f34 [435424,52999] 0 2024-09-18T21:12:44.683 INFO:tasks.workunit.client.0.smithi077.stdout:8/183: rmdir d2/d5/d6/d22/d26 39 2024-09-18T21:12:44.684 INFO:tasks.workunit.client.0.smithi077.stdout:8/184: write d2/f19 [692720,72688] 0 2024-09-18T21:12:44.684 INFO:tasks.workunit.client.1.smithi103.stdout:7/205: mknod d1/df/d1d/d29/c3d 0 2024-09-18T21:12:44.687 INFO:tasks.workunit.client.1.smithi103.stdout:4/200: creat d9/d1c/f42 x:0 0 0 2024-09-18T21:12:44.688 INFO:tasks.workunit.client.1.smithi103.stdout:2/184: mkdir d3/d5/d2f/d32/d46 0 2024-09-18T21:12:44.690 INFO:tasks.workunit.client.1.smithi103.stdout:0/184: mkdir d1/d9/d3e 0 2024-09-18T21:12:44.691 INFO:tasks.workunit.client.1.smithi103.stdout:1/221: symlink d0/d2/d9/dc/l50 0 2024-09-18T21:12:44.693 INFO:tasks.workunit.client.0.smithi077.stdout:5/284: truncate d0/d6/dd/f3a 3087306 0 2024-09-18T21:12:44.694 INFO:tasks.workunit.client.1.smithi103.stdout:2/185: mkdir d3/d5/d25/d47 0 2024-09-18T21:12:44.696 INFO:tasks.workunit.client.0.smithi077.stdout:5/285: write d0/d6/fb [298362,122994] 0 2024-09-18T21:12:44.697 INFO:tasks.workunit.client.1.smithi103.stdout:1/222: creat d0/d2/d2b/d3a/f51 x:0 0 0 2024-09-18T21:12:44.698 INFO:tasks.workunit.client.1.smithi103.stdout:9/188: rename d18/d1f/c34 to d18/d1f/c39 0 2024-09-18T21:12:44.698 INFO:tasks.workunit.client.1.smithi103.stdout:9/189: fdatasync d18/f24 0 2024-09-18T21:12:44.700 INFO:tasks.workunit.client.0.smithi077.stdout:5/286: symlink d0/d43/l6b 0 2024-09-18T21:12:44.701 INFO:tasks.workunit.client.0.smithi077.stdout:2/246: truncate d1/d4/d9/f1e 900950 0 2024-09-18T21:12:44.702 INFO:tasks.workunit.client.0.smithi077.stdout:2/247: chown d1/d4/d9/d4f 2535 1 2024-09-18T21:12:44.703 INFO:tasks.workunit.client.1.smithi103.stdout:2/186: mkdir d3/d5/d2f/d48 0 2024-09-18T21:12:44.704 INFO:tasks.workunit.client.0.smithi077.stdout:2/248: write d1/d4/d5/f3a [3861702,107358] 0 2024-09-18T21:12:44.706 INFO:tasks.workunit.client.1.smithi103.stdout:9/190: dwrite d18/d1f/f28 [0,4194304] 0 2024-09-18T21:12:44.706 INFO:tasks.workunit.client.0.smithi077.stdout:2/249: chown d1/d4/d5/d1a/d2e/d41/d2c 167727 1 2024-09-18T21:12:44.706 INFO:tasks.workunit.client.0.smithi077.stdout:5/287: dwrite d0/df/d10/f26 [0,4194304] 0 2024-09-18T21:12:44.708 INFO:tasks.workunit.client.0.smithi077.stdout:5/288: chown d0/d6/dd/c53 9692 1 2024-09-18T21:12:44.708 INFO:tasks.workunit.client.1.smithi103.stdout:5/190: dwrite de/d3e/f12 [4194304,4194304] 0 2024-09-18T21:12:44.708 INFO:tasks.workunit.client.0.smithi077.stdout:5/289: stat d0/df/l28 0 2024-09-18T21:12:44.709 INFO:tasks.workunit.client.1.smithi103.stdout:0/185: creat d1/f3f x:0 0 0 2024-09-18T21:12:44.712 INFO:tasks.workunit.client.0.smithi077.stdout:2/250: dread d1/d4/d5/d1a/d2e/d40/f44 [0,4194304] 0 2024-09-18T21:12:44.712 INFO:tasks.workunit.client.0.smithi077.stdout:5/290: rmdir d0/df/d10 39 2024-09-18T21:12:44.712 INFO:tasks.workunit.client.1.smithi103.stdout:5/191: fsync de/d14/f32 0 2024-09-18T21:12:44.713 INFO:tasks.workunit.client.0.smithi077.stdout:5/291: fdatasync d0/d6/f3c 0 2024-09-18T21:12:44.714 INFO:tasks.workunit.client.1.smithi103.stdout:5/192: write fb [8416786,105591] 0 2024-09-18T21:12:44.715 INFO:tasks.workunit.client.0.smithi077.stdout:6/281: write d7/df/d11/d25/f47 [790898,94224] 0 2024-09-18T21:12:44.718 INFO:tasks.workunit.client.0.smithi077.stdout:2/251: creat d1/d4/d9/d4f/f52 x:0 0 0 2024-09-18T21:12:44.719 INFO:tasks.workunit.client.0.smithi077.stdout:8/185: truncate f1 1166813 0 2024-09-18T21:12:44.720 INFO:tasks.workunit.client.0.smithi077.stdout:8/186: write d2/f19 [107189,22950] 0 2024-09-18T21:12:44.721 INFO:tasks.workunit.client.0.smithi077.stdout:5/292: readlink d0/df/d10/l34 0 2024-09-18T21:12:44.724 INFO:tasks.workunit.client.0.smithi077.stdout:2/252: creat d1/d4/d5/f53 x:0 0 0 2024-09-18T21:12:44.725 INFO:tasks.workunit.client.0.smithi077.stdout:2/253: write d1/f42 [3167171,37916] 0 2024-09-18T21:12:44.726 INFO:tasks.workunit.client.1.smithi103.stdout:7/206: dwrite d1/df/d1d/f1e [0,4194304] 0 2024-09-18T21:12:44.728 INFO:tasks.workunit.client.0.smithi077.stdout:8/187: symlink d2/d5/d6/d22/d20/l40 0 2024-09-18T21:12:44.728 INFO:tasks.workunit.client.1.smithi103.stdout:9/191: link le d18/d1f/l3a 0 2024-09-18T21:12:44.729 INFO:tasks.workunit.client.1.smithi103.stdout:9/192: chown d18/f38 412643 1 2024-09-18T21:12:44.729 INFO:tasks.workunit.client.1.smithi103.stdout:9/193: stat d18/d29/l26 0 2024-09-18T21:12:44.730 INFO:tasks.workunit.client.0.smithi077.stdout:5/293: readlink d0/d36/d49/l5a 0 2024-09-18T21:12:44.733 INFO:tasks.workunit.client.0.smithi077.stdout:4/169: sync 2024-09-18T21:12:44.734 INFO:tasks.workunit.client.0.smithi077.stdout:0/285: sync 2024-09-18T21:12:44.734 INFO:tasks.workunit.client.0.smithi077.stdout:2/254: dwrite d1/d4/f22 [0,4194304] 0 2024-09-18T21:12:44.735 INFO:tasks.workunit.client.1.smithi103.stdout:0/186: rmdir d1/d5/de/d22/d3c 0 2024-09-18T21:12:44.740 INFO:tasks.workunit.client.0.smithi077.stdout:4/170: dread d3/f5 [0,4194304] 0 2024-09-18T21:12:44.741 INFO:tasks.workunit.client.0.smithi077.stdout:5/294: creat d0/d6/d3b/d64/f6c x:0 0 0 2024-09-18T21:12:44.742 INFO:tasks.workunit.client.0.smithi077.stdout:0/286: mkdir d8/d1d/d57 0 2024-09-18T21:12:44.742 INFO:tasks.workunit.client.0.smithi077.stdout:4/171: write d3/dc/d20/f2a [1844463,51437] 0 2024-09-18T21:12:44.742 INFO:tasks.workunit.client.0.smithi077.stdout:5/295: chown d0/df/f25 174391 1 2024-09-18T21:12:44.744 INFO:tasks.workunit.client.0.smithi077.stdout:5/296: dread - d0/df/f25 zero size 2024-09-18T21:12:44.749 INFO:tasks.workunit.client.1.smithi103.stdout:9/194: mknod d18/c3b 0 2024-09-18T21:12:44.750 INFO:tasks.workunit.client.1.smithi103.stdout:9/195: chown d18/l1c 32431 1 2024-09-18T21:12:44.750 INFO:tasks.workunit.client.0.smithi077.stdout:0/287: dwrite d8/d1a/d35/f4d [0,4194304] 0 2024-09-18T21:12:44.751 INFO:tasks.workunit.client.1.smithi103.stdout:0/187: mknod d1/d5/de/d19/d1e/d34/c40 0 2024-09-18T21:12:44.752 INFO:tasks.workunit.client.1.smithi103.stdout:0/188: stat d1/d5/de/d24/l35 0 2024-09-18T21:12:44.753 INFO:tasks.workunit.client.0.smithi077.stdout:4/172: rename d3/d7/ce to d3/dc/c33 0 2024-09-18T21:12:44.754 INFO:tasks.workunit.client.1.smithi103.stdout:5/193: link lc de/d14/l42 0 2024-09-18T21:12:44.756 INFO:tasks.workunit.client.0.smithi077.stdout:4/173: truncate d3/dc/d20/f29 703801 0 2024-09-18T21:12:44.757 INFO:tasks.workunit.client.0.smithi077.stdout:4/174: write d3/dc/f1c [522809,60854] 0 2024-09-18T21:12:44.758 INFO:tasks.workunit.client.0.smithi077.stdout:5/297: mkdir d0/d43/d6d 0 2024-09-18T21:12:44.761 INFO:tasks.workunit.client.1.smithi103.stdout:0/189: fdatasync d1/d5/f6 0 2024-09-18T21:12:44.761 INFO:tasks.workunit.client.1.smithi103.stdout:0/190: fdatasync d1/f36 0 2024-09-18T21:12:44.761 INFO:tasks.workunit.client.0.smithi077.stdout:0/288: mkdir d8/d1a/d39/d3b/d4e/d58 0 2024-09-18T21:12:44.762 INFO:tasks.workunit.client.1.smithi103.stdout:0/191: read d1/d9/d13/f14 [199042,79363] 0 2024-09-18T21:12:44.762 INFO:tasks.workunit.client.0.smithi077.stdout:0/289: chown d8/f23 57 1 2024-09-18T21:12:44.765 INFO:tasks.workunit.client.1.smithi103.stdout:5/194: rename f8 to de/d3e/f43 0 2024-09-18T21:12:44.768 INFO:tasks.workunit.client.1.smithi103.stdout:0/192: creat d1/d5/de/d19/d1e/f41 x:0 0 0 2024-09-18T21:12:44.769 INFO:tasks.workunit.client.1.smithi103.stdout:7/207: write d1/df/f14 [494423,127187] 0 2024-09-18T21:12:44.769 INFO:tasks.workunit.client.1.smithi103.stdout:5/195: rmdir de/d3e/d15 39 2024-09-18T21:12:44.770 INFO:tasks.workunit.client.0.smithi077.stdout:2/255: dread d1/f1d [0,4194304] 0 2024-09-18T21:12:44.771 INFO:tasks.workunit.client.0.smithi077.stdout:2/256: write d1/f1c [4953175,110057] 0 2024-09-18T21:12:44.772 INFO:tasks.workunit.client.1.smithi103.stdout:9/196: creat d18/f3c x:0 0 0 2024-09-18T21:12:44.774 INFO:tasks.workunit.client.0.smithi077.stdout:0/290: creat d8/d1a/d39/f59 x:0 0 0 2024-09-18T21:12:44.774 INFO:tasks.workunit.client.0.smithi077.stdout:0/291: fsync d8/d26/f38 0 2024-09-18T21:12:44.774 INFO:tasks.workunit.client.1.smithi103.stdout:0/193: mkdir d1/d5/de/d22/d42 0 2024-09-18T21:12:44.775 INFO:tasks.workunit.client.0.smithi077.stdout:0/292: dread - d8/d26/f54 zero size 2024-09-18T21:12:44.778 INFO:tasks.workunit.client.1.smithi103.stdout:7/208: creat d1/df/d1d/d29/d2f/d33/f3e x:0 0 0 2024-09-18T21:12:44.779 INFO:tasks.workunit.client.0.smithi077.stdout:8/188: dwrite d2/d27/d29/f38 [4194304,4194304] 0 2024-09-18T21:12:44.783 INFO:tasks.workunit.client.1.smithi103.stdout:0/194: unlink d1/d5/de/d22/f3b 0 2024-09-18T21:12:44.785 INFO:tasks.workunit.client.1.smithi103.stdout:0/195: truncate d1/f29 795714 0 2024-09-18T21:12:44.788 INFO:tasks.workunit.client.1.smithi103.stdout:5/196: mkdir de/d2d/d44 0 2024-09-18T21:12:44.790 INFO:tasks.workunit.client.1.smithi103.stdout:7/209: mkdir d1/df/d1d/d1f/d2e/d3f 0 2024-09-18T21:12:44.794 INFO:tasks.workunit.client.0.smithi077.stdout:8/189: mkdir d2/d27/d29/d41 0 2024-09-18T21:12:44.796 INFO:tasks.workunit.client.1.smithi103.stdout:7/210: dwrite d1/f15 [0,4194304] 0 2024-09-18T21:12:44.797 INFO:tasks.workunit.client.0.smithi077.stdout:2/257: write d1/d4/d5/d1a/f4a [626722,26510] 0 2024-09-18T21:12:44.797 INFO:tasks.workunit.client.0.smithi077.stdout:2/258: chown d1/l23 7378 1 2024-09-18T21:12:44.800 INFO:tasks.workunit.client.1.smithi103.stdout:0/196: truncate d1/d9/d13/f37 1394721 0 2024-09-18T21:12:44.801 INFO:tasks.workunit.client.0.smithi077.stdout:8/190: rmdir d2/d5/d6/d22/d26 39 2024-09-18T21:12:44.802 INFO:tasks.workunit.client.0.smithi077.stdout:0/293: dread f3 [0,4194304] 0 2024-09-18T21:12:44.802 INFO:tasks.workunit.client.1.smithi103.stdout:6/224: sync 2024-09-18T21:12:44.803 INFO:tasks.workunit.client.1.smithi103.stdout:3/179: sync 2024-09-18T21:12:44.803 INFO:tasks.workunit.client.1.smithi103.stdout:6/225: chown d2/d3/d8/f10 13526803 1 2024-09-18T21:12:44.803 INFO:tasks.workunit.client.1.smithi103.stdout:6/226: readlink d2/le 0 2024-09-18T21:12:44.804 INFO:tasks.workunit.client.0.smithi077.stdout:2/259: symlink d1/d4/d5/d1a/d2e/d41/l54 0 2024-09-18T21:12:44.806 INFO:tasks.workunit.client.1.smithi103.stdout:9/197: link d18/l27 d18/d1f/d2f/l3d 0 2024-09-18T21:12:44.806 INFO:tasks.workunit.client.1.smithi103.stdout:9/198: chown f17 2 1 2024-09-18T21:12:44.807 INFO:tasks.workunit.client.0.smithi077.stdout:4/175: write d3/d7/f1a [1375431,102041] 0 2024-09-18T21:12:44.807 INFO:tasks.workunit.client.0.smithi077.stdout:0/294: fsync d8/d37/f50 0 2024-09-18T21:12:44.808 INFO:tasks.workunit.client.0.smithi077.stdout:2/260: dread d1/f42 [0,4194304] 0 2024-09-18T21:12:44.809 INFO:tasks.workunit.client.1.smithi103.stdout:3/180: symlink d1/d2/l32 0 2024-09-18T21:12:44.810 INFO:tasks.workunit.client.0.smithi077.stdout:5/298: truncate d0/df/f22 1078631 0 2024-09-18T21:12:44.810 INFO:tasks.workunit.client.1.smithi103.stdout:3/181: readlink d1/l2b 0 2024-09-18T21:12:44.810 INFO:tasks.workunit.client.1.smithi103.stdout:5/197: dread de/d3e/f12 [0,4194304] 0 2024-09-18T21:12:44.811 INFO:tasks.workunit.client.1.smithi103.stdout:5/198: chown de/d14/f32 3400 1 2024-09-18T21:12:44.812 INFO:tasks.workunit.client.0.smithi077.stdout:0/295: dread d8/d1a/d35/f4d [0,4194304] 0 2024-09-18T21:12:44.821 INFO:tasks.workunit.client.1.smithi103.stdout:6/227: dread d2/d3/d4/f2b [0,4194304] 0 2024-09-18T21:12:44.823 INFO:tasks.workunit.client.1.smithi103.stdout:0/197: dread d1/f12 [0,4194304] 0 2024-09-18T21:12:44.858 INFO:tasks.workunit.client.0.smithi077.stdout:8/191: rename d2/d5/d6/d22/d20/c3b to d2/c42 0 2024-09-18T21:12:44.860 INFO:tasks.workunit.client.0.smithi077.stdout:4/176: symlink d3/d17/l34 0 2024-09-18T21:12:44.861 INFO:tasks.workunit.client.0.smithi077.stdout:4/177: write d3/f2b [278716,11425] 0 2024-09-18T21:12:44.861 INFO:tasks.workunit.client.1.smithi103.stdout:3/182: mknod d1/d2/c33 0 2024-09-18T21:12:44.863 INFO:tasks.workunit.client.0.smithi077.stdout:2/261: creat d1/d4/d9/d24/f55 x:0 0 0 2024-09-18T21:12:44.864 INFO:tasks.workunit.client.0.smithi077.stdout:5/299: symlink d0/df/d10/d47/l6e 0 2024-09-18T21:12:44.865 INFO:tasks.workunit.client.0.smithi077.stdout:0/296: mknod d8/d1a/d35/c5a 0 2024-09-18T21:12:44.867 INFO:tasks.workunit.client.0.smithi077.stdout:8/192: creat d2/d27/d29/f43 x:0 0 0 2024-09-18T21:12:44.867 INFO:tasks.workunit.client.0.smithi077.stdout:0/297: read d8/d1a/d39/d3b/f44 [2069718,122638] 0 2024-09-18T21:12:44.868 INFO:tasks.workunit.client.0.smithi077.stdout:0/298: dread - d8/d1d/f55 zero size 2024-09-18T21:12:44.868 INFO:tasks.workunit.client.0.smithi077.stdout:4/178: mkdir d3/d35 0 2024-09-18T21:12:44.869 INFO:tasks.workunit.client.0.smithi077.stdout:4/179: stat d3/dc/f1c 0 2024-09-18T21:12:44.872 INFO:tasks.workunit.client.1.smithi103.stdout:5/199: creat de/d2d/d44/f45 x:0 0 0 2024-09-18T21:12:44.873 INFO:tasks.workunit.client.1.smithi103.stdout:3/183: dread d1/d2/d18/f29 [0,4194304] 0 2024-09-18T21:12:44.874 INFO:tasks.workunit.client.0.smithi077.stdout:2/262: rename c0 to d1/d4/d5/d1a/c56 0 2024-09-18T21:12:44.875 INFO:tasks.workunit.client.0.smithi077.stdout:4/180: dwrite d3/f26 [0,4194304] 0 2024-09-18T21:12:44.876 INFO:tasks.workunit.client.1.smithi103.stdout:6/228: unlink d2/d3/d4/f2b 0 2024-09-18T21:12:44.877 INFO:tasks.workunit.client.1.smithi103.stdout:0/198: dread d1/d5/f6 [0,4194304] 0 2024-09-18T21:12:44.877 INFO:tasks.workunit.client.0.smithi077.stdout:5/300: mknod d0/df/d3d/c6f 0 2024-09-18T21:12:44.878 INFO:tasks.workunit.client.1.smithi103.stdout:7/211: write d1/df/d1d/f26 [841422,35148] 0 2024-09-18T21:12:44.879 INFO:tasks.workunit.client.0.smithi077.stdout:5/301: write d0/df/d10/d47/f68 [113040,90012] 0 2024-09-18T21:12:44.880 INFO:tasks.workunit.client.0.smithi077.stdout:8/193: write d2/d5/f16 [1447837,83296] 0 2024-09-18T21:12:44.881 INFO:tasks.workunit.client.0.smithi077.stdout:5/302: write d0/d6/d3b/f55 [610987,14879] 0 2024-09-18T21:12:44.882 INFO:tasks.workunit.client.1.smithi103.stdout:6/229: mkdir d2/d3/d4/d49 0 2024-09-18T21:12:44.884 INFO:tasks.workunit.client.0.smithi077.stdout:0/299: rename d8/f17 to d8/d1a/d39/d3b/f5b 0 2024-09-18T21:12:44.887 INFO:tasks.workunit.client.0.smithi077.stdout:8/194: dwrite d2/d5/d6/f2c [0,4194304] 0 2024-09-18T21:12:44.887 INFO:tasks.workunit.client.1.smithi103.stdout:0/199: mkdir d1/d5/de/d24/d43 0 2024-09-18T21:12:44.888 INFO:tasks.workunit.client.0.smithi077.stdout:8/195: read - d2/d27/d29/f43 zero size 2024-09-18T21:12:44.888 INFO:tasks.workunit.client.1.smithi103.stdout:7/212: creat d1/df/d1d/d29/d2f/d33/f40 x:0 0 0 2024-09-18T21:12:44.889 INFO:tasks.workunit.client.1.smithi103.stdout:6/230: dwrite d2/d24/f27 [0,4194304] 0 2024-09-18T21:12:44.890 INFO:tasks.workunit.client.0.smithi077.stdout:5/303: creat d0/d36/f70 x:0 0 0 2024-09-18T21:12:44.892 INFO:tasks.workunit.client.1.smithi103.stdout:3/184: mkdir d1/d34 0 2024-09-18T21:12:44.895 INFO:tasks.workunit.client.0.smithi077.stdout:2/263: mknod d1/d4/d5/c57 0 2024-09-18T21:12:44.895 INFO:tasks.workunit.client.1.smithi103.stdout:5/200: fsync de/d2d/d44/f45 0 2024-09-18T21:12:44.896 INFO:tasks.workunit.client.1.smithi103.stdout:3/185: dread d1/f24 [0,4194304] 0 2024-09-18T21:12:44.896 INFO:tasks.workunit.client.1.smithi103.stdout:0/200: creat d1/d5/f44 x:0 0 0 2024-09-18T21:12:44.897 INFO:tasks.workunit.client.0.smithi077.stdout:8/196: dwrite d2/d27/d29/f43 [0,4194304] 0 2024-09-18T21:12:44.897 INFO:tasks.workunit.client.1.smithi103.stdout:3/186: dread - d1/d23/f2a zero size 2024-09-18T21:12:44.898 INFO:tasks.workunit.client.0.smithi077.stdout:8/197: chown d2/f19 492 1 2024-09-18T21:12:44.898 INFO:tasks.workunit.client.1.smithi103.stdout:0/201: truncate d1/d9/d13/f3d 131931 0 2024-09-18T21:12:44.900 INFO:tasks.workunit.client.1.smithi103.stdout:7/213: unlink d1/l9 0 2024-09-18T21:12:44.900 INFO:tasks.workunit.client.1.smithi103.stdout:0/202: dread d1/d9/d13/f14 [0,4194304] 0 2024-09-18T21:12:44.901 INFO:tasks.workunit.client.0.smithi077.stdout:4/181: mknod d3/dc/d32/c36 0 2024-09-18T21:12:44.901 INFO:tasks.workunit.client.1.smithi103.stdout:7/214: chown d1/df/f14 3445038 1 2024-09-18T21:12:44.901 INFO:tasks.workunit.client.1.smithi103.stdout:0/203: chown d1/d5/de/d19/d1e 99181 1 2024-09-18T21:12:44.906 INFO:tasks.workunit.client.1.smithi103.stdout:3/187: rename d1/d2/l32 to d1/d2/d18/l35 0 2024-09-18T21:12:44.907 INFO:tasks.workunit.client.1.smithi103.stdout:7/215: dwrite d1/f1b [0,4194304] 0 2024-09-18T21:12:44.907 INFO:tasks.workunit.client.1.smithi103.stdout:3/188: fsync d1/da/f22 0 2024-09-18T21:12:44.909 INFO:tasks.workunit.client.0.smithi077.stdout:0/300: symlink d8/d1a/d39/d3b/d4e/d58/l5c 0 2024-09-18T21:12:44.909 INFO:tasks.workunit.client.1.smithi103.stdout:3/189: write d1/f2e [792935,113615] 0 2024-09-18T21:12:44.910 INFO:tasks.workunit.client.0.smithi077.stdout:0/301: dread - d8/d1d/f55 zero size 2024-09-18T21:12:44.910 INFO:tasks.workunit.client.1.smithi103.stdout:0/204: creat d1/d5/de/d19/d1e/d34/f45 x:0 0 0 2024-09-18T21:12:44.912 INFO:tasks.workunit.client.1.smithi103.stdout:5/201: unlink de/f31 0 2024-09-18T21:12:44.913 INFO:tasks.workunit.client.1.smithi103.stdout:5/202: read - de/d14/f18 zero size 2024-09-18T21:12:44.913 INFO:tasks.workunit.client.1.smithi103.stdout:4/201: sync 2024-09-18T21:12:44.913 INFO:tasks.workunit.client.1.smithi103.stdout:8/219: sync 2024-09-18T21:12:44.913 INFO:tasks.workunit.client.1.smithi103.stdout:5/203: chown de/d2d/d44 31 1 2024-09-18T21:12:44.914 INFO:tasks.workunit.client.1.smithi103.stdout:5/204: readlink ld 0 2024-09-18T21:12:44.915 INFO:tasks.workunit.client.0.smithi077.stdout:5/304: creat d0/d43/d6d/f71 x:0 0 0 2024-09-18T21:12:44.917 INFO:tasks.workunit.client.0.smithi077.stdout:5/305: truncate d0/df/d10/f45 459036 0 2024-09-18T21:12:44.918 INFO:tasks.workunit.client.1.smithi103.stdout:0/205: creat d1/d9/d13/f46 x:0 0 0 2024-09-18T21:12:44.918 INFO:tasks.workunit.client.0.smithi077.stdout:8/198: mknod d2/d5/d6/d22/d20/d35/c44 0 2024-09-18T21:12:44.919 INFO:tasks.workunit.client.1.smithi103.stdout:6/231: fsync d2/d24/f27 0 2024-09-18T21:12:44.921 INFO:tasks.workunit.client.1.smithi103.stdout:4/202: symlink d9/d1f/d31/l43 0 2024-09-18T21:12:44.923 INFO:tasks.workunit.client.1.smithi103.stdout:7/216: link d1/df/f14 d1/df/d1d/d1f/d2e/f41 0 2024-09-18T21:12:44.924 INFO:tasks.workunit.client.0.smithi077.stdout:0/302: rename d8/d1a/c1f to d8/d1d/d57/c5d 0 2024-09-18T21:12:44.924 INFO:tasks.workunit.client.0.smithi077.stdout:0/303: chown d8/f13 4 1 2024-09-18T21:12:44.925 INFO:tasks.workunit.client.0.smithi077.stdout:0/304: readlink d8/d1a/d35/l4f 0 2024-09-18T21:12:44.926 INFO:tasks.workunit.client.1.smithi103.stdout:5/205: creat de/d14/d33/f46 x:0 0 0 2024-09-18T21:12:44.926 INFO:tasks.workunit.client.0.smithi077.stdout:5/306: creat d0/df/d10/d5c/f72 x:0 0 0 2024-09-18T21:12:44.928 INFO:tasks.workunit.client.1.smithi103.stdout:7/217: dwrite d1/df/d1d/d29/d2f/d33/f40 [0,4194304] 0 2024-09-18T21:12:44.931 INFO:tasks.workunit.client.1.smithi103.stdout:0/206: mknod d1/d5/c47 0 2024-09-18T21:12:44.932 INFO:tasks.workunit.client.1.smithi103.stdout:8/220: getdents d4/de/d4a 0 2024-09-18T21:12:44.933 INFO:tasks.workunit.client.1.smithi103.stdout:4/203: creat d9/d1f/f44 x:0 0 0 2024-09-18T21:12:44.934 INFO:tasks.workunit.client.0.smithi077.stdout:0/305: unlink d8/d1a/d35/f3e 0 2024-09-18T21:12:44.937 INFO:tasks.workunit.client.1.smithi103.stdout:3/190: dwrite d1/d2/d18/f29 [4194304,4194304] 0 2024-09-18T21:12:44.938 INFO:tasks.workunit.client.0.smithi077.stdout:4/182: getdents d3/dc/d24 0 2024-09-18T21:12:44.938 INFO:tasks.workunit.client.0.smithi077.stdout:4/183: fsync d3/f1f 0 2024-09-18T21:12:44.939 INFO:tasks.workunit.client.0.smithi077.stdout:2/264: getdents d1/d4/d5/d1a/d49 0 2024-09-18T21:12:44.941 INFO:tasks.workunit.client.0.smithi077.stdout:8/199: dread d2/d5/f16 [0,4194304] 0 2024-09-18T21:12:44.941 INFO:tasks.workunit.client.1.smithi103.stdout:0/207: mkdir d1/d9/d48 0 2024-09-18T21:12:44.941 INFO:tasks.workunit.client.1.smithi103.stdout:7/218: dread d1/df/d1d/f2b [0,4194304] 0 2024-09-18T21:12:44.941 INFO:tasks.workunit.client.0.smithi077.stdout:8/200: chown d2/d27/d29/d41 2 1 2024-09-18T21:12:44.944 INFO:tasks.workunit.client.0.smithi077.stdout:5/307: unlink d0/df/f22 0 2024-09-18T21:12:44.948 INFO:tasks.workunit.client.1.smithi103.stdout:6/232: creat d2/f4a x:0 0 0 2024-09-18T21:12:44.948 INFO:tasks.workunit.client.0.smithi077.stdout:2/265: write d1/d4/d9/f51 [1039754,50533] 0 2024-09-18T21:12:44.950 INFO:tasks.workunit.client.1.smithi103.stdout:9/199: sync 2024-09-18T21:12:44.951 INFO:tasks.workunit.client.1.smithi103.stdout:2/187: sync 2024-09-18T21:12:44.951 INFO:tasks.workunit.client.1.smithi103.stdout:1/223: sync 2024-09-18T21:12:44.954 INFO:tasks.workunit.client.0.smithi077.stdout:4/184: creat d3/d35/f37 x:0 0 0 2024-09-18T21:12:44.954 INFO:tasks.workunit.client.0.smithi077.stdout:4/185: fsync d3/f26 0 2024-09-18T21:12:44.955 INFO:tasks.workunit.client.0.smithi077.stdout:4/186: read - d3/d17/f28 zero size 2024-09-18T21:12:44.957 INFO:tasks.workunit.client.0.smithi077.stdout:8/201: creat d2/d27/d29/d41/f45 x:0 0 0 2024-09-18T21:12:44.957 INFO:tasks.workunit.client.1.smithi103.stdout:8/221: getdents d4/d2d/d44 0 2024-09-18T21:12:44.958 INFO:tasks.workunit.client.1.smithi103.stdout:8/222: write d4/d2c/f36 [173683,10988] 0 2024-09-18T21:12:44.959 INFO:tasks.workunit.client.1.smithi103.stdout:4/204: link d9/fc d9/d38/f45 0 2024-09-18T21:12:44.962 INFO:tasks.workunit.client.1.smithi103.stdout:0/208: write d1/d9/d13/f37 [330130,48931] 0 2024-09-18T21:12:44.963 INFO:tasks.workunit.client.0.smithi077.stdout:0/306: dwrite d8/d1a/d39/d3b/f5b [0,4194304] 0 2024-09-18T21:12:44.963 INFO:tasks.workunit.client.1.smithi103.stdout:1/224: unlink d0/d3/l1b 0 2024-09-18T21:12:44.965 INFO:tasks.workunit.client.1.smithi103.stdout:3/191: creat d1/d34/f36 x:0 0 0 2024-09-18T21:12:44.966 INFO:tasks.workunit.client.0.smithi077.stdout:5/308: dread d0/d6/fb [0,4194304] 0 2024-09-18T21:12:44.966 INFO:tasks.workunit.client.0.smithi077.stdout:9/149: sync 2024-09-18T21:12:44.968 INFO:tasks.workunit.client.1.smithi103.stdout:6/233: dread d2/d3/f2f [0,4194304] 0 2024-09-18T21:12:44.968 INFO:tasks.workunit.client.1.smithi103.stdout:4/205: dwrite d9/d2e/f3f [0,4194304] 0 2024-09-18T21:12:44.969 INFO:tasks.workunit.client.0.smithi077.stdout:8/202: fdatasync f1 0 2024-09-18T21:12:44.970 INFO:tasks.workunit.client.0.smithi077.stdout:8/203: write d2/f19 [2748453,101739] 0 2024-09-18T21:12:44.971 INFO:tasks.workunit.client.0.smithi077.stdout:2/266: truncate d1/d4/d5/d1a/d2e/f34 511410 0 2024-09-18T21:12:44.971 INFO:tasks.workunit.client.0.smithi077.stdout:8/204: fsync d2/f31 0 2024-09-18T21:12:44.972 INFO:tasks.workunit.client.0.smithi077.stdout:0/307: creat d8/d1a/d39/d3b/d4e/d58/f5e x:0 0 0 2024-09-18T21:12:44.974 INFO:tasks.workunit.client.0.smithi077.stdout:0/308: write d8/f19 [978028,50875] 0 2024-09-18T21:12:44.981 INFO:tasks.workunit.client.0.smithi077.stdout:2/267: dwrite d1/d4/d5/d1a/d2e/d41/d2c/f47 [0,4194304] 0 2024-09-18T21:12:44.982 INFO:tasks.workunit.client.0.smithi077.stdout:2/268: stat d1/d4/d9/d4f/f52 0 2024-09-18T21:12:44.986 INFO:tasks.workunit.client.1.smithi103.stdout:3/192: truncate d1/f24 2065716 0 2024-09-18T21:12:44.988 INFO:tasks.workunit.client.1.smithi103.stdout:6/234: mknod d2/d3/d4/c4b 0 2024-09-18T21:12:44.989 INFO:tasks.workunit.client.0.smithi077.stdout:5/309: link d0/d6/dd/f35 d0/df/d3d/f73 0 2024-09-18T21:12:44.990 INFO:tasks.workunit.client.0.smithi077.stdout:5/310: chown d0/df/f27 5531746 1 2024-09-18T21:12:44.992 INFO:tasks.workunit.client.1.smithi103.stdout:8/223: symlink d4/l4b 0 2024-09-18T21:12:44.992 INFO:tasks.workunit.client.1.smithi103.stdout:4/206: creat d9/d1f/d31/f46 x:0 0 0 2024-09-18T21:12:44.993 INFO:tasks.workunit.client.0.smithi077.stdout:8/205: creat d2/d5/d25/d2a/f46 x:0 0 0 2024-09-18T21:12:44.993 INFO:tasks.workunit.client.1.smithi103.stdout:8/224: chown d4/de/f11 142 1 2024-09-18T21:12:44.993 INFO:tasks.workunit.client.1.smithi103.stdout:0/209: dread d1/d5/de/d24/f32 [0,4194304] 0 2024-09-18T21:12:44.994 INFO:tasks.workunit.client.1.smithi103.stdout:5/206: getdents de/d3e/d15 0 2024-09-18T21:12:44.995 INFO:tasks.workunit.client.1.smithi103.stdout:0/210: write d1/d5/fc [1143642,87249] 0 2024-09-18T21:12:44.995 INFO:tasks.workunit.client.0.smithi077.stdout:2/269: rmdir d1/d4/d5/d1a/d2e 39 2024-09-18T21:12:44.996 INFO:tasks.workunit.client.1.smithi103.stdout:5/207: fsync de/d2d/d44/f45 0 2024-09-18T21:12:44.996 INFO:tasks.workunit.client.0.smithi077.stdout:9/150: fdatasync d1/df/f12 0 2024-09-18T21:12:44.997 INFO:tasks.workunit.client.1.smithi103.stdout:9/200: rename d18/d1f/f2e to d18/f3e 0 2024-09-18T21:12:44.998 INFO:tasks.workunit.client.1.smithi103.stdout:9/201: stat d18/f22 0 2024-09-18T21:12:44.999 INFO:tasks.workunit.client.0.smithi077.stdout:5/311: rename d0/d36/d49 to d0/df/d10/d5c/d74 0 2024-09-18T21:12:45.000 INFO:tasks.workunit.client.1.smithi103.stdout:7/219: getdents d1/df/d1d/d29 0 2024-09-18T21:12:45.002 INFO:tasks.workunit.client.1.smithi103.stdout:8/225: dwrite d4/de/f1e [4194304,4194304] 0 2024-09-18T21:12:45.003 INFO:tasks.workunit.client.1.smithi103.stdout:6/235: mkdir d2/d3/d8/d4c 0 2024-09-18T21:12:45.003 INFO:tasks.workunit.client.1.smithi103.stdout:5/208: dread de/d1f/f24 [0,4194304] 0 2024-09-18T21:12:45.004 INFO:tasks.workunit.client.1.smithi103.stdout:6/236: rename d2 to d2/d3/d8/df/d4d 22 2024-09-18T21:12:45.005 INFO:tasks.workunit.client.1.smithi103.stdout:6/237: fdatasync d2/d3/f48 0 2024-09-18T21:12:45.006 INFO:tasks.workunit.client.0.smithi077.stdout:9/151: mkdir d1/dd/d11/d2d 0 2024-09-18T21:12:45.009 INFO:tasks.workunit.client.0.smithi077.stdout:5/312: creat d0/d36/f75 x:0 0 0 2024-09-18T21:12:45.009 INFO:tasks.workunit.client.0.smithi077.stdout:8/206: dwrite d2/d5/d6/d22/d26/f39 [0,4194304] 0 2024-09-18T21:12:45.012 INFO:tasks.workunit.client.1.smithi103.stdout:3/193: symlink d1/d23/d25/l37 0 2024-09-18T21:12:45.013 INFO:tasks.workunit.client.1.smithi103.stdout:3/194: chown d1/da/df/l2c 7565 1 2024-09-18T21:12:45.013 INFO:tasks.workunit.client.0.smithi077.stdout:0/309: getdents d8/d1a/d39/d3b/d4e/d58 0 2024-09-18T21:12:45.015 INFO:tasks.workunit.client.1.smithi103.stdout:7/220: rename d1/df/d1d to d1/df/d42 0 2024-09-18T21:12:45.017 INFO:tasks.workunit.client.0.smithi077.stdout:9/152: unlink d1/dd/d11/d1c/l2b 0 2024-09-18T21:12:45.017 INFO:tasks.workunit.client.0.smithi077.stdout:5/313: dwrite d0/df/d10/d47/f58 [0,4194304] 0 2024-09-18T21:12:45.019 INFO:tasks.workunit.client.1.smithi103.stdout:8/226: unlink d4/d26/l1f 0 2024-09-18T21:12:45.020 INFO:tasks.workunit.client.0.smithi077.stdout:8/207: readlink d2/d5/d6/l10 0 2024-09-18T21:12:45.023 INFO:tasks.workunit.client.1.smithi103.stdout:5/209: chown de/d2d/c30 37804128 1 2024-09-18T21:12:45.024 INFO:tasks.workunit.client.0.smithi077.stdout:0/310: creat d8/d1d/d57/f5f x:0 0 0 2024-09-18T21:12:45.025 INFO:tasks.workunit.client.0.smithi077.stdout:5/314: dread d0/d6/dd/f19 [0,4194304] 0 2024-09-18T21:12:45.028 INFO:tasks.workunit.client.0.smithi077.stdout:2/270: truncate d1/d4/f8 4153144 0 2024-09-18T21:12:45.028 INFO:tasks.workunit.client.0.smithi077.stdout:0/311: dread d8/d1a/d35/f47 [0,4194304] 0 2024-09-18T21:12:45.029 INFO:tasks.workunit.client.0.smithi077.stdout:2/271: readlink d1/d4/d9/d24/l4e 0 2024-09-18T21:12:45.029 INFO:tasks.workunit.client.1.smithi103.stdout:0/211: mknod d1/d9/d3e/c49 0 2024-09-18T21:12:45.030 INFO:tasks.workunit.client.0.smithi077.stdout:0/312: write d8/d26/f1b [411565,125654] 0 2024-09-18T21:12:45.031 INFO:tasks.workunit.client.1.smithi103.stdout:1/225: getdents d0/d2/d9 0 2024-09-18T21:12:45.033 INFO:tasks.workunit.client.1.smithi103.stdout:1/226: truncate d0/d11/d16/d19/f34 924424 0 2024-09-18T21:12:45.035 INFO:tasks.workunit.client.1.smithi103.stdout:9/202: mkdir d18/d1f/d3f 0 2024-09-18T21:12:45.035 INFO:tasks.workunit.client.1.smithi103.stdout:4/207: truncate d9/d1a/f1e 2343600 0 2024-09-18T21:12:45.037 INFO:tasks.workunit.client.1.smithi103.stdout:3/195: unlink d1/d2/f26 0 2024-09-18T21:12:45.038 INFO:tasks.workunit.client.1.smithi103.stdout:5/210: creat de/d2d/d44/f47 x:0 0 0 2024-09-18T21:12:45.039 INFO:tasks.workunit.client.1.smithi103.stdout:6/238: mkdir d2/d3/d8/d4c/d4e 0 2024-09-18T21:12:45.040 INFO:tasks.workunit.client.1.smithi103.stdout:6/239: stat d2/le 0 2024-09-18T21:12:45.041 INFO:tasks.workunit.client.1.smithi103.stdout:0/212: creat d1/d5/de/d19/f4a x:0 0 0 2024-09-18T21:12:45.041 INFO:tasks.workunit.client.0.smithi077.stdout:0/313: mknod d8/d1a/d39/d3b/d4e/c60 0 2024-09-18T21:12:45.042 INFO:tasks.workunit.client.1.smithi103.stdout:0/213: readlink d1/d5/de/l15 0 2024-09-18T21:12:45.042 INFO:tasks.workunit.client.1.smithi103.stdout:1/227: mkdir d0/d2/d9/dc/d36/d52 0 2024-09-18T21:12:45.043 INFO:tasks.workunit.client.0.smithi077.stdout:5/315: symlink d0/l76 0 2024-09-18T21:12:45.044 INFO:tasks.workunit.client.1.smithi103.stdout:1/228: write d0/f37 [1946422,124543] 0 2024-09-18T21:12:45.044 INFO:tasks.workunit.client.0.smithi077.stdout:5/316: write d0/d6/dd/f30 [4273558,69288] 0 2024-09-18T21:12:45.044 INFO:tasks.workunit.client.0.smithi077.stdout:9/153: symlink d1/df/d27/l2e 0 2024-09-18T21:12:45.045 INFO:tasks.workunit.client.1.smithi103.stdout:0/214: truncate d1/d5/de/d24/f38 2016847 0 2024-09-18T21:12:45.045 INFO:tasks.workunit.client.0.smithi077.stdout:8/208: link f1 d2/d5/d6/d22/d20/d3e/f47 0 2024-09-18T21:12:45.047 INFO:tasks.workunit.client.1.smithi103.stdout:8/227: mkdir d4/d2d/d44/d4c 0 2024-09-18T21:12:45.047 INFO:tasks.workunit.client.0.smithi077.stdout:2/272: dread d1/d4/d5/d1a/d2e/f37 [0,4194304] 0 2024-09-18T21:12:45.048 INFO:tasks.workunit.client.0.smithi077.stdout:0/314: mknod d8/d37/c61 0 2024-09-18T21:12:45.048 INFO:tasks.workunit.client.1.smithi103.stdout:6/240: dread d2/f22 [0,4194304] 0 2024-09-18T21:12:45.049 INFO:tasks.workunit.client.1.smithi103.stdout:0/215: dread d1/f29 [0,4194304] 0 2024-09-18T21:12:45.049 INFO:tasks.workunit.client.1.smithi103.stdout:6/241: truncate d2/d24/f27 5138243 0 2024-09-18T21:12:45.050 INFO:tasks.workunit.client.0.smithi077.stdout:2/273: truncate d1/f19 1050670 0 2024-09-18T21:12:45.050 INFO:tasks.workunit.client.1.smithi103.stdout:6/242: dread - d2/f4a zero size 2024-09-18T21:12:45.051 INFO:tasks.workunit.client.0.smithi077.stdout:2/274: chown d1/d4/d5 10325184 1 2024-09-18T21:12:45.052 INFO:tasks.workunit.client.1.smithi103.stdout:9/203: unlink d18/l35 0 2024-09-18T21:12:45.052 INFO:tasks.workunit.client.0.smithi077.stdout:5/317: dwrite d0/d6/f48 [0,4194304] 0 2024-09-18T21:12:45.052 INFO:tasks.workunit.client.0.smithi077.stdout:9/154: dread d1/df/f12 [0,4194304] 0 2024-09-18T21:12:45.053 INFO:tasks.workunit.client.0.smithi077.stdout:9/155: read d1/f16 [538835,110946] 0 2024-09-18T21:12:45.056 INFO:tasks.workunit.client.1.smithi103.stdout:5/211: dwrite de/d3e/f43 [0,4194304] 0 2024-09-18T21:12:45.057 INFO:tasks.workunit.client.0.smithi077.stdout:0/315: rename d8/d26/c45 to d8/d1a/d39/d3b/d4e/d58/c62 0 2024-09-18T21:12:45.061 INFO:tasks.workunit.client.1.smithi103.stdout:9/204: dwrite fa [0,4194304] 0 2024-09-18T21:12:45.062 INFO:tasks.workunit.client.1.smithi103.stdout:1/229: rename d0/d2/d9/c26 to d0/d2/d9/dc/c53 0 2024-09-18T21:12:45.062 INFO:tasks.workunit.client.1.smithi103.stdout:3/196: creat d1/d2/d18/d30/f38 x:0 0 0 2024-09-18T21:12:45.064 INFO:tasks.workunit.client.1.smithi103.stdout:0/216: symlink d1/d5/de/d22/l4b 0 2024-09-18T21:12:45.066 INFO:tasks.workunit.client.0.smithi077.stdout:5/318: dwrite d0/d6/fb [0,4194304] 0 2024-09-18T21:12:45.066 INFO:tasks.workunit.client.0.smithi077.stdout:8/209: link d2/d5/d6/c3a d2/d36/c48 0 2024-09-18T21:12:45.067 INFO:tasks.workunit.client.0.smithi077.stdout:5/319: readlink d0/d6/d3b/l4c 0 2024-09-18T21:12:45.068 INFO:tasks.workunit.client.0.smithi077.stdout:8/210: stat d2/d5/d6/d22/d20/d3e 0 2024-09-18T21:12:45.069 INFO:tasks.workunit.client.0.smithi077.stdout:0/316: creat d8/d37/f63 x:0 0 0 2024-09-18T21:12:45.069 INFO:tasks.workunit.client.0.smithi077.stdout:0/317: stat l2 0 2024-09-18T21:12:45.070 INFO:tasks.workunit.client.1.smithi103.stdout:5/212: dwrite de/d3e/f29 [0,4194304] 0 2024-09-18T21:12:45.071 INFO:tasks.workunit.client.0.smithi077.stdout:5/320: dread d0/d6/f3c [0,4194304] 0 2024-09-18T21:12:45.071 INFO:tasks.workunit.client.1.smithi103.stdout:5/213: fsync de/d1f/f23 0 2024-09-18T21:12:45.072 INFO:tasks.workunit.client.0.smithi077.stdout:5/321: readlink d0/df/d10/d5c/d74/l5a 0 2024-09-18T21:12:45.075 INFO:tasks.workunit.client.1.smithi103.stdout:5/214: read de/d14/f22 [2244693,22713] 0 2024-09-18T21:12:45.076 INFO:tasks.workunit.client.1.smithi103.stdout:9/205: readlink d18/d1f/l3a 0 2024-09-18T21:12:45.076 INFO:tasks.workunit.client.1.smithi103.stdout:5/215: readlink de/d1f/l34 0 2024-09-18T21:12:45.079 INFO:tasks.workunit.client.1.smithi103.stdout:8/228: rename d4/d2c/f37 to d4/d26/f4d 0 2024-09-18T21:12:45.080 INFO:tasks.workunit.client.0.smithi077.stdout:0/318: mkdir d8/d1a/d39/d64 0 2024-09-18T21:12:45.083 INFO:tasks.workunit.client.1.smithi103.stdout:9/206: dwrite d18/f1a [4194304,4194304] 0 2024-09-18T21:12:45.088 INFO:tasks.workunit.client.0.smithi077.stdout:1/198: sync 2024-09-18T21:12:45.090 INFO:tasks.workunit.client.1.smithi103.stdout:6/243: link d2/d3/d8/f29 d2/d3/d4/f4f 0 2024-09-18T21:12:45.092 INFO:tasks.workunit.client.0.smithi077.stdout:5/322: creat d0/d6/d40/f77 x:0 0 0 2024-09-18T21:12:45.093 INFO:tasks.workunit.client.1.smithi103.stdout:0/217: mkdir d1/d5/d4c 0 2024-09-18T21:12:45.094 INFO:tasks.workunit.client.1.smithi103.stdout:3/197: symlink d1/d2/d18/d30/l39 0 2024-09-18T21:12:45.095 INFO:tasks.workunit.client.1.smithi103.stdout:3/198: chown d1/d2/d18/d30 91 1 2024-09-18T21:12:45.095 INFO:tasks.workunit.client.0.smithi077.stdout:2/275: link d1/d4/d5/d1a/d2e/d41/d2c/c38 d1/d4/d5/d1a/d49/c58 0 2024-09-18T21:12:45.096 INFO:tasks.workunit.client.1.smithi103.stdout:3/199: dread - d1/d34/f36 zero size 2024-09-18T21:12:45.097 INFO:tasks.workunit.client.1.smithi103.stdout:1/230: symlink d0/d2/d9/dc/d36/l54 0 2024-09-18T21:12:45.097 INFO:tasks.workunit.client.0.smithi077.stdout:0/319: creat d8/d1d/d57/f65 x:0 0 0 2024-09-18T21:12:45.101 INFO:tasks.workunit.client.0.smithi077.stdout:0/320: mkdir d8/d37/d66 0 2024-09-18T21:12:45.101 INFO:tasks.workunit.client.0.smithi077.stdout:0/321: fsync d8/d26/f1b 0 2024-09-18T21:12:45.101 INFO:tasks.workunit.client.0.smithi077.stdout:1/199: mkdir d3/d8/d49 0 2024-09-18T21:12:45.102 INFO:tasks.workunit.client.1.smithi103.stdout:4/208: dwrite d9/d1f/f20 [0,4194304] 0 2024-09-18T21:12:45.103 INFO:tasks.workunit.client.1.smithi103.stdout:4/209: chown f5 943132546 1 2024-09-18T21:12:45.103 INFO:tasks.workunit.client.0.smithi077.stdout:1/200: truncate d3/d1e/f35 1031894 0 2024-09-18T21:12:45.104 INFO:tasks.workunit.client.1.smithi103.stdout:8/229: mkdir d4/d2d/d4e 0 2024-09-18T21:12:45.104 INFO:tasks.workunit.client.1.smithi103.stdout:4/210: chown d9/d1f/d31/l3a 37048042 1 2024-09-18T21:12:45.107 INFO:tasks.workunit.client.0.smithi077.stdout:5/323: creat d0/f78 x:0 0 0 2024-09-18T21:12:45.109 INFO:tasks.workunit.client.0.smithi077.stdout:5/324: write d0/df/d10/f7 [4458079,43005] 0 2024-09-18T21:12:45.111 INFO:tasks.workunit.client.0.smithi077.stdout:1/201: rename d3/d1e/f33 to d3/d1e/d32/f4a 0 2024-09-18T21:12:45.111 INFO:tasks.workunit.client.0.smithi077.stdout:0/322: dwrite d8/d1a/d39/d3b/d4e/d58/f5e [0,4194304] 0 2024-09-18T21:12:45.116 INFO:tasks.workunit.client.0.smithi077.stdout:1/202: dread d3/ff [0,4194304] 0 2024-09-18T21:12:45.117 INFO:tasks.workunit.client.0.smithi077.stdout:1/203: truncate d3/d1e/f31 482773 0 2024-09-18T21:12:45.119 INFO:tasks.workunit.client.0.smithi077.stdout:5/325: creat d0/d6/d3b/d64/f79 x:0 0 0 2024-09-18T21:12:45.119 INFO:tasks.workunit.client.0.smithi077.stdout:5/326: dread - d0/d6/d3b/d64/f6c zero size 2024-09-18T21:12:45.120 INFO:tasks.workunit.client.0.smithi077.stdout:9/156: write d1/dd/f1f [737314,4357] 0 2024-09-18T21:12:45.121 INFO:tasks.workunit.client.0.smithi077.stdout:5/327: read d0/df/d10/d47/f58 [3482938,108993] 0 2024-09-18T21:12:45.123 INFO:tasks.workunit.client.1.smithi103.stdout:5/216: mknod de/d14/c48 0 2024-09-18T21:12:45.125 INFO:tasks.workunit.client.1.smithi103.stdout:8/230: creat d4/d2c/d39/f4f x:0 0 0 2024-09-18T21:12:45.128 INFO:tasks.workunit.client.0.smithi077.stdout:5/328: dwrite d0/d6/dd/f30 [4194304,4194304] 0 2024-09-18T21:12:45.128 INFO:tasks.workunit.client.1.smithi103.stdout:9/207: mkdir d18/d40 0 2024-09-18T21:12:45.131 INFO:tasks.workunit.client.1.smithi103.stdout:0/218: symlink d1/d5/de/l4d 0 2024-09-18T21:12:45.135 INFO:tasks.workunit.client.0.smithi077.stdout:0/323: symlink d8/d1a/d39/d64/l67 0 2024-09-18T21:12:45.136 INFO:tasks.workunit.client.1.smithi103.stdout:1/231: symlink d0/d2/l55 0 2024-09-18T21:12:45.137 INFO:tasks.workunit.client.0.smithi077.stdout:1/204: symlink d3/d1e/d32/d3e/l4b 0 2024-09-18T21:12:45.137 INFO:tasks.workunit.client.1.smithi103.stdout:2/188: sync 2024-09-18T21:12:45.138 INFO:tasks.workunit.client.0.smithi077.stdout:1/205: write d3/d8/f17 [3771006,94658] 0 2024-09-18T21:12:45.138 INFO:tasks.workunit.client.1.smithi103.stdout:5/217: unlink ld 0 2024-09-18T21:12:45.140 INFO:tasks.workunit.client.0.smithi077.stdout:5/329: creat d0/d6/dd/d5d/f7a x:0 0 0 2024-09-18T21:12:45.140 INFO:tasks.workunit.client.0.smithi077.stdout:5/330: readlink d0/d43/l5b 0 2024-09-18T21:12:45.141 INFO:tasks.workunit.client.1.smithi103.stdout:8/231: rmdir d4/de 39 2024-09-18T21:12:45.142 INFO:tasks.workunit.client.1.smithi103.stdout:5/218: dread de/d3e/f12 [0,4194304] 0 2024-09-18T21:12:45.144 INFO:tasks.workunit.client.1.smithi103.stdout:4/211: mknod d9/d38/c47 0 2024-09-18T21:12:45.144 INFO:tasks.workunit.client.1.smithi103.stdout:4/212: readlink d9/l17 0 2024-09-18T21:12:45.145 INFO:tasks.workunit.client.0.smithi077.stdout:9/157: rename d1/df/l13 to d1/dd/d11/d26/l2f 0 2024-09-18T21:12:45.147 INFO:tasks.workunit.client.0.smithi077.stdout:0/324: unlink d8/d26/cf 0 2024-09-18T21:12:45.150 INFO:tasks.workunit.client.1.smithi103.stdout:0/219: unlink d1/d5/de/d19/d1e/d34/c40 0 2024-09-18T21:12:45.151 INFO:tasks.workunit.client.0.smithi077.stdout:1/206: mkdir d3/d1e/d4c 0 2024-09-18T21:12:45.153 INFO:tasks.workunit.client.1.smithi103.stdout:3/200: write d1/f24 [12913,62206] 0 2024-09-18T21:12:45.155 INFO:tasks.workunit.client.1.smithi103.stdout:2/189: rename d3/f8 to d3/d5/d25/d40/f49 0 2024-09-18T21:12:45.155 INFO:tasks.workunit.client.0.smithi077.stdout:9/158: creat d1/dd/f30 x:0 0 0 2024-09-18T21:12:45.156 INFO:tasks.workunit.client.1.smithi103.stdout:1/232: dread d0/d2/d9/f2f [4194304,4194304] 0 2024-09-18T21:12:45.157 INFO:tasks.workunit.client.0.smithi077.stdout:0/325: creat d8/d1d/f68 x:0 0 0 2024-09-18T21:12:45.157 INFO:tasks.workunit.client.0.smithi077.stdout:0/326: dread - d8/d26/f54 zero size 2024-09-18T21:12:45.158 INFO:tasks.workunit.client.1.smithi103.stdout:5/219: readlink de/d14/l42 0 2024-09-18T21:12:45.158 INFO:tasks.workunit.client.1.smithi103.stdout:5/220: chown de/d14/l42 4322 1 2024-09-18T21:12:45.161 INFO:tasks.workunit.client.1.smithi103.stdout:9/208: creat d18/d1f/d2f/f41 x:0 0 0 2024-09-18T21:12:45.163 INFO:tasks.workunit.client.1.smithi103.stdout:6/244: getdents d2/d3 0 2024-09-18T21:12:45.163 INFO:tasks.workunit.client.0.smithi077.stdout:0/327: rmdir d8/d1a/d39/d3b/d4e 39 2024-09-18T21:12:45.165 INFO:tasks.workunit.client.0.smithi077.stdout:5/331: write d0/d6/f3c [1567436,113141] 0 2024-09-18T21:12:45.167 INFO:tasks.workunit.client.0.smithi077.stdout:9/159: unlink d1/dd/d11/d26/l2f 0 2024-09-18T21:12:45.168 INFO:tasks.workunit.client.0.smithi077.stdout:0/328: dread d8/d1a/f42 [0,4194304] 0 2024-09-18T21:12:45.168 INFO:tasks.workunit.client.1.smithi103.stdout:3/201: mknod d1/d2/d18/d30/c3a 0 2024-09-18T21:12:45.168 INFO:tasks.workunit.client.1.smithi103.stdout:3/202: fdatasync d1/f2e 0 2024-09-18T21:12:45.170 INFO:tasks.workunit.client.0.smithi077.stdout:5/332: rename d0/d6/dd/c46 to d0/d6/dd/d5d/c7b 0 2024-09-18T21:12:45.170 INFO:tasks.workunit.client.1.smithi103.stdout:4/213: write f3 [4062514,20780] 0 2024-09-18T21:12:45.171 INFO:tasks.workunit.client.0.smithi077.stdout:5/333: readlink d0/df/l2c 0 2024-09-18T21:12:45.173 INFO:tasks.workunit.client.1.smithi103.stdout:1/233: mknod d0/d2/d9/c56 0 2024-09-18T21:12:45.173 INFO:tasks.workunit.client.1.smithi103.stdout:7/221: sync 2024-09-18T21:12:45.174 INFO:tasks.workunit.client.0.smithi077.stdout:1/207: dwrite d3/ff [4194304,4194304] 0 2024-09-18T21:12:45.174 INFO:tasks.workunit.client.1.smithi103.stdout:1/234: fsync d0/d2/d2b/f41 0 2024-09-18T21:12:45.174 INFO:tasks.workunit.client.1.smithi103.stdout:7/222: write d1/f1b [3619023,119956] 0 2024-09-18T21:12:45.177 INFO:tasks.workunit.client.1.smithi103.stdout:0/220: mkdir d1/d5/d4c/d4e 0 2024-09-18T21:12:45.179 INFO:tasks.workunit.client.1.smithi103.stdout:6/245: truncate d2/d3/d8/df/f11 4586460 0 2024-09-18T21:12:45.180 INFO:tasks.workunit.client.0.smithi077.stdout:0/329: write d8/d1a/f20 [2882220,56926] 0 2024-09-18T21:12:45.182 INFO:tasks.workunit.client.0.smithi077.stdout:9/160: getdents d1/dd/d11 0 2024-09-18T21:12:45.183 INFO:tasks.workunit.client.1.smithi103.stdout:2/190: mkdir d3/d5/d4a 0 2024-09-18T21:12:45.184 INFO:tasks.workunit.client.1.smithi103.stdout:8/232: dwrite d4/d26/f1a [4194304,4194304] 0 2024-09-18T21:12:45.185 INFO:tasks.workunit.client.1.smithi103.stdout:4/214: mkdir d9/d1a/d2b/d48 0 2024-09-18T21:12:45.186 INFO:tasks.workunit.client.0.smithi077.stdout:9/161: creat d1/dd/d11/d1c/f31 x:0 0 0 2024-09-18T21:12:45.187 INFO:tasks.workunit.client.1.smithi103.stdout:5/221: symlink de/d3e/l49 0 2024-09-18T21:12:45.187 INFO:tasks.workunit.client.0.smithi077.stdout:5/334: getdents d0/d6/dd/d5d 0 2024-09-18T21:12:45.188 INFO:tasks.workunit.client.0.smithi077.stdout:0/330: chown d8/d1a/d39/d3b/d4e/d58/c62 64989 1 2024-09-18T21:12:45.189 INFO:tasks.workunit.client.1.smithi103.stdout:5/222: truncate de/d14/d33/f46 483880 0 2024-09-18T21:12:45.190 INFO:tasks.workunit.client.1.smithi103.stdout:5/223: fdatasync de/d2d/d44/f47 0 2024-09-18T21:12:45.192 INFO:tasks.workunit.client.0.smithi077.stdout:5/335: mknod d0/df/d10/d5c/d74/c7c 0 2024-09-18T21:12:45.195 INFO:tasks.workunit.client.0.smithi077.stdout:0/331: creat d8/d1a/d39/d56/f69 x:0 0 0 2024-09-18T21:12:45.198 INFO:tasks.workunit.client.0.smithi077.stdout:9/162: rmdir d1/dd/d11/d26 0 2024-09-18T21:12:45.200 INFO:tasks.workunit.client.0.smithi077.stdout:5/336: truncate d0/f37 2908134 0 2024-09-18T21:12:45.200 INFO:tasks.workunit.client.1.smithi103.stdout:1/235: mknod d0/d2/d2b/c57 0 2024-09-18T21:12:45.200 INFO:tasks.workunit.client.1.smithi103.stdout:7/223: unlink d1/df/f14 0 2024-09-18T21:12:45.201 INFO:tasks.workunit.client.1.smithi103.stdout:0/221: mkdir d1/d9/d13/d4f 0 2024-09-18T21:12:45.201 INFO:tasks.workunit.client.1.smithi103.stdout:6/246: truncate d2/d3/d8/df/f17 3780937 0 2024-09-18T21:12:45.201 INFO:tasks.workunit.client.1.smithi103.stdout:4/215: dwrite d9/d1c/f42 [0,4194304] 0 2024-09-18T21:12:45.202 INFO:tasks.workunit.client.1.smithi103.stdout:8/233: symlink d4/d2c/l50 0 2024-09-18T21:12:45.202 INFO:tasks.workunit.client.0.smithi077.stdout:9/163: rename d1/dd/f30 to d1/dd/d11/d2d/f32 0 2024-09-18T21:12:45.202 INFO:tasks.workunit.client.1.smithi103.stdout:0/222: dread - d1/f3f zero size 2024-09-18T21:12:45.203 INFO:tasks.workunit.client.0.smithi077.stdout:9/164: write d1/dd/f14 [835662,2473] 0 2024-09-18T21:12:45.204 INFO:tasks.workunit.client.1.smithi103.stdout:0/223: dread - d1/d9/f2b zero size 2024-09-18T21:12:45.204 INFO:tasks.workunit.client.1.smithi103.stdout:5/224: creat de/d1f/d3b/f4a x:0 0 0 2024-09-18T21:12:45.204 INFO:tasks.workunit.client.1.smithi103.stdout:9/209: rmdir d18/d40 0 2024-09-18T21:12:45.207 INFO:tasks.workunit.client.0.smithi077.stdout:5/337: rename d0/df/d10/d4b/l56 to d0/df/d10/d47/l7d 0 2024-09-18T21:12:45.213 INFO:tasks.workunit.client.0.smithi077.stdout:9/165: rename d1/c20 to d1/dd/d11/d15/c33 0 2024-09-18T21:12:45.218 INFO:tasks.workunit.client.0.smithi077.stdout:9/166: link d1/dd/d1a/l2c d1/dd/d11/d2d/l34 0 2024-09-18T21:12:45.221 INFO:tasks.workunit.client.0.smithi077.stdout:9/167: rename d1/dd/le to d1/df/d27/l35 0 2024-09-18T21:12:45.222 INFO:tasks.workunit.client.0.smithi077.stdout:9/168: mknod d1/df/d27/c36 0 2024-09-18T21:12:45.225 INFO:tasks.workunit.client.0.smithi077.stdout:9/169: symlink d1/dd/d11/d15/l37 0 2024-09-18T21:12:45.233 INFO:tasks.workunit.client.0.smithi077.stdout:5/338: dread d0/df/d3d/f73 [0,4194304] 0 2024-09-18T21:12:45.233 INFO:tasks.workunit.client.0.smithi077.stdout:5/339: write d0/d36/f70 [760865,36858] 0 2024-09-18T21:12:45.242 INFO:tasks.workunit.client.0.smithi077.stdout:5/340: dwrite d0/f37 [0,4194304] 0 2024-09-18T21:12:45.249 INFO:tasks.workunit.client.0.smithi077.stdout:5/341: dwrite d0/d6/dd/f30 [4194304,4194304] 0 2024-09-18T21:12:45.251 INFO:tasks.workunit.client.0.smithi077.stdout:5/342: creat d0/d6/d3b/f7e x:0 0 0 2024-09-18T21:12:45.252 INFO:tasks.workunit.client.0.smithi077.stdout:5/343: chown d0/df/d10/d4b/f65 813806 1 2024-09-18T21:12:45.254 INFO:tasks.workunit.client.0.smithi077.stdout:5/344: mknod d0/df/d10/c7f 0 2024-09-18T21:12:45.255 INFO:tasks.workunit.client.0.smithi077.stdout:5/345: write d0/d36/f75 [447731,115215] 0 2024-09-18T21:12:45.260 INFO:tasks.workunit.client.0.smithi077.stdout:5/346: dread d0/df/d10/d47/f58 [0,4194304] 0 2024-09-18T21:12:45.261 INFO:tasks.workunit.client.1.smithi103.stdout:8/234: write d4/d26/fb [1524203,42637] 0 2024-09-18T21:12:45.261 INFO:tasks.workunit.client.1.smithi103.stdout:7/224: mkdir d1/df/d43 0 2024-09-18T21:12:45.263 INFO:tasks.workunit.client.1.smithi103.stdout:4/216: creat d9/d2e/f49 x:0 0 0 2024-09-18T21:12:45.263 INFO:tasks.workunit.client.0.smithi077.stdout:5/347: mkdir d0/df/d10/d4b/d80 0 2024-09-18T21:12:45.263 INFO:tasks.workunit.client.0.smithi077.stdout:5/348: stat d0/df/d10/d5c 0 2024-09-18T21:12:45.264 INFO:tasks.workunit.client.0.smithi077.stdout:3/201: sync 2024-09-18T21:12:45.264 INFO:tasks.workunit.client.0.smithi077.stdout:6/282: sync 2024-09-18T21:12:45.264 INFO:tasks.workunit.client.0.smithi077.stdout:7/340: sync 2024-09-18T21:12:45.264 INFO:tasks.workunit.client.0.smithi077.stdout:4/187: sync 2024-09-18T21:12:45.265 INFO:tasks.workunit.client.1.smithi103.stdout:4/217: read d9/d1f/f20 [4002002,4930] 0 2024-09-18T21:12:45.266 INFO:tasks.workunit.client.0.smithi077.stdout:6/283: chown d7/c33 2990261 1 2024-09-18T21:12:45.266 INFO:tasks.workunit.client.0.smithi077.stdout:7/341: dread - d12/d22/f63 zero size 2024-09-18T21:12:45.267 INFO:tasks.workunit.client.1.smithi103.stdout:9/210: mknod d18/d29/c42 0 2024-09-18T21:12:45.270 INFO:tasks.workunit.client.0.smithi077.stdout:3/202: read f3 [4585188,125905] 0 2024-09-18T21:12:45.270 INFO:tasks.workunit.client.0.smithi077.stdout:5/349: truncate d0/d6/dd/f3a 1207546 0 2024-09-18T21:12:45.271 INFO:tasks.workunit.client.1.smithi103.stdout:4/218: mknod d9/d1c/c4a 0 2024-09-18T21:12:45.272 INFO:tasks.workunit.client.0.smithi077.stdout:5/350: fdatasync d0/df/d10/d4b/f60 0 2024-09-18T21:12:45.272 INFO:tasks.workunit.client.0.smithi077.stdout:6/284: rmdir d7/df/d11/d3e 39 2024-09-18T21:12:45.273 INFO:tasks.workunit.client.1.smithi103.stdout:0/224: dwrite d1/d5/de/d19/f4a [0,4194304] 0 2024-09-18T21:12:45.274 INFO:tasks.workunit.client.0.smithi077.stdout:7/342: dwrite d12/d31/d33/f36 [0,4194304] 0 2024-09-18T21:12:45.274 INFO:tasks.workunit.client.1.smithi103.stdout:5/225: dwrite de/d14/f32 [0,4194304] 0 2024-09-18T21:12:45.276 INFO:tasks.workunit.client.0.smithi077.stdout:7/343: truncate d12/d22/d59/d72/d68/f76 1029658 0 2024-09-18T21:12:45.277 INFO:tasks.workunit.client.1.smithi103.stdout:7/225: write d1/df/d42/f2b [417387,112800] 0 2024-09-18T21:12:45.283 INFO:tasks.workunit.client.0.smithi077.stdout:6/285: unlink d7/df/d11/d1d/c4b 0 2024-09-18T21:12:45.284 INFO:tasks.workunit.client.0.smithi077.stdout:7/344: readlink d12/d22/d59/l5b 0 2024-09-18T21:12:45.286 INFO:tasks.workunit.client.0.smithi077.stdout:4/188: link d3/d17/l34 d3/d17/l38 0 2024-09-18T21:12:45.286 INFO:tasks.workunit.client.1.smithi103.stdout:8/235: dwrite d4/de/f1e [4194304,4194304] 0 2024-09-18T21:12:45.286 INFO:tasks.workunit.client.1.smithi103.stdout:1/236: getdents d0/d2/d9 0 2024-09-18T21:12:45.287 INFO:tasks.workunit.client.1.smithi103.stdout:4/219: mkdir d9/d1f/d4b 0 2024-09-18T21:12:45.289 INFO:tasks.workunit.client.1.smithi103.stdout:6/247: dread d2/d3/d8/f10 [0,4194304] 0 2024-09-18T21:12:45.290 INFO:tasks.workunit.client.0.smithi077.stdout:6/286: rmdir d7/df/d11/d1d/d49 39 2024-09-18T21:12:45.291 INFO:tasks.workunit.client.0.smithi077.stdout:7/345: chown d12/d22/c74 0 1 2024-09-18T21:12:45.293 INFO:tasks.workunit.client.0.smithi077.stdout:4/189: creat d3/d17/f39 x:0 0 0 2024-09-18T21:12:45.294 INFO:tasks.workunit.client.1.smithi103.stdout:8/236: symlink d4/d2c/l51 0 2024-09-18T21:12:45.295 INFO:tasks.workunit.client.1.smithi103.stdout:9/211: dwrite d18/d1f/f28 [0,4194304] 0 2024-09-18T21:12:45.297 INFO:tasks.workunit.client.0.smithi077.stdout:3/203: getdents db/d14/d32 0 2024-09-18T21:12:45.297 INFO:tasks.workunit.client.1.smithi103.stdout:1/237: symlink d0/d11/d16/l58 0 2024-09-18T21:12:45.297 INFO:tasks.workunit.client.0.smithi077.stdout:5/351: getdents d0/df/d10/d5c 0 2024-09-18T21:12:45.299 INFO:tasks.workunit.client.0.smithi077.stdout:5/352: write d0/df/f25 [859981,43878] 0 2024-09-18T21:12:45.302 INFO:tasks.workunit.client.1.smithi103.stdout:5/226: dwrite fb [0,4194304] 0 2024-09-18T21:12:45.302 INFO:tasks.workunit.client.1.smithi103.stdout:4/220: rename d9/d1a/f3e to d9/d38/f4c 0 2024-09-18T21:12:45.302 INFO:tasks.workunit.client.0.smithi077.stdout:3/204: truncate db/d14/d22/f2f 3985735 0 2024-09-18T21:12:45.303 INFO:tasks.workunit.client.1.smithi103.stdout:7/226: dwrite d1/df/d42/f2b [0,4194304] 0 2024-09-18T21:12:45.303 INFO:tasks.workunit.client.1.smithi103.stdout:6/248: rmdir d2/d3/d8 39 2024-09-18T21:12:45.303 INFO:tasks.workunit.client.0.smithi077.stdout:3/205: chown db/d14/d32/d3a 3878 1 2024-09-18T21:12:45.304 INFO:tasks.workunit.client.0.smithi077.stdout:5/353: creat d0/df/d10/d5c/d74/f81 x:0 0 0 2024-09-18T21:12:45.305 INFO:tasks.workunit.client.1.smithi103.stdout:5/227: chown de/d1f/f23 66721 1 2024-09-18T21:12:45.305 INFO:tasks.workunit.client.1.smithi103.stdout:9/212: fsync f13 0 2024-09-18T21:12:45.306 INFO:tasks.workunit.client.1.smithi103.stdout:1/238: dread d0/d2/d9/dc/f22 [0,4194304] 0 2024-09-18T21:12:45.306 INFO:tasks.workunit.client.0.smithi077.stdout:5/354: chown d0/d6/d3b/l4c 8623366 1 2024-09-18T21:12:45.307 INFO:tasks.workunit.client.1.smithi103.stdout:7/227: mkdir d1/df/d44 0 2024-09-18T21:12:45.307 INFO:tasks.workunit.client.1.smithi103.stdout:5/228: chown de/d1f/d3b/d3c 96612891 1 2024-09-18T21:12:45.309 INFO:tasks.workunit.client.1.smithi103.stdout:9/213: write f17 [4073912,123721] 0 2024-09-18T21:12:45.310 INFO:tasks.workunit.client.1.smithi103.stdout:5/229: fsync de/d3e/f17 0 2024-09-18T21:12:45.310 INFO:tasks.workunit.client.0.smithi077.stdout:5/355: dread d0/df/f52 [0,4194304] 0 2024-09-18T21:12:45.311 INFO:tasks.workunit.client.0.smithi077.stdout:5/356: dread - d0/d6/d40/f77 zero size 2024-09-18T21:12:45.312 INFO:tasks.workunit.client.0.smithi077.stdout:3/206: getdents db/d14/d22 0 2024-09-18T21:12:45.313 INFO:tasks.workunit.client.0.smithi077.stdout:5/357: fdatasync d0/df/d10/f44 0 2024-09-18T21:12:45.315 INFO:tasks.workunit.client.1.smithi103.stdout:8/237: dwrite d4/d26/f4d [0,4194304] 0 2024-09-18T21:12:45.317 INFO:tasks.workunit.client.0.smithi077.stdout:3/207: mknod db/d14/d22/d36/c41 0 2024-09-18T21:12:45.317 INFO:tasks.workunit.client.0.smithi077.stdout:7/346: dread d12/d31/f41 [0,4194304] 0 2024-09-18T21:12:45.318 INFO:tasks.workunit.client.0.smithi077.stdout:3/208: chown db/d14/f40 28138304 1 2024-09-18T21:12:45.318 INFO:tasks.workunit.client.1.smithi103.stdout:8/238: write d4/de/f1e [1163974,102931] 0 2024-09-18T21:12:45.318 INFO:tasks.workunit.client.0.smithi077.stdout:5/358: mknod d0/d6/d40/c82 0 2024-09-18T21:12:45.319 INFO:tasks.workunit.client.0.smithi077.stdout:7/347: chown d12/d22/d59/d72/d68 11 1 2024-09-18T21:12:45.319 INFO:tasks.workunit.client.0.smithi077.stdout:3/209: fsync db/f2e 0 2024-09-18T21:12:45.320 INFO:tasks.workunit.client.0.smithi077.stdout:5/359: chown d0/d6/f50 111 1 2024-09-18T21:12:45.320 INFO:tasks.workunit.client.0.smithi077.stdout:4/190: dread d3/dc/f16 [0,4194304] 0 2024-09-18T21:12:45.320 INFO:tasks.workunit.client.1.smithi103.stdout:9/214: creat d18/d29/f43 x:0 0 0 2024-09-18T21:12:45.322 INFO:tasks.workunit.client.0.smithi077.stdout:4/191: chown d3/c30 4233 1 2024-09-18T21:12:45.322 INFO:tasks.workunit.client.0.smithi077.stdout:5/360: truncate d0/d6/f50 1228898 0 2024-09-18T21:12:45.323 INFO:tasks.workunit.client.0.smithi077.stdout:7/348: unlink d12/d31/d33/f36 0 2024-09-18T21:12:45.327 INFO:tasks.workunit.client.1.smithi103.stdout:5/230: symlink de/l4b 0 2024-09-18T21:12:45.330 INFO:tasks.workunit.client.1.smithi103.stdout:8/239: mknod d4/c52 0 2024-09-18T21:12:45.333 INFO:tasks.workunit.client.0.smithi077.stdout:3/210: dwrite db/d14/f18 [0,4194304] 0 2024-09-18T21:12:45.334 INFO:tasks.workunit.client.1.smithi103.stdout:8/240: truncate d4/d2d/f33 495324 0 2024-09-18T21:12:45.335 INFO:tasks.workunit.client.1.smithi103.stdout:8/241: chown d4/d2d/d4e 57 1 2024-09-18T21:12:45.335 INFO:tasks.workunit.client.0.smithi077.stdout:3/211: chown db/ld 763 1 2024-09-18T21:12:45.335 INFO:tasks.workunit.client.1.smithi103.stdout:9/215: dwrite d18/f3e [0,4194304] 0 2024-09-18T21:12:45.337 INFO:tasks.workunit.client.0.smithi077.stdout:3/212: fdatasync db/d14/f40 0 2024-09-18T21:12:45.337 INFO:tasks.workunit.client.0.smithi077.stdout:5/361: dwrite d0/d6/d3b/d64/f79 [0,4194304] 0 2024-09-18T21:12:45.337 INFO:tasks.workunit.client.1.smithi103.stdout:3/203: sync 2024-09-18T21:12:45.342 INFO:tasks.workunit.client.1.smithi103.stdout:0/225: write d1/d5/de/d19/d1e/f21 [171502,119440] 0 2024-09-18T21:12:45.344 INFO:tasks.workunit.client.1.smithi103.stdout:9/216: creat d18/d29/f44 x:0 0 0 2024-09-18T21:12:45.345 INFO:tasks.workunit.client.1.smithi103.stdout:8/242: dwrite d4/de/f1e [4194304,4194304] 0 2024-09-18T21:12:45.346 INFO:tasks.workunit.client.0.smithi077.stdout:7/349: creat d12/d31/d33/f7c x:0 0 0 2024-09-18T21:12:45.347 INFO:tasks.workunit.client.1.smithi103.stdout:8/243: read - d4/de/f46 zero size 2024-09-18T21:12:45.348 INFO:tasks.workunit.client.0.smithi077.stdout:5/362: chown d0/d6/c3f 3636 1 2024-09-18T21:12:45.352 INFO:tasks.workunit.client.0.smithi077.stdout:7/350: symlink d12/d31/d77/l7d 0 2024-09-18T21:12:45.355 INFO:tasks.workunit.client.1.smithi103.stdout:1/239: dread d0/d2/d9/dc/f15 [0,4194304] 0 2024-09-18T21:12:45.356 INFO:tasks.workunit.client.0.smithi077.stdout:6/287: dwrite d7/f2c [0,4194304] 0 2024-09-18T21:12:45.357 INFO:tasks.workunit.client.1.smithi103.stdout:9/217: dwrite d18/d29/f2d [0,4194304] 0 2024-09-18T21:12:45.359 INFO:tasks.workunit.client.1.smithi103.stdout:9/218: fdatasync f13 0 2024-09-18T21:12:45.359 INFO:tasks.workunit.client.1.smithi103.stdout:4/221: dread d9/d1f/d31/f3d [0,4194304] 0 2024-09-18T21:12:45.359 INFO:tasks.workunit.client.1.smithi103.stdout:0/226: link d1/d5/c47 d1/d5/de/c50 0 2024-09-18T21:12:45.363 INFO:tasks.workunit.client.0.smithi077.stdout:4/192: dread d3/dc/f1b [0,4194304] 0 2024-09-18T21:12:45.363 INFO:tasks.workunit.client.0.smithi077.stdout:7/351: creat d12/d31/f7e x:0 0 0 2024-09-18T21:12:45.364 INFO:tasks.workunit.client.0.smithi077.stdout:4/193: chown d3/d7/c14 22 1 2024-09-18T21:12:45.367 INFO:tasks.workunit.client.0.smithi077.stdout:6/288: dread d7/df/d11/f45 [0,4194304] 0 2024-09-18T21:12:45.368 INFO:tasks.workunit.client.1.smithi103.stdout:6/249: dwrite d2/d3/f2f [0,4194304] 0 2024-09-18T21:12:45.372 INFO:tasks.workunit.client.0.smithi077.stdout:6/289: dread d7/df/d11/f16 [0,4194304] 0 2024-09-18T21:12:45.374 INFO:tasks.workunit.client.0.smithi077.stdout:5/363: getdents d0/d6/d40 0 2024-09-18T21:12:45.375 INFO:tasks.workunit.client.0.smithi077.stdout:3/213: dread f5 [0,4194304] 0 2024-09-18T21:12:45.376 INFO:tasks.workunit.client.1.smithi103.stdout:7/228: dwrite d1/f1c [0,4194304] 0 2024-09-18T21:12:45.380 INFO:tasks.workunit.client.0.smithi077.stdout:6/290: symlink d7/df/d11/d25/l5e 0 2024-09-18T21:12:45.382 INFO:tasks.workunit.client.1.smithi103.stdout:4/222: mknod d9/d1a/d2b/d48/c4d 0 2024-09-18T21:12:45.382 INFO:tasks.workunit.client.0.smithi077.stdout:5/364: rmdir d0/d6/dd/d5d 39 2024-09-18T21:12:45.383 INFO:tasks.workunit.client.1.smithi103.stdout:6/250: write d2/d3/d8/f20 [5109361,1918] 0 2024-09-18T21:12:45.384 INFO:tasks.workunit.client.1.smithi103.stdout:0/227: dread d1/f18 [0,4194304] 0 2024-09-18T21:12:45.384 INFO:tasks.workunit.client.0.smithi077.stdout:3/214: unlink db/d14/d32/f38 0 2024-09-18T21:12:45.385 INFO:tasks.workunit.client.1.smithi103.stdout:4/223: readlink d9/lf 0 2024-09-18T21:12:45.386 INFO:tasks.workunit.client.0.smithi077.stdout:4/194: truncate d3/dc/f1b 3730031 0 2024-09-18T21:12:45.386 INFO:tasks.workunit.client.0.smithi077.stdout:4/195: stat d3/d7/f1a 0 2024-09-18T21:12:45.387 INFO:tasks.workunit.client.0.smithi077.stdout:6/291: stat d7/df/d11/d3e/f51 0 2024-09-18T21:12:45.389 INFO:tasks.workunit.client.1.smithi103.stdout:6/251: write d2/d3/f2f [611726,84433] 0 2024-09-18T21:12:45.389 INFO:tasks.workunit.client.0.smithi077.stdout:5/365: rename d0/d43/l6b to d0/d43/d6d/l83 0 2024-09-18T21:12:45.389 INFO:tasks.workunit.client.1.smithi103.stdout:5/231: dwrite de/d1f/f24 [0,4194304] 0 2024-09-18T21:12:45.390 INFO:tasks.workunit.client.1.smithi103.stdout:5/232: stat de/d14 0 2024-09-18T21:12:45.390 INFO:tasks.workunit.client.1.smithi103.stdout:6/252: rename d2 to d2/d3/d8/d4c/d50 22 2024-09-18T21:12:45.391 INFO:tasks.workunit.client.1.smithi103.stdout:5/233: chown de/d1f/d3b/f4a 30382158 1 2024-09-18T21:12:45.392 INFO:tasks.workunit.client.0.smithi077.stdout:3/215: dwrite db/ff [0,4194304] 0 2024-09-18T21:12:45.392 INFO:tasks.workunit.client.1.smithi103.stdout:5/234: chown de/d14/f32 1953 1 2024-09-18T21:12:45.392 INFO:tasks.workunit.client.1.smithi103.stdout:5/235: readlink de/d3e/l49 0 2024-09-18T21:12:45.393 INFO:tasks.workunit.client.1.smithi103.stdout:4/224: mknod d9/d1a/d2b/c4e 0 2024-09-18T21:12:45.394 INFO:tasks.workunit.client.1.smithi103.stdout:7/229: write d1/df/d42/d1f/d2e/f37 [2319573,20887] 0 2024-09-18T21:12:45.394 INFO:tasks.workunit.client.0.smithi077.stdout:3/216: truncate db/d14/d32/d3a/f3e 919411 0 2024-09-18T21:12:45.396 INFO:tasks.workunit.client.0.smithi077.stdout:3/217: chown db/d14/d22/d36/d39 69 1 2024-09-18T21:12:45.399 INFO:tasks.workunit.client.0.smithi077.stdout:6/292: rename d7/df/d11/f16 to d7/df/d11/d1d/d50/f5f 0 2024-09-18T21:12:45.399 INFO:tasks.workunit.client.0.smithi077.stdout:6/293: fsync d7/fc 0 2024-09-18T21:12:45.401 INFO:tasks.workunit.client.1.smithi103.stdout:6/253: write d2/f22 [3337853,110648] 0 2024-09-18T21:12:45.403 INFO:tasks.workunit.client.1.smithi103.stdout:1/240: dread d0/d2/fb [0,4194304] 0 2024-09-18T21:12:45.404 INFO:tasks.workunit.client.0.smithi077.stdout:5/366: mkdir d0/df/d84 0 2024-09-18T21:12:45.405 INFO:tasks.workunit.client.1.smithi103.stdout:5/236: creat de/d2d/d44/f4c x:0 0 0 2024-09-18T21:12:45.406 INFO:tasks.workunit.client.0.smithi077.stdout:3/218: mkdir db/d14/d22/d36/d42 0 2024-09-18T21:12:45.409 INFO:tasks.workunit.client.0.smithi077.stdout:6/294: dwrite d7/df/d11/d1d/d31/f5a [0,4194304] 0 2024-09-18T21:12:45.410 INFO:tasks.workunit.client.0.smithi077.stdout:6/295: fdatasync d7/df/f14 0 2024-09-18T21:12:45.410 INFO:tasks.workunit.client.1.smithi103.stdout:0/228: link d1/d5/fc d1/d5/de/d22/d42/f51 0 2024-09-18T21:12:45.412 INFO:tasks.workunit.client.1.smithi103.stdout:9/219: truncate f17 549859 0 2024-09-18T21:12:45.413 INFO:tasks.workunit.client.1.smithi103.stdout:9/220: stat d18/d1f/d2f/f41 0 2024-09-18T21:12:45.413 INFO:tasks.workunit.client.1.smithi103.stdout:7/230: dwrite d1/df/d42/d1f/f2d [0,4194304] 0 2024-09-18T21:12:45.415 INFO:tasks.workunit.client.1.smithi103.stdout:7/231: chown d1/df/f22 78 1 2024-09-18T21:12:45.416 INFO:tasks.workunit.client.0.smithi077.stdout:5/367: mkdir d0/df/d3d/d85 0 2024-09-18T21:12:45.416 INFO:tasks.workunit.client.1.smithi103.stdout:1/241: creat d0/d2/d9/f59 x:0 0 0 2024-09-18T21:12:45.417 INFO:tasks.workunit.client.1.smithi103.stdout:1/242: stat d0/d2/d9/l45 0 2024-09-18T21:12:45.418 INFO:tasks.workunit.client.0.smithi077.stdout:8/211: sync 2024-09-18T21:12:45.420 INFO:tasks.workunit.client.1.smithi103.stdout:0/229: creat d1/d9/f52 x:0 0 0 2024-09-18T21:12:45.422 INFO:tasks.workunit.client.0.smithi077.stdout:3/219: write f3 [3941343,117446] 0 2024-09-18T21:12:45.422 INFO:tasks.workunit.client.1.smithi103.stdout:6/254: mknod d2/d3/d8/d4c/d4e/c51 0 2024-09-18T21:12:45.423 INFO:tasks.workunit.client.0.smithi077.stdout:3/220: chown c0 23748 1 2024-09-18T21:12:45.425 INFO:tasks.workunit.client.0.smithi077.stdout:4/196: getdents d3/d17 0 2024-09-18T21:12:45.426 INFO:tasks.workunit.client.0.smithi077.stdout:3/221: readlink db/d14/d32/d3a/d3b/l3d 0 2024-09-18T21:12:45.426 INFO:tasks.workunit.client.1.smithi103.stdout:5/237: dwrite de/f2b [0,4194304] 0 2024-09-18T21:12:45.426 INFO:tasks.workunit.client.1.smithi103.stdout:4/225: dread d9/f11 [0,4194304] 0 2024-09-18T21:12:45.429 INFO:tasks.workunit.client.0.smithi077.stdout:8/212: dwrite d2/d27/d29/f43 [4194304,4194304] 0 2024-09-18T21:12:45.429 INFO:tasks.workunit.client.1.smithi103.stdout:1/243: rename d0/d2/l5 to d0/d2/d2b/d3a/d42/l5a 0 2024-09-18T21:12:45.431 INFO:tasks.workunit.client.1.smithi103.stdout:1/244: chown d0/d11/d16/d19/f34 0 1 2024-09-18T21:12:45.434 INFO:tasks.workunit.client.0.smithi077.stdout:8/213: dread d2/d5/f16 [0,4194304] 0 2024-09-18T21:12:45.435 INFO:tasks.workunit.client.0.smithi077.stdout:8/214: chown d2/d5/c23 62932041 1 2024-09-18T21:12:45.435 INFO:tasks.workunit.client.1.smithi103.stdout:0/230: creat d1/d5/d4c/f53 x:0 0 0 2024-09-18T21:12:45.436 INFO:tasks.workunit.client.1.smithi103.stdout:1/245: chown d0/d2/d9/dc/d36 172292785 1 2024-09-18T21:12:45.437 INFO:tasks.workunit.client.0.smithi077.stdout:5/368: creat d0/df/d3d/d85/f86 x:0 0 0 2024-09-18T21:12:45.437 INFO:tasks.workunit.client.1.smithi103.stdout:6/255: readlink d2/d3/d4/l32 0 2024-09-18T21:12:45.438 INFO:tasks.workunit.client.1.smithi103.stdout:1/246: truncate d0/d11/d16/d19/f34 1835700 0 2024-09-18T21:12:45.439 INFO:tasks.workunit.client.1.smithi103.stdout:1/247: fsync d0/d2/d2b/d3a/f51 0 2024-09-18T21:12:45.440 INFO:tasks.workunit.client.0.smithi077.stdout:3/222: creat db/d14/d32/d3a/f43 x:0 0 0 2024-09-18T21:12:45.441 INFO:tasks.workunit.client.0.smithi077.stdout:4/197: dwrite d3/dc/d20/f27 [0,4194304] 0 2024-09-18T21:12:45.442 INFO:tasks.workunit.client.0.smithi077.stdout:8/215: rmdir d2/d5 39 2024-09-18T21:12:45.442 INFO:tasks.workunit.client.0.smithi077.stdout:4/198: chown d3/dc/d32 843200 1 2024-09-18T21:12:45.444 INFO:tasks.workunit.client.1.smithi103.stdout:5/238: mkdir de/d2d/d4d 0 2024-09-18T21:12:45.447 INFO:tasks.workunit.client.1.smithi103.stdout:1/248: dwrite d0/d2/d2b/f41 [0,4194304] 0 2024-09-18T21:12:45.448 INFO:tasks.workunit.client.1.smithi103.stdout:9/221: dread d18/f20 [4194304,4194304] 0 2024-09-18T21:12:45.448 INFO:tasks.workunit.client.1.smithi103.stdout:4/226: creat d9/d1a/d2b/d48/f4f x:0 0 0 2024-09-18T21:12:45.451 INFO:tasks.workunit.client.1.smithi103.stdout:0/231: creat d1/d9/f54 x:0 0 0 2024-09-18T21:12:45.453 INFO:tasks.workunit.client.1.smithi103.stdout:6/256: symlink d2/d3/d8/d4c/d4e/l52 0 2024-09-18T21:12:45.454 INFO:tasks.workunit.client.1.smithi103.stdout:7/232: creat d1/df/d42/f45 x:0 0 0 2024-09-18T21:12:45.455 INFO:tasks.workunit.client.1.smithi103.stdout:9/222: dwrite f13 [0,4194304] 0 2024-09-18T21:12:45.458 INFO:tasks.workunit.client.1.smithi103.stdout:1/249: unlink d0/c1d 0 2024-09-18T21:12:45.459 INFO:tasks.workunit.client.1.smithi103.stdout:4/227: unlink d9/d1a/d2b/d48/f4f 0 2024-09-18T21:12:45.462 INFO:tasks.workunit.client.1.smithi103.stdout:0/232: rename d1/d5/c11 to d1/d5/d4c/d4e/c55 0 2024-09-18T21:12:45.463 INFO:tasks.workunit.client.1.smithi103.stdout:6/257: symlink d2/d3/d8/d4c/d4e/l53 0 2024-09-18T21:12:45.466 INFO:tasks.workunit.client.1.smithi103.stdout:1/250: symlink d0/d3/l5b 0 2024-09-18T21:12:45.471 INFO:tasks.workunit.client.1.smithi103.stdout:7/233: mknod d1/df/d42/c46 0 2024-09-18T21:12:45.473 INFO:tasks.workunit.client.1.smithi103.stdout:1/251: write d0/d2/f4e [3361870,72592] 0 2024-09-18T21:12:45.473 INFO:tasks.workunit.client.1.smithi103.stdout:5/239: truncate de/d3e/f19 1840012 0 2024-09-18T21:12:45.474 INFO:tasks.workunit.client.1.smithi103.stdout:6/258: dread d2/d3/f19 [0,4194304] 0 2024-09-18T21:12:45.474 INFO:tasks.workunit.client.1.smithi103.stdout:0/233: mkdir d1/d56 0 2024-09-18T21:12:45.474 INFO:tasks.workunit.client.1.smithi103.stdout:2/191: sync 2024-09-18T21:12:45.477 INFO:tasks.workunit.client.1.smithi103.stdout:7/234: readlink d1/df/d42/d1f/d2e/l36 0 2024-09-18T21:12:45.477 INFO:tasks.workunit.client.1.smithi103.stdout:4/228: rmdir d9/d1f/d4b 0 2024-09-18T21:12:45.478 INFO:tasks.workunit.client.1.smithi103.stdout:9/223: getdents d18 0 2024-09-18T21:12:45.480 INFO:tasks.workunit.client.1.smithi103.stdout:2/192: readlink d3/l19 0 2024-09-18T21:12:45.481 INFO:tasks.workunit.client.1.smithi103.stdout:6/259: write d2/d3/d8/f2a [4470105,81812] 0 2024-09-18T21:12:45.482 INFO:tasks.workunit.client.1.smithi103.stdout:2/193: chown d3/l4 0 1 2024-09-18T21:12:45.482 INFO:tasks.workunit.client.1.smithi103.stdout:9/224: rmdir d18/d1f/d2f 39 2024-09-18T21:12:45.484 INFO:tasks.workunit.client.1.smithi103.stdout:5/240: dwrite de/d1f/f23 [4194304,4194304] 0 2024-09-18T21:12:45.485 INFO:tasks.workunit.client.1.smithi103.stdout:2/194: fdatasync d3/d5/fe 0 2024-09-18T21:12:45.485 INFO:tasks.workunit.client.1.smithi103.stdout:1/252: dread d0/d2/f4e [0,4194304] 0 2024-09-18T21:12:45.486 INFO:tasks.workunit.client.1.smithi103.stdout:0/234: link d1/d5/de/d24/f38 d1/d5/de/d22/f57 0 2024-09-18T21:12:45.488 INFO:tasks.workunit.client.1.smithi103.stdout:1/253: fsync d0/d11/d16/d19/f34 0 2024-09-18T21:12:45.490 INFO:tasks.workunit.client.1.smithi103.stdout:2/195: truncate d3/d5/f28 194255 0 2024-09-18T21:12:45.490 INFO:tasks.workunit.client.1.smithi103.stdout:5/241: symlink de/d1f/l4e 0 2024-09-18T21:12:45.490 INFO:tasks.workunit.client.0.smithi077.stdout:3/223: mknod db/d14/d22/d36/c44 0 2024-09-18T21:12:45.491 INFO:tasks.workunit.client.1.smithi103.stdout:2/196: read - d3/d5/f36 zero size 2024-09-18T21:12:45.491 INFO:tasks.workunit.client.1.smithi103.stdout:4/229: getdents d9/d1f/d31 0 2024-09-18T21:12:45.491 INFO:tasks.workunit.client.0.smithi077.stdout:5/369: symlink d0/df/d84/l87 0 2024-09-18T21:12:45.492 INFO:tasks.workunit.client.1.smithi103.stdout:4/230: readlink d9/l17 0 2024-09-18T21:12:45.492 INFO:tasks.workunit.client.1.smithi103.stdout:2/197: chown d3/f21 1449296 1 2024-09-18T21:12:45.493 INFO:tasks.workunit.client.0.smithi077.stdout:5/370: write d0/df/d10/d5c/f72 [216574,60887] 0 2024-09-18T21:12:45.494 INFO:tasks.workunit.client.0.smithi077.stdout:5/371: write d0/d6/fb [2846353,73383] 0 2024-09-18T21:12:45.495 INFO:tasks.workunit.client.0.smithi077.stdout:4/199: symlink d3/dc/l3a 0 2024-09-18T21:12:45.496 INFO:tasks.workunit.client.0.smithi077.stdout:5/372: write d0/df/d10/f45 [691932,56925] 0 2024-09-18T21:12:45.498 INFO:tasks.workunit.client.0.smithi077.stdout:8/216: rename d2/d5/c11 to d2/d5/d25/c49 0 2024-09-18T21:12:45.499 INFO:tasks.workunit.client.1.smithi103.stdout:5/242: mkdir de/d14/d33/d4f 0 2024-09-18T21:12:45.499 INFO:tasks.workunit.client.1.smithi103.stdout:4/231: dread d9/d1c/f42 [0,4194304] 0 2024-09-18T21:12:45.499 INFO:tasks.workunit.client.1.smithi103.stdout:1/254: dwrite d0/d3/f20 [0,4194304] 0 2024-09-18T21:12:45.501 INFO:tasks.workunit.client.1.smithi103.stdout:7/235: truncate d1/df/d42/f2b 3347402 0 2024-09-18T21:12:45.503 INFO:tasks.workunit.client.0.smithi077.stdout:4/200: dwrite d3/d7/f23 [0,4194304] 0 2024-09-18T21:12:45.505 INFO:tasks.workunit.client.1.smithi103.stdout:7/236: dread d1/df/d42/d29/d2f/d33/f40 [0,4194304] 0 2024-09-18T21:12:45.506 INFO:tasks.workunit.client.1.smithi103.stdout:6/260: dread d2/d24/f3b [0,4194304] 0 2024-09-18T21:12:45.507 INFO:tasks.workunit.client.0.smithi077.stdout:4/201: fsync d3/dc/d20/f2a 0 2024-09-18T21:12:45.508 INFO:tasks.workunit.client.1.smithi103.stdout:1/255: rmdir d0 39 2024-09-18T21:12:45.510 INFO:tasks.workunit.client.0.smithi077.stdout:4/202: write d3/dc/d20/f27 [3436508,30934] 0 2024-09-18T21:12:45.510 INFO:tasks.workunit.client.1.smithi103.stdout:5/243: mknod de/d1f/c50 0 2024-09-18T21:12:45.511 INFO:tasks.workunit.client.0.smithi077.stdout:8/217: dwrite d2/d5/d6/d22/d26/f32 [0,4194304] 0 2024-09-18T21:12:45.512 INFO:tasks.workunit.client.1.smithi103.stdout:5/244: truncate de/d14/f18 816670 0 2024-09-18T21:12:45.513 INFO:tasks.workunit.client.1.smithi103.stdout:9/225: dread f12 [0,4194304] 0 2024-09-18T21:12:45.515 INFO:tasks.workunit.client.0.smithi077.stdout:3/224: creat db/d14/d22/d36/d39/f45 x:0 0 0 2024-09-18T21:12:45.515 INFO:tasks.workunit.client.1.smithi103.stdout:4/232: read d9/d1f/f3b [739525,93570] 0 2024-09-18T21:12:45.516 INFO:tasks.workunit.client.1.smithi103.stdout:0/235: getdents d1/d5/d4c/d4e 0 2024-09-18T21:12:45.521 INFO:tasks.workunit.client.0.smithi077.stdout:8/218: dwrite d2/d27/d29/f3f [0,4194304] 0 2024-09-18T21:12:45.522 INFO:tasks.workunit.client.1.smithi103.stdout:7/237: symlink d1/df/l47 0 2024-09-18T21:12:45.522 INFO:tasks.workunit.client.0.smithi077.stdout:5/373: symlink d0/df/l88 0 2024-09-18T21:12:45.522 INFO:tasks.workunit.client.1.smithi103.stdout:5/245: dwrite de/ff [0,4194304] 0 2024-09-18T21:12:45.523 INFO:tasks.workunit.client.0.smithi077.stdout:8/219: chown d2/d5/d6/d22/d26/f32 4 1 2024-09-18T21:12:45.523 INFO:tasks.workunit.client.1.smithi103.stdout:0/236: chown d1/d5/de/d19/d1e/f1f 1358 1 2024-09-18T21:12:45.525 INFO:tasks.workunit.client.0.smithi077.stdout:4/203: rename d3/dc/f1c to d3/dc/d20/f3b 0 2024-09-18T21:12:45.526 INFO:tasks.workunit.client.1.smithi103.stdout:0/237: chown d1/d5 121 1 2024-09-18T21:12:45.528 INFO:tasks.workunit.client.1.smithi103.stdout:1/256: readlink d0/d11/d16/d19/l1f 0 2024-09-18T21:12:45.529 INFO:tasks.workunit.client.0.smithi077.stdout:8/220: mknod d2/d5/d6/d22/d20/c4a 0 2024-09-18T21:12:45.530 INFO:tasks.workunit.client.0.smithi077.stdout:2/276: sync 2024-09-18T21:12:45.531 INFO:tasks.workunit.client.0.smithi077.stdout:4/204: creat d3/dc/d20/f3c x:0 0 0 2024-09-18T21:12:45.532 INFO:tasks.workunit.client.0.smithi077.stdout:3/225: creat db/d14/d22/d36/d42/f46 x:0 0 0 2024-09-18T21:12:45.532 INFO:tasks.workunit.client.0.smithi077.stdout:4/205: fsync d3/d17/f39 0 2024-09-18T21:12:45.532 INFO:tasks.workunit.client.1.smithi103.stdout:4/233: dwrite d9/d2e/f40 [0,4194304] 0 2024-09-18T21:12:45.533 INFO:tasks.workunit.client.0.smithi077.stdout:8/221: stat d2/d5/d25/c49 0 2024-09-18T21:12:45.534 INFO:tasks.workunit.client.0.smithi077.stdout:3/226: dread db/d14/f1d [0,4194304] 0 2024-09-18T21:12:45.535 INFO:tasks.workunit.client.1.smithi103.stdout:5/246: rmdir de/d1f 39 2024-09-18T21:12:45.535 INFO:tasks.workunit.client.0.smithi077.stdout:3/227: chown c0 113372549 1 2024-09-18T21:12:45.537 INFO:tasks.workunit.client.1.smithi103.stdout:7/238: mkdir d1/df/d42/d29/d48 0 2024-09-18T21:12:45.538 INFO:tasks.workunit.client.0.smithi077.stdout:4/206: symlink d3/dc/d20/l3d 0 2024-09-18T21:12:45.540 INFO:tasks.workunit.client.0.smithi077.stdout:4/207: write d3/dc/d20/f2a [1884975,124017] 0 2024-09-18T21:12:45.540 INFO:tasks.workunit.client.0.smithi077.stdout:2/277: truncate d1/d4/d9/f1e 597535 0 2024-09-18T21:12:45.541 INFO:tasks.workunit.client.0.smithi077.stdout:3/228: dread db/ff [0,4194304] 0 2024-09-18T21:12:45.542 INFO:tasks.workunit.client.0.smithi077.stdout:3/229: stat db/d14/l15 0 2024-09-18T21:12:45.543 INFO:tasks.workunit.client.1.smithi103.stdout:1/257: creat d0/d2/d2b/d3a/f5c x:0 0 0 2024-09-18T21:12:45.544 INFO:tasks.workunit.client.1.smithi103.stdout:6/261: rmdir d2/d3/d4/d49 0 2024-09-18T21:12:45.545 INFO:tasks.workunit.client.1.smithi103.stdout:4/234: fdatasync d9/f2c 0 2024-09-18T21:12:45.546 INFO:tasks.workunit.client.0.smithi077.stdout:3/230: dread db/d14/f18 [0,4194304] 0 2024-09-18T21:12:45.547 INFO:tasks.workunit.client.0.smithi077.stdout:3/231: dread - db/d14/d32/d3a/f43 zero size 2024-09-18T21:12:45.548 INFO:tasks.workunit.client.0.smithi077.stdout:3/232: chown f3 218 1 2024-09-18T21:12:45.548 INFO:tasks.workunit.client.1.smithi103.stdout:7/239: rename d1/c28 to d1/df/d42/d29/d48/c49 0 2024-09-18T21:12:45.550 INFO:tasks.workunit.client.1.smithi103.stdout:4/235: dwrite f6 [0,4194304] 0 2024-09-18T21:12:45.551 INFO:tasks.workunit.client.1.smithi103.stdout:9/226: rmdir d18/d1f/d3f 0 2024-09-18T21:12:45.553 INFO:tasks.workunit.client.1.smithi103.stdout:6/262: unlink d2/d3/d8/f42 0 2024-09-18T21:12:45.555 INFO:tasks.workunit.client.0.smithi077.stdout:3/233: rename db/f16 to db/d14/d22/d36/d39/f47 0 2024-09-18T21:12:45.555 INFO:tasks.workunit.client.0.smithi077.stdout:8/222: link d2/d5/d6/c3a d2/d36/c4b 0 2024-09-18T21:12:45.556 INFO:tasks.workunit.client.1.smithi103.stdout:9/227: dread f12 [0,4194304] 0 2024-09-18T21:12:45.557 INFO:tasks.workunit.client.1.smithi103.stdout:5/247: mkdir de/d1f/d3b/d51 0 2024-09-18T21:12:45.559 INFO:tasks.workunit.client.1.smithi103.stdout:5/248: read de/d1f/f24 [3964078,17035] 0 2024-09-18T21:12:45.559 INFO:tasks.workunit.client.1.smithi103.stdout:7/240: rmdir d1/df/d42/d29/d2f/d33 39 2024-09-18T21:12:45.560 INFO:tasks.workunit.client.1.smithi103.stdout:1/258: dwrite d0/d2/f4e [0,4194304] 0 2024-09-18T21:12:45.561 INFO:tasks.workunit.client.0.smithi077.stdout:3/234: symlink db/d14/d22/d36/d39/l48 0 2024-09-18T21:12:45.561 INFO:tasks.workunit.client.1.smithi103.stdout:5/249: stat de/d3e/d15/f2e 0 2024-09-18T21:12:45.562 INFO:tasks.workunit.client.0.smithi077.stdout:8/223: rmdir d2/d5/d6/d22/d20/d35 39 2024-09-18T21:12:45.564 INFO:tasks.workunit.client.0.smithi077.stdout:8/224: write d2/d5/d6/f2c [3225057,6327] 0 2024-09-18T21:12:45.566 INFO:tasks.workunit.client.0.smithi077.stdout:4/208: getdents d3 0 2024-09-18T21:12:45.567 INFO:tasks.workunit.client.0.smithi077.stdout:8/225: truncate d2/d27/d29/d41/f45 5468 0 2024-09-18T21:12:45.568 INFO:tasks.workunit.client.0.smithi077.stdout:3/235: mkdir db/d14/d32/d49 0 2024-09-18T21:12:45.569 INFO:tasks.workunit.client.1.smithi103.stdout:1/259: dwrite d0/d2/d9/f59 [0,4194304] 0 2024-09-18T21:12:45.572 INFO:tasks.workunit.client.1.smithi103.stdout:0/238: getdents d1/d9/d13 0 2024-09-18T21:12:45.574 INFO:tasks.workunit.client.0.smithi077.stdout:4/209: chown d3/dc/d24/l31 0 1 2024-09-18T21:12:45.575 INFO:tasks.workunit.client.0.smithi077.stdout:8/226: creat d2/d5/d6/d22/d18/f4c x:0 0 0 2024-09-18T21:12:45.576 INFO:tasks.workunit.client.0.smithi077.stdout:3/236: dwrite db/f35 [0,4194304] 0 2024-09-18T21:12:45.579 INFO:tasks.workunit.client.1.smithi103.stdout:5/250: creat de/d1f/f52 x:0 0 0 2024-09-18T21:12:45.580 INFO:tasks.workunit.client.0.smithi077.stdout:4/210: creat d3/dc/d32/f3e x:0 0 0 2024-09-18T21:12:45.581 INFO:tasks.workunit.client.1.smithi103.stdout:5/251: chown c4 9 1 2024-09-18T21:12:45.582 INFO:tasks.workunit.client.1.smithi103.stdout:5/252: write de/d3e/f17 [3537789,130060] 0 2024-09-18T21:12:45.583 INFO:tasks.workunit.client.1.smithi103.stdout:5/253: fdatasync de/d14/d33/f2c 0 2024-09-18T21:12:45.584 INFO:tasks.workunit.client.0.smithi077.stdout:2/278: dread d1/d4/d5/f7 [0,4194304] 0 2024-09-18T21:12:45.586 INFO:tasks.workunit.client.1.smithi103.stdout:6/263: creat d2/d3/d4/d43/d44/f54 x:0 0 0 2024-09-18T21:12:45.588 INFO:tasks.workunit.client.0.smithi077.stdout:4/211: dwrite d3/d7/f23 [0,4194304] 0 2024-09-18T21:12:45.591 INFO:tasks.workunit.client.0.smithi077.stdout:3/237: symlink db/l4a 0 2024-09-18T21:12:45.592 INFO:tasks.workunit.client.1.smithi103.stdout:3/204: sync 2024-09-18T21:12:45.592 INFO:tasks.workunit.client.1.smithi103.stdout:1/260: mkdir d0/d2/d9/d10/d5d 0 2024-09-18T21:12:45.593 INFO:tasks.workunit.client.1.smithi103.stdout:3/205: write d1/da/f16 [3191837,18374] 0 2024-09-18T21:12:45.594 INFO:tasks.workunit.client.0.smithi077.stdout:4/212: dread d3/dc/d20/f3b [0,4194304] 0 2024-09-18T21:12:45.595 INFO:tasks.workunit.client.0.smithi077.stdout:4/213: dread - d3/f1f zero size 2024-09-18T21:12:45.595 INFO:tasks.workunit.client.0.smithi077.stdout:2/279: rmdir d1/d4/d5/d1a/d2e/d41/d2c 39 2024-09-18T21:12:45.598 INFO:tasks.workunit.client.0.smithi077.stdout:3/238: rmdir db/d14/d32/d3a/d3b 39 2024-09-18T21:12:45.598 INFO:tasks.workunit.client.0.smithi077.stdout:4/214: dread d3/dc/d20/f29 [0,4194304] 0 2024-09-18T21:12:45.598 INFO:tasks.workunit.client.0.smithi077.stdout:3/239: write fa [3696995,92519] 0 2024-09-18T21:12:45.600 INFO:tasks.workunit.client.1.smithi103.stdout:9/228: dread f1 [0,4194304] 0 2024-09-18T21:12:45.601 INFO:tasks.workunit.client.1.smithi103.stdout:9/229: stat d18/f1a 0 2024-09-18T21:12:45.601 INFO:tasks.workunit.client.1.smithi103.stdout:5/254: rename de/d14/d33/f2c to de/d14/d33/f53 0 2024-09-18T21:12:45.602 INFO:tasks.workunit.client.1.smithi103.stdout:5/255: stat de/d1f/d3b 0 2024-09-18T21:12:45.603 INFO:tasks.workunit.client.1.smithi103.stdout:4/236: write d9/d38/f45 [1004059,6645] 0 2024-09-18T21:12:45.604 INFO:tasks.workunit.client.0.smithi077.stdout:2/280: symlink d1/d4/d5/d1a/d2e/d40/l59 0 2024-09-18T21:12:45.605 INFO:tasks.workunit.client.0.smithi077.stdout:3/240: dwrite fa [0,4194304] 0 2024-09-18T21:12:45.606 INFO:tasks.workunit.client.0.smithi077.stdout:2/281: truncate d1/f19 1436164 0 2024-09-18T21:12:45.606 INFO:tasks.workunit.client.0.smithi077.stdout:2/282: stat d1/d4/f22 0 2024-09-18T21:12:45.608 INFO:tasks.workunit.client.0.smithi077.stdout:4/215: rename d3/d7/c21 to d3/dc/d24/c3f 0 2024-09-18T21:12:45.610 INFO:tasks.workunit.client.1.smithi103.stdout:1/261: rename d0/ca to d0/d11/d16/c5e 0 2024-09-18T21:12:45.610 INFO:tasks.workunit.client.0.smithi077.stdout:8/227: link d2/d5/d6/d22/d20/l30 d2/d5/d6/d22/d20/l4d 0 2024-09-18T21:12:45.612 INFO:tasks.workunit.client.1.smithi103.stdout:7/241: creat d1/df/d42/d1f/d2e/d3f/f4a x:0 0 0 2024-09-18T21:12:45.615 INFO:tasks.workunit.client.1.smithi103.stdout:9/230: creat d18/d29/f45 x:0 0 0 2024-09-18T21:12:45.618 INFO:tasks.workunit.client.0.smithi077.stdout:4/216: read d3/d7/f11 [1315836,10321] 0 2024-09-18T21:12:45.619 INFO:tasks.workunit.client.0.smithi077.stdout:8/228: dread d2/d5/d6/d22/f1b [0,4194304] 0 2024-09-18T21:12:45.620 INFO:tasks.workunit.client.0.smithi077.stdout:8/229: write d2/d27/d29/f43 [5747020,125481] 0 2024-09-18T21:12:45.620 INFO:tasks.workunit.client.1.smithi103.stdout:3/206: symlink d1/l3b 0 2024-09-18T21:12:45.621 INFO:tasks.workunit.client.0.smithi077.stdout:2/283: creat d1/d4/d5/d1a/d2e/f5a x:0 0 0 2024-09-18T21:12:45.622 INFO:tasks.workunit.client.1.smithi103.stdout:3/207: stat d1/da/df 0 2024-09-18T21:12:45.623 INFO:tasks.workunit.client.1.smithi103.stdout:4/237: dwrite f3 [0,4194304] 0 2024-09-18T21:12:45.623 INFO:tasks.workunit.client.0.smithi077.stdout:4/217: creat d3/dc/d20/f40 x:0 0 0 2024-09-18T21:12:45.626 INFO:tasks.workunit.client.1.smithi103.stdout:4/238: truncate d9/d2e/f40 4523065 0 2024-09-18T21:12:45.627 INFO:tasks.workunit.client.1.smithi103.stdout:9/231: symlink d18/d29/l46 0 2024-09-18T21:12:45.628 INFO:tasks.workunit.client.1.smithi103.stdout:8/244: sync 2024-09-18T21:12:45.628 INFO:tasks.workunit.client.1.smithi103.stdout:6/264: dwrite d2/d3/d4/f4f [0,4194304] 0 2024-09-18T21:12:45.628 INFO:tasks.workunit.client.1.smithi103.stdout:3/208: dread d1/f2e [0,4194304] 0 2024-09-18T21:12:45.629 INFO:tasks.workunit.client.0.smithi077.stdout:2/284: dwrite d1/d4/d5/d1a/d2e/f43 [0,4194304] 0 2024-09-18T21:12:45.629 INFO:tasks.workunit.client.1.smithi103.stdout:8/245: rename d4 to d4/d2d/d44/d4c/d53 22 2024-09-18T21:12:45.632 INFO:tasks.workunit.client.1.smithi103.stdout:1/262: rename d0/d11/d16 to d0/d11/d5f 0 2024-09-18T21:12:45.634 INFO:tasks.workunit.client.0.smithi077.stdout:4/218: link d3/dc/d32/f3e d3/d17/f41 0 2024-09-18T21:12:45.636 INFO:tasks.workunit.client.1.smithi103.stdout:0/239: getdents d1/d5 0 2024-09-18T21:12:45.637 INFO:tasks.workunit.client.1.smithi103.stdout:0/240: dread - d1/d5/f44 zero size 2024-09-18T21:12:45.638 INFO:tasks.workunit.client.1.smithi103.stdout:0/241: write d1/d9/f54 [84821,125883] 0 2024-09-18T21:12:45.641 INFO:tasks.workunit.client.0.smithi077.stdout:4/219: unlink d3/d7/f23 0 2024-09-18T21:12:45.641 INFO:tasks.workunit.client.0.smithi077.stdout:4/220: dread - d3/d35/f37 zero size 2024-09-18T21:12:45.642 INFO:tasks.workunit.client.1.smithi103.stdout:4/239: creat d9/d1f/f50 x:0 0 0 2024-09-18T21:12:45.643 INFO:tasks.workunit.client.1.smithi103.stdout:4/240: fdatasync d9/f23 0 2024-09-18T21:12:45.643 INFO:tasks.workunit.client.0.smithi077.stdout:2/285: symlink d1/d4/d9/l5b 0 2024-09-18T21:12:45.644 INFO:tasks.workunit.client.1.smithi103.stdout:0/242: dread d1/d9/f33 [0,4194304] 0 2024-09-18T21:12:45.644 INFO:tasks.workunit.client.1.smithi103.stdout:9/232: rmdir d18 39 2024-09-18T21:12:45.646 INFO:tasks.workunit.client.0.smithi077.stdout:4/221: mkdir d3/d7/d42 0 2024-09-18T21:12:45.647 INFO:tasks.workunit.client.1.smithi103.stdout:5/256: truncate de/d14/f39 2675410 0 2024-09-18T21:12:45.648 INFO:tasks.workunit.client.1.smithi103.stdout:5/257: fsync de/d1f/f2a 0 2024-09-18T21:12:45.651 INFO:tasks.workunit.client.1.smithi103.stdout:0/243: dwrite d1/d5/d4c/f53 [0,4194304] 0 2024-09-18T21:12:45.651 INFO:tasks.workunit.client.1.smithi103.stdout:0/244: chown d1/d9/d13/f14 1126890 1 2024-09-18T21:12:45.653 INFO:tasks.workunit.client.1.smithi103.stdout:4/241: creat d9/d38/f51 x:0 0 0 2024-09-18T21:12:45.653 INFO:tasks.workunit.client.0.smithi077.stdout:4/222: dwrite d3/d17/f28 [0,4194304] 0 2024-09-18T21:12:45.655 INFO:tasks.workunit.client.0.smithi077.stdout:2/286: rename d1/c2 to d1/d4/d5/d1a/d2e/d41/c5c 0 2024-09-18T21:12:45.656 INFO:tasks.workunit.client.1.smithi103.stdout:4/242: fsync d9/d1a/f24 0 2024-09-18T21:12:45.660 INFO:tasks.workunit.client.1.smithi103.stdout:5/258: dread - de/f36 zero size 2024-09-18T21:12:45.661 INFO:tasks.workunit.client.1.smithi103.stdout:4/243: dread d9/d1c/f39 [0,4194304] 0 2024-09-18T21:12:45.665 INFO:tasks.workunit.client.0.smithi077.stdout:4/223: truncate d3/f26 1665275 0 2024-09-18T21:12:45.669 INFO:tasks.workunit.client.0.smithi077.stdout:4/224: creat d3/dc/d24/f43 x:0 0 0 2024-09-18T21:12:45.670 INFO:tasks.workunit.client.1.smithi103.stdout:6/265: creat d2/d3/f55 x:0 0 0 2024-09-18T21:12:45.672 INFO:tasks.workunit.client.0.smithi077.stdout:4/225: creat d3/dc/d32/f44 x:0 0 0 2024-09-18T21:12:45.673 INFO:tasks.workunit.client.1.smithi103.stdout:3/209: creat d1/f3c x:0 0 0 2024-09-18T21:12:45.674 INFO:tasks.workunit.client.0.smithi077.stdout:4/226: mkdir d3/dc/d32/d45 0 2024-09-18T21:12:45.675 INFO:tasks.workunit.client.1.smithi103.stdout:4/244: creat d9/d1c/f52 x:0 0 0 2024-09-18T21:12:45.675 INFO:tasks.workunit.client.0.smithi077.stdout:4/227: fdatasync d3/f1f 0 2024-09-18T21:12:45.676 INFO:tasks.workunit.client.1.smithi103.stdout:7/242: dread d1/df/d42/d1f/d2e/f41 [0,4194304] 0 2024-09-18T21:12:45.678 INFO:tasks.workunit.client.0.smithi077.stdout:4/228: read d3/dc/d20/f2a [3155940,29556] 0 2024-09-18T21:12:45.678 INFO:tasks.workunit.client.1.smithi103.stdout:9/233: mknod d18/d1f/c47 0 2024-09-18T21:12:45.679 INFO:tasks.workunit.client.1.smithi103.stdout:7/243: read d1/df/d42/d1f/d2e/f37 [3095328,33496] 0 2024-09-18T21:12:45.679 INFO:tasks.workunit.client.1.smithi103.stdout:9/234: write d18/d29/f45 [791053,19137] 0 2024-09-18T21:12:45.681 INFO:tasks.workunit.client.1.smithi103.stdout:3/210: creat d1/da/f3d x:0 0 0 2024-09-18T21:12:45.681 INFO:tasks.workunit.client.0.smithi077.stdout:2/287: dwrite d1/d4/f8 [0,4194304] 0 2024-09-18T21:12:45.683 INFO:tasks.workunit.client.0.smithi077.stdout:4/229: creat d3/dc/f46 x:0 0 0 2024-09-18T21:12:45.684 INFO:tasks.workunit.client.1.smithi103.stdout:9/235: read d18/f20 [2149199,71367] 0 2024-09-18T21:12:45.684 INFO:tasks.workunit.client.1.smithi103.stdout:4/245: creat d9/d1a/d2b/f53 x:0 0 0 2024-09-18T21:12:45.685 INFO:tasks.workunit.client.0.smithi077.stdout:4/230: creat d3/dc/f47 x:0 0 0 2024-09-18T21:12:45.685 INFO:tasks.workunit.client.1.smithi103.stdout:3/211: read d1/da/f22 [3783351,35105] 0 2024-09-18T21:12:45.687 INFO:tasks.workunit.client.1.smithi103.stdout:8/246: dread d4/de/f11 [0,4194304] 0 2024-09-18T21:12:45.688 INFO:tasks.workunit.client.0.smithi077.stdout:2/288: creat d1/d4/d5/d1a/d2e/d41/f5d x:0 0 0 2024-09-18T21:12:45.688 INFO:tasks.workunit.client.1.smithi103.stdout:0/245: getdents d1/d9 0 2024-09-18T21:12:45.689 INFO:tasks.workunit.client.0.smithi077.stdout:4/231: creat d3/dc/d32/f48 x:0 0 0 2024-09-18T21:12:45.692 INFO:tasks.workunit.client.1.smithi103.stdout:4/246: dread d9/f11 [0,4194304] 0 2024-09-18T21:12:45.692 INFO:tasks.workunit.client.1.smithi103.stdout:6/266: rename d2/d3/d4/f4f to d2/f56 0 2024-09-18T21:12:45.695 INFO:tasks.workunit.client.1.smithi103.stdout:9/236: readlink l16 0 2024-09-18T21:12:45.695 INFO:tasks.workunit.client.0.smithi077.stdout:4/232: symlink d3/dc/d32/l49 0 2024-09-18T21:12:45.697 INFO:tasks.workunit.client.1.smithi103.stdout:3/212: fsync d1/da/f3d 0 2024-09-18T21:12:45.697 INFO:tasks.workunit.client.0.smithi077.stdout:4/233: creat d3/dc/d24/f4a x:0 0 0 2024-09-18T21:12:45.700 INFO:tasks.workunit.client.1.smithi103.stdout:4/247: unlink d9/d1f/d31/f46 0 2024-09-18T21:12:45.701 INFO:tasks.workunit.client.0.smithi077.stdout:4/234: unlink d3/d17/f28 0 2024-09-18T21:12:45.701 INFO:tasks.workunit.client.1.smithi103.stdout:0/246: dread d1/f29 [0,4194304] 0 2024-09-18T21:12:45.702 INFO:tasks.workunit.client.0.smithi077.stdout:4/235: truncate d3/f2b 1028552 0 2024-09-18T21:12:45.702 INFO:tasks.workunit.client.1.smithi103.stdout:8/247: rename d4/de/l19 to d4/d2d/d4e/l54 0 2024-09-18T21:12:45.703 INFO:tasks.workunit.client.0.smithi077.stdout:4/236: write d3/dc/d24/f43 [469708,97700] 0 2024-09-18T21:12:45.703 INFO:tasks.workunit.client.0.smithi077.stdout:4/237: stat d3/d7/c2f 0 2024-09-18T21:12:45.704 INFO:tasks.workunit.client.1.smithi103.stdout:8/248: write d4/de/f1e [799362,125434] 0 2024-09-18T21:12:45.704 INFO:tasks.workunit.client.1.smithi103.stdout:6/267: mknod d2/d3/d4/c57 0 2024-09-18T21:12:45.705 INFO:tasks.workunit.client.1.smithi103.stdout:5/259: dwrite de/d3e/f19 [0,4194304] 0 2024-09-18T21:12:45.705 INFO:tasks.workunit.client.0.smithi077.stdout:2/289: rmdir d1 39 2024-09-18T21:12:45.707 INFO:tasks.workunit.client.0.smithi077.stdout:4/238: symlink d3/dc/d20/l4b 0 2024-09-18T21:12:45.710 INFO:tasks.workunit.client.1.smithi103.stdout:3/213: creat d1/d2/f3e x:0 0 0 2024-09-18T21:12:45.710 INFO:tasks.workunit.client.0.smithi077.stdout:4/239: write d3/dc/f16 [528680,5580] 0 2024-09-18T21:12:45.712 INFO:tasks.workunit.client.0.smithi077.stdout:4/240: write d3/d35/f37 [719779,153] 0 2024-09-18T21:12:45.714 INFO:tasks.workunit.client.1.smithi103.stdout:4/248: creat d9/d1f/d31/f54 x:0 0 0 2024-09-18T21:12:45.717 INFO:tasks.workunit.client.0.smithi077.stdout:4/241: creat d3/dc/d24/f4c x:0 0 0 2024-09-18T21:12:45.719 INFO:tasks.workunit.client.0.smithi077.stdout:2/290: dwrite d1/f42 [0,4194304] 0 2024-09-18T21:12:45.720 INFO:tasks.workunit.client.0.smithi077.stdout:4/242: symlink d3/dc/d24/l4d 0 2024-09-18T21:12:45.725 INFO:tasks.workunit.client.0.smithi077.stdout:2/291: unlink d1/d4/d9/d4f/f52 0 2024-09-18T21:12:45.729 INFO:tasks.workunit.client.0.smithi077.stdout:2/292: mknod d1/d4/d5/d1a/d49/c5e 0 2024-09-18T21:12:45.731 INFO:tasks.workunit.client.0.smithi077.stdout:4/243: rename d3/l4 to d3/dc/d20/l4e 0 2024-09-18T21:12:45.734 INFO:tasks.workunit.client.0.smithi077.stdout:4/244: fdatasync d3/dc/d20/f29 0 2024-09-18T21:12:45.735 INFO:tasks.workunit.client.0.smithi077.stdout:4/245: dread - d3/f1f zero size 2024-09-18T21:12:45.735 INFO:tasks.workunit.client.0.smithi077.stdout:2/293: truncate d1/d4/d5/d1a/d2e/f34 210384 0 2024-09-18T21:12:45.735 INFO:tasks.workunit.client.0.smithi077.stdout:4/246: chown d3/f2b 12830 1 2024-09-18T21:12:45.737 INFO:tasks.workunit.client.0.smithi077.stdout:4/247: read d3/fa [3575132,7447] 0 2024-09-18T21:12:45.740 INFO:tasks.workunit.client.0.smithi077.stdout:4/248: creat d3/d7/f4f x:0 0 0 2024-09-18T21:12:45.740 INFO:tasks.workunit.client.0.smithi077.stdout:4/249: dread - d3/d17/f39 zero size 2024-09-18T21:12:45.741 INFO:tasks.workunit.client.0.smithi077.stdout:2/294: link d1/d4/d5/d1a/d2e/f43 d1/d4/f5f 0 2024-09-18T21:12:45.741 INFO:tasks.workunit.client.0.smithi077.stdout:4/250: stat d3/dc/d20/f40 0 2024-09-18T21:12:45.742 INFO:tasks.workunit.client.1.smithi103.stdout:2/198: sync 2024-09-18T21:12:45.742 INFO:tasks.workunit.client.0.smithi077.stdout:4/251: write d3/dc/d24/f43 [143471,22632] 0 2024-09-18T21:12:45.742 INFO:tasks.workunit.client.0.smithi077.stdout:2/295: write d1/d4/d5/d1a/d2e/f5a [214035,71719] 0 2024-09-18T21:12:45.745 INFO:tasks.workunit.client.0.smithi077.stdout:4/252: unlink d3/d7/c14 0 2024-09-18T21:12:45.746 INFO:tasks.workunit.client.0.smithi077.stdout:4/253: mknod d3/c50 0 2024-09-18T21:12:45.746 INFO:tasks.workunit.client.0.smithi077.stdout:2/296: rmdir d1/d4/d5/d1a/d2e/d41/d2c 39 2024-09-18T21:12:45.747 INFO:tasks.workunit.client.0.smithi077.stdout:4/254: unlink d3/d7/l1e 0 2024-09-18T21:12:45.748 INFO:tasks.workunit.client.0.smithi077.stdout:4/255: truncate d3/d17/f41 974776 0 2024-09-18T21:12:45.752 INFO:tasks.workunit.client.0.smithi077.stdout:2/297: dwrite d1/d4/f2f [0,4194304] 0 2024-09-18T21:12:45.753 INFO:tasks.workunit.client.0.smithi077.stdout:2/298: read d1/d4/f22 [2040110,115699] 0 2024-09-18T21:12:45.755 INFO:tasks.workunit.client.1.smithi103.stdout:0/247: rmdir d1/d9 39 2024-09-18T21:12:45.756 INFO:tasks.workunit.client.1.smithi103.stdout:3/214: dwrite d1/da/df/f19 [0,4194304] 0 2024-09-18T21:12:45.756 INFO:tasks.workunit.client.1.smithi103.stdout:9/237: rename d18/d1f/d2f/c32 to d18/c48 0 2024-09-18T21:12:45.756 INFO:tasks.workunit.client.0.smithi077.stdout:2/299: mknod d1/d4/d9/d4f/c60 0 2024-09-18T21:12:45.757 INFO:tasks.workunit.client.1.smithi103.stdout:3/215: stat d1/l3 0 2024-09-18T21:12:45.758 INFO:tasks.workunit.client.0.smithi077.stdout:1/208: sync 2024-09-18T21:12:45.759 INFO:tasks.workunit.client.1.smithi103.stdout:7/244: getdents d1/df/d42/d1f/d2e/d3f 0 2024-09-18T21:12:45.760 INFO:tasks.workunit.client.0.smithi077.stdout:2/300: dread d1/d4/f8 [0,4194304] 0 2024-09-18T21:12:45.762 INFO:tasks.workunit.client.0.smithi077.stdout:1/209: creat d3/d8/d13/d18/f4d x:0 0 0 2024-09-18T21:12:45.762 INFO:tasks.workunit.client.1.smithi103.stdout:7/245: read - d1/df/d42/f45 zero size 2024-09-18T21:12:45.762 INFO:tasks.workunit.client.1.smithi103.stdout:4/249: creat d9/d1a/f55 x:0 0 0 2024-09-18T21:12:45.763 INFO:tasks.workunit.client.0.smithi077.stdout:1/210: chown d3/d8/d13/l39 95 1 2024-09-18T21:12:45.764 INFO:tasks.workunit.client.1.smithi103.stdout:4/250: dread - d9/d1c/f52 zero size 2024-09-18T21:12:45.765 INFO:tasks.workunit.client.1.smithi103.stdout:5/260: symlink de/d3e/l54 0 2024-09-18T21:12:45.766 INFO:tasks.workunit.client.1.smithi103.stdout:5/261: fsync de/d14/d33/f46 0 2024-09-18T21:12:45.767 INFO:tasks.workunit.client.0.smithi077.stdout:4/256: dwrite d3/dc/d20/f2a [0,4194304] 0 2024-09-18T21:12:45.769 INFO:tasks.workunit.client.1.smithi103.stdout:6/268: dwrite d2/d3/f2f [4194304,4194304] 0 2024-09-18T21:12:45.770 INFO:tasks.workunit.client.0.smithi077.stdout:2/301: stat d1/d4/d9/f1e 0 2024-09-18T21:12:45.771 INFO:tasks.workunit.client.1.smithi103.stdout:3/216: creat d1/d2/d18/d30/f3f x:0 0 0 2024-09-18T21:12:45.774 INFO:tasks.workunit.client.0.smithi077.stdout:2/302: dread d1/d4/f2f [0,4194304] 0 2024-09-18T21:12:45.774 INFO:tasks.workunit.client.1.smithi103.stdout:7/246: creat d1/f4b x:0 0 0 2024-09-18T21:12:45.774 INFO:tasks.workunit.client.0.smithi077.stdout:4/257: mkdir d3/dc/d51 0 2024-09-18T21:12:45.775 INFO:tasks.workunit.client.0.smithi077.stdout:4/258: stat l1 0 2024-09-18T21:12:45.775 INFO:tasks.workunit.client.0.smithi077.stdout:2/303: chown d1/d4/d5/d1a/d49 2 1 2024-09-18T21:12:45.775 INFO:tasks.workunit.client.0.smithi077.stdout:4/259: fdatasync d3/d17/f39 0 2024-09-18T21:12:45.776 INFO:tasks.workunit.client.1.smithi103.stdout:9/238: unlink l3 0 2024-09-18T21:12:45.778 INFO:tasks.workunit.client.0.smithi077.stdout:1/211: mkdir d3/d8/d49/d4e 0 2024-09-18T21:12:45.779 INFO:tasks.workunit.client.1.smithi103.stdout:2/199: rename d3/c26 to d3/d5/d2f/d32/c4b 0 2024-09-18T21:12:45.779 INFO:tasks.workunit.client.0.smithi077.stdout:1/212: chown d3/f2a 737 1 2024-09-18T21:12:45.780 INFO:tasks.workunit.client.0.smithi077.stdout:4/260: symlink d3/d35/l52 0 2024-09-18T21:12:45.782 INFO:tasks.workunit.client.1.smithi103.stdout:5/262: rmdir de/d14 39 2024-09-18T21:12:45.784 INFO:tasks.workunit.client.0.smithi077.stdout:1/213: symlink d3/d8/d13/d18/d22/d3d/l4f 0 2024-09-18T21:12:45.785 INFO:tasks.workunit.client.0.smithi077.stdout:1/214: chown d3/d8/d13/d18/d22/f2c 3849 1 2024-09-18T21:12:45.787 INFO:tasks.workunit.client.1.smithi103.stdout:3/217: rmdir d1/da 39 2024-09-18T21:12:45.787 INFO:tasks.workunit.client.1.smithi103.stdout:4/251: dwrite f5 [4194304,4194304] 0 2024-09-18T21:12:45.788 INFO:tasks.workunit.client.0.smithi077.stdout:4/261: mkdir d3/dc/d51/d53 0 2024-09-18T21:12:45.789 INFO:tasks.workunit.client.1.smithi103.stdout:7/247: creat d1/df/f4c x:0 0 0 2024-09-18T21:12:45.789 INFO:tasks.workunit.client.1.smithi103.stdout:3/218: readlink d1/l27 0 2024-09-18T21:12:45.790 INFO:tasks.workunit.client.0.smithi077.stdout:4/262: dread d3/dc/d20/f3b [0,4194304] 0 2024-09-18T21:12:45.793 INFO:tasks.workunit.client.1.smithi103.stdout:6/269: dwrite d2/d3/d8/f29 [0,4194304] 0 2024-09-18T21:12:45.797 INFO:tasks.workunit.client.0.smithi077.stdout:2/304: getdents d1/d4/d5/d1a/d49 0 2024-09-18T21:12:45.797 INFO:tasks.workunit.client.1.smithi103.stdout:4/252: truncate d9/d2e/f49 31737 0 2024-09-18T21:12:45.797 INFO:tasks.workunit.client.1.smithi103.stdout:7/248: write d1/f17 [4130241,110690] 0 2024-09-18T21:12:45.799 INFO:tasks.workunit.client.0.smithi077.stdout:4/263: dwrite d3/dc/d24/f43 [0,4194304] 0 2024-09-18T21:12:45.800 INFO:tasks.workunit.client.0.smithi077.stdout:2/305: rmdir d1/d4/d9/d24 39 2024-09-18T21:12:45.801 INFO:tasks.workunit.client.1.smithi103.stdout:3/219: mknod d1/d23/c40 0 2024-09-18T21:12:45.801 INFO:tasks.workunit.client.1.smithi103.stdout:0/248: dread d1/f4 [0,4194304] 0 2024-09-18T21:12:45.802 INFO:tasks.workunit.client.1.smithi103.stdout:3/220: write d1/d2/f3e [343958,22421] 0 2024-09-18T21:12:45.806 INFO:tasks.workunit.client.1.smithi103.stdout:5/263: rmdir de/d2d/d4d 0 2024-09-18T21:12:45.807 INFO:tasks.workunit.client.1.smithi103.stdout:7/249: dread - d1/df/d42/d1f/d2e/d3f/f4a zero size 2024-09-18T21:12:45.809 INFO:tasks.workunit.client.0.smithi077.stdout:2/306: dwrite d1/d4/d9/f51 [0,4194304] 0 2024-09-18T21:12:45.810 INFO:tasks.workunit.client.1.smithi103.stdout:4/253: dwrite d9/d38/f4c [4194304,4194304] 0 2024-09-18T21:12:45.811 INFO:tasks.workunit.client.1.smithi103.stdout:7/250: fsync d1/df/d42/d1f/d2e/d3f/f4a 0 2024-09-18T21:12:45.814 INFO:tasks.workunit.client.1.smithi103.stdout:7/251: write d1/df/d42/f45 [94116,958] 0 2024-09-18T21:12:45.815 INFO:tasks.workunit.client.1.smithi103.stdout:5/264: read de/d1f/f23 [1151120,58828] 0 2024-09-18T21:12:45.815 INFO:tasks.workunit.client.0.smithi077.stdout:2/307: mknod d1/d4/d5/d1a/d2e/d40/c61 0 2024-09-18T21:12:45.819 INFO:tasks.workunit.client.1.smithi103.stdout:3/221: symlink d1/d2/d18/d30/l41 0 2024-09-18T21:12:45.819 INFO:tasks.workunit.client.1.smithi103.stdout:2/200: rename d3/d5/d2c/f31 to d3/d5/f4c 0 2024-09-18T21:12:45.820 INFO:tasks.workunit.client.0.smithi077.stdout:2/308: rmdir d1/d4/d5/d1a/d2e/d40 39 2024-09-18T21:12:45.822 INFO:tasks.workunit.client.1.smithi103.stdout:4/254: creat d9/d1a/d2b/d48/f56 x:0 0 0 2024-09-18T21:12:45.823 INFO:tasks.workunit.client.1.smithi103.stdout:9/239: unlink d18/d29/f45 0 2024-09-18T21:12:45.823 INFO:tasks.workunit.client.1.smithi103.stdout:4/255: chown d9/fc 414732155 1 2024-09-18T21:12:45.825 INFO:tasks.workunit.client.1.smithi103.stdout:4/256: dread - d9/d1a/d2b/f35 zero size 2024-09-18T21:12:45.825 INFO:tasks.workunit.client.1.smithi103.stdout:5/265: mknod de/d1f/d3b/c55 0 2024-09-18T21:12:45.826 INFO:tasks.workunit.client.1.smithi103.stdout:3/222: dwrite d1/f13 [0,4194304] 0 2024-09-18T21:12:45.829 INFO:tasks.workunit.client.1.smithi103.stdout:4/257: dread d9/d2e/f49 [0,4194304] 0 2024-09-18T21:12:45.829 INFO:tasks.workunit.client.0.smithi077.stdout:1/215: rename d3/d8/d13/d18/d22 to d3/d8/d49/d4e/d50 0 2024-09-18T21:12:45.831 INFO:tasks.workunit.client.0.smithi077.stdout:2/309: dwrite d1/d4/d9/d24/f55 [0,4194304] 0 2024-09-18T21:12:45.832 INFO:tasks.workunit.client.1.smithi103.stdout:9/240: read - d18/d1f/d2f/f41 zero size 2024-09-18T21:12:45.833 INFO:tasks.workunit.client.0.smithi077.stdout:2/310: dread d1/d4/d5/d1a/d2e/f37 [0,4194304] 0 2024-09-18T21:12:45.834 INFO:tasks.workunit.client.0.smithi077.stdout:1/216: creat d3/d8/d13/d18/f51 x:0 0 0 2024-09-18T21:12:45.837 INFO:tasks.workunit.client.1.smithi103.stdout:7/252: link d1/f21 d1/df/d43/f4d 0 2024-09-18T21:12:45.837 INFO:tasks.workunit.client.1.smithi103.stdout:1/263: sync 2024-09-18T21:12:45.837 INFO:tasks.workunit.client.1.smithi103.stdout:6/270: dread d2/d3/d8/df/f11 [0,4194304] 0 2024-09-18T21:12:45.838 INFO:tasks.workunit.client.0.smithi077.stdout:4/264: rename d3/dc/c33 to d3/dc/d51/c54 0 2024-09-18T21:12:45.838 INFO:tasks.workunit.client.1.smithi103.stdout:3/223: dwrite d1/d2/d18/f29 [0,4194304] 0 2024-09-18T21:12:45.840 INFO:tasks.workunit.client.1.smithi103.stdout:1/264: write d0/d2/d2b/d3a/f5c [598752,52019] 0 2024-09-18T21:12:45.840 INFO:tasks.workunit.client.0.smithi077.stdout:2/311: unlink d1/d4/l21 0 2024-09-18T21:12:45.842 INFO:tasks.workunit.client.0.smithi077.stdout:1/217: dwrite d3/d8/d13/d18/f1a [0,4194304] 0 2024-09-18T21:12:45.843 INFO:tasks.workunit.client.1.smithi103.stdout:6/271: write d2/d3/d4/f2e [377205,46376] 0 2024-09-18T21:12:45.844 INFO:tasks.workunit.client.0.smithi077.stdout:4/265: symlink d3/d17/l55 0 2024-09-18T21:12:45.846 INFO:tasks.workunit.client.0.smithi077.stdout:4/266: write d3/d17/f39 [352487,100996] 0 2024-09-18T21:12:45.849 INFO:tasks.workunit.client.1.smithi103.stdout:4/258: creat d9/d1a/d21/f57 x:0 0 0 2024-09-18T21:12:45.849 INFO:tasks.workunit.client.1.smithi103.stdout:0/249: getdents d1/d5/d4c 0 2024-09-18T21:12:45.850 INFO:tasks.workunit.client.0.smithi077.stdout:2/312: mkdir d1/d62 0 2024-09-18T21:12:45.850 INFO:tasks.workunit.client.1.smithi103.stdout:9/241: mknod d18/d1f/d2f/c49 0 2024-09-18T21:12:45.851 INFO:tasks.workunit.client.1.smithi103.stdout:7/253: dread d1/df/d42/d1f/d2e/f41 [0,4194304] 0 2024-09-18T21:12:45.853 INFO:tasks.workunit.client.1.smithi103.stdout:1/265: rmdir d0/d2/d9/dc 39 2024-09-18T21:12:45.854 INFO:tasks.workunit.client.1.smithi103.stdout:5/266: dwrite de/d14/f32 [0,4194304] 0 2024-09-18T21:12:45.855 INFO:tasks.workunit.client.0.smithi077.stdout:4/267: dwrite d3/d35/f37 [0,4194304] 0 2024-09-18T21:12:45.857 INFO:tasks.workunit.client.1.smithi103.stdout:3/224: rmdir d1/d2 39 2024-09-18T21:12:45.858 INFO:tasks.workunit.client.0.smithi077.stdout:2/313: creat d1/d4/d9/d4f/f63 x:0 0 0 2024-09-18T21:12:45.860 INFO:tasks.workunit.client.0.smithi077.stdout:0/332: sync 2024-09-18T21:12:45.860 INFO:tasks.workunit.client.1.smithi103.stdout:2/201: rename d3/d5/f12 to d3/f4d 0 2024-09-18T21:12:45.862 INFO:tasks.workunit.client.1.smithi103.stdout:9/242: dwrite d18/d29/f43 [0,4194304] 0 2024-09-18T21:12:45.866 INFO:tasks.workunit.client.0.smithi077.stdout:2/314: dwrite d1/f42 [0,4194304] 0 2024-09-18T21:12:45.866 INFO:tasks.workunit.client.0.smithi077.stdout:4/268: creat d3/d35/f56 x:0 0 0 2024-09-18T21:12:45.867 INFO:tasks.workunit.client.1.smithi103.stdout:4/259: mkdir d9/d38/d58 0 2024-09-18T21:12:45.871 INFO:tasks.workunit.client.0.smithi077.stdout:0/333: rmdir d8/d37 39 2024-09-18T21:12:45.873 INFO:tasks.workunit.client.1.smithi103.stdout:0/250: mkdir d1/d5/de/d19/d1e/d58 0 2024-09-18T21:12:45.876 INFO:tasks.workunit.client.1.smithi103.stdout:1/266: write d0/d11/f35 [1340087,79950] 0 2024-09-18T21:12:45.885 INFO:tasks.workunit.client.1.smithi103.stdout:2/202: creat d3/d5/d25/d40/f4e x:0 0 0 2024-09-18T21:12:45.885 INFO:tasks.workunit.client.1.smithi103.stdout:8/249: sync 2024-09-18T21:12:45.887 INFO:tasks.workunit.client.1.smithi103.stdout:2/203: dread d3/d5/d2c/f3e [0,4194304] 0 2024-09-18T21:12:45.888 INFO:tasks.workunit.client.0.smithi077.stdout:0/334: creat d8/f6a x:0 0 0 2024-09-18T21:12:45.888 INFO:tasks.workunit.client.1.smithi103.stdout:2/204: chown d3/d5/f38 6595821 1 2024-09-18T21:12:45.889 INFO:tasks.workunit.client.0.smithi077.stdout:1/218: truncate d3/f10 7797929 0 2024-09-18T21:12:45.890 INFO:tasks.workunit.client.1.smithi103.stdout:4/260: truncate d9/d1f/f3b 1029073 0 2024-09-18T21:12:45.890 INFO:tasks.workunit.client.1.smithi103.stdout:8/250: dread d4/de/f1e [4194304,4194304] 0 2024-09-18T21:12:45.891 INFO:tasks.workunit.client.0.smithi077.stdout:1/219: chown d3/d1e/d32/f44 8 1 2024-09-18T21:12:45.892 INFO:tasks.workunit.client.1.smithi103.stdout:4/261: chown d9/d38/f45 885711458 1 2024-09-18T21:12:45.892 INFO:tasks.workunit.client.1.smithi103.stdout:4/262: stat f6 0 2024-09-18T21:12:45.894 INFO:tasks.workunit.client.0.smithi077.stdout:1/220: fdatasync d3/d8/d13/f1f 0 2024-09-18T21:12:45.895 INFO:tasks.workunit.client.0.smithi077.stdout:2/315: write d1/d4/f5f [2046525,36747] 0 2024-09-18T21:12:45.895 INFO:tasks.workunit.client.0.smithi077.stdout:1/221: chown d3/d8/d13/d18/f51 25558000 1 2024-09-18T21:12:45.895 INFO:tasks.workunit.client.1.smithi103.stdout:2/205: dread d3/d5/f4c [0,4194304] 0 2024-09-18T21:12:45.896 INFO:tasks.workunit.client.0.smithi077.stdout:4/269: truncate d3/dc/f16 1166933 0 2024-09-18T21:12:45.897 INFO:tasks.workunit.client.1.smithi103.stdout:1/267: truncate d0/d2/d9/dc/f28 77523 0 2024-09-18T21:12:45.898 INFO:tasks.workunit.client.1.smithi103.stdout:3/225: symlink d1/da/l42 0 2024-09-18T21:12:45.899 INFO:tasks.workunit.client.1.smithi103.stdout:8/251: dwrite d4/d2c/d39/f3e [4194304,4194304] 0 2024-09-18T21:12:45.899 INFO:tasks.workunit.client.1.smithi103.stdout:6/272: truncate d2/d24/f27 4730013 0 2024-09-18T21:12:45.899 INFO:tasks.workunit.client.1.smithi103.stdout:1/268: chown d0/d11/l12 83305 1 2024-09-18T21:12:45.900 INFO:tasks.workunit.client.0.smithi077.stdout:2/316: dread d1/d4/d9/d24/f55 [0,4194304] 0 2024-09-18T21:12:45.900 INFO:tasks.workunit.client.0.smithi077.stdout:0/335: dread d8/f13 [0,4194304] 0 2024-09-18T21:12:45.901 INFO:tasks.workunit.client.1.smithi103.stdout:1/269: readlink d0/le 0 2024-09-18T21:12:45.902 INFO:tasks.workunit.client.0.smithi077.stdout:0/336: write d8/f19 [1646996,121569] 0 2024-09-18T21:12:45.902 INFO:tasks.workunit.client.0.smithi077.stdout:2/317: truncate d1/d4/d9/fb 866917 0 2024-09-18T21:12:45.903 INFO:tasks.workunit.client.1.smithi103.stdout:3/226: truncate d1/f31 677336 0 2024-09-18T21:12:45.904 INFO:tasks.workunit.client.1.smithi103.stdout:9/243: symlink d18/l4a 0 2024-09-18T21:12:45.905 INFO:tasks.workunit.client.1.smithi103.stdout:1/270: chown d0/d11/d5f/d19/d4d 1614805287 1 2024-09-18T21:12:45.905 INFO:tasks.workunit.client.1.smithi103.stdout:6/273: write d2/f4a [553253,18325] 0 2024-09-18T21:12:45.908 INFO:tasks.workunit.client.1.smithi103.stdout:5/267: truncate de/d3e/f12 5172161 0 2024-09-18T21:12:45.908 INFO:tasks.workunit.client.1.smithi103.stdout:2/206: dwrite d3/d5/d2c/f3e [0,4194304] 0 2024-09-18T21:12:45.910 INFO:tasks.workunit.client.1.smithi103.stdout:6/274: write d2/d3/d8/f29 [5134912,3885] 0 2024-09-18T21:12:45.911 INFO:tasks.workunit.client.0.smithi077.stdout:0/337: dwrite d8/d1a/f51 [0,4194304] 0 2024-09-18T21:12:45.912 INFO:tasks.workunit.client.0.smithi077.stdout:0/338: chown l2 184798988 1 2024-09-18T21:12:45.912 INFO:tasks.workunit.client.1.smithi103.stdout:7/254: creat d1/df/d42/f4e x:0 0 0 2024-09-18T21:12:45.915 INFO:tasks.workunit.client.1.smithi103.stdout:4/263: creat d9/d1f/d31/f59 x:0 0 0 2024-09-18T21:12:45.916 INFO:tasks.workunit.client.1.smithi103.stdout:4/264: readlink d9/l17 0 2024-09-18T21:12:45.918 INFO:tasks.workunit.client.0.smithi077.stdout:2/318: mknod d1/c64 0 2024-09-18T21:12:45.918 INFO:tasks.workunit.client.1.smithi103.stdout:0/251: mknod d1/d9/d3e/c59 0 2024-09-18T21:12:45.918 INFO:tasks.workunit.client.1.smithi103.stdout:4/265: write d9/d1f/f44 [61872,128109] 0 2024-09-18T21:12:45.919 INFO:tasks.workunit.client.1.smithi103.stdout:0/252: write d1/d9/f2b [1029022,35106] 0 2024-09-18T21:12:45.923 INFO:tasks.workunit.client.0.smithi077.stdout:4/270: dwrite d3/fa [0,4194304] 0 2024-09-18T21:12:45.926 INFO:tasks.workunit.client.0.smithi077.stdout:4/271: fsync d3/dc/d32/f44 0 2024-09-18T21:12:45.927 INFO:tasks.workunit.client.1.smithi103.stdout:6/275: dread d2/f12 [0,4194304] 0 2024-09-18T21:12:45.927 INFO:tasks.workunit.client.0.smithi077.stdout:4/272: dread - d3/dc/d24/f4a zero size 2024-09-18T21:12:45.929 INFO:tasks.workunit.client.0.smithi077.stdout:2/319: dwrite d1/d4/d5/d1a/d2e/d41/f3f [0,4194304] 0 2024-09-18T21:12:45.931 INFO:tasks.workunit.client.0.smithi077.stdout:2/320: write d1/d4/d9/d4f/f63 [231233,38910] 0 2024-09-18T21:12:45.933 INFO:tasks.workunit.client.1.smithi103.stdout:1/271: rename d0/d11/d5f/l49 to d0/d2/d9/d10/l60 0 2024-09-18T21:12:45.934 INFO:tasks.workunit.client.1.smithi103.stdout:0/253: dwrite d1/f3f [0,4194304] 0 2024-09-18T21:12:45.935 INFO:tasks.workunit.client.1.smithi103.stdout:5/268: creat de/d2d/f56 x:0 0 0 2024-09-18T21:12:45.938 INFO:tasks.workunit.client.0.smithi077.stdout:2/321: creat d1/d4/d9/f65 x:0 0 0 2024-09-18T21:12:45.942 INFO:tasks.workunit.client.1.smithi103.stdout:7/255: truncate d1/df/d42/d29/d2f/d33/f3e 70326 0 2024-09-18T21:12:45.942 INFO:tasks.workunit.client.0.smithi077.stdout:2/322: dread d1/f39 [0,4194304] 0 2024-09-18T21:12:45.943 INFO:tasks.workunit.client.1.smithi103.stdout:3/227: rename d1/da/le to d1/d2/d18/d30/l43 0 2024-09-18T21:12:45.945 INFO:tasks.workunit.client.0.smithi077.stdout:0/339: dread d8/d1a/d39/f3c [0,4194304] 0 2024-09-18T21:12:45.946 INFO:tasks.workunit.client.0.smithi077.stdout:2/323: truncate d1/d4/d5/d1a/d2e/d41/f5d 912467 0 2024-09-18T21:12:45.946 INFO:tasks.workunit.client.0.smithi077.stdout:0/340: chown d8/f2d 6647764 1 2024-09-18T21:12:45.946 INFO:tasks.workunit.client.1.smithi103.stdout:2/207: creat d3/d5/d2f/d48/f4f x:0 0 0 2024-09-18T21:12:45.947 INFO:tasks.workunit.client.0.smithi077.stdout:2/324: dread - d1/d4/d9/f65 zero size 2024-09-18T21:12:45.947 INFO:tasks.workunit.client.1.smithi103.stdout:4/266: getdents d9/d1a/d41 0 2024-09-18T21:12:45.948 INFO:tasks.workunit.client.1.smithi103.stdout:8/252: rmdir d4/d2d/d44/d4c 0 2024-09-18T21:12:45.949 INFO:tasks.workunit.client.1.smithi103.stdout:8/253: chown d4/c52 79404 1 2024-09-18T21:12:45.949 INFO:tasks.workunit.client.1.smithi103.stdout:6/276: dread d2/f28 [0,4194304] 0 2024-09-18T21:12:45.949 INFO:tasks.workunit.client.1.smithi103.stdout:3/228: creat d1/d2/d18/f44 x:0 0 0 2024-09-18T21:12:45.950 INFO:tasks.workunit.client.0.smithi077.stdout:2/325: rmdir d1/d4/d9/d24 39 2024-09-18T21:12:45.950 INFO:tasks.workunit.client.0.smithi077.stdout:2/326: readlink d1/d4/d5/d1a/d2e/d41/l54 0 2024-09-18T21:12:45.951 INFO:tasks.workunit.client.1.smithi103.stdout:3/229: stat d1/d23/f2a 0 2024-09-18T21:12:45.952 INFO:tasks.workunit.client.1.smithi103.stdout:1/272: dread d0/d11/f35 [0,4194304] 0 2024-09-18T21:12:45.952 INFO:tasks.workunit.client.1.smithi103.stdout:5/269: mkdir de/d1f/d3b/d51/d57 0 2024-09-18T21:12:45.952 INFO:tasks.workunit.client.1.smithi103.stdout:6/277: truncate d2/d3/f55 475127 0 2024-09-18T21:12:45.953 INFO:tasks.workunit.client.0.smithi077.stdout:2/327: write d1/d4/d5/d1a/d2e/d41/d2c/f35 [2842661,99628] 0 2024-09-18T21:12:45.954 INFO:tasks.workunit.client.1.smithi103.stdout:0/254: unlink d1/d5/de/c50 0 2024-09-18T21:12:45.956 INFO:tasks.workunit.client.1.smithi103.stdout:9/244: getdents d18/d1f/d2f 0 2024-09-18T21:12:45.956 INFO:tasks.workunit.client.1.smithi103.stdout:6/278: chown d2/l3f 5895455 1 2024-09-18T21:12:45.956 INFO:tasks.workunit.client.1.smithi103.stdout:2/208: creat d3/d5/d2c/f50 x:0 0 0 2024-09-18T21:12:45.956 INFO:tasks.workunit.client.0.smithi077.stdout:2/328: mkdir d1/d4/d9/d24/d66 0 2024-09-18T21:12:45.958 INFO:tasks.workunit.client.1.smithi103.stdout:7/256: creat d1/df/d42/d29/d2f/f4f x:0 0 0 2024-09-18T21:12:45.961 INFO:tasks.workunit.client.1.smithi103.stdout:3/230: link d1/f31 d1/d2/d18/d30/f45 0 2024-09-18T21:12:45.961 INFO:tasks.workunit.client.0.smithi077.stdout:2/329: creat d1/f67 x:0 0 0 2024-09-18T21:12:45.964 INFO:tasks.workunit.client.1.smithi103.stdout:4/267: dwrite d9/d1a/d2b/f53 [0,4194304] 0 2024-09-18T21:12:45.968 INFO:tasks.workunit.client.1.smithi103.stdout:9/245: chown le 55 1 2024-09-18T21:12:45.970 INFO:tasks.workunit.client.1.smithi103.stdout:3/231: chown d1/l3 22 1 2024-09-18T21:12:45.972 INFO:tasks.workunit.client.1.smithi103.stdout:4/268: mknod d9/d2e/c5a 0 2024-09-18T21:12:45.973 INFO:tasks.workunit.client.1.smithi103.stdout:9/246: chown d18/d29/l46 30197 1 2024-09-18T21:12:45.974 INFO:tasks.workunit.client.1.smithi103.stdout:8/254: dwrite d4/d2d/f33 [0,4194304] 0 2024-09-18T21:12:45.977 INFO:tasks.workunit.client.1.smithi103.stdout:3/232: chown d1/d34 0 1 2024-09-18T21:12:45.977 INFO:tasks.workunit.client.1.smithi103.stdout:6/279: rename d2/d3/d4/f2e to d2/d3/d4/d43/f58 0 2024-09-18T21:12:45.977 INFO:tasks.workunit.client.1.smithi103.stdout:0/255: dread d1/d5/de/d19/d1e/f1f [0,4194304] 0 2024-09-18T21:12:45.977 INFO:tasks.workunit.client.1.smithi103.stdout:1/273: dwrite d0/d3/f20 [0,4194304] 0 2024-09-18T21:12:45.978 INFO:tasks.workunit.client.1.smithi103.stdout:9/247: truncate f13 4564609 0 2024-09-18T21:12:45.979 INFO:tasks.workunit.client.1.smithi103.stdout:5/270: dwrite de/d2d/f56 [0,4194304] 0 2024-09-18T21:12:45.981 INFO:tasks.workunit.client.1.smithi103.stdout:6/280: read d2/f12 [3942338,7597] 0 2024-09-18T21:12:45.981 INFO:tasks.workunit.client.0.smithi077.stdout:0/341: truncate d8/f19 1129217 0 2024-09-18T21:12:45.986 INFO:tasks.workunit.client.1.smithi103.stdout:8/255: mknod d4/d2d/d3d/c55 0 2024-09-18T21:12:45.987 INFO:tasks.workunit.client.1.smithi103.stdout:7/257: truncate d1/df/d42/d29/d2f/d33/f40 2633843 0 2024-09-18T21:12:45.990 INFO:tasks.workunit.client.0.smithi077.stdout:0/342: link d8/d1d/f68 d8/d26/f6b 0 2024-09-18T21:12:45.990 INFO:tasks.workunit.client.1.smithi103.stdout:5/271: write de/f16 [1748714,5517] 0 2024-09-18T21:12:45.992 INFO:tasks.workunit.client.1.smithi103.stdout:0/256: creat d1/d5/de/d19/d1e/d34/f5a x:0 0 0 2024-09-18T21:12:45.993 INFO:tasks.workunit.client.1.smithi103.stdout:8/256: read d4/de/f16 [4035041,31824] 0 2024-09-18T21:12:45.993 INFO:tasks.workunit.client.1.smithi103.stdout:9/248: unlink l6 0 2024-09-18T21:12:45.994 INFO:tasks.workunit.client.1.smithi103.stdout:7/258: read d1/f1b [2076781,20593] 0 2024-09-18T21:12:45.996 INFO:tasks.workunit.client.1.smithi103.stdout:4/269: dwrite d9/f11 [0,4194304] 0 2024-09-18T21:12:45.997 INFO:tasks.workunit.client.1.smithi103.stdout:3/233: link d1/d23/f2a d1/d2/d18/f46 0 2024-09-18T21:12:45.997 INFO:tasks.workunit.client.0.smithi077.stdout:2/330: truncate d1/d4/f8 4073631 0 2024-09-18T21:12:45.997 INFO:tasks.workunit.client.1.smithi103.stdout:2/209: dread d3/d5/f18 [0,4194304] 0 2024-09-18T21:12:45.998 INFO:tasks.workunit.client.1.smithi103.stdout:9/249: write f13 [3699647,3583] 0 2024-09-18T21:12:45.998 INFO:tasks.workunit.client.1.smithi103.stdout:8/257: write d4/d26/fb [352140,37852] 0 2024-09-18T21:12:45.999 INFO:tasks.workunit.client.0.smithi077.stdout:0/343: creat d8/d37/d66/f6c x:0 0 0 2024-09-18T21:12:46.001 INFO:tasks.workunit.client.1.smithi103.stdout:3/234: chown d1/f3c 780722591 1 2024-09-18T21:12:46.001 INFO:tasks.workunit.client.0.smithi077.stdout:2/331: truncate d1/d4/d5/d1a/d2e/f37 298272 0 2024-09-18T21:12:46.002 INFO:tasks.workunit.client.0.smithi077.stdout:0/344: mkdir d8/d1a/d35/d6d 0 2024-09-18T21:12:46.003 INFO:tasks.workunit.client.0.smithi077.stdout:0/345: write d8/d37/f50 [240890,128398] 0 2024-09-18T21:12:46.003 INFO:tasks.workunit.client.1.smithi103.stdout:6/281: dwrite d2/d3/d8/f29 [0,4194304] 0 2024-09-18T21:12:46.005 INFO:tasks.workunit.client.1.smithi103.stdout:2/210: dread d3/d5/f27 [0,4194304] 0 2024-09-18T21:12:46.005 INFO:tasks.workunit.client.0.smithi077.stdout:2/332: write d1/d4/d5/f3a [2753274,25764] 0 2024-09-18T21:12:46.006 INFO:tasks.workunit.client.0.smithi077.stdout:0/346: chown d8/d1d/d57/c5d 11 1 2024-09-18T21:12:46.006 INFO:tasks.workunit.client.1.smithi103.stdout:3/235: write d1/da/df/f14 [2048295,47277] 0 2024-09-18T21:12:46.006 INFO:tasks.workunit.client.1.smithi103.stdout:8/258: write d4/d2c/d39/f4f [76545,47372] 0 2024-09-18T21:12:46.008 INFO:tasks.workunit.client.0.smithi077.stdout:2/333: write d1/d4/d5/d1a/d2e/d41/d2c/f47 [4439751,57387] 0 2024-09-18T21:12:46.008 INFO:tasks.workunit.client.0.smithi077.stdout:0/347: read d8/d1a/f4b [197072,23458] 0 2024-09-18T21:12:46.009 INFO:tasks.workunit.client.0.smithi077.stdout:0/348: fsync d8/d26/f1b 0 2024-09-18T21:12:46.010 INFO:tasks.workunit.client.0.smithi077.stdout:2/334: chown d1/d4/d9/d24/d66 2001248 1 2024-09-18T21:12:46.010 INFO:tasks.workunit.client.1.smithi103.stdout:2/211: chown d3/f22 159760 1 2024-09-18T21:12:46.011 INFO:tasks.workunit.client.0.smithi077.stdout:0/349: chown d8/d1a/f51 3608 1 2024-09-18T21:12:46.013 INFO:tasks.workunit.client.1.smithi103.stdout:0/257: creat d1/d5/de/d22/f5b x:0 0 0 2024-09-18T21:12:46.013 INFO:tasks.workunit.client.1.smithi103.stdout:4/270: mknod d9/d1f/d31/c5b 0 2024-09-18T21:12:46.017 INFO:tasks.workunit.client.0.smithi077.stdout:0/350: creat d8/d1a/d39/f6e x:0 0 0 2024-09-18T21:12:46.018 INFO:tasks.workunit.client.1.smithi103.stdout:7/259: dwrite d1/f4b [0,4194304] 0 2024-09-18T21:12:46.019 INFO:tasks.workunit.client.1.smithi103.stdout:3/236: mkdir d1/d23/d47 0 2024-09-18T21:12:46.020 INFO:tasks.workunit.client.0.smithi077.stdout:2/335: rmdir d1/d4/d5/d1a/d2e/d40 39 2024-09-18T21:12:46.020 INFO:tasks.workunit.client.1.smithi103.stdout:0/258: write d1/d5/d4c/f53 [2535500,75272] 0 2024-09-18T21:12:46.022 INFO:tasks.workunit.client.0.smithi077.stdout:2/336: write d1/d4/d5/d1a/d2e/d41/d2c/f35 [2068571,27049] 0 2024-09-18T21:12:46.030 INFO:tasks.workunit.client.0.smithi077.stdout:0/351: dwrite d8/f13 [0,4194304] 0 2024-09-18T21:12:46.035 INFO:tasks.workunit.client.0.smithi077.stdout:2/337: creat d1/d4/d5/d1a/d2e/d41/f68 x:0 0 0 2024-09-18T21:12:46.037 INFO:tasks.workunit.client.0.smithi077.stdout:0/352: dread d8/d26/f18 [0,4194304] 0 2024-09-18T21:12:46.037 INFO:tasks.workunit.client.0.smithi077.stdout:0/353: chown d8/d1a/d39/f3c 2 1 2024-09-18T21:12:46.039 INFO:tasks.workunit.client.0.smithi077.stdout:2/338: mkdir d1/d4/d5/d1a/d2e/d40/d69 0 2024-09-18T21:12:46.041 INFO:tasks.workunit.client.0.smithi077.stdout:0/354: creat d8/d37/f6f x:0 0 0 2024-09-18T21:12:46.042 INFO:tasks.workunit.client.0.smithi077.stdout:2/339: mkdir d1/d4/d5/d1a/d49/d6a 0 2024-09-18T21:12:46.043 INFO:tasks.workunit.client.0.smithi077.stdout:0/355: mkdir d8/d1a/d39/d3b/d70 0 2024-09-18T21:12:46.044 INFO:tasks.workunit.client.0.smithi077.stdout:2/340: fdatasync d1/d4/d5/d1a/d2e/d40/f44 0 2024-09-18T21:12:46.054 INFO:tasks.workunit.client.0.smithi077.stdout:0/356: getdents d8/d37 0 2024-09-18T21:12:46.060 INFO:tasks.workunit.client.0.smithi077.stdout:0/357: dwrite d8/d37/f63 [0,4194304] 0 2024-09-18T21:12:46.060 INFO:tasks.workunit.client.0.smithi077.stdout:9/170: sync 2024-09-18T21:12:46.061 INFO:tasks.workunit.client.0.smithi077.stdout:0/358: write d8/d26/f54 [778453,97740] 0 2024-09-18T21:12:46.061 INFO:tasks.workunit.client.0.smithi077.stdout:2/341: dread d1/d4/f8 [0,4194304] 0 2024-09-18T21:12:46.068 INFO:tasks.workunit.client.1.smithi103.stdout:4/271: creat d9/d1f/f5c x:0 0 0 2024-09-18T21:12:46.068 INFO:tasks.workunit.client.1.smithi103.stdout:7/260: chown d1/df/d42/c46 7463 1 2024-09-18T21:12:46.069 INFO:tasks.workunit.client.0.smithi077.stdout:2/342: dwrite d1/d4/d5/f53 [0,4194304] 0 2024-09-18T21:12:46.069 INFO:tasks.workunit.client.1.smithi103.stdout:9/250: getdents d18/d1f/d2f 0 2024-09-18T21:12:46.070 INFO:tasks.workunit.client.1.smithi103.stdout:3/237: write d1/d2/d18/d30/f3f [669232,129098] 0 2024-09-18T21:12:46.070 INFO:tasks.workunit.client.0.smithi077.stdout:2/343: fdatasync d1/f39 0 2024-09-18T21:12:46.073 INFO:tasks.workunit.client.1.smithi103.stdout:8/259: dwrite d4/d2d/f33 [0,4194304] 0 2024-09-18T21:12:46.074 INFO:tasks.workunit.client.1.smithi103.stdout:1/274: dread d0/d11/f2d [0,4194304] 0 2024-09-18T21:12:46.076 INFO:tasks.workunit.client.1.smithi103.stdout:6/282: truncate d2/d3/d8/f20 1598208 0 2024-09-18T21:12:46.079 INFO:tasks.workunit.client.0.smithi077.stdout:2/344: dwrite d1/d4/f2f [4194304,4194304] 0 2024-09-18T21:12:46.080 INFO:tasks.workunit.client.1.smithi103.stdout:6/283: write d2/f34 [3017532,86628] 0 2024-09-18T21:12:46.081 INFO:tasks.workunit.client.0.smithi077.stdout:9/171: write d1/dd/d1a/f23 [1346023,92082] 0 2024-09-18T21:12:46.083 INFO:tasks.workunit.client.1.smithi103.stdout:4/272: creat d9/d38/f5d x:0 0 0 2024-09-18T21:12:46.084 INFO:tasks.workunit.client.1.smithi103.stdout:9/251: creat d18/d29/f4b x:0 0 0 2024-09-18T21:12:46.085 INFO:tasks.workunit.client.0.smithi077.stdout:2/345: mknod d1/d4/d5/d1a/d49/d6a/c6b 0 2024-09-18T21:12:46.085 INFO:tasks.workunit.client.1.smithi103.stdout:8/260: unlink d4/d2c/d39/f3e 0 2024-09-18T21:12:46.088 INFO:tasks.workunit.client.1.smithi103.stdout:5/272: dwrite de/d14/f39 [0,4194304] 0 2024-09-18T21:12:46.088 INFO:tasks.workunit.client.1.smithi103.stdout:8/261: chown d4/d26/fb 684929628 1 2024-09-18T21:12:46.089 INFO:tasks.workunit.client.0.smithi077.stdout:9/172: getdents d1/dd/d11/d15 0 2024-09-18T21:12:46.090 INFO:tasks.workunit.client.0.smithi077.stdout:0/359: dwrite d8/d1a/d35/f4d [0,4194304] 0 2024-09-18T21:12:46.091 INFO:tasks.workunit.client.1.smithi103.stdout:1/275: rename d0/d3/f1a to d0/d2/d9/dc/f61 0 2024-09-18T21:12:46.091 INFO:tasks.workunit.client.1.smithi103.stdout:8/262: write d4/d2d/f33 [2893040,93180] 0 2024-09-18T21:12:46.091 INFO:tasks.workunit.client.0.smithi077.stdout:9/173: read d1/dd/f1f [453406,23634] 0 2024-09-18T21:12:46.091 INFO:tasks.workunit.client.1.smithi103.stdout:8/263: readlink d4/d26/l47 0 2024-09-18T21:12:46.093 INFO:tasks.workunit.client.1.smithi103.stdout:3/238: dread d1/da/f15 [0,4194304] 0 2024-09-18T21:12:46.094 INFO:tasks.workunit.client.1.smithi103.stdout:9/252: rmdir d18 39 2024-09-18T21:12:46.096 INFO:tasks.workunit.client.1.smithi103.stdout:6/284: creat d2/d3/d8/f59 x:0 0 0 2024-09-18T21:12:46.130 INFO:tasks.workunit.client.1.smithi103.stdout:1/276: rename d0/d2/d2b/c57 to d0/d2/d9/dc/d36/d52/c62 0 2024-09-18T21:12:46.130 INFO:tasks.workunit.client.1.smithi103.stdout:3/239: rmdir d1/d23/d25 39 2024-09-18T21:12:46.130 INFO:tasks.workunit.client.1.smithi103.stdout:7/261: write d1/df/f18 [2797915,9189] 0 2024-09-18T21:12:46.130 INFO:tasks.workunit.client.1.smithi103.stdout:0/259: dwrite d1/f12 [0,4194304] 0 2024-09-18T21:12:46.132 INFO:tasks.workunit.client.1.smithi103.stdout:4/273: creat d9/d38/d58/f5e x:0 0 0 2024-09-18T21:12:46.135 INFO:tasks.workunit.client.1.smithi103.stdout:0/260: creat d1/d9/f5c x:0 0 0 2024-09-18T21:12:46.135 INFO:tasks.workunit.client.1.smithi103.stdout:9/253: dread - d18/f3c zero size 2024-09-18T21:12:46.136 INFO:tasks.workunit.client.1.smithi103.stdout:7/262: truncate d1/df/d42/f45 162831 0 2024-09-18T21:12:46.137 INFO:tasks.workunit.client.1.smithi103.stdout:3/240: rmdir d1/d34 39 2024-09-18T21:12:46.139 INFO:tasks.workunit.client.1.smithi103.stdout:1/277: fsync d0/d2/d9/dc/f15 0 2024-09-18T21:12:46.140 INFO:tasks.workunit.client.1.smithi103.stdout:6/285: dread d2/d3/d8/f2a [0,4194304] 0 2024-09-18T21:12:46.142 INFO:tasks.workunit.client.1.smithi103.stdout:3/241: symlink d1/da/df/l48 0 2024-09-18T21:12:46.144 INFO:tasks.workunit.client.1.smithi103.stdout:4/274: creat d9/d1a/d41/f5f x:0 0 0 2024-09-18T21:12:46.145 INFO:tasks.workunit.client.1.smithi103.stdout:3/242: dread d1/d2/f8 [0,4194304] 0 2024-09-18T21:12:46.145 INFO:tasks.workunit.client.1.smithi103.stdout:9/254: symlink d18/d1f/l4c 0 2024-09-18T21:12:46.147 INFO:tasks.workunit.client.1.smithi103.stdout:6/286: fsync d2/d3/d8/df/f11 0 2024-09-18T21:12:46.148 INFO:tasks.workunit.client.1.smithi103.stdout:4/275: symlink d9/d1a/d2b/d48/l60 0 2024-09-18T21:12:46.150 INFO:tasks.workunit.client.1.smithi103.stdout:9/255: creat d18/d29/f4d x:0 0 0 2024-09-18T21:12:46.150 INFO:tasks.workunit.client.1.smithi103.stdout:6/287: chown d2/f34 1 1 2024-09-18T21:12:46.150 INFO:tasks.workunit.client.1.smithi103.stdout:3/243: mknod d1/d2/d18/d30/c49 0 2024-09-18T21:12:46.151 INFO:tasks.workunit.client.1.smithi103.stdout:0/261: getdents d1/d5 0 2024-09-18T21:12:46.151 INFO:tasks.workunit.client.1.smithi103.stdout:7/263: getdents d1/df/d42/d29/d48 0 2024-09-18T21:12:46.152 INFO:tasks.workunit.client.1.smithi103.stdout:1/278: truncate d0/ff 674882 0 2024-09-18T21:12:46.168 INFO:tasks.workunit.client.1.smithi103.stdout:2/212: sync 2024-09-18T21:12:46.174 INFO:tasks.workunit.client.1.smithi103.stdout:9/256: write d18/d1f/d2f/f41 [690612,29006] 0 2024-09-18T21:12:46.174 INFO:tasks.workunit.client.1.smithi103.stdout:8/264: dwrite d4/d26/f25 [0,4194304] 0 2024-09-18T21:12:46.175 INFO:tasks.workunit.client.1.smithi103.stdout:3/244: write d1/d2/d18/d30/f3f [634190,117142] 0 2024-09-18T21:12:46.175 INFO:tasks.workunit.client.1.smithi103.stdout:0/262: mknod d1/d5/d4c/d4e/c5d 0 2024-09-18T21:12:46.176 INFO:tasks.workunit.client.1.smithi103.stdout:1/279: dread - d0/d3/f4c zero size 2024-09-18T21:12:46.177 INFO:tasks.workunit.client.1.smithi103.stdout:6/288: rename d2/d3/d8/df to d2/d24/d5a 0 2024-09-18T21:12:46.180 INFO:tasks.workunit.client.1.smithi103.stdout:8/265: mkdir d4/d26/d56 0 2024-09-18T21:12:46.182 INFO:tasks.workunit.client.1.smithi103.stdout:3/245: dread - d1/d2/d18/f44 zero size 2024-09-18T21:12:46.183 INFO:tasks.workunit.client.1.smithi103.stdout:9/257: write d18/f1a [5779418,75741] 0 2024-09-18T21:12:46.184 INFO:tasks.workunit.client.1.smithi103.stdout:0/263: mknod d1/d5/de/d19/d1e/c5e 0 2024-09-18T21:12:46.184 INFO:tasks.workunit.client.1.smithi103.stdout:8/266: chown d4/d2c/l51 126 1 2024-09-18T21:12:46.187 INFO:tasks.workunit.client.1.smithi103.stdout:7/264: creat d1/df/d42/d1f/d2e/f50 x:0 0 0 2024-09-18T21:12:46.189 INFO:tasks.workunit.client.1.smithi103.stdout:0/264: stat d1/d5/de/d24/l35 0 2024-09-18T21:12:46.189 INFO:tasks.workunit.client.0.smithi077.stdout:9/174: write d1/df/f1e [5083142,63924] 0 2024-09-18T21:12:46.190 INFO:tasks.workunit.client.1.smithi103.stdout:9/258: creat d18/d1f/d2f/f4e x:0 0 0 2024-09-18T21:12:46.192 INFO:tasks.workunit.client.1.smithi103.stdout:2/213: dwrite d3/f1e [0,4194304] 0 2024-09-18T21:12:46.193 INFO:tasks.workunit.client.0.smithi077.stdout:0/360: dwrite d8/d37/f3f [0,4194304] 0 2024-09-18T21:12:46.194 INFO:tasks.workunit.client.1.smithi103.stdout:8/267: mkdir d4/d2c/d39/d57 0 2024-09-18T21:12:46.195 INFO:tasks.workunit.client.0.smithi077.stdout:2/346: dwrite d1/d4/d9/f1e [0,4194304] 0 2024-09-18T21:12:46.197 INFO:tasks.workunit.client.0.smithi077.stdout:0/361: write d8/d1a/d39/d3b/d4e/d58/f5e [2901323,48651] 0 2024-09-18T21:12:46.199 INFO:tasks.workunit.client.1.smithi103.stdout:9/259: write d18/d1f/f28 [542010,46790] 0 2024-09-18T21:12:46.199 INFO:tasks.workunit.client.1.smithi103.stdout:7/265: mkdir d1/df/d42/d29/d2f/d33/d51 0 2024-09-18T21:12:46.200 INFO:tasks.workunit.client.1.smithi103.stdout:2/214: fdatasync d3/d5/f28 0 2024-09-18T21:12:46.203 INFO:tasks.workunit.client.0.smithi077.stdout:9/175: truncate d1/df/f18 3062477 0 2024-09-18T21:12:46.204 INFO:tasks.workunit.client.1.smithi103.stdout:9/260: readlink d18/d29/l2c 0 2024-09-18T21:12:46.205 INFO:tasks.workunit.client.1.smithi103.stdout:0/265: creat d1/d5/de/d19/d1e/f5f x:0 0 0 2024-09-18T21:12:46.206 INFO:tasks.workunit.client.1.smithi103.stdout:6/289: dwrite d2/d3/d8/f10 [4194304,4194304] 0 2024-09-18T21:12:46.206 INFO:tasks.workunit.client.0.smithi077.stdout:0/362: creat d8/d1a/d39/d3b/d70/f71 x:0 0 0 2024-09-18T21:12:46.208 INFO:tasks.workunit.client.0.smithi077.stdout:2/347: dwrite d1/d4/d5/d1a/d2e/d40/f44 [4194304,4194304] 0 2024-09-18T21:12:46.208 INFO:tasks.workunit.client.1.smithi103.stdout:1/280: truncate d0/d2/d9/dc/f22 746478 0 2024-09-18T21:12:46.210 INFO:tasks.workunit.client.0.smithi077.stdout:9/176: mkdir d1/dd/d11/d1c/d38 0 2024-09-18T21:12:46.211 INFO:tasks.workunit.client.0.smithi077.stdout:9/177: chown d1/f16 837 1 2024-09-18T21:12:46.211 INFO:tasks.workunit.client.1.smithi103.stdout:3/246: dwrite d1/da/f3d [0,4194304] 0 2024-09-18T21:12:46.213 INFO:tasks.workunit.client.1.smithi103.stdout:9/261: creat d18/d1f/d2f/f4f x:0 0 0 2024-09-18T21:12:46.213 INFO:tasks.workunit.client.1.smithi103.stdout:3/247: fsync d1/d2/d18/f2f 0 2024-09-18T21:12:46.214 INFO:tasks.workunit.client.1.smithi103.stdout:0/266: truncate d1/d5/de/d19/d1e/f1f 1169558 0 2024-09-18T21:12:46.215 INFO:tasks.workunit.client.0.smithi077.stdout:0/363: mknod d8/d1a/d35/d6d/c72 0 2024-09-18T21:12:46.216 INFO:tasks.workunit.client.1.smithi103.stdout:9/262: dread - d18/d1f/d2f/f4f zero size 2024-09-18T21:12:46.218 INFO:tasks.workunit.client.1.smithi103.stdout:2/215: unlink d3/c3d 0 2024-09-18T21:12:46.219 INFO:tasks.workunit.client.0.smithi077.stdout:2/348: dwrite d1/d4/d5/d1a/f4a [0,4194304] 0 2024-09-18T21:12:46.221 INFO:tasks.workunit.client.1.smithi103.stdout:9/263: read f13 [3514720,63089] 0 2024-09-18T21:12:46.223 INFO:tasks.workunit.client.1.smithi103.stdout:6/290: rmdir d2/d3/d4 39 2024-09-18T21:12:46.223 INFO:tasks.workunit.client.0.smithi077.stdout:0/364: symlink d8/d37/d66/l73 0 2024-09-18T21:12:46.225 INFO:tasks.workunit.client.1.smithi103.stdout:3/248: dwrite d1/f3c [0,4194304] 0 2024-09-18T21:12:46.226 INFO:tasks.workunit.client.1.smithi103.stdout:3/249: readlink d1/da/ld 0 2024-09-18T21:12:46.228 INFO:tasks.workunit.client.0.smithi077.stdout:9/178: dwrite d1/df/f21 [0,4194304] 0 2024-09-18T21:12:46.228 INFO:tasks.workunit.client.0.smithi077.stdout:7/352: sync 2024-09-18T21:12:46.228 INFO:tasks.workunit.client.0.smithi077.stdout:6/296: sync 2024-09-18T21:12:46.229 INFO:tasks.workunit.client.0.smithi077.stdout:7/353: fsync d12/d22/f63 0 2024-09-18T21:12:46.230 INFO:tasks.workunit.client.1.smithi103.stdout:5/273: sync 2024-09-18T21:12:46.233 INFO:tasks.workunit.client.1.smithi103.stdout:8/268: rmdir d4/d2c/d39/d57 0 2024-09-18T21:12:46.234 INFO:tasks.workunit.client.1.smithi103.stdout:8/269: chown d4/c52 39 1 2024-09-18T21:12:46.236 INFO:tasks.workunit.client.1.smithi103.stdout:8/270: dread d4/d26/f1d [0,4194304] 0 2024-09-18T21:12:46.237 INFO:tasks.workunit.client.1.smithi103.stdout:8/271: chown d4/de/f1c 329863735 1 2024-09-18T21:12:46.239 INFO:tasks.workunit.client.1.smithi103.stdout:2/216: stat d3/d5/d2f/d32/c4b 0 2024-09-18T21:12:46.240 INFO:tasks.workunit.client.1.smithi103.stdout:2/217: write d3/d5/f18 [420631,8454] 0 2024-09-18T21:12:46.243 INFO:tasks.workunit.client.1.smithi103.stdout:2/218: stat d3/d5/d2f/d32/d46 0 2024-09-18T21:12:46.244 INFO:tasks.workunit.client.0.smithi077.stdout:6/297: mknod d7/df/d11/d1d/d49/c60 0 2024-09-18T21:12:46.245 INFO:tasks.workunit.client.1.smithi103.stdout:2/219: write d3/d5/fe [5054068,130706] 0 2024-09-18T21:12:46.247 INFO:tasks.workunit.client.0.smithi077.stdout:2/349: getdents d1/d4/d9/d4f 0 2024-09-18T21:12:46.247 INFO:tasks.workunit.client.1.smithi103.stdout:2/220: write d3/ff [1608237,42245] 0 2024-09-18T21:12:46.247 INFO:tasks.workunit.client.1.smithi103.stdout:7/266: dwrite d1/f1b [0,4194304] 0 2024-09-18T21:12:46.249 INFO:tasks.workunit.client.1.smithi103.stdout:5/274: mkdir de/d1f/d3b/d58 0 2024-09-18T21:12:46.249 INFO:tasks.workunit.client.1.smithi103.stdout:7/267: write d1/f4b [1314991,123243] 0 2024-09-18T21:12:46.250 INFO:tasks.workunit.client.0.smithi077.stdout:0/365: getdents d8/d1a/d35 0 2024-09-18T21:12:46.253 INFO:tasks.workunit.client.0.smithi077.stdout:6/298: symlink d7/df/d11/d1d/d4c/l61 0 2024-09-18T21:12:46.253 INFO:tasks.workunit.client.1.smithi103.stdout:9/264: rename d18/f20 to d18/d1f/d2f/f50 0 2024-09-18T21:12:46.255 INFO:tasks.workunit.client.0.smithi077.stdout:0/366: creat d8/d1d/f74 x:0 0 0 2024-09-18T21:12:46.257 INFO:tasks.workunit.client.1.smithi103.stdout:3/250: symlink d1/d23/l4a 0 2024-09-18T21:12:46.258 INFO:tasks.workunit.client.0.smithi077.stdout:6/299: dread d7/df/f28 [0,4194304] 0 2024-09-18T21:12:46.258 INFO:tasks.workunit.client.1.smithi103.stdout:3/251: write d1/f13 [2593199,1806] 0 2024-09-18T21:12:46.259 INFO:tasks.workunit.client.1.smithi103.stdout:6/291: write d2/d24/d5a/f11 [1271234,70435] 0 2024-09-18T21:12:46.259 INFO:tasks.workunit.client.0.smithi077.stdout:6/300: dread - d7/df/f58 zero size 2024-09-18T21:12:46.260 INFO:tasks.workunit.client.0.smithi077.stdout:0/367: creat d8/d26/f75 x:0 0 0 2024-09-18T21:12:46.261 INFO:tasks.workunit.client.1.smithi103.stdout:4/276: sync 2024-09-18T21:12:46.262 INFO:tasks.workunit.client.0.smithi077.stdout:9/179: dwrite d1/fb [0,4194304] 0 2024-09-18T21:12:46.263 INFO:tasks.workunit.client.0.smithi077.stdout:2/350: creat d1/d4/d5/d1a/f6c x:0 0 0 2024-09-18T21:12:46.264 INFO:tasks.workunit.client.0.smithi077.stdout:2/351: chown d1/d4/d9/fb 281 1 2024-09-18T21:12:46.267 INFO:tasks.workunit.client.1.smithi103.stdout:6/292: dwrite d2/d3/d8/f29 [4194304,4194304] 0 2024-09-18T21:12:46.268 INFO:tasks.workunit.client.0.smithi077.stdout:6/301: mknod d7/df/c62 0 2024-09-18T21:12:46.269 INFO:tasks.workunit.client.0.smithi077.stdout:6/302: truncate d7/f2d 4376735 0 2024-09-18T21:12:46.269 INFO:tasks.workunit.client.1.smithi103.stdout:1/281: getdents d0/d2/d2b 0 2024-09-18T21:12:46.270 INFO:tasks.workunit.client.0.smithi077.stdout:6/303: stat d7/df/d11/d1d/d4c/l61 0 2024-09-18T21:12:46.270 INFO:tasks.workunit.client.0.smithi077.stdout:0/368: mknod d8/d1d/c76 0 2024-09-18T21:12:46.272 INFO:tasks.workunit.client.0.smithi077.stdout:9/180: fsync d1/f16 0 2024-09-18T21:12:46.273 INFO:tasks.workunit.client.1.smithi103.stdout:6/293: write d2/d3/f55 [1485392,19037] 0 2024-09-18T21:12:46.273 INFO:tasks.workunit.client.1.smithi103.stdout:9/265: readlink ld 0 2024-09-18T21:12:46.273 INFO:tasks.workunit.client.1.smithi103.stdout:4/277: dwrite d9/d1a/d2b/f35 [0,4194304] 0 2024-09-18T21:12:46.273 INFO:tasks.workunit.client.1.smithi103.stdout:9/266: fdatasync d18/d1f/f28 0 2024-09-18T21:12:46.275 INFO:tasks.workunit.client.1.smithi103.stdout:6/294: write d2/d3/d8/f29 [1602405,69695] 0 2024-09-18T21:12:46.276 INFO:tasks.workunit.client.1.smithi103.stdout:8/272: rename d4/d2c/l50 to d4/d2d/d3d/l58 0 2024-09-18T21:12:46.276 INFO:tasks.workunit.client.1.smithi103.stdout:4/278: chown d9/d1a/d21/f57 457467436 1 2024-09-18T21:12:46.276 INFO:tasks.workunit.client.0.smithi077.stdout:0/369: symlink d8/d1a/l77 0 2024-09-18T21:12:46.277 INFO:tasks.workunit.client.0.smithi077.stdout:6/304: dwrite d7/f1f [0,4194304] 0 2024-09-18T21:12:46.280 INFO:tasks.workunit.client.1.smithi103.stdout:3/252: creat d1/d2/f4b x:0 0 0 2024-09-18T21:12:46.281 INFO:tasks.workunit.client.1.smithi103.stdout:5/275: mkdir de/d1f/d3b/d51/d57/d59 0 2024-09-18T21:12:46.283 INFO:tasks.workunit.client.1.smithi103.stdout:0/267: getdents d1/d5/d4c/d4e 0 2024-09-18T21:12:46.283 INFO:tasks.workunit.client.1.smithi103.stdout:0/268: chown d1 0 1 2024-09-18T21:12:46.284 INFO:tasks.workunit.client.0.smithi077.stdout:2/352: creat d1/d4/d5/d1a/f6d x:0 0 0 2024-09-18T21:12:46.284 INFO:tasks.workunit.client.0.smithi077.stdout:2/353: chown d1/f1c 97157 1 2024-09-18T21:12:46.285 INFO:tasks.workunit.client.1.smithi103.stdout:7/268: mkdir d1/df/d43/d52 0 2024-09-18T21:12:46.285 INFO:tasks.workunit.client.1.smithi103.stdout:4/279: dwrite d9/d1a/d2b/f53 [4194304,4194304] 0 2024-09-18T21:12:46.285 INFO:tasks.workunit.client.0.smithi077.stdout:6/305: mknod d7/df/d11/c63 0 2024-09-18T21:12:46.285 INFO:tasks.workunit.client.1.smithi103.stdout:7/269: readlink d1/df/l2a 0 2024-09-18T21:12:46.286 INFO:tasks.workunit.client.0.smithi077.stdout:6/306: read - d7/df/d11/d1d/f5d zero size 2024-09-18T21:12:46.286 INFO:tasks.workunit.client.0.smithi077.stdout:2/354: symlink d1/d4/d5/d1a/d2e/d40/l6e 0 2024-09-18T21:12:46.287 INFO:tasks.workunit.client.0.smithi077.stdout:2/355: chown d1/d4/f22 138 1 2024-09-18T21:12:46.288 INFO:tasks.workunit.client.0.smithi077.stdout:2/356: readlink d1/d4/d5/d1a/l36 0 2024-09-18T21:12:46.291 INFO:tasks.workunit.client.0.smithi077.stdout:6/307: dread d7/df/d11/d1d/d50/f5f [0,4194304] 0 2024-09-18T21:12:46.291 INFO:tasks.workunit.client.0.smithi077.stdout:6/308: chown d7/df/f2a 72057436 1 2024-09-18T21:12:46.293 INFO:tasks.workunit.client.0.smithi077.stdout:2/357: creat d1/d4/d9/d24/d66/f6f x:0 0 0 2024-09-18T21:12:46.294 INFO:tasks.workunit.client.1.smithi103.stdout:0/269: mknod d1/d5/d4c/d4e/c60 0 2024-09-18T21:12:46.294 INFO:tasks.workunit.client.1.smithi103.stdout:4/280: mkdir d9/d2e/d61 0 2024-09-18T21:12:46.296 INFO:tasks.workunit.client.0.smithi077.stdout:2/358: unlink d1/d4/d5/d1a/d2e/d41/l54 0 2024-09-18T21:12:46.298 INFO:tasks.workunit.client.0.smithi077.stdout:6/309: mknod d7/df/d11/d1d/d5c/c64 0 2024-09-18T21:12:46.300 INFO:tasks.workunit.client.0.smithi077.stdout:2/359: dread d1/d4/d5/d1a/d2e/f43 [0,4194304] 0 2024-09-18T21:12:46.301 INFO:tasks.workunit.client.0.smithi077.stdout:2/360: fdatasync d1/d4/d9/f65 0 2024-09-18T21:12:46.301 INFO:tasks.workunit.client.1.smithi103.stdout:4/281: dwrite d9/d1f/f5c [0,4194304] 0 2024-09-18T21:12:46.302 INFO:tasks.workunit.client.0.smithi077.stdout:2/361: write d1/f39 [4271152,104760] 0 2024-09-18T21:12:46.316 INFO:tasks.workunit.client.0.smithi077.stdout:6/310: creat d7/df/d11/d3e/f65 x:0 0 0 2024-09-18T21:12:46.317 INFO:tasks.workunit.client.0.smithi077.stdout:6/311: truncate d7/df/d11/d1d/f2e 4520381 0 2024-09-18T21:12:46.322 INFO:tasks.workunit.client.1.smithi103.stdout:6/295: dread d2/d24/d5a/f17 [0,4194304] 0 2024-09-18T21:12:46.323 INFO:tasks.workunit.client.1.smithi103.stdout:3/253: dread d1/da/df/f14 [0,4194304] 0 2024-09-18T21:12:46.326 INFO:tasks.workunit.client.1.smithi103.stdout:9/267: dread d18/d1f/d2f/f50 [0,4194304] 0 2024-09-18T21:12:46.328 INFO:tasks.workunit.client.1.smithi103.stdout:6/296: dread d2/d3/f2f [4194304,4194304] 0 2024-09-18T21:12:46.332 INFO:tasks.workunit.client.1.smithi103.stdout:1/282: creat d0/d2/d9/f63 x:0 0 0 2024-09-18T21:12:46.337 INFO:tasks.workunit.client.1.smithi103.stdout:4/282: symlink d9/d1a/d41/l62 0 2024-09-18T21:12:46.338 INFO:tasks.workunit.client.1.smithi103.stdout:2/221: fdatasync d3/f1b 0 2024-09-18T21:12:46.339 INFO:tasks.workunit.client.0.smithi077.stdout:0/370: dwrite d8/d1d/f68 [0,4194304] 0 2024-09-18T21:12:46.343 INFO:tasks.workunit.client.1.smithi103.stdout:8/273: write d4/de/f1e [2650824,33882] 0 2024-09-18T21:12:46.343 INFO:tasks.workunit.client.1.smithi103.stdout:9/268: fdatasync ff 0 2024-09-18T21:12:46.344 INFO:tasks.workunit.client.1.smithi103.stdout:8/274: fdatasync d4/ff 0 2024-09-18T21:12:46.346 INFO:tasks.workunit.client.1.smithi103.stdout:8/275: dread - d4/de/f46 zero size 2024-09-18T21:12:46.347 INFO:tasks.workunit.client.1.smithi103.stdout:8/276: chown d4/d26/l2a 3082370 1 2024-09-18T21:12:46.349 INFO:tasks.workunit.client.1.smithi103.stdout:8/277: chown d4/de/f3b 2 1 2024-09-18T21:12:46.350 INFO:tasks.workunit.client.1.smithi103.stdout:4/283: unlink d9/d1a/f24 0 2024-09-18T21:12:46.351 INFO:tasks.workunit.client.1.smithi103.stdout:4/284: chown d9/d38/f5d 34990 1 2024-09-18T21:12:46.354 INFO:tasks.workunit.client.1.smithi103.stdout:9/269: symlink d18/d1f/d2f/l51 0 2024-09-18T21:12:46.355 INFO:tasks.workunit.client.1.smithi103.stdout:9/270: dread - d18/d29/f44 zero size 2024-09-18T21:12:46.357 INFO:tasks.workunit.client.1.smithi103.stdout:7/270: getdents d1/df/d42/d1f 0 2024-09-18T21:12:46.359 INFO:tasks.workunit.client.1.smithi103.stdout:2/222: mknod d3/d5/d4a/c51 0 2024-09-18T21:12:46.360 INFO:tasks.workunit.client.1.smithi103.stdout:4/285: dwrite d9/f11 [0,4194304] 0 2024-09-18T21:12:46.361 INFO:tasks.workunit.client.1.smithi103.stdout:1/283: link d0/d11/d5f/c46 d0/d11/c64 0 2024-09-18T21:12:46.365 INFO:tasks.workunit.client.1.smithi103.stdout:3/254: getdents d1 0 2024-09-18T21:12:46.365 INFO:tasks.workunit.client.1.smithi103.stdout:4/286: readlink d9/d1f/d31/l43 0 2024-09-18T21:12:46.366 INFO:tasks.workunit.client.1.smithi103.stdout:9/271: chown d18/c48 29478 1 2024-09-18T21:12:46.371 INFO:tasks.workunit.client.1.smithi103.stdout:4/287: rmdir d9/d38 39 2024-09-18T21:12:46.373 INFO:tasks.workunit.client.1.smithi103.stdout:3/255: rmdir d1/d2/d18/d30 39 2024-09-18T21:12:46.378 INFO:tasks.workunit.client.1.smithi103.stdout:1/284: truncate d0/d11/d5f/d19/f34 381171 0 2024-09-18T21:12:46.379 INFO:tasks.workunit.client.1.smithi103.stdout:5/276: sync 2024-09-18T21:12:46.380 INFO:tasks.workunit.client.1.smithi103.stdout:3/256: unlink d1/d2/d18/l35 0 2024-09-18T21:12:46.385 INFO:tasks.workunit.client.0.smithi077.stdout:6/312: write d7/df/f15 [5367474,126458] 0 2024-09-18T21:12:46.385 INFO:tasks.workunit.client.1.smithi103.stdout:5/277: mknod de/d1f/c5a 0 2024-09-18T21:12:46.386 INFO:tasks.workunit.client.0.smithi077.stdout:6/313: write d7/fc [63180,54558] 0 2024-09-18T21:12:46.386 INFO:tasks.workunit.client.0.smithi077.stdout:5/374: sync 2024-09-18T21:12:46.386 INFO:tasks.workunit.client.0.smithi077.stdout:3/241: sync 2024-09-18T21:12:46.388 INFO:tasks.workunit.client.1.smithi103.stdout:1/285: creat d0/d2/d9/f65 x:0 0 0 2024-09-18T21:12:46.389 INFO:tasks.workunit.client.0.smithi077.stdout:6/314: symlink d7/df/d11/d1d/d31/l66 0 2024-09-18T21:12:46.390 INFO:tasks.workunit.client.0.smithi077.stdout:6/315: readlink d7/df/d11/l24 0 2024-09-18T21:12:46.390 INFO:tasks.workunit.client.0.smithi077.stdout:3/242: symlink db/d14/d22/d36/d42/l4b 0 2024-09-18T21:12:46.393 INFO:tasks.workunit.client.0.smithi077.stdout:6/316: symlink d7/df/d11/d25/l67 0 2024-09-18T21:12:46.393 INFO:tasks.workunit.client.1.smithi103.stdout:7/271: dread d1/f15 [4194304,4194304] 0 2024-09-18T21:12:46.395 INFO:tasks.workunit.client.1.smithi103.stdout:2/223: dread d3/ff [0,4194304] 0 2024-09-18T21:12:46.396 INFO:tasks.workunit.client.1.smithi103.stdout:0/270: dwrite d1/fd [0,4194304] 0 2024-09-18T21:12:46.396 INFO:tasks.workunit.client.1.smithi103.stdout:8/278: dread d4/ff [0,4194304] 0 2024-09-18T21:12:46.396 INFO:tasks.workunit.client.1.smithi103.stdout:5/278: unlink de/d14/c1d 0 2024-09-18T21:12:46.397 INFO:tasks.workunit.client.1.smithi103.stdout:1/286: write d0/d2/d9/d10/f44 [1008129,92983] 0 2024-09-18T21:12:46.398 INFO:tasks.workunit.client.1.smithi103.stdout:5/279: write de/d14/f39 [1157901,56381] 0 2024-09-18T21:12:46.399 INFO:tasks.workunit.client.0.smithi077.stdout:6/317: dwrite d7/df/d11/f56 [0,4194304] 0 2024-09-18T21:12:46.400 INFO:tasks.workunit.client.1.smithi103.stdout:1/287: fsync d0/d2/f3d 0 2024-09-18T21:12:46.403 INFO:tasks.workunit.client.1.smithi103.stdout:4/288: dread d9/fa [0,4194304] 0 2024-09-18T21:12:46.403 INFO:tasks.workunit.client.1.smithi103.stdout:8/279: unlink d4/d2c/f36 0 2024-09-18T21:12:46.405 INFO:tasks.workunit.client.1.smithi103.stdout:1/288: dread d0/d2/d9/dc/f28 [0,4194304] 0 2024-09-18T21:12:46.408 INFO:tasks.workunit.client.1.smithi103.stdout:1/289: chown d0/d11/d5f/d19/f34 213290 1 2024-09-18T21:12:46.411 INFO:tasks.workunit.client.1.smithi103.stdout:2/224: readlink d3/d5/d25/l41 0 2024-09-18T21:12:46.413 INFO:tasks.workunit.client.1.smithi103.stdout:3/257: link d1/d2/f8 d1/d23/d25/f4c 0 2024-09-18T21:12:46.413 INFO:tasks.workunit.client.1.smithi103.stdout:2/225: write d3/f22 [860367,57059] 0 2024-09-18T21:12:46.414 INFO:tasks.workunit.client.0.smithi077.stdout:6/318: getdents d7/df/d11/d1d/d49 0 2024-09-18T21:12:46.415 INFO:tasks.workunit.client.1.smithi103.stdout:0/271: rename d1/d5/de/d19/d1e/f41 to d1/d5/de/d24/f61 0 2024-09-18T21:12:46.415 INFO:tasks.workunit.client.1.smithi103.stdout:5/280: dwrite de/d1f/d3b/f4a [0,4194304] 0 2024-09-18T21:12:46.416 INFO:tasks.workunit.client.0.smithi077.stdout:6/319: write d7/df/d11/d1d/d49/d55/f59 [5016284,79829] 0 2024-09-18T21:12:46.419 INFO:tasks.workunit.client.1.smithi103.stdout:5/281: fsync de/d1f/f2a 0 2024-09-18T21:12:46.420 INFO:tasks.workunit.client.0.smithi077.stdout:6/320: creat d7/df/d11/d1d/d49/d55/f68 x:0 0 0 2024-09-18T21:12:46.421 INFO:tasks.workunit.client.1.smithi103.stdout:7/272: mknod d1/df/d42/d29/d2f/c53 0 2024-09-18T21:12:46.421 INFO:tasks.workunit.client.1.smithi103.stdout:6/297: dwrite d2/d24/f27 [0,4194304] 0 2024-09-18T21:12:46.424 INFO:tasks.workunit.client.1.smithi103.stdout:6/298: dread - d2/d3/d8/f47 zero size 2024-09-18T21:12:46.425 INFO:tasks.workunit.client.0.smithi077.stdout:6/321: creat d7/df/d11/d25/f69 x:0 0 0 2024-09-18T21:12:46.425 INFO:tasks.workunit.client.1.smithi103.stdout:5/282: dread - de/f36 zero size 2024-09-18T21:12:46.425 INFO:tasks.workunit.client.1.smithi103.stdout:1/290: creat d0/d3/f66 x:0 0 0 2024-09-18T21:12:46.427 INFO:tasks.workunit.client.1.smithi103.stdout:2/226: mknod d3/d5/d25/d40/c52 0 2024-09-18T21:12:46.428 INFO:tasks.workunit.client.1.smithi103.stdout:5/283: dread - de/d1f/f2a zero size 2024-09-18T21:12:46.428 INFO:tasks.workunit.client.1.smithi103.stdout:8/280: mkdir d4/de/d4a/d59 0 2024-09-18T21:12:46.430 INFO:tasks.workunit.client.1.smithi103.stdout:1/291: chown d0/d2/d9/d10/d5d 219480804 1 2024-09-18T21:12:46.430 INFO:tasks.workunit.client.0.smithi077.stdout:2/362: mknod d1/c70 0 2024-09-18T21:12:46.431 INFO:tasks.workunit.client.1.smithi103.stdout:0/272: dwrite d1/f36 [0,4194304] 0 2024-09-18T21:12:46.433 INFO:tasks.workunit.client.1.smithi103.stdout:6/299: rmdir d2/d24/d38 39 2024-09-18T21:12:46.440 INFO:tasks.workunit.client.0.smithi077.stdout:2/363: dwrite d1/d4/f5f [4194304,4194304] 0 2024-09-18T21:12:46.440 INFO:tasks.workunit.client.1.smithi103.stdout:6/300: chown d2/d24/d5a/f17 452593 1 2024-09-18T21:12:46.442 INFO:tasks.workunit.client.0.smithi077.stdout:2/364: truncate d1/d4/d5/d1a/f6d 355994 0 2024-09-18T21:12:46.443 INFO:tasks.workunit.client.1.smithi103.stdout:6/301: write d2/d3/d8/f59 [761397,87354] 0 2024-09-18T21:12:46.444 INFO:tasks.workunit.client.1.smithi103.stdout:8/281: chown d4/d2c/d39/l40 0 1 2024-09-18T21:12:46.444 INFO:tasks.workunit.client.1.smithi103.stdout:2/227: creat d3/d5/d4a/f53 x:0 0 0 2024-09-18T21:12:46.446 INFO:tasks.workunit.client.1.smithi103.stdout:1/292: creat d0/d2/d9/d10/f67 x:0 0 0 2024-09-18T21:12:46.448 INFO:tasks.workunit.client.1.smithi103.stdout:8/282: chown d4/de/c20 32 1 2024-09-18T21:12:46.449 INFO:tasks.workunit.client.0.smithi077.stdout:2/365: rename d1/d4/d9/d4f/c60 to d1/d4/d5/d1a/d49/d6a/c71 0 2024-09-18T21:12:46.449 INFO:tasks.workunit.client.1.smithi103.stdout:9/272: dwrite d18/f22 [0,4194304] 0 2024-09-18T21:12:46.450 INFO:tasks.workunit.client.1.smithi103.stdout:4/289: link d9/d1a/d2b/f35 d9/d1a/d21/f63 0 2024-09-18T21:12:46.450 INFO:tasks.workunit.client.0.smithi077.stdout:2/366: creat d1/d4/d5/d1a/d49/f72 x:0 0 0 2024-09-18T21:12:46.451 INFO:tasks.workunit.client.1.smithi103.stdout:0/273: dwrite d1/d5/de/d19/f4a [0,4194304] 0 2024-09-18T21:12:46.456 INFO:tasks.workunit.client.0.smithi077.stdout:5/375: truncate d0/d6/dd/f1e 1397907 0 2024-09-18T21:12:46.457 INFO:tasks.workunit.client.0.smithi077.stdout:3/243: dwrite db/d14/f17 [0,4194304] 0 2024-09-18T21:12:46.460 INFO:tasks.workunit.client.0.smithi077.stdout:2/367: dwrite d1/d4/d5/d1a/d2e/d41/f68 [0,4194304] 0 2024-09-18T21:12:46.460 INFO:tasks.workunit.client.1.smithi103.stdout:1/293: mkdir d0/d3/d68 0 2024-09-18T21:12:46.462 INFO:tasks.workunit.client.1.smithi103.stdout:1/294: write d0/d2/d9/f63 [546812,87464] 0 2024-09-18T21:12:46.463 INFO:tasks.workunit.client.1.smithi103.stdout:0/274: dread d1/d5/de/d19/d1e/f21 [0,4194304] 0 2024-09-18T21:12:46.464 INFO:tasks.workunit.client.1.smithi103.stdout:4/290: mkdir d9/d1a/d41/d64 0 2024-09-18T21:12:46.465 INFO:tasks.workunit.client.1.smithi103.stdout:8/283: dwrite d4/de/f46 [0,4194304] 0 2024-09-18T21:12:46.465 INFO:tasks.workunit.client.1.smithi103.stdout:7/273: getdents d1/df 0 2024-09-18T21:12:46.466 INFO:tasks.workunit.client.0.smithi077.stdout:5/376: mkdir d0/df/d10/d5c/d74/d89 0 2024-09-18T21:12:46.466 INFO:tasks.workunit.client.0.smithi077.stdout:3/244: dwrite f3 [0,4194304] 0 2024-09-18T21:12:46.467 INFO:tasks.workunit.client.0.smithi077.stdout:5/377: chown d0/df/d10/l39 345 1 2024-09-18T21:12:46.469 INFO:tasks.workunit.client.1.smithi103.stdout:8/284: readlink d4/d26/l34 0 2024-09-18T21:12:46.470 INFO:tasks.workunit.client.1.smithi103.stdout:9/273: chown d18/d1f/d2f/l3d 325144856 1 2024-09-18T21:12:46.471 INFO:tasks.workunit.client.1.smithi103.stdout:8/285: read d4/de/f46 [2943553,58257] 0 2024-09-18T21:12:46.472 INFO:tasks.workunit.client.0.smithi077.stdout:2/368: symlink d1/d4/d5/l73 0 2024-09-18T21:12:46.475 INFO:tasks.workunit.client.0.smithi077.stdout:3/245: symlink db/d14/d32/d3a/d3b/l4c 0 2024-09-18T21:12:46.477 INFO:tasks.workunit.client.1.smithi103.stdout:5/284: creat de/d14/f5b x:0 0 0 2024-09-18T21:12:46.477 INFO:tasks.workunit.client.0.smithi077.stdout:2/369: creat d1/d4/d9/d24/f74 x:0 0 0 2024-09-18T21:12:46.482 INFO:tasks.workunit.client.1.smithi103.stdout:3/258: link d1/da/l10 d1/d2/d18/d30/l4d 0 2024-09-18T21:12:46.483 INFO:tasks.workunit.client.0.smithi077.stdout:6/322: dwrite d7/df/d11/f45 [0,4194304] 0 2024-09-18T21:12:46.484 INFO:tasks.workunit.client.0.smithi077.stdout:2/370: rename d1/d4/d9/f1e to d1/d4/d9/d24/d66/f75 0 2024-09-18T21:12:46.487 INFO:tasks.workunit.client.1.smithi103.stdout:4/291: mknod d9/d1a/c65 0 2024-09-18T21:12:46.491 INFO:tasks.workunit.client.1.smithi103.stdout:1/295: creat d0/d2/d9/dc/f69 x:0 0 0 2024-09-18T21:12:46.492 INFO:tasks.workunit.client.1.smithi103.stdout:1/296: chown d0/d11/f35 9 1 2024-09-18T21:12:46.493 INFO:tasks.workunit.client.0.smithi077.stdout:5/378: getdents d0/df 0 2024-09-18T21:12:46.493 INFO:tasks.workunit.client.1.smithi103.stdout:1/297: truncate d0/f7 5676405 0 2024-09-18T21:12:46.494 INFO:tasks.workunit.client.1.smithi103.stdout:7/274: mkdir d1/df/d54 0 2024-09-18T21:12:46.495 INFO:tasks.workunit.client.0.smithi077.stdout:5/379: read d0/d36/f70 [499211,72696] 0 2024-09-18T21:12:46.495 INFO:tasks.workunit.client.1.smithi103.stdout:1/298: truncate d0/d3/f4b 509793 0 2024-09-18T21:12:46.496 INFO:tasks.workunit.client.1.smithi103.stdout:1/299: fsync d0/d3/f66 0 2024-09-18T21:12:46.497 INFO:tasks.workunit.client.0.smithi077.stdout:2/371: creat d1/d4/f76 x:0 0 0 2024-09-18T21:12:46.498 INFO:tasks.workunit.client.0.smithi077.stdout:6/323: mknod d7/df/d11/d3e/c6a 0 2024-09-18T21:12:46.499 INFO:tasks.workunit.client.1.smithi103.stdout:8/286: chown d4/d2d/d3d/l58 5082523 1 2024-09-18T21:12:46.500 INFO:tasks.workunit.client.1.smithi103.stdout:8/287: read d4/d2d/f33 [3612849,66337] 0 2024-09-18T21:12:46.500 INFO:tasks.workunit.client.1.smithi103.stdout:2/228: rmdir d3/d5/d25/d47 0 2024-09-18T21:12:46.502 INFO:tasks.workunit.client.1.smithi103.stdout:5/285: rename de/d14/f39 to de/d1f/d3b/d51/d57/d59/f5c 0 2024-09-18T21:12:46.502 INFO:tasks.workunit.client.1.smithi103.stdout:0/275: mkdir d1/d56/d62 0 2024-09-18T21:12:46.504 INFO:tasks.workunit.client.0.smithi077.stdout:6/324: rmdir d7/df/d11/d1d 39 2024-09-18T21:12:46.506 INFO:tasks.workunit.client.0.smithi077.stdout:5/380: mkdir d0/d6/d8a 0 2024-09-18T21:12:46.507 INFO:tasks.workunit.client.0.smithi077.stdout:2/372: rename d1/d4/d5/d1a/d49/d6a/c71 to d1/d4/d9/d24/c77 0 2024-09-18T21:12:46.509 INFO:tasks.workunit.client.0.smithi077.stdout:6/325: truncate d7/df/d11/d1d/f5d 944991 0 2024-09-18T21:12:46.509 INFO:tasks.workunit.client.0.smithi077.stdout:5/381: mknod d0/df/d84/c8b 0 2024-09-18T21:12:46.510 INFO:tasks.workunit.client.0.smithi077.stdout:5/382: chown d0/df/d10/l69 96739326 1 2024-09-18T21:12:46.511 INFO:tasks.workunit.client.0.smithi077.stdout:5/383: fsync d0/d6/d3b/f4e 0 2024-09-18T21:12:46.511 INFO:tasks.workunit.client.1.smithi103.stdout:1/300: dwrite d0/d3/f29 [0,4194304] 0 2024-09-18T21:12:46.511 INFO:tasks.workunit.client.0.smithi077.stdout:2/373: creat d1/d4/d5/d1a/d2e/d40/f78 x:0 0 0 2024-09-18T21:12:46.514 INFO:tasks.workunit.client.1.smithi103.stdout:2/229: mkdir d3/d5/d2c/d54 0 2024-09-18T21:12:46.516 INFO:tasks.workunit.client.0.smithi077.stdout:2/374: rmdir d1/d4/d5/d1a/d2e/d41 39 2024-09-18T21:12:46.518 INFO:tasks.workunit.client.0.smithi077.stdout:2/375: write d1/f1c [1489371,19068] 0 2024-09-18T21:12:46.518 INFO:tasks.workunit.client.1.smithi103.stdout:5/286: creat de/d14/d33/f5d x:0 0 0 2024-09-18T21:12:46.519 INFO:tasks.workunit.client.1.smithi103.stdout:8/288: dwrite d4/de/f11 [4194304,4194304] 0 2024-09-18T21:12:46.519 INFO:tasks.workunit.client.0.smithi077.stdout:5/384: dwrite d0/d6/d3b/f7e [0,4194304] 0 2024-09-18T21:12:46.521 INFO:tasks.workunit.client.0.smithi077.stdout:5/385: dread - d0/df/d3d/d85/f86 zero size 2024-09-18T21:12:46.522 INFO:tasks.workunit.client.1.smithi103.stdout:8/289: fsync d4/d26/f8 0 2024-09-18T21:12:46.524 INFO:tasks.workunit.client.0.smithi077.stdout:2/376: mknod d1/d4/d5/d1a/d49/c79 0 2024-09-18T21:12:46.526 INFO:tasks.workunit.client.0.smithi077.stdout:2/377: read d1/f1d [2980306,69916] 0 2024-09-18T21:12:46.526 INFO:tasks.workunit.client.1.smithi103.stdout:5/287: symlink de/d3e/l5e 0 2024-09-18T21:12:46.527 INFO:tasks.workunit.client.1.smithi103.stdout:2/230: dwrite d3/f1b [4194304,4194304] 0 2024-09-18T21:12:46.528 INFO:tasks.workunit.client.0.smithi077.stdout:5/386: mknod d0/d6/d3b/d64/d67/c8c 0 2024-09-18T21:12:46.528 INFO:tasks.workunit.client.0.smithi077.stdout:5/387: chown d0/d6/d40 768164294 1 2024-09-18T21:12:46.530 INFO:tasks.workunit.client.1.smithi103.stdout:8/290: readlink d4/de/l35 0 2024-09-18T21:12:46.531 INFO:tasks.workunit.client.1.smithi103.stdout:7/275: rename d1/df/d42/d1f/d2e/l34 to d1/df/d42/d1f/d2e/l55 0 2024-09-18T21:12:46.531 INFO:tasks.workunit.client.0.smithi077.stdout:2/378: mkdir d1/d4/d9/d7a 0 2024-09-18T21:12:46.532 INFO:tasks.workunit.client.0.smithi077.stdout:2/379: write d1/f2a [964481,20118] 0 2024-09-18T21:12:46.536 INFO:tasks.workunit.client.1.smithi103.stdout:5/288: symlink de/d1f/l5f 0 2024-09-18T21:12:46.539 INFO:tasks.workunit.client.1.smithi103.stdout:7/276: creat d1/df/d42/d1f/d2e/d3f/f56 x:0 0 0 2024-09-18T21:12:46.540 INFO:tasks.workunit.client.1.smithi103.stdout:3/259: dread d1/da/f22 [0,4194304] 0 2024-09-18T21:12:46.541 INFO:tasks.workunit.client.0.smithi077.stdout:2/380: dwrite d1/d4/d5/f53 [4194304,4194304] 0 2024-09-18T21:12:46.542 INFO:tasks.workunit.client.0.smithi077.stdout:2/381: dread - d1/d4/d9/d24/d66/f6f zero size 2024-09-18T21:12:46.544 INFO:tasks.workunit.client.1.smithi103.stdout:7/277: unlink d1/f1b 0 2024-09-18T21:12:46.546 INFO:tasks.workunit.client.1.smithi103.stdout:5/289: dwrite de/d14/d33/f5d [0,4194304] 0 2024-09-18T21:12:46.546 INFO:tasks.workunit.client.0.smithi077.stdout:5/388: link d0/d6/dd/d5d/l66 d0/l8d 0 2024-09-18T21:12:46.548 INFO:tasks.workunit.client.0.smithi077.stdout:1/222: sync 2024-09-18T21:12:46.548 INFO:tasks.workunit.client.0.smithi077.stdout:8/230: sync 2024-09-18T21:12:46.549 INFO:tasks.workunit.client.1.smithi103.stdout:3/260: mkdir d1/d2/d18/d30/d4e 0 2024-09-18T21:12:46.549 INFO:tasks.workunit.client.1.smithi103.stdout:8/291: dread d4/de/f1c [0,4194304] 0 2024-09-18T21:12:46.549 INFO:tasks.workunit.client.0.smithi077.stdout:2/382: creat d1/d4/d5/d1a/d2e/d40/f7b x:0 0 0 2024-09-18T21:12:46.549 INFO:tasks.workunit.client.1.smithi103.stdout:6/302: truncate d2/d24/f27 4238896 0 2024-09-18T21:12:46.550 INFO:tasks.workunit.client.1.smithi103.stdout:3/261: chown d1/d2/d18/d30/l41 100889 1 2024-09-18T21:12:46.552 INFO:tasks.workunit.client.0.smithi077.stdout:1/223: mknod d3/d1e/d32/c52 0 2024-09-18T21:12:46.552 INFO:tasks.workunit.client.1.smithi103.stdout:7/278: unlink d1/f15 0 2024-09-18T21:12:46.553 INFO:tasks.workunit.client.0.smithi077.stdout:3/246: write db/d14/d22/f2f [135547,20223] 0 2024-09-18T21:12:46.554 INFO:tasks.workunit.client.0.smithi077.stdout:8/231: creat d2/d5/d6/d22/d18/f4e x:0 0 0 2024-09-18T21:12:46.556 INFO:tasks.workunit.client.0.smithi077.stdout:2/383: symlink d1/d4/d5/d1a/d2e/d40/l7c 0 2024-09-18T21:12:46.558 INFO:tasks.workunit.client.0.smithi077.stdout:5/389: symlink d0/df/d10/d5c/d74/d89/l8e 0 2024-09-18T21:12:46.558 INFO:tasks.workunit.client.0.smithi077.stdout:5/390: stat d0/d6/d8a 0 2024-09-18T21:12:46.559 INFO:tasks.workunit.client.1.smithi103.stdout:3/262: dread d1/d23/d25/f4c [0,4194304] 0 2024-09-18T21:12:46.560 INFO:tasks.workunit.client.0.smithi077.stdout:8/232: dread d2/f31 [0,4194304] 0 2024-09-18T21:12:46.565 INFO:tasks.workunit.client.0.smithi077.stdout:5/391: creat d0/d6/d3b/f8f x:0 0 0 2024-09-18T21:12:46.569 INFO:tasks.workunit.client.0.smithi077.stdout:7/354: sync 2024-09-18T21:12:46.569 INFO:tasks.workunit.client.0.smithi077.stdout:0/371: sync 2024-09-18T21:12:46.569 INFO:tasks.workunit.client.0.smithi077.stdout:4/273: sync 2024-09-18T21:12:46.569 INFO:tasks.workunit.client.0.smithi077.stdout:9/181: sync 2024-09-18T21:12:46.570 INFO:tasks.workunit.client.1.smithi103.stdout:4/292: dwrite d9/fa [0,4194304] 0 2024-09-18T21:12:46.570 INFO:tasks.workunit.client.0.smithi077.stdout:8/233: dwrite d2/d5/d6/d22/d18/f4c [0,4194304] 0 2024-09-18T21:12:46.570 INFO:tasks.workunit.client.1.smithi103.stdout:3/263: mkdir d1/d23/d25/d4f 0 2024-09-18T21:12:46.571 INFO:tasks.workunit.client.0.smithi077.stdout:9/182: chown d1/df 26 1 2024-09-18T21:12:46.571 INFO:tasks.workunit.client.1.smithi103.stdout:4/293: stat d9/d1f/f50 0 2024-09-18T21:12:46.572 INFO:tasks.workunit.client.1.smithi103.stdout:6/303: dread d2/f34 [0,4194304] 0 2024-09-18T21:12:46.572 INFO:tasks.workunit.client.0.smithi077.stdout:2/384: mkdir d1/d4/d5/d7d 0 2024-09-18T21:12:46.577 INFO:tasks.workunit.client.0.smithi077.stdout:4/274: dread d3/dc/d24/f43 [0,4194304] 0 2024-09-18T21:12:46.579 INFO:tasks.workunit.client.0.smithi077.stdout:7/355: dwrite d12/f45 [0,4194304] 0 2024-09-18T21:12:46.579 INFO:tasks.workunit.client.0.smithi077.stdout:6/326: truncate d7/df/d11/d1d/d49/d55/f59 3403625 0 2024-09-18T21:12:46.581 INFO:tasks.workunit.client.0.smithi077.stdout:7/356: write d12/f78 [1484923,41954] 0 2024-09-18T21:12:46.586 INFO:tasks.workunit.client.0.smithi077.stdout:5/392: truncate d0/df/d10/d4b/f65 4178924 0 2024-09-18T21:12:46.587 INFO:tasks.workunit.client.0.smithi077.stdout:0/372: creat d8/d1d/d57/f78 x:0 0 0 2024-09-18T21:12:46.591 INFO:tasks.workunit.client.0.smithi077.stdout:6/327: dwrite d7/df/f14 [0,4194304] 0 2024-09-18T21:12:46.591 INFO:tasks.workunit.client.0.smithi077.stdout:3/247: getdents db/d14/d32/d3a/d3b 0 2024-09-18T21:12:46.592 INFO:tasks.workunit.client.0.smithi077.stdout:1/224: dread d3/d8/f1c [0,4194304] 0 2024-09-18T21:12:46.592 INFO:tasks.workunit.client.0.smithi077.stdout:6/328: write d7/fc [5139943,52175] 0 2024-09-18T21:12:46.592 INFO:tasks.workunit.client.0.smithi077.stdout:3/248: readlink db/d14/l15 0 2024-09-18T21:12:46.595 INFO:tasks.workunit.client.0.smithi077.stdout:7/357: mkdir d12/d31/d33/d2a/d7f 0 2024-09-18T21:12:46.598 INFO:tasks.workunit.client.0.smithi077.stdout:9/183: unlink d1/c10 0 2024-09-18T21:12:46.598 INFO:tasks.workunit.client.0.smithi077.stdout:0/373: read d8/f2d [4149023,122258] 0 2024-09-18T21:12:46.599 INFO:tasks.workunit.client.0.smithi077.stdout:8/234: mkdir d2/d5/d6/d22/d4f 0 2024-09-18T21:12:46.599 INFO:tasks.workunit.client.1.smithi103.stdout:8/292: rmdir d4/d2d/d44 0 2024-09-18T21:12:46.600 INFO:tasks.workunit.client.1.smithi103.stdout:2/231: rmdir d3/d5/d2c 39 2024-09-18T21:12:46.600 INFO:tasks.workunit.client.1.smithi103.stdout:3/264: mkdir d1/d34/d50 0 2024-09-18T21:12:46.602 INFO:tasks.workunit.client.1.smithi103.stdout:0/276: write d1/f18 [2154296,42473] 0 2024-09-18T21:12:46.602 INFO:tasks.workunit.client.1.smithi103.stdout:9/274: truncate d18/f3e 2351253 0 2024-09-18T21:12:46.602 INFO:tasks.workunit.client.1.smithi103.stdout:7/279: dread d1/df/d43/f4d [0,4194304] 0 2024-09-18T21:12:46.603 INFO:tasks.workunit.client.0.smithi077.stdout:2/385: mkdir d1/d4/d5/d1a/d2e/d7e 0 2024-09-18T21:12:46.608 INFO:tasks.workunit.client.0.smithi077.stdout:3/249: chown db/c3f 282048 1 2024-09-18T21:12:46.609 INFO:tasks.workunit.client.0.smithi077.stdout:1/225: creat d3/d1e/d32/f53 x:0 0 0 2024-09-18T21:12:46.610 INFO:tasks.workunit.client.1.smithi103.stdout:8/293: dwrite d4/d2c/f31 [0,4194304] 0 2024-09-18T21:12:46.611 INFO:tasks.workunit.client.0.smithi077.stdout:6/329: creat d7/df/d11/d1d/d5c/f6b x:0 0 0 2024-09-18T21:12:46.611 INFO:tasks.workunit.client.1.smithi103.stdout:8/294: write d4/de/f43 [4275053,71062] 0 2024-09-18T21:12:46.614 INFO:tasks.workunit.client.0.smithi077.stdout:7/358: creat d12/d22/d59/d72/f80 x:0 0 0 2024-09-18T21:12:46.614 INFO:tasks.workunit.client.0.smithi077.stdout:3/250: dwrite db/d14/d22/f2f [0,4194304] 0 2024-09-18T21:12:46.615 INFO:tasks.workunit.client.1.smithi103.stdout:5/290: truncate de/d3e/f29 124951 0 2024-09-18T21:12:46.621 INFO:tasks.workunit.client.0.smithi077.stdout:8/235: readlink d2/d5/l17 0 2024-09-18T21:12:46.626 INFO:tasks.workunit.client.1.smithi103.stdout:9/275: mkdir d18/d52 0 2024-09-18T21:12:46.629 INFO:tasks.workunit.client.1.smithi103.stdout:8/295: creat d4/d2d/d3d/f5a x:0 0 0 2024-09-18T21:12:46.630 INFO:tasks.workunit.client.0.smithi077.stdout:1/226: mkdir d3/d8/d49/d4e/d50/d3d/d54 0 2024-09-18T21:12:46.631 INFO:tasks.workunit.client.0.smithi077.stdout:1/227: fdatasync d3/d8/d13/d18/f51 0 2024-09-18T21:12:46.631 INFO:tasks.workunit.client.0.smithi077.stdout:6/330: mknod d7/df/d11/d1d/d49/d55/c6c 0 2024-09-18T21:12:46.632 INFO:tasks.workunit.client.0.smithi077.stdout:6/331: fdatasync d7/df/d11/d3e/f51 0 2024-09-18T21:12:46.632 INFO:tasks.workunit.client.1.smithi103.stdout:2/232: mknod d3/d5/d2f/d32/d46/c55 0 2024-09-18T21:12:46.633 INFO:tasks.workunit.client.0.smithi077.stdout:7/359: stat le 0 2024-09-18T21:12:46.634 INFO:tasks.workunit.client.0.smithi077.stdout:4/275: write d3/dc/f1b [3408759,101112] 0 2024-09-18T21:12:46.634 INFO:tasks.workunit.client.1.smithi103.stdout:8/296: dwrite d4/de/f43 [0,4194304] 0 2024-09-18T21:12:46.635 INFO:tasks.workunit.client.1.smithi103.stdout:3/265: mkdir d1/d23/d25/d4f/d51 0 2024-09-18T21:12:46.636 INFO:tasks.workunit.client.1.smithi103.stdout:7/280: creat d1/df/d54/f57 x:0 0 0 2024-09-18T21:12:46.637 INFO:tasks.workunit.client.0.smithi077.stdout:0/374: mkdir d8/d1a/d39/d3b/d79 0 2024-09-18T21:12:46.639 INFO:tasks.workunit.client.0.smithi077.stdout:8/236: unlink d2/d27/d29/f38 0 2024-09-18T21:12:46.640 INFO:tasks.workunit.client.1.smithi103.stdout:4/294: getdents d9/d1c 0 2024-09-18T21:12:46.640 INFO:tasks.workunit.client.0.smithi077.stdout:8/237: chown d2/f19 29665603 1 2024-09-18T21:12:46.642 INFO:tasks.workunit.client.0.smithi077.stdout:5/393: getdents d0/df/d10/d5c 0 2024-09-18T21:12:46.643 INFO:tasks.workunit.client.0.smithi077.stdout:5/394: chown d0/df/f52 184012974 1 2024-09-18T21:12:46.643 INFO:tasks.workunit.client.1.smithi103.stdout:7/281: chown d1/df/d42/d29/d2f/d33/f3e 5284 1 2024-09-18T21:12:46.644 INFO:tasks.workunit.client.0.smithi077.stdout:9/184: write d1/f16 [2575552,93490] 0 2024-09-18T21:12:46.644 INFO:tasks.workunit.client.1.smithi103.stdout:6/304: truncate d2/d3/d8/f29 2230800 0 2024-09-18T21:12:46.644 INFO:tasks.workunit.client.0.smithi077.stdout:9/185: chown d1/dd 242549 1 2024-09-18T21:12:46.645 INFO:tasks.workunit.client.0.smithi077.stdout:9/186: fsync d1/fb 0 2024-09-18T21:12:46.646 INFO:tasks.workunit.client.0.smithi077.stdout:9/187: truncate d1/dd/d11/d2d/f32 565510 0 2024-09-18T21:12:46.647 INFO:tasks.workunit.client.1.smithi103.stdout:2/233: stat c2 0 2024-09-18T21:12:46.647 INFO:tasks.workunit.client.1.smithi103.stdout:5/291: symlink de/d1f/d3b/d3c/l60 0 2024-09-18T21:12:46.647 INFO:tasks.workunit.client.0.smithi077.stdout:1/228: truncate d3/d8/d13/f1f 695390 0 2024-09-18T21:12:46.648 INFO:tasks.workunit.client.1.smithi103.stdout:3/266: dwrite d1/d34/f36 [0,4194304] 0 2024-09-18T21:12:46.648 INFO:tasks.workunit.client.0.smithi077.stdout:9/188: truncate d1/dd/d11/d1c/f31 846294 0 2024-09-18T21:12:46.651 INFO:tasks.workunit.client.1.smithi103.stdout:8/297: dread d4/de/f43 [0,4194304] 0 2024-09-18T21:12:46.652 INFO:tasks.workunit.client.1.smithi103.stdout:2/234: write d3/f20 [474915,79787] 0 2024-09-18T21:12:46.652 INFO:tasks.workunit.client.0.smithi077.stdout:3/251: mkdir db/d4d 0 2024-09-18T21:12:46.654 INFO:tasks.workunit.client.1.smithi103.stdout:4/295: symlink d9/d1f/l66 0 2024-09-18T21:12:46.655 INFO:tasks.workunit.client.1.smithi103.stdout:0/277: dwrite d1/f29 [0,4194304] 0 2024-09-18T21:12:46.658 INFO:tasks.workunit.client.0.smithi077.stdout:0/375: creat d8/d1a/d35/f7a x:0 0 0 2024-09-18T21:12:46.659 INFO:tasks.workunit.client.1.smithi103.stdout:8/298: chown d4/de/l35 119103 1 2024-09-18T21:12:46.663 INFO:tasks.workunit.client.1.smithi103.stdout:7/282: dwrite d1/f17 [0,4194304] 0 2024-09-18T21:12:46.663 INFO:tasks.workunit.client.1.smithi103.stdout:8/299: chown d4/d26/f8 5 1 2024-09-18T21:12:46.664 INFO:tasks.workunit.client.0.smithi077.stdout:2/386: creat d1/d4/d5/d1a/d2e/f7f x:0 0 0 2024-09-18T21:12:46.666 INFO:tasks.workunit.client.0.smithi077.stdout:5/395: chown d0/df/d10/d4b/f65 28644 1 2024-09-18T21:12:46.667 INFO:tasks.workunit.client.1.smithi103.stdout:5/292: unlink de/d14/f32 0 2024-09-18T21:12:46.667 INFO:tasks.workunit.client.0.smithi077.stdout:5/396: fsync d0/df/f25 0 2024-09-18T21:12:46.670 INFO:tasks.workunit.client.0.smithi077.stdout:1/229: creat d3/d1e/f55 x:0 0 0 2024-09-18T21:12:46.671 INFO:tasks.workunit.client.1.smithi103.stdout:2/235: mkdir d3/d5/d4a/d56 0 2024-09-18T21:12:46.672 INFO:tasks.workunit.client.1.smithi103.stdout:2/236: chown d3/d5/f18 474 1 2024-09-18T21:12:46.674 INFO:tasks.workunit.client.1.smithi103.stdout:0/278: unlink d1/d9/d13/f14 0 2024-09-18T21:12:46.676 INFO:tasks.workunit.client.1.smithi103.stdout:1/301: sync 2024-09-18T21:12:46.676 INFO:tasks.workunit.client.1.smithi103.stdout:4/296: creat d9/d1a/d41/f67 x:0 0 0 2024-09-18T21:12:46.679 INFO:tasks.workunit.client.1.smithi103.stdout:8/300: creat d4/d2c/f5b x:0 0 0 2024-09-18T21:12:46.679 INFO:tasks.workunit.client.0.smithi077.stdout:7/360: dread d12/d22/f28 [0,4194304] 0 2024-09-18T21:12:46.680 INFO:tasks.workunit.client.1.smithi103.stdout:1/302: truncate d0/d2/d9/dc/f69 906669 0 2024-09-18T21:12:46.681 INFO:tasks.workunit.client.1.smithi103.stdout:8/301: chown d4/d2c/d39/l40 21 1 2024-09-18T21:12:46.682 INFO:tasks.workunit.client.1.smithi103.stdout:9/276: dread f4 [0,4194304] 0 2024-09-18T21:12:46.682 INFO:tasks.workunit.client.1.smithi103.stdout:1/303: dread - d0/d2/d2b/d3a/f51 zero size 2024-09-18T21:12:46.682 INFO:tasks.workunit.client.1.smithi103.stdout:5/293: creat de/d1f/d3b/f61 x:0 0 0 2024-09-18T21:12:46.683 INFO:tasks.workunit.client.0.smithi077.stdout:8/238: symlink d2/d36/l50 0 2024-09-18T21:12:46.683 INFO:tasks.workunit.client.1.smithi103.stdout:3/267: symlink d1/d2/d18/d30/d4e/l52 0 2024-09-18T21:12:46.687 INFO:tasks.workunit.client.1.smithi103.stdout:6/305: creat d2/d3/f5b x:0 0 0 2024-09-18T21:12:46.689 INFO:tasks.workunit.client.0.smithi077.stdout:5/397: rename d0/df/d10/d5c/d74/f81 to d0/df/d84/f90 0 2024-09-18T21:12:46.689 INFO:tasks.workunit.client.0.smithi077.stdout:1/230: rename d3 to d3/d8/d49/d56 22 2024-09-18T21:12:46.690 INFO:tasks.workunit.client.0.smithi077.stdout:9/189: truncate d1/df/f18 1124253 0 2024-09-18T21:12:46.692 INFO:tasks.workunit.client.1.smithi103.stdout:6/306: dread d2/d3/d8/f59 [0,4194304] 0 2024-09-18T21:12:46.693 INFO:tasks.workunit.client.0.smithi077.stdout:3/252: mkdir db/d14/d32/d49/d4e 0 2024-09-18T21:12:46.693 INFO:tasks.workunit.client.0.smithi077.stdout:6/332: truncate d7/f2d 1448153 0 2024-09-18T21:12:46.694 INFO:tasks.workunit.client.1.smithi103.stdout:7/283: dread d1/df/d42/d1f/d2e/f41 [0,4194304] 0 2024-09-18T21:12:46.695 INFO:tasks.workunit.client.0.smithi077.stdout:7/361: creat d12/d22/d59/d72/f81 x:0 0 0 2024-09-18T21:12:46.696 INFO:tasks.workunit.client.1.smithi103.stdout:1/304: mknod d0/d11/d5f/c6a 0 2024-09-18T21:12:46.698 INFO:tasks.workunit.client.1.smithi103.stdout:1/305: read d0/d2/d9/f63 [17630,40486] 0 2024-09-18T21:12:46.698 INFO:tasks.workunit.client.0.smithi077.stdout:2/387: mkdir d1/d4/d9/d80 0 2024-09-18T21:12:46.701 INFO:tasks.workunit.client.1.smithi103.stdout:6/307: dwrite d2/d24/d5a/f11 [0,4194304] 0 2024-09-18T21:12:46.703 INFO:tasks.workunit.client.0.smithi077.stdout:4/276: dwrite d3/d7/f1a [0,4194304] 0 2024-09-18T21:12:46.703 INFO:tasks.workunit.client.0.smithi077.stdout:2/388: chown d1/d4/d5/d1a/d2e/d40/l45 130522485 1 2024-09-18T21:12:46.705 INFO:tasks.workunit.client.0.smithi077.stdout:0/376: dwrite d8/d1a/f4b [0,4194304] 0 2024-09-18T21:12:46.705 INFO:tasks.workunit.client.1.smithi103.stdout:4/297: getdents d9/d2e/d61 0 2024-09-18T21:12:46.706 INFO:tasks.workunit.client.0.smithi077.stdout:2/389: write d1/f67 [97555,52349] 0 2024-09-18T21:12:46.707 INFO:tasks.workunit.client.0.smithi077.stdout:0/377: readlink d8/d26/l29 0 2024-09-18T21:12:46.709 INFO:tasks.workunit.client.0.smithi077.stdout:1/231: rmdir d3/d8/d49/d4e 39 2024-09-18T21:12:46.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:46 smithi077 ceph-mon[27689]: pgmap v14: 65 pgs: 65 active+clean; 1.1 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 16 MiB/s rd, 137 MiB/s wr, 345 op/s 2024-09-18T21:12:46.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:46 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:12:46.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:46 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:12:46.714 INFO:tasks.workunit.client.0.smithi077.stdout:6/333: symlink d7/df/d11/d1d/d50/l6d 0 2024-09-18T21:12:46.715 INFO:tasks.workunit.client.0.smithi077.stdout:6/334: read d7/df/d11/d1d/d50/f5f [4614155,110824] 0 2024-09-18T21:12:46.717 INFO:tasks.workunit.client.0.smithi077.stdout:6/335: truncate d7/df/d11/d3e/f51 440931 0 2024-09-18T21:12:46.721 INFO:tasks.workunit.client.0.smithi077.stdout:8/239: rename d2/d5/d6/d22/d18/c1e to d2/d27/d29/d41/c51 0 2024-09-18T21:12:46.723 INFO:tasks.workunit.client.1.smithi103.stdout:7/284: unlink d1/df/d42/d29/d48/c49 0 2024-09-18T21:12:46.724 INFO:tasks.workunit.client.1.smithi103.stdout:3/268: dwrite d1/d2/f8 [0,4194304] 0 2024-09-18T21:12:46.724 INFO:tasks.workunit.client.1.smithi103.stdout:9/277: write f17 [225955,84663] 0 2024-09-18T21:12:46.725 INFO:tasks.workunit.client.0.smithi077.stdout:4/277: creat d3/f57 x:0 0 0 2024-09-18T21:12:46.728 INFO:tasks.workunit.client.0.smithi077.stdout:5/398: fdatasync d0/d6/dd/f1e 0 2024-09-18T21:12:46.729 INFO:tasks.workunit.client.1.smithi103.stdout:2/237: creat d3/d5/f57 x:0 0 0 2024-09-18T21:12:46.730 INFO:tasks.workunit.client.0.smithi077.stdout:1/232: chown d3/f23 7472 1 2024-09-18T21:12:46.731 INFO:tasks.workunit.client.1.smithi103.stdout:0/279: link d1/d9/d13/c2c d1/d9/c63 0 2024-09-18T21:12:46.731 INFO:tasks.workunit.client.0.smithi077.stdout:8/240: dwrite d2/d5/d6/d22/d18/f4e [0,4194304] 0 2024-09-18T21:12:46.732 INFO:tasks.workunit.client.1.smithi103.stdout:7/285: dwrite d1/df/d42/d1f/f2d [0,4194304] 0 2024-09-18T21:12:46.733 INFO:tasks.workunit.client.1.smithi103.stdout:1/306: rename d0/d2/d9/dc/f61 to d0/d11/d5f/d19/d4d/f6b 0 2024-09-18T21:12:46.735 INFO:tasks.workunit.client.0.smithi077.stdout:1/233: write d3/d8/d13/d18/f46 [494616,59107] 0 2024-09-18T21:12:46.737 INFO:tasks.workunit.client.0.smithi077.stdout:9/190: rename d1/fb to d1/df/d27/f39 0 2024-09-18T21:12:46.738 INFO:tasks.workunit.client.1.smithi103.stdout:4/298: write f5 [6250259,48754] 0 2024-09-18T21:12:46.739 INFO:tasks.workunit.client.0.smithi077.stdout:0/378: dread f5 [0,4194304] 0 2024-09-18T21:12:46.741 INFO:tasks.workunit.client.1.smithi103.stdout:9/278: fdatasync fa 0 2024-09-18T21:12:46.744 INFO:tasks.workunit.client.0.smithi077.stdout:5/399: mkdir d0/d6/dd/d5d/d91 0 2024-09-18T21:12:46.746 INFO:tasks.workunit.client.1.smithi103.stdout:0/280: mknod d1/d5/c64 0 2024-09-18T21:12:46.747 INFO:tasks.workunit.client.0.smithi077.stdout:0/379: dwrite d8/d1d/f68 [0,4194304] 0 2024-09-18T21:12:46.749 INFO:tasks.workunit.client.0.smithi077.stdout:1/234: write d3/d8/d49/d4e/d50/f30 [508546,96525] 0 2024-09-18T21:12:46.749 INFO:tasks.workunit.client.0.smithi077.stdout:2/390: rename d1/d4/d9/d7a to d1/d4/d5/d1a/d49/d6a/d81 0 2024-09-18T21:12:46.751 INFO:tasks.workunit.client.0.smithi077.stdout:0/380: chown d8/d37/d66/l73 316503 1 2024-09-18T21:12:46.751 INFO:tasks.workunit.client.0.smithi077.stdout:0/381: chown d8/d26/f18 8210491 1 2024-09-18T21:12:46.752 INFO:tasks.workunit.client.0.smithi077.stdout:4/278: creat d3/dc/d51/d53/f58 x:0 0 0 2024-09-18T21:12:46.753 INFO:tasks.workunit.client.1.smithi103.stdout:3/269: rename d1/d2/d18/d30/c3a to d1/d23/d47/c53 0 2024-09-18T21:12:46.754 INFO:tasks.workunit.client.0.smithi077.stdout:5/400: symlink d0/d6/d3b/l92 0 2024-09-18T21:12:46.755 INFO:tasks.workunit.client.1.smithi103.stdout:4/299: creat d9/d1c/f68 x:0 0 0 2024-09-18T21:12:46.756 INFO:tasks.workunit.client.0.smithi077.stdout:5/401: fdatasync d0/df/f1c 0 2024-09-18T21:12:46.757 INFO:tasks.workunit.client.1.smithi103.stdout:9/279: mknod d18/d1f/d2f/c53 0 2024-09-18T21:12:46.757 INFO:tasks.workunit.client.0.smithi077.stdout:5/402: fsync d0/d6/d3b/f55 0 2024-09-18T21:12:46.758 INFO:tasks.workunit.client.0.smithi077.stdout:0/382: dwrite d8/f13 [0,4194304] 0 2024-09-18T21:12:46.759 INFO:tasks.workunit.client.0.smithi077.stdout:2/391: creat d1/d4/d9/d24/f82 x:0 0 0 2024-09-18T21:12:46.762 INFO:tasks.workunit.client.0.smithi077.stdout:1/235: creat d3/d8/d49/d4e/f57 x:0 0 0 2024-09-18T21:12:46.762 INFO:tasks.workunit.client.1.smithi103.stdout:7/286: truncate d1/df/d42/d29/d2f/d33/f40 1065769 0 2024-09-18T21:12:46.763 INFO:tasks.workunit.client.0.smithi077.stdout:3/253: write db/f10 [292295,27229] 0 2024-09-18T21:12:46.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:46 smithi103 ceph-mon[34827]: pgmap v14: 65 pgs: 65 active+clean; 1.1 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 16 MiB/s rd, 137 MiB/s wr, 345 op/s 2024-09-18T21:12:46.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:46 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:12:46.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:46 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:12:46.764 INFO:tasks.workunit.client.1.smithi103.stdout:7/287: write d1/f4b [4105548,56675] 0 2024-09-18T21:12:46.764 INFO:tasks.workunit.client.1.smithi103.stdout:8/302: truncate d4/d2c/f31 1476931 0 2024-09-18T21:12:46.766 INFO:tasks.workunit.client.1.smithi103.stdout:3/270: rmdir d1/da/df 39 2024-09-18T21:12:46.766 INFO:tasks.workunit.client.1.smithi103.stdout:9/280: dwrite d18/d29/f2a [0,4194304] 0 2024-09-18T21:12:46.770 INFO:tasks.workunit.client.0.smithi077.stdout:5/403: dwrite d0/d43/d6d/f71 [0,4194304] 0 2024-09-18T21:12:46.772 INFO:tasks.workunit.client.0.smithi077.stdout:2/392: dwrite d1/d4/f2f [0,4194304] 0 2024-09-18T21:12:46.773 INFO:tasks.workunit.client.1.smithi103.stdout:4/300: fdatasync d9/d38/d58/f5e 0 2024-09-18T21:12:46.774 INFO:tasks.workunit.client.0.smithi077.stdout:9/191: dread d1/dd/d1a/f1b [0,4194304] 0 2024-09-18T21:12:46.775 INFO:tasks.workunit.client.1.smithi103.stdout:2/238: symlink d3/d5/d2c/d54/l58 0 2024-09-18T21:12:46.775 INFO:tasks.workunit.client.1.smithi103.stdout:2/239: dread - d3/f4d zero size 2024-09-18T21:12:46.781 INFO:tasks.workunit.client.0.smithi077.stdout:1/236: symlink d3/d1e/l58 0 2024-09-18T21:12:46.783 INFO:tasks.workunit.client.1.smithi103.stdout:1/307: creat d0/d2/f6c x:0 0 0 2024-09-18T21:12:46.788 INFO:tasks.workunit.client.1.smithi103.stdout:9/281: dread ff [0,4194304] 0 2024-09-18T21:12:46.789 INFO:tasks.workunit.client.0.smithi077.stdout:3/254: mkdir db/d14/d32/d4f 0 2024-09-18T21:12:46.789 INFO:tasks.workunit.client.0.smithi077.stdout:1/237: dwrite d3/f2a [0,4194304] 0 2024-09-18T21:12:46.790 INFO:tasks.workunit.client.0.smithi077.stdout:5/404: creat d0/df/d10/d47/f93 x:0 0 0 2024-09-18T21:12:46.791 INFO:tasks.workunit.client.1.smithi103.stdout:7/288: mkdir d1/df/d42/d1f/d58 0 2024-09-18T21:12:46.795 INFO:tasks.workunit.client.0.smithi077.stdout:6/336: truncate d7/f1f 3009423 0 2024-09-18T21:12:46.797 INFO:tasks.workunit.client.1.smithi103.stdout:7/289: dwrite d1/f12 [0,4194304] 0 2024-09-18T21:12:46.797 INFO:tasks.workunit.client.0.smithi077.stdout:6/337: truncate d7/f23 902678 0 2024-09-18T21:12:46.798 INFO:tasks.workunit.client.0.smithi077.stdout:8/241: rename d2/d5/d25/d2a/f46 to d2/d5/d6/f52 0 2024-09-18T21:12:46.798 INFO:tasks.workunit.client.0.smithi077.stdout:5/405: dwrite d0/f78 [0,4194304] 0 2024-09-18T21:12:46.798 INFO:tasks.workunit.client.1.smithi103.stdout:7/290: write d1/df/d42/d29/d2f/f4f [180216,123697] 0 2024-09-18T21:12:46.799 INFO:tasks.workunit.client.0.smithi077.stdout:6/338: read d7/df/d11/d1d/d50/f5f [1097498,38427] 0 2024-09-18T21:12:46.800 INFO:tasks.workunit.client.1.smithi103.stdout:7/291: readlink d1/df/l3b 0 2024-09-18T21:12:46.800 INFO:tasks.workunit.client.1.smithi103.stdout:4/301: mkdir d9/d1c/d69 0 2024-09-18T21:12:46.801 INFO:tasks.workunit.client.1.smithi103.stdout:6/308: truncate d2/f4a 196643 0 2024-09-18T21:12:46.801 INFO:tasks.workunit.client.1.smithi103.stdout:7/292: write d1/df/d42/d29/d2f/f4f [245162,70209] 0 2024-09-18T21:12:46.804 INFO:tasks.workunit.client.1.smithi103.stdout:5/294: sync 2024-09-18T21:12:46.807 INFO:tasks.workunit.client.1.smithi103.stdout:1/308: creat d0/d2/d9/dc/d36/f6d x:0 0 0 2024-09-18T21:12:46.809 INFO:tasks.workunit.client.1.smithi103.stdout:1/309: fsync d0/d3/f29 0 2024-09-18T21:12:46.809 INFO:tasks.workunit.client.0.smithi077.stdout:3/255: mkdir db/d14/d22/d36/d39/d50 0 2024-09-18T21:12:46.813 INFO:tasks.workunit.client.0.smithi077.stdout:2/393: mkdir d1/d4/d9/d80/d83 0 2024-09-18T21:12:46.814 INFO:tasks.workunit.client.1.smithi103.stdout:7/293: dwrite d1/df/d42/d1f/d2e/f50 [0,4194304] 0 2024-09-18T21:12:46.814 INFO:tasks.workunit.client.1.smithi103.stdout:3/271: mkdir d1/d34/d50/d54 0 2024-09-18T21:12:46.820 INFO:tasks.workunit.client.0.smithi077.stdout:4/279: write d3/fb [1297554,17926] 0 2024-09-18T21:12:46.823 INFO:tasks.workunit.client.0.smithi077.stdout:4/280: read d3/dc/f1b [2035447,12717] 0 2024-09-18T21:12:46.825 INFO:tasks.workunit.client.1.smithi103.stdout:0/281: truncate d1/d5/d4c/f53 3370024 0 2024-09-18T21:12:46.825 INFO:tasks.workunit.client.1.smithi103.stdout:0/282: dread - d1/d9/d13/f46 zero size 2024-09-18T21:12:46.826 INFO:tasks.workunit.client.1.smithi103.stdout:0/283: chown d1/d5/d4c/d4e 43865 1 2024-09-18T21:12:46.828 INFO:tasks.workunit.client.1.smithi103.stdout:9/282: creat d18/d52/f54 x:0 0 0 2024-09-18T21:12:46.829 INFO:tasks.workunit.client.0.smithi077.stdout:0/383: link d8/d1d/l49 d8/d1a/l7b 0 2024-09-18T21:12:46.832 INFO:tasks.workunit.client.1.smithi103.stdout:1/310: mkdir d0/d2/d9/dc/d6e 0 2024-09-18T21:12:46.833 INFO:tasks.workunit.client.1.smithi103.stdout:1/311: read d0/d3/f4b [303949,121588] 0 2024-09-18T21:12:46.833 INFO:tasks.workunit.client.1.smithi103.stdout:7/294: symlink d1/df/d54/l59 0 2024-09-18T21:12:46.835 INFO:tasks.workunit.client.1.smithi103.stdout:7/295: write d1/df/d42/d1f/d2e/f50 [3572901,10727] 0 2024-09-18T21:12:46.836 INFO:tasks.workunit.client.0.smithi077.stdout:8/242: mknod d2/d5/d6/d22/c53 0 2024-09-18T21:12:46.839 INFO:tasks.workunit.client.1.smithi103.stdout:2/240: link d3/d5/d4a/c51 d3/d5/d25/d40/c59 0 2024-09-18T21:12:46.840 INFO:tasks.workunit.client.0.smithi077.stdout:5/406: symlink d0/df/d10/d4b/d80/l94 0 2024-09-18T21:12:46.840 INFO:tasks.workunit.client.1.smithi103.stdout:5/295: getdents de/d3e/d15 0 2024-09-18T21:12:46.841 INFO:tasks.workunit.client.1.smithi103.stdout:0/284: symlink d1/d5/de/d22/l65 0 2024-09-18T21:12:46.841 INFO:tasks.workunit.client.1.smithi103.stdout:5/296: chown de/d1f/f52 31 1 2024-09-18T21:12:46.842 INFO:tasks.workunit.client.0.smithi077.stdout:0/384: write d8/d1a/f42 [412350,65669] 0 2024-09-18T21:12:46.843 INFO:tasks.workunit.client.1.smithi103.stdout:9/283: readlink d18/l1d 0 2024-09-18T21:12:46.846 INFO:tasks.workunit.client.1.smithi103.stdout:8/303: dwrite f2 [4194304,4194304] 0 2024-09-18T21:12:46.846 INFO:tasks.workunit.client.0.smithi077.stdout:1/238: link d3/d8/d49/d4e/f57 d3/d8/f59 0 2024-09-18T21:12:46.847 INFO:tasks.workunit.client.0.smithi077.stdout:1/239: dread - d3/d8/d13/d18/f4d zero size 2024-09-18T21:12:46.850 INFO:tasks.workunit.client.1.smithi103.stdout:3/272: symlink d1/da/df/l55 0 2024-09-18T21:12:46.851 INFO:tasks.workunit.client.1.smithi103.stdout:0/285: dwrite d1/d9/f52 [0,4194304] 0 2024-09-18T21:12:46.853 INFO:tasks.workunit.client.0.smithi077.stdout:4/281: mknod d3/dc/d32/d45/c59 0 2024-09-18T21:12:46.853 INFO:tasks.workunit.client.0.smithi077.stdout:4/282: stat d3/l2d 0 2024-09-18T21:12:46.854 INFO:tasks.workunit.client.0.smithi077.stdout:4/283: write d3/dc/d20/f2a [926323,61358] 0 2024-09-18T21:12:46.856 INFO:tasks.workunit.client.1.smithi103.stdout:4/302: creat d9/f6a x:0 0 0 2024-09-18T21:12:46.856 INFO:tasks.workunit.client.1.smithi103.stdout:6/309: rename d2/d3/d8/c26 to d2/d3/c5c 0 2024-09-18T21:12:46.857 INFO:tasks.workunit.client.1.smithi103.stdout:3/273: dread d1/da/f3d [0,4194304] 0 2024-09-18T21:12:46.858 INFO:tasks.workunit.client.1.smithi103.stdout:5/297: rmdir de/d3e/d15 39 2024-09-18T21:12:46.859 INFO:tasks.workunit.client.0.smithi077.stdout:2/394: mknod d1/d4/d5/d1a/d2e/d41/c84 0 2024-09-18T21:12:46.860 INFO:tasks.workunit.client.0.smithi077.stdout:1/240: readlink d3/d8/l11 0 2024-09-18T21:12:46.862 INFO:tasks.workunit.client.0.smithi077.stdout:5/407: write d0/f78 [4616373,57399] 0 2024-09-18T21:12:46.864 INFO:tasks.workunit.client.0.smithi077.stdout:2/395: dread d1/fd [4194304,4194304] 0 2024-09-18T21:12:46.865 INFO:tasks.workunit.client.0.smithi077.stdout:4/284: symlink d3/dc/d24/l5a 0 2024-09-18T21:12:46.869 INFO:tasks.workunit.client.0.smithi077.stdout:3/256: getdents db/d14/d32 0 2024-09-18T21:12:46.869 INFO:tasks.workunit.client.0.smithi077.stdout:9/192: truncate d1/df/f21 1565202 0 2024-09-18T21:12:46.869 INFO:tasks.workunit.client.1.smithi103.stdout:1/312: mkdir d0/d2/d9/d10/d5d/d6f 0 2024-09-18T21:12:46.872 INFO:tasks.workunit.client.1.smithi103.stdout:8/304: dwrite d4/de/f1c [0,4194304] 0 2024-09-18T21:12:46.873 INFO:tasks.workunit.client.0.smithi077.stdout:2/396: dwrite d1/d4/d5/d1a/d2e/d40/f7b [0,4194304] 0 2024-09-18T21:12:46.873 INFO:tasks.workunit.client.0.smithi077.stdout:1/241: mkdir d3/d8/d49/d4e/d5a 0 2024-09-18T21:12:46.877 INFO:tasks.workunit.client.0.smithi077.stdout:8/243: rename d2/d5/d6/d22/d20/c4a to d2/d5/d6/c54 0 2024-09-18T21:12:46.878 INFO:tasks.workunit.client.0.smithi077.stdout:6/339: dwrite d7/df/d11/d1d/d31/f3f [0,4194304] 0 2024-09-18T21:12:46.879 INFO:tasks.workunit.client.1.smithi103.stdout:4/303: creat d9/d38/d58/f6b x:0 0 0 2024-09-18T21:12:46.880 INFO:tasks.workunit.client.1.smithi103.stdout:7/296: rmdir d1/df/d54 39 2024-09-18T21:12:46.880 INFO:tasks.workunit.client.1.smithi103.stdout:7/297: chown d1/df 9 1 2024-09-18T21:12:46.881 INFO:tasks.workunit.client.0.smithi077.stdout:5/408: mkdir d0/d6/d3b/d64/d95 0 2024-09-18T21:12:46.882 INFO:tasks.workunit.client.1.smithi103.stdout:7/298: write d1/df/f18 [2370162,66893] 0 2024-09-18T21:12:46.884 INFO:tasks.workunit.client.0.smithi077.stdout:1/242: dread d3/d8/d13/d18/f46 [0,4194304] 0 2024-09-18T21:12:46.884 INFO:tasks.workunit.client.0.smithi077.stdout:5/409: fsync d0/df/d10/f45 0 2024-09-18T21:12:46.889 INFO:tasks.workunit.client.1.smithi103.stdout:3/274: creat d1/d23/d47/f56 x:0 0 0 2024-09-18T21:12:46.889 INFO:tasks.workunit.client.0.smithi077.stdout:9/193: symlink d1/df/d27/l3a 0 2024-09-18T21:12:46.890 INFO:tasks.workunit.client.1.smithi103.stdout:7/299: dwrite d1/df/d42/f45 [0,4194304] 0 2024-09-18T21:12:46.892 INFO:tasks.workunit.client.1.smithi103.stdout:7/300: chown d1/df/d42/l23 88466471 1 2024-09-18T21:12:46.892 INFO:tasks.workunit.client.1.smithi103.stdout:5/298: mkdir de/d1f/d3b/d3c/d62 0 2024-09-18T21:12:46.895 INFO:tasks.workunit.client.1.smithi103.stdout:5/299: chown de/d14/d33/l26 401369 1 2024-09-18T21:12:46.895 INFO:tasks.workunit.client.1.smithi103.stdout:7/301: write d1/df/d42/d1f/f2d [425116,4829] 0 2024-09-18T21:12:46.896 INFO:tasks.workunit.client.0.smithi077.stdout:0/385: rename d8/d1d/d57/f5f to d8/d1a/f7c 0 2024-09-18T21:12:46.897 INFO:tasks.workunit.client.0.smithi077.stdout:3/257: dread db/f13 [0,4194304] 0 2024-09-18T21:12:46.902 INFO:tasks.workunit.client.1.smithi103.stdout:8/305: rename d4/c1b to d4/de/c5c 0 2024-09-18T21:12:46.903 INFO:tasks.workunit.client.0.smithi077.stdout:0/386: dwrite d8/f2f [0,4194304] 0 2024-09-18T21:12:46.906 INFO:tasks.workunit.client.0.smithi077.stdout:1/243: read - d3/f2e zero size 2024-09-18T21:12:46.907 INFO:tasks.workunit.client.1.smithi103.stdout:4/304: symlink d9/d1c/l6c 0 2024-09-18T21:12:46.908 INFO:tasks.workunit.client.1.smithi103.stdout:4/305: chown d9/d38/d58/f5e 1 1 2024-09-18T21:12:46.909 INFO:tasks.workunit.client.0.smithi077.stdout:0/387: dread d8/f2f [0,4194304] 0 2024-09-18T21:12:46.909 INFO:tasks.workunit.client.0.smithi077.stdout:5/410: write d0/df/d3d/f73 [2841241,27645] 0 2024-09-18T21:12:46.914 INFO:tasks.workunit.client.0.smithi077.stdout:2/397: symlink d1/d4/d5/d1a/d2e/d7e/l85 0 2024-09-18T21:12:46.915 INFO:tasks.workunit.client.1.smithi103.stdout:6/310: mknod d2/d3/d4/c5d 0 2024-09-18T21:12:46.917 INFO:tasks.workunit.client.1.smithi103.stdout:3/275: mknod d1/d2/d18/d30/d4e/c57 0 2024-09-18T21:12:46.917 INFO:tasks.workunit.client.1.smithi103.stdout:3/276: stat d1/da/l1d 0 2024-09-18T21:12:46.917 INFO:tasks.workunit.client.1.smithi103.stdout:3/277: readlink d1/da/l1d 0 2024-09-18T21:12:46.918 INFO:tasks.workunit.client.0.smithi077.stdout:9/194: dwrite d1/dd/d1a/f1b [0,4194304] 0 2024-09-18T21:12:46.918 INFO:tasks.workunit.client.1.smithi103.stdout:3/278: fdatasync d1/d34/f36 0 2024-09-18T21:12:46.926 INFO:tasks.workunit.client.1.smithi103.stdout:1/313: fdatasync d0/d2/d9/dc/f22 0 2024-09-18T21:12:46.928 INFO:tasks.workunit.client.0.smithi077.stdout:0/388: chown d8/f19 378 1 2024-09-18T21:12:46.929 INFO:tasks.workunit.client.1.smithi103.stdout:2/241: dwrite d3/d5/f11 [0,4194304] 0 2024-09-18T21:12:46.929 INFO:tasks.workunit.client.1.smithi103.stdout:8/306: stat d4/d2d/d4e/l54 0 2024-09-18T21:12:46.929 INFO:tasks.workunit.client.0.smithi077.stdout:5/411: rmdir d0/d6 39 2024-09-18T21:12:46.930 INFO:tasks.workunit.client.1.smithi103.stdout:2/242: chown d3/d5/d2f/d32 212 1 2024-09-18T21:12:46.930 INFO:tasks.workunit.client.1.smithi103.stdout:0/286: write d1/d5/de/d19/d1e/f21 [696762,91519] 0 2024-09-18T21:12:46.931 INFO:tasks.workunit.client.0.smithi077.stdout:5/412: dread - d0/df/d84/f90 zero size 2024-09-18T21:12:46.931 INFO:tasks.workunit.client.0.smithi077.stdout:9/195: dread d1/df/f12 [0,4194304] 0 2024-09-18T21:12:46.931 INFO:tasks.workunit.client.1.smithi103.stdout:8/307: read d4/de/f43 [2660963,44263] 0 2024-09-18T21:12:46.933 INFO:tasks.workunit.client.1.smithi103.stdout:8/308: truncate f2 8543181 0 2024-09-18T21:12:46.934 INFO:tasks.workunit.client.1.smithi103.stdout:8/309: write d4/de/f3b [317038,8399] 0 2024-09-18T21:12:46.935 INFO:tasks.workunit.client.1.smithi103.stdout:6/311: fdatasync d2/d3/f19 0 2024-09-18T21:12:46.935 INFO:tasks.workunit.client.0.smithi077.stdout:6/340: creat d7/df/d11/f6e x:0 0 0 2024-09-18T21:12:46.938 INFO:tasks.workunit.client.1.smithi103.stdout:9/284: getdents d18/d29 0 2024-09-18T21:12:46.938 INFO:tasks.workunit.client.0.smithi077.stdout:8/244: link d2/d5/l17 d2/d5/d6/d22/d26/l55 0 2024-09-18T21:12:46.941 INFO:tasks.workunit.client.1.smithi103.stdout:2/243: dwrite d3/d5/d25/f45 [0,4194304] 0 2024-09-18T21:12:46.942 INFO:tasks.workunit.client.1.smithi103.stdout:5/300: mknod de/d3e/d15/c63 0 2024-09-18T21:12:46.945 INFO:tasks.workunit.client.0.smithi077.stdout:2/398: mkdir d1/d4/d5/d1a/d2e/d86 0 2024-09-18T21:12:46.946 INFO:tasks.workunit.client.0.smithi077.stdout:3/258: dwrite db/d14/f1d [0,4194304] 0 2024-09-18T21:12:46.946 INFO:tasks.workunit.client.1.smithi103.stdout:7/302: creat d1/df/d54/f5a x:0 0 0 2024-09-18T21:12:46.947 INFO:tasks.workunit.client.0.smithi077.stdout:2/399: chown d1/d4/d5/d1a/d49/c5e 1054 1 2024-09-18T21:12:46.948 INFO:tasks.workunit.client.0.smithi077.stdout:5/413: dread - d0/d6/dd/d5d/f7a zero size 2024-09-18T21:12:46.948 INFO:tasks.workunit.client.1.smithi103.stdout:5/301: dwrite de/d2d/d44/f47 [0,4194304] 0 2024-09-18T21:12:46.948 INFO:tasks.workunit.client.1.smithi103.stdout:1/314: mkdir d0/d11/d5f/d19/d70 0 2024-09-18T21:12:46.951 INFO:tasks.workunit.client.0.smithi077.stdout:6/341: rmdir d7/df/d11/d1d/d50 39 2024-09-18T21:12:46.952 INFO:tasks.workunit.client.1.smithi103.stdout:0/287: creat d1/d5/d4c/d4e/f66 x:0 0 0 2024-09-18T21:12:46.955 INFO:tasks.workunit.client.1.smithi103.stdout:8/310: symlink d4/de/l5d 0 2024-09-18T21:12:46.956 INFO:tasks.workunit.client.1.smithi103.stdout:8/311: chown d4/d2c/d39/l40 165 1 2024-09-18T21:12:46.958 INFO:tasks.workunit.client.0.smithi077.stdout:0/389: creat d8/d1a/d39/d3b/d79/f7d x:0 0 0 2024-09-18T21:12:46.961 INFO:tasks.workunit.client.1.smithi103.stdout:6/312: unlink d2/d3/d8/f47 0 2024-09-18T21:12:46.962 INFO:tasks.workunit.client.0.smithi077.stdout:3/259: mknod db/d14/d22/c51 0 2024-09-18T21:12:46.962 INFO:tasks.workunit.client.0.smithi077.stdout:1/244: truncate d3/d8/f1c 6740969 0 2024-09-18T21:12:46.964 INFO:tasks.workunit.client.0.smithi077.stdout:3/260: dread - db/d14/d22/d36/d39/f45 zero size 2024-09-18T21:12:46.964 INFO:tasks.workunit.client.1.smithi103.stdout:9/285: creat d18/d29/f55 x:0 0 0 2024-09-18T21:12:46.964 INFO:tasks.workunit.client.0.smithi077.stdout:2/400: creat d1/d4/d9/d80/f87 x:0 0 0 2024-09-18T21:12:46.965 INFO:tasks.workunit.client.0.smithi077.stdout:2/401: chown d1/d4/d5/d1a/d2e/d40/d69 234 1 2024-09-18T21:12:46.966 INFO:tasks.workunit.client.1.smithi103.stdout:3/279: dwrite d1/da/f3d [0,4194304] 0 2024-09-18T21:12:46.969 INFO:tasks.workunit.client.0.smithi077.stdout:6/342: stat d7/df/l3b 0 2024-09-18T21:12:46.972 INFO:tasks.workunit.client.1.smithi103.stdout:5/302: chown de/l38 2148344 1 2024-09-18T21:12:46.973 INFO:tasks.workunit.client.0.smithi077.stdout:0/390: unlink d8/f13 0 2024-09-18T21:12:46.974 INFO:tasks.workunit.client.1.smithi103.stdout:3/280: dwrite d1/d2/f8 [0,4194304] 0 2024-09-18T21:12:46.974 INFO:tasks.workunit.client.0.smithi077.stdout:3/261: dread f4 [0,4194304] 0 2024-09-18T21:12:46.975 INFO:tasks.workunit.client.1.smithi103.stdout:4/306: creat d9/f6d x:0 0 0 2024-09-18T21:12:46.977 INFO:tasks.workunit.client.0.smithi077.stdout:3/262: write db/d14/d22/f2f [1452985,57720] 0 2024-09-18T21:12:46.978 INFO:tasks.workunit.client.0.smithi077.stdout:6/343: dwrite d7/df/f2a [4194304,4194304] 0 2024-09-18T21:12:46.980 INFO:tasks.workunit.client.0.smithi077.stdout:9/196: creat d1/df/f3b x:0 0 0 2024-09-18T21:12:46.981 INFO:tasks.workunit.client.1.smithi103.stdout:0/288: rmdir d1/d5 39 2024-09-18T21:12:46.984 INFO:tasks.workunit.client.0.smithi077.stdout:5/414: dread d0/f37 [0,4194304] 0 2024-09-18T21:12:46.984 INFO:tasks.workunit.client.1.smithi103.stdout:6/313: stat d2/d24/d38/c3e 0 2024-09-18T21:12:46.985 INFO:tasks.workunit.client.0.smithi077.stdout:9/197: dread d1/dd/d1a/f23 [0,4194304] 0 2024-09-18T21:12:46.986 INFO:tasks.workunit.client.0.smithi077.stdout:8/245: creat d2/d5/d6/d22/d20/f56 x:0 0 0 2024-09-18T21:12:46.989 INFO:tasks.workunit.client.1.smithi103.stdout:2/244: symlink d3/d5/l5a 0 2024-09-18T21:12:46.990 INFO:tasks.workunit.client.1.smithi103.stdout:7/303: mkdir d1/df/d42/d1f/d58/d5b 0 2024-09-18T21:12:46.991 INFO:tasks.workunit.client.1.smithi103.stdout:2/245: truncate d3/d5/f28 243965 0 2024-09-18T21:12:46.991 INFO:tasks.workunit.client.0.smithi077.stdout:1/245: link d3/d8/d49/d4e/d50/f30 d3/d1e/f5b 0 2024-09-18T21:12:46.992 INFO:tasks.workunit.client.1.smithi103.stdout:5/303: creat de/d1f/d3b/d51/f64 x:0 0 0 2024-09-18T21:12:46.992 INFO:tasks.workunit.client.0.smithi077.stdout:3/263: creat db/d14/d22/d36/d42/f52 x:0 0 0 2024-09-18T21:12:46.993 INFO:tasks.workunit.client.1.smithi103.stdout:5/304: chown de/d3e/l5e 472 1 2024-09-18T21:12:46.993 INFO:tasks.workunit.client.1.smithi103.stdout:3/281: mkdir d1/d23/d25/d4f/d58 0 2024-09-18T21:12:46.996 INFO:tasks.workunit.client.0.smithi077.stdout:2/402: link d1/d4/d9/d24/f74 d1/d4/d5/d1a/d2e/d41/d2c/f88 0 2024-09-18T21:12:46.996 INFO:tasks.workunit.client.1.smithi103.stdout:8/312: mkdir d4/de/d4a/d59/d5e 0 2024-09-18T21:12:46.997 INFO:tasks.workunit.client.0.smithi077.stdout:2/403: write d1/d4/d5/d1a/f6d [75324,85491] 0 2024-09-18T21:12:46.997 INFO:tasks.workunit.client.0.smithi077.stdout:5/415: unlink d0/df/d10/d4b/l4d 0 2024-09-18T21:12:46.998 INFO:tasks.workunit.client.0.smithi077.stdout:2/404: write d1/f2a [788459,97966] 0 2024-09-18T21:12:46.999 INFO:tasks.workunit.client.1.smithi103.stdout:0/289: creat d1/d9/d3e/f67 x:0 0 0 2024-09-18T21:12:46.999 INFO:tasks.workunit.client.0.smithi077.stdout:9/198: symlink d1/dd/d11/d15/l3c 0 2024-09-18T21:12:47.000 INFO:tasks.workunit.client.1.smithi103.stdout:0/290: truncate d1/d9/d13/f3d 743186 0 2024-09-18T21:12:47.002 INFO:tasks.workunit.client.0.smithi077.stdout:0/391: unlink d8/d37/c61 0 2024-09-18T21:12:47.002 INFO:tasks.workunit.client.0.smithi077.stdout:0/392: truncate d8/f6a 381879 0 2024-09-18T21:12:47.002 INFO:tasks.workunit.client.1.smithi103.stdout:2/246: mkdir d3/d5/d2f/d5b 0 2024-09-18T21:12:47.003 INFO:tasks.workunit.client.1.smithi103.stdout:2/247: chown d3/d5/f35 1615 1 2024-09-18T21:12:47.004 INFO:tasks.workunit.client.0.smithi077.stdout:0/393: dread d8/d26/f18 [0,4194304] 0 2024-09-18T21:12:47.004 INFO:tasks.workunit.client.1.smithi103.stdout:2/248: read - d3/d5/d25/f37 zero size 2024-09-18T21:12:47.006 INFO:tasks.workunit.client.1.smithi103.stdout:4/307: fsync d9/d1a/f1e 0 2024-09-18T21:12:47.007 INFO:tasks.workunit.client.0.smithi077.stdout:6/344: truncate d7/f1f 2316651 0 2024-09-18T21:12:47.008 INFO:tasks.workunit.client.1.smithi103.stdout:0/291: dread d1/d9/f54 [0,4194304] 0 2024-09-18T21:12:47.009 INFO:tasks.workunit.client.1.smithi103.stdout:0/292: chown d1/d9/c63 132 1 2024-09-18T21:12:47.012 INFO:tasks.workunit.client.1.smithi103.stdout:9/286: dwrite d18/d1f/d2f/f31 [0,4194304] 0 2024-09-18T21:12:47.012 INFO:tasks.workunit.client.0.smithi077.stdout:5/416: creat d0/df/d3d/d85/f96 x:0 0 0 2024-09-18T21:12:47.016 INFO:tasks.workunit.client.0.smithi077.stdout:8/246: unlink d2/d5/d6/d22/d20/l4d 0 2024-09-18T21:12:47.017 INFO:tasks.workunit.client.0.smithi077.stdout:8/247: readlink d2/d5/d6/l10 0 2024-09-18T21:12:47.017 INFO:tasks.workunit.client.1.smithi103.stdout:2/249: creat d3/d5/d2c/f5c x:0 0 0 2024-09-18T21:12:47.019 INFO:tasks.workunit.client.0.smithi077.stdout:6/345: dread d7/df/d11/d1d/f2e [0,4194304] 0 2024-09-18T21:12:47.022 INFO:tasks.workunit.client.0.smithi077.stdout:3/264: creat db/d14/d32/d4f/f53 x:0 0 0 2024-09-18T21:12:47.025 INFO:tasks.workunit.client.0.smithi077.stdout:5/417: mknod d0/df/d3d/c97 0 2024-09-18T21:12:47.029 INFO:tasks.workunit.client.0.smithi077.stdout:6/346: creat d7/df/d11/d1d/d5c/f6f x:0 0 0 2024-09-18T21:12:47.030 INFO:tasks.workunit.client.0.smithi077.stdout:9/199: dread d1/df/f1e [0,4194304] 0 2024-09-18T21:12:47.031 INFO:tasks.workunit.client.0.smithi077.stdout:9/200: dread - d1/dd/d11/d1c/f25 zero size 2024-09-18T21:12:47.035 INFO:tasks.workunit.client.0.smithi077.stdout:8/248: creat d2/d27/f57 x:0 0 0 2024-09-18T21:12:47.035 INFO:tasks.workunit.client.1.smithi103.stdout:1/315: getdents d0/d11 0 2024-09-18T21:12:47.036 INFO:tasks.workunit.client.1.smithi103.stdout:8/313: mknod d4/d2d/d3d/d42/c5f 0 2024-09-18T21:12:47.036 INFO:tasks.workunit.client.0.smithi077.stdout:0/394: getdents d8/d1a/d35 0 2024-09-18T21:12:47.037 INFO:tasks.workunit.client.1.smithi103.stdout:6/314: creat d2/d24/f5e x:0 0 0 2024-09-18T21:12:47.037 INFO:tasks.workunit.client.1.smithi103.stdout:9/287: mknod d18/d1f/d2f/c56 0 2024-09-18T21:12:47.037 INFO:tasks.workunit.client.1.smithi103.stdout:7/304: link d1/df/d42/d1f/d2e/l36 d1/df/d42/d29/d2f/d33/d51/l5c 0 2024-09-18T21:12:47.037 INFO:tasks.workunit.client.1.smithi103.stdout:3/282: dread d1/d2/d18/f29 [0,4194304] 0 2024-09-18T21:12:47.038 INFO:tasks.workunit.client.1.smithi103.stdout:8/314: write d4/de/f11 [1443596,34250] 0 2024-09-18T21:12:47.039 INFO:tasks.workunit.client.0.smithi077.stdout:5/418: dread d0/d6/dd/f11 [0,4194304] 0 2024-09-18T21:12:47.039 INFO:tasks.workunit.client.0.smithi077.stdout:6/347: dwrite d7/df/d11/d25/f5b [0,4194304] 0 2024-09-18T21:12:47.039 INFO:tasks.workunit.client.1.smithi103.stdout:0/293: mkdir d1/d9/d13/d4f/d68 0 2024-09-18T21:12:47.039 INFO:tasks.workunit.client.1.smithi103.stdout:7/305: chown d1/f1c 1730 1 2024-09-18T21:12:47.043 INFO:tasks.workunit.client.1.smithi103.stdout:1/316: symlink d0/d11/d5f/l71 0 2024-09-18T21:12:47.043 INFO:tasks.workunit.client.0.smithi077.stdout:1/246: write d3/d8/d13/f1f [1172232,91576] 0 2024-09-18T21:12:47.044 INFO:tasks.workunit.client.0.smithi077.stdout:0/395: dread d8/f19 [0,4194304] 0 2024-09-18T21:12:47.044 INFO:tasks.workunit.client.0.smithi077.stdout:1/247: chown d3/d1e 118751 1 2024-09-18T21:12:47.047 INFO:tasks.workunit.client.0.smithi077.stdout:5/419: mkdir d0/df/d10/d4b/d98 0 2024-09-18T21:12:47.047 INFO:tasks.workunit.client.1.smithi103.stdout:2/250: mknod d3/d5/d2f/d5b/c5d 0 2024-09-18T21:12:47.048 INFO:tasks.workunit.client.0.smithi077.stdout:5/420: write d0/d6/dd/f30 [1220003,42946] 0 2024-09-18T21:12:47.049 INFO:tasks.workunit.client.1.smithi103.stdout:9/288: rename d18/d1f/c47 to d18/d1f/d2f/c57 0 2024-09-18T21:12:47.053 INFO:tasks.workunit.client.0.smithi077.stdout:9/201: rename d1/dd/d11/d15/c33 to d1/df/c3d 0 2024-09-18T21:12:47.054 INFO:tasks.workunit.client.0.smithi077.stdout:0/396: symlink d8/d1a/d39/d3b/d79/l7e 0 2024-09-18T21:12:47.055 INFO:tasks.workunit.client.0.smithi077.stdout:0/397: write d8/d26/f38 [1948568,6239] 0 2024-09-18T21:12:47.055 INFO:tasks.workunit.client.0.smithi077.stdout:3/265: truncate db/d14/d22/f2f 581856 0 2024-09-18T21:12:47.057 INFO:tasks.workunit.client.0.smithi077.stdout:1/248: chown d3/d1e/d32/c43 0 1 2024-09-18T21:12:47.062 INFO:tasks.workunit.client.0.smithi077.stdout:3/266: dwrite db/d14/d22/f30 [0,4194304] 0 2024-09-18T21:12:47.062 INFO:tasks.workunit.client.0.smithi077.stdout:9/202: creat d1/dd/d11/f3e x:0 0 0 2024-09-18T21:12:47.064 INFO:tasks.workunit.client.0.smithi077.stdout:9/203: write d1/dd/f14 [914621,42082] 0 2024-09-18T21:12:47.070 INFO:tasks.workunit.client.0.smithi077.stdout:3/267: unlink db/d14/d32/f37 0 2024-09-18T21:12:47.071 INFO:tasks.workunit.client.0.smithi077.stdout:8/249: dwrite d2/d5/d6/d22/d20/d3e/f47 [0,4194304] 0 2024-09-18T21:12:47.072 INFO:tasks.workunit.client.0.smithi077.stdout:3/268: write db/d14/f40 [873489,9483] 0 2024-09-18T21:12:47.074 INFO:tasks.workunit.client.0.smithi077.stdout:1/249: creat d3/d1e/d4c/f5c x:0 0 0 2024-09-18T21:12:47.075 INFO:tasks.workunit.client.0.smithi077.stdout:3/269: write db/d14/f40 [1654212,53013] 0 2024-09-18T21:12:47.076 INFO:tasks.workunit.client.0.smithi077.stdout:6/348: rename d7/df/d11/d25/l67 to d7/df/d11/l70 0 2024-09-18T21:12:47.076 INFO:tasks.workunit.client.0.smithi077.stdout:6/349: stat l5 0 2024-09-18T21:12:47.083 INFO:tasks.workunit.client.0.smithi077.stdout:9/204: rmdir d1/dd/d11 39 2024-09-18T21:12:47.085 INFO:tasks.workunit.client.0.smithi077.stdout:8/250: rename d2/d5/d6/d22/d18/f4e to d2/d27/d29/f58 0 2024-09-18T21:12:47.090 INFO:tasks.workunit.client.0.smithi077.stdout:6/350: truncate d7/f2d 441100 0 2024-09-18T21:12:47.092 INFO:tasks.workunit.client.0.smithi077.stdout:3/270: dwrite db/f35 [0,4194304] 0 2024-09-18T21:12:47.092 INFO:tasks.workunit.client.0.smithi077.stdout:1/250: dwrite d3/d8/d13/f1f [0,4194304] 0 2024-09-18T21:12:47.093 INFO:tasks.workunit.client.0.smithi077.stdout:5/421: dwrite d0/df/f52 [0,4194304] 0 2024-09-18T21:12:47.093 INFO:tasks.workunit.client.0.smithi077.stdout:9/205: fsync d1/dd/d1a/f23 0 2024-09-18T21:12:47.095 INFO:tasks.workunit.client.0.smithi077.stdout:1/251: write d3/d1e/f35 [1201989,24013] 0 2024-09-18T21:12:47.095 INFO:tasks.workunit.client.0.smithi077.stdout:3/271: fsync db/d14/f20 0 2024-09-18T21:12:47.099 INFO:tasks.workunit.client.0.smithi077.stdout:8/251: symlink d2/d5/d6/l59 0 2024-09-18T21:12:47.102 INFO:tasks.workunit.client.0.smithi077.stdout:1/252: creat d3/d8/d13/d18/f5d x:0 0 0 2024-09-18T21:12:47.104 INFO:tasks.workunit.client.0.smithi077.stdout:8/252: rename d2/d5/d25 to d2/d5/d6/d22/d4f/d5a 0 2024-09-18T21:12:47.105 INFO:tasks.workunit.client.0.smithi077.stdout:8/253: chown d2/d5/d6/d22/d20/f24 1460 1 2024-09-18T21:12:47.108 INFO:tasks.workunit.client.0.smithi077.stdout:3/272: creat db/f54 x:0 0 0 2024-09-18T21:12:47.108 INFO:tasks.workunit.client.0.smithi077.stdout:5/422: link d0/d6/lc d0/d6/d3b/d64/d95/l99 0 2024-09-18T21:12:47.109 INFO:tasks.workunit.client.0.smithi077.stdout:1/253: symlink d3/d8/d49/d4e/d5a/l5e 0 2024-09-18T21:12:47.111 INFO:tasks.workunit.client.0.smithi077.stdout:9/206: dread d1/dd/d11/d2d/f32 [0,4194304] 0 2024-09-18T21:12:47.112 INFO:tasks.workunit.client.0.smithi077.stdout:3/273: rename db/d14/f18 to db/d14/d32/f55 0 2024-09-18T21:12:47.116 INFO:tasks.workunit.client.0.smithi077.stdout:1/254: mkdir d3/d5f 0 2024-09-18T21:12:47.120 INFO:tasks.workunit.client.0.smithi077.stdout:5/423: link d0/df/d3d/f73 d0/df/d3d/f9a 0 2024-09-18T21:12:47.121 INFO:tasks.workunit.client.0.smithi077.stdout:9/207: dwrite d1/dd/f14 [0,4194304] 0 2024-09-18T21:12:47.123 INFO:tasks.workunit.client.0.smithi077.stdout:5/424: mkdir d0/df/d10/d5c/d9b 0 2024-09-18T21:12:47.123 INFO:tasks.workunit.client.0.smithi077.stdout:1/255: truncate d3/d8/d13/d18/f51 930229 0 2024-09-18T21:12:47.123 INFO:tasks.workunit.client.0.smithi077.stdout:3/274: dwrite db/f29 [0,4194304] 0 2024-09-18T21:12:47.127 INFO:tasks.workunit.client.0.smithi077.stdout:1/256: write d3/d1e/d32/f53 [26793,37357] 0 2024-09-18T21:12:47.128 INFO:tasks.workunit.client.0.smithi077.stdout:1/257: write d3/d1e/d32/f44 [985954,39429] 0 2024-09-18T21:12:47.129 INFO:tasks.workunit.client.0.smithi077.stdout:9/208: rename d1/df/d27/c36 to d1/c3f 0 2024-09-18T21:12:47.133 INFO:tasks.workunit.client.0.smithi077.stdout:9/209: symlink d1/dd/d1a/l40 0 2024-09-18T21:12:47.134 INFO:tasks.workunit.client.0.smithi077.stdout:3/275: link db/d14/f20 db/d14/d32/f56 0 2024-09-18T21:12:47.137 INFO:tasks.workunit.client.0.smithi077.stdout:1/258: creat d3/d38/f60 x:0 0 0 2024-09-18T21:12:47.138 INFO:tasks.workunit.client.0.smithi077.stdout:5/425: getdents d0/df/d84 0 2024-09-18T21:12:47.138 INFO:tasks.workunit.client.0.smithi077.stdout:1/259: stat d3/d8/f17 0 2024-09-18T21:12:47.138 INFO:tasks.workunit.client.0.smithi077.stdout:3/276: creat db/d14/d22/d36/d39/f57 x:0 0 0 2024-09-18T21:12:47.139 INFO:tasks.workunit.client.0.smithi077.stdout:1/260: fsync d3/d8/d49/d4e/d50/f2c 0 2024-09-18T21:12:47.141 INFO:tasks.workunit.client.0.smithi077.stdout:5/426: unlink d0/d6/d3b/d64/d67/c8c 0 2024-09-18T21:12:47.141 INFO:tasks.workunit.client.0.smithi077.stdout:1/261: write d3/d8/d13/d18/f51 [1115841,55135] 0 2024-09-18T21:12:47.142 INFO:tasks.workunit.client.0.smithi077.stdout:1/262: write d3/d1e/f55 [530874,15723] 0 2024-09-18T21:12:47.142 INFO:tasks.workunit.client.0.smithi077.stdout:5/427: write d0/d6/f48 [4050111,110446] 0 2024-09-18T21:12:47.145 INFO:tasks.workunit.client.0.smithi077.stdout:1/263: creat d3/d8/d49/d4e/d50/d3d/f61 x:0 0 0 2024-09-18T21:12:47.146 INFO:tasks.workunit.client.0.smithi077.stdout:1/264: fdatasync d3/d1e/d32/f42 0 2024-09-18T21:12:47.147 INFO:tasks.workunit.client.0.smithi077.stdout:5/428: truncate d0/df/d10/f45 584141 0 2024-09-18T21:12:47.148 INFO:tasks.workunit.client.0.smithi077.stdout:5/429: truncate d0/d6/d3b/f4e 4197258 0 2024-09-18T21:12:47.149 INFO:tasks.workunit.client.0.smithi077.stdout:1/265: creat d3/d8/d49/f62 x:0 0 0 2024-09-18T21:12:47.149 INFO:tasks.workunit.client.1.smithi103.stdout:1/317: dwrite d0/d2/d9/d10/f44 [0,4194304] 0 2024-09-18T21:12:47.150 INFO:tasks.workunit.client.0.smithi077.stdout:1/266: fdatasync d3/d8/d13/f2b 0 2024-09-18T21:12:47.151 INFO:tasks.workunit.client.1.smithi103.stdout:1/318: readlink d0/d11/d5f/l58 0 2024-09-18T21:12:47.153 INFO:tasks.workunit.client.1.smithi103.stdout:6/315: creat d2/d24/f5f x:0 0 0 2024-09-18T21:12:47.157 INFO:tasks.workunit.client.1.smithi103.stdout:9/289: rename f13 to d18/d1f/f58 0 2024-09-18T21:12:47.158 INFO:tasks.workunit.client.0.smithi077.stdout:5/430: dwrite d0/d6/d3b/d64/f6c [0,4194304] 0 2024-09-18T21:12:47.158 INFO:tasks.workunit.client.1.smithi103.stdout:9/290: stat d18/f22 0 2024-09-18T21:12:47.159 INFO:tasks.workunit.client.1.smithi103.stdout:1/319: mkdir d0/d2/d2b/d3a/d42/d72 0 2024-09-18T21:12:47.160 INFO:tasks.workunit.client.1.smithi103.stdout:8/315: dwrite d4/d26/f1d [0,4194304] 0 2024-09-18T21:12:47.161 INFO:tasks.workunit.client.1.smithi103.stdout:0/294: truncate d1/d5/de/d24/f38 1025392 0 2024-09-18T21:12:47.161 INFO:tasks.workunit.client.1.smithi103.stdout:2/251: dwrite d3/d5/f4c [0,4194304] 0 2024-09-18T21:12:47.163 INFO:tasks.workunit.client.0.smithi077.stdout:1/267: dwrite d3/f23 [0,4194304] 0 2024-09-18T21:12:47.165 INFO:tasks.workunit.client.0.smithi077.stdout:5/431: dread d0/d43/d6d/f71 [0,4194304] 0 2024-09-18T21:12:47.166 INFO:tasks.workunit.client.1.smithi103.stdout:9/291: creat d18/d29/f59 x:0 0 0 2024-09-18T21:12:47.168 INFO:tasks.workunit.client.0.smithi077.stdout:1/268: rename d3/d1e/d32/f53 to d3/d8/d49/d4e/d50/d3d/f63 0 2024-09-18T21:12:47.169 INFO:tasks.workunit.client.0.smithi077.stdout:1/269: chown d3/d1e/l58 375229 1 2024-09-18T21:12:47.172 INFO:tasks.workunit.client.1.smithi103.stdout:2/252: creat d3/d5/d4a/f5e x:0 0 0 2024-09-18T21:12:47.173 INFO:tasks.workunit.client.1.smithi103.stdout:2/253: readlink d3/d5/l24 0 2024-09-18T21:12:47.173 INFO:tasks.workunit.client.0.smithi077.stdout:5/432: dwrite d0/f78 [0,4194304] 0 2024-09-18T21:12:47.174 INFO:tasks.workunit.client.1.smithi103.stdout:2/254: read d3/d5/f11 [299929,82069] 0 2024-09-18T21:12:47.176 INFO:tasks.workunit.client.0.smithi077.stdout:5/433: chown d0/d6/dd/d5d/f7a 137210 1 2024-09-18T21:12:47.177 INFO:tasks.workunit.client.1.smithi103.stdout:9/292: dread - d18/f38 zero size 2024-09-18T21:12:47.178 INFO:tasks.workunit.client.1.smithi103.stdout:1/320: mknod d0/d2/d9/d10/d5d/d6f/c73 0 2024-09-18T21:12:47.179 INFO:tasks.workunit.client.0.smithi077.stdout:1/270: dwrite d3/f2a [0,4194304] 0 2024-09-18T21:12:47.180 INFO:tasks.workunit.client.1.smithi103.stdout:9/293: write d18/d1f/d2f/f4f [447699,16624] 0 2024-09-18T21:12:47.181 INFO:tasks.workunit.client.1.smithi103.stdout:8/316: mknod d4/d26/d56/c60 0 2024-09-18T21:12:47.181 INFO:tasks.workunit.client.1.smithi103.stdout:9/294: stat d18/d29/c42 0 2024-09-18T21:12:47.182 INFO:tasks.workunit.client.0.smithi077.stdout:3/277: dread db/d14/d32/f56 [0,4194304] 0 2024-09-18T21:12:47.182 INFO:tasks.workunit.client.0.smithi077.stdout:3/278: read - db/f28 zero size 2024-09-18T21:12:47.182 INFO:tasks.workunit.client.0.smithi077.stdout:3/279: stat db/d14 0 2024-09-18T21:12:47.185 INFO:tasks.workunit.client.0.smithi077.stdout:3/280: fsync fa 0 2024-09-18T21:12:47.186 INFO:tasks.workunit.client.1.smithi103.stdout:0/295: creat d1/d5/de/d19/d1e/d34/f69 x:0 0 0 2024-09-18T21:12:47.187 INFO:tasks.workunit.client.0.smithi077.stdout:1/271: creat d3/d8/d13/d18/f64 x:0 0 0 2024-09-18T21:12:47.187 INFO:tasks.workunit.client.0.smithi077.stdout:3/281: chown db/d14/c31 42912975 1 2024-09-18T21:12:47.188 INFO:tasks.workunit.client.0.smithi077.stdout:3/282: fdatasync db/d14/d22/d36/d39/f45 0 2024-09-18T21:12:47.190 INFO:tasks.workunit.client.1.smithi103.stdout:6/316: getdents d2 0 2024-09-18T21:12:47.190 INFO:tasks.workunit.client.1.smithi103.stdout:2/255: truncate d3/d5/d25/f33 2448770 0 2024-09-18T21:12:47.193 INFO:tasks.workunit.client.1.smithi103.stdout:9/295: dwrite d18/f38 [0,4194304] 0 2024-09-18T21:12:47.193 INFO:tasks.workunit.client.1.smithi103.stdout:8/317: chown d4/d26/c29 63705 1 2024-09-18T21:12:47.194 INFO:tasks.workunit.client.1.smithi103.stdout:9/296: dread - d18/d29/f55 zero size 2024-09-18T21:12:47.194 INFO:tasks.workunit.client.1.smithi103.stdout:8/318: chown d4/d2d/f33 2005786786 1 2024-09-18T21:12:47.194 INFO:tasks.workunit.client.0.smithi077.stdout:1/272: creat d3/d8/d49/f65 x:0 0 0 2024-09-18T21:12:47.195 INFO:tasks.workunit.client.1.smithi103.stdout:0/296: mkdir d1/d5/de/d22/d6a 0 2024-09-18T21:12:47.195 INFO:tasks.workunit.client.1.smithi103.stdout:1/321: symlink d0/d2/d9/l74 0 2024-09-18T21:12:47.196 INFO:tasks.workunit.client.0.smithi077.stdout:3/283: link db/d14/f1d db/d14/d22/f58 0 2024-09-18T21:12:47.199 INFO:tasks.workunit.client.1.smithi103.stdout:0/297: truncate d1/d9/d13/f3d 861577 0 2024-09-18T21:12:47.199 INFO:tasks.workunit.client.1.smithi103.stdout:8/319: mknod d4/de/d4a/d59/d5e/c61 0 2024-09-18T21:12:47.200 INFO:tasks.workunit.client.1.smithi103.stdout:5/305: sync 2024-09-18T21:12:47.200 INFO:tasks.workunit.client.1.smithi103.stdout:6/317: dwrite d2/d3/f55 [0,4194304] 0 2024-09-18T21:12:47.201 INFO:tasks.workunit.client.1.smithi103.stdout:1/322: rename d0/d11/l24 to d0/d11/l75 0 2024-09-18T21:12:47.201 INFO:tasks.workunit.client.1.smithi103.stdout:0/298: chown d1/d5/de/l4d 6 1 2024-09-18T21:12:47.203 INFO:tasks.workunit.client.0.smithi077.stdout:3/284: symlink db/d14/d22/d36/d39/d50/l59 0 2024-09-18T21:12:47.203 INFO:tasks.workunit.client.0.smithi077.stdout:1/273: dwrite d3/d8/d13/d18/f4d [0,4194304] 0 2024-09-18T21:12:47.203 INFO:tasks.workunit.client.1.smithi103.stdout:0/299: write d1/fd [4710848,69483] 0 2024-09-18T21:12:47.204 INFO:tasks.workunit.client.0.smithi077.stdout:1/274: write d3/f2a [4501311,15110] 0 2024-09-18T21:12:47.205 INFO:tasks.workunit.client.1.smithi103.stdout:8/320: creat d4/d26/d56/f62 x:0 0 0 2024-09-18T21:12:47.208 INFO:tasks.workunit.client.0.smithi077.stdout:3/285: creat db/d14/d22/f5a x:0 0 0 2024-09-18T21:12:47.209 INFO:tasks.workunit.client.1.smithi103.stdout:0/300: chown d1/f12 331 1 2024-09-18T21:12:47.212 INFO:tasks.workunit.client.1.smithi103.stdout:6/318: mknod d2/d3/d8/d4c/c60 0 2024-09-18T21:12:47.213 INFO:tasks.workunit.client.1.smithi103.stdout:8/321: symlink d4/d2d/d4e/l63 0 2024-09-18T21:12:47.213 INFO:tasks.workunit.client.1.smithi103.stdout:5/306: dwrite de/d1f/f52 [0,4194304] 0 2024-09-18T21:12:47.217 INFO:tasks.workunit.client.0.smithi077.stdout:1/275: dwrite d3/d8/d13/d18/f4d [0,4194304] 0 2024-09-18T21:12:47.218 INFO:tasks.workunit.client.1.smithi103.stdout:8/322: write d4/ff [3852416,61298] 0 2024-09-18T21:12:47.219 INFO:tasks.workunit.client.0.smithi077.stdout:3/286: dwrite db/d14/d22/f5a [0,4194304] 0 2024-09-18T21:12:47.219 INFO:tasks.workunit.client.1.smithi103.stdout:0/301: getdents d1/d5 0 2024-09-18T21:12:47.219 INFO:tasks.workunit.client.1.smithi103.stdout:1/323: dwrite d0/f7 [4194304,4194304] 0 2024-09-18T21:12:47.223 INFO:tasks.workunit.client.1.smithi103.stdout:6/319: creat d2/d3/d8/d4c/f61 x:0 0 0 2024-09-18T21:12:47.225 INFO:tasks.workunit.client.0.smithi077.stdout:3/287: symlink db/d14/d22/d36/d39/d50/l5b 0 2024-09-18T21:12:47.226 INFO:tasks.workunit.client.0.smithi077.stdout:3/288: fsync db/d14/d22/d36/d42/f46 0 2024-09-18T21:12:47.228 INFO:tasks.workunit.client.1.smithi103.stdout:0/302: mknod d1/d9/d13/c6b 0 2024-09-18T21:12:47.231 INFO:tasks.workunit.client.1.smithi103.stdout:8/323: dwrite d4/de/f1e [0,4194304] 0 2024-09-18T21:12:47.234 INFO:tasks.workunit.client.1.smithi103.stdout:6/320: creat d2/d3/d8/f62 x:0 0 0 2024-09-18T21:12:47.235 INFO:tasks.workunit.client.1.smithi103.stdout:8/324: fsync d4/d26/f8 0 2024-09-18T21:12:47.236 INFO:tasks.workunit.client.1.smithi103.stdout:2/256: getdents d3/d5/d4a 0 2024-09-18T21:12:47.236 INFO:tasks.workunit.client.1.smithi103.stdout:6/321: dread - d2/d3/d8/d4c/f61 zero size 2024-09-18T21:12:47.236 INFO:tasks.workunit.client.0.smithi077.stdout:5/434: write d0/df/f27 [2858838,33671] 0 2024-09-18T21:12:47.237 INFO:tasks.workunit.client.1.smithi103.stdout:0/303: getdents d1/d9/d48 0 2024-09-18T21:12:47.243 INFO:tasks.workunit.client.0.smithi077.stdout:5/435: truncate d0/df/d10/f45 1358942 0 2024-09-18T21:12:47.246 INFO:tasks.workunit.client.1.smithi103.stdout:8/325: dwrite d4/d26/f1a [0,4194304] 0 2024-09-18T21:12:47.247 INFO:tasks.workunit.client.1.smithi103.stdout:8/326: chown d4/de/c38 214540683 1 2024-09-18T21:12:47.249 INFO:tasks.workunit.client.1.smithi103.stdout:1/324: readlink d0/d11/l75 0 2024-09-18T21:12:47.251 INFO:tasks.workunit.client.1.smithi103.stdout:8/327: rename d4/c52 to d4/d2d/d3d/d42/c64 0 2024-09-18T21:12:47.254 INFO:tasks.workunit.client.1.smithi103.stdout:1/325: symlink d0/d3/d68/l76 0 2024-09-18T21:12:47.255 INFO:tasks.workunit.client.1.smithi103.stdout:8/328: write d4/de/f43 [3976021,122745] 0 2024-09-18T21:12:47.256 INFO:tasks.workunit.client.1.smithi103.stdout:8/329: readlink d4/de/l2b 0 2024-09-18T21:12:47.257 INFO:tasks.workunit.client.1.smithi103.stdout:8/330: chown d4/de/f1e 51631 1 2024-09-18T21:12:47.259 INFO:tasks.workunit.client.1.smithi103.stdout:1/326: link d0/d2/d9/c56 d0/d2/d9/d10/c77 0 2024-09-18T21:12:47.261 INFO:tasks.workunit.client.1.smithi103.stdout:8/331: rename d4/d2c to d4/d2d/d3d/d42/d65 0 2024-09-18T21:12:47.262 INFO:tasks.workunit.client.1.smithi103.stdout:1/327: symlink d0/d2/d2b/l78 0 2024-09-18T21:12:47.263 INFO:tasks.workunit.client.0.smithi077.stdout:1/276: write d3/d8/d13/f14 [3345049,120598] 0 2024-09-18T21:12:47.263 INFO:tasks.workunit.client.0.smithi077.stdout:3/289: truncate db/d14/d22/f30 36874 0 2024-09-18T21:12:47.264 INFO:tasks.workunit.client.1.smithi103.stdout:8/332: read d4/de/f46 [1449373,22849] 0 2024-09-18T21:12:47.264 INFO:tasks.workunit.client.0.smithi077.stdout:3/290: stat db/d14/d22/c25 0 2024-09-18T21:12:47.264 INFO:tasks.workunit.client.0.smithi077.stdout:1/277: mknod d3/d1e/d4c/c66 0 2024-09-18T21:12:47.265 INFO:tasks.workunit.client.0.smithi077.stdout:1/278: dread - d3/d8/d13/d18/f64 zero size 2024-09-18T21:12:47.266 INFO:tasks.workunit.client.1.smithi103.stdout:5/307: dwrite de/d14/f22 [0,4194304] 0 2024-09-18T21:12:47.266 INFO:tasks.workunit.client.1.smithi103.stdout:1/328: truncate d0/d2/d9/d10/f67 823301 0 2024-09-18T21:12:47.267 INFO:tasks.workunit.client.0.smithi077.stdout:3/291: mkdir db/d14/d22/d36/d39/d50/d5c 0 2024-09-18T21:12:47.267 INFO:tasks.workunit.client.0.smithi077.stdout:5/436: write d0/df/d3d/f73 [3094921,50484] 0 2024-09-18T21:12:47.271 INFO:tasks.workunit.client.1.smithi103.stdout:2/257: truncate d3/f9 5621685 0 2024-09-18T21:12:47.271 INFO:tasks.workunit.client.1.smithi103.stdout:0/304: truncate d1/f29 3532313 0 2024-09-18T21:12:47.271 INFO:tasks.workunit.client.1.smithi103.stdout:5/308: creat de/d2d/d44/f65 x:0 0 0 2024-09-18T21:12:47.273 INFO:tasks.workunit.client.1.smithi103.stdout:6/322: dread d2/f22 [0,4194304] 0 2024-09-18T21:12:47.274 INFO:tasks.workunit.client.1.smithi103.stdout:5/309: fdatasync de/d2d/d44/f47 0 2024-09-18T21:12:47.274 INFO:tasks.workunit.client.0.smithi077.stdout:5/437: fdatasync d0/f37 0 2024-09-18T21:12:47.275 INFO:tasks.workunit.client.0.smithi077.stdout:3/292: creat db/d14/d22/d36/d42/f5d x:0 0 0 2024-09-18T21:12:47.276 INFO:tasks.workunit.client.1.smithi103.stdout:2/258: creat d3/d5/d25/f5f x:0 0 0 2024-09-18T21:12:47.277 INFO:tasks.workunit.client.1.smithi103.stdout:2/259: read - d3/d5/d2c/f43 zero size 2024-09-18T21:12:47.277 INFO:tasks.workunit.client.0.smithi077.stdout:5/438: mknod d0/d6/d40/c9c 0 2024-09-18T21:12:47.279 INFO:tasks.workunit.client.1.smithi103.stdout:6/323: write d2/f12 [4091646,44700] 0 2024-09-18T21:12:47.279 INFO:tasks.workunit.client.0.smithi077.stdout:1/279: creat d3/d8/f67 x:0 0 0 2024-09-18T21:12:47.281 INFO:tasks.workunit.client.0.smithi077.stdout:5/439: truncate d0/df/d10/d4b/f65 73750 0 2024-09-18T21:12:47.282 INFO:tasks.workunit.client.1.smithi103.stdout:1/329: truncate d0/d11/d5f/d19/f34 634010 0 2024-09-18T21:12:47.283 INFO:tasks.workunit.client.0.smithi077.stdout:1/280: rename d3/d1e/d32 to d3/d1e/d68 0 2024-09-18T21:12:47.285 INFO:tasks.workunit.client.1.smithi103.stdout:0/305: symlink d1/d56/d62/l6c 0 2024-09-18T21:12:47.286 INFO:tasks.workunit.client.1.smithi103.stdout:2/260: creat d3/d5/d2f/d32/f60 x:0 0 0 2024-09-18T21:12:47.287 INFO:tasks.workunit.client.0.smithi077.stdout:5/440: dwrite d0/d6/d3b/d64/f6c [0,4194304] 0 2024-09-18T21:12:47.289 INFO:tasks.workunit.client.1.smithi103.stdout:8/333: getdents d4/de/d4a/d59/d5e 0 2024-09-18T21:12:47.295 INFO:tasks.workunit.client.1.smithi103.stdout:5/310: rename de/d1f/c50 to de/d14/c66 0 2024-09-18T21:12:47.296 INFO:tasks.workunit.client.1.smithi103.stdout:0/306: mkdir d1/d5/de/d19/d1e/d6d 0 2024-09-18T21:12:47.298 INFO:tasks.workunit.client.0.smithi077.stdout:1/281: getdents d3/d8 0 2024-09-18T21:12:47.298 INFO:tasks.workunit.client.0.smithi077.stdout:3/293: write db/d14/d22/f2f [755335,92716] 0 2024-09-18T21:12:47.301 INFO:tasks.workunit.client.1.smithi103.stdout:0/307: mkdir d1/d9/d3e/d6e 0 2024-09-18T21:12:47.302 INFO:tasks.workunit.client.1.smithi103.stdout:8/334: dwrite d4/d26/d56/f62 [0,4194304] 0 2024-09-18T21:12:47.305 INFO:tasks.workunit.client.0.smithi077.stdout:3/294: dwrite db/d14/f34 [0,4194304] 0 2024-09-18T21:12:47.308 INFO:tasks.workunit.client.1.smithi103.stdout:5/311: truncate de/d14/d33/f46 214170 0 2024-09-18T21:12:47.309 INFO:tasks.workunit.client.0.smithi077.stdout:3/295: mknod db/d14/d32/d49/c5e 0 2024-09-18T21:12:47.310 INFO:tasks.workunit.client.1.smithi103.stdout:5/312: readlink de/d14/l42 0 2024-09-18T21:12:47.310 INFO:tasks.workunit.client.0.smithi077.stdout:5/441: truncate d0/df/d10/f26 3661936 0 2024-09-18T21:12:47.310 INFO:tasks.workunit.client.0.smithi077.stdout:3/296: fdatasync db/f13 0 2024-09-18T21:12:47.310 INFO:tasks.workunit.client.0.smithi077.stdout:5/442: dread - d0/df/d84/f90 zero size 2024-09-18T21:12:47.311 INFO:tasks.workunit.client.0.smithi077.stdout:3/297: chown db/d14/d22/d36/c44 0 1 2024-09-18T21:12:47.312 INFO:tasks.workunit.client.0.smithi077.stdout:4/285: sync 2024-09-18T21:12:47.312 INFO:tasks.workunit.client.0.smithi077.stdout:7/362: sync 2024-09-18T21:12:47.312 INFO:tasks.workunit.client.0.smithi077.stdout:2/405: sync 2024-09-18T21:12:47.314 INFO:tasks.workunit.client.0.smithi077.stdout:7/363: write d12/d22/f64 [729358,39027] 0 2024-09-18T21:12:47.315 INFO:tasks.workunit.client.0.smithi077.stdout:1/282: write d3/d8/f1c [2762437,54983] 0 2024-09-18T21:12:47.317 INFO:tasks.workunit.client.0.smithi077.stdout:7/364: write d12/d56/f3a [409268,18231] 0 2024-09-18T21:12:47.318 INFO:tasks.workunit.client.1.smithi103.stdout:0/308: creat d1/d5/de/f6f x:0 0 0 2024-09-18T21:12:47.320 INFO:tasks.workunit.client.0.smithi077.stdout:4/286: mkdir d3/dc/d32/d5b 0 2024-09-18T21:12:47.321 INFO:tasks.workunit.client.0.smithi077.stdout:4/287: fdatasync d3/dc/f16 0 2024-09-18T21:12:47.324 INFO:tasks.workunit.client.0.smithi077.stdout:3/298: symlink db/d14/d32/d3a/l5f 0 2024-09-18T21:12:47.324 INFO:tasks.workunit.client.1.smithi103.stdout:0/309: creat d1/d5/de/d19/d1e/d34/f70 x:0 0 0 2024-09-18T21:12:47.324 INFO:tasks.workunit.client.1.smithi103.stdout:8/335: getdents d4/d26/d56 0 2024-09-18T21:12:47.325 INFO:tasks.workunit.client.1.smithi103.stdout:0/310: read - d1/d5/de/d19/d1e/d34/f70 zero size 2024-09-18T21:12:47.326 INFO:tasks.workunit.client.1.smithi103.stdout:8/336: write d4/d26/f1d [1277355,110825] 0 2024-09-18T21:12:47.326 INFO:tasks.workunit.client.0.smithi077.stdout:7/365: rename d12/d22/d59/d72/d68/f76 to d12/d31/d33/d2a/f82 0 2024-09-18T21:12:47.326 INFO:tasks.workunit.client.0.smithi077.stdout:7/366: readlink d12/l13 0 2024-09-18T21:12:47.328 INFO:tasks.workunit.client.0.smithi077.stdout:5/443: link d0/df/d10/f44 d0/df/d10/f9d 0 2024-09-18T21:12:47.329 INFO:tasks.workunit.client.1.smithi103.stdout:0/311: dread d1/f36 [0,4194304] 0 2024-09-18T21:12:47.329 INFO:tasks.workunit.client.0.smithi077.stdout:3/299: dwrite db/d14/f40 [0,4194304] 0 2024-09-18T21:12:47.330 INFO:tasks.workunit.client.1.smithi103.stdout:0/312: write d1/f18 [2105048,48303] 0 2024-09-18T21:12:47.330 INFO:tasks.workunit.client.0.smithi077.stdout:5/444: chown d0/df/d10/d5c/d74/l5a 37868441 1 2024-09-18T21:12:47.331 INFO:tasks.workunit.client.1.smithi103.stdout:0/313: write d1/d9/f5c [377309,40292] 0 2024-09-18T21:12:47.334 INFO:tasks.workunit.client.1.smithi103.stdout:8/337: unlink c0 0 2024-09-18T21:12:47.338 INFO:tasks.workunit.client.0.smithi077.stdout:1/283: link d3/d8/d49/d4e/d50/d3d/f61 d3/d8/d49/d4e/d5a/f69 0 2024-09-18T21:12:47.339 INFO:tasks.workunit.client.1.smithi103.stdout:5/313: truncate de/d14/f22 2537197 0 2024-09-18T21:12:47.339 INFO:tasks.workunit.client.1.smithi103.stdout:5/314: readlink de/l38 0 2024-09-18T21:12:47.340 INFO:tasks.workunit.client.0.smithi077.stdout:3/300: dwrite db/d14/d22/d36/d42/f46 [0,4194304] 0 2024-09-18T21:12:47.342 INFO:tasks.workunit.client.0.smithi077.stdout:7/367: rmdir d12/d22/d59/d5d/d62 39 2024-09-18T21:12:47.346 INFO:tasks.workunit.client.0.smithi077.stdout:5/445: symlink d0/df/d10/d5c/d74/l9e 0 2024-09-18T21:12:47.347 INFO:tasks.workunit.client.1.smithi103.stdout:8/338: creat d4/de/d4a/f66 x:0 0 0 2024-09-18T21:12:47.347 INFO:tasks.workunit.client.0.smithi077.stdout:5/446: stat d0/d6/dd/d5d/d91 0 2024-09-18T21:12:47.348 INFO:tasks.workunit.client.0.smithi077.stdout:2/406: dwrite d1/d4/d5/d1a/d2e/d40/f44 [0,4194304] 0 2024-09-18T21:12:47.349 INFO:tasks.workunit.client.0.smithi077.stdout:4/288: creat d3/d7/d42/f5c x:0 0 0 2024-09-18T21:12:47.349 INFO:tasks.workunit.client.0.smithi077.stdout:5/447: write d0/df/d3d/f73 [2471314,73438] 0 2024-09-18T21:12:47.351 INFO:tasks.workunit.client.1.smithi103.stdout:5/315: chown de/d14/c66 3279 1 2024-09-18T21:12:47.351 INFO:tasks.workunit.client.0.smithi077.stdout:5/448: readlink d0/df/d10/d5c/d74/l9e 0 2024-09-18T21:12:47.352 INFO:tasks.workunit.client.1.smithi103.stdout:0/314: link d1/d5/de/d19/d1e/d34/f69 d1/d9/d13/f71 0 2024-09-18T21:12:47.354 INFO:tasks.workunit.client.1.smithi103.stdout:8/339: dwrite d4/d26/d56/f62 [0,4194304] 0 2024-09-18T21:12:47.354 INFO:tasks.workunit.client.1.smithi103.stdout:4/308: sync 2024-09-18T21:12:47.356 INFO:tasks.workunit.client.0.smithi077.stdout:5/449: dread d0/d6/d3b/d64/f6c [0,4194304] 0 2024-09-18T21:12:47.357 INFO:tasks.workunit.client.0.smithi077.stdout:5/450: stat d0/df/d10/d5c/f72 0 2024-09-18T21:12:47.358 INFO:tasks.workunit.client.0.smithi077.stdout:3/301: creat db/d14/d32/d4f/f60 x:0 0 0 2024-09-18T21:12:47.365 INFO:tasks.workunit.client.1.smithi103.stdout:5/316: creat de/d1f/d3b/d58/f67 x:0 0 0 2024-09-18T21:12:47.365 INFO:tasks.workunit.client.0.smithi077.stdout:3/302: dwrite f3 [0,4194304] 0 2024-09-18T21:12:47.365 INFO:tasks.workunit.client.1.smithi103.stdout:5/317: chown de/d3e/d15/f2e 3830179 1 2024-09-18T21:12:47.368 INFO:tasks.workunit.client.1.smithi103.stdout:8/340: fdatasync d4/d2d/d3d/d42/d65/f31 0 2024-09-18T21:12:47.368 INFO:tasks.workunit.client.0.smithi077.stdout:1/284: mkdir d3/d6a 0 2024-09-18T21:12:47.370 INFO:tasks.workunit.client.0.smithi077.stdout:7/368: dread fb [0,4194304] 0 2024-09-18T21:12:47.370 INFO:tasks.workunit.client.1.smithi103.stdout:0/315: dread d1/d5/fc [0,4194304] 0 2024-09-18T21:12:47.371 INFO:tasks.workunit.client.0.smithi077.stdout:5/451: rename d0/d6/c14 to d0/df/d10/d5c/c9f 0 2024-09-18T21:12:47.375 INFO:tasks.workunit.client.1.smithi103.stdout:4/309: rename d9/d1a/d41/f67 to d9/f6e 0 2024-09-18T21:12:47.376 INFO:tasks.workunit.client.0.smithi077.stdout:1/285: symlink d3/d1e/d68/l6b 0 2024-09-18T21:12:47.376 INFO:tasks.workunit.client.1.smithi103.stdout:0/316: dread - d1/d5/de/d19/d1e/f5f zero size 2024-09-18T21:12:47.376 INFO:tasks.workunit.client.0.smithi077.stdout:1/286: fdatasync d3/f23 0 2024-09-18T21:12:47.377 INFO:tasks.workunit.client.0.smithi077.stdout:7/369: creat d12/d31/f83 x:0 0 0 2024-09-18T21:12:47.379 INFO:tasks.workunit.client.0.smithi077.stdout:7/370: write d12/f78 [129765,58521] 0 2024-09-18T21:12:47.380 INFO:tasks.workunit.client.0.smithi077.stdout:3/303: getdents db/d14/d22/d36/d39/d50/d5c 0 2024-09-18T21:12:47.380 INFO:tasks.workunit.client.1.smithi103.stdout:0/317: dread d1/d9/d13/f3d [0,4194304] 0 2024-09-18T21:12:47.380 INFO:tasks.workunit.client.1.smithi103.stdout:4/310: read d9/d2e/f40 [2380813,91009] 0 2024-09-18T21:12:47.380 INFO:tasks.workunit.client.0.smithi077.stdout:3/304: chown db/ff 4933 1 2024-09-18T21:12:47.381 INFO:tasks.workunit.client.1.smithi103.stdout:4/311: chown d9/d1f/d31 118267296 1 2024-09-18T21:12:47.384 INFO:tasks.workunit.client.0.smithi077.stdout:7/371: rmdir d12/d22/d59/d72 39 2024-09-18T21:12:47.384 INFO:tasks.workunit.client.1.smithi103.stdout:0/318: dread d1/fd [4194304,4194304] 0 2024-09-18T21:12:47.388 INFO:tasks.workunit.client.1.smithi103.stdout:8/341: getdents d4 0 2024-09-18T21:12:47.392 INFO:tasks.workunit.client.1.smithi103.stdout:5/318: dread de/d1f/f23 [0,4194304] 0 2024-09-18T21:12:47.393 INFO:tasks.workunit.client.1.smithi103.stdout:8/342: unlink d4/de/f1e 0 2024-09-18T21:12:47.393 INFO:tasks.workunit.client.1.smithi103.stdout:8/343: stat d4/d26/d56/c60 0 2024-09-18T21:12:47.394 INFO:tasks.workunit.client.1.smithi103.stdout:4/312: link f6 d9/d1f/d31/f6f 0 2024-09-18T21:12:47.394 INFO:tasks.workunit.client.1.smithi103.stdout:8/344: write d4/d26/f1a [6222349,55641] 0 2024-09-18T21:12:47.396 INFO:tasks.workunit.client.0.smithi077.stdout:5/452: write d0/d6/dd/f19 [743258,49420] 0 2024-09-18T21:12:47.398 INFO:tasks.workunit.client.1.smithi103.stdout:5/319: creat de/d14/d33/d4f/f68 x:0 0 0 2024-09-18T21:12:47.399 INFO:tasks.workunit.client.1.smithi103.stdout:4/313: rename d9/d1c/c4a to d9/d1a/d2b/d48/c70 0 2024-09-18T21:12:47.400 INFO:tasks.workunit.client.0.smithi077.stdout:5/453: mkdir d0/df/d10/d47/da0 0 2024-09-18T21:12:47.401 INFO:tasks.workunit.client.0.smithi077.stdout:1/287: write d3/d8/d49/d4e/d50/f30 [1380308,75908] 0 2024-09-18T21:12:47.403 INFO:tasks.workunit.client.1.smithi103.stdout:5/320: creat de/d2d/f69 x:0 0 0 2024-09-18T21:12:47.403 INFO:tasks.workunit.client.1.smithi103.stdout:5/321: readlink de/d3e/l54 0 2024-09-18T21:12:47.404 INFO:tasks.workunit.client.1.smithi103.stdout:0/319: write d1/d9/f33 [275173,97094] 0 2024-09-18T21:12:47.405 INFO:tasks.workunit.client.1.smithi103.stdout:4/314: creat d9/d1c/d69/f71 x:0 0 0 2024-09-18T21:12:47.406 INFO:tasks.workunit.client.1.smithi103.stdout:5/322: creat de/d14/d33/d4f/f6a x:0 0 0 2024-09-18T21:12:47.407 INFO:tasks.workunit.client.1.smithi103.stdout:4/315: dread d9/d1c/f39 [0,4194304] 0 2024-09-18T21:12:47.408 INFO:tasks.workunit.client.1.smithi103.stdout:0/320: creat d1/d56/f72 x:0 0 0 2024-09-18T21:12:47.409 INFO:tasks.workunit.client.1.smithi103.stdout:4/316: write d9/d38/d58/f6b [372865,15041] 0 2024-09-18T21:12:47.409 INFO:tasks.workunit.client.0.smithi077.stdout:5/454: dwrite d0/f37 [0,4194304] 0 2024-09-18T21:12:47.411 INFO:tasks.workunit.client.0.smithi077.stdout:3/305: dwrite db/d14/d22/f58 [0,4194304] 0 2024-09-18T21:12:47.412 INFO:tasks.workunit.client.1.smithi103.stdout:4/317: mkdir d9/d38/d72 0 2024-09-18T21:12:47.412 INFO:tasks.workunit.client.0.smithi077.stdout:1/288: dwrite d3/d8/d49/f65 [0,4194304] 0 2024-09-18T21:12:47.413 INFO:tasks.workunit.client.0.smithi077.stdout:5/455: fdatasync d0/df/d10/d47/f93 0 2024-09-18T21:12:47.415 INFO:tasks.workunit.client.1.smithi103.stdout:5/323: getdents de/d1f/d3b/d3c 0 2024-09-18T21:12:47.416 INFO:tasks.workunit.client.0.smithi077.stdout:3/306: rmdir db/d14/d32/d3a/d3b 39 2024-09-18T21:12:47.417 INFO:tasks.workunit.client.1.smithi103.stdout:0/321: dwrite d1/d9/d13/f46 [0,4194304] 0 2024-09-18T21:12:47.417 INFO:tasks.workunit.client.1.smithi103.stdout:5/324: write fb [197637,6672] 0 2024-09-18T21:12:47.419 INFO:tasks.workunit.client.1.smithi103.stdout:5/325: fsync de/d2d/f56 0 2024-09-18T21:12:47.419 INFO:tasks.workunit.client.1.smithi103.stdout:8/345: truncate f2 7853694 0 2024-09-18T21:12:47.420 INFO:tasks.workunit.client.0.smithi077.stdout:5/456: creat d0/d43/d6d/fa1 x:0 0 0 2024-09-18T21:12:47.421 INFO:tasks.workunit.client.1.smithi103.stdout:4/318: write d9/d1f/d31/f3d [2394265,65835] 0 2024-09-18T21:12:47.422 INFO:tasks.workunit.client.0.smithi077.stdout:1/289: creat d3/d8/d13/d18/f6c x:0 0 0 2024-09-18T21:12:47.424 INFO:tasks.workunit.client.0.smithi077.stdout:3/307: creat db/d14/d22/d36/d42/f61 x:0 0 0 2024-09-18T21:12:47.429 INFO:tasks.workunit.client.1.smithi103.stdout:8/346: symlink d4/de/l67 0 2024-09-18T21:12:47.429 INFO:tasks.workunit.client.0.smithi077.stdout:3/308: readlink db/d14/d32/d3a/d3b/l3c 0 2024-09-18T21:12:47.430 INFO:tasks.workunit.client.0.smithi077.stdout:1/290: dread d3/d1e/f35 [0,4194304] 0 2024-09-18T21:12:47.430 INFO:tasks.workunit.client.1.smithi103.stdout:4/319: symlink d9/d1a/d41/l73 0 2024-09-18T21:12:47.431 INFO:tasks.workunit.client.1.smithi103.stdout:4/320: fsync d9/d38/f45 0 2024-09-18T21:12:47.431 INFO:tasks.workunit.client.0.smithi077.stdout:3/309: chown db/d14/d22/d36/d39/d50/d5c 0 1 2024-09-18T21:12:47.431 INFO:tasks.workunit.client.1.smithi103.stdout:4/321: dread - d9/d1a/d21/f57 zero size 2024-09-18T21:12:47.432 INFO:tasks.workunit.client.1.smithi103.stdout:0/322: mknod d1/d5/de/d19/d1e/c73 0 2024-09-18T21:12:47.432 INFO:tasks.workunit.client.0.smithi077.stdout:3/310: dread - db/d14/d22/d36/d42/f61 zero size 2024-09-18T21:12:47.434 INFO:tasks.workunit.client.0.smithi077.stdout:1/291: chown d3/d1e/d68/c36 219360 1 2024-09-18T21:12:47.434 INFO:tasks.workunit.client.1.smithi103.stdout:0/323: fdatasync d1/d5/de/d22/f5b 0 2024-09-18T21:12:47.436 INFO:tasks.workunit.client.1.smithi103.stdout:4/322: mknod d9/d38/d58/c74 0 2024-09-18T21:12:47.438 INFO:tasks.workunit.client.0.smithi077.stdout:3/311: getdents db/d4d 0 2024-09-18T21:12:47.438 INFO:tasks.workunit.client.1.smithi103.stdout:0/324: readlink d1/d5/de/d19/d1e/l39 0 2024-09-18T21:12:47.439 INFO:tasks.workunit.client.0.smithi077.stdout:3/312: write f3 [3817592,65301] 0 2024-09-18T21:12:47.444 INFO:tasks.workunit.client.0.smithi077.stdout:1/292: link d3/d8/d13/d18/c25 d3/d8/d49/d4e/d50/c6d 0 2024-09-18T21:12:47.445 INFO:tasks.workunit.client.0.smithi077.stdout:1/293: write d3/d1e/f31 [155316,22488] 0 2024-09-18T21:12:47.445 INFO:tasks.workunit.client.0.smithi077.stdout:1/294: chown d3/d1e 1844762576 1 2024-09-18T21:12:47.447 INFO:tasks.workunit.client.0.smithi077.stdout:5/457: write d0/df/d10/f44 [904392,96248] 0 2024-09-18T21:12:47.447 INFO:tasks.workunit.client.0.smithi077.stdout:1/295: dread - d3/d8/d49/d4e/d50/d3d/f61 zero size 2024-09-18T21:12:47.449 INFO:tasks.workunit.client.1.smithi103.stdout:0/325: link d1/d9/f54 d1/d5/de/d19/d1e/d34/f74 0 2024-09-18T21:12:47.451 INFO:tasks.workunit.client.0.smithi077.stdout:5/458: fsync d0/f2 0 2024-09-18T21:12:47.453 INFO:tasks.workunit.client.0.smithi077.stdout:1/296: symlink d3/d8/d49/d4e/d50/d3d/d54/l6e 0 2024-09-18T21:12:47.455 INFO:tasks.workunit.client.1.smithi103.stdout:0/326: rename d1/f18 to d1/d9/d48/f75 0 2024-09-18T21:12:47.455 INFO:tasks.workunit.client.0.smithi077.stdout:5/459: symlink d0/df/d10/d4b/la2 0 2024-09-18T21:12:47.456 INFO:tasks.workunit.client.1.smithi103.stdout:0/327: stat d1/d9/d13/f71 0 2024-09-18T21:12:47.457 INFO:tasks.workunit.client.0.smithi077.stdout:1/297: chown d3/d8/d49/d4e/d50/d3d/l45 133 1 2024-09-18T21:12:47.458 INFO:tasks.workunit.client.1.smithi103.stdout:8/347: dwrite d4/d2d/f33 [0,4194304] 0 2024-09-18T21:12:47.458 INFO:tasks.workunit.client.1.smithi103.stdout:5/326: dread de/d1f/d3b/d51/d57/d59/f5c [0,4194304] 0 2024-09-18T21:12:47.460 INFO:tasks.workunit.client.1.smithi103.stdout:4/323: dread d9/d1f/d31/f6f [0,4194304] 0 2024-09-18T21:12:47.460 INFO:tasks.workunit.client.1.smithi103.stdout:5/327: write de/f36 [181150,79497] 0 2024-09-18T21:12:47.461 INFO:tasks.workunit.client.0.smithi077.stdout:5/460: dread d0/f78 [4194304,4194304] 0 2024-09-18T21:12:47.461 INFO:tasks.workunit.client.0.smithi077.stdout:1/298: creat d3/d8/d49/d4e/d50/d3d/d54/f6f x:0 0 0 2024-09-18T21:12:47.462 INFO:tasks.workunit.client.1.smithi103.stdout:4/324: fdatasync d9/d1f/d31/f59 0 2024-09-18T21:12:47.463 INFO:tasks.workunit.client.1.smithi103.stdout:0/328: mkdir d1/d5/de/d24/d43/d76 0 2024-09-18T21:12:47.463 INFO:tasks.workunit.client.0.smithi077.stdout:1/299: mknod d3/d1e/d68/d3e/c70 0 2024-09-18T21:12:47.464 INFO:tasks.workunit.client.1.smithi103.stdout:0/329: chown d1/f36 182139 1 2024-09-18T21:12:47.465 INFO:tasks.workunit.client.0.smithi077.stdout:5/461: rename d0/d6/l20 to d0/df/d10/d47/la3 0 2024-09-18T21:12:47.466 INFO:tasks.workunit.client.0.smithi077.stdout:5/462: chown d0/d6/d3b/d64/d95 767 1 2024-09-18T21:12:47.467 INFO:tasks.workunit.client.1.smithi103.stdout:4/325: rename d9/d1a/d2b/d48/c4d to d9/d1a/d21/c75 0 2024-09-18T21:12:47.467 INFO:tasks.workunit.client.1.smithi103.stdout:4/326: readlink d9/d1f/d31/l3a 0 2024-09-18T21:12:47.468 INFO:tasks.workunit.client.1.smithi103.stdout:0/330: creat d1/d5/de/d24/d43/d76/f77 x:0 0 0 2024-09-18T21:12:47.468 INFO:tasks.workunit.client.1.smithi103.stdout:4/327: chown d9/d1a/d41/l62 94 1 2024-09-18T21:12:47.469 INFO:tasks.workunit.client.1.smithi103.stdout:0/331: fsync d1/f12 0 2024-09-18T21:12:47.469 INFO:tasks.workunit.client.0.smithi077.stdout:5/463: fdatasync d0/df/f5f 0 2024-09-18T21:12:47.470 INFO:tasks.workunit.client.0.smithi077.stdout:3/313: dread db/ff [0,4194304] 0 2024-09-18T21:12:47.470 INFO:tasks.workunit.client.1.smithi103.stdout:4/328: truncate d9/f2c 1347428 0 2024-09-18T21:12:47.471 INFO:tasks.workunit.client.1.smithi103.stdout:4/329: fsync d9/d1f/d31/f54 0 2024-09-18T21:12:47.471 INFO:tasks.workunit.client.1.smithi103.stdout:0/332: symlink d1/l78 0 2024-09-18T21:12:47.472 INFO:tasks.workunit.client.0.smithi077.stdout:5/464: mknod d0/df/d10/d4b/d80/ca4 0 2024-09-18T21:12:47.472 INFO:tasks.workunit.client.0.smithi077.stdout:1/300: dwrite d3/d8/f1c [0,4194304] 0 2024-09-18T21:12:47.473 INFO:tasks.workunit.client.0.smithi077.stdout:5/465: stat d0/df/d10/f9d 0 2024-09-18T21:12:47.474 INFO:tasks.workunit.client.0.smithi077.stdout:3/314: mknod db/d14/d32/c62 0 2024-09-18T21:12:47.474 INFO:tasks.workunit.client.1.smithi103.stdout:4/330: truncate d9/d2e/f40 660342 0 2024-09-18T21:12:47.476 INFO:tasks.workunit.client.0.smithi077.stdout:3/315: fdatasync db/d14/d22/d36/d39/f47 0 2024-09-18T21:12:47.476 INFO:tasks.workunit.client.1.smithi103.stdout:9/297: sync 2024-09-18T21:12:47.476 INFO:tasks.workunit.client.1.smithi103.stdout:7/306: sync 2024-09-18T21:12:47.476 INFO:tasks.workunit.client.1.smithi103.stdout:3/283: sync 2024-09-18T21:12:47.477 INFO:tasks.workunit.client.0.smithi077.stdout:3/316: dread - db/d14/d32/d4f/f60 zero size 2024-09-18T21:12:47.477 INFO:tasks.workunit.client.0.smithi077.stdout:5/466: mkdir d0/d6/dd/da5 0 2024-09-18T21:12:47.480 INFO:tasks.workunit.client.1.smithi103.stdout:7/307: readlink d1/df/d54/l59 0 2024-09-18T21:12:47.480 INFO:tasks.workunit.client.1.smithi103.stdout:0/333: link d1/d5/de/d19/d1e/f1f d1/d56/f79 0 2024-09-18T21:12:47.481 INFO:tasks.workunit.client.1.smithi103.stdout:4/331: creat d9/d2e/d61/f76 x:0 0 0 2024-09-18T21:12:47.483 INFO:tasks.workunit.client.1.smithi103.stdout:4/332: read - d9/f6a zero size 2024-09-18T21:12:47.485 INFO:tasks.workunit.client.1.smithi103.stdout:9/298: write f1 [4118438,126931] 0 2024-09-18T21:12:47.487 INFO:tasks.workunit.client.0.smithi077.stdout:5/467: dwrite d0/d6/f50 [0,4194304] 0 2024-09-18T21:12:47.488 INFO:tasks.workunit.client.1.smithi103.stdout:3/284: dwrite d1/f13 [4194304,4194304] 0 2024-09-18T21:12:47.489 INFO:tasks.workunit.client.1.smithi103.stdout:9/299: write d18/d1f/d2f/f4e [36883,7669] 0 2024-09-18T21:12:47.489 INFO:tasks.workunit.client.1.smithi103.stdout:7/308: dwrite d1/df/d54/f57 [0,4194304] 0 2024-09-18T21:12:47.493 INFO:tasks.workunit.client.1.smithi103.stdout:7/309: fsync d1/df/d42/d1f/d2e/f50 0 2024-09-18T21:12:47.499 INFO:tasks.workunit.client.1.smithi103.stdout:3/285: dwrite d1/d2/d18/d30/f38 [0,4194304] 0 2024-09-18T21:12:47.531 INFO:tasks.workunit.client.1.smithi103.stdout:9/300: symlink d18/d52/l5a 0 2024-09-18T21:12:47.532 INFO:tasks.workunit.client.0.smithi077.stdout:3/317: link db/d14/d22/d36/d39/d50/l59 db/d14/d32/l63 0 2024-09-18T21:12:47.533 INFO:tasks.workunit.client.0.smithi077.stdout:5/468: mknod d0/d6/dd/d5d/d91/ca6 0 2024-09-18T21:12:47.537 INFO:tasks.workunit.client.1.smithi103.stdout:9/301: stat d18/f1b 0 2024-09-18T21:12:47.538 INFO:tasks.workunit.client.1.smithi103.stdout:9/302: write d18/d1f/f28 [3623859,19712] 0 2024-09-18T21:12:47.539 INFO:tasks.workunit.client.0.smithi077.stdout:3/318: dwrite db/f2e [0,4194304] 0 2024-09-18T21:12:47.539 INFO:tasks.workunit.client.1.smithi103.stdout:9/303: write d18/d1f/d2f/f41 [394862,47] 0 2024-09-18T21:12:47.540 INFO:tasks.workunit.client.1.smithi103.stdout:3/286: symlink d1/d2/d18/l59 0 2024-09-18T21:12:47.541 INFO:tasks.workunit.client.1.smithi103.stdout:3/287: dread - d1/d2/d18/f2f zero size 2024-09-18T21:12:47.542 INFO:tasks.workunit.client.1.smithi103.stdout:3/288: chown d1/d2/d18/d30/f3f 64725490 1 2024-09-18T21:12:47.543 INFO:tasks.workunit.client.0.smithi077.stdout:1/301: dwrite d3/d8/d49/d4e/d5a/f69 [0,4194304] 0 2024-09-18T21:12:47.544 INFO:tasks.workunit.client.1.smithi103.stdout:0/334: rename d1/d5/c47 to d1/d5/de/c7a 0 2024-09-18T21:12:47.545 INFO:tasks.workunit.client.0.smithi077.stdout:1/302: fsync d3/d8/d49/d4e/d50/d3d/d54/f6f 0 2024-09-18T21:12:47.551 INFO:tasks.workunit.client.1.smithi103.stdout:9/304: rename d18/d29/f59 to d18/d29/f5b 0 2024-09-18T21:12:47.553 INFO:tasks.workunit.client.1.smithi103.stdout:3/289: unlink d1/l12 0 2024-09-18T21:12:47.554 INFO:tasks.workunit.client.0.smithi077.stdout:1/303: rmdir d3/d1e 39 2024-09-18T21:12:47.556 INFO:tasks.workunit.client.1.smithi103.stdout:4/333: rename d9/d1f/d31 to d9/d1c/d77 0 2024-09-18T21:12:47.557 INFO:tasks.workunit.client.0.smithi077.stdout:3/319: mknod db/d14/d32/d49/d4e/c64 0 2024-09-18T21:12:47.558 INFO:tasks.workunit.client.0.smithi077.stdout:3/320: chown db/d14/d22/d36/d39/d50/l5b 5443353 1 2024-09-18T21:12:47.558 INFO:tasks.workunit.client.1.smithi103.stdout:0/335: symlink d1/d5/de/d24/d43/l7b 0 2024-09-18T21:12:47.559 INFO:tasks.workunit.client.0.smithi077.stdout:5/469: truncate d0/d6/d3b/f7e 612955 0 2024-09-18T21:12:47.560 INFO:tasks.workunit.client.0.smithi077.stdout:1/304: mknod d3/d6a/c71 0 2024-09-18T21:12:47.564 INFO:tasks.workunit.client.0.smithi077.stdout:1/305: dread d3/f2a [0,4194304] 0 2024-09-18T21:12:47.565 INFO:tasks.workunit.client.1.smithi103.stdout:9/305: rename d18/d29/l2c to d18/d1f/d2f/l5c 0 2024-09-18T21:12:47.567 INFO:tasks.workunit.client.1.smithi103.stdout:4/334: unlink d9/d1c/d77/l43 0 2024-09-18T21:12:47.570 INFO:tasks.workunit.client.0.smithi077.stdout:5/470: dread d0/d6/dd/f3a [0,4194304] 0 2024-09-18T21:12:47.571 INFO:tasks.workunit.client.0.smithi077.stdout:1/306: dwrite d3/ff [4194304,4194304] 0 2024-09-18T21:12:47.572 INFO:tasks.workunit.client.1.smithi103.stdout:9/306: dwrite ff [0,4194304] 0 2024-09-18T21:12:47.573 INFO:tasks.workunit.client.1.smithi103.stdout:3/290: read d1/d2/d18/d30/f38 [3695432,115450] 0 2024-09-18T21:12:47.579 INFO:tasks.workunit.client.1.smithi103.stdout:4/335: fsync d9/d2e/f40 0 2024-09-18T21:12:47.580 INFO:tasks.workunit.client.1.smithi103.stdout:0/336: dwrite d1/d9/d48/f75 [0,4194304] 0 2024-09-18T21:12:47.581 INFO:tasks.workunit.client.0.smithi077.stdout:5/471: dwrite d0/df/d10/d47/f68 [0,4194304] 0 2024-09-18T21:12:47.582 INFO:tasks.workunit.client.1.smithi103.stdout:4/336: write d9/f6a [975031,62057] 0 2024-09-18T21:12:47.583 INFO:tasks.workunit.client.0.smithi077.stdout:1/307: mknod d3/d1e/c72 0 2024-09-18T21:12:47.583 INFO:tasks.workunit.client.1.smithi103.stdout:0/337: dread - d1/d9/d13/f71 zero size 2024-09-18T21:12:47.584 INFO:tasks.workunit.client.0.smithi077.stdout:1/308: dread - d3/d8/f59 zero size 2024-09-18T21:12:47.585 INFO:tasks.workunit.client.1.smithi103.stdout:9/307: rename d18/d1f/d2f/l3d to d18/d29/l5d 0 2024-09-18T21:12:47.587 INFO:tasks.workunit.client.0.smithi077.stdout:5/472: rename d0/df/d10/d47/f58 to d0/df/fa7 0 2024-09-18T21:12:47.591 INFO:tasks.workunit.client.0.smithi077.stdout:5/473: dread d0/d6/dd/f1e [0,4194304] 0 2024-09-18T21:12:47.591 INFO:tasks.workunit.client.0.smithi077.stdout:5/474: stat d0/df/d10/d4b/la2 0 2024-09-18T21:12:47.594 INFO:tasks.workunit.client.0.smithi077.stdout:1/309: creat d3/d1e/d68/d3e/f73 x:0 0 0 2024-09-18T21:12:47.594 INFO:tasks.workunit.client.0.smithi077.stdout:5/475: truncate d0/f18 2979162 0 2024-09-18T21:12:47.595 INFO:tasks.workunit.client.1.smithi103.stdout:0/338: creat d1/d5/de/d19/f7c x:0 0 0 2024-09-18T21:12:47.596 INFO:tasks.workunit.client.0.smithi077.stdout:1/310: creat d3/d8/d13/d18/f74 x:0 0 0 2024-09-18T21:12:47.597 INFO:tasks.workunit.client.0.smithi077.stdout:5/476: stat d0/d43/d6d/l83 0 2024-09-18T21:12:47.597 INFO:tasks.workunit.client.1.smithi103.stdout:0/339: read d1/d9/d13/f46 [76949,106123] 0 2024-09-18T21:12:47.597 INFO:tasks.workunit.client.0.smithi077.stdout:1/311: read d3/d8/d13/d18/f4d [2229222,88086] 0 2024-09-18T21:12:47.598 INFO:tasks.workunit.client.0.smithi077.stdout:5/477: chown d0/d6/dd/d5d/c62 0 1 2024-09-18T21:12:47.598 INFO:tasks.workunit.client.1.smithi103.stdout:6/324: sync 2024-09-18T21:12:47.599 INFO:tasks.workunit.client.1.smithi103.stdout:4/337: truncate d9/d38/f45 2928771 0 2024-09-18T21:12:47.599 INFO:tasks.workunit.client.1.smithi103.stdout:9/308: truncate fc 1243763 0 2024-09-18T21:12:47.600 INFO:tasks.workunit.client.1.smithi103.stdout:6/325: write d2/d3/d8/f62 [594811,72500] 0 2024-09-18T21:12:47.602 INFO:tasks.workunit.client.0.smithi077.stdout:5/478: creat d0/d6/d3b/fa8 x:0 0 0 2024-09-18T21:12:47.606 INFO:tasks.workunit.client.0.smithi077.stdout:5/479: mknod d0/d43/d6d/ca9 0 2024-09-18T21:12:47.606 INFO:tasks.workunit.client.1.smithi103.stdout:3/291: dread d1/f24 [0,4194304] 0 2024-09-18T21:12:47.608 INFO:tasks.workunit.client.1.smithi103.stdout:9/309: mkdir d18/d52/d5e 0 2024-09-18T21:12:47.608 INFO:tasks.workunit.client.1.smithi103.stdout:3/292: write d1/d2/d18/d30/f3f [1346335,84591] 0 2024-09-18T21:12:47.612 INFO:tasks.workunit.client.1.smithi103.stdout:9/310: chown d18/l27 15169743 1 2024-09-18T21:12:47.614 INFO:tasks.workunit.client.1.smithi103.stdout:3/293: mknod d1/c5a 0 2024-09-18T21:12:47.619 INFO:tasks.workunit.client.0.smithi077.stdout:5/480: dread d0/df/d10/f7 [0,4194304] 0 2024-09-18T21:12:47.620 INFO:tasks.workunit.client.1.smithi103.stdout:0/340: write d1/d9/d13/f3d [1263978,65663] 0 2024-09-18T21:12:47.620 INFO:tasks.workunit.client.0.smithi077.stdout:1/312: truncate d3/d1e/d68/f44 960560 0 2024-09-18T21:12:47.621 INFO:tasks.workunit.client.1.smithi103.stdout:0/341: dread - d1/d56/f72 zero size 2024-09-18T21:12:47.622 INFO:tasks.workunit.client.1.smithi103.stdout:6/326: dread d2/d3/d8/f10 [4194304,4194304] 0 2024-09-18T21:12:47.622 INFO:tasks.workunit.client.0.smithi077.stdout:5/481: mkdir d0/d6/daa 0 2024-09-18T21:12:47.622 INFO:tasks.workunit.client.1.smithi103.stdout:9/311: dwrite d18/f24 [0,4194304] 0 2024-09-18T21:12:47.625 INFO:tasks.workunit.client.0.smithi077.stdout:1/313: rename d3/d8/d49/d4e/d50/d3d to d3/d8/d75 0 2024-09-18T21:12:47.626 INFO:tasks.workunit.client.1.smithi103.stdout:4/338: write f3 [7142118,28138] 0 2024-09-18T21:12:47.626 INFO:tasks.workunit.client.1.smithi103.stdout:6/327: fsync d2/d3/f48 0 2024-09-18T21:12:47.627 INFO:tasks.workunit.client.1.smithi103.stdout:0/342: mknod d1/d5/de/d19/c7d 0 2024-09-18T21:12:47.627 INFO:tasks.workunit.client.1.smithi103.stdout:4/339: fsync d9/d38/f5d 0 2024-09-18T21:12:47.630 INFO:tasks.workunit.client.0.smithi077.stdout:5/482: creat d0/d6/d8a/fab x:0 0 0 2024-09-18T21:12:47.631 INFO:tasks.workunit.client.0.smithi077.stdout:5/483: fdatasync d0/d6/d8a/fab 0 2024-09-18T21:12:47.633 INFO:tasks.workunit.client.1.smithi103.stdout:9/312: creat d18/d52/d5e/f5f x:0 0 0 2024-09-18T21:12:47.635 INFO:tasks.workunit.client.1.smithi103.stdout:6/328: mknod d2/d3/d4/d43/d44/c63 0 2024-09-18T21:12:47.637 INFO:tasks.workunit.client.1.smithi103.stdout:4/340: mknod d9/d2e/c78 0 2024-09-18T21:12:47.637 INFO:tasks.workunit.client.0.smithi077.stdout:5/484: dwrite d0/d6/f50 [4194304,4194304] 0 2024-09-18T21:12:47.638 INFO:tasks.workunit.client.1.smithi103.stdout:0/343: creat d1/d5/de/d19/f7e x:0 0 0 2024-09-18T21:12:47.639 INFO:tasks.workunit.client.1.smithi103.stdout:0/344: chown d1/d5/de/l10 199 1 2024-09-18T21:12:47.640 INFO:tasks.workunit.client.0.smithi077.stdout:5/485: unlink d0/df/d3d/f73 0 2024-09-18T21:12:47.642 INFO:tasks.workunit.client.1.smithi103.stdout:4/341: rmdir d9/d1a/d21 39 2024-09-18T21:12:47.645 INFO:tasks.workunit.client.1.smithi103.stdout:9/313: rename f8 to d18/d52/f60 0 2024-09-18T21:12:47.647 INFO:tasks.workunit.client.0.smithi077.stdout:5/486: dread d0/d6/d3b/f55 [0,4194304] 0 2024-09-18T21:12:47.649 INFO:tasks.workunit.client.0.smithi077.stdout:1/314: link d3/d8/cc d3/d8/d13/d18/c76 0 2024-09-18T21:12:47.650 INFO:tasks.workunit.client.1.smithi103.stdout:4/342: rename f5 to d9/d1a/d2b/f79 0 2024-09-18T21:12:47.651 INFO:tasks.workunit.client.1.smithi103.stdout:0/345: symlink d1/d5/de/l7f 0 2024-09-18T21:12:47.651 INFO:tasks.workunit.client.0.smithi077.stdout:1/315: dread - d3/d8/f59 zero size 2024-09-18T21:12:47.652 INFO:tasks.workunit.client.1.smithi103.stdout:9/314: dwrite d18/d29/f55 [0,4194304] 0 2024-09-18T21:12:47.654 INFO:tasks.workunit.client.0.smithi077.stdout:1/316: mkdir d3/d8/d13/d77 0 2024-09-18T21:12:47.655 INFO:tasks.workunit.client.1.smithi103.stdout:6/329: truncate d2/f34 1994755 0 2024-09-18T21:12:47.657 INFO:tasks.workunit.client.1.smithi103.stdout:0/346: mkdir d1/d5/de/d22/d42/d80 0 2024-09-18T21:12:47.657 INFO:tasks.workunit.client.0.smithi077.stdout:1/317: read d3/d8/d49/f65 [692114,10209] 0 2024-09-18T21:12:47.657 INFO:tasks.workunit.client.1.smithi103.stdout:0/347: read - d1/d5/de/d19/d1e/d34/f45 zero size 2024-09-18T21:12:47.658 INFO:tasks.workunit.client.1.smithi103.stdout:9/315: creat d18/d1f/f61 x:0 0 0 2024-09-18T21:12:47.659 INFO:tasks.workunit.client.1.smithi103.stdout:9/316: fdatasync d18/d29/f2a 0 2024-09-18T21:12:47.660 INFO:tasks.workunit.client.0.smithi077.stdout:1/318: creat d3/d8/d49/d4e/d5a/f78 x:0 0 0 2024-09-18T21:12:47.688 INFO:tasks.workunit.client.1.smithi103.stdout:2/261: sync 2024-09-18T21:12:47.688 INFO:tasks.workunit.client.1.smithi103.stdout:1/330: sync 2024-09-18T21:12:47.690 INFO:tasks.workunit.client.1.smithi103.stdout:0/348: write d1/d5/de/d19/d1e/f21 [571627,115199] 0 2024-09-18T21:12:47.692 INFO:tasks.workunit.client.1.smithi103.stdout:0/349: chown d1/d5/de/d19/f7c 11923 1 2024-09-18T21:12:47.694 INFO:tasks.workunit.client.1.smithi103.stdout:9/317: dread f4 [0,4194304] 0 2024-09-18T21:12:47.694 INFO:tasks.workunit.client.1.smithi103.stdout:2/262: creat d3/d5/f61 x:0 0 0 2024-09-18T21:12:47.695 INFO:tasks.workunit.client.1.smithi103.stdout:1/331: write d0/d2/d9/f2f [4682809,85982] 0 2024-09-18T21:12:47.695 INFO:tasks.workunit.client.1.smithi103.stdout:9/318: fsync d18/d29/f4b 0 2024-09-18T21:12:47.695 INFO:tasks.workunit.client.1.smithi103.stdout:2/263: dread - d3/d5/d2c/f43 zero size 2024-09-18T21:12:47.699 INFO:tasks.workunit.client.1.smithi103.stdout:2/264: mknod d3/d5/d2f/c62 0 2024-09-18T21:12:47.702 INFO:tasks.workunit.client.1.smithi103.stdout:2/265: symlink d3/d5/d2f/d5b/l63 0 2024-09-18T21:12:47.704 INFO:tasks.workunit.client.1.smithi103.stdout:9/319: dwrite d18/f24 [0,4194304] 0 2024-09-18T21:12:47.704 INFO:tasks.workunit.client.1.smithi103.stdout:2/266: chown d3/d5/d25/d40 7 1 2024-09-18T21:12:47.704 INFO:tasks.workunit.client.1.smithi103.stdout:1/332: dwrite d0/d2/d2b/f41 [0,4194304] 0 2024-09-18T21:12:47.705 INFO:tasks.workunit.client.1.smithi103.stdout:9/320: stat d18/f1b 0 2024-09-18T21:12:47.705 INFO:tasks.workunit.client.1.smithi103.stdout:2/267: dread - d3/d5/f35 zero size 2024-09-18T21:12:47.706 INFO:tasks.workunit.client.1.smithi103.stdout:6/330: dread d2/d24/f27 [0,4194304] 0 2024-09-18T21:12:47.708 INFO:tasks.workunit.client.1.smithi103.stdout:9/321: mkdir d18/d29/d62 0 2024-09-18T21:12:47.709 INFO:tasks.workunit.client.1.smithi103.stdout:6/331: write d2/d3/f5b [898952,85694] 0 2024-09-18T21:12:47.710 INFO:tasks.workunit.client.1.smithi103.stdout:1/333: dread d0/d2/d9/dc/f69 [0,4194304] 0 2024-09-18T21:12:47.711 INFO:tasks.workunit.client.1.smithi103.stdout:6/332: dread - d2/d24/f5f zero size 2024-09-18T21:12:47.712 INFO:tasks.workunit.client.1.smithi103.stdout:1/334: chown d0/d2/d9/dc/f69 61 1 2024-09-18T21:12:47.714 INFO:tasks.workunit.client.1.smithi103.stdout:9/322: creat d18/d1f/d2f/f63 x:0 0 0 2024-09-18T21:12:47.714 INFO:tasks.workunit.client.1.smithi103.stdout:6/333: read d2/d24/f3b [1345524,49856] 0 2024-09-18T21:12:47.715 INFO:tasks.workunit.client.1.smithi103.stdout:2/268: dwrite d3/d5/f61 [0,4194304] 0 2024-09-18T21:12:47.719 INFO:tasks.workunit.client.1.smithi103.stdout:6/334: creat d2/d24/d5a/f64 x:0 0 0 2024-09-18T21:12:47.720 INFO:tasks.workunit.client.1.smithi103.stdout:6/335: chown d2/d24 806018932 1 2024-09-18T21:12:47.721 INFO:tasks.workunit.client.1.smithi103.stdout:9/323: creat d18/f64 x:0 0 0 2024-09-18T21:12:47.726 INFO:tasks.workunit.client.1.smithi103.stdout:2/269: dwrite d3/d5/f35 [0,4194304] 0 2024-09-18T21:12:47.727 INFO:tasks.workunit.client.1.smithi103.stdout:9/324: read d18/d1f/d2f/f41 [516653,79083] 0 2024-09-18T21:12:47.728 INFO:tasks.workunit.client.1.smithi103.stdout:1/335: dwrite d0/d11/d5f/d19/d4d/f6b [0,4194304] 0 2024-09-18T21:12:47.730 INFO:tasks.workunit.client.1.smithi103.stdout:6/336: read d2/d3/f19 [1743105,24795] 0 2024-09-18T21:12:47.731 INFO:tasks.workunit.client.1.smithi103.stdout:6/337: read d2/d3/f55 [847994,93473] 0 2024-09-18T21:12:47.733 INFO:tasks.workunit.client.1.smithi103.stdout:1/336: truncate d0/d2/d9/d10/f67 1601967 0 2024-09-18T21:12:47.737 INFO:tasks.workunit.client.1.smithi103.stdout:6/338: creat d2/d24/f65 x:0 0 0 2024-09-18T21:12:47.739 INFO:tasks.workunit.client.1.smithi103.stdout:1/337: getdents d0/d3 0 2024-09-18T21:12:47.742 INFO:tasks.workunit.client.1.smithi103.stdout:1/338: unlink d0/d2/d2b/d3a/f5c 0 2024-09-18T21:12:47.742 INFO:tasks.workunit.client.1.smithi103.stdout:6/339: link d2/d3/d8/cc d2/d24/d5a/c66 0 2024-09-18T21:12:47.744 INFO:tasks.workunit.client.1.smithi103.stdout:6/340: mkdir d2/d24/d5a/d67 0 2024-09-18T21:12:47.744 INFO:tasks.workunit.client.1.smithi103.stdout:1/339: creat d0/d2/d9/d10/d5d/f79 x:0 0 0 2024-09-18T21:12:47.745 INFO:tasks.workunit.client.1.smithi103.stdout:6/341: mkdir d2/d24/d38/d68 0 2024-09-18T21:12:47.746 INFO:tasks.workunit.client.1.smithi103.stdout:6/342: rename d2/d3/d4/d43/d44 to d2/d3/d4/d43/d44/d69 22 2024-09-18T21:12:47.746 INFO:tasks.workunit.client.1.smithi103.stdout:1/340: unlink d0/d11/f2d 0 2024-09-18T21:12:47.748 INFO:tasks.workunit.client.1.smithi103.stdout:9/325: truncate d18/d29/f2d 262627 0 2024-09-18T21:12:47.749 INFO:tasks.workunit.client.1.smithi103.stdout:6/343: chown d2/d3/c23 0 1 2024-09-18T21:12:47.750 INFO:tasks.workunit.client.1.smithi103.stdout:9/326: rename f4 to d18/d1f/d2f/f65 0 2024-09-18T21:12:47.750 INFO:tasks.workunit.client.1.smithi103.stdout:6/344: truncate d2/d24/d5a/f17 4254292 0 2024-09-18T21:12:47.751 INFO:tasks.workunit.client.1.smithi103.stdout:9/327: write d18/d29/f4b [959607,32437] 0 2024-09-18T21:12:47.751 INFO:tasks.workunit.client.1.smithi103.stdout:6/345: write d2/d24/f5f [145804,6276] 0 2024-09-18T21:12:47.755 INFO:tasks.workunit.client.1.smithi103.stdout:9/328: link l11 d18/d1f/l66 0 2024-09-18T21:12:47.757 INFO:tasks.workunit.client.1.smithi103.stdout:9/329: unlink d18/d1f/f61 0 2024-09-18T21:12:47.757 INFO:tasks.workunit.client.1.smithi103.stdout:9/330: dread - d18/d29/f44 zero size 2024-09-18T21:12:47.759 INFO:tasks.workunit.client.1.smithi103.stdout:9/331: symlink d18/l67 0 2024-09-18T21:12:47.761 INFO:tasks.workunit.client.1.smithi103.stdout:9/332: read f12 [2163119,72416] 0 2024-09-18T21:12:47.762 INFO:tasks.workunit.client.1.smithi103.stdout:9/333: fdatasync d18/d1f/f21 0 2024-09-18T21:12:47.765 INFO:tasks.workunit.client.1.smithi103.stdout:6/346: truncate d2/d24/f3b 2851687 0 2024-09-18T21:12:47.766 INFO:tasks.workunit.client.0.smithi077.stdout:1/319: dwrite d3/d8/f17 [4194304,4194304] 0 2024-09-18T21:12:47.769 INFO:tasks.workunit.client.1.smithi103.stdout:6/347: dread d2/d24/f27 [0,4194304] 0 2024-09-18T21:12:47.769 INFO:tasks.workunit.client.0.smithi077.stdout:1/320: read - d3/d8/d13/f26 zero size 2024-09-18T21:12:47.775 INFO:tasks.workunit.client.0.smithi077.stdout:1/321: dwrite d3/d8/d13/d18/f1a [0,4194304] 0 2024-09-18T21:12:47.779 INFO:tasks.workunit.client.1.smithi103.stdout:6/348: creat d2/d24/f6a x:0 0 0 2024-09-18T21:12:47.780 INFO:tasks.workunit.client.1.smithi103.stdout:6/349: rmdir d2/d24/d5a 39 2024-09-18T21:12:47.783 INFO:tasks.workunit.client.1.smithi103.stdout:6/350: rmdir d2/d3/d8/d4c 39 2024-09-18T21:12:47.791 INFO:tasks.workunit.client.1.smithi103.stdout:6/351: dwrite d2/f4a [0,4194304] 0 2024-09-18T21:12:47.795 INFO:tasks.workunit.client.1.smithi103.stdout:9/334: dread d18/d29/f2d [0,4194304] 0 2024-09-18T21:12:47.798 INFO:tasks.workunit.client.1.smithi103.stdout:6/352: mknod d2/d24/d38/c6b 0 2024-09-18T21:12:47.799 INFO:tasks.workunit.client.1.smithi103.stdout:9/335: mkdir d18/d29/d68 0 2024-09-18T21:12:47.800 INFO:tasks.workunit.client.1.smithi103.stdout:9/336: write d18/f1b [315323,13545] 0 2024-09-18T21:12:47.803 INFO:tasks.workunit.client.1.smithi103.stdout:6/353: write d2/f22 [2178384,40527] 0 2024-09-18T21:12:47.804 INFO:tasks.workunit.client.1.smithi103.stdout:9/337: symlink d18/d29/l69 0 2024-09-18T21:12:47.806 INFO:tasks.workunit.client.1.smithi103.stdout:9/338: symlink d18/l6a 0 2024-09-18T21:12:47.807 INFO:tasks.workunit.client.1.smithi103.stdout:9/339: fdatasync d18/d1f/d2f/f65 0 2024-09-18T21:12:47.809 INFO:tasks.workunit.client.1.smithi103.stdout:9/340: mknod d18/d29/d62/c6b 0 2024-09-18T21:12:47.809 INFO:tasks.workunit.client.1.smithi103.stdout:7/310: sync 2024-09-18T21:12:47.810 INFO:tasks.workunit.client.1.smithi103.stdout:5/328: sync 2024-09-18T21:12:47.810 INFO:tasks.workunit.client.1.smithi103.stdout:8/348: sync 2024-09-18T21:12:47.810 INFO:tasks.workunit.client.1.smithi103.stdout:3/294: sync 2024-09-18T21:12:47.812 INFO:tasks.workunit.client.1.smithi103.stdout:9/341: link d18/d52/l5a d18/l6c 0 2024-09-18T21:12:47.812 INFO:tasks.workunit.client.1.smithi103.stdout:3/295: fsync d1/d2/f4b 0 2024-09-18T21:12:47.813 INFO:tasks.workunit.client.1.smithi103.stdout:9/342: chown d18/d29/f4d 169 1 2024-09-18T21:12:47.814 INFO:tasks.workunit.client.1.smithi103.stdout:7/311: unlink d1/df/d42/d29/d2f/c53 0 2024-09-18T21:12:47.815 INFO:tasks.workunit.client.1.smithi103.stdout:9/343: mknod d18/d52/c6d 0 2024-09-18T21:12:47.817 INFO:tasks.workunit.client.1.smithi103.stdout:9/344: read f1 [8238537,69996] 0 2024-09-18T21:12:47.818 INFO:tasks.workunit.client.1.smithi103.stdout:3/296: symlink d1/d23/d25/d4f/d51/l5b 0 2024-09-18T21:12:47.819 INFO:tasks.workunit.client.1.smithi103.stdout:5/329: dwrite de/d2d/d44/f65 [0,4194304] 0 2024-09-18T21:12:47.820 INFO:tasks.workunit.client.1.smithi103.stdout:6/354: truncate d2/f4a 1141091 0 2024-09-18T21:12:47.824 INFO:tasks.workunit.client.1.smithi103.stdout:3/297: creat d1/d23/d25/d4f/d51/f5c x:0 0 0 2024-09-18T21:12:47.825 INFO:tasks.workunit.client.1.smithi103.stdout:5/330: creat de/d2d/d44/f6b x:0 0 0 2024-09-18T21:12:47.826 INFO:tasks.workunit.client.1.smithi103.stdout:6/355: mknod d2/d3/d4/c6c 0 2024-09-18T21:12:47.827 INFO:tasks.workunit.client.1.smithi103.stdout:7/312: dwrite d1/df/d42/f26 [0,4194304] 0 2024-09-18T21:12:47.830 INFO:tasks.workunit.client.1.smithi103.stdout:5/331: truncate de/d14/d33/d4f/f6a 429981 0 2024-09-18T21:12:47.831 INFO:tasks.workunit.client.1.smithi103.stdout:5/332: chown de/d3e/l5e 11 1 2024-09-18T21:12:47.832 INFO:tasks.workunit.client.1.smithi103.stdout:7/313: rmdir d1/df/d42/d1f 39 2024-09-18T21:12:47.832 INFO:tasks.workunit.client.1.smithi103.stdout:6/356: mknod d2/d24/c6d 0 2024-09-18T21:12:47.834 INFO:tasks.workunit.client.1.smithi103.stdout:5/333: chown de/d14/d33/f53 9 1 2024-09-18T21:12:47.835 INFO:tasks.workunit.client.1.smithi103.stdout:3/298: dwrite d1/f2e [0,4194304] 0 2024-09-18T21:12:47.837 INFO:tasks.workunit.client.1.smithi103.stdout:3/299: stat d1/d2/l1a 0 2024-09-18T21:12:47.837 INFO:tasks.workunit.client.1.smithi103.stdout:8/349: dread d4/d26/f4d [0,4194304] 0 2024-09-18T21:12:47.839 INFO:tasks.workunit.client.1.smithi103.stdout:5/334: write de/d2d/d44/f45 [8322,83312] 0 2024-09-18T21:12:47.840 INFO:tasks.workunit.client.1.smithi103.stdout:6/357: rename d2/d24/f27 to d2/d3/d4/d43/d44/f6e 0 2024-09-18T21:12:47.841 INFO:tasks.workunit.client.1.smithi103.stdout:8/350: read d4/d26/f8 [703695,26401] 0 2024-09-18T21:12:47.842 INFO:tasks.workunit.client.1.smithi103.stdout:7/314: unlink d1/df/d42/d29/d2f/d33/f3a 0 2024-09-18T21:12:47.842 INFO:tasks.workunit.client.1.smithi103.stdout:9/345: dread d18/f22 [0,4194304] 0 2024-09-18T21:12:47.843 INFO:tasks.workunit.client.1.smithi103.stdout:3/300: creat d1/d23/d25/d4f/d51/f5d x:0 0 0 2024-09-18T21:12:47.844 INFO:tasks.workunit.client.1.smithi103.stdout:9/346: fdatasync d18/d1f/d2f/f4e 0 2024-09-18T21:12:47.845 INFO:tasks.workunit.client.1.smithi103.stdout:5/335: dread de/d14/d33/f46 [0,4194304] 0 2024-09-18T21:12:47.845 INFO:tasks.workunit.client.1.smithi103.stdout:7/315: mkdir d1/df/d42/d1f/d5d 0 2024-09-18T21:12:47.846 INFO:tasks.workunit.client.1.smithi103.stdout:3/301: fdatasync d1/d23/d25/d4f/d51/f5c 0 2024-09-18T21:12:47.847 INFO:tasks.workunit.client.1.smithi103.stdout:5/336: write de/d2d/f69 [1001340,47337] 0 2024-09-18T21:12:47.847 INFO:tasks.workunit.client.1.smithi103.stdout:9/347: symlink d18/d1f/d2f/l6e 0 2024-09-18T21:12:47.848 INFO:tasks.workunit.client.1.smithi103.stdout:5/337: write de/d14/d33/d4f/f68 [996198,26008] 0 2024-09-18T21:12:47.849 INFO:tasks.workunit.client.1.smithi103.stdout:5/338: chown de/d3e/f43 5 1 2024-09-18T21:12:47.849 INFO:tasks.workunit.client.1.smithi103.stdout:6/358: rename d2/d3/d4/d43/f58 to d2/d3/f6f 0 2024-09-18T21:12:47.851 INFO:tasks.workunit.client.1.smithi103.stdout:9/348: mkdir d18/d52/d6f 0 2024-09-18T21:12:47.852 INFO:tasks.workunit.client.1.smithi103.stdout:9/349: write d18/d52/f54 [617566,126883] 0 2024-09-18T21:12:47.853 INFO:tasks.workunit.client.1.smithi103.stdout:3/302: mkdir d1/d23/d5e 0 2024-09-18T21:12:47.857 INFO:tasks.workunit.client.1.smithi103.stdout:5/339: mknod de/c6c 0 2024-09-18T21:12:47.857 INFO:tasks.workunit.client.1.smithi103.stdout:8/351: truncate d4/de/f11 6063433 0 2024-09-18T21:12:47.858 INFO:tasks.workunit.client.1.smithi103.stdout:5/340: truncate de/f36 1095928 0 2024-09-18T21:12:47.858 INFO:tasks.workunit.client.1.smithi103.stdout:3/303: truncate d1/f24 2801148 0 2024-09-18T21:12:47.859 INFO:tasks.workunit.client.1.smithi103.stdout:6/359: creat d2/d3/d8/d4c/d4e/f70 x:0 0 0 2024-09-18T21:12:47.860 INFO:tasks.workunit.client.1.smithi103.stdout:3/304: chown d1/d2/d18/d30/f45 1835467146 1 2024-09-18T21:12:47.860 INFO:tasks.workunit.client.1.smithi103.stdout:5/341: mknod de/d1f/d3b/c6d 0 2024-09-18T21:12:47.860 INFO:tasks.workunit.client.1.smithi103.stdout:7/316: truncate d1/f17 2086873 0 2024-09-18T21:12:47.861 INFO:tasks.workunit.client.1.smithi103.stdout:6/360: write d2/d3/d8/d4c/f61 [169221,107060] 0 2024-09-18T21:12:47.861 INFO:tasks.workunit.client.1.smithi103.stdout:9/350: rename d18/f1b to d18/f70 0 2024-09-18T21:12:47.863 INFO:tasks.workunit.client.1.smithi103.stdout:7/317: stat d1/df/d42/d29/d2f/d33/f3e 0 2024-09-18T21:12:47.863 INFO:tasks.workunit.client.1.smithi103.stdout:3/305: readlink d1/da/df/l2c 0 2024-09-18T21:12:47.867 INFO:tasks.workunit.client.1.smithi103.stdout:3/306: unlink d1/da/l42 0 2024-09-18T21:12:47.868 INFO:tasks.workunit.client.1.smithi103.stdout:6/361: getdents d2/d3/d4/d43/d44 0 2024-09-18T21:12:47.870 INFO:tasks.workunit.client.1.smithi103.stdout:5/342: dwrite de/d14/d33/d4f/f6a [0,4194304] 0 2024-09-18T21:12:47.871 INFO:tasks.workunit.client.1.smithi103.stdout:5/343: write de/d2d/d44/f45 [194431,105643] 0 2024-09-18T21:12:47.872 INFO:tasks.workunit.client.1.smithi103.stdout:9/351: rename d18/f22 to d18/d1f/f71 0 2024-09-18T21:12:47.873 INFO:tasks.workunit.client.1.smithi103.stdout:8/352: truncate d4/d26/d56/f62 3677871 0 2024-09-18T21:12:47.874 INFO:tasks.workunit.client.1.smithi103.stdout:5/344: truncate de/d1f/d3b/f61 669912 0 2024-09-18T21:12:47.874 INFO:tasks.workunit.client.1.smithi103.stdout:6/362: dread d2/d3/d8/d4c/f61 [0,4194304] 0 2024-09-18T21:12:47.876 INFO:tasks.workunit.client.1.smithi103.stdout:5/345: chown de/d14/l3a 2045663 1 2024-09-18T21:12:47.876 INFO:tasks.workunit.client.1.smithi103.stdout:9/352: symlink d18/d29/d62/l72 0 2024-09-18T21:12:47.877 INFO:tasks.workunit.client.1.smithi103.stdout:6/363: readlink d2/d24/l35 0 2024-09-18T21:12:47.877 INFO:tasks.workunit.client.1.smithi103.stdout:5/346: chown de/ff 227776 1 2024-09-18T21:12:47.877 INFO:tasks.workunit.client.1.smithi103.stdout:3/307: rename d1/da/l1f to d1/d23/d25/d4f/d51/l5f 0 2024-09-18T21:12:47.880 INFO:tasks.workunit.client.1.smithi103.stdout:5/347: write de/d2d/d44/f65 [4441798,33984] 0 2024-09-18T21:12:47.880 INFO:tasks.workunit.client.1.smithi103.stdout:6/364: fsync d2/d3/d8/d4c/d4e/f70 0 2024-09-18T21:12:47.880 INFO:tasks.workunit.client.1.smithi103.stdout:3/308: truncate d1/f24 2933137 0 2024-09-18T21:12:47.882 INFO:tasks.workunit.client.1.smithi103.stdout:8/353: dwrite d4/ff [4194304,4194304] 0 2024-09-18T21:12:47.884 INFO:tasks.workunit.client.1.smithi103.stdout:3/309: creat d1/d23/d25/f60 x:0 0 0 2024-09-18T21:12:47.885 INFO:tasks.workunit.client.1.smithi103.stdout:9/353: dwrite f12 [0,4194304] 0 2024-09-18T21:12:47.885 INFO:tasks.workunit.client.1.smithi103.stdout:6/365: truncate d2/d3/f55 2208384 0 2024-09-18T21:12:47.888 INFO:tasks.workunit.client.1.smithi103.stdout:3/310: creat d1/d2/d18/d30/d4e/f61 x:0 0 0 2024-09-18T21:12:47.888 INFO:tasks.workunit.client.1.smithi103.stdout:9/354: symlink d18/d52/d5e/l73 0 2024-09-18T21:12:47.889 INFO:tasks.workunit.client.1.smithi103.stdout:3/311: truncate d1/d23/d25/f60 82912 0 2024-09-18T21:12:47.889 INFO:tasks.workunit.client.1.smithi103.stdout:6/366: getdents d2/d3/d4/d43/d44 0 2024-09-18T21:12:47.889 INFO:tasks.workunit.client.1.smithi103.stdout:9/355: mknod d18/d1f/d2f/c74 0 2024-09-18T21:12:47.892 INFO:tasks.workunit.client.1.smithi103.stdout:3/312: mkdir d1/d2/d18/d30/d4e/d62 0 2024-09-18T21:12:47.893 INFO:tasks.workunit.client.1.smithi103.stdout:3/313: read d1/d2/f8 [2438722,29033] 0 2024-09-18T21:12:47.894 INFO:tasks.workunit.client.1.smithi103.stdout:9/356: symlink d18/d1f/l75 0 2024-09-18T21:12:47.894 INFO:tasks.workunit.client.1.smithi103.stdout:3/314: write d1/d2/d18/f2f [414740,4070] 0 2024-09-18T21:12:47.896 INFO:tasks.workunit.client.1.smithi103.stdout:9/357: mknod d18/d52/c76 0 2024-09-18T21:12:47.897 INFO:tasks.workunit.client.1.smithi103.stdout:9/358: symlink d18/d1f/d2f/l77 0 2024-09-18T21:12:47.901 INFO:tasks.workunit.client.1.smithi103.stdout:3/315: dwrite d1/d2/fb [4194304,4194304] 0 2024-09-18T21:12:47.904 INFO:tasks.workunit.client.1.smithi103.stdout:9/359: dwrite d18/d52/f54 [0,4194304] 0 2024-09-18T21:12:47.906 INFO:tasks.workunit.client.1.smithi103.stdout:3/316: link d1/d2/f4b d1/d23/f63 0 2024-09-18T21:12:47.908 INFO:tasks.workunit.client.1.smithi103.stdout:9/360: mkdir d18/d29/d68/d78 0 2024-09-18T21:12:47.909 INFO:tasks.workunit.client.1.smithi103.stdout:4/343: sync 2024-09-18T21:12:47.910 INFO:tasks.workunit.client.1.smithi103.stdout:9/361: symlink d18/d52/d5e/l79 0 2024-09-18T21:12:47.912 INFO:tasks.workunit.client.1.smithi103.stdout:4/344: creat d9/d38/f7a x:0 0 0 2024-09-18T21:12:47.913 INFO:tasks.workunit.client.1.smithi103.stdout:3/317: rmdir d1/d23/d5e 0 2024-09-18T21:12:47.914 INFO:tasks.workunit.client.1.smithi103.stdout:9/362: mknod d18/d52/c7a 0 2024-09-18T21:12:47.914 INFO:tasks.workunit.client.1.smithi103.stdout:4/345: mknod d9/d1c/d69/c7b 0 2024-09-18T21:12:47.915 INFO:tasks.workunit.client.1.smithi103.stdout:3/318: rmdir d1/d23/d47 39 2024-09-18T21:12:47.915 INFO:tasks.workunit.client.0.smithi077.stdout:6/351: sync 2024-09-18T21:12:47.915 INFO:tasks.workunit.client.0.smithi077.stdout:0/398: sync 2024-09-18T21:12:47.916 INFO:tasks.workunit.client.0.smithi077.stdout:8/254: sync 2024-09-18T21:12:47.917 INFO:tasks.workunit.client.0.smithi077.stdout:6/352: write d7/df/d11/f57 [209643,56263] 0 2024-09-18T21:12:47.917 INFO:tasks.workunit.client.1.smithi103.stdout:3/319: mkdir d1/d64 0 2024-09-18T21:12:47.918 INFO:tasks.workunit.client.0.smithi077.stdout:0/399: creat d8/d1a/d39/d3b/d4e/f7f x:0 0 0 2024-09-18T21:12:47.921 INFO:tasks.workunit.client.1.smithi103.stdout:9/363: dread d18/d1f/d2f/f50 [0,4194304] 0 2024-09-18T21:12:47.925 INFO:tasks.workunit.client.0.smithi077.stdout:0/400: rename d8/d1a/d39/d3b/d4e/d58 to d8/d1d/d80 0 2024-09-18T21:12:47.929 INFO:tasks.workunit.client.0.smithi077.stdout:0/401: mkdir d8/d1d/d57/d81 0 2024-09-18T21:12:47.936 INFO:tasks.workunit.client.1.smithi103.stdout:7/318: dread d1/df/d42/d29/d2f/f4f [0,4194304] 0 2024-09-18T21:12:47.936 INFO:tasks.workunit.client.1.smithi103.stdout:6/367: read d2/f56 [1989924,65617] 0 2024-09-18T21:12:47.938 INFO:tasks.workunit.client.1.smithi103.stdout:7/319: creat d1/df/d42/d1f/f5e x:0 0 0 2024-09-18T21:12:47.950 INFO:tasks.workunit.client.0.smithi077.stdout:0/402: dread d8/d1a/d39/f3c [0,4194304] 0 2024-09-18T21:12:47.951 INFO:tasks.workunit.client.0.smithi077.stdout:0/403: creat d8/d1a/d35/f82 x:0 0 0 2024-09-18T21:12:47.952 INFO:tasks.workunit.client.0.smithi077.stdout:0/404: fsync d8/d26/f75 0 2024-09-18T21:12:47.953 INFO:tasks.workunit.client.0.smithi077.stdout:8/255: truncate d2/d5/d6/f2c 1613146 0 2024-09-18T21:12:47.953 INFO:tasks.workunit.client.0.smithi077.stdout:6/353: write d7/df/d11/d1d/f38 [9340,83996] 0 2024-09-18T21:12:47.953 INFO:tasks.workunit.client.0.smithi077.stdout:0/405: write d8/d1a/d39/d3b/d79/f7d [593510,104769] 0 2024-09-18T21:12:47.954 INFO:tasks.workunit.client.0.smithi077.stdout:8/256: fsync d2/d5/d6/d22/d20/f24 0 2024-09-18T21:12:47.958 INFO:tasks.workunit.client.0.smithi077.stdout:0/406: mknod d8/d1a/d39/d64/c83 0 2024-09-18T21:12:47.960 INFO:tasks.workunit.client.0.smithi077.stdout:8/257: symlink d2/d5/d6/d22/l5b 0 2024-09-18T21:12:47.961 INFO:tasks.workunit.client.0.smithi077.stdout:0/407: creat d8/d1d/d80/f84 x:0 0 0 2024-09-18T21:12:47.963 INFO:tasks.workunit.client.0.smithi077.stdout:8/258: truncate d2/f31 608436 0 2024-09-18T21:12:47.965 INFO:tasks.workunit.client.0.smithi077.stdout:6/354: dread d7/f1f [0,4194304] 0 2024-09-18T21:12:47.968 INFO:tasks.workunit.client.0.smithi077.stdout:8/259: dread f1 [0,4194304] 0 2024-09-18T21:12:47.968 INFO:tasks.workunit.client.0.smithi077.stdout:0/408: link d8/d1d/d80/f84 d8/d1a/d35/f85 0 2024-09-18T21:12:47.972 INFO:tasks.workunit.client.0.smithi077.stdout:8/260: creat d2/d5/d6/d22/d4f/d5a/f5c x:0 0 0 2024-09-18T21:12:47.973 INFO:tasks.workunit.client.0.smithi077.stdout:8/261: write d2/d5/d6/f14 [2793399,5130] 0 2024-09-18T21:12:47.973 INFO:tasks.workunit.client.0.smithi077.stdout:6/355: link d7/df/d11/f45 d7/df/d11/d1d/d31/f71 0 2024-09-18T21:12:47.977 INFO:tasks.workunit.client.0.smithi077.stdout:8/262: creat d2/d5/d6/d22/d4f/f5d x:0 0 0 2024-09-18T21:12:47.979 INFO:tasks.workunit.client.0.smithi077.stdout:6/356: rename d7/f23 to d7/df/d11/d3e/d42/f72 0 2024-09-18T21:12:47.982 INFO:tasks.workunit.client.0.smithi077.stdout:6/357: truncate d7/df/d11/d1d/d5c/f6b 620050 0 2024-09-18T21:12:47.983 INFO:tasks.workunit.client.0.smithi077.stdout:6/358: stat d7/df/l3b 0 2024-09-18T21:12:47.984 INFO:tasks.workunit.client.0.smithi077.stdout:8/263: dwrite d2/d5/d6/d22/d20/f56 [0,4194304] 0 2024-09-18T21:12:47.986 INFO:tasks.workunit.client.1.smithi103.stdout:6/368: rmdir d2/d3/d8/d4c/d4e 39 2024-09-18T21:12:47.987 INFO:tasks.workunit.client.1.smithi103.stdout:5/348: truncate de/d3e/f43 7690540 0 2024-09-18T21:12:47.987 INFO:tasks.workunit.client.1.smithi103.stdout:6/369: readlink d2/l3f 0 2024-09-18T21:12:47.987 INFO:tasks.workunit.client.0.smithi077.stdout:6/359: symlink d7/df/d11/d1d/d49/d55/l73 0 2024-09-18T21:12:47.988 INFO:tasks.workunit.client.1.smithi103.stdout:8/354: truncate d4/d26/d56/f62 1871974 0 2024-09-18T21:12:47.988 INFO:tasks.workunit.client.0.smithi077.stdout:0/409: write d8/d26/f32 [298834,117833] 0 2024-09-18T21:12:47.991 INFO:tasks.workunit.client.0.smithi077.stdout:6/360: symlink d7/df/d11/d3e/d42/l74 0 2024-09-18T21:12:47.994 INFO:tasks.workunit.client.0.smithi077.stdout:0/410: creat d8/d1a/d39/f86 x:0 0 0 2024-09-18T21:12:47.995 INFO:tasks.workunit.client.1.smithi103.stdout:7/320: dread d1/df/d42/d29/d2f/d33/f40 [0,4194304] 0 2024-09-18T21:12:47.996 INFO:tasks.workunit.client.1.smithi103.stdout:8/355: truncate d4/d2d/d3d/d42/d65/f5b 528203 0 2024-09-18T21:12:47.997 INFO:tasks.workunit.client.1.smithi103.stdout:9/364: dwrite d18/d1f/f58 [0,4194304] 0 2024-09-18T21:12:47.999 INFO:tasks.workunit.client.1.smithi103.stdout:5/349: dwrite de/d2d/f69 [0,4194304] 0 2024-09-18T21:12:47.999 INFO:tasks.workunit.client.1.smithi103.stdout:6/370: dread d2/d3/d8/f59 [0,4194304] 0 2024-09-18T21:12:47.999 INFO:tasks.workunit.client.0.smithi077.stdout:6/361: rename d7/df/d11/d3e/l4f to d7/df/d11/d3e/l75 0 2024-09-18T21:12:48.002 INFO:tasks.workunit.client.0.smithi077.stdout:8/264: dread d2/d5/d6/d22/d26/f32 [0,4194304] 0 2024-09-18T21:12:48.002 INFO:tasks.workunit.client.0.smithi077.stdout:7/372: sync 2024-09-18T21:12:48.003 INFO:tasks.workunit.client.0.smithi077.stdout:4/289: sync 2024-09-18T21:12:48.003 INFO:tasks.workunit.client.0.smithi077.stdout:9/210: sync 2024-09-18T21:12:48.003 INFO:tasks.workunit.client.0.smithi077.stdout:2/407: sync 2024-09-18T21:12:48.004 INFO:tasks.workunit.client.0.smithi077.stdout:4/290: stat d3/dc/f46 0 2024-09-18T21:12:48.004 INFO:tasks.workunit.client.1.smithi103.stdout:7/321: creat d1/f5f x:0 0 0 2024-09-18T21:12:48.004 INFO:tasks.workunit.client.1.smithi103.stdout:8/356: mknod d4/d2d/d3d/d42/c68 0 2024-09-18T21:12:48.004 INFO:tasks.workunit.client.0.smithi077.stdout:4/291: dread - d3/dc/d20/f40 zero size 2024-09-18T21:12:48.005 INFO:tasks.workunit.client.0.smithi077.stdout:6/362: readlink d7/df/d11/d1d/d50/l6d 0 2024-09-18T21:12:48.006 INFO:tasks.workunit.client.0.smithi077.stdout:7/373: rmdir d12/d31 39 2024-09-18T21:12:48.007 INFO:tasks.workunit.client.1.smithi103.stdout:9/365: dwrite d18/d1f/d2f/f65 [4194304,4194304] 0 2024-09-18T21:12:48.008 INFO:tasks.workunit.client.0.smithi077.stdout:8/265: mkdir d2/d5/d6/d22/d4f/d5a/d5e 0 2024-09-18T21:12:48.011 INFO:tasks.workunit.client.1.smithi103.stdout:7/322: symlink d1/df/d54/l60 0 2024-09-18T21:12:48.013 INFO:tasks.workunit.client.0.smithi077.stdout:6/363: creat d7/df/d11/d3e/f76 x:0 0 0 2024-09-18T21:12:48.013 INFO:tasks.workunit.client.1.smithi103.stdout:8/357: unlink d4/d2d/d3d/d42/d65/f5b 0 2024-09-18T21:12:48.016 INFO:tasks.workunit.client.0.smithi077.stdout:6/364: write d7/df/f14 [3402919,57324] 0 2024-09-18T21:12:48.017 INFO:tasks.workunit.client.1.smithi103.stdout:9/366: creat d18/d52/d5e/f7b x:0 0 0 2024-09-18T21:12:48.018 INFO:tasks.workunit.client.0.smithi077.stdout:9/211: dwrite d1/dd/d11/f3e [0,4194304] 0 2024-09-18T21:12:48.019 INFO:tasks.workunit.client.1.smithi103.stdout:5/350: link de/d2d/f56 de/d1f/d3b/d51/d57/d59/f6e 0 2024-09-18T21:12:48.021 INFO:tasks.workunit.client.0.smithi077.stdout:7/374: dread d12/d22/f64 [0,4194304] 0 2024-09-18T21:12:48.022 INFO:tasks.workunit.client.0.smithi077.stdout:4/292: dwrite d3/dc/d32/f48 [0,4194304] 0 2024-09-18T21:12:48.023 INFO:tasks.workunit.client.1.smithi103.stdout:7/323: mkdir d1/df/d43/d61 0 2024-09-18T21:12:48.024 INFO:tasks.workunit.client.1.smithi103.stdout:8/358: mknod d4/d2d/d3d/d42/c69 0 2024-09-18T21:12:48.025 INFO:tasks.workunit.client.1.smithi103.stdout:8/359: readlink d4/d2d/d4e/l63 0 2024-09-18T21:12:48.026 INFO:tasks.workunit.client.0.smithi077.stdout:2/408: creat d1/d4/d5/d1a/f89 x:0 0 0 2024-09-18T21:12:48.027 INFO:tasks.workunit.client.1.smithi103.stdout:6/371: creat d2/d3/d8/d4c/f71 x:0 0 0 2024-09-18T21:12:48.029 INFO:tasks.workunit.client.0.smithi077.stdout:2/409: dread - d1/d4/d9/d80/f87 zero size 2024-09-18T21:12:48.029 INFO:tasks.workunit.client.0.smithi077.stdout:2/410: readlink d1/d4/d5/l73 0 2024-09-18T21:12:48.029 INFO:tasks.workunit.client.0.smithi077.stdout:8/266: mkdir d2/d5f 0 2024-09-18T21:12:48.030 INFO:tasks.workunit.client.0.smithi077.stdout:8/267: chown d2/d5/d6/d22/l2f 2391 1 2024-09-18T21:12:48.033 INFO:tasks.workunit.client.1.smithi103.stdout:7/324: truncate d1/df/d42/d29/d2f/d33/f40 1060731 0 2024-09-18T21:12:48.034 INFO:tasks.workunit.client.1.smithi103.stdout:7/325: truncate d1/df/d42/f4e 475102 0 2024-09-18T21:12:48.035 INFO:tasks.workunit.client.0.smithi077.stdout:0/411: truncate d8/d1a/f42 264565 0 2024-09-18T21:12:48.036 INFO:tasks.workunit.client.1.smithi103.stdout:8/360: creat d4/de/d4a/d59/d5e/f6a x:0 0 0 2024-09-18T21:12:48.037 INFO:tasks.workunit.client.1.smithi103.stdout:0/350: sync 2024-09-18T21:12:48.037 INFO:tasks.workunit.client.1.smithi103.stdout:2/270: sync 2024-09-18T21:12:48.037 INFO:tasks.workunit.client.1.smithi103.stdout:1/341: sync 2024-09-18T21:12:48.037 INFO:tasks.workunit.client.0.smithi077.stdout:2/411: fdatasync d1/f11 0 2024-09-18T21:12:48.040 INFO:tasks.workunit.client.0.smithi077.stdout:9/212: creat d1/dd/d11/d1c/d38/f41 x:0 0 0 2024-09-18T21:12:48.042 INFO:tasks.workunit.client.1.smithi103.stdout:9/367: rename d18/l1e to d18/d52/l7c 0 2024-09-18T21:12:48.043 INFO:tasks.workunit.client.0.smithi077.stdout:0/412: dwrite d8/d1a/d35/f7a [0,4194304] 0 2024-09-18T21:12:48.043 INFO:tasks.workunit.client.0.smithi077.stdout:8/268: readlink d2/d5/l17 0 2024-09-18T21:12:48.045 INFO:tasks.workunit.client.0.smithi077.stdout:8/269: write d2/d27/d29/f3f [2911420,62827] 0 2024-09-18T21:12:48.047 INFO:tasks.workunit.client.1.smithi103.stdout:7/326: mknod d1/df/d54/c62 0 2024-09-18T21:12:48.047 INFO:tasks.workunit.client.0.smithi077.stdout:9/213: dread d1/df/f1e [0,4194304] 0 2024-09-18T21:12:48.049 INFO:tasks.workunit.client.0.smithi077.stdout:3/321: sync 2024-09-18T21:12:48.049 INFO:tasks.workunit.client.0.smithi077.stdout:5/487: sync 2024-09-18T21:12:48.050 INFO:tasks.workunit.client.0.smithi077.stdout:1/322: sync 2024-09-18T21:12:48.050 INFO:tasks.workunit.client.1.smithi103.stdout:0/351: unlink d1/d9/d13/c2c 0 2024-09-18T21:12:48.051 INFO:tasks.workunit.client.0.smithi077.stdout:3/322: write db/f29 [3062389,86312] 0 2024-09-18T21:12:48.051 INFO:tasks.workunit.client.0.smithi077.stdout:5/488: write d0/d6/f50 [7863271,10848] 0 2024-09-18T21:12:48.052 INFO:tasks.workunit.client.0.smithi077.stdout:1/323: dread - d3/d8/d49/d4e/d5a/f78 zero size 2024-09-18T21:12:48.053 INFO:tasks.workunit.client.0.smithi077.stdout:7/375: dread d12/f24 [0,4194304] 0 2024-09-18T21:12:48.054 INFO:tasks.workunit.client.0.smithi077.stdout:1/324: read - d3/d8/d13/d18/f74 zero size 2024-09-18T21:12:48.055 INFO:tasks.workunit.client.0.smithi077.stdout:1/325: stat d3/d1e/d68/c43 0 2024-09-18T21:12:48.055 INFO:tasks.workunit.client.0.smithi077.stdout:5/489: read - d0/df/d3d/d85/f86 zero size 2024-09-18T21:12:48.056 INFO:tasks.workunit.client.1.smithi103.stdout:6/372: getdents d2/d3/d4/d43/d44 0 2024-09-18T21:12:48.059 INFO:tasks.workunit.client.1.smithi103.stdout:9/368: creat d18/d52/d5e/f7d x:0 0 0 2024-09-18T21:12:48.059 INFO:tasks.workunit.client.1.smithi103.stdout:9/369: chown d18/d1f/c33 405971 1 2024-09-18T21:12:48.063 INFO:tasks.workunit.client.1.smithi103.stdout:7/327: mkdir d1/df/d43/d63 0 2024-09-18T21:12:48.064 INFO:tasks.workunit.client.1.smithi103.stdout:7/328: chown d1/df/d44 388499 1 2024-09-18T21:12:48.066 INFO:tasks.workunit.client.0.smithi077.stdout:8/270: unlink d2/d5/d6/f52 0 2024-09-18T21:12:48.067 INFO:tasks.workunit.client.0.smithi077.stdout:8/271: stat d2/d27 0 2024-09-18T21:12:48.067 INFO:tasks.workunit.client.1.smithi103.stdout:1/342: mkdir d0/d11/d5f/d19/d70/d7a 0 2024-09-18T21:12:48.068 INFO:tasks.workunit.client.0.smithi077.stdout:4/293: dwrite d3/dc/f1b [0,4194304] 0 2024-09-18T21:12:48.068 INFO:tasks.workunit.client.0.smithi077.stdout:9/214: mkdir d1/dd/d1a/d42 0 2024-09-18T21:12:48.069 INFO:tasks.workunit.client.1.smithi103.stdout:7/329: dwrite d1/df/d42/f4e [0,4194304] 0 2024-09-18T21:12:48.070 INFO:tasks.workunit.client.1.smithi103.stdout:2/271: link d3/d5/d2f/d48/f4f d3/d5/d2c/f64 0 2024-09-18T21:12:48.071 INFO:tasks.workunit.client.1.smithi103.stdout:2/272: readlink d3/l19 0 2024-09-18T21:12:48.075 INFO:tasks.workunit.client.1.smithi103.stdout:1/343: dwrite d0/f37 [0,4194304] 0 2024-09-18T21:12:48.076 INFO:tasks.workunit.client.1.smithi103.stdout:5/351: getdents de/d1f/d3b/d58 0 2024-09-18T21:12:48.076 INFO:tasks.workunit.client.0.smithi077.stdout:2/412: write d1/d4/f8 [3944692,75978] 0 2024-09-18T21:12:48.077 INFO:tasks.workunit.client.1.smithi103.stdout:5/352: write de/d3e/d15/f2e [861975,105434] 0 2024-09-18T21:12:48.078 INFO:tasks.workunit.client.0.smithi077.stdout:2/413: write d1/d4/d9/d24/f82 [890915,14285] 0 2024-09-18T21:12:48.078 INFO:tasks.workunit.client.0.smithi077.stdout:3/323: creat db/d14/d22/d36/d39/f65 x:0 0 0 2024-09-18T21:12:48.083 INFO:tasks.workunit.client.0.smithi077.stdout:5/490: creat d0/df/d10/fac x:0 0 0 2024-09-18T21:12:48.089 INFO:tasks.workunit.client.0.smithi077.stdout:6/365: getdents d7/df/d11/d1d/d5c 0 2024-09-18T21:12:48.090 INFO:tasks.workunit.client.1.smithi103.stdout:9/370: symlink d18/d52/d6f/l7e 0 2024-09-18T21:12:48.096 INFO:tasks.workunit.client.0.smithi077.stdout:4/294: creat d3/d7/d42/f5d x:0 0 0 2024-09-18T21:12:48.097 INFO:tasks.workunit.client.1.smithi103.stdout:9/371: dwrite d18/f3c [0,4194304] 0 2024-09-18T21:12:48.098 INFO:tasks.workunit.client.1.smithi103.stdout:9/372: readlink d18/l6a 0 2024-09-18T21:12:48.099 INFO:tasks.workunit.client.0.smithi077.stdout:3/324: unlink db/d14/d22/d36/d39/f57 0 2024-09-18T21:12:48.101 INFO:tasks.workunit.client.0.smithi077.stdout:3/325: write db/d14/f1d [495682,26460] 0 2024-09-18T21:12:48.101 INFO:tasks.workunit.client.1.smithi103.stdout:6/373: dread d2/d24/f3b [0,4194304] 0 2024-09-18T21:12:48.103 INFO:tasks.workunit.client.0.smithi077.stdout:8/272: dread d2/d5/d6/f2c [0,4194304] 0 2024-09-18T21:12:48.104 INFO:tasks.workunit.client.1.smithi103.stdout:7/330: dread d1/f13 [0,4194304] 0 2024-09-18T21:12:48.105 INFO:tasks.workunit.client.0.smithi077.stdout:2/414: creat d1/d4/d9/d24/d66/f8a x:0 0 0 2024-09-18T21:12:48.106 INFO:tasks.workunit.client.1.smithi103.stdout:2/273: dread d3/d5/d25/f33 [0,4194304] 0 2024-09-18T21:12:48.106 INFO:tasks.workunit.client.0.smithi077.stdout:2/415: chown d1/d4/d9/d4f/f63 1658338 1 2024-09-18T21:12:48.107 INFO:tasks.workunit.client.1.smithi103.stdout:5/353: dread de/d1f/d3b/f4a [0,4194304] 0 2024-09-18T21:12:48.110 INFO:tasks.workunit.client.0.smithi077.stdout:2/416: truncate d1/d4/d5/d1a/f4c 294213 0 2024-09-18T21:12:48.111 INFO:tasks.workunit.client.0.smithi077.stdout:8/273: dread d2/d5/d6/d22/d20/d3e/f47 [0,4194304] 0 2024-09-18T21:12:48.111 INFO:tasks.workunit.client.0.smithi077.stdout:2/417: stat d1/d4/d9/l5b 0 2024-09-18T21:12:48.114 INFO:tasks.workunit.client.0.smithi077.stdout:5/491: unlink d0/d43/l63 0 2024-09-18T21:12:48.115 INFO:tasks.workunit.client.0.smithi077.stdout:7/376: truncate d12/d56/f3a 3270909 0 2024-09-18T21:12:48.118 INFO:tasks.workunit.client.0.smithi077.stdout:0/413: mkdir d8/d37/d66/d87 0 2024-09-18T21:12:48.118 INFO:tasks.workunit.client.0.smithi077.stdout:4/295: dread d3/d35/f37 [0,4194304] 0 2024-09-18T21:12:48.118 INFO:tasks.workunit.client.0.smithi077.stdout:4/296: dread - d3/f57 zero size 2024-09-18T21:12:48.119 INFO:tasks.workunit.client.1.smithi103.stdout:7/331: rename d1/df/d54/f57 to d1/df/d43/d61/f64 0 2024-09-18T21:12:48.119 INFO:tasks.workunit.client.1.smithi103.stdout:7/332: write d1/df/f18 [2610279,85431] 0 2024-09-18T21:12:48.120 INFO:tasks.workunit.client.1.smithi103.stdout:2/274: creat d3/d5/d2c/f65 x:0 0 0 2024-09-18T21:12:48.121 INFO:tasks.workunit.client.1.smithi103.stdout:5/354: mknod de/d1f/d3b/d51/c6f 0 2024-09-18T21:12:48.121 INFO:tasks.workunit.client.1.smithi103.stdout:2/275: chown d3/d5/d25/f5f 482452821 1 2024-09-18T21:12:48.122 INFO:tasks.workunit.client.1.smithi103.stdout:6/374: mknod d2/d24/c72 0 2024-09-18T21:12:48.124 INFO:tasks.workunit.client.0.smithi077.stdout:3/326: unlink db/d14/d22/f5a 0 2024-09-18T21:12:48.127 INFO:tasks.workunit.client.0.smithi077.stdout:8/274: creat d2/d5/d6/d22/d26/f60 x:0 0 0 2024-09-18T21:12:48.128 INFO:tasks.workunit.client.1.smithi103.stdout:5/355: dwrite de/d14/d33/d4f/f68 [0,4194304] 0 2024-09-18T21:12:48.128 INFO:tasks.workunit.client.1.smithi103.stdout:1/344: write d0/d2/d9/dc/f69 [1361612,26819] 0 2024-09-18T21:12:48.129 INFO:tasks.workunit.client.0.smithi077.stdout:5/492: read d0/d6/d3b/d64/f6c [3970964,64305] 0 2024-09-18T21:12:48.130 INFO:tasks.workunit.client.1.smithi103.stdout:6/375: dread d2/f12 [0,4194304] 0 2024-09-18T21:12:48.130 INFO:tasks.workunit.client.0.smithi077.stdout:5/493: write d0/df/f27 [263368,84980] 0 2024-09-18T21:12:48.131 INFO:tasks.workunit.client.0.smithi077.stdout:5/494: dread - d0/df/d84/f90 zero size 2024-09-18T21:12:48.133 INFO:tasks.workunit.client.1.smithi103.stdout:7/333: symlink d1/df/d54/l65 0 2024-09-18T21:12:48.133 INFO:tasks.workunit.client.0.smithi077.stdout:5/495: write d0/df/d3d/d85/f96 [761130,108285] 0 2024-09-18T21:12:48.135 INFO:tasks.workunit.client.1.smithi103.stdout:7/334: write d1/fe [3383856,105071] 0 2024-09-18T21:12:48.136 INFO:tasks.workunit.client.0.smithi077.stdout:1/326: rename d3/d8/d13/d18/f51 to d3/d8/d49/f79 0 2024-09-18T21:12:48.137 INFO:tasks.workunit.client.0.smithi077.stdout:1/327: write d3/f23 [3591250,79145] 0 2024-09-18T21:12:48.137 INFO:tasks.workunit.client.1.smithi103.stdout:1/345: dwrite d0/d3/f29 [0,4194304] 0 2024-09-18T21:12:48.141 INFO:tasks.workunit.client.0.smithi077.stdout:0/414: rmdir d8/d1a/d39 39 2024-09-18T21:12:48.141 INFO:tasks.workunit.client.1.smithi103.stdout:2/276: creat d3/d5/d2c/f66 x:0 0 0 2024-09-18T21:12:48.141 INFO:tasks.workunit.client.1.smithi103.stdout:6/376: dwrite d2/f22 [4194304,4194304] 0 2024-09-18T21:12:48.141 INFO:tasks.workunit.client.1.smithi103.stdout:1/346: chown d0/d11/l17 22565526 1 2024-09-18T21:12:48.142 INFO:tasks.workunit.client.0.smithi077.stdout:4/297: mkdir d3/dc/d32/d45/d5e 0 2024-09-18T21:12:48.143 INFO:tasks.workunit.client.0.smithi077.stdout:4/298: dread - d3/d35/f56 zero size 2024-09-18T21:12:48.153 INFO:tasks.workunit.client.0.smithi077.stdout:4/299: dwrite d3/f1f [0,4194304] 0 2024-09-18T21:12:48.155 INFO:tasks.workunit.client.0.smithi077.stdout:3/327: creat db/d14/d32/d3a/d3b/f66 x:0 0 0 2024-09-18T21:12:48.160 INFO:tasks.workunit.client.0.smithi077.stdout:7/377: creat d12/d31/d77/f84 x:0 0 0 2024-09-18T21:12:48.162 INFO:tasks.workunit.client.1.smithi103.stdout:6/377: symlink d2/d3/d8/d4c/d4e/l73 0 2024-09-18T21:12:48.163 INFO:tasks.workunit.client.0.smithi077.stdout:1/328: symlink d3/d1e/l7a 0 2024-09-18T21:12:48.165 INFO:tasks.workunit.client.0.smithi077.stdout:0/415: unlink d8/d1a/l77 0 2024-09-18T21:12:48.165 INFO:tasks.workunit.client.0.smithi077.stdout:9/215: link d1/df/d27/l35 d1/dd/d11/d2d/l43 0 2024-09-18T21:12:48.166 INFO:tasks.workunit.client.1.smithi103.stdout:5/356: getdents de/d1f/d3b/d51/d57/d59 0 2024-09-18T21:12:48.167 INFO:tasks.workunit.client.1.smithi103.stdout:5/357: write de/d14/d33/d4f/f68 [1990478,23953] 0 2024-09-18T21:12:48.168 INFO:tasks.workunit.client.1.smithi103.stdout:6/378: dwrite d2/d3/f48 [0,4194304] 0 2024-09-18T21:12:48.169 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:48 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:12:48.169 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:48 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:12:48.169 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:48 smithi103 ceph-mon[34827]: pgmap v15: 65 pgs: 65 active+clean; 1.1 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 16 MiB/s rd, 124 MiB/s wr, 232 op/s 2024-09-18T21:12:48.169 INFO:tasks.workunit.client.0.smithi077.stdout:8/275: link d2/d5/d6/d22/d26/f60 d2/d27/d29/f61 0 2024-09-18T21:12:48.170 INFO:tasks.workunit.client.1.smithi103.stdout:5/358: write de/d14/d33/d4f/f6a [4345912,113977] 0 2024-09-18T21:12:48.170 INFO:tasks.workunit.client.0.smithi077.stdout:7/378: rmdir d12/d31/d33 39 2024-09-18T21:12:48.171 INFO:tasks.workunit.client.1.smithi103.stdout:5/359: dread - de/d2d/d44/f6b zero size 2024-09-18T21:12:48.171 INFO:tasks.workunit.client.0.smithi077.stdout:7/379: chown d12/d22/d59/d5a 31955 1 2024-09-18T21:12:48.173 INFO:tasks.workunit.client.0.smithi077.stdout:0/416: creat d8/d26/f88 x:0 0 0 2024-09-18T21:12:48.175 INFO:tasks.workunit.client.0.smithi077.stdout:8/276: dread d2/d5/d6/d22/d20/f56 [0,4194304] 0 2024-09-18T21:12:48.175 INFO:tasks.workunit.client.1.smithi103.stdout:2/277: dread d3/d5/d2c/f3e [0,4194304] 0 2024-09-18T21:12:48.175 INFO:tasks.workunit.client.1.smithi103.stdout:6/379: unlink d2/l3c 0 2024-09-18T21:12:48.176 INFO:tasks.workunit.client.0.smithi077.stdout:9/216: fdatasync d1/df/f1e 0 2024-09-18T21:12:48.177 INFO:tasks.workunit.client.0.smithi077.stdout:4/300: creat d3/dc/d32/d45/d5e/f5f x:0 0 0 2024-09-18T21:12:48.181 INFO:tasks.workunit.client.0.smithi077.stdout:4/301: dread d3/dc/d20/f29 [0,4194304] 0 2024-09-18T21:12:48.182 INFO:tasks.workunit.client.0.smithi077.stdout:5/496: rename d0/l13 to d0/lad 0 2024-09-18T21:12:48.182 INFO:tasks.workunit.client.0.smithi077.stdout:9/217: dread d1/df/f1e [0,4194304] 0 2024-09-18T21:12:48.183 INFO:tasks.workunit.client.0.smithi077.stdout:4/302: chown d3/dc/d32/d45/c59 808 1 2024-09-18T21:12:48.185 INFO:tasks.workunit.client.0.smithi077.stdout:4/303: write d3/d7/d42/f5d [647432,64243] 0 2024-09-18T21:12:48.189 INFO:tasks.workunit.client.0.smithi077.stdout:7/380: symlink d12/d56/l85 0 2024-09-18T21:12:48.191 INFO:tasks.workunit.client.0.smithi077.stdout:0/417: creat d8/d1a/d35/d6d/f89 x:0 0 0 2024-09-18T21:12:48.192 INFO:tasks.workunit.client.0.smithi077.stdout:0/418: fsync d8/d1d/f2b 0 2024-09-18T21:12:48.193 INFO:tasks.workunit.client.0.smithi077.stdout:8/277: write d2/d5/d6/d22/d26/f60 [802946,70035] 0 2024-09-18T21:12:48.194 INFO:tasks.workunit.client.1.smithi103.stdout:6/380: creat d2/d3/f74 x:0 0 0 2024-09-18T21:12:48.195 INFO:tasks.workunit.client.0.smithi077.stdout:8/278: chown d2/d5/d6/d22/d20/f24 60960 1 2024-09-18T21:12:48.197 INFO:tasks.workunit.client.1.smithi103.stdout:1/347: dwrite d0/d2/d9/dc/f22 [0,4194304] 0 2024-09-18T21:12:48.198 INFO:tasks.workunit.client.0.smithi077.stdout:3/328: rename db/d14/d22/d36/d39/f65 to db/d14/d32/d3a/f67 0 2024-09-18T21:12:48.199 INFO:tasks.workunit.client.1.smithi103.stdout:5/360: dread de/d1f/f52 [0,4194304] 0 2024-09-18T21:12:48.203 INFO:tasks.workunit.client.0.smithi077.stdout:4/304: dread d3/fa [0,4194304] 0 2024-09-18T21:12:48.205 INFO:tasks.workunit.client.1.smithi103.stdout:6/381: dread d2/d3/d8/f20 [0,4194304] 0 2024-09-18T21:12:48.205 INFO:tasks.workunit.client.0.smithi077.stdout:1/329: creat d3/d8/f7b x:0 0 0 2024-09-18T21:12:48.213 INFO:tasks.workunit.client.1.smithi103.stdout:1/348: link d0/d3/d68/l76 d0/d11/d5f/d19/d70/l7b 0 2024-09-18T21:12:48.213 INFO:tasks.workunit.client.1.smithi103.stdout:1/349: chown d0/d3/f4c 986374950 1 2024-09-18T21:12:48.214 INFO:tasks.workunit.client.0.smithi077.stdout:0/419: creat d8/d1d/d57/f8a x:0 0 0 2024-09-18T21:12:48.214 INFO:tasks.workunit.client.1.smithi103.stdout:1/350: chown d0/d2/d9/dc/f15 58372 1 2024-09-18T21:12:48.217 INFO:tasks.workunit.client.1.smithi103.stdout:1/351: symlink d0/d3/d68/l7c 0 2024-09-18T21:12:48.219 INFO:tasks.workunit.client.0.smithi077.stdout:5/497: mknod d0/d6/cae 0 2024-09-18T21:12:48.219 INFO:tasks.workunit.client.1.smithi103.stdout:2/278: dwrite d3/d5/fe [0,4194304] 0 2024-09-18T21:12:48.219 INFO:tasks.workunit.client.0.smithi077.stdout:4/305: creat d3/dc/f60 x:0 0 0 2024-09-18T21:12:48.221 INFO:tasks.workunit.client.1.smithi103.stdout:1/352: stat d0/d2/d9/d10/f67 0 2024-09-18T21:12:48.221 INFO:tasks.workunit.client.0.smithi077.stdout:5/498: write d0/df/d3d/d85/f96 [1057092,18981] 0 2024-09-18T21:12:48.222 INFO:tasks.workunit.client.0.smithi077.stdout:8/279: dwrite f1 [0,4194304] 0 2024-09-18T21:12:48.224 INFO:tasks.workunit.client.0.smithi077.stdout:1/330: truncate d3/d8/f67 420925 0 2024-09-18T21:12:48.225 INFO:tasks.workunit.client.1.smithi103.stdout:5/361: write de/d1f/d3b/d51/d57/d59/f6e [4965581,99576] 0 2024-09-18T21:12:48.225 INFO:tasks.workunit.client.1.smithi103.stdout:4/346: sync 2024-09-18T21:12:48.227 INFO:tasks.workunit.client.1.smithi103.stdout:1/353: symlink d0/d2/d9/dc/d36/l7d 0 2024-09-18T21:12:48.228 INFO:tasks.workunit.client.1.smithi103.stdout:1/354: write d0/d11/d5f/d19/d4d/f6b [3123235,109742] 0 2024-09-18T21:12:48.229 INFO:tasks.workunit.client.1.smithi103.stdout:1/355: readlink d0/d3/l8 0 2024-09-18T21:12:48.234 INFO:tasks.workunit.client.1.smithi103.stdout:5/362: symlink de/d1f/d3b/l70 0 2024-09-18T21:12:48.234 INFO:tasks.workunit.client.1.smithi103.stdout:6/382: truncate d2/d3/d8/f62 189205 0 2024-09-18T21:12:48.234 INFO:tasks.workunit.client.0.smithi077.stdout:9/218: dwrite d1/dd/f14 [4194304,4194304] 0 2024-09-18T21:12:48.236 INFO:tasks.workunit.client.0.smithi077.stdout:9/219: stat d1/dd/d11/l28 0 2024-09-18T21:12:48.237 INFO:tasks.workunit.client.0.smithi077.stdout:4/306: symlink d3/dc/d20/l61 0 2024-09-18T21:12:48.238 INFO:tasks.workunit.client.0.smithi077.stdout:8/280: dwrite d2/d5/d6/d22/d4f/d5a/f5c [0,4194304] 0 2024-09-18T21:12:48.239 INFO:tasks.workunit.client.1.smithi103.stdout:5/363: symlink de/d1f/l71 0 2024-09-18T21:12:48.239 INFO:tasks.workunit.client.1.smithi103.stdout:5/364: dread - de/d14/d33/f53 zero size 2024-09-18T21:12:48.240 INFO:tasks.workunit.client.0.smithi077.stdout:8/281: write d2/d27/d29/f3f [1037882,90316] 0 2024-09-18T21:12:48.240 INFO:tasks.workunit.client.1.smithi103.stdout:6/383: truncate d2/d24/f3b 26844 0 2024-09-18T21:12:48.241 INFO:tasks.workunit.client.0.smithi077.stdout:1/331: dread d3/d1e/f55 [0,4194304] 0 2024-09-18T21:12:48.242 INFO:tasks.workunit.client.0.smithi077.stdout:7/381: link d12/d31/f83 d12/d22/d59/d72/f86 0 2024-09-18T21:12:48.243 INFO:tasks.workunit.client.1.smithi103.stdout:1/356: unlink d0/d11/d5f/c46 0 2024-09-18T21:12:48.245 INFO:tasks.workunit.client.0.smithi077.stdout:0/420: link d8/d1d/d80/f5e d8/d1d/f8b 0 2024-09-18T21:12:48.245 INFO:tasks.workunit.client.0.smithi077.stdout:0/421: readlink d8/d26/l29 0 2024-09-18T21:12:48.247 INFO:tasks.workunit.client.0.smithi077.stdout:8/282: dread d2/d5/d6/d22/d20/d3e/f47 [0,4194304] 0 2024-09-18T21:12:48.247 INFO:tasks.workunit.client.1.smithi103.stdout:2/279: getdents d3/d5 0 2024-09-18T21:12:48.248 INFO:tasks.workunit.client.0.smithi077.stdout:8/283: dread - d2/d27/f57 zero size 2024-09-18T21:12:48.249 INFO:tasks.workunit.client.1.smithi103.stdout:5/365: dwrite de/d14/d33/d4f/f68 [0,4194304] 0 2024-09-18T21:12:48.249 INFO:tasks.workunit.client.0.smithi077.stdout:3/329: creat db/f68 x:0 0 0 2024-09-18T21:12:48.253 INFO:tasks.workunit.client.1.smithi103.stdout:1/357: rmdir d0/d2/d9 39 2024-09-18T21:12:48.258 INFO:tasks.workunit.client.0.smithi077.stdout:9/220: write d1/df/d27/f39 [1268334,87018] 0 2024-09-18T21:12:48.258 INFO:tasks.workunit.client.1.smithi103.stdout:5/366: creat de/d1f/d3b/f72 x:0 0 0 2024-09-18T21:12:48.259 INFO:tasks.workunit.client.0.smithi077.stdout:4/307: creat d3/dc/d32/f62 x:0 0 0 2024-09-18T21:12:48.261 INFO:tasks.workunit.client.0.smithi077.stdout:4/308: write d3/d7/d42/f5d [482731,127294] 0 2024-09-18T21:12:48.264 INFO:tasks.workunit.client.0.smithi077.stdout:1/332: fsync d3/d8/d13/f1f 0 2024-09-18T21:12:48.265 INFO:tasks.workunit.client.1.smithi103.stdout:5/367: mknod de/d1f/d3b/d51/c73 0 2024-09-18T21:12:48.265 INFO:tasks.workunit.client.1.smithi103.stdout:5/368: read de/d2d/d44/f65 [269487,69422] 0 2024-09-18T21:12:48.267 INFO:tasks.workunit.client.1.smithi103.stdout:1/358: creat d0/d2/d9/dc/f7e x:0 0 0 2024-09-18T21:12:48.268 INFO:tasks.workunit.client.0.smithi077.stdout:7/382: unlink d12/d56/l2f 0 2024-09-18T21:12:48.269 INFO:tasks.workunit.client.1.smithi103.stdout:2/280: link d3/d5/d2c/l30 d3/d5/d25/l67 0 2024-09-18T21:12:48.271 INFO:tasks.workunit.client.1.smithi103.stdout:5/369: dwrite de/f2b [0,4194304] 0 2024-09-18T21:12:48.271 INFO:tasks.workunit.client.1.smithi103.stdout:2/281: write d3/d5/d2c/f65 [367109,64598] 0 2024-09-18T21:12:48.277 INFO:tasks.workunit.client.0.smithi077.stdout:5/499: truncate d0/d6/d3b/d64/f79 3093321 0 2024-09-18T21:12:48.278 INFO:tasks.workunit.client.0.smithi077.stdout:5/500: chown d0/df/d10/c2f 19487445 1 2024-09-18T21:12:48.281 INFO:tasks.workunit.client.1.smithi103.stdout:1/359: dwrite d0/d11/f35 [0,4194304] 0 2024-09-18T21:12:48.284 INFO:tasks.workunit.client.1.smithi103.stdout:2/282: mkdir d3/d5/d2c/d54/d68 0 2024-09-18T21:12:48.287 INFO:tasks.workunit.client.1.smithi103.stdout:6/384: dwrite d2/d24/d5a/f17 [0,4194304] 0 2024-09-18T21:12:48.288 INFO:tasks.workunit.client.0.smithi077.stdout:9/221: dread d1/df/f21 [0,4194304] 0 2024-09-18T21:12:48.288 INFO:tasks.workunit.client.1.smithi103.stdout:6/385: read d2/d3/d8/d4c/f61 [48323,44033] 0 2024-09-18T21:12:48.289 INFO:tasks.workunit.client.0.smithi077.stdout:7/383: dread - d12/d22/d59/d5d/d62/f6d zero size 2024-09-18T21:12:48.290 INFO:tasks.workunit.client.1.smithi103.stdout:5/370: mknod de/d3e/c74 0 2024-09-18T21:12:48.291 INFO:tasks.workunit.client.0.smithi077.stdout:7/384: fdatasync d12/d22/d59/d5d/d62/f6d 0 2024-09-18T21:12:48.292 INFO:tasks.workunit.client.0.smithi077.stdout:9/222: dread d1/dd/d11/d2d/f32 [0,4194304] 0 2024-09-18T21:12:48.292 INFO:tasks.workunit.client.0.smithi077.stdout:0/422: fdatasync d8/d37/f48 0 2024-09-18T21:12:48.293 INFO:tasks.workunit.client.0.smithi077.stdout:7/385: stat d12/d22/d59/d72 0 2024-09-18T21:12:48.295 INFO:tasks.workunit.client.1.smithi103.stdout:8/361: sync 2024-09-18T21:12:48.295 INFO:tasks.workunit.client.1.smithi103.stdout:3/320: sync 2024-09-18T21:12:48.295 INFO:tasks.workunit.client.1.smithi103.stdout:9/373: sync 2024-09-18T21:12:48.295 INFO:tasks.workunit.client.1.smithi103.stdout:0/352: sync 2024-09-18T21:12:48.295 INFO:tasks.workunit.client.1.smithi103.stdout:7/335: sync 2024-09-18T21:12:48.296 INFO:tasks.workunit.client.0.smithi077.stdout:8/284: mknod d2/d5/d6/d22/d20/d3e/c62 0 2024-09-18T21:12:48.296 INFO:tasks.workunit.client.1.smithi103.stdout:9/374: stat d18/l1d 0 2024-09-18T21:12:48.296 INFO:tasks.workunit.client.1.smithi103.stdout:2/283: mknod d3/d5/d4a/c69 0 2024-09-18T21:12:48.297 INFO:tasks.workunit.client.1.smithi103.stdout:0/353: dread - d1/d5/de/d19/f7c zero size 2024-09-18T21:12:48.297 INFO:tasks.workunit.client.1.smithi103.stdout:2/284: stat d3/d5/d2f/d5b 0 2024-09-18T21:12:48.299 INFO:tasks.workunit.client.0.smithi077.stdout:3/330: creat db/d4d/f69 x:0 0 0 2024-09-18T21:12:48.300 INFO:tasks.workunit.client.0.smithi077.stdout:9/223: dread d1/dd/f14 [4194304,4194304] 0 2024-09-18T21:12:48.302 INFO:tasks.workunit.client.0.smithi077.stdout:0/423: dwrite d8/d1a/d35/d6d/f89 [0,4194304] 0 2024-09-18T21:12:48.304 INFO:tasks.workunit.client.0.smithi077.stdout:0/424: chown d8/d26/f18 1975 1 2024-09-18T21:12:48.304 INFO:tasks.workunit.client.0.smithi077.stdout:9/224: read d1/dd/d11/d2d/f32 [181506,52441] 0 2024-09-18T21:12:48.306 INFO:tasks.workunit.client.0.smithi077.stdout:0/425: chown d8/d1d/d57/d81 33900196 1 2024-09-18T21:12:48.306 INFO:tasks.workunit.client.1.smithi103.stdout:9/375: mknod d18/d29/c7f 0 2024-09-18T21:12:48.307 INFO:tasks.workunit.client.1.smithi103.stdout:8/362: read d4/d26/d56/f62 [1334905,11548] 0 2024-09-18T21:12:48.309 INFO:tasks.workunit.client.0.smithi077.stdout:3/331: dwrite db/d14/d22/d36/d42/f46 [0,4194304] 0 2024-09-18T21:12:48.309 INFO:tasks.workunit.client.1.smithi103.stdout:9/376: write ff [4682918,86318] 0 2024-09-18T21:12:48.311 INFO:tasks.workunit.client.1.smithi103.stdout:1/360: stat d0/d11/d5f/d19/d70/d7a 0 2024-09-18T21:12:48.312 INFO:tasks.workunit.client.1.smithi103.stdout:1/361: readlink d0/d2/l55 0 2024-09-18T21:12:48.314 INFO:tasks.workunit.client.1.smithi103.stdout:3/321: dwrite d1/d23/d47/f56 [0,4194304] 0 2024-09-18T21:12:48.315 INFO:tasks.workunit.client.1.smithi103.stdout:8/363: dread d4/d26/f4d [0,4194304] 0 2024-09-18T21:12:48.316 INFO:tasks.workunit.client.1.smithi103.stdout:0/354: mkdir d1/d5/de/d24/d43/d81 0 2024-09-18T21:12:48.316 INFO:tasks.workunit.client.1.smithi103.stdout:2/285: mknod d3/d5/d25/d40/c6a 0 2024-09-18T21:12:48.316 INFO:tasks.workunit.client.1.smithi103.stdout:8/364: readlink d4/de/l35 0 2024-09-18T21:12:48.319 INFO:tasks.workunit.client.0.smithi077.stdout:1/333: link d3/d8/d13/c19 d3/d8/d13/d77/c7c 0 2024-09-18T21:12:48.319 INFO:tasks.workunit.client.1.smithi103.stdout:2/286: write d3/d5/f28 [93315,72804] 0 2024-09-18T21:12:48.321 INFO:tasks.workunit.client.1.smithi103.stdout:2/287: stat d3/d5/d2f/d32/f60 0 2024-09-18T21:12:48.322 INFO:tasks.workunit.client.1.smithi103.stdout:2/288: fsync d3/d5/f57 0 2024-09-18T21:12:48.323 INFO:tasks.workunit.client.0.smithi077.stdout:9/225: stat d1/dd/d1a/l2c 0 2024-09-18T21:12:48.323 INFO:tasks.workunit.client.1.smithi103.stdout:5/371: write de/d1f/f24 [3504873,57793] 0 2024-09-18T21:12:48.324 INFO:tasks.workunit.client.1.smithi103.stdout:8/365: dwrite d4/d26/f25 [0,4194304] 0 2024-09-18T21:12:48.328 INFO:tasks.workunit.client.1.smithi103.stdout:7/336: rename d1/df/d42/d29/d2f/d33/c3c to d1/df/d42/d1f/d58/d5b/c66 0 2024-09-18T21:12:48.329 INFO:tasks.workunit.client.1.smithi103.stdout:7/337: chown d1/df/d42/d1f/d2e/d3f/f56 252426 1 2024-09-18T21:12:48.330 INFO:tasks.workunit.client.1.smithi103.stdout:9/377: creat d18/d52/d6f/f80 x:0 0 0 2024-09-18T21:12:48.330 INFO:tasks.workunit.client.0.smithi077.stdout:7/386: write d12/d31/f83 [310882,4588] 0 2024-09-18T21:12:48.330 INFO:tasks.workunit.client.1.smithi103.stdout:7/338: fsync d1/df/d54/f5a 0 2024-09-18T21:12:48.331 INFO:tasks.workunit.client.0.smithi077.stdout:7/387: read - d12/d22/d59/d5a/f67 zero size 2024-09-18T21:12:48.334 INFO:tasks.workunit.client.0.smithi077.stdout:3/332: rename db/d14/d22/d36/d42 to db/d14/d32/d49/d4e/d6a 0 2024-09-18T21:12:48.334 INFO:tasks.workunit.client.1.smithi103.stdout:9/378: read d18/d52/f60 [3622979,16708] 0 2024-09-18T21:12:48.335 INFO:tasks.workunit.client.1.smithi103.stdout:3/322: symlink d1/d23/d25/d4f/d51/l65 0 2024-09-18T21:12:48.335 INFO:tasks.workunit.client.0.smithi077.stdout:4/309: getdents d3/dc/d51/d53 0 2024-09-18T21:12:48.336 INFO:tasks.workunit.client.0.smithi077.stdout:4/310: chown d3/dc/d32/d45/c59 33552549 1 2024-09-18T21:12:48.339 INFO:tasks.workunit.client.1.smithi103.stdout:6/386: creat d2/d3/d8/f75 x:0 0 0 2024-09-18T21:12:48.339 INFO:tasks.workunit.client.1.smithi103.stdout:3/323: read d1/da/f15 [1011277,124083] 0 2024-09-18T21:12:48.341 INFO:tasks.workunit.client.0.smithi077.stdout:1/334: symlink d3/d38/l7d 0 2024-09-18T21:12:48.341 INFO:tasks.workunit.client.0.smithi077.stdout:8/285: write d2/d5/d6/d22/d20/f56 [2703179,129392] 0 2024-09-18T21:12:48.342 INFO:tasks.workunit.client.0.smithi077.stdout:4/311: chown d3/dc/l2e 1135663624 1 2024-09-18T21:12:48.344 INFO:tasks.workunit.client.0.smithi077.stdout:1/335: write d3/d1e/d68/d3e/f73 [324655,111438] 0 2024-09-18T21:12:48.345 INFO:tasks.workunit.client.0.smithi077.stdout:5/501: getdents d0/df/d10/d5c/d74 0 2024-09-18T21:12:48.346 INFO:tasks.workunit.client.1.smithi103.stdout:3/324: mknod d1/d2/d18/d30/c66 0 2024-09-18T21:12:48.349 INFO:tasks.workunit.client.1.smithi103.stdout:2/289: creat d3/d5/d2c/d54/d68/f6b x:0 0 0 2024-09-18T21:12:48.350 INFO:tasks.workunit.client.1.smithi103.stdout:7/339: rename d1/df/d42/d1f/d58 to d1/df/d43/d63/d67 0 2024-09-18T21:12:48.352 INFO:tasks.workunit.client.0.smithi077.stdout:0/426: dwrite d8/d1d/d80/f5e [0,4194304] 0 2024-09-18T21:12:48.353 INFO:tasks.workunit.client.0.smithi077.stdout:0/427: stat d8/d37/d66/l73 0 2024-09-18T21:12:48.353 INFO:tasks.workunit.client.0.smithi077.stdout:0/428: stat d8/d26/f15 0 2024-09-18T21:12:48.354 INFO:tasks.workunit.client.1.smithi103.stdout:3/325: dwrite d1/d2/d18/f44 [0,4194304] 0 2024-09-18T21:12:48.354 INFO:tasks.workunit.client.0.smithi077.stdout:0/429: write d8/d1d/f2b [3150425,107582] 0 2024-09-18T21:12:48.354 INFO:tasks.workunit.client.1.smithi103.stdout:3/326: chown d1/d2/d18/d30/f38 0 1 2024-09-18T21:12:48.358 INFO:tasks.workunit.client.1.smithi103.stdout:1/362: dread d0/d2/d9/f2f [4194304,4194304] 0 2024-09-18T21:12:48.358 INFO:tasks.workunit.client.0.smithi077.stdout:2/418: sync 2024-09-18T21:12:48.359 INFO:tasks.workunit.client.0.smithi077.stdout:6/366: sync 2024-09-18T21:12:48.363 INFO:tasks.workunit.client.1.smithi103.stdout:9/379: rename d18/d1f/f21 to d18/d52/d6f/f81 0 2024-09-18T21:12:48.364 INFO:tasks.workunit.client.1.smithi103.stdout:8/366: link d4/d26/d56/c60 d4/de/d4a/c6b 0 2024-09-18T21:12:48.366 INFO:tasks.workunit.client.1.smithi103.stdout:5/372: dwrite de/f1c [4194304,4194304] 0 2024-09-18T21:12:48.368 INFO:tasks.workunit.client.1.smithi103.stdout:3/327: symlink d1/d23/d47/l67 0 2024-09-18T21:12:48.369 INFO:tasks.workunit.client.1.smithi103.stdout:3/328: chown d1/d2/d18/d30/l39 55866 1 2024-09-18T21:12:48.370 INFO:tasks.workunit.client.1.smithi103.stdout:1/363: readlink d0/d2/d9/l74 0 2024-09-18T21:12:48.371 INFO:tasks.workunit.client.0.smithi077.stdout:4/312: creat d3/f63 x:0 0 0 2024-09-18T21:12:48.374 INFO:tasks.workunit.client.1.smithi103.stdout:6/387: rename d2/d3/d4 to d2/d24/d5a/d67/d76 0 2024-09-18T21:12:48.375 INFO:tasks.workunit.client.0.smithi077.stdout:5/502: creat d0/df/d10/d5c/d74/faf x:0 0 0 2024-09-18T21:12:48.377 INFO:tasks.workunit.client.1.smithi103.stdout:7/340: mknod d1/df/d42/d1f/d5d/c68 0 2024-09-18T21:12:48.378 INFO:tasks.workunit.client.1.smithi103.stdout:2/290: dwrite d3/d5/d25/f33 [0,4194304] 0 2024-09-18T21:12:48.378 INFO:tasks.workunit.client.1.smithi103.stdout:1/364: dwrite d0/d2/d9/d10/f67 [0,4194304] 0 2024-09-18T21:12:48.378 INFO:tasks.workunit.client.1.smithi103.stdout:6/388: dread d2/f4a [0,4194304] 0 2024-09-18T21:12:48.379 INFO:tasks.workunit.client.0.smithi077.stdout:5/503: truncate d0/df/d10/d5c/f72 460723 0 2024-09-18T21:12:48.379 INFO:tasks.workunit.client.0.smithi077.stdout:2/419: creat d1/d4/d5/d1a/d49/d6a/f8b x:0 0 0 2024-09-18T21:12:48.379 INFO:tasks.workunit.client.1.smithi103.stdout:2/291: chown d3/d5/d25 360 1 2024-09-18T21:12:48.379 INFO:tasks.workunit.client.1.smithi103.stdout:7/341: chown d1/df/d42/f26 255575 1 2024-09-18T21:12:48.380 INFO:tasks.workunit.client.0.smithi077.stdout:7/388: write d12/d31/d33/d2a/f32 [1899472,18235] 0 2024-09-18T21:12:48.380 INFO:tasks.workunit.client.0.smithi077.stdout:1/336: dwrite d3/d8/d49/d4e/d50/f2c [0,4194304] 0 2024-09-18T21:12:48.380 INFO:tasks.workunit.client.1.smithi103.stdout:5/373: creat de/d2d/f75 x:0 0 0 2024-09-18T21:12:48.381 INFO:tasks.workunit.client.1.smithi103.stdout:1/365: dread - d0/d3/f66 zero size 2024-09-18T21:12:48.381 INFO:tasks.workunit.client.1.smithi103.stdout:2/292: chown d3/d5/d2f 0 1 2024-09-18T21:12:48.381 INFO:tasks.workunit.client.1.smithi103.stdout:3/329: chown d1/f3c 12 1 2024-09-18T21:12:48.382 INFO:tasks.workunit.client.1.smithi103.stdout:1/366: chown d0/d2/l55 609748 1 2024-09-18T21:12:48.382 INFO:tasks.workunit.client.0.smithi077.stdout:6/367: write d7/df/d11/d1d/d50/f5f [906344,105838] 0 2024-09-18T21:12:48.383 INFO:tasks.workunit.client.0.smithi077.stdout:9/226: creat d1/df/f44 x:0 0 0 2024-09-18T21:12:48.383 INFO:tasks.workunit.client.0.smithi077.stdout:2/420: stat d1/d4/d5/d1a/d49/d6a/c6b 0 2024-09-18T21:12:48.387 INFO:tasks.workunit.client.1.smithi103.stdout:8/367: rename d4/d26/ca to d4/d2d/d3d/d42/d65/c6c 0 2024-09-18T21:12:48.389 INFO:tasks.workunit.client.0.smithi077.stdout:4/313: write d3/f5 [1507847,101388] 0 2024-09-18T21:12:48.392 INFO:tasks.workunit.client.1.smithi103.stdout:7/342: symlink d1/df/d42/d1f/l69 0 2024-09-18T21:12:48.392 INFO:tasks.workunit.client.0.smithi077.stdout:1/337: dread d3/d8/d49/f79 [0,4194304] 0 2024-09-18T21:12:48.395 INFO:tasks.workunit.client.1.smithi103.stdout:2/293: creat d3/d5/d2f/d5b/f6c x:0 0 0 2024-09-18T21:12:48.395 INFO:tasks.workunit.client.0.smithi077.stdout:4/314: read d3/d7/f1a [848897,11314] 0 2024-09-18T21:12:48.395 INFO:tasks.workunit.client.0.smithi077.stdout:3/333: getdents db/d14/d32 0 2024-09-18T21:12:48.396 INFO:tasks.workunit.client.1.smithi103.stdout:1/367: fdatasync d0/d2/d9/dc/f15 0 2024-09-18T21:12:48.397 INFO:tasks.workunit.client.0.smithi077.stdout:2/421: symlink d1/d4/d5/d1a/d49/d6a/l8c 0 2024-09-18T21:12:48.397 INFO:tasks.workunit.client.1.smithi103.stdout:1/368: write d0/d2/d9/dc/f22 [1171797,104438] 0 2024-09-18T21:12:48.400 INFO:tasks.workunit.client.0.smithi077.stdout:5/504: dwrite d0/d6/f50 [0,4194304] 0 2024-09-18T21:12:48.400 INFO:tasks.workunit.client.0.smithi077.stdout:9/227: fdatasync d1/dd/d11/d2d/f32 0 2024-09-18T21:12:48.400 INFO:tasks.workunit.client.1.smithi103.stdout:7/343: mknod d1/df/d42/d1f/d5d/c6a 0 2024-09-18T21:12:48.401 INFO:tasks.workunit.client.0.smithi077.stdout:8/286: link d2/d5/c23 d2/d5/d6/d22/d26/c63 0 2024-09-18T21:12:48.401 INFO:tasks.workunit.client.1.smithi103.stdout:7/344: write d1/df/d42/f4e [63694,2286] 0 2024-09-18T21:12:48.402 INFO:tasks.workunit.client.1.smithi103.stdout:5/374: creat de/d1f/d3b/d3c/d62/f76 x:0 0 0 2024-09-18T21:12:48.404 INFO:tasks.workunit.client.1.smithi103.stdout:7/345: write d1/df/d42/d29/d2f/d33/f3e [645647,69782] 0 2024-09-18T21:12:48.405 INFO:tasks.workunit.client.1.smithi103.stdout:7/346: chown d1/df/d42/f4e 38489104 1 2024-09-18T21:12:48.406 INFO:tasks.workunit.client.0.smithi077.stdout:1/338: dwrite d3/d8/f67 [0,4194304] 0 2024-09-18T21:12:48.407 INFO:tasks.workunit.client.1.smithi103.stdout:9/380: getdents d18/d1f 0 2024-09-18T21:12:48.409 INFO:tasks.workunit.client.0.smithi077.stdout:4/315: symlink d3/d17/l64 0 2024-09-18T21:12:48.411 INFO:tasks.workunit.client.1.smithi103.stdout:3/330: rename d1/d34 to d1/d23/d25/d4f/d58/d68 0 2024-09-18T21:12:48.411 INFO:tasks.workunit.client.0.smithi077.stdout:4/316: chown d3/dc/d32/d45/d5e 61753 1 2024-09-18T21:12:48.412 INFO:tasks.workunit.client.1.smithi103.stdout:1/369: chown d0/c4 8081 1 2024-09-18T21:12:48.412 INFO:tasks.workunit.client.0.smithi077.stdout:9/228: dwrite d1/df/d27/f39 [0,4194304] 0 2024-09-18T21:12:48.412 INFO:tasks.workunit.client.1.smithi103.stdout:8/368: dread d4/d26/d56/f62 [0,4194304] 0 2024-09-18T21:12:48.413 INFO:tasks.workunit.client.0.smithi077.stdout:9/229: write d1/df/f44 [910735,31546] 0 2024-09-18T21:12:48.417 INFO:tasks.workunit.client.1.smithi103.stdout:7/347: fdatasync d1/f21 0 2024-09-18T21:12:48.418 INFO:tasks.workunit.client.0.smithi077.stdout:2/422: rename d1/d4/d5/d1a/d2e/d41/l32 to d1/d4/l8d 0 2024-09-18T21:12:48.422 INFO:tasks.workunit.client.0.smithi077.stdout:8/287: mknod d2/d5/d6/d22/d18/c64 0 2024-09-18T21:12:48.422 INFO:tasks.workunit.client.1.smithi103.stdout:2/294: rename d3/d5/d2f/d32/d46/c55 to d3/d5/c6d 0 2024-09-18T21:12:48.423 INFO:tasks.workunit.client.0.smithi077.stdout:7/389: link d12/c14 d12/d22/d59/d72/c87 0 2024-09-18T21:12:48.423 INFO:tasks.workunit.client.0.smithi077.stdout:6/368: creat d7/df/d11/d1d/f77 x:0 0 0 2024-09-18T21:12:48.424 INFO:tasks.workunit.client.1.smithi103.stdout:4/347: sync 2024-09-18T21:12:48.424 INFO:tasks.workunit.client.1.smithi103.stdout:0/355: sync 2024-09-18T21:12:48.426 INFO:tasks.workunit.client.1.smithi103.stdout:8/369: symlink d4/de/d4a/d59/d5e/l6d 0 2024-09-18T21:12:48.428 INFO:tasks.workunit.client.0.smithi077.stdout:4/317: dwrite d3/dc/d20/f40 [0,4194304] 0 2024-09-18T21:12:48.430 INFO:tasks.workunit.client.0.smithi077.stdout:7/390: dread d12/d31/f83 [0,4194304] 0 2024-09-18T21:12:48.431 INFO:tasks.workunit.client.0.smithi077.stdout:3/334: dread f5 [0,4194304] 0 2024-09-18T21:12:48.435 INFO:tasks.workunit.client.0.smithi077.stdout:2/423: rename d1/d4/d9/d24 to d1/d4/d9/d80/d8e 0 2024-09-18T21:12:48.436 INFO:tasks.workunit.client.1.smithi103.stdout:7/348: mkdir d1/df/d42/d1f/d6b 0 2024-09-18T21:12:48.436 INFO:tasks.workunit.client.0.smithi077.stdout:2/424: chown d1/d4/d5/d1a/d2e/d41 0 1 2024-09-18T21:12:48.436 INFO:tasks.workunit.client.0.smithi077.stdout:2/425: stat d1/d4/d5 0 2024-09-18T21:12:48.438 INFO:tasks.workunit.client.0.smithi077.stdout:5/505: truncate d0/df/d10/d4b/f65 794396 0 2024-09-18T21:12:48.440 INFO:tasks.workunit.client.1.smithi103.stdout:1/370: creat d0/d11/d5f/d19/d4d/f7f x:0 0 0 2024-09-18T21:12:48.440 INFO:tasks.workunit.client.1.smithi103.stdout:6/389: write d2/d3/d8/f20 [264820,54867] 0 2024-09-18T21:12:48.441 INFO:tasks.workunit.client.0.smithi077.stdout:6/369: creat d7/df/d11/d3e/f78 x:0 0 0 2024-09-18T21:12:48.442 INFO:tasks.workunit.client.0.smithi077.stdout:6/370: dread - d7/df/d11/d3e/f65 zero size 2024-09-18T21:12:48.443 INFO:tasks.workunit.client.1.smithi103.stdout:0/356: mknod d1/d56/c82 0 2024-09-18T21:12:48.443 INFO:tasks.workunit.client.0.smithi077.stdout:6/371: fdatasync d7/df/d11/d25/f69 0 2024-09-18T21:12:48.445 INFO:tasks.workunit.client.0.smithi077.stdout:6/372: chown d7/df/d11/d1d/l21 121585910 1 2024-09-18T21:12:48.445 INFO:tasks.workunit.client.0.smithi077.stdout:4/318: mknod d3/dc/c65 0 2024-09-18T21:12:48.445 INFO:tasks.workunit.client.1.smithi103.stdout:4/348: creat d9/d1a/d41/f7c x:0 0 0 2024-09-18T21:12:48.446 INFO:tasks.workunit.client.1.smithi103.stdout:8/370: fdatasync d4/d26/d56/f62 0 2024-09-18T21:12:48.447 INFO:tasks.workunit.client.0.smithi077.stdout:4/319: write d3/dc/d20/f3c [960512,39217] 0 2024-09-18T21:12:48.448 INFO:tasks.workunit.client.0.smithi077.stdout:3/335: mkdir db/d14/d32/d49/d6b 0 2024-09-18T21:12:48.449 INFO:tasks.workunit.client.0.smithi077.stdout:0/430: truncate d8/d37/f3f 1091313 0 2024-09-18T21:12:48.449 INFO:tasks.workunit.client.0.smithi077.stdout:4/320: read d3/d7/f1a [2697688,1154] 0 2024-09-18T21:12:48.449 INFO:tasks.workunit.client.0.smithi077.stdout:3/336: readlink db/d14/d32/d3a/d3b/l4c 0 2024-09-18T21:12:48.450 INFO:tasks.workunit.client.1.smithi103.stdout:7/349: creat d1/df/d43/f6c x:0 0 0 2024-09-18T21:12:48.450 INFO:tasks.workunit.client.0.smithi077.stdout:4/321: dread - d3/dc/d24/f4a zero size 2024-09-18T21:12:48.450 INFO:tasks.workunit.client.1.smithi103.stdout:7/350: readlink d1/df/d42/l23 0 2024-09-18T21:12:48.452 INFO:tasks.workunit.client.1.smithi103.stdout:3/331: rename d1/l2b to d1/d23/d25/d4f/l69 0 2024-09-18T21:12:48.453 INFO:tasks.workunit.client.0.smithi077.stdout:2/426: creat d1/d4/d9/d4f/f8f x:0 0 0 2024-09-18T21:12:48.453 INFO:tasks.workunit.client.1.smithi103.stdout:2/295: dread d3/ff [0,4194304] 0 2024-09-18T21:12:48.454 INFO:tasks.workunit.client.0.smithi077.stdout:2/427: dread - d1/d4/d9/d80/f87 zero size 2024-09-18T21:12:48.454 INFO:tasks.workunit.client.1.smithi103.stdout:1/371: mknod d0/d3/c80 0 2024-09-18T21:12:48.454 INFO:tasks.workunit.client.0.smithi077.stdout:2/428: chown d1/d4/d9/d4f 87 1 2024-09-18T21:12:48.455 INFO:tasks.workunit.client.0.smithi077.stdout:2/429: write d1/d4/d5/d1a/f6d [517993,35940] 0 2024-09-18T21:12:48.460 INFO:tasks.workunit.client.0.smithi077.stdout:6/373: mknod d7/df/d11/d1d/d5c/c79 0 2024-09-18T21:12:48.461 INFO:tasks.workunit.client.0.smithi077.stdout:6/374: write d7/df/d11/d1d/d31/f5a [4306858,100479] 0 2024-09-18T21:12:48.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:48 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:12:48.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:48 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:12:48.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:48 smithi077 ceph-mon[27689]: pgmap v15: 65 pgs: 65 active+clean; 1.1 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 16 MiB/s rd, 124 MiB/s wr, 232 op/s 2024-09-18T21:12:48.465 INFO:tasks.workunit.client.0.smithi077.stdout:3/337: creat db/d14/d32/d49/d4e/d6a/f6c x:0 0 0 2024-09-18T21:12:48.467 INFO:tasks.workunit.client.0.smithi077.stdout:4/322: rmdir d3/dc/d32/d45 39 2024-09-18T21:12:48.467 INFO:tasks.workunit.client.1.smithi103.stdout:5/375: truncate de/d14/d33/d4f/f6a 915969 0 2024-09-18T21:12:48.469 INFO:tasks.workunit.client.1.smithi103.stdout:7/351: mknod d1/df/d43/d61/c6d 0 2024-09-18T21:12:48.470 INFO:tasks.workunit.client.0.smithi077.stdout:3/338: write db/d14/d32/d4f/f53 [849344,88245] 0 2024-09-18T21:12:48.470 INFO:tasks.workunit.client.0.smithi077.stdout:4/323: write d3/d7/f4f [939909,100288] 0 2024-09-18T21:12:48.470 INFO:tasks.workunit.client.1.smithi103.stdout:9/381: truncate d18/d29/f4b 636925 0 2024-09-18T21:12:48.472 INFO:tasks.workunit.client.0.smithi077.stdout:6/375: dwrite d7/f1c [0,4194304] 0 2024-09-18T21:12:48.472 INFO:tasks.workunit.client.0.smithi077.stdout:5/506: link d0/df/d10/d47/f68 d0/df/d10/fb0 0 2024-09-18T21:12:48.473 INFO:tasks.workunit.client.0.smithi077.stdout:4/324: stat d3/dc/d24/f4c 0 2024-09-18T21:12:48.474 INFO:tasks.workunit.client.0.smithi077.stdout:1/339: dwrite d3/d8/d13/f26 [0,4194304] 0 2024-09-18T21:12:48.475 INFO:tasks.workunit.client.0.smithi077.stdout:2/430: creat d1/d4/d9/d80/f90 x:0 0 0 2024-09-18T21:12:48.483 INFO:tasks.workunit.client.1.smithi103.stdout:4/349: rmdir d9/d1a/d41 39 2024-09-18T21:12:48.487 INFO:tasks.workunit.client.0.smithi077.stdout:7/391: rename d12/d31/d33/d2a/d6c/f5c to d12/d31/d33/f88 0 2024-09-18T21:12:48.489 INFO:tasks.workunit.client.1.smithi103.stdout:9/382: creat d18/d52/f82 x:0 0 0 2024-09-18T21:12:48.490 INFO:tasks.workunit.client.1.smithi103.stdout:4/350: dread d9/f23 [0,4194304] 0 2024-09-18T21:12:48.490 INFO:tasks.workunit.client.1.smithi103.stdout:9/383: write d18/d52/d6f/f80 [975967,20013] 0 2024-09-18T21:12:48.491 INFO:tasks.workunit.client.1.smithi103.stdout:3/332: creat d1/d2/d18/d30/d4e/d62/f6a x:0 0 0 2024-09-18T21:12:48.492 INFO:tasks.workunit.client.0.smithi077.stdout:3/339: mkdir db/d14/d32/d4f/d6d 0 2024-09-18T21:12:48.493 INFO:tasks.workunit.client.0.smithi077.stdout:8/288: truncate d2/d27/d29/f3f 1996547 0 2024-09-18T21:12:48.494 INFO:tasks.workunit.client.0.smithi077.stdout:5/507: dread - d0/df/f2b zero size 2024-09-18T21:12:48.497 INFO:tasks.workunit.client.1.smithi103.stdout:8/371: link d4/d2d/d3d/d42/d65/l45 d4/d2d/d3d/d42/l6e 0 2024-09-18T21:12:48.497 INFO:tasks.workunit.client.1.smithi103.stdout:9/384: dwrite d18/d29/f4d [0,4194304] 0 2024-09-18T21:12:48.498 INFO:tasks.workunit.client.1.smithi103.stdout:4/351: symlink d9/d38/d58/l7d 0 2024-09-18T21:12:48.499 INFO:tasks.workunit.client.1.smithi103.stdout:2/296: dread d3/d5/f61 [0,4194304] 0 2024-09-18T21:12:48.500 INFO:tasks.workunit.client.1.smithi103.stdout:2/297: chown d3/f20 104352903 1 2024-09-18T21:12:48.500 INFO:tasks.workunit.client.0.smithi077.stdout:1/340: symlink d3/d8/d49/d4e/d5a/l7e 0 2024-09-18T21:12:48.504 INFO:tasks.workunit.client.0.smithi077.stdout:2/431: creat d1/d4/d5/d1a/d2e/d7e/f91 x:0 0 0 2024-09-18T21:12:48.505 INFO:tasks.workunit.client.1.smithi103.stdout:7/352: dread d1/df/f22 [0,4194304] 0 2024-09-18T21:12:48.506 INFO:tasks.workunit.client.0.smithi077.stdout:2/432: write d1/d4/d5/d1a/d49/d6a/f8b [995103,18596] 0 2024-09-18T21:12:48.509 INFO:tasks.workunit.client.1.smithi103.stdout:8/372: fsync d4/d26/f4d 0 2024-09-18T21:12:48.510 INFO:tasks.workunit.client.0.smithi077.stdout:3/340: symlink db/d14/d22/l6e 0 2024-09-18T21:12:48.510 INFO:tasks.workunit.client.0.smithi077.stdout:0/431: truncate d8/f2f 500982 0 2024-09-18T21:12:48.511 INFO:tasks.workunit.client.0.smithi077.stdout:3/341: truncate db/d4d/f69 165158 0 2024-09-18T21:12:48.512 INFO:tasks.workunit.client.1.smithi103.stdout:7/353: dwrite d1/f5f [0,4194304] 0 2024-09-18T21:12:48.512 INFO:tasks.workunit.client.0.smithi077.stdout:8/289: symlink d2/d36/l65 0 2024-09-18T21:12:48.513 INFO:tasks.workunit.client.1.smithi103.stdout:8/373: dread d4/d26/d56/f62 [0,4194304] 0 2024-09-18T21:12:48.513 INFO:tasks.workunit.client.1.smithi103.stdout:7/354: write d1/df/d54/f5a [1048409,67029] 0 2024-09-18T21:12:48.514 INFO:tasks.workunit.client.1.smithi103.stdout:8/374: chown d4/d2d/d3d/f5a 484432 1 2024-09-18T21:12:48.515 INFO:tasks.workunit.client.1.smithi103.stdout:3/333: unlink d1/d23/d25/d4f/d51/l5f 0 2024-09-18T21:12:48.516 INFO:tasks.workunit.client.0.smithi077.stdout:6/376: mknod d7/df/d11/d1d/c7a 0 2024-09-18T21:12:48.516 INFO:tasks.workunit.client.1.smithi103.stdout:3/334: chown d1/d2/d18/d30/d4e/d62 178759 1 2024-09-18T21:12:48.518 INFO:tasks.workunit.client.0.smithi077.stdout:1/341: mkdir d3/d1e/d7f 0 2024-09-18T21:12:48.520 INFO:tasks.workunit.client.0.smithi077.stdout:1/342: dread d3/d1e/f55 [0,4194304] 0 2024-09-18T21:12:48.521 INFO:tasks.workunit.client.0.smithi077.stdout:1/343: readlink d3/d8/d13/d18/l48 0 2024-09-18T21:12:48.522 INFO:tasks.workunit.client.1.smithi103.stdout:5/376: write de/d3e/f12 [1699143,18492] 0 2024-09-18T21:12:48.524 INFO:tasks.workunit.client.0.smithi077.stdout:7/392: mkdir d12/d31/d33/d89 0 2024-09-18T21:12:48.528 INFO:tasks.workunit.client.1.smithi103.stdout:4/352: unlink d9/d1f/f3b 0 2024-09-18T21:12:48.530 INFO:tasks.workunit.client.0.smithi077.stdout:2/433: rmdir d1/d4/d5/d1a/d2e 39 2024-09-18T21:12:48.530 INFO:tasks.workunit.client.1.smithi103.stdout:7/355: chown d1/l8 15097446 1 2024-09-18T21:12:48.532 INFO:tasks.workunit.client.1.smithi103.stdout:8/375: mknod d4/d26/d56/c6f 0 2024-09-18T21:12:48.534 INFO:tasks.workunit.client.1.smithi103.stdout:7/356: truncate d1/df/d42/d29/d2f/f4f 361983 0 2024-09-18T21:12:48.535 INFO:tasks.workunit.client.1.smithi103.stdout:4/353: dwrite d9/f14 [0,4194304] 0 2024-09-18T21:12:48.535 INFO:tasks.workunit.client.0.smithi077.stdout:1/344: rename d3/d1e/d68/d3e/c70 to d3/d38/c80 0 2024-09-18T21:12:48.537 INFO:tasks.workunit.client.0.smithi077.stdout:7/393: unlink d12/d31/d77/f84 0 2024-09-18T21:12:48.538 INFO:tasks.workunit.client.0.smithi077.stdout:7/394: truncate d12/f26 1512732 0 2024-09-18T21:12:48.540 INFO:tasks.workunit.client.1.smithi103.stdout:9/385: rename le to d18/l83 0 2024-09-18T21:12:48.542 INFO:tasks.workunit.client.1.smithi103.stdout:7/357: dwrite d1/df/d42/d1f/d2e/d3f/f4a [0,4194304] 0 2024-09-18T21:12:48.542 INFO:tasks.workunit.client.1.smithi103.stdout:9/386: truncate d18/d52/d5e/f7b 130004 0 2024-09-18T21:12:48.548 INFO:tasks.workunit.client.0.smithi077.stdout:7/395: dwrite d12/d22/d59/d5d/d62/f6d [0,4194304] 0 2024-09-18T21:12:48.548 INFO:tasks.workunit.client.0.smithi077.stdout:2/434: chown d1/d4/d9/d80/d8e/c77 33 1 2024-09-18T21:12:48.550 INFO:tasks.workunit.client.0.smithi077.stdout:4/325: getdents d3/dc 0 2024-09-18T21:12:48.552 INFO:tasks.workunit.client.0.smithi077.stdout:4/326: write d3/f1f [4279926,79970] 0 2024-09-18T21:12:48.553 INFO:tasks.workunit.client.0.smithi077.stdout:2/435: read d1/f67 [46398,80428] 0 2024-09-18T21:12:48.553 INFO:tasks.workunit.client.0.smithi077.stdout:1/345: rmdir d3/d1e/d4c 39 2024-09-18T21:12:48.554 INFO:tasks.workunit.client.1.smithi103.stdout:4/354: creat d9/d1a/d2b/d48/f7e x:0 0 0 2024-09-18T21:12:48.555 INFO:tasks.workunit.client.0.smithi077.stdout:1/346: write d3/d1e/f3b [609365,87760] 0 2024-09-18T21:12:48.556 INFO:tasks.workunit.client.0.smithi077.stdout:0/432: link d8/d1a/d39/f59 d8/d1a/d39/d3b/d4e/f8c 0 2024-09-18T21:12:48.557 INFO:tasks.workunit.client.0.smithi077.stdout:0/433: fsync d8/d1a/d35/f82 0 2024-09-18T21:12:48.558 INFO:tasks.workunit.client.0.smithi077.stdout:8/290: fsync d2/d27/d29/f3f 0 2024-09-18T21:12:48.560 INFO:tasks.workunit.client.0.smithi077.stdout:0/434: write d8/d1a/f51 [2390365,100299] 0 2024-09-18T21:12:48.560 INFO:tasks.workunit.client.0.smithi077.stdout:8/291: fdatasync d2/d5/d6/d22/d26/f60 0 2024-09-18T21:12:48.561 INFO:tasks.workunit.client.1.smithi103.stdout:7/358: write d1/df/d42/d1f/d2e/f41 [4683524,67712] 0 2024-09-18T21:12:48.562 INFO:tasks.workunit.client.0.smithi077.stdout:0/435: stat d8/d1d/f2b 0 2024-09-18T21:12:48.562 INFO:tasks.workunit.client.0.smithi077.stdout:3/342: link db/d14/d32/d3a/d3b/l4c db/d14/d32/d49/d6b/l6f 0 2024-09-18T21:12:48.562 INFO:tasks.workunit.client.0.smithi077.stdout:4/327: dwrite d3/dc/d20/f40 [0,4194304] 0 2024-09-18T21:12:48.564 INFO:tasks.workunit.client.1.smithi103.stdout:9/387: mknod d18/d1f/c84 0 2024-09-18T21:12:48.565 INFO:tasks.workunit.client.0.smithi077.stdout:8/292: stat d2/d5/d6/d22/d20/d3e 0 2024-09-18T21:12:48.569 INFO:tasks.workunit.client.1.smithi103.stdout:3/335: creat d1/da/f6b x:0 0 0 2024-09-18T21:12:48.569 INFO:tasks.workunit.client.0.smithi077.stdout:3/343: chown db/d14/d32/d3a/f3e 18886 1 2024-09-18T21:12:48.572 INFO:tasks.workunit.client.0.smithi077.stdout:8/293: write d2/d5/d6/d22/d20/f24 [682773,95039] 0 2024-09-18T21:12:48.572 INFO:tasks.workunit.client.1.smithi103.stdout:8/376: write d4/de/f16 [11482050,26596] 0 2024-09-18T21:12:48.573 INFO:tasks.workunit.client.0.smithi077.stdout:3/344: write db/d14/d22/d36/d39/f45 [1026604,57156] 0 2024-09-18T21:12:48.578 INFO:tasks.workunit.client.1.smithi103.stdout:7/359: mknod d1/df/d43/d61/c6e 0 2024-09-18T21:12:48.579 INFO:tasks.workunit.client.0.smithi077.stdout:4/328: dwrite d3/dc/d32/f62 [0,4194304] 0 2024-09-18T21:12:48.579 INFO:tasks.workunit.client.0.smithi077.stdout:7/396: dwrite d12/f26 [0,4194304] 0 2024-09-18T21:12:48.581 INFO:tasks.workunit.client.0.smithi077.stdout:7/397: write d12/f78 [918721,51872] 0 2024-09-18T21:12:48.581 INFO:tasks.workunit.client.1.smithi103.stdout:3/336: mknod d1/d2/d18/d30/d4e/d62/c6c 0 2024-09-18T21:12:48.582 INFO:tasks.workunit.client.1.smithi103.stdout:5/377: dwrite de/d3e/f29 [0,4194304] 0 2024-09-18T21:12:48.583 INFO:tasks.workunit.client.1.smithi103.stdout:3/337: chown d1/da/f22 159187227 1 2024-09-18T21:12:48.584 INFO:tasks.workunit.client.1.smithi103.stdout:2/298: getdents d3/d5/d2c 0 2024-09-18T21:12:48.585 INFO:tasks.workunit.client.1.smithi103.stdout:5/378: chown de/d1f/d3b/d51/d57/d59/f6e 1 1 2024-09-18T21:12:48.585 INFO:tasks.workunit.client.1.smithi103.stdout:8/377: mknod d4/d2d/d3d/d42/d65/c70 0 2024-09-18T21:12:48.588 INFO:tasks.workunit.client.1.smithi103.stdout:2/299: truncate d3/d5/d2c/f50 1022198 0 2024-09-18T21:12:48.589 INFO:tasks.workunit.client.0.smithi077.stdout:2/436: dwrite d1/d4/d9/d80/d8e/f55 [4194304,4194304] 0 2024-09-18T21:12:48.590 INFO:tasks.workunit.client.1.smithi103.stdout:7/360: creat d1/df/d42/d29/d2f/d33/f6f x:0 0 0 2024-09-18T21:12:48.590 INFO:tasks.workunit.client.1.smithi103.stdout:2/300: fsync d3/d5/d2c/f65 0 2024-09-18T21:12:48.591 INFO:tasks.workunit.client.0.smithi077.stdout:2/437: chown d1/d4/d9/d80/d8e/c77 1041 1 2024-09-18T21:12:48.596 INFO:tasks.workunit.client.1.smithi103.stdout:8/378: mkdir d4/d2d/d3d/d42/d71 0 2024-09-18T21:12:48.598 INFO:tasks.workunit.client.0.smithi077.stdout:3/345: symlink db/d14/d32/d49/l70 0 2024-09-18T21:12:48.599 INFO:tasks.workunit.client.1.smithi103.stdout:9/388: link d18/d29/f2d d18/d52/f85 0 2024-09-18T21:12:48.600 INFO:tasks.workunit.client.1.smithi103.stdout:4/355: write d9/d2e/f49 [283402,115836] 0 2024-09-18T21:12:48.602 INFO:tasks.workunit.client.1.smithi103.stdout:3/338: rmdir d1/d23/d25/d4f/d51 39 2024-09-18T21:12:48.603 INFO:tasks.workunit.client.1.smithi103.stdout:8/379: dwrite d4/d2d/d3d/f5a [0,4194304] 0 2024-09-18T21:12:48.604 INFO:tasks.workunit.client.0.smithi077.stdout:1/347: unlink d3/d8/d49/d4e/d50/c6d 0 2024-09-18T21:12:48.604 INFO:tasks.workunit.client.1.smithi103.stdout:3/339: write d1/da/f16 [2918485,5225] 0 2024-09-18T21:12:48.606 INFO:tasks.workunit.client.0.smithi077.stdout:4/329: mkdir d3/dc/d51/d53/d66 0 2024-09-18T21:12:48.607 INFO:tasks.workunit.client.0.smithi077.stdout:4/330: chown d3/d7/c2f 1 1 2024-09-18T21:12:48.608 INFO:tasks.workunit.client.0.smithi077.stdout:4/331: write d3/dc/f46 [231119,1256] 0 2024-09-18T21:12:48.608 INFO:tasks.workunit.client.1.smithi103.stdout:2/301: chown d3/d5/d25/d40/c52 120 1 2024-09-18T21:12:48.609 INFO:tasks.workunit.client.0.smithi077.stdout:2/438: dread d1/d4/d9/fb [0,4194304] 0 2024-09-18T21:12:48.609 INFO:tasks.workunit.client.1.smithi103.stdout:2/302: read d3/f22 [692299,108426] 0 2024-09-18T21:12:48.611 INFO:tasks.workunit.client.1.smithi103.stdout:2/303: write d3/d5/d25/f45 [3763922,51952] 0 2024-09-18T21:12:48.612 INFO:tasks.workunit.client.0.smithi077.stdout:2/439: write d1/d4/f8 [2111042,78976] 0 2024-09-18T21:12:48.612 INFO:tasks.workunit.client.0.smithi077.stdout:7/398: truncate d12/d31/d33/d2a/f3d 1997058 0 2024-09-18T21:12:48.614 INFO:tasks.workunit.client.0.smithi077.stdout:8/294: write d2/d5/d6/f21 [547337,34788] 0 2024-09-18T21:12:48.614 INFO:tasks.workunit.client.0.smithi077.stdout:7/399: stat d12/d31/d33/d2a/d6c/l60 0 2024-09-18T21:12:48.615 INFO:tasks.workunit.client.1.smithi103.stdout:4/356: creat d9/d1c/d77/f7f x:0 0 0 2024-09-18T21:12:48.619 INFO:tasks.workunit.client.1.smithi103.stdout:5/379: dread de/d1f/d3b/d51/d57/d59/f5c [0,4194304] 0 2024-09-18T21:12:48.619 INFO:tasks.workunit.client.1.smithi103.stdout:3/340: creat d1/d23/d25/d4f/d58/f6d x:0 0 0 2024-09-18T21:12:48.621 INFO:tasks.workunit.client.0.smithi077.stdout:7/400: dwrite d12/d22/d59/d72/d68/f75 [0,4194304] 0 2024-09-18T21:12:48.621 INFO:tasks.workunit.client.0.smithi077.stdout:3/346: rename db/d14/d32/d3a to db/d14/d32/d4f/d71 0 2024-09-18T21:12:48.622 INFO:tasks.workunit.client.0.smithi077.stdout:3/347: read f5 [549808,49512] 0 2024-09-18T21:12:48.624 INFO:tasks.workunit.client.0.smithi077.stdout:1/348: creat d3/d6a/f81 x:0 0 0 2024-09-18T21:12:48.624 INFO:tasks.workunit.client.1.smithi103.stdout:3/341: dwrite d1/da/f3d [0,4194304] 0 2024-09-18T21:12:48.627 INFO:tasks.workunit.client.1.smithi103.stdout:9/389: dread d18/d1f/d2f/f4e [0,4194304] 0 2024-09-18T21:12:48.628 INFO:tasks.workunit.client.1.smithi103.stdout:9/390: stat d18/d52/f60 0 2024-09-18T21:12:48.629 INFO:tasks.workunit.client.1.smithi103.stdout:9/391: write d18/d52/d5e/f5f [244037,82641] 0 2024-09-18T21:12:48.630 INFO:tasks.workunit.client.1.smithi103.stdout:9/392: chown d18/d29/f55 1989339 1 2024-09-18T21:12:48.633 INFO:tasks.workunit.client.0.smithi077.stdout:7/401: dread d12/d22/d59/d72/f57 [0,4194304] 0 2024-09-18T21:12:48.635 INFO:tasks.workunit.client.1.smithi103.stdout:9/393: dwrite d18/f38 [0,4194304] 0 2024-09-18T21:12:48.637 INFO:tasks.workunit.client.0.smithi077.stdout:8/295: dwrite d2/d27/d29/f58 [0,4194304] 0 2024-09-18T21:12:48.639 INFO:tasks.workunit.client.0.smithi077.stdout:3/348: mkdir db/d14/d72 0 2024-09-18T21:12:48.641 INFO:tasks.workunit.client.1.smithi103.stdout:3/342: mknod d1/d2/c6e 0 2024-09-18T21:12:48.644 INFO:tasks.workunit.client.0.smithi077.stdout:3/349: dread f4 [0,4194304] 0 2024-09-18T21:12:48.644 INFO:tasks.workunit.client.0.smithi077.stdout:0/436: truncate d8/d1a/d35/f4d 3164057 0 2024-09-18T21:12:48.647 INFO:tasks.workunit.client.0.smithi077.stdout:4/332: creat d3/dc/d32/d5b/f67 x:0 0 0 2024-09-18T21:12:48.651 INFO:tasks.workunit.client.0.smithi077.stdout:7/402: write d12/d22/f64 [389987,119896] 0 2024-09-18T21:12:48.653 INFO:tasks.workunit.client.0.smithi077.stdout:1/349: mknod d3/c82 0 2024-09-18T21:12:48.655 INFO:tasks.workunit.client.0.smithi077.stdout:4/333: dread d3/d17/f39 [0,4194304] 0 2024-09-18T21:12:48.655 INFO:tasks.workunit.client.1.smithi103.stdout:9/394: symlink d18/d52/d6f/l86 0 2024-09-18T21:12:48.657 INFO:tasks.workunit.client.0.smithi077.stdout:3/350: creat db/d14/d22/d36/f73 x:0 0 0 2024-09-18T21:12:48.658 INFO:tasks.workunit.client.0.smithi077.stdout:1/350: write d3/d1e/d68/f37 [382860,74566] 0 2024-09-18T21:12:48.658 INFO:tasks.workunit.client.1.smithi103.stdout:2/304: creat d3/f6e x:0 0 0 2024-09-18T21:12:48.661 INFO:tasks.workunit.client.1.smithi103.stdout:5/380: creat de/f77 x:0 0 0 2024-09-18T21:12:48.662 INFO:tasks.workunit.client.1.smithi103.stdout:8/380: dwrite d4/de/f11 [4194304,4194304] 0 2024-09-18T21:12:48.662 INFO:tasks.workunit.client.0.smithi077.stdout:0/437: link d8/d1a/f4b d8/d26/f8d 0 2024-09-18T21:12:48.662 INFO:tasks.workunit.client.1.smithi103.stdout:9/395: dread d18/f3c [0,4194304] 0 2024-09-18T21:12:48.663 INFO:tasks.workunit.client.0.smithi077.stdout:2/440: dwrite d1/f11 [4194304,4194304] 0 2024-09-18T21:12:48.663 INFO:tasks.workunit.client.0.smithi077.stdout:7/403: dwrite d12/d22/d59/d5a/f69 [0,4194304] 0 2024-09-18T21:12:48.664 INFO:tasks.workunit.client.0.smithi077.stdout:4/334: creat d3/d7/f68 x:0 0 0 2024-09-18T21:12:48.665 INFO:tasks.workunit.client.0.smithi077.stdout:0/438: stat d8/d1d/d80/l5c 0 2024-09-18T21:12:48.665 INFO:tasks.workunit.client.1.smithi103.stdout:3/343: mknod d1/d23/d25/d4f/c6f 0 2024-09-18T21:12:48.666 INFO:tasks.workunit.client.0.smithi077.stdout:4/335: stat d3/dc/c65 0 2024-09-18T21:12:48.672 INFO:tasks.workunit.client.1.smithi103.stdout:5/381: creat de/d2d/d44/f78 x:0 0 0 2024-09-18T21:12:48.672 INFO:tasks.workunit.client.0.smithi077.stdout:3/351: rmdir db/d14/d32/d4f 39 2024-09-18T21:12:48.673 INFO:tasks.workunit.client.0.smithi077.stdout:3/352: read - db/f68 zero size 2024-09-18T21:12:48.674 INFO:tasks.workunit.client.1.smithi103.stdout:4/357: truncate d9/d1c/d77/f3d 2706790 0 2024-09-18T21:12:48.676 INFO:tasks.workunit.client.1.smithi103.stdout:8/381: rmdir d4/de/d4a/d59 39 2024-09-18T21:12:48.677 INFO:tasks.workunit.client.0.smithi077.stdout:7/404: creat d12/d22/d59/d5a/f8a x:0 0 0 2024-09-18T21:12:48.679 INFO:tasks.workunit.client.0.smithi077.stdout:4/336: dread d3/d17/f39 [0,4194304] 0 2024-09-18T21:12:48.681 INFO:tasks.workunit.client.1.smithi103.stdout:2/305: creat d3/d5/f6f x:0 0 0 2024-09-18T21:12:48.682 INFO:tasks.workunit.client.1.smithi103.stdout:8/382: dread d4/d26/f4d [0,4194304] 0 2024-09-18T21:12:48.682 INFO:tasks.workunit.client.1.smithi103.stdout:3/344: dread d1/d2/f8 [0,4194304] 0 2024-09-18T21:12:48.683 INFO:tasks.workunit.client.0.smithi077.stdout:1/351: link d3/d8/d13/d18/f6c d3/d8/d13/d18/f83 0 2024-09-18T21:12:48.685 INFO:tasks.workunit.client.1.smithi103.stdout:4/358: mkdir d9/d1a/d21/d80 0 2024-09-18T21:12:48.685 INFO:tasks.workunit.client.0.smithi077.stdout:8/296: fsync d2/d27/d29/f58 0 2024-09-18T21:12:48.685 INFO:tasks.workunit.client.1.smithi103.stdout:4/359: readlink d9/d1f/l66 0 2024-09-18T21:12:48.686 INFO:tasks.workunit.client.1.smithi103.stdout:2/306: stat d3/d5/f28 0 2024-09-18T21:12:48.690 INFO:tasks.workunit.client.1.smithi103.stdout:3/345: mkdir d1/da/df/d70 0 2024-09-18T21:12:48.690 INFO:tasks.workunit.client.1.smithi103.stdout:3/346: fdatasync d1/d2/f3e 0 2024-09-18T21:12:48.691 INFO:tasks.workunit.client.1.smithi103.stdout:3/347: fsync d1/da/f22 0 2024-09-18T21:12:48.691 INFO:tasks.workunit.client.0.smithi077.stdout:4/337: chown d3/dc/d32/d45/d5e 940 1 2024-09-18T21:12:48.698 INFO:tasks.workunit.client.1.smithi103.stdout:3/348: symlink d1/d2/d18/d30/l71 0 2024-09-18T21:12:48.701 INFO:tasks.workunit.client.1.smithi103.stdout:2/307: creat d3/d5/d2f/d48/f70 x:0 0 0 2024-09-18T21:12:48.703 INFO:tasks.workunit.client.0.smithi077.stdout:4/338: unlink d3/dc/l2e 0 2024-09-18T21:12:48.703 INFO:tasks.workunit.client.0.smithi077.stdout:4/339: fdatasync d3/fb 0 2024-09-18T21:12:48.704 INFO:tasks.workunit.client.1.smithi103.stdout:2/308: chown d3/d5/f35 6951104 1 2024-09-18T21:12:48.705 INFO:tasks.workunit.client.1.smithi103.stdout:5/382: truncate de/d2d/f69 1034204 0 2024-09-18T21:12:48.705 INFO:tasks.workunit.client.0.smithi077.stdout:7/405: creat d12/d22/f8b x:0 0 0 2024-09-18T21:12:48.706 INFO:tasks.workunit.client.1.smithi103.stdout:3/349: mkdir d1/d23/d25/d4f/d72 0 2024-09-18T21:12:48.709 INFO:tasks.workunit.client.0.smithi077.stdout:8/297: symlink d2/d5/d6/d22/d20/l66 0 2024-09-18T21:12:48.709 INFO:tasks.workunit.client.0.smithi077.stdout:0/439: dread d8/d26/f6b [0,4194304] 0 2024-09-18T21:12:48.709 INFO:tasks.workunit.client.1.smithi103.stdout:8/383: dread d4/de/f16 [4194304,4194304] 0 2024-09-18T21:12:48.710 INFO:tasks.workunit.client.0.smithi077.stdout:0/440: readlink d8/d1d/d80/l5c 0 2024-09-18T21:12:48.710 INFO:tasks.workunit.client.1.smithi103.stdout:4/360: dread d9/d1a/d21/f63 [0,4194304] 0 2024-09-18T21:12:48.710 INFO:tasks.workunit.client.1.smithi103.stdout:5/383: unlink de/d1f/f2a 0 2024-09-18T21:12:48.711 INFO:tasks.workunit.client.1.smithi103.stdout:4/361: fdatasync f3 0 2024-09-18T21:12:48.712 INFO:tasks.workunit.client.1.smithi103.stdout:5/384: readlink de/d3e/l28 0 2024-09-18T21:12:48.712 INFO:tasks.workunit.client.0.smithi077.stdout:3/353: rename db/d14/d22/l6e to db/d14/d32/d4f/d71/l74 0 2024-09-18T21:12:48.712 INFO:tasks.workunit.client.1.smithi103.stdout:4/362: fsync d9/d2e/d61/f76 0 2024-09-18T21:12:48.713 INFO:tasks.workunit.client.1.smithi103.stdout:2/309: dread d3/d5/f18 [0,4194304] 0 2024-09-18T21:12:48.713 INFO:tasks.workunit.client.1.smithi103.stdout:3/350: symlink d1/d2/l73 0 2024-09-18T21:12:48.713 INFO:tasks.workunit.client.0.smithi077.stdout:3/354: fsync db/d14/d32/d4f/f53 0 2024-09-18T21:12:48.714 INFO:tasks.workunit.client.1.smithi103.stdout:4/363: chown d9/d1a/c65 1 1 2024-09-18T21:12:48.714 INFO:tasks.workunit.client.0.smithi077.stdout:3/355: stat db/f35 0 2024-09-18T21:12:48.715 INFO:tasks.workunit.client.0.smithi077.stdout:2/441: truncate d1/d4/d5/d1a/d2e/d41/d2c/f47 2805003 0 2024-09-18T21:12:48.716 INFO:tasks.workunit.client.0.smithi077.stdout:7/406: creat d12/d22/d59/d5a/f8c x:0 0 0 2024-09-18T21:12:48.716 INFO:tasks.workunit.client.0.smithi077.stdout:0/441: dwrite d8/d1a/f51 [0,4194304] 0 2024-09-18T21:12:48.717 INFO:tasks.workunit.client.0.smithi077.stdout:2/442: chown d1/d4/d5/d1a/d49/l4d 6931734 1 2024-09-18T21:12:48.719 INFO:tasks.workunit.client.1.smithi103.stdout:3/351: dwrite d1/da/f6b [0,4194304] 0 2024-09-18T21:12:48.720 INFO:tasks.workunit.client.0.smithi077.stdout:2/443: write d1/d4/d5/d1a/d2e/f43 [8862403,84951] 0 2024-09-18T21:12:48.721 INFO:tasks.workunit.client.0.smithi077.stdout:1/352: rename d3/d8/d75/l4f to d3/d8/d49/d4e/d5a/l84 0 2024-09-18T21:12:48.721 INFO:tasks.workunit.client.1.smithi103.stdout:8/384: symlink d4/d2d/d3d/d42/d65/d39/l72 0 2024-09-18T21:12:48.723 INFO:tasks.workunit.client.1.smithi103.stdout:2/310: unlink d3/d5/d25/f45 0 2024-09-18T21:12:48.725 INFO:tasks.workunit.client.1.smithi103.stdout:4/364: rename d9/d38/f5d to d9/d38/f81 0 2024-09-18T21:12:48.730 INFO:tasks.workunit.client.0.smithi077.stdout:4/340: rename d3/dc/d32/d45/d5e/f5f to d3/d35/f69 0 2024-09-18T21:12:48.731 INFO:tasks.workunit.client.1.smithi103.stdout:4/365: dwrite d9/d2e/f3f [0,4194304] 0 2024-09-18T21:12:48.732 INFO:tasks.workunit.client.0.smithi077.stdout:0/442: link d8/d1d/d57/f8a d8/d1a/d39/f8e 0 2024-09-18T21:12:48.732 INFO:tasks.workunit.client.1.smithi103.stdout:4/366: dread - d9/d1c/f68 zero size 2024-09-18T21:12:48.733 INFO:tasks.workunit.client.1.smithi103.stdout:8/385: mkdir d4/d2d/d4e/d73 0 2024-09-18T21:12:48.733 INFO:tasks.workunit.client.0.smithi077.stdout:8/298: dread d2/d27/d29/f43 [4194304,4194304] 0 2024-09-18T21:12:48.740 INFO:tasks.workunit.client.1.smithi103.stdout:4/367: dwrite d9/d1a/d2b/d48/f7e [0,4194304] 0 2024-09-18T21:12:48.740 INFO:tasks.workunit.client.1.smithi103.stdout:4/368: chown d9/d1c/l6c 30765024 1 2024-09-18T21:12:48.741 INFO:tasks.workunit.client.0.smithi077.stdout:3/356: rename db/d14/f40 to db/d14/d22/f75 0 2024-09-18T21:12:48.747 INFO:tasks.workunit.client.0.smithi077.stdout:4/341: write d3/d35/f37 [1733055,33595] 0 2024-09-18T21:12:48.748 INFO:tasks.workunit.client.1.smithi103.stdout:3/352: symlink d1/d23/d25/d4f/l74 0 2024-09-18T21:12:48.749 INFO:tasks.workunit.client.0.smithi077.stdout:1/353: symlink d3/d1e/d7f/l85 0 2024-09-18T21:12:48.750 INFO:tasks.workunit.client.0.smithi077.stdout:3/357: dwrite db/d14/d32/d49/d4e/d6a/f61 [0,4194304] 0 2024-09-18T21:12:48.750 INFO:tasks.workunit.client.0.smithi077.stdout:4/342: write d3/d7/f68 [309946,3909] 0 2024-09-18T21:12:48.751 INFO:tasks.workunit.client.0.smithi077.stdout:0/443: creat d8/d1d/d57/f8f x:0 0 0 2024-09-18T21:12:48.753 INFO:tasks.workunit.client.0.smithi077.stdout:1/354: fdatasync d3/d1e/f3b 0 2024-09-18T21:12:48.753 INFO:tasks.workunit.client.0.smithi077.stdout:3/358: read db/f10 [175652,74752] 0 2024-09-18T21:12:48.754 INFO:tasks.workunit.client.1.smithi103.stdout:8/386: chown d4/de/d4a/c6b 15 1 2024-09-18T21:12:48.754 INFO:tasks.workunit.client.1.smithi103.stdout:3/353: dwrite d1/d2/f3e [0,4194304] 0 2024-09-18T21:12:48.755 INFO:tasks.workunit.client.0.smithi077.stdout:8/299: mkdir d2/d5/d6/d22/d4f/d5a/d2a/d67 0 2024-09-18T21:12:48.755 INFO:tasks.workunit.client.0.smithi077.stdout:3/359: write db/d14/d22/d36/d39/f47 [2833836,57930] 0 2024-09-18T21:12:48.756 INFO:tasks.workunit.client.0.smithi077.stdout:7/407: link d12/d22/d59/d5d/d62/c6f d12/d22/d59/d72/c8d 0 2024-09-18T21:12:48.756 INFO:tasks.workunit.client.0.smithi077.stdout:3/360: stat db/f2e 0 2024-09-18T21:12:48.756 INFO:tasks.workunit.client.0.smithi077.stdout:8/300: fsync d2/d5/d6/d22/d18/f4c 0 2024-09-18T21:12:48.766 INFO:tasks.workunit.client.1.smithi103.stdout:5/385: getdents de/d3e 0 2024-09-18T21:12:48.768 INFO:tasks.workunit.client.1.smithi103.stdout:4/369: rmdir d9 39 2024-09-18T21:12:48.771 INFO:tasks.workunit.client.0.smithi077.stdout:7/408: dread d12/d22/f28 [0,4194304] 0 2024-09-18T21:12:48.772 INFO:tasks.workunit.client.1.smithi103.stdout:8/387: mknod d4/d2d/d4e/c74 0 2024-09-18T21:12:48.773 INFO:tasks.workunit.client.0.smithi077.stdout:4/343: creat d3/dc/d20/f6a x:0 0 0 2024-09-18T21:12:48.773 INFO:tasks.workunit.client.0.smithi077.stdout:2/444: write d1/d4/d9/fb [665903,85833] 0 2024-09-18T21:12:48.773 INFO:tasks.workunit.client.0.smithi077.stdout:4/344: chown d3 8043 1 2024-09-18T21:12:48.774 INFO:tasks.workunit.client.1.smithi103.stdout:3/354: write d1/d23/d25/d4f/d51/f5d [3538,47308] 0 2024-09-18T21:12:48.775 INFO:tasks.workunit.client.1.smithi103.stdout:3/355: readlink d1/da/l1d 0 2024-09-18T21:12:48.779 INFO:tasks.workunit.client.0.smithi077.stdout:0/444: dread d8/d26/f11 [0,4194304] 0 2024-09-18T21:12:48.779 INFO:tasks.workunit.client.0.smithi077.stdout:2/445: dread d1/f2a [0,4194304] 0 2024-09-18T21:12:48.779 INFO:tasks.workunit.client.1.smithi103.stdout:6/390: sync 2024-09-18T21:12:48.779 INFO:tasks.workunit.client.1.smithi103.stdout:0/357: sync 2024-09-18T21:12:48.779 INFO:tasks.workunit.client.1.smithi103.stdout:6/391: fsync d2/d24/f5e 0 2024-09-18T21:12:48.780 INFO:tasks.workunit.client.1.smithi103.stdout:5/386: write de/d1f/d3b/f4a [5226165,32491] 0 2024-09-18T21:12:48.780 INFO:tasks.workunit.client.1.smithi103.stdout:0/358: chown d1/d5/de/d24/l35 57274 1 2024-09-18T21:12:48.781 INFO:tasks.workunit.client.1.smithi103.stdout:6/392: dread d2/f4a [0,4194304] 0 2024-09-18T21:12:48.785 INFO:tasks.workunit.client.1.smithi103.stdout:8/388: mknod d4/c75 0 2024-09-18T21:12:48.785 INFO:tasks.workunit.client.0.smithi077.stdout:7/409: truncate d12/f1f 1413278 0 2024-09-18T21:12:48.786 INFO:tasks.workunit.client.0.smithi077.stdout:7/410: dread - d12/d22/d59/d5a/f67 zero size 2024-09-18T21:12:48.789 INFO:tasks.workunit.client.1.smithi103.stdout:2/311: link d3/l10 d3/l71 0 2024-09-18T21:12:48.789 INFO:tasks.workunit.client.1.smithi103.stdout:4/370: dwrite d9/d2e/f49 [0,4194304] 0 2024-09-18T21:12:48.789 INFO:tasks.workunit.client.1.smithi103.stdout:6/393: dread d2/f28 [0,4194304] 0 2024-09-18T21:12:48.790 INFO:tasks.workunit.client.1.smithi103.stdout:6/394: chown d2/d3/d8/f2a 19944 1 2024-09-18T21:12:48.790 INFO:tasks.workunit.client.0.smithi077.stdout:4/345: creat d3/dc/f6b x:0 0 0 2024-09-18T21:12:48.792 INFO:tasks.workunit.client.0.smithi077.stdout:7/411: dwrite d12/f45 [0,4194304] 0 2024-09-18T21:12:48.792 INFO:tasks.workunit.client.0.smithi077.stdout:4/346: chown d3/dc/d32/f48 2842899 1 2024-09-18T21:12:48.792 INFO:tasks.workunit.client.1.smithi103.stdout:5/387: mkdir de/d1f/d3b/d51/d57/d79 0 2024-09-18T21:12:48.794 INFO:tasks.workunit.client.0.smithi077.stdout:1/355: mknod d3/d8/c86 0 2024-09-18T21:12:48.794 INFO:tasks.workunit.client.0.smithi077.stdout:7/412: truncate d12/d22/d59/d72/f86 985315 0 2024-09-18T21:12:48.800 INFO:tasks.workunit.client.0.smithi077.stdout:8/301: rename d2/f31 to d2/d27/d29/f68 0 2024-09-18T21:12:48.803 INFO:tasks.workunit.client.0.smithi077.stdout:9/230: sync 2024-09-18T21:12:48.808 INFO:tasks.workunit.client.1.smithi103.stdout:4/371: symlink d9/d1c/d69/l82 0 2024-09-18T21:12:48.809 INFO:tasks.workunit.client.0.smithi077.stdout:4/347: mkdir d3/d7/d6c 0 2024-09-18T21:12:48.812 INFO:tasks.workunit.client.1.smithi103.stdout:5/388: creat de/d3e/d15/f7a x:0 0 0 2024-09-18T21:12:48.815 INFO:tasks.workunit.client.1.smithi103.stdout:4/372: dwrite d9/d38/f7a [0,4194304] 0 2024-09-18T21:12:48.816 INFO:tasks.workunit.client.1.smithi103.stdout:0/359: rename d1/d5/d4c/f53 to d1/d5/de/d22/f83 0 2024-09-18T21:12:48.817 INFO:tasks.workunit.client.1.smithi103.stdout:0/360: readlink d1/d5/de/l4d 0 2024-09-18T21:12:48.817 INFO:tasks.workunit.client.0.smithi077.stdout:1/356: mknod d3/d8/d49/d4e/d5a/c87 0 2024-09-18T21:12:48.817 INFO:tasks.workunit.client.0.smithi077.stdout:4/348: dwrite d3/dc/d20/f2a [4194304,4194304] 0 2024-09-18T21:12:48.818 INFO:tasks.workunit.client.0.smithi077.stdout:1/357: readlink d3/d8/d75/l45 0 2024-09-18T21:12:48.820 INFO:tasks.workunit.client.1.smithi103.stdout:3/356: creat d1/f75 x:0 0 0 2024-09-18T21:12:48.824 INFO:tasks.workunit.client.0.smithi077.stdout:0/445: creat d8/d37/d66/d87/f90 x:0 0 0 2024-09-18T21:12:48.825 INFO:tasks.workunit.client.0.smithi077.stdout:4/349: dwrite d3/dc/d20/f2a [4194304,4194304] 0 2024-09-18T21:12:48.826 INFO:tasks.workunit.client.0.smithi077.stdout:8/302: creat d2/d5/d6/d22/d4f/f69 x:0 0 0 2024-09-18T21:12:48.827 INFO:tasks.workunit.client.1.smithi103.stdout:5/389: mknod de/d1f/d3b/d51/d57/c7b 0 2024-09-18T21:12:48.828 INFO:tasks.workunit.client.0.smithi077.stdout:9/231: creat d1/dd/d11/d15/f45 x:0 0 0 2024-09-18T21:12:48.830 INFO:tasks.workunit.client.0.smithi077.stdout:9/232: write d1/dd/d11/d1c/d38/f41 [788033,31172] 0 2024-09-18T21:12:48.834 INFO:tasks.workunit.client.1.smithi103.stdout:3/357: rmdir d1/d23/d25 39 2024-09-18T21:12:48.834 INFO:tasks.workunit.client.0.smithi077.stdout:4/350: dwrite d3/dc/d32/d5b/f67 [0,4194304] 0 2024-09-18T21:12:48.834 INFO:tasks.workunit.client.0.smithi077.stdout:4/351: write d3/f1f [4807770,8894] 0 2024-09-18T21:12:48.835 INFO:tasks.workunit.client.1.smithi103.stdout:2/312: link d3/d5/f6f d3/d5/d4a/d56/f72 0 2024-09-18T21:12:48.836 INFO:tasks.workunit.client.0.smithi077.stdout:4/352: write d3/f57 [254939,4255] 0 2024-09-18T21:12:48.837 INFO:tasks.workunit.client.0.smithi077.stdout:2/446: creat d1/f92 x:0 0 0 2024-09-18T21:12:48.838 INFO:tasks.workunit.client.0.smithi077.stdout:4/353: readlink d3/dc/d20/l61 0 2024-09-18T21:12:48.838 INFO:tasks.workunit.client.1.smithi103.stdout:5/390: creat de/d14/d33/f7c x:0 0 0 2024-09-18T21:12:48.840 INFO:tasks.workunit.client.0.smithi077.stdout:0/446: unlink d8/f14 0 2024-09-18T21:12:48.841 INFO:tasks.workunit.client.1.smithi103.stdout:4/373: unlink d9/d1a/d41/f7c 0 2024-09-18T21:12:48.843 INFO:tasks.workunit.client.0.smithi077.stdout:8/303: creat d2/d36/f6a x:0 0 0 2024-09-18T21:12:48.844 INFO:tasks.workunit.client.1.smithi103.stdout:2/313: dread d3/f1d [0,4194304] 0 2024-09-18T21:12:48.845 INFO:tasks.workunit.client.1.smithi103.stdout:2/314: truncate d3/d5/f6f 117789 0 2024-09-18T21:12:48.845 INFO:tasks.workunit.client.0.smithi077.stdout:2/447: dwrite d1/d4/d5/d1a/d2e/d7e/f91 [0,4194304] 0 2024-09-18T21:12:48.846 INFO:tasks.workunit.client.1.smithi103.stdout:2/315: dread - d3/d5/d2c/f66 zero size 2024-09-18T21:12:48.846 INFO:tasks.workunit.client.1.smithi103.stdout:8/389: mknod d4/d2d/d3d/c76 0 2024-09-18T21:12:48.847 INFO:tasks.workunit.client.0.smithi077.stdout:8/304: read d2/d5/d6/d22/d26/f39 [2002100,20908] 0 2024-09-18T21:12:48.847 INFO:tasks.workunit.client.0.smithi077.stdout:9/233: mkdir d1/dd/d11/d1c/d38/d46 0 2024-09-18T21:12:48.851 INFO:tasks.workunit.client.1.smithi103.stdout:5/391: creat de/d1f/d3b/d51/d57/d59/f7d x:0 0 0 2024-09-18T21:12:48.853 INFO:tasks.workunit.client.1.smithi103.stdout:1/372: sync 2024-09-18T21:12:48.853 INFO:tasks.workunit.client.1.smithi103.stdout:7/361: sync 2024-09-18T21:12:48.853 INFO:tasks.workunit.client.1.smithi103.stdout:1/373: fsync d0/d3/f20 0 2024-09-18T21:12:48.854 INFO:tasks.workunit.client.0.smithi077.stdout:4/354: mknod d3/dc/c6d 0 2024-09-18T21:12:48.854 INFO:tasks.workunit.client.0.smithi077.stdout:2/448: dwrite d1/d4/d5/d1a/d2e/f7f [0,4194304] 0 2024-09-18T21:12:48.855 INFO:tasks.workunit.client.1.smithi103.stdout:1/374: chown d0/d11/d5f/c6a 1 1 2024-09-18T21:12:48.858 INFO:tasks.workunit.client.1.smithi103.stdout:4/374: write d9/d1a/d2b/f79 [1588707,109498] 0 2024-09-18T21:12:48.859 INFO:tasks.workunit.client.0.smithi077.stdout:7/413: dwrite d12/d22/d59/d72/f57 [0,4194304] 0 2024-09-18T21:12:48.869 INFO:tasks.workunit.client.0.smithi077.stdout:2/449: dwrite d1/fd [8388608,4194304] 0 2024-09-18T21:12:48.871 INFO:tasks.workunit.client.0.smithi077.stdout:4/355: dwrite d3/dc/d24/f4c [0,4194304] 0 2024-09-18T21:12:48.874 INFO:tasks.workunit.client.0.smithi077.stdout:8/305: dread f1 [0,4194304] 0 2024-09-18T21:12:48.876 INFO:tasks.workunit.client.0.smithi077.stdout:2/450: dread d1/d4/d5/d1a/f4c [0,4194304] 0 2024-09-18T21:12:48.879 INFO:tasks.workunit.client.0.smithi077.stdout:4/356: dread d3/dc/d32/f62 [0,4194304] 0 2024-09-18T21:12:48.880 INFO:tasks.workunit.client.1.smithi103.stdout:1/375: mkdir d0/d3/d68/d81 0 2024-09-18T21:12:48.881 INFO:tasks.workunit.client.1.smithi103.stdout:1/376: dread - d0/d2/d9/dc/f7e zero size 2024-09-18T21:12:48.881 INFO:tasks.workunit.client.1.smithi103.stdout:1/377: fdatasync d0/d3/f29 0 2024-09-18T21:12:48.882 INFO:tasks.workunit.client.1.smithi103.stdout:4/375: mkdir d9/d2e/d83 0 2024-09-18T21:12:48.882 INFO:tasks.workunit.client.1.smithi103.stdout:1/378: readlink d0/d11/d5f/d19/l1f 0 2024-09-18T21:12:48.883 INFO:tasks.workunit.client.0.smithi077.stdout:0/447: truncate d8/d1a/f42 1241101 0 2024-09-18T21:12:48.885 INFO:tasks.workunit.client.1.smithi103.stdout:8/390: mkdir d4/d26/d56/d77 0 2024-09-18T21:12:48.886 INFO:tasks.workunit.client.0.smithi077.stdout:4/357: dwrite d3/dc/f6b [0,4194304] 0 2024-09-18T21:12:48.888 INFO:tasks.workunit.client.0.smithi077.stdout:9/234: symlink d1/df/l47 0 2024-09-18T21:12:48.889 INFO:tasks.workunit.client.0.smithi077.stdout:9/235: stat d1/f16 0 2024-09-18T21:12:48.889 INFO:tasks.workunit.client.1.smithi103.stdout:1/379: dwrite d0/d2/d2b/d3a/f51 [0,4194304] 0 2024-09-18T21:12:48.890 INFO:tasks.workunit.client.1.smithi103.stdout:6/395: sync 2024-09-18T21:12:48.890 INFO:tasks.workunit.client.1.smithi103.stdout:9/396: sync 2024-09-18T21:12:48.892 INFO:tasks.workunit.client.1.smithi103.stdout:0/361: dwrite d1/d9/d13/f37 [0,4194304] 0 2024-09-18T21:12:48.893 INFO:tasks.workunit.client.0.smithi077.stdout:1/358: getdents d3/d1e 0 2024-09-18T21:12:48.894 INFO:tasks.workunit.client.1.smithi103.stdout:0/362: chown d1/d5/de/l4d 156067957 1 2024-09-18T21:12:48.897 INFO:tasks.workunit.client.0.smithi077.stdout:8/306: symlink d2/d5/d6/d22/d26/l6b 0 2024-09-18T21:12:48.900 INFO:tasks.workunit.client.1.smithi103.stdout:9/397: dwrite d18/d1f/d2f/f31 [0,4194304] 0 2024-09-18T21:12:48.904 INFO:tasks.workunit.client.1.smithi103.stdout:3/358: rename d1/l3 to d1/d2/d18/l76 0 2024-09-18T21:12:48.905 INFO:tasks.workunit.client.1.smithi103.stdout:5/392: getdents de/d1f/d3b/d3c 0 2024-09-18T21:12:48.906 INFO:tasks.workunit.client.1.smithi103.stdout:5/393: dread - de/d14/f5b zero size 2024-09-18T21:12:48.908 INFO:tasks.workunit.client.1.smithi103.stdout:1/380: mknod d0/d2/d9/d10/c82 0 2024-09-18T21:12:48.909 INFO:tasks.workunit.client.1.smithi103.stdout:7/362: truncate d1/df/f20 2524372 0 2024-09-18T21:12:48.909 INFO:tasks.workunit.client.1.smithi103.stdout:1/381: dread - d0/d2/d9/dc/f7e zero size 2024-09-18T21:12:48.910 INFO:tasks.workunit.client.0.smithi077.stdout:4/358: fdatasync d3/dc/d32/f3e 0 2024-09-18T21:12:48.910 INFO:tasks.workunit.client.0.smithi077.stdout:4/359: fdatasync d3/dc/f16 0 2024-09-18T21:12:48.912 INFO:tasks.workunit.client.1.smithi103.stdout:6/396: symlink d2/d24/d5a/d67/d76/l77 0 2024-09-18T21:12:48.913 INFO:tasks.workunit.client.0.smithi077.stdout:8/307: symlink d2/d5/d6/d22/d20/d3e/l6c 0 2024-09-18T21:12:48.914 INFO:tasks.workunit.client.0.smithi077.stdout:8/308: read d2/d5/d6/d22/d4f/d5a/f5c [3492543,95587] 0 2024-09-18T21:12:48.915 INFO:tasks.workunit.client.1.smithi103.stdout:8/391: creat d4/de/f78 x:0 0 0 2024-09-18T21:12:48.916 INFO:tasks.workunit.client.0.smithi077.stdout:0/448: unlink d8/d1a/l7b 0 2024-09-18T21:12:48.917 INFO:tasks.workunit.client.1.smithi103.stdout:2/316: rename d3/d5/d25/c39 to d3/d5/d2f/d48/c73 0 2024-09-18T21:12:48.918 INFO:tasks.workunit.client.0.smithi077.stdout:7/414: creat d12/d31/d33/f8e x:0 0 0 2024-09-18T21:12:48.918 INFO:tasks.workunit.client.1.smithi103.stdout:3/359: creat d1/da/df/f77 x:0 0 0 2024-09-18T21:12:48.923 INFO:tasks.workunit.client.0.smithi077.stdout:9/236: dread d1/dd/d1a/f23 [0,4194304] 0 2024-09-18T21:12:48.923 INFO:tasks.workunit.client.0.smithi077.stdout:8/309: mknod d2/d27/d29/d41/c6d 0 2024-09-18T21:12:48.924 INFO:tasks.workunit.client.1.smithi103.stdout:0/363: mknod d1/d9/c84 0 2024-09-18T21:12:48.924 INFO:tasks.workunit.client.0.smithi077.stdout:0/449: chown d8/d37/l53 19 1 2024-09-18T21:12:48.926 INFO:tasks.workunit.client.1.smithi103.stdout:4/376: link d9/d1a/c28 d9/d1a/d21/d80/c84 0 2024-09-18T21:12:48.929 INFO:tasks.workunit.client.0.smithi077.stdout:7/415: stat c8 0 2024-09-18T21:12:48.929 INFO:tasks.workunit.client.1.smithi103.stdout:7/363: dread d1/f17 [0,4194304] 0 2024-09-18T21:12:48.930 INFO:tasks.workunit.client.0.smithi077.stdout:2/451: write d1/d4/d5/d1a/d2e/d41/d2c/f88 [829803,100527] 0 2024-09-18T21:12:48.931 INFO:tasks.workunit.client.0.smithi077.stdout:8/310: dwrite d2/d5/d6/d22/d26/f60 [0,4194304] 0 2024-09-18T21:12:48.935 INFO:tasks.workunit.client.0.smithi077.stdout:1/359: rename d3/d8/d75/f63 to d3/d8/f88 0 2024-09-18T21:12:48.938 INFO:tasks.workunit.client.1.smithi103.stdout:2/317: rename d3/d5/d4a/d56/f72 to d3/d5/d2f/d32/f74 0 2024-09-18T21:12:48.942 INFO:tasks.workunit.client.1.smithi103.stdout:5/394: mkdir de/d14/d7e 0 2024-09-18T21:12:48.942 INFO:tasks.workunit.client.0.smithi077.stdout:4/360: dwrite d3/dc/d32/f3e [0,4194304] 0 2024-09-18T21:12:48.943 INFO:tasks.workunit.client.1.smithi103.stdout:5/395: chown de/d3e/d15/f7a 0 1 2024-09-18T21:12:48.943 INFO:tasks.workunit.client.1.smithi103.stdout:5/396: fsync de/f77 0 2024-09-18T21:12:48.950 INFO:tasks.workunit.client.1.smithi103.stdout:0/364: fsync d1/d5/de/d19/d1e/f1f 0 2024-09-18T21:12:48.952 INFO:tasks.workunit.client.0.smithi077.stdout:1/360: mkdir d3/d8/d75/d89 0 2024-09-18T21:12:48.953 INFO:tasks.workunit.client.0.smithi077.stdout:1/361: fsync d3/d8/d49/d4e/d50/f30 0 2024-09-18T21:12:48.956 INFO:tasks.workunit.client.1.smithi103.stdout:7/364: creat d1/df/d43/d63/d67/d5b/f70 x:0 0 0 2024-09-18T21:12:48.957 INFO:tasks.workunit.client.1.smithi103.stdout:9/398: creat d18/d1f/f87 x:0 0 0 2024-09-18T21:12:48.958 INFO:tasks.workunit.client.0.smithi077.stdout:4/361: mknod d3/dc/d51/c6e 0 2024-09-18T21:12:48.960 INFO:tasks.workunit.client.0.smithi077.stdout:2/452: mknod d1/d4/d5/d1a/d2e/c93 0 2024-09-18T21:12:48.961 INFO:tasks.workunit.client.1.smithi103.stdout:2/318: dread - d3/d5/f57 zero size 2024-09-18T21:12:48.962 INFO:tasks.workunit.client.1.smithi103.stdout:2/319: write d3/f21 [2225883,93300] 0 2024-09-18T21:12:48.962 INFO:tasks.workunit.client.0.smithi077.stdout:8/311: mkdir d2/d5/d6/d22/d20/d35/d6e 0 2024-09-18T21:12:48.967 INFO:tasks.workunit.client.0.smithi077.stdout:8/312: dread d2/d27/d29/f61 [0,4194304] 0 2024-09-18T21:12:48.967 INFO:tasks.workunit.client.1.smithi103.stdout:1/382: link d0/d3/l5b d0/d2/d9/d10/l83 0 2024-09-18T21:12:48.968 INFO:tasks.workunit.client.0.smithi077.stdout:8/313: write d2/d27/d29/f61 [640675,17982] 0 2024-09-18T21:12:48.968 INFO:tasks.workunit.client.0.smithi077.stdout:1/362: readlink d3/d8/d49/d4e/d5a/l84 0 2024-09-18T21:12:48.970 INFO:tasks.workunit.client.1.smithi103.stdout:8/392: dwrite f2 [0,4194304] 0 2024-09-18T21:12:48.970 INFO:tasks.workunit.client.1.smithi103.stdout:6/397: creat d2/d3/d8/d4c/f78 x:0 0 0 2024-09-18T21:12:48.971 INFO:tasks.workunit.client.1.smithi103.stdout:8/393: fdatasync d4/d26/f25 0 2024-09-18T21:12:48.972 INFO:tasks.workunit.client.0.smithi077.stdout:4/362: truncate d3/dc/d32/f62 4096713 0 2024-09-18T21:12:48.972 INFO:tasks.workunit.client.0.smithi077.stdout:4/363: write d3/d7/f1a [723752,110241] 0 2024-09-18T21:12:48.973 INFO:tasks.workunit.client.0.smithi077.stdout:4/364: fdatasync d3/f63 0 2024-09-18T21:12:48.973 INFO:tasks.workunit.client.1.smithi103.stdout:0/365: creat d1/d5/d4c/d4e/f85 x:0 0 0 2024-09-18T21:12:48.975 INFO:tasks.workunit.client.0.smithi077.stdout:2/453: unlink d1/d4/d5/d1a/d2e/d40/c61 0 2024-09-18T21:12:48.975 INFO:tasks.workunit.client.0.smithi077.stdout:2/454: readlink d1/d4/d5/l73 0 2024-09-18T21:12:48.975 INFO:tasks.workunit.client.1.smithi103.stdout:9/399: dread d18/d29/f55 [0,4194304] 0 2024-09-18T21:12:48.976 INFO:tasks.workunit.client.0.smithi077.stdout:7/416: link d12/d22/d59/d72/l52 d12/d31/d33/d2a/d6c/l8f 0 2024-09-18T21:12:48.976 INFO:tasks.workunit.client.1.smithi103.stdout:4/377: mkdir d9/d38/d72/d85 0 2024-09-18T21:12:48.977 INFO:tasks.workunit.client.1.smithi103.stdout:4/378: readlink d9/d1a/d41/l73 0 2024-09-18T21:12:48.978 INFO:tasks.workunit.client.0.smithi077.stdout:8/314: chown d2/c3 76 1 2024-09-18T21:12:48.980 INFO:tasks.workunit.client.0.smithi077.stdout:4/365: dread d3/d7/f4f [0,4194304] 0 2024-09-18T21:12:48.982 INFO:tasks.workunit.client.1.smithi103.stdout:5/397: dwrite de/d14/d33/f46 [0,4194304] 0 2024-09-18T21:12:48.982 INFO:tasks.workunit.client.0.smithi077.stdout:2/455: chown d1/d4/d5/c48 85843 1 2024-09-18T21:12:48.984 INFO:tasks.workunit.client.0.smithi077.stdout:7/417: dwrite d12/d22/d59/d5a/f69 [0,4194304] 0 2024-09-18T21:12:48.987 INFO:tasks.workunit.client.0.smithi077.stdout:1/363: rename d3/d8/c12 to d3/d8/d13/d18/c8a 0 2024-09-18T21:12:48.988 INFO:tasks.workunit.client.0.smithi077.stdout:4/366: rmdir d3/dc/d32/d5b 39 2024-09-18T21:12:48.990 INFO:tasks.workunit.client.1.smithi103.stdout:0/366: creat d1/d5/d4c/f86 x:0 0 0 2024-09-18T21:12:48.993 INFO:tasks.workunit.client.0.smithi077.stdout:8/315: mkdir d2/d5f/d6f 0 2024-09-18T21:12:48.993 INFO:tasks.workunit.client.1.smithi103.stdout:9/400: write d18/d29/f5b [844289,115385] 0 2024-09-18T21:12:48.993 INFO:tasks.workunit.client.1.smithi103.stdout:0/367: read - d1/d5/de/d19/f7c zero size 2024-09-18T21:12:48.994 INFO:tasks.workunit.client.0.smithi077.stdout:8/316: chown d2/d5/d6/d22/d20/d3e/f47 12 1 2024-09-18T21:12:48.995 INFO:tasks.workunit.client.0.smithi077.stdout:1/364: creat d3/d8/d49/d4e/d50/f8b x:0 0 0 2024-09-18T21:12:48.997 INFO:tasks.workunit.client.0.smithi077.stdout:1/365: truncate d3/d8/d49/f62 650088 0 2024-09-18T21:12:48.999 INFO:tasks.workunit.client.0.smithi077.stdout:7/418: dread d12/d22/f65 [0,4194304] 0 2024-09-18T21:12:49.000 INFO:tasks.workunit.client.0.smithi077.stdout:2/456: creat d1/d62/f94 x:0 0 0 2024-09-18T21:12:49.000 INFO:tasks.workunit.client.1.smithi103.stdout:0/368: dwrite d1/d56/f72 [0,4194304] 0 2024-09-18T21:12:49.004 INFO:tasks.workunit.client.0.smithi077.stdout:0/450: truncate d8/d26/f6b 3751191 0 2024-09-18T21:12:49.005 INFO:tasks.workunit.client.1.smithi103.stdout:1/383: creat d0/d2/d9/dc/d6e/f84 x:0 0 0 2024-09-18T21:12:49.006 INFO:tasks.workunit.client.1.smithi103.stdout:6/398: mkdir d2/d3/d8/d4c/d79 0 2024-09-18T21:12:49.009 INFO:tasks.workunit.client.1.smithi103.stdout:4/379: mkdir d9/d1a/d86 0 2024-09-18T21:12:49.010 INFO:tasks.workunit.client.1.smithi103.stdout:4/380: truncate d9/d1a/d21/f57 768408 0 2024-09-18T21:12:49.011 INFO:tasks.workunit.client.0.smithi077.stdout:2/457: mkdir d1/d4/d9/d80/d95 0 2024-09-18T21:12:49.012 INFO:tasks.workunit.client.0.smithi077.stdout:1/366: dwrite d3/d1e/f35 [0,4194304] 0 2024-09-18T21:12:49.015 INFO:tasks.workunit.client.1.smithi103.stdout:3/360: getdents d1/d23/d25/d4f/d51 0 2024-09-18T21:12:49.017 INFO:tasks.workunit.client.1.smithi103.stdout:2/320: link d3/f1d d3/d5/d2f/d5b/f75 0 2024-09-18T21:12:49.022 INFO:tasks.workunit.client.1.smithi103.stdout:1/384: rename d0/d11/d5f/d19/d4d to d0/d2/d2b/d85 0 2024-09-18T21:12:49.025 INFO:tasks.workunit.client.1.smithi103.stdout:8/394: creat d4/de/d4a/f79 x:0 0 0 2024-09-18T21:12:49.026 INFO:tasks.workunit.client.0.smithi077.stdout:4/367: getdents d3/d35 0 2024-09-18T21:12:49.027 INFO:tasks.workunit.client.0.smithi077.stdout:0/451: unlink d8/d1a/d35/f4d 0 2024-09-18T21:12:49.027 INFO:tasks.workunit.client.1.smithi103.stdout:9/401: truncate d18/f3e 2757371 0 2024-09-18T21:12:49.027 INFO:tasks.workunit.client.1.smithi103.stdout:9/402: fdatasync ff 0 2024-09-18T21:12:49.029 INFO:tasks.workunit.client.1.smithi103.stdout:3/361: symlink d1/d23/d47/l78 0 2024-09-18T21:12:49.030 INFO:tasks.workunit.client.0.smithi077.stdout:7/419: rename d12/d31/l40 to d12/d22/d59/l90 0 2024-09-18T21:12:49.031 INFO:tasks.workunit.client.0.smithi077.stdout:2/458: symlink d1/d4/d9/d80/d95/l96 0 2024-09-18T21:12:49.033 INFO:tasks.workunit.client.1.smithi103.stdout:2/321: write d3/d5/f4c [571697,110887] 0 2024-09-18T21:12:49.033 INFO:tasks.workunit.client.0.smithi077.stdout:8/317: getdents d2/d5/d6/d22/d4f/d5a 0 2024-09-18T21:12:49.033 INFO:tasks.workunit.client.0.smithi077.stdout:8/318: readlink d2/d5/d6/d22/l5b 0 2024-09-18T21:12:49.034 INFO:tasks.workunit.client.0.smithi077.stdout:8/319: chown d2/d27/d29/f3f 117418478 1 2024-09-18T21:12:49.035 INFO:tasks.workunit.client.0.smithi077.stdout:1/367: creat d3/d8/d75/d89/f8c x:0 0 0 2024-09-18T21:12:49.036 INFO:tasks.workunit.client.1.smithi103.stdout:6/399: mkdir d2/d3/d8/d4c/d7a 0 2024-09-18T21:12:49.039 INFO:tasks.workunit.client.0.smithi077.stdout:0/452: creat d8/d1a/d39/d3b/d79/f91 x:0 0 0 2024-09-18T21:12:49.041 INFO:tasks.workunit.client.1.smithi103.stdout:7/365: sync 2024-09-18T21:12:49.042 INFO:tasks.workunit.client.0.smithi077.stdout:4/368: dread d3/dc/f16 [0,4194304] 0 2024-09-18T21:12:49.042 INFO:tasks.workunit.client.0.smithi077.stdout:7/420: write d12/d22/d59/d72/f86 [531675,5764] 0 2024-09-18T21:12:49.044 INFO:tasks.workunit.client.0.smithi077.stdout:2/459: unlink d1/d4/d9/d80/f87 0 2024-09-18T21:12:49.045 INFO:tasks.workunit.client.0.smithi077.stdout:2/460: readlink d1/d4/d5/d1a/d2e/d41/d2c/l50 0 2024-09-18T21:12:49.045 INFO:tasks.workunit.client.0.smithi077.stdout:8/320: mknod d2/d5/d6/d22/d18/c70 0 2024-09-18T21:12:49.046 INFO:tasks.workunit.client.0.smithi077.stdout:2/461: stat d1/d4/d5/d1a/d2e/d41/d2c 0 2024-09-18T21:12:49.048 INFO:tasks.workunit.client.0.smithi077.stdout:1/368: creat d3/d8/d49/d4e/d50/f8d x:0 0 0 2024-09-18T21:12:49.050 INFO:tasks.workunit.client.1.smithi103.stdout:9/403: creat d18/d52/d6f/f88 x:0 0 0 2024-09-18T21:12:49.050 INFO:tasks.workunit.client.1.smithi103.stdout:4/381: truncate d9/fa 41895 0 2024-09-18T21:12:49.050 INFO:tasks.workunit.client.1.smithi103.stdout:3/362: fdatasync d1/d2/d18/f46 0 2024-09-18T21:12:49.051 INFO:tasks.workunit.client.1.smithi103.stdout:5/398: getdents de/d2d/d44 0 2024-09-18T21:12:49.051 INFO:tasks.workunit.client.1.smithi103.stdout:4/382: readlink d9/d1a/d41/l73 0 2024-09-18T21:12:49.051 INFO:tasks.workunit.client.1.smithi103.stdout:3/363: readlink d1/da/ld 0 2024-09-18T21:12:49.052 INFO:tasks.workunit.client.1.smithi103.stdout:5/399: chown de/l38 12763 1 2024-09-18T21:12:49.052 INFO:tasks.workunit.client.0.smithi077.stdout:4/369: creat d3/d35/f6f x:0 0 0 2024-09-18T21:12:49.053 INFO:tasks.workunit.client.1.smithi103.stdout:9/404: read d18/f24 [273363,71339] 0 2024-09-18T21:12:49.054 INFO:tasks.workunit.client.1.smithi103.stdout:2/322: creat d3/d5/d2f/d32/f76 x:0 0 0 2024-09-18T21:12:49.054 INFO:tasks.workunit.client.0.smithi077.stdout:8/321: dwrite d2/d5/d6/d22/f3c [0,4194304] 0 2024-09-18T21:12:49.057 INFO:tasks.workunit.client.0.smithi077.stdout:8/322: stat d2/d5/d6/d22/d20/d35/c44 0 2024-09-18T21:12:49.057 INFO:tasks.workunit.client.1.smithi103.stdout:3/364: dwrite d1/da/df/f14 [4194304,4194304] 0 2024-09-18T21:12:49.058 INFO:tasks.workunit.client.0.smithi077.stdout:0/453: dwrite d8/d26/f54 [0,4194304] 0 2024-09-18T21:12:49.059 INFO:tasks.workunit.client.1.smithi103.stdout:8/395: mknod d4/d26/d56/d77/c7a 0 2024-09-18T21:12:49.060 INFO:tasks.workunit.client.0.smithi077.stdout:0/454: chown d8/d1a/d39/f3c 1488290 1 2024-09-18T21:12:49.060 INFO:tasks.workunit.client.1.smithi103.stdout:8/396: write d4/d2d/d3d/f5a [2206334,113532] 0 2024-09-18T21:12:49.061 INFO:tasks.workunit.client.1.smithi103.stdout:0/369: getdents d1/d9/d13/d4f 0 2024-09-18T21:12:49.063 INFO:tasks.workunit.client.0.smithi077.stdout:4/370: unlink d3/d35/f6f 0 2024-09-18T21:12:49.068 INFO:tasks.workunit.client.1.smithi103.stdout:4/383: creat d9/d1c/d77/f87 x:0 0 0 2024-09-18T21:12:49.071 INFO:tasks.workunit.client.0.smithi077.stdout:5/508: sync 2024-09-18T21:12:49.071 INFO:tasks.workunit.client.0.smithi077.stdout:6/377: sync 2024-09-18T21:12:49.075 INFO:tasks.workunit.client.0.smithi077.stdout:5/509: read d0/d6/d3b/d64/f6c [3839347,9692] 0 2024-09-18T21:12:49.075 INFO:tasks.workunit.client.1.smithi103.stdout:5/400: rename de/d2d/d44 to de/d2d/d7f 0 2024-09-18T21:12:49.076 INFO:tasks.workunit.client.1.smithi103.stdout:2/323: mkdir d3/d5/d2c/d77 0 2024-09-18T21:12:49.077 INFO:tasks.workunit.client.0.smithi077.stdout:1/369: dwrite d3/d8/d13/d18/f46 [0,4194304] 0 2024-09-18T21:12:49.077 INFO:tasks.workunit.client.0.smithi077.stdout:6/378: write d7/df/d11/d1d/d50/f5f [4554405,116491] 0 2024-09-18T21:12:49.077 INFO:tasks.workunit.client.1.smithi103.stdout:2/324: chown d3/f21 3 1 2024-09-18T21:12:49.078 INFO:tasks.workunit.client.0.smithi077.stdout:6/379: chown d7/df/d11/d25/f47 48 1 2024-09-18T21:12:49.080 INFO:tasks.workunit.client.0.smithi077.stdout:7/421: rmdir d12/d22/d59/d5d/d7a 0 2024-09-18T21:12:49.080 INFO:tasks.workunit.client.1.smithi103.stdout:3/365: creat d1/da/df/f79 x:0 0 0 2024-09-18T21:12:49.082 INFO:tasks.workunit.client.1.smithi103.stdout:7/366: dread d1/df/d42/d1f/d2e/f41 [0,4194304] 0 2024-09-18T21:12:49.083 INFO:tasks.workunit.client.1.smithi103.stdout:8/397: symlink d4/de/l7b 0 2024-09-18T21:12:49.085 INFO:tasks.workunit.client.0.smithi077.stdout:1/370: dwrite d3/d8/f67 [0,4194304] 0 2024-09-18T21:12:49.086 INFO:tasks.workunit.client.0.smithi077.stdout:1/371: write d3/f2e [140494,80537] 0 2024-09-18T21:12:49.087 INFO:tasks.workunit.client.0.smithi077.stdout:4/371: link d3/d7/d42/f5c d3/d7/f70 0 2024-09-18T21:12:49.090 INFO:tasks.workunit.client.0.smithi077.stdout:5/510: rmdir d0/df/d10/d47 39 2024-09-18T21:12:49.093 INFO:tasks.workunit.client.1.smithi103.stdout:9/405: mknod d18/c89 0 2024-09-18T21:12:49.095 INFO:tasks.workunit.client.0.smithi077.stdout:6/380: rename l5 to d7/df/d11/d1d/d49/l7b 0 2024-09-18T21:12:49.096 INFO:tasks.workunit.client.0.smithi077.stdout:8/323: dread d2/d5/d6/f14 [0,4194304] 0 2024-09-18T21:12:49.096 INFO:tasks.workunit.client.0.smithi077.stdout:6/381: chown d7/fc 0 1 2024-09-18T21:12:49.096 INFO:tasks.workunit.client.0.smithi077.stdout:7/422: mkdir d12/d22/d59/d72/d91 0 2024-09-18T21:12:49.097 INFO:tasks.workunit.client.1.smithi103.stdout:2/325: mknod d3/d5/d2c/c78 0 2024-09-18T21:12:49.098 INFO:tasks.workunit.client.0.smithi077.stdout:4/372: dwrite d3/d7/f68 [0,4194304] 0 2024-09-18T21:12:49.098 INFO:tasks.workunit.client.0.smithi077.stdout:0/455: rmdir d8/d1d/d57/d81 0 2024-09-18T21:12:49.099 INFO:tasks.workunit.client.0.smithi077.stdout:1/372: symlink d3/d8/d75/l8e 0 2024-09-18T21:12:49.100 INFO:tasks.workunit.client.1.smithi103.stdout:4/384: dwrite d9/d1a/d21/f63 [0,4194304] 0 2024-09-18T21:12:49.100 INFO:tasks.workunit.client.0.smithi077.stdout:4/373: chown d3/d7/f68 5039418 1 2024-09-18T21:12:49.101 INFO:tasks.workunit.client.1.smithi103.stdout:4/385: write d9/d1a/d2b/f53 [436976,64581] 0 2024-09-18T21:12:49.102 INFO:tasks.workunit.client.1.smithi103.stdout:7/367: creat d1/df/d42/d1f/d5d/f71 x:0 0 0 2024-09-18T21:12:49.103 INFO:tasks.workunit.client.0.smithi077.stdout:5/511: mknod d0/df/cb1 0 2024-09-18T21:12:49.103 INFO:tasks.workunit.client.1.smithi103.stdout:8/398: creat d4/d2d/d3d/d42/f7c x:0 0 0 2024-09-18T21:12:49.104 INFO:tasks.workunit.client.0.smithi077.stdout:6/382: mkdir d7/d7c 0 2024-09-18T21:12:49.104 INFO:tasks.workunit.client.0.smithi077.stdout:5/512: write d0/d6/dd/f30 [2250885,78099] 0 2024-09-18T21:12:49.107 INFO:tasks.workunit.client.0.smithi077.stdout:7/423: truncate f5 3956948 0 2024-09-18T21:12:49.110 INFO:tasks.workunit.client.0.smithi077.stdout:1/373: dwrite d3/d8/d49/d4e/d50/f2c [0,4194304] 0 2024-09-18T21:12:49.113 INFO:tasks.workunit.client.0.smithi077.stdout:0/456: symlink d8/d1d/d57/l92 0 2024-09-18T21:12:49.114 INFO:tasks.workunit.client.0.smithi077.stdout:0/457: write d8/d37/d66/f6c [70502,75733] 0 2024-09-18T21:12:49.119 INFO:tasks.workunit.client.1.smithi103.stdout:6/400: dwrite d2/d3/f55 [0,4194304] 0 2024-09-18T21:12:49.121 INFO:tasks.workunit.client.0.smithi077.stdout:6/383: symlink d7/l7d 0 2024-09-18T21:12:49.122 INFO:tasks.workunit.client.1.smithi103.stdout:8/399: mknod d4/d26/c7d 0 2024-09-18T21:12:49.128 INFO:tasks.workunit.client.1.smithi103.stdout:5/401: link de/d14/c66 de/d1f/d3b/d3c/c80 0 2024-09-18T21:12:49.130 INFO:tasks.workunit.client.1.smithi103.stdout:5/402: dread de/d1f/d3b/f61 [0,4194304] 0 2024-09-18T21:12:49.131 INFO:tasks.workunit.client.1.smithi103.stdout:5/403: fsync de/d14/d33/f5d 0 2024-09-18T21:12:49.131 INFO:tasks.workunit.client.0.smithi077.stdout:6/384: dwrite d7/df/d11/d1d/d5c/f6b [0,4194304] 0 2024-09-18T21:12:49.131 INFO:tasks.workunit.client.0.smithi077.stdout:4/374: creat d3/d7/d6c/f71 x:0 0 0 2024-09-18T21:12:49.132 INFO:tasks.workunit.client.1.smithi103.stdout:5/404: write de/d2d/f56 [389501,38346] 0 2024-09-18T21:12:49.133 INFO:tasks.workunit.client.1.smithi103.stdout:6/401: rename d2/d3/d8/ca to d2/d24/d5a/d67/c7b 0 2024-09-18T21:12:49.138 INFO:tasks.workunit.client.1.smithi103.stdout:8/400: truncate d4/d26/d56/f62 2769850 0 2024-09-18T21:12:49.142 INFO:tasks.workunit.client.1.smithi103.stdout:6/402: dwrite d2/d24/f5f [0,4194304] 0 2024-09-18T21:12:49.143 INFO:tasks.workunit.client.0.smithi077.stdout:6/385: rename d7/df to d7/d7e 0 2024-09-18T21:12:49.144 INFO:tasks.workunit.client.1.smithi103.stdout:6/403: write d2/d24/f5f [1586432,71874] 0 2024-09-18T21:12:49.144 INFO:tasks.workunit.client.1.smithi103.stdout:3/366: dwrite d1/d23/f63 [0,4194304] 0 2024-09-18T21:12:49.146 INFO:tasks.workunit.client.1.smithi103.stdout:0/370: truncate d1/d5/de/d24/f32 1620101 0 2024-09-18T21:12:49.146 INFO:tasks.workunit.client.1.smithi103.stdout:3/367: write d1/d23/d25/f60 [826998,80491] 0 2024-09-18T21:12:49.148 INFO:tasks.workunit.client.0.smithi077.stdout:4/375: fdatasync d3/dc/d20/f3b 0 2024-09-18T21:12:49.151 INFO:tasks.workunit.client.0.smithi077.stdout:4/376: chown d3/dc/d24/l31 881820701 1 2024-09-18T21:12:49.152 INFO:tasks.workunit.client.1.smithi103.stdout:3/368: dwrite d1/f3c [0,4194304] 0 2024-09-18T21:12:49.153 INFO:tasks.workunit.client.0.smithi077.stdout:6/386: dread d7/d7e/d11/d1d/f44 [0,4194304] 0 2024-09-18T21:12:49.154 INFO:tasks.workunit.client.0.smithi077.stdout:4/377: write d3/d7/d42/f5d [1156008,113880] 0 2024-09-18T21:12:49.158 INFO:tasks.workunit.client.1.smithi103.stdout:5/405: unlink de/d2d/d7f/f47 0 2024-09-18T21:12:49.158 INFO:tasks.workunit.client.0.smithi077.stdout:8/324: dwrite d2/d5/d6/d22/d26/f60 [0,4194304] 0 2024-09-18T21:12:49.159 INFO:tasks.workunit.client.1.smithi103.stdout:5/406: write de/d1f/d3b/d51/d57/d59/f6e [2538789,58252] 0 2024-09-18T21:12:49.160 INFO:tasks.workunit.client.0.smithi077.stdout:7/424: rename d12/d31/d33/d2a/l5f to d12/d31/d33/l92 0 2024-09-18T21:12:49.163 INFO:tasks.workunit.client.1.smithi103.stdout:9/406: write d18/f3e [2037076,61080] 0 2024-09-18T21:12:49.166 INFO:tasks.workunit.client.1.smithi103.stdout:4/386: dwrite d9/d2e/f40 [0,4194304] 0 2024-09-18T21:12:49.167 INFO:tasks.workunit.client.1.smithi103.stdout:5/407: dwrite de/d14/d33/f5d [4194304,4194304] 0 2024-09-18T21:12:49.167 INFO:tasks.workunit.client.1.smithi103.stdout:5/408: dread - de/d3e/f2f zero size 2024-09-18T21:12:49.168 INFO:tasks.workunit.client.1.smithi103.stdout:5/409: chown de/d3e 1 1 2024-09-18T21:12:49.168 INFO:tasks.workunit.client.0.smithi077.stdout:8/325: fdatasync d2/d27/d29/f3f 0 2024-09-18T21:12:49.168 INFO:tasks.workunit.client.0.smithi077.stdout:5/513: dread d0/df/d10/f26 [0,4194304] 0 2024-09-18T21:12:49.170 INFO:tasks.workunit.client.0.smithi077.stdout:0/458: write d8/d37/f48 [3112599,91401] 0 2024-09-18T21:12:49.170 INFO:tasks.workunit.client.0.smithi077.stdout:1/374: rename d3/d8/d13/d18/l48 to d3/d8/d13/l8f 0 2024-09-18T21:12:49.172 INFO:tasks.workunit.client.0.smithi077.stdout:4/378: dwrite d3/d35/f56 [0,4194304] 0 2024-09-18T21:12:49.176 INFO:tasks.workunit.client.1.smithi103.stdout:5/410: dwrite fb [4194304,4194304] 0 2024-09-18T21:12:49.177 INFO:tasks.workunit.client.0.smithi077.stdout:6/387: dwrite d7/d7e/d11/d1d/f53 [0,4194304] 0 2024-09-18T21:12:49.181 INFO:tasks.workunit.client.0.smithi077.stdout:7/425: dread d12/d22/f28 [0,4194304] 0 2024-09-18T21:12:49.185 INFO:tasks.workunit.client.0.smithi077.stdout:8/326: mknod d2/d5/d6/d22/d4f/d5a/c71 0 2024-09-18T21:12:49.185 INFO:tasks.workunit.client.1.smithi103.stdout:2/326: getdents d3/d5/d2f/d32/d46 0 2024-09-18T21:12:49.187 INFO:tasks.workunit.client.0.smithi077.stdout:5/514: dwrite d0/df/f52 [0,4194304] 0 2024-09-18T21:12:49.188 INFO:tasks.workunit.client.1.smithi103.stdout:5/411: dwrite de/d1f/f24 [4194304,4194304] 0 2024-09-18T21:12:49.189 INFO:tasks.workunit.client.0.smithi077.stdout:5/515: write d0/df/d10/d5c/f72 [37523,107137] 0 2024-09-18T21:12:49.189 INFO:tasks.workunit.client.0.smithi077.stdout:4/379: read d3/f57 [100311,87932] 0 2024-09-18T21:12:49.190 INFO:tasks.workunit.client.0.smithi077.stdout:1/375: mknod d3/d1e/d7f/c90 0 2024-09-18T21:12:49.190 INFO:tasks.workunit.client.0.smithi077.stdout:4/380: chown d3/f5 1052676772 1 2024-09-18T21:12:49.191 INFO:tasks.workunit.client.1.smithi103.stdout:5/412: chown de/f77 12712081 1 2024-09-18T21:12:49.192 INFO:tasks.workunit.client.0.smithi077.stdout:5/516: read d0/d6/dd/f51 [990922,8033] 0 2024-09-18T21:12:49.195 INFO:tasks.workunit.client.1.smithi103.stdout:8/401: rmdir d4/de/d4a/d59/d5e 39 2024-09-18T21:12:49.196 INFO:tasks.workunit.client.0.smithi077.stdout:8/327: mkdir d2/d27/d29/d72 0 2024-09-18T21:12:49.198 INFO:tasks.workunit.client.1.smithi103.stdout:9/407: rmdir d18/d1f/d2f 39 2024-09-18T21:12:49.201 INFO:tasks.workunit.client.0.smithi077.stdout:9/237: sync 2024-09-18T21:12:49.202 INFO:tasks.workunit.client.0.smithi077.stdout:4/381: mkdir d3/dc/d24/d72 0 2024-09-18T21:12:49.203 INFO:tasks.workunit.client.1.smithi103.stdout:6/404: mkdir d2/d24/d38/d68/d7c 0 2024-09-18T21:12:49.204 INFO:tasks.workunit.client.0.smithi077.stdout:5/517: creat d0/d6/d3b/d64/fb2 x:0 0 0 2024-09-18T21:12:49.204 INFO:tasks.workunit.client.1.smithi103.stdout:8/402: dwrite d4/d2d/d3d/d42/f7c [0,4194304] 0 2024-09-18T21:12:49.206 INFO:tasks.workunit.client.1.smithi103.stdout:2/327: rmdir d3/d5/d2f/d32 39 2024-09-18T21:12:49.208 INFO:tasks.workunit.client.1.smithi103.stdout:5/413: unlink de/d2d/c30 0 2024-09-18T21:12:49.208 INFO:tasks.workunit.client.1.smithi103.stdout:5/414: readlink de/d3e/d15/l3d 0 2024-09-18T21:12:49.209 INFO:tasks.workunit.client.1.smithi103.stdout:3/369: mkdir d1/da/d7a 0 2024-09-18T21:12:49.212 INFO:tasks.workunit.client.0.smithi077.stdout:1/376: link d3/d8/d49/d4e/d50/f8d d3/d8/d13/d18/f91 0 2024-09-18T21:12:49.214 INFO:tasks.workunit.client.1.smithi103.stdout:0/371: creat d1/d5/de/f87 x:0 0 0 2024-09-18T21:12:49.214 INFO:tasks.workunit.client.0.smithi077.stdout:1/377: truncate d3/d8/d13/d18/f6c 884564 0 2024-09-18T21:12:49.215 INFO:tasks.workunit.client.0.smithi077.stdout:8/328: creat d2/d5/d6/d22/d4f/d5a/d2a/d67/f73 x:0 0 0 2024-09-18T21:12:49.217 INFO:tasks.workunit.client.1.smithi103.stdout:2/328: unlink d3/d5/d25/f29 0 2024-09-18T21:12:49.218 INFO:tasks.workunit.client.1.smithi103.stdout:3/370: fsync d1/d23/f2a 0 2024-09-18T21:12:49.218 INFO:tasks.workunit.client.0.smithi077.stdout:3/361: sync 2024-09-18T21:12:49.223 INFO:tasks.workunit.client.0.smithi077.stdout:1/378: dwrite d3/d1e/f5b [0,4194304] 0 2024-09-18T21:12:49.223 INFO:tasks.workunit.client.0.smithi077.stdout:7/426: rename d12/d31/d33 to d12/d31/d77/d93 0 2024-09-18T21:12:49.223 INFO:tasks.workunit.client.0.smithi077.stdout:8/329: dread f1 [0,4194304] 0 2024-09-18T21:12:49.230 INFO:tasks.workunit.client.0.smithi077.stdout:9/238: link d1/df/f12 d1/f48 0 2024-09-18T21:12:49.231 INFO:tasks.workunit.client.0.smithi077.stdout:5/518: getdents d0/d43 0 2024-09-18T21:12:49.233 INFO:tasks.workunit.client.0.smithi077.stdout:6/388: rename d7/d7e/d11/d25/f69 to d7/d7e/d11/d3e/f7f 0 2024-09-18T21:12:49.234 INFO:tasks.workunit.client.0.smithi077.stdout:2/462: sync 2024-09-18T21:12:49.235 INFO:tasks.workunit.client.0.smithi077.stdout:4/382: dread d3/f26 [0,4194304] 0 2024-09-18T21:12:49.235 INFO:tasks.workunit.client.0.smithi077.stdout:8/330: symlink d2/l74 0 2024-09-18T21:12:49.236 INFO:tasks.workunit.client.0.smithi077.stdout:7/427: mkdir d12/d31/d77/d93/d89/d94 0 2024-09-18T21:12:49.237 INFO:tasks.workunit.client.0.smithi077.stdout:1/379: truncate d3/f10 7949445 0 2024-09-18T21:12:49.239 INFO:tasks.workunit.client.0.smithi077.stdout:6/389: read d7/d7e/d11/d1d/f2e [1723572,9019] 0 2024-09-18T21:12:49.239 INFO:tasks.workunit.client.0.smithi077.stdout:1/380: write d3/d8/d49/d4e/d5a/f78 [534847,56275] 0 2024-09-18T21:12:49.239 INFO:tasks.workunit.client.0.smithi077.stdout:5/519: truncate d0/df/f25 486509 0 2024-09-18T21:12:49.241 INFO:tasks.workunit.client.0.smithi077.stdout:4/383: mkdir d3/d7/d73 0 2024-09-18T21:12:49.241 INFO:tasks.workunit.client.0.smithi077.stdout:5/520: dread - d0/df/d84/f90 zero size 2024-09-18T21:12:49.242 INFO:tasks.workunit.client.0.smithi077.stdout:9/239: creat d1/f49 x:0 0 0 2024-09-18T21:12:49.243 INFO:tasks.workunit.client.0.smithi077.stdout:5/521: dread - d0/d43/d6d/fa1 zero size 2024-09-18T21:12:49.243 INFO:tasks.workunit.client.0.smithi077.stdout:1/381: mkdir d3/d8/d75/d54/d92 0 2024-09-18T21:12:49.245 INFO:tasks.workunit.client.0.smithi077.stdout:2/463: creat d1/d4/d5/d1a/d2e/f97 x:0 0 0 2024-09-18T21:12:49.245 INFO:tasks.workunit.client.0.smithi077.stdout:1/382: chown d3/d8/d13/d18 235978 1 2024-09-18T21:12:49.246 INFO:tasks.workunit.client.0.smithi077.stdout:2/464: dread - d1/f92 zero size 2024-09-18T21:12:49.246 INFO:tasks.workunit.client.0.smithi077.stdout:7/428: mknod d12/d31/d77/d93/c95 0 2024-09-18T21:12:49.246 INFO:tasks.workunit.client.0.smithi077.stdout:9/240: symlink d1/dd/d11/d15/l4a 0 2024-09-18T21:12:49.248 INFO:tasks.workunit.client.0.smithi077.stdout:2/465: fdatasync d1/d4/d9/d80/d8e/d66/f8a 0 2024-09-18T21:12:49.248 INFO:tasks.workunit.client.0.smithi077.stdout:5/522: mknod d0/df/d10/cb3 0 2024-09-18T21:12:49.250 INFO:tasks.workunit.client.0.smithi077.stdout:6/390: getdents d7/d7e/d11/d1d/d49 0 2024-09-18T21:12:49.251 INFO:tasks.workunit.client.0.smithi077.stdout:7/429: creat d12/d31/d77/d93/d2a/d6c/f96 x:0 0 0 2024-09-18T21:12:49.252 INFO:tasks.workunit.client.0.smithi077.stdout:7/430: write d12/d22/d59/d72/f81 [371411,4961] 0 2024-09-18T21:12:49.253 INFO:tasks.workunit.client.0.smithi077.stdout:4/384: getdents d3/dc/d32/d45/d5e 0 2024-09-18T21:12:49.256 INFO:tasks.workunit.client.0.smithi077.stdout:7/431: symlink d12/d31/d77/l97 0 2024-09-18T21:12:49.258 INFO:tasks.workunit.client.0.smithi077.stdout:4/385: mknod d3/d7/d42/c74 0 2024-09-18T21:12:49.259 INFO:tasks.workunit.client.0.smithi077.stdout:6/391: symlink d7/d7e/d11/l80 0 2024-09-18T21:12:49.261 INFO:tasks.workunit.client.0.smithi077.stdout:4/386: symlink d3/dc/d20/l75 0 2024-09-18T21:12:49.262 INFO:tasks.workunit.client.0.smithi077.stdout:6/392: creat d7/d7e/d11/d25/f81 x:0 0 0 2024-09-18T21:12:49.264 INFO:tasks.workunit.client.0.smithi077.stdout:4/387: creat d3/f76 x:0 0 0 2024-09-18T21:12:49.264 INFO:tasks.workunit.client.0.smithi077.stdout:4/388: chown d3/dc/d20/f6a 537 1 2024-09-18T21:12:49.265 INFO:tasks.workunit.client.0.smithi077.stdout:6/393: mknod d7/d7e/d11/c82 0 2024-09-18T21:12:49.266 INFO:tasks.workunit.client.0.smithi077.stdout:4/389: truncate d3/fa 2243866 0 2024-09-18T21:12:49.269 INFO:tasks.workunit.client.1.smithi103.stdout:7/368: sync 2024-09-18T21:12:49.269 INFO:tasks.workunit.client.1.smithi103.stdout:1/385: sync 2024-09-18T21:12:49.273 INFO:tasks.workunit.client.1.smithi103.stdout:8/403: creat d4/d2d/d3d/d42/d71/f7e x:0 0 0 2024-09-18T21:12:49.274 INFO:tasks.workunit.client.1.smithi103.stdout:0/372: symlink d1/d9/d13/l88 0 2024-09-18T21:12:49.274 INFO:tasks.workunit.client.1.smithi103.stdout:7/369: fdatasync d1/df/d43/f6c 0 2024-09-18T21:12:49.275 INFO:tasks.workunit.client.1.smithi103.stdout:2/329: symlink d3/d5/d4a/l79 0 2024-09-18T21:12:49.276 INFO:tasks.workunit.client.0.smithi077.stdout:5/523: read d0/df/d10/d5c/f72 [300801,54194] 0 2024-09-18T21:12:49.277 INFO:tasks.workunit.client.1.smithi103.stdout:4/387: dread d9/d1c/d77/f3d [0,4194304] 0 2024-09-18T21:12:49.277 INFO:tasks.workunit.client.1.smithi103.stdout:9/408: dread f17 [0,4194304] 0 2024-09-18T21:12:49.278 INFO:tasks.workunit.client.0.smithi077.stdout:5/524: stat d0/d6/d3b/f4e 0 2024-09-18T21:12:49.279 INFO:tasks.workunit.client.1.smithi103.stdout:3/371: symlink d1/da/df/d70/l7b 0 2024-09-18T21:12:49.279 INFO:tasks.workunit.client.1.smithi103.stdout:7/370: truncate d1/df/d42/f26 4305176 0 2024-09-18T21:12:49.281 INFO:tasks.workunit.client.1.smithi103.stdout:2/330: truncate d3/f6e 79946 0 2024-09-18T21:12:49.281 INFO:tasks.workunit.client.1.smithi103.stdout:0/373: write d1/d5/de/d19/f7e [881757,100424] 0 2024-09-18T21:12:49.281 INFO:tasks.workunit.client.1.smithi103.stdout:5/415: getdents de/d14/d33 0 2024-09-18T21:12:49.282 INFO:tasks.workunit.client.0.smithi077.stdout:4/390: dread d3/dc/f1b [0,4194304] 0 2024-09-18T21:12:49.282 INFO:tasks.workunit.client.0.smithi077.stdout:3/362: dread db/d14/d32/f55 [4194304,4194304] 0 2024-09-18T21:12:49.283 INFO:tasks.workunit.client.0.smithi077.stdout:4/391: fdatasync d3/dc/d32/f48 0 2024-09-18T21:12:49.284 INFO:tasks.workunit.client.0.smithi077.stdout:3/363: write db/d14/f1d [2807385,32184] 0 2024-09-18T21:12:49.284 INFO:tasks.workunit.client.1.smithi103.stdout:7/371: write d1/f1c [3972927,106227] 0 2024-09-18T21:12:49.285 INFO:tasks.workunit.client.1.smithi103.stdout:2/331: write d3/d5/d25/f33 [142196,27692] 0 2024-09-18T21:12:49.285 INFO:tasks.workunit.client.0.smithi077.stdout:4/392: readlink d3/dc/d24/l4d 0 2024-09-18T21:12:49.288 INFO:tasks.workunit.client.1.smithi103.stdout:7/372: write d1/f4b [4330218,63654] 0 2024-09-18T21:12:49.289 INFO:tasks.workunit.client.1.smithi103.stdout:1/386: dwrite d0/d3/f29 [0,4194304] 0 2024-09-18T21:12:49.289 INFO:tasks.workunit.client.1.smithi103.stdout:2/332: dread - d3/d5/d2f/d48/f70 zero size 2024-09-18T21:12:49.293 INFO:tasks.workunit.client.0.smithi077.stdout:3/364: dwrite db/f35 [4194304,4194304] 0 2024-09-18T21:12:49.293 INFO:tasks.workunit.client.1.smithi103.stdout:3/372: dwrite d1/da/df/f14 [4194304,4194304] 0 2024-09-18T21:12:49.293 INFO:tasks.workunit.client.0.smithi077.stdout:8/331: dread d2/f19 [0,4194304] 0 2024-09-18T21:12:49.296 INFO:tasks.workunit.client.0.smithi077.stdout:4/393: rename d3/d17 to d3/d77 0 2024-09-18T21:12:49.299 INFO:tasks.workunit.client.0.smithi077.stdout:4/394: dread - d3/d35/f69 zero size 2024-09-18T21:12:49.301 INFO:tasks.workunit.client.0.smithi077.stdout:0/459: dwrite d8/d26/f15 [0,4194304] 0 2024-09-18T21:12:49.305 INFO:tasks.workunit.client.0.smithi077.stdout:5/525: getdents d0/d6/dd/d5d/d91 0 2024-09-18T21:12:49.305 INFO:tasks.workunit.client.0.smithi077.stdout:1/383: dread d3/d8/d49/f65 [0,4194304] 0 2024-09-18T21:12:49.305 INFO:tasks.workunit.client.0.smithi077.stdout:1/384: stat d3/d38/l7d 0 2024-09-18T21:12:49.312 INFO:tasks.workunit.client.1.smithi103.stdout:0/374: mknod d1/d9/d13/c89 0 2024-09-18T21:12:49.316 INFO:tasks.workunit.client.0.smithi077.stdout:1/385: dwrite d3/d1e/f5b [0,4194304] 0 2024-09-18T21:12:49.316 INFO:tasks.workunit.client.0.smithi077.stdout:8/332: creat d2/d5/d6/d22/d4f/d5a/d2a/d67/f75 x:0 0 0 2024-09-18T21:12:49.321 INFO:tasks.workunit.client.1.smithi103.stdout:4/388: link d9/d1f/f5c d9/d1a/d21/f88 0 2024-09-18T21:12:49.322 INFO:tasks.workunit.client.0.smithi077.stdout:5/526: dread d0/d6/dd/f19 [0,4194304] 0 2024-09-18T21:12:49.325 INFO:tasks.workunit.client.1.smithi103.stdout:1/387: stat d0/d2/d9/l45 0 2024-09-18T21:12:49.327 INFO:tasks.workunit.client.1.smithi103.stdout:4/389: dwrite d9/d1c/d77/f87 [0,4194304] 0 2024-09-18T21:12:49.328 INFO:tasks.workunit.client.0.smithi077.stdout:0/460: dwrite f5 [0,4194304] 0 2024-09-18T21:12:49.329 INFO:tasks.workunit.client.1.smithi103.stdout:4/390: chown d9/d1a/d2b/d48/f56 0 1 2024-09-18T21:12:49.331 INFO:tasks.workunit.client.1.smithi103.stdout:2/333: dread d3/d5/f18 [0,4194304] 0 2024-09-18T21:12:49.339 INFO:tasks.workunit.client.1.smithi103.stdout:4/391: dwrite d9/d38/f51 [0,4194304] 0 2024-09-18T21:12:49.339 INFO:tasks.workunit.client.1.smithi103.stdout:5/416: creat de/f81 x:0 0 0 2024-09-18T21:12:49.340 INFO:tasks.workunit.client.0.smithi077.stdout:1/386: mkdir d3/d8/d93 0 2024-09-18T21:12:49.342 INFO:tasks.workunit.client.1.smithi103.stdout:3/373: dwrite d1/da/f15 [4194304,4194304] 0 2024-09-18T21:12:49.343 INFO:tasks.workunit.client.1.smithi103.stdout:5/417: write de/d2d/d7f/f6b [904318,51810] 0 2024-09-18T21:12:49.345 INFO:tasks.workunit.client.0.smithi077.stdout:8/333: symlink d2/d5f/d6f/l76 0 2024-09-18T21:12:49.346 INFO:tasks.workunit.client.1.smithi103.stdout:7/373: mkdir d1/df/d42/d1f/d6b/d72 0 2024-09-18T21:12:49.346 INFO:tasks.workunit.client.0.smithi077.stdout:0/461: rename d8/d1a/d39/d3b/d79/f91 to d8/d1a/d39/d64/f93 0 2024-09-18T21:12:49.350 INFO:tasks.workunit.client.1.smithi103.stdout:8/404: getdents d4/d2d/d3d/d42/d65 0 2024-09-18T21:12:49.350 INFO:tasks.workunit.client.0.smithi077.stdout:0/462: dread - d8/d37/d66/d87/f90 zero size 2024-09-18T21:12:49.352 INFO:tasks.workunit.client.0.smithi077.stdout:7/432: write d12/d56/f3a [2334551,118258] 0 2024-09-18T21:12:49.353 INFO:tasks.workunit.client.1.smithi103.stdout:2/334: rename d3/d5/d4a/l79 to d3/d5/d25/d40/l7a 0 2024-09-18T21:12:49.357 INFO:tasks.workunit.client.0.smithi077.stdout:2/466: dwrite d1/d4/d5/d1a/d2e/f34 [0,4194304] 0 2024-09-18T21:12:49.357 INFO:tasks.workunit.client.0.smithi077.stdout:9/241: dwrite d1/df/f21 [0,4194304] 0 2024-09-18T21:12:49.359 INFO:tasks.workunit.client.0.smithi077.stdout:1/387: write d3/d1e/d68/f4a [419456,112505] 0 2024-09-18T21:12:49.359 INFO:tasks.workunit.client.1.smithi103.stdout:1/388: dread d0/d2/d2b/d85/f6b [0,4194304] 0 2024-09-18T21:12:49.361 INFO:tasks.workunit.client.0.smithi077.stdout:6/394: write d7/d7e/d11/d1d/f2e [2259141,110755] 0 2024-09-18T21:12:49.366 INFO:tasks.workunit.client.1.smithi103.stdout:8/405: chown d4/de/d4a/d59/d5e/c61 7493 1 2024-09-18T21:12:49.369 INFO:tasks.workunit.client.1.smithi103.stdout:2/335: creat d3/d5/d2c/d54/f7b x:0 0 0 2024-09-18T21:12:49.369 INFO:tasks.workunit.client.1.smithi103.stdout:4/392: symlink d9/d1a/l89 0 2024-09-18T21:12:49.372 INFO:tasks.workunit.client.1.smithi103.stdout:1/389: dread d0/d2/d9/dc/f28 [0,4194304] 0 2024-09-18T21:12:49.373 INFO:tasks.workunit.client.1.smithi103.stdout:3/374: unlink d1/d2/d18/d30/l4d 0 2024-09-18T21:12:49.375 INFO:tasks.workunit.client.1.smithi103.stdout:5/418: creat de/d14/d7e/f82 x:0 0 0 2024-09-18T21:12:49.375 INFO:tasks.workunit.client.1.smithi103.stdout:9/409: dwrite d18/d52/f85 [0,4194304] 0 2024-09-18T21:12:49.376 INFO:tasks.workunit.client.0.smithi077.stdout:3/365: dwrite db/f10 [0,4194304] 0 2024-09-18T21:12:49.377 INFO:tasks.workunit.client.1.smithi103.stdout:8/406: write d4/ff [2221120,47114] 0 2024-09-18T21:12:49.377 INFO:tasks.workunit.client.0.smithi077.stdout:3/366: stat db/d14/d22/d36/c44 0 2024-09-18T21:12:49.379 INFO:tasks.workunit.client.1.smithi103.stdout:0/375: write d1/d5/de/d19/d1e/d34/f69 [430494,28429] 0 2024-09-18T21:12:49.384 INFO:tasks.workunit.client.1.smithi103.stdout:1/390: mkdir d0/d11/d5f/d19/d70/d86 0 2024-09-18T21:12:49.385 INFO:tasks.workunit.client.1.smithi103.stdout:1/391: chown d0/d2/d9/dc/d36/l54 9299 1 2024-09-18T21:12:49.386 INFO:tasks.workunit.client.1.smithi103.stdout:1/392: stat d0/d3/f20 0 2024-09-18T21:12:49.387 INFO:tasks.workunit.client.1.smithi103.stdout:9/410: stat d18/d1f/l66 0 2024-09-18T21:12:49.388 INFO:tasks.workunit.client.1.smithi103.stdout:5/419: mkdir de/d1f/d3b/d58/d83 0 2024-09-18T21:12:49.393 INFO:tasks.workunit.client.0.smithi077.stdout:0/463: symlink d8/d1a/d39/d64/l94 0 2024-09-18T21:12:49.393 INFO:tasks.workunit.client.1.smithi103.stdout:4/393: dread d9/d1a/d21/f88 [0,4194304] 0 2024-09-18T21:12:49.394 INFO:tasks.workunit.client.1.smithi103.stdout:3/375: symlink d1/da/d7a/l7c 0 2024-09-18T21:12:49.394 INFO:tasks.workunit.client.0.smithi077.stdout:5/527: link d0/df/d10/l39 d0/df/d10/d5c/d9b/lb4 0 2024-09-18T21:12:49.394 INFO:tasks.workunit.client.1.smithi103.stdout:4/394: chown d9/d2e/c78 10551649 1 2024-09-18T21:12:49.395 INFO:tasks.workunit.client.1.smithi103.stdout:1/393: mkdir d0/d2/d2b/d3a/d42/d87 0 2024-09-18T21:12:49.395 INFO:tasks.workunit.client.1.smithi103.stdout:4/395: write f3 [8753515,35770] 0 2024-09-18T21:12:49.395 INFO:tasks.workunit.client.1.smithi103.stdout:1/394: fsync d0/d2/d9/d10/f67 0 2024-09-18T21:12:49.396 INFO:tasks.workunit.client.0.smithi077.stdout:7/433: creat d12/d22/d59/d72/f98 x:0 0 0 2024-09-18T21:12:49.397 INFO:tasks.workunit.client.1.smithi103.stdout:5/420: symlink de/d1f/d3b/l84 0 2024-09-18T21:12:49.397 INFO:tasks.workunit.client.1.smithi103.stdout:5/421: chown de/d3e/f12 104104 1 2024-09-18T21:12:49.401 INFO:tasks.workunit.client.1.smithi103.stdout:2/336: creat d3/d5/d2f/f7c x:0 0 0 2024-09-18T21:12:49.401 INFO:tasks.workunit.client.1.smithi103.stdout:2/337: readlink d3/l4 0 2024-09-18T21:12:49.402 INFO:tasks.workunit.client.0.smithi077.stdout:5/528: dwrite d0/df/d3d/d85/f96 [0,4194304] 0 2024-09-18T21:12:49.402 INFO:tasks.workunit.client.0.smithi077.stdout:6/395: mknod d7/d7e/d11/d1d/d50/c83 0 2024-09-18T21:12:49.407 INFO:tasks.workunit.client.1.smithi103.stdout:3/376: fdatasync d1/d2/d18/f29 0 2024-09-18T21:12:49.408 INFO:tasks.workunit.client.0.smithi077.stdout:8/334: symlink d2/d5/d6/l77 0 2024-09-18T21:12:49.409 INFO:tasks.workunit.client.0.smithi077.stdout:8/335: dread - d2/d36/f6a zero size 2024-09-18T21:12:49.411 INFO:tasks.workunit.client.0.smithi077.stdout:4/395: truncate d3/fa 736564 0 2024-09-18T21:12:49.412 INFO:tasks.workunit.client.1.smithi103.stdout:9/411: truncate fc 1811057 0 2024-09-18T21:12:49.413 INFO:tasks.workunit.client.1.smithi103.stdout:1/395: dread d0/d2/d9/d10/f25 [0,4194304] 0 2024-09-18T21:12:49.414 INFO:tasks.workunit.client.1.smithi103.stdout:5/422: rename de/d1f/d3b/d58/d83 to de/d3e/d85 0 2024-09-18T21:12:49.415 INFO:tasks.workunit.client.0.smithi077.stdout:9/242: mkdir d1/dd/d1a/d42/d4b 0 2024-09-18T21:12:49.417 INFO:tasks.workunit.client.0.smithi077.stdout:7/434: mkdir d12/d31/d77/d93/d89/d99 0 2024-09-18T21:12:49.420 INFO:tasks.workunit.client.0.smithi077.stdout:7/435: dread d12/d22/d59/d72/f81 [0,4194304] 0 2024-09-18T21:12:49.421 INFO:tasks.workunit.client.0.smithi077.stdout:2/467: mknod d1/d4/d5/d1a/d2e/d86/c98 0 2024-09-18T21:12:49.422 INFO:tasks.workunit.client.0.smithi077.stdout:2/468: chown d1/d4/f5f 1 1 2024-09-18T21:12:49.422 INFO:tasks.workunit.client.0.smithi077.stdout:5/529: creat d0/d6/d3b/fb5 x:0 0 0 2024-09-18T21:12:49.423 INFO:tasks.workunit.client.1.smithi103.stdout:4/396: symlink d9/d38/d72/d85/l8a 0 2024-09-18T21:12:49.425 INFO:tasks.workunit.client.0.smithi077.stdout:6/396: rename d7/fc to d7/d7e/d11/d1d/d49/f84 0 2024-09-18T21:12:49.426 INFO:tasks.workunit.client.1.smithi103.stdout:9/412: creat d18/d52/d6f/f8a x:0 0 0 2024-09-18T21:12:49.426 INFO:tasks.workunit.client.0.smithi077.stdout:1/388: write d3/d8/d13/d18/f83 [186170,115399] 0 2024-09-18T21:12:49.427 INFO:tasks.workunit.client.1.smithi103.stdout:4/397: dread d9/d1c/d77/f87 [0,4194304] 0 2024-09-18T21:12:49.427 INFO:tasks.workunit.client.0.smithi077.stdout:3/367: mknod db/d14/d72/c76 0 2024-09-18T21:12:49.428 INFO:tasks.workunit.client.1.smithi103.stdout:4/398: read d9/d1c/d77/f3d [1190716,897] 0 2024-09-18T21:12:49.428 INFO:tasks.workunit.client.0.smithi077.stdout:3/368: stat f5 0 2024-09-18T21:12:49.429 INFO:tasks.workunit.client.1.smithi103.stdout:1/396: creat d0/d2/d9/d10/d5d/f88 x:0 0 0 2024-09-18T21:12:49.430 INFO:tasks.workunit.client.1.smithi103.stdout:1/397: read - d0/d2/d9/d10/d5d/f79 zero size 2024-09-18T21:12:49.431 INFO:tasks.workunit.client.0.smithi077.stdout:4/396: creat d3/dc/d24/f78 x:0 0 0 2024-09-18T21:12:49.432 INFO:tasks.workunit.client.0.smithi077.stdout:5/530: dwrite d0/df/d3d/d85/f96 [0,4194304] 0 2024-09-18T21:12:49.434 INFO:tasks.workunit.client.0.smithi077.stdout:4/397: chown d3/dc/d24/f43 3239 1 2024-09-18T21:12:49.436 INFO:tasks.workunit.client.1.smithi103.stdout:8/407: getdents d4/de 0 2024-09-18T21:12:49.437 INFO:tasks.workunit.client.0.smithi077.stdout:0/464: mkdir d8/d37/d95 0 2024-09-18T21:12:49.437 INFO:tasks.workunit.client.1.smithi103.stdout:8/408: fsync d4/de/f3b 0 2024-09-18T21:12:49.438 INFO:tasks.workunit.client.0.smithi077.stdout:8/336: dwrite d2/d5/d6/f14 [0,4194304] 0 2024-09-18T21:12:49.440 INFO:tasks.workunit.client.0.smithi077.stdout:9/243: dread d1/dd/d11/f3e [0,4194304] 0 2024-09-18T21:12:49.440 INFO:tasks.workunit.client.1.smithi103.stdout:2/338: creat d3/d5/d2f/d32/f7d x:0 0 0 2024-09-18T21:12:49.441 INFO:tasks.workunit.client.0.smithi077.stdout:5/531: dwrite d0/df/d10/d4b/f60 [0,4194304] 0 2024-09-18T21:12:49.443 INFO:tasks.workunit.client.1.smithi103.stdout:0/376: getdents d1 0 2024-09-18T21:12:49.444 INFO:tasks.workunit.client.1.smithi103.stdout:3/377: mkdir d1/d64/d7d 0 2024-09-18T21:12:49.445 INFO:tasks.workunit.client.1.smithi103.stdout:6/405: sync 2024-09-18T21:12:49.450 INFO:tasks.workunit.client.1.smithi103.stdout:0/377: dread - d1/d5/f31 zero size 2024-09-18T21:12:49.452 INFO:tasks.workunit.client.1.smithi103.stdout:4/399: symlink d9/d1c/l8b 0 2024-09-18T21:12:49.452 INFO:tasks.workunit.client.1.smithi103.stdout:9/413: readlink d18/d1f/d2f/l51 0 2024-09-18T21:12:49.454 INFO:tasks.workunit.client.0.smithi077.stdout:3/369: creat db/d14/d32/d49/f77 x:0 0 0 2024-09-18T21:12:49.454 INFO:tasks.workunit.client.1.smithi103.stdout:5/423: fsync de/d2d/f69 0 2024-09-18T21:12:49.455 INFO:tasks.workunit.client.1.smithi103.stdout:8/409: dwrite d4/de/f11 [0,4194304] 0 2024-09-18T21:12:49.456 INFO:tasks.workunit.client.1.smithi103.stdout:1/398: dread d0/d2/d9/dc/f15 [0,4194304] 0 2024-09-18T21:12:49.461 INFO:tasks.workunit.client.0.smithi077.stdout:0/465: read d8/f2f [331864,6335] 0 2024-09-18T21:12:49.465 INFO:tasks.workunit.client.1.smithi103.stdout:4/400: dwrite f3 [8388608,4194304] 0 2024-09-18T21:12:49.469 INFO:tasks.workunit.client.1.smithi103.stdout:5/424: dwrite de/f81 [0,4194304] 0 2024-09-18T21:12:49.471 INFO:tasks.workunit.client.1.smithi103.stdout:8/410: dread d4/d2d/d3d/f5a [0,4194304] 0 2024-09-18T21:12:49.471 INFO:tasks.workunit.client.1.smithi103.stdout:0/378: dwrite d1/d5/de/d19/d1e/d34/f70 [0,4194304] 0 2024-09-18T21:12:49.472 INFO:tasks.workunit.client.1.smithi103.stdout:2/339: write d3/f22 [1588378,122711] 0 2024-09-18T21:12:49.472 INFO:tasks.workunit.client.0.smithi077.stdout:1/389: dwrite d3/d8/d49/d4e/f57 [0,4194304] 0 2024-09-18T21:12:49.473 INFO:tasks.workunit.client.0.smithi077.stdout:1/390: chown d3/d8/d13/d18/f6c 58086676 1 2024-09-18T21:12:49.475 INFO:tasks.workunit.client.0.smithi077.stdout:6/397: link d7/d7e/d11/d3e/f76 d7/d7e/d11/d25/f85 0 2024-09-18T21:12:49.476 INFO:tasks.workunit.client.1.smithi103.stdout:0/379: fsync d1/d5/fc 0 2024-09-18T21:12:49.476 INFO:tasks.workunit.client.0.smithi077.stdout:4/398: creat d3/d7/d73/f79 x:0 0 0 2024-09-18T21:12:49.479 INFO:tasks.workunit.client.1.smithi103.stdout:6/406: rmdir d2/d24/d5a/d67/d76/d43/d44 39 2024-09-18T21:12:49.480 INFO:tasks.workunit.client.0.smithi077.stdout:8/337: unlink d2/c1d 0 2024-09-18T21:12:49.481 INFO:tasks.workunit.client.1.smithi103.stdout:5/425: truncate de/d2d/d7f/f4c 370562 0 2024-09-18T21:12:49.482 INFO:tasks.workunit.client.1.smithi103.stdout:4/401: dwrite d9/d38/f7a [0,4194304] 0 2024-09-18T21:12:49.482 INFO:tasks.workunit.client.0.smithi077.stdout:8/338: dread - d2/d5/d6/d22/d4f/f69 zero size 2024-09-18T21:12:49.482 INFO:tasks.workunit.client.1.smithi103.stdout:4/402: fdatasync d9/d1a/f55 0 2024-09-18T21:12:49.483 INFO:tasks.workunit.client.0.smithi077.stdout:9/244: rename d1/df/c3d to d1/dd/d11/d15/c4c 0 2024-09-18T21:12:49.487 INFO:tasks.workunit.client.0.smithi077.stdout:8/339: dread d2/d27/d29/f61 [0,4194304] 0 2024-09-18T21:12:49.488 INFO:tasks.workunit.client.0.smithi077.stdout:5/532: mkdir d0/df/d10/d47/db6 0 2024-09-18T21:12:49.488 INFO:tasks.workunit.client.1.smithi103.stdout:3/378: mkdir d1/d23/d25/d4f/d72/d7e 0 2024-09-18T21:12:49.489 INFO:tasks.workunit.client.0.smithi077.stdout:8/340: dread - d2/d5/d6/d22/d4f/f5d zero size 2024-09-18T21:12:49.490 INFO:tasks.workunit.client.0.smithi077.stdout:7/436: rename d12/f26 to d12/f9a 0 2024-09-18T21:12:49.493 INFO:tasks.workunit.client.0.smithi077.stdout:1/391: truncate d3/d8/d13/d18/f4d 1476760 0 2024-09-18T21:12:49.493 INFO:tasks.workunit.client.0.smithi077.stdout:6/398: fdatasync d7/d7e/d11/d3e/d42/f72 0 2024-09-18T21:12:49.494 INFO:tasks.workunit.client.1.smithi103.stdout:7/374: sync 2024-09-18T21:12:49.494 INFO:tasks.workunit.client.0.smithi077.stdout:1/392: write d3/d1e/d68/d3e/f73 [1097335,121993] 0 2024-09-18T21:12:49.494 INFO:tasks.workunit.client.0.smithi077.stdout:4/399: creat d3/d77/f7a x:0 0 0 2024-09-18T21:12:49.494 INFO:tasks.workunit.client.1.smithi103.stdout:2/340: mknod d3/d5/d2f/d32/d46/c7e 0 2024-09-18T21:12:49.495 INFO:tasks.workunit.client.1.smithi103.stdout:2/341: fdatasync d3/d5/d2f/f7c 0 2024-09-18T21:12:49.495 INFO:tasks.workunit.client.1.smithi103.stdout:8/411: mkdir d4/d2d/d3d/d42/d71/d7f 0 2024-09-18T21:12:49.496 INFO:tasks.workunit.client.0.smithi077.stdout:1/393: write d3/d8/d13/d18/f64 [118286,32464] 0 2024-09-18T21:12:49.496 INFO:tasks.workunit.client.0.smithi077.stdout:6/399: truncate d7/d7e/d11/d3e/f65 1021212 0 2024-09-18T21:12:49.496 INFO:tasks.workunit.client.1.smithi103.stdout:8/412: fdatasync d4/d2d/d3d/d42/d65/d39/f4f 0 2024-09-18T21:12:49.498 INFO:tasks.workunit.client.0.smithi077.stdout:1/394: fdatasync d3/d8/d13/f26 0 2024-09-18T21:12:49.501 INFO:tasks.workunit.client.0.smithi077.stdout:2/469: getdents d1/d4/d9/d80/d95 0 2024-09-18T21:12:49.502 INFO:tasks.workunit.client.1.smithi103.stdout:4/403: chown d9/d1a/d21/c75 523822093 1 2024-09-18T21:12:49.503 INFO:tasks.workunit.client.0.smithi077.stdout:8/341: creat d2/d36/f78 x:0 0 0 2024-09-18T21:12:49.503 INFO:tasks.workunit.client.0.smithi077.stdout:1/395: read d3/d8/d13/f26 [2145264,97749] 0 2024-09-18T21:12:49.505 INFO:tasks.workunit.client.1.smithi103.stdout:2/342: symlink d3/d5/d25/d40/l7f 0 2024-09-18T21:12:49.505 INFO:tasks.workunit.client.0.smithi077.stdout:3/370: creat db/d14/d32/d4f/d71/f78 x:0 0 0 2024-09-18T21:12:49.507 INFO:tasks.workunit.client.1.smithi103.stdout:5/426: dwrite de/d1f/d3b/d51/d57/d59/f5c [0,4194304] 0 2024-09-18T21:12:49.507 INFO:tasks.workunit.client.0.smithi077.stdout:0/466: creat d8/d26/f96 x:0 0 0 2024-09-18T21:12:49.509 INFO:tasks.workunit.client.0.smithi077.stdout:6/400: creat d7/d7e/d11/d1d/d4c/f86 x:0 0 0 2024-09-18T21:12:49.509 INFO:tasks.workunit.client.1.smithi103.stdout:6/407: mkdir d2/d3/d8/d4c/d7d 0 2024-09-18T21:12:49.511 INFO:tasks.workunit.client.1.smithi103.stdout:1/399: dread d0/d2/d9/f59 [0,4194304] 0 2024-09-18T21:12:49.513 INFO:tasks.workunit.client.0.smithi077.stdout:9/245: unlink d1/df/f18 0 2024-09-18T21:12:49.514 INFO:tasks.workunit.client.0.smithi077.stdout:5/533: fsync d0/d6/d3b/f7e 0 2024-09-18T21:12:49.516 INFO:tasks.workunit.client.1.smithi103.stdout:4/404: rmdir d9/d1a 39 2024-09-18T21:12:49.518 INFO:tasks.workunit.client.0.smithi077.stdout:2/470: creat d1/d4/d5/d1a/d2e/d40/f99 x:0 0 0 2024-09-18T21:12:49.520 INFO:tasks.workunit.client.1.smithi103.stdout:2/343: mknod d3/d5/d2c/d54/c80 0 2024-09-18T21:12:49.523 INFO:tasks.workunit.client.0.smithi077.stdout:9/246: dwrite d1/dd/d11/d2d/f32 [0,4194304] 0 2024-09-18T21:12:49.524 INFO:tasks.workunit.client.0.smithi077.stdout:3/371: creat db/d14/d32/d49/d4e/f79 x:0 0 0 2024-09-18T21:12:49.525 INFO:tasks.workunit.client.1.smithi103.stdout:8/413: truncate d4/d26/f4d 3301791 0 2024-09-18T21:12:49.526 INFO:tasks.workunit.client.0.smithi077.stdout:0/467: unlink d8/d1d/d57/f78 0 2024-09-18T21:12:49.527 INFO:tasks.workunit.client.0.smithi077.stdout:0/468: fdatasync d8/d1d/f55 0 2024-09-18T21:12:49.528 INFO:tasks.workunit.client.0.smithi077.stdout:6/401: mknod d7/d7e/d11/d1d/d50/c87 0 2024-09-18T21:12:49.529 INFO:tasks.workunit.client.0.smithi077.stdout:4/400: dread d3/dc/d32/f48 [0,4194304] 0 2024-09-18T21:12:49.530 INFO:tasks.workunit.client.0.smithi077.stdout:4/401: stat d3/d77 0 2024-09-18T21:12:49.531 INFO:tasks.workunit.client.0.smithi077.stdout:4/402: write d3/dc/d20/f27 [867418,101051] 0 2024-09-18T21:12:49.536 INFO:tasks.workunit.client.1.smithi103.stdout:2/344: mknod d3/d5/d2f/d32/d46/c81 0 2024-09-18T21:12:49.537 INFO:tasks.workunit.client.1.smithi103.stdout:9/414: truncate f1 24656 0 2024-09-18T21:12:49.538 INFO:tasks.workunit.client.1.smithi103.stdout:8/414: creat d4/de/f80 x:0 0 0 2024-09-18T21:12:49.541 INFO:tasks.workunit.client.1.smithi103.stdout:0/380: truncate d1/d9/d13/f37 2449116 0 2024-09-18T21:12:49.543 INFO:tasks.workunit.client.1.smithi103.stdout:5/427: link fb de/d1f/f86 0 2024-09-18T21:12:49.543 INFO:tasks.workunit.client.1.smithi103.stdout:5/428: write de/d14/d33/f7c [613732,18825] 0 2024-09-18T21:12:49.544 INFO:tasks.workunit.client.0.smithi077.stdout:8/342: truncate d2/d5/d6/d22/d18/f4c 3970785 0 2024-09-18T21:12:49.547 INFO:tasks.workunit.client.1.smithi103.stdout:1/400: rename d0/d2/d9/d10/c77 to d0/d2/d9/d10/d5d/c89 0 2024-09-18T21:12:49.549 INFO:tasks.workunit.client.1.smithi103.stdout:7/375: getdents d1/df 0 2024-09-18T21:12:49.550 INFO:tasks.workunit.client.0.smithi077.stdout:0/469: creat d8/d1d/d80/f97 x:0 0 0 2024-09-18T21:12:49.550 INFO:tasks.workunit.client.0.smithi077.stdout:7/437: write fb [584536,36384] 0 2024-09-18T21:12:49.550 INFO:tasks.workunit.client.1.smithi103.stdout:9/415: creat d18/d52/f8b x:0 0 0 2024-09-18T21:12:49.551 INFO:tasks.workunit.client.0.smithi077.stdout:0/470: read d8/f2f [143528,4950] 0 2024-09-18T21:12:49.552 INFO:tasks.workunit.client.0.smithi077.stdout:6/402: mkdir d7/d7e/d11/d3e/d42/d88 0 2024-09-18T21:12:49.554 INFO:tasks.workunit.client.1.smithi103.stdout:9/416: dread d18/d29/f5b [0,4194304] 0 2024-09-18T21:12:49.556 INFO:tasks.workunit.client.0.smithi077.stdout:7/438: dwrite d12/d22/d59/d5a/f69 [0,4194304] 0 2024-09-18T21:12:49.557 INFO:tasks.workunit.client.1.smithi103.stdout:2/345: rename d3/l4 to d3/d5/d2f/d48/l82 0 2024-09-18T21:12:49.558 INFO:tasks.workunit.client.0.smithi077.stdout:1/396: rmdir d3/d8/d75/d54/d92 0 2024-09-18T21:12:49.558 INFO:tasks.workunit.client.1.smithi103.stdout:2/346: fdatasync d3/d5/d2f/f7c 0 2024-09-18T21:12:49.558 INFO:tasks.workunit.client.1.smithi103.stdout:0/381: dwrite d1/d9/f2b [0,4194304] 0 2024-09-18T21:12:49.559 INFO:tasks.workunit.client.0.smithi077.stdout:1/397: write d3/d8/d75/f61 [1755274,66637] 0 2024-09-18T21:12:49.561 INFO:tasks.workunit.client.0.smithi077.stdout:1/398: write d3/d8/d13/d18/f46 [1080301,126284] 0 2024-09-18T21:12:49.561 INFO:tasks.workunit.client.0.smithi077.stdout:1/399: stat d3/f23 0 2024-09-18T21:12:49.562 INFO:tasks.workunit.client.1.smithi103.stdout:3/379: fsync d1/f24 0 2024-09-18T21:12:49.563 INFO:tasks.workunit.client.0.smithi077.stdout:9/247: mknod d1/dd/d1a/d42/d4b/c4d 0 2024-09-18T21:12:49.570 INFO:tasks.workunit.client.0.smithi077.stdout:4/403: getdents d3/dc/d32/d45/d5e 0 2024-09-18T21:12:49.571 INFO:tasks.workunit.client.0.smithi077.stdout:9/248: dwrite d1/f16 [4194304,4194304] 0 2024-09-18T21:12:49.573 INFO:tasks.workunit.client.0.smithi077.stdout:9/249: write d1/df/f44 [1621316,35482] 0 2024-09-18T21:12:49.574 INFO:tasks.workunit.client.0.smithi077.stdout:7/439: creat d12/d22/d59/d72/f9b x:0 0 0 2024-09-18T21:12:49.577 INFO:tasks.workunit.client.1.smithi103.stdout:3/380: dread - d1/da/df/f77 zero size 2024-09-18T21:12:49.580 INFO:tasks.workunit.client.1.smithi103.stdout:0/382: dwrite d1/d5/de/d22/f5b [0,4194304] 0 2024-09-18T21:12:49.582 INFO:tasks.workunit.client.0.smithi077.stdout:1/400: mknod d3/d1e/c94 0 2024-09-18T21:12:49.583 INFO:tasks.workunit.client.1.smithi103.stdout:0/383: dread - d1/d5/de/d24/f61 zero size 2024-09-18T21:12:49.584 INFO:tasks.workunit.client.1.smithi103.stdout:0/384: chown d1/d9/d13/c6b 4 1 2024-09-18T21:12:49.584 INFO:tasks.workunit.client.1.smithi103.stdout:7/376: symlink d1/df/d42/d1f/d2e/l73 0 2024-09-18T21:12:49.585 INFO:tasks.workunit.client.0.smithi077.stdout:0/471: symlink d8/d37/d95/l98 0 2024-09-18T21:12:49.586 INFO:tasks.workunit.client.1.smithi103.stdout:7/377: write d1/fe [1466232,85652] 0 2024-09-18T21:12:49.587 INFO:tasks.workunit.client.0.smithi077.stdout:5/534: getdents d0 0 2024-09-18T21:12:49.590 INFO:tasks.workunit.client.0.smithi077.stdout:9/250: mknod d1/dd/d1a/d42/c4e 0 2024-09-18T21:12:49.591 INFO:tasks.workunit.client.1.smithi103.stdout:4/405: link d9/d1c/c2f d9/d1a/c8c 0 2024-09-18T21:12:49.591 INFO:tasks.workunit.client.1.smithi103.stdout:6/408: dwrite d2/d3/d8/f62 [0,4194304] 0 2024-09-18T21:12:49.592 INFO:tasks.workunit.client.1.smithi103.stdout:3/381: read d1/d2/d18/f29 [5355300,100399] 0 2024-09-18T21:12:49.593 INFO:tasks.workunit.client.1.smithi103.stdout:3/382: fsync d1/d2/f3e 0 2024-09-18T21:12:49.594 INFO:tasks.workunit.client.0.smithi077.stdout:2/471: getdents d1/d4/d5/d1a/d2e/d86 0 2024-09-18T21:12:49.594 INFO:tasks.workunit.client.0.smithi077.stdout:4/404: dread d3/fa [0,4194304] 0 2024-09-18T21:12:49.597 INFO:tasks.workunit.client.1.smithi103.stdout:5/429: getdents de/d14/d7e 0 2024-09-18T21:12:49.601 INFO:tasks.workunit.client.0.smithi077.stdout:0/472: fdatasync d8/d1a/d39/d3b/d4e/f8c 0 2024-09-18T21:12:49.604 INFO:tasks.workunit.client.1.smithi103.stdout:8/415: rename d4/d2d/d3d/d42 to d4/d81 0 2024-09-18T21:12:49.605 INFO:tasks.workunit.client.1.smithi103.stdout:5/430: dwrite de/f36 [0,4194304] 0 2024-09-18T21:12:49.608 INFO:tasks.workunit.client.0.smithi077.stdout:4/405: mkdir d3/d7/d7b 0 2024-09-18T21:12:49.608 INFO:tasks.workunit.client.1.smithi103.stdout:7/378: symlink d1/df/l74 0 2024-09-18T21:12:49.609 INFO:tasks.workunit.client.0.smithi077.stdout:9/251: read d1/dd/f14 [7373818,117596] 0 2024-09-18T21:12:49.612 INFO:tasks.workunit.client.1.smithi103.stdout:1/401: write d0/d11/d5f/d19/f34 [1155130,75130] 0 2024-09-18T21:12:49.613 INFO:tasks.workunit.client.0.smithi077.stdout:0/473: readlink d8/d1d/l49 0 2024-09-18T21:12:49.616 INFO:tasks.workunit.client.1.smithi103.stdout:1/402: dread d0/d3/f29 [0,4194304] 0 2024-09-18T21:12:49.617 INFO:tasks.workunit.client.0.smithi077.stdout:4/406: creat d3/d7/f7c x:0 0 0 2024-09-18T21:12:49.617 INFO:tasks.workunit.client.1.smithi103.stdout:1/403: dread - d0/d3/f66 zero size 2024-09-18T21:12:49.617 INFO:tasks.workunit.client.0.smithi077.stdout:4/407: stat d3/d7/f4f 0 2024-09-18T21:12:49.618 INFO:tasks.workunit.client.1.smithi103.stdout:3/383: unlink d1/d2/d18/l28 0 2024-09-18T21:12:49.621 INFO:tasks.workunit.client.1.smithi103.stdout:3/384: dread d1/d2/f8 [0,4194304] 0 2024-09-18T21:12:49.621 INFO:tasks.workunit.client.1.smithi103.stdout:0/385: mknod d1/d5/de/d24/d43/d81/c8a 0 2024-09-18T21:12:49.622 INFO:tasks.workunit.client.0.smithi077.stdout:9/252: mknod d1/dd/d11/d1c/d38/d46/c4f 0 2024-09-18T21:12:49.623 INFO:tasks.workunit.client.0.smithi077.stdout:9/253: chown d1/dd/d1a/d42/d4b 21732 1 2024-09-18T21:12:49.623 INFO:tasks.workunit.client.0.smithi077.stdout:7/440: link d12/l17 d12/d22/d59/d5d/l9c 0 2024-09-18T21:12:49.625 INFO:tasks.workunit.client.1.smithi103.stdout:5/431: creat de/d2d/d7f/f87 x:0 0 0 2024-09-18T21:12:49.626 INFO:tasks.workunit.client.0.smithi077.stdout:9/254: rmdir d1/dd/d11/d1c 39 2024-09-18T21:12:49.627 INFO:tasks.workunit.client.1.smithi103.stdout:2/347: getdents d3/d5/d2f/d32/d46 0 2024-09-18T21:12:49.628 INFO:tasks.workunit.client.0.smithi077.stdout:9/255: read d1/df/f44 [623121,113513] 0 2024-09-18T21:12:49.631 INFO:tasks.workunit.client.0.smithi077.stdout:1/401: dread d3/d8/d13/d18/f4d [0,4194304] 0 2024-09-18T21:12:49.633 INFO:tasks.workunit.client.0.smithi077.stdout:9/256: stat d1/f48 0 2024-09-18T21:12:49.635 INFO:tasks.workunit.client.1.smithi103.stdout:6/409: write d2/d24/d5a/d67/d76/d43/d44/f6e [4979562,102597] 0 2024-09-18T21:12:49.637 INFO:tasks.workunit.client.0.smithi077.stdout:7/441: link d12/d31/d77/d93/c2c d12/d31/d77/d93/d89/c9d 0 2024-09-18T21:12:49.639 INFO:tasks.workunit.client.1.smithi103.stdout:4/406: dwrite d9/d1a/f1e [0,4194304] 0 2024-09-18T21:12:49.640 INFO:tasks.workunit.client.0.smithi077.stdout:9/257: write d1/dd/d11/d1c/f31 [1372230,104272] 0 2024-09-18T21:12:49.641 INFO:tasks.workunit.client.1.smithi103.stdout:8/416: symlink d4/d2d/d3d/l82 0 2024-09-18T21:12:49.643 INFO:tasks.workunit.client.0.smithi077.stdout:7/442: mknod d12/d31/d77/c9e 0 2024-09-18T21:12:49.644 INFO:tasks.workunit.client.0.smithi077.stdout:7/443: chown d12/d22/d59/d5d 1 1 2024-09-18T21:12:49.645 INFO:tasks.workunit.client.1.smithi103.stdout:6/410: dwrite d2/d3/f48 [0,4194304] 0 2024-09-18T21:12:49.645 INFO:tasks.workunit.client.0.smithi077.stdout:7/444: write d12/d31/d77/d93/d2a/d6c/f96 [337031,31853] 0 2024-09-18T21:12:49.645 INFO:tasks.workunit.client.0.smithi077.stdout:9/258: rmdir d1/dd/d1a/d42/d4b 39 2024-09-18T21:12:49.646 INFO:tasks.workunit.client.0.smithi077.stdout:9/259: fsync d1/dd/d11/d1c/d38/f41 0 2024-09-18T21:12:49.648 INFO:tasks.workunit.client.0.smithi077.stdout:9/260: read d1/dd/d1a/f1b [2751885,86918] 0 2024-09-18T21:12:49.648 INFO:tasks.workunit.client.0.smithi077.stdout:1/402: mknod d3/d1e/d68/d3e/c95 0 2024-09-18T21:12:49.648 INFO:tasks.workunit.client.0.smithi077.stdout:9/261: chown d1/df 4527982 1 2024-09-18T21:12:49.649 INFO:tasks.workunit.client.0.smithi077.stdout:9/262: write d1/f49 [709900,26311] 0 2024-09-18T21:12:49.651 INFO:tasks.workunit.client.0.smithi077.stdout:9/263: write d1/dd/d11/d1c/f25 [517697,127006] 0 2024-09-18T21:12:49.653 INFO:tasks.workunit.client.0.smithi077.stdout:7/445: link d12/d22/d59/d5d/d62/f6d d12/d31/d77/d93/d2a/f9f 0 2024-09-18T21:12:49.653 INFO:tasks.workunit.client.1.smithi103.stdout:3/385: mknod d1/d23/d25/d4f/d58/d68/d50/d54/c7f 0 2024-09-18T21:12:49.654 INFO:tasks.workunit.client.1.smithi103.stdout:7/379: dwrite d1/df/d42/d1f/f5e [0,4194304] 0 2024-09-18T21:12:49.654 INFO:tasks.workunit.client.0.smithi077.stdout:7/446: write d12/d22/d59/d5a/f8a [145147,8335] 0 2024-09-18T21:12:49.655 INFO:tasks.workunit.client.1.smithi103.stdout:0/386: truncate d1/d5/de/d22/d42/f51 974600 0 2024-09-18T21:12:49.655 INFO:tasks.workunit.client.0.smithi077.stdout:9/264: creat d1/dd/d11/d15/f50 x:0 0 0 2024-09-18T21:12:49.657 INFO:tasks.workunit.client.1.smithi103.stdout:4/407: write d9/d1c/f42 [2326296,112737] 0 2024-09-18T21:12:49.658 INFO:tasks.workunit.client.1.smithi103.stdout:2/348: symlink d3/d5/d2f/l83 0 2024-09-18T21:12:49.661 INFO:tasks.workunit.client.0.smithi077.stdout:9/265: mkdir d1/df/d51 0 2024-09-18T21:12:49.662 INFO:tasks.workunit.client.0.smithi077.stdout:9/266: stat d1/df/d27/l2e 0 2024-09-18T21:12:49.663 INFO:tasks.workunit.client.1.smithi103.stdout:0/387: chown d1/d9/d3e/c59 107087 1 2024-09-18T21:12:49.663 INFO:tasks.workunit.client.1.smithi103.stdout:0/388: chown d1/d5/de 6807611 1 2024-09-18T21:12:49.665 INFO:tasks.workunit.client.1.smithi103.stdout:3/386: creat d1/d23/d25/d4f/d58/d68/d50/f80 x:0 0 0 2024-09-18T21:12:49.667 INFO:tasks.workunit.client.0.smithi077.stdout:9/267: unlink d1/dd/d1a/d42/c4e 0 2024-09-18T21:12:49.669 INFO:tasks.workunit.client.1.smithi103.stdout:4/408: unlink d9/d2e/f40 0 2024-09-18T21:12:49.672 INFO:tasks.workunit.client.1.smithi103.stdout:2/349: creat d3/d5/d2c/d54/d68/f84 x:0 0 0 2024-09-18T21:12:49.672 INFO:tasks.workunit.client.1.smithi103.stdout:2/350: dread - d3/d5/f57 zero size 2024-09-18T21:12:49.673 INFO:tasks.workunit.client.0.smithi077.stdout:9/268: symlink d1/dd/d1a/d42/d4b/l52 0 2024-09-18T21:12:49.674 INFO:tasks.workunit.client.1.smithi103.stdout:1/404: truncate d0/d2/d9/d10/f44 3660275 0 2024-09-18T21:12:49.676 INFO:tasks.workunit.client.1.smithi103.stdout:5/432: getdents de/d1f/d3b 0 2024-09-18T21:12:49.680 INFO:tasks.workunit.client.1.smithi103.stdout:2/351: dwrite d3/d5/d25/f37 [0,4194304] 0 2024-09-18T21:12:49.682 INFO:tasks.workunit.client.1.smithi103.stdout:7/380: creat d1/df/d43/d52/f75 x:0 0 0 2024-09-18T21:12:49.683 INFO:tasks.workunit.client.0.smithi077.stdout:7/447: dread d12/f9a [0,4194304] 0 2024-09-18T21:12:49.683 INFO:tasks.workunit.client.0.smithi077.stdout:9/269: dwrite d1/dd/d11/f3e [0,4194304] 0 2024-09-18T21:12:49.685 INFO:tasks.workunit.client.1.smithi103.stdout:0/389: link d1/d9/f2b d1/d5/de/d24/d43/f8b 0 2024-09-18T21:12:49.686 INFO:tasks.workunit.client.0.smithi077.stdout:1/403: truncate d3/d8/d13/d18/f6c 227638 0 2024-09-18T21:12:49.688 INFO:tasks.workunit.client.1.smithi103.stdout:1/405: creat d0/d2/d9/d10/d5d/f8a x:0 0 0 2024-09-18T21:12:49.690 INFO:tasks.workunit.client.1.smithi103.stdout:3/387: dread d1/d23/d25/d4f/d58/d68/f36 [0,4194304] 0 2024-09-18T21:12:49.691 INFO:tasks.workunit.client.0.smithi077.stdout:7/448: mkdir d12/d31/d77/da0 0 2024-09-18T21:12:49.692 INFO:tasks.workunit.client.0.smithi077.stdout:7/449: write d12/d22/d59/d72/d68/f75 [4002316,25703] 0 2024-09-18T21:12:49.693 INFO:tasks.workunit.client.0.smithi077.stdout:9/270: creat d1/dd/d11/d1c/f53 x:0 0 0 2024-09-18T21:12:49.694 INFO:tasks.workunit.client.0.smithi077.stdout:7/450: read d12/d31/f83 [259937,65440] 0 2024-09-18T21:12:49.695 INFO:tasks.workunit.client.1.smithi103.stdout:8/417: getdents d4/d2d/d3d 0 2024-09-18T21:12:49.699 INFO:tasks.workunit.client.1.smithi103.stdout:6/411: getdents d2/d3/d8/d4c/d4e 0 2024-09-18T21:12:49.699 INFO:tasks.workunit.client.1.smithi103.stdout:0/390: rename d1/d5/de/d22/d42/d80 to d1/d56/d8c 0 2024-09-18T21:12:49.702 INFO:tasks.workunit.client.1.smithi103.stdout:0/391: write d1/d5/de/d19/d1e/d34/f70 [2500232,83700] 0 2024-09-18T21:12:49.702 INFO:tasks.workunit.client.1.smithi103.stdout:1/406: chown d0/d2/d9/d10/d5d/c89 2113 1 2024-09-18T21:12:49.702 INFO:tasks.workunit.client.1.smithi103.stdout:1/407: stat d0/d2/d9/d10/f67 0 2024-09-18T21:12:49.703 INFO:tasks.workunit.client.0.smithi077.stdout:1/404: creat d3/d5f/f96 x:0 0 0 2024-09-18T21:12:49.703 INFO:tasks.workunit.client.1.smithi103.stdout:1/408: chown d0/d2/l55 0 1 2024-09-18T21:12:49.705 INFO:tasks.workunit.client.1.smithi103.stdout:1/409: truncate d0/d2/d2b/d85/f7f 559269 0 2024-09-18T21:12:49.705 INFO:tasks.workunit.client.1.smithi103.stdout:8/418: write d4/de/f1c [1841369,36940] 0 2024-09-18T21:12:49.706 INFO:tasks.workunit.client.0.smithi077.stdout:7/451: fsync d12/d22/d59/d72/f81 0 2024-09-18T21:12:49.707 INFO:tasks.workunit.client.1.smithi103.stdout:6/412: rmdir d2/d24 39 2024-09-18T21:12:49.708 INFO:tasks.workunit.client.0.smithi077.stdout:9/271: getdents d1/df/d51 0 2024-09-18T21:12:49.709 INFO:tasks.workunit.client.0.smithi077.stdout:1/405: fdatasync d3/d8/f17 0 2024-09-18T21:12:49.712 INFO:tasks.workunit.client.0.smithi077.stdout:7/452: unlink d12/d22/d59/l5b 0 2024-09-18T21:12:49.712 INFO:tasks.workunit.client.0.smithi077.stdout:7/453: chown d12/f78 2723135 1 2024-09-18T21:12:49.714 INFO:tasks.workunit.client.0.smithi077.stdout:7/454: rmdir d12/d31/d77/d93/d2a 39 2024-09-18T21:12:49.715 INFO:tasks.workunit.client.1.smithi103.stdout:1/410: creat d0/d2/d9/d10/d5d/d6f/f8b x:0 0 0 2024-09-18T21:12:49.719 INFO:tasks.workunit.client.0.smithi077.stdout:7/455: mkdir d12/d56/da1 0 2024-09-18T21:12:49.721 INFO:tasks.workunit.client.1.smithi103.stdout:5/433: dwrite de/d2d/d7f/f65 [0,4194304] 0 2024-09-18T21:12:49.723 INFO:tasks.workunit.client.0.smithi077.stdout:7/456: fdatasync d12/d22/d59/d72/f86 0 2024-09-18T21:12:49.724 INFO:tasks.workunit.client.1.smithi103.stdout:6/413: mknod d2/d24/d5a/d67/d76/c7e 0 2024-09-18T21:12:49.726 INFO:tasks.workunit.client.1.smithi103.stdout:3/388: rename d1/d2/d18/d30/l71 to d1/da/l81 0 2024-09-18T21:12:49.727 INFO:tasks.workunit.client.0.smithi077.stdout:7/457: creat d12/d56/fa2 x:0 0 0 2024-09-18T21:12:49.730 INFO:tasks.workunit.client.0.smithi077.stdout:7/458: mkdir d12/d31/d77/da3 0 2024-09-18T21:12:49.731 INFO:tasks.workunit.client.1.smithi103.stdout:8/419: dread d4/d26/f1a [0,4194304] 0 2024-09-18T21:12:49.733 INFO:tasks.workunit.client.1.smithi103.stdout:6/414: unlink d2/l37 0 2024-09-18T21:12:49.733 INFO:tasks.workunit.client.0.smithi077.stdout:7/459: rmdir d12/d31/d77/d93/d89 39 2024-09-18T21:12:49.737 INFO:tasks.workunit.client.0.smithi077.stdout:9/272: truncate d1/dd/d11/d1c/f25 227327 0 2024-09-18T21:12:49.738 INFO:tasks.workunit.client.0.smithi077.stdout:9/273: write d1/dd/d11/f3e [2340068,53004] 0 2024-09-18T21:12:49.738 INFO:tasks.workunit.client.1.smithi103.stdout:0/392: write d1/d5/de/d19/d1e/d34/f74 [177410,129011] 0 2024-09-18T21:12:49.739 INFO:tasks.workunit.client.0.smithi077.stdout:9/274: chown d1/df/d51 260631513 1 2024-09-18T21:12:49.742 INFO:tasks.workunit.client.1.smithi103.stdout:6/415: truncate d2/d3/d8/f2d 2823364 0 2024-09-18T21:12:49.742 INFO:tasks.workunit.client.1.smithi103.stdout:8/420: creat d4/d81/d65/f83 x:0 0 0 2024-09-18T21:12:49.743 INFO:tasks.workunit.client.1.smithi103.stdout:8/421: write d4/d81/d65/d39/f4f [1026859,89019] 0 2024-09-18T21:12:49.745 INFO:tasks.workunit.client.1.smithi103.stdout:0/393: rmdir d1/d5/d4c/d4e 39 2024-09-18T21:12:49.747 INFO:tasks.workunit.client.0.smithi077.stdout:9/275: rename d1/df to d1/d54 0 2024-09-18T21:12:49.748 INFO:tasks.workunit.client.1.smithi103.stdout:3/389: dread d1/da/df/f19 [0,4194304] 0 2024-09-18T21:12:49.748 INFO:tasks.workunit.client.1.smithi103.stdout:3/390: rename d1/d2 to d1/d2/d82 22 2024-09-18T21:12:49.749 INFO:tasks.workunit.client.1.smithi103.stdout:3/391: stat d1/d23/d47/l78 0 2024-09-18T21:12:49.749 INFO:tasks.workunit.client.1.smithi103.stdout:5/434: getdents de/d2d/d7f 0 2024-09-18T21:12:49.752 INFO:tasks.workunit.client.1.smithi103.stdout:3/392: dread d1/d2/f8 [0,4194304] 0 2024-09-18T21:12:49.754 INFO:tasks.workunit.client.1.smithi103.stdout:0/394: mkdir d1/d9/d13/d8d 0 2024-09-18T21:12:49.755 INFO:tasks.workunit.client.1.smithi103.stdout:0/395: chown d1/d5/de/d24/d43/d81/c8a 423 1 2024-09-18T21:12:49.755 INFO:tasks.workunit.client.1.smithi103.stdout:6/416: mkdir d2/d3/d7f 0 2024-09-18T21:12:49.758 INFO:tasks.workunit.client.1.smithi103.stdout:8/422: link d4/de/f46 d4/d81/d71/f84 0 2024-09-18T21:12:49.760 INFO:tasks.workunit.client.1.smithi103.stdout:0/396: symlink d1/d9/d3e/d6e/l8e 0 2024-09-18T21:12:49.761 INFO:tasks.workunit.client.1.smithi103.stdout:3/393: unlink d1/l3b 0 2024-09-18T21:12:49.763 INFO:tasks.workunit.client.1.smithi103.stdout:3/394: write d1/d2/d18/d30/f3f [495630,102845] 0 2024-09-18T21:12:49.763 INFO:tasks.workunit.client.1.smithi103.stdout:8/423: creat d4/de/d4a/d59/d5e/f85 x:0 0 0 2024-09-18T21:12:49.763 INFO:tasks.workunit.client.1.smithi103.stdout:0/397: mknod d1/d56/d8c/c8f 0 2024-09-18T21:12:49.764 INFO:tasks.workunit.client.1.smithi103.stdout:6/417: creat d2/d24/f80 x:0 0 0 2024-09-18T21:12:49.765 INFO:tasks.workunit.client.1.smithi103.stdout:5/435: dwrite de/d3e/f19 [0,4194304] 0 2024-09-18T21:12:49.768 INFO:tasks.workunit.client.1.smithi103.stdout:6/418: read d2/d24/d5a/f17 [76336,83747] 0 2024-09-18T21:12:49.769 INFO:tasks.workunit.client.1.smithi103.stdout:5/436: creat de/d2d/f88 x:0 0 0 2024-09-18T21:12:49.772 INFO:tasks.workunit.client.1.smithi103.stdout:0/398: truncate d1/d5/de/d19/d1e/f1f 830126 0 2024-09-18T21:12:49.772 INFO:tasks.workunit.client.1.smithi103.stdout:3/395: dread d1/f24 [0,4194304] 0 2024-09-18T21:12:49.772 INFO:tasks.workunit.client.1.smithi103.stdout:5/437: creat de/d1f/d3b/d3c/f89 x:0 0 0 2024-09-18T21:12:49.772 INFO:tasks.workunit.client.1.smithi103.stdout:5/438: fsync de/d2d/d7f/f4c 0 2024-09-18T21:12:49.772 INFO:tasks.workunit.client.1.smithi103.stdout:3/396: write d1/d2/d18/d30/d4e/d62/f6a [392491,79887] 0 2024-09-18T21:12:49.775 INFO:tasks.workunit.client.1.smithi103.stdout:0/399: unlink d1/d5/de/d19/f4a 0 2024-09-18T21:12:49.777 INFO:tasks.workunit.client.1.smithi103.stdout:5/439: chown de/c13 362 1 2024-09-18T21:12:49.778 INFO:tasks.workunit.client.1.smithi103.stdout:3/397: mkdir d1/d2/d18/d30/d4e/d83 0 2024-09-18T21:12:49.779 INFO:tasks.workunit.client.1.smithi103.stdout:3/398: fsync d1/da/f3d 0 2024-09-18T21:12:49.780 INFO:tasks.workunit.client.1.smithi103.stdout:6/419: link d2/d24/d5a/d67/d76/c7e d2/d24/d38/c81 0 2024-09-18T21:12:49.780 INFO:tasks.workunit.client.1.smithi103.stdout:0/400: creat d1/d5/de/d24/d43/d76/f90 x:0 0 0 2024-09-18T21:12:49.781 INFO:tasks.workunit.client.1.smithi103.stdout:8/424: dwrite d4/d2d/d3d/f5a [0,4194304] 0 2024-09-18T21:12:49.781 INFO:tasks.workunit.client.1.smithi103.stdout:3/399: fdatasync d1/da/df/f19 0 2024-09-18T21:12:49.784 INFO:tasks.workunit.client.1.smithi103.stdout:5/440: creat de/d3e/d15/f8a x:0 0 0 2024-09-18T21:12:49.784 INFO:tasks.workunit.client.0.smithi077.stdout:9/276: rmdir d1/dd 39 2024-09-18T21:12:49.784 INFO:tasks.workunit.client.1.smithi103.stdout:8/425: mknod d4/d26/d56/d77/c86 0 2024-09-18T21:12:49.785 INFO:tasks.workunit.client.1.smithi103.stdout:8/426: stat d4/d2d/d4e/d73 0 2024-09-18T21:12:49.793 INFO:tasks.workunit.client.1.smithi103.stdout:0/401: creat d1/d5/de/d22/d6a/f91 x:0 0 0 2024-09-18T21:12:49.793 INFO:tasks.workunit.client.1.smithi103.stdout:8/427: unlink d4/d26/fb 0 2024-09-18T21:12:49.797 INFO:tasks.workunit.client.0.smithi077.stdout:9/277: dwrite d1/dd/d11/d1c/d38/f41 [0,4194304] 0 2024-09-18T21:12:49.798 INFO:tasks.workunit.client.1.smithi103.stdout:3/400: link d1/d2/d18/d30/d4e/f61 d1/d2/d18/d30/d4e/f84 0 2024-09-18T21:12:49.798 INFO:tasks.workunit.client.1.smithi103.stdout:3/401: fdatasync d1/d23/d25/f60 0 2024-09-18T21:12:49.804 INFO:tasks.workunit.client.1.smithi103.stdout:8/428: mkdir d4/d2d/d87 0 2024-09-18T21:12:49.806 INFO:tasks.workunit.client.1.smithi103.stdout:3/402: dwrite d1/da/f15 [4194304,4194304] 0 2024-09-18T21:12:49.808 INFO:tasks.workunit.client.1.smithi103.stdout:8/429: mknod d4/de/c88 0 2024-09-18T21:12:49.810 INFO:tasks.workunit.client.1.smithi103.stdout:5/441: link de/d14/d33/c40 de/d2d/c8b 0 2024-09-18T21:12:49.811 INFO:tasks.workunit.client.1.smithi103.stdout:3/403: mkdir d1/d23/d25/d4f/d72/d85 0 2024-09-18T21:12:49.811 INFO:tasks.workunit.client.1.smithi103.stdout:6/420: write d2/f34 [646632,24137] 0 2024-09-18T21:12:49.812 INFO:tasks.workunit.client.1.smithi103.stdout:3/404: dread - d1/da/df/f77 zero size 2024-09-18T21:12:49.812 INFO:tasks.workunit.client.1.smithi103.stdout:8/430: symlink d4/d81/d71/d7f/l89 0 2024-09-18T21:12:49.812 INFO:tasks.workunit.client.1.smithi103.stdout:5/442: read - de/d1f/d3b/d3c/d62/f76 zero size 2024-09-18T21:12:49.814 INFO:tasks.workunit.client.1.smithi103.stdout:3/405: write d1/f24 [609804,9045] 0 2024-09-18T21:12:49.814 INFO:tasks.workunit.client.1.smithi103.stdout:8/431: dread - d4/de/d4a/f79 zero size 2024-09-18T21:12:49.814 INFO:tasks.workunit.client.1.smithi103.stdout:6/421: creat d2/d3/d8/d4c/d79/f82 x:0 0 0 2024-09-18T21:12:49.815 INFO:tasks.workunit.client.1.smithi103.stdout:5/443: write de/d1f/d3b/f4a [3779701,93346] 0 2024-09-18T21:12:49.815 INFO:tasks.workunit.client.0.smithi077.stdout:9/278: write d1/dd/d11/d15/f50 [1044236,24952] 0 2024-09-18T21:12:49.818 INFO:tasks.workunit.client.1.smithi103.stdout:8/432: creat d4/d81/d65/d39/f8a x:0 0 0 2024-09-18T21:12:49.819 INFO:tasks.workunit.client.0.smithi077.stdout:7/460: truncate d12/d56/f3a 3156547 0 2024-09-18T21:12:49.820 INFO:tasks.workunit.client.0.smithi077.stdout:9/279: dread d1/d54/f21 [0,4194304] 0 2024-09-18T21:12:49.821 INFO:tasks.workunit.client.0.smithi077.stdout:9/280: chown d1/dd/d11/d15/f50 5 1 2024-09-18T21:12:49.821 INFO:tasks.workunit.client.1.smithi103.stdout:3/406: mkdir d1/d23/d25/d4f/d58/d86 0 2024-09-18T21:12:49.823 INFO:tasks.workunit.client.1.smithi103.stdout:8/433: dread d4/de/f3b [0,4194304] 0 2024-09-18T21:12:49.823 INFO:tasks.workunit.client.1.smithi103.stdout:5/444: symlink de/d3e/l8c 0 2024-09-18T21:12:49.825 INFO:tasks.workunit.client.0.smithi077.stdout:9/281: dread d1/dd/d11/d1c/f31 [0,4194304] 0 2024-09-18T21:12:49.827 INFO:tasks.workunit.client.1.smithi103.stdout:3/407: creat d1/d23/d25/d4f/d72/f87 x:0 0 0 2024-09-18T21:12:49.828 INFO:tasks.workunit.client.1.smithi103.stdout:3/408: chown d1/d23/d25/d4f/d72/f87 202020 1 2024-09-18T21:12:49.828 INFO:tasks.workunit.client.1.smithi103.stdout:8/434: dwrite d4/d2d/d3d/f5a [4194304,4194304] 0 2024-09-18T21:12:49.831 INFO:tasks.workunit.client.0.smithi077.stdout:9/282: mkdir d1/dd/d11/d1c/d38/d46/d55 0 2024-09-18T21:12:49.832 INFO:tasks.workunit.client.0.smithi077.stdout:9/283: write d1/d54/d27/f39 [3853064,125012] 0 2024-09-18T21:12:49.832 INFO:tasks.workunit.client.1.smithi103.stdout:8/435: mknod d4/d2d/c8b 0 2024-09-18T21:12:49.833 INFO:tasks.workunit.client.0.smithi077.stdout:9/284: dread - d1/d54/f3b zero size 2024-09-18T21:12:49.834 INFO:tasks.workunit.client.1.smithi103.stdout:5/445: mkdir de/d1f/d3b/d51/d57/d79/d8d 0 2024-09-18T21:12:49.834 INFO:tasks.workunit.client.1.smithi103.stdout:8/436: chown d4/d2d/d3d/l82 13 1 2024-09-18T21:12:49.834 INFO:tasks.workunit.client.1.smithi103.stdout:3/409: dread d1/d2/d18/d30/d4e/d62/f6a [0,4194304] 0 2024-09-18T21:12:49.836 INFO:tasks.workunit.client.1.smithi103.stdout:0/402: dwrite d1/d5/de/d24/f32 [0,4194304] 0 2024-09-18T21:12:49.838 INFO:tasks.workunit.client.1.smithi103.stdout:3/410: write d1/f2e [5001228,26677] 0 2024-09-18T21:12:49.841 INFO:tasks.workunit.client.0.smithi077.stdout:9/285: dwrite d1/dd/d11/d1c/d38/f41 [4194304,4194304] 0 2024-09-18T21:12:49.843 INFO:tasks.workunit.client.0.smithi077.stdout:9/286: fdatasync d1/f49 0 2024-09-18T21:12:49.843 INFO:tasks.workunit.client.1.smithi103.stdout:8/437: dwrite d4/de/d4a/f66 [0,4194304] 0 2024-09-18T21:12:49.850 INFO:tasks.workunit.client.1.smithi103.stdout:3/411: symlink d1/d23/d25/d4f/d72/d7e/l88 0 2024-09-18T21:12:49.854 INFO:tasks.workunit.client.1.smithi103.stdout:3/412: mknod d1/da/df/d70/c89 0 2024-09-18T21:12:49.856 INFO:tasks.workunit.client.0.smithi077.stdout:9/287: link d1/d54/f44 d1/dd/d11/d2d/f56 0 2024-09-18T21:12:49.857 INFO:tasks.workunit.client.0.smithi077.stdout:7/461: dwrite d12/d22/d59/d72/f3b [0,4194304] 0 2024-09-18T21:12:49.860 INFO:tasks.workunit.client.1.smithi103.stdout:3/413: rename d1/d2/d18/l59 to d1/d2/l8a 0 2024-09-18T21:12:49.860 INFO:tasks.workunit.client.1.smithi103.stdout:8/438: getdents d4/d26/d56 0 2024-09-18T21:12:49.864 INFO:tasks.workunit.client.1.smithi103.stdout:8/439: creat d4/d2d/d4e/f8c x:0 0 0 2024-09-18T21:12:49.867 INFO:tasks.workunit.client.1.smithi103.stdout:5/446: truncate de/d1f/f24 2095157 0 2024-09-18T21:12:49.867 INFO:tasks.workunit.client.0.smithi077.stdout:9/288: getdents d1/dd/d11/d15 0 2024-09-18T21:12:49.868 INFO:tasks.workunit.client.0.smithi077.stdout:7/462: mknod d12/d31/d77/d93/d2a/d7f/ca4 0 2024-09-18T21:12:49.869 INFO:tasks.workunit.client.1.smithi103.stdout:3/414: dwrite d1/d2/d18/f29 [4194304,4194304] 0 2024-09-18T21:12:49.871 INFO:tasks.workunit.client.1.smithi103.stdout:0/403: dwrite d1/f29 [0,4194304] 0 2024-09-18T21:12:49.871 INFO:tasks.workunit.client.0.smithi077.stdout:7/463: write d12/f78 [1573968,6858] 0 2024-09-18T21:12:49.873 INFO:tasks.workunit.client.0.smithi077.stdout:7/464: chown d12/d22/d59/d72/l52 5230560 1 2024-09-18T21:12:49.874 INFO:tasks.workunit.client.1.smithi103.stdout:5/447: creat de/d14/d33/f8e x:0 0 0 2024-09-18T21:12:49.874 INFO:tasks.workunit.client.1.smithi103.stdout:3/415: fsync d1/d2/f8 0 2024-09-18T21:12:49.881 INFO:tasks.workunit.client.0.smithi077.stdout:7/465: symlink d12/d31/la5 0 2024-09-18T21:12:49.883 INFO:tasks.workunit.client.0.smithi077.stdout:7/466: truncate d12/d31/d77/d93/d2a/d6c/f96 1209925 0 2024-09-18T21:12:49.883 INFO:tasks.workunit.client.1.smithi103.stdout:3/416: rename d1/da/df/l2c to d1/d2/d18/d30/l8b 0 2024-09-18T21:12:49.887 INFO:tasks.workunit.client.1.smithi103.stdout:3/417: mkdir d1/d23/d25/d4f/d58/d68/d50/d54/d8c 0 2024-09-18T21:12:49.888 INFO:tasks.workunit.client.1.smithi103.stdout:8/440: truncate d4/de/f11 4762428 0 2024-09-18T21:12:49.888 INFO:tasks.workunit.client.1.smithi103.stdout:3/418: write d1/f75 [338287,108397] 0 2024-09-18T21:12:49.889 INFO:tasks.workunit.client.1.smithi103.stdout:8/441: write d4/de/d4a/f66 [3776894,1876] 0 2024-09-18T21:12:49.892 INFO:tasks.workunit.client.0.smithi077.stdout:9/289: truncate d1/dd/d11/d15/f50 626336 0 2024-09-18T21:12:49.893 INFO:tasks.workunit.client.0.smithi077.stdout:9/290: read d1/dd/d11/d1c/f31 [1263275,77907] 0 2024-09-18T21:12:49.894 INFO:tasks.workunit.client.0.smithi077.stdout:9/291: readlink d1/dd/d11/d15/l3c 0 2024-09-18T21:12:49.895 INFO:tasks.workunit.client.0.smithi077.stdout:9/292: fdatasync d1/f16 0 2024-09-18T21:12:49.898 INFO:tasks.workunit.client.0.smithi077.stdout:9/293: truncate d1/dd/d11/d15/f45 270342 0 2024-09-18T21:12:49.901 INFO:tasks.workunit.client.0.smithi077.stdout:7/467: dwrite d12/d22/d59/d5a/f70 [0,4194304] 0 2024-09-18T21:12:49.903 INFO:tasks.workunit.client.0.smithi077.stdout:9/294: mkdir d1/dd/d57 0 2024-09-18T21:12:49.906 INFO:tasks.workunit.client.0.smithi077.stdout:9/295: symlink d1/d54/d27/l58 0 2024-09-18T21:12:49.907 INFO:tasks.workunit.client.0.smithi077.stdout:9/296: stat d1/dd/d11/d1c/d38/f41 0 2024-09-18T21:12:49.908 INFO:tasks.workunit.client.0.smithi077.stdout:7/468: getdents d12/d31/d77/d93/d2a/d7f 0 2024-09-18T21:12:49.908 INFO:tasks.workunit.client.0.smithi077.stdout:9/297: chown d1/dd/d11/d15 1713 1 2024-09-18T21:12:49.909 INFO:tasks.workunit.client.0.smithi077.stdout:9/298: chown d1/d54/f1e 0 1 2024-09-18T21:12:49.913 INFO:tasks.workunit.client.0.smithi077.stdout:9/299: mkdir d1/dd/d11/d2d/d59 0 2024-09-18T21:12:49.915 INFO:tasks.workunit.client.0.smithi077.stdout:9/300: creat d1/dd/f5a x:0 0 0 2024-09-18T21:12:49.917 INFO:tasks.workunit.client.0.smithi077.stdout:9/301: unlink d1/d54/d27/l58 0 2024-09-18T21:12:49.917 INFO:tasks.workunit.client.0.smithi077.stdout:9/302: chown d1/d54/d27/f39 829 1 2024-09-18T21:12:49.917 INFO:tasks.workunit.client.0.smithi077.stdout:7/469: write d12/f1f [1300084,119065] 0 2024-09-18T21:12:49.920 INFO:tasks.workunit.client.0.smithi077.stdout:7/470: symlink d12/d56/da1/la6 0 2024-09-18T21:12:49.926 INFO:tasks.workunit.client.0.smithi077.stdout:7/471: dwrite d12/d22/d59/d72/f3b [0,4194304] 0 2024-09-18T21:12:49.926 INFO:tasks.workunit.client.0.smithi077.stdout:9/303: truncate d1/d54/d27/f39 1163705 0 2024-09-18T21:12:49.927 INFO:tasks.workunit.client.0.smithi077.stdout:9/304: write d1/f16 [8913468,109983] 0 2024-09-18T21:12:49.928 INFO:tasks.workunit.client.0.smithi077.stdout:7/472: dread - d12/d31/f54 zero size 2024-09-18T21:12:49.932 INFO:tasks.workunit.client.0.smithi077.stdout:7/473: rename d12/f55 to d12/d31/d77/da0/fa7 0 2024-09-18T21:12:49.946 INFO:tasks.workunit.client.0.smithi077.stdout:7/474: dread d12/d31/d77/da0/fa7 [0,4194304] 0 2024-09-18T21:12:49.947 INFO:tasks.workunit.client.0.smithi077.stdout:9/305: dwrite d1/d54/d27/f39 [0,4194304] 0 2024-09-18T21:12:49.950 INFO:tasks.workunit.client.0.smithi077.stdout:9/306: creat d1/dd/d11/d1c/d38/d46/f5b x:0 0 0 2024-09-18T21:12:49.951 INFO:tasks.workunit.client.0.smithi077.stdout:7/475: write d12/f9a [1651309,5325] 0 2024-09-18T21:12:49.951 INFO:tasks.workunit.client.0.smithi077.stdout:9/307: chown d1/dd/d11/d15/l3c 194 1 2024-09-18T21:12:49.953 INFO:tasks.workunit.client.0.smithi077.stdout:9/308: getdents d1/dd/d11/d2d/d59 0 2024-09-18T21:12:49.955 INFO:tasks.workunit.client.0.smithi077.stdout:7/476: getdents d12/d31/d77/d93/d89 0 2024-09-18T21:12:49.956 INFO:tasks.workunit.client.0.smithi077.stdout:9/309: creat d1/d54/f5c x:0 0 0 2024-09-18T21:12:49.957 INFO:tasks.workunit.client.0.smithi077.stdout:7/477: creat d12/d31/d77/da0/fa8 x:0 0 0 2024-09-18T21:12:49.958 INFO:tasks.workunit.client.1.smithi103.stdout:9/417: sync 2024-09-18T21:12:49.959 INFO:tasks.workunit.client.0.smithi077.stdout:9/310: creat d1/dd/f5d x:0 0 0 2024-09-18T21:12:49.962 INFO:tasks.workunit.client.0.smithi077.stdout:9/311: getdents d1/dd/d11/d1c/d38/d46/d55 0 2024-09-18T21:12:49.966 INFO:tasks.workunit.client.0.smithi077.stdout:7/478: dwrite d12/d31/f61 [0,4194304] 0 2024-09-18T21:12:49.966 INFO:tasks.workunit.client.0.smithi077.stdout:9/312: creat d1/dd/d1a/d42/f5e x:0 0 0 2024-09-18T21:12:49.973 INFO:tasks.workunit.client.1.smithi103.stdout:0/404: truncate d1/f3f 1446451 0 2024-09-18T21:12:49.974 INFO:tasks.workunit.client.0.smithi077.stdout:9/313: dwrite d1/dd/d11/f3e [4194304,4194304] 0 2024-09-18T21:12:49.975 INFO:tasks.workunit.client.1.smithi103.stdout:9/418: write d18/f3c [2803466,53710] 0 2024-09-18T21:12:49.977 INFO:tasks.workunit.client.1.smithi103.stdout:8/442: symlink d4/d2d/d4e/d73/l8d 0 2024-09-18T21:12:49.977 INFO:tasks.workunit.client.1.smithi103.stdout:3/419: dwrite d1/da/f3d [4194304,4194304] 0 2024-09-18T21:12:49.980 INFO:tasks.workunit.client.1.smithi103.stdout:0/405: rename d1/d5/de/d24/l35 to d1/d5/de/d24/d43/d81/l92 0 2024-09-18T21:12:49.980 INFO:tasks.workunit.client.1.smithi103.stdout:3/420: chown d1/d2/d18/d30/l39 30289640 1 2024-09-18T21:12:49.980 INFO:tasks.workunit.client.1.smithi103.stdout:8/443: truncate d4/d2d/d4e/f8c 261478 0 2024-09-18T21:12:49.980 INFO:tasks.workunit.client.1.smithi103.stdout:9/419: mknod d18/c8c 0 2024-09-18T21:12:49.982 INFO:tasks.workunit.client.1.smithi103.stdout:8/444: dread - d4/d81/d65/f83 zero size 2024-09-18T21:12:49.982 INFO:tasks.workunit.client.1.smithi103.stdout:0/406: mkdir d1/d93 0 2024-09-18T21:12:49.983 INFO:tasks.workunit.client.1.smithi103.stdout:3/421: stat d1/d23/d25/d4f/d72/d85 0 2024-09-18T21:12:49.983 INFO:tasks.workunit.client.1.smithi103.stdout:8/445: stat d4/d81/c69 0 2024-09-18T21:12:49.984 INFO:tasks.workunit.client.1.smithi103.stdout:8/446: write f2 [5864128,102761] 0 2024-09-18T21:12:49.985 INFO:tasks.workunit.client.1.smithi103.stdout:3/422: chown d1/d2/d18/d30/d4e/d62/c6c 205 1 2024-09-18T21:12:49.986 INFO:tasks.workunit.client.1.smithi103.stdout:9/420: rename d18/d1f to d18/d8d 0 2024-09-18T21:12:49.989 INFO:tasks.workunit.client.1.smithi103.stdout:9/421: mkdir d18/d52/d6f/d8e 0 2024-09-18T21:12:49.991 INFO:tasks.workunit.client.1.smithi103.stdout:3/423: link d1/d2/l1a d1/d23/d25/d4f/d58/l8d 0 2024-09-18T21:12:49.992 INFO:tasks.workunit.client.1.smithi103.stdout:8/447: dwrite d4/d81/d65/d39/f8a [0,4194304] 0 2024-09-18T21:12:49.992 INFO:tasks.workunit.client.1.smithi103.stdout:9/422: mkdir d18/d52/d6f/d8e/d8f 0 2024-09-18T21:12:49.993 INFO:tasks.workunit.client.1.smithi103.stdout:8/448: readlink d4/de/l7b 0 2024-09-18T21:12:49.993 INFO:tasks.workunit.client.1.smithi103.stdout:3/424: dread - d1/da/df/f79 zero size 2024-09-18T21:12:49.993 INFO:tasks.workunit.client.1.smithi103.stdout:9/423: chown d18/f3e 0 1 2024-09-18T21:12:49.994 INFO:tasks.workunit.client.1.smithi103.stdout:3/425: dread - d1/d2/d18/f46 zero size 2024-09-18T21:12:49.996 INFO:tasks.workunit.client.1.smithi103.stdout:8/449: rmdir d4/de 39 2024-09-18T21:12:49.999 INFO:tasks.workunit.client.0.smithi077.stdout:9/314: dread d1/d54/f12 [0,4194304] 0 2024-09-18T21:12:50.000 INFO:tasks.workunit.client.1.smithi103.stdout:3/426: dwrite d1/f24 [0,4194304] 0 2024-09-18T21:12:50.000 INFO:tasks.workunit.client.1.smithi103.stdout:9/424: mkdir d18/d90 0 2024-09-18T21:12:50.000 INFO:tasks.workunit.client.1.smithi103.stdout:3/427: readlink d1/da/ld 0 2024-09-18T21:12:50.000 INFO:tasks.workunit.client.1.smithi103.stdout:9/425: chown d18/f64 1353180 1 2024-09-18T21:12:50.001 INFO:tasks.workunit.client.1.smithi103.stdout:8/450: getdents d4/d2d/d87 0 2024-09-18T21:12:50.002 INFO:tasks.workunit.client.0.smithi077.stdout:9/315: mknod d1/dd/d11/c5f 0 2024-09-18T21:12:50.002 INFO:tasks.workunit.client.1.smithi103.stdout:9/426: chown d18/d8d/d2f/c49 0 1 2024-09-18T21:12:50.004 INFO:tasks.workunit.client.1.smithi103.stdout:8/451: read d4/de/d4a/f66 [1523055,80398] 0 2024-09-18T21:12:50.006 INFO:tasks.workunit.client.1.smithi103.stdout:8/452: write d4/d26/f1d [276031,22059] 0 2024-09-18T21:12:50.006 INFO:tasks.workunit.client.0.smithi077.stdout:9/316: dread d1/f16 [4194304,4194304] 0 2024-09-18T21:12:50.007 INFO:tasks.workunit.client.1.smithi103.stdout:9/427: chown d18/c3b 12 1 2024-09-18T21:12:50.007 INFO:tasks.workunit.client.0.smithi077.stdout:9/317: chown d1/dd/d1a/d42/d4b/l52 2330 1 2024-09-18T21:12:50.008 INFO:tasks.workunit.client.1.smithi103.stdout:9/428: write d18/f38 [3644164,16180] 0 2024-09-18T21:12:50.013 INFO:tasks.workunit.client.1.smithi103.stdout:0/407: write d1/f12 [156063,128128] 0 2024-09-18T21:12:50.013 INFO:tasks.workunit.client.1.smithi103.stdout:8/453: symlink d4/d2d/d4e/d73/l8e 0 2024-09-18T21:12:50.014 INFO:tasks.workunit.client.0.smithi077.stdout:9/318: dwrite d1/dd/d1a/d42/f5e [0,4194304] 0 2024-09-18T21:12:50.015 INFO:tasks.workunit.client.1.smithi103.stdout:9/429: mknod d18/d29/d68/c91 0 2024-09-18T21:12:50.018 INFO:tasks.workunit.client.1.smithi103.stdout:8/454: link d4/d81/f7c d4/d26/d56/d77/f8f 0 2024-09-18T21:12:50.019 INFO:tasks.workunit.client.1.smithi103.stdout:0/408: rmdir d1/d9/d3e/d6e 39 2024-09-18T21:12:50.021 INFO:tasks.workunit.client.1.smithi103.stdout:8/455: unlink d4/d26/c24 0 2024-09-18T21:12:50.022 INFO:tasks.workunit.client.1.smithi103.stdout:3/428: truncate d1/d2/f4b 649586 0 2024-09-18T21:12:50.027 INFO:tasks.workunit.client.1.smithi103.stdout:8/456: symlink d4/de/d4a/d59/l90 0 2024-09-18T21:12:50.028 INFO:tasks.workunit.client.0.smithi077.stdout:9/319: write d1/dd/f14 [1099151,97442] 0 2024-09-18T21:12:50.028 INFO:tasks.workunit.client.1.smithi103.stdout:8/457: mknod d4/d81/d71/d7f/c91 0 2024-09-18T21:12:50.030 INFO:tasks.workunit.client.1.smithi103.stdout:8/458: chown d4/de/f11 7129175 1 2024-09-18T21:12:50.031 INFO:tasks.workunit.client.0.smithi077.stdout:9/320: creat d1/dd/d11/d1c/d38/d46/f60 x:0 0 0 2024-09-18T21:12:50.031 INFO:tasks.workunit.client.0.smithi077.stdout:9/321: chown d1/dd/d11/d1c/d38/d46 32067888 1 2024-09-18T21:12:50.032 INFO:tasks.workunit.client.1.smithi103.stdout:8/459: truncate d4/d26/d56/f62 2189542 0 2024-09-18T21:12:50.035 INFO:tasks.workunit.client.0.smithi077.stdout:9/322: rename d1/dd/d11/d15/l37 to d1/dd/d1a/d42/d4b/l61 0 2024-09-18T21:12:50.036 INFO:tasks.workunit.client.1.smithi103.stdout:3/429: write d1/d23/f2a [828059,119216] 0 2024-09-18T21:12:50.036 INFO:tasks.workunit.client.0.smithi077.stdout:9/323: readlink d1/d54/d27/l3a 0 2024-09-18T21:12:50.037 INFO:tasks.workunit.client.1.smithi103.stdout:3/430: stat d1/d23/d25/d4f/d58/d68/d50/d54/c7f 0 2024-09-18T21:12:50.038 INFO:tasks.workunit.client.1.smithi103.stdout:0/409: write d1/d5/de/d24/d43/f8b [112918,20451] 0 2024-09-18T21:12:50.038 INFO:tasks.workunit.client.0.smithi077.stdout:9/324: creat d1/dd/f62 x:0 0 0 2024-09-18T21:12:50.039 INFO:tasks.workunit.client.1.smithi103.stdout:9/430: dread fa [4194304,4194304] 0 2024-09-18T21:12:50.040 INFO:tasks.workunit.client.1.smithi103.stdout:0/410: write d1/d9/d3e/f67 [884572,24820] 0 2024-09-18T21:12:50.042 INFO:tasks.workunit.client.1.smithi103.stdout:9/431: mkdir d18/d29/d68/d92 0 2024-09-18T21:12:50.042 INFO:tasks.workunit.client.0.smithi077.stdout:9/325: dread d1/d54/f12 [0,4194304] 0 2024-09-18T21:12:50.043 INFO:tasks.workunit.client.1.smithi103.stdout:3/431: truncate d1/d2/d18/d30/f38 3241864 0 2024-09-18T21:12:50.047 INFO:tasks.workunit.client.0.smithi077.stdout:9/326: dread d1/dd/d1a/d42/f5e [0,4194304] 0 2024-09-18T21:12:50.048 INFO:tasks.workunit.client.1.smithi103.stdout:8/460: dwrite d4/d81/f7c [0,4194304] 0 2024-09-18T21:12:50.049 INFO:tasks.workunit.client.1.smithi103.stdout:8/461: chown d4/de/d4a/d59/d5e/f6a 33 1 2024-09-18T21:12:50.049 INFO:tasks.workunit.client.1.smithi103.stdout:8/462: chown d4 240797772 1 2024-09-18T21:12:50.050 INFO:tasks.workunit.client.1.smithi103.stdout:0/411: write d1/d9/d13/f46 [884017,81954] 0 2024-09-18T21:12:50.051 INFO:tasks.workunit.client.1.smithi103.stdout:8/463: write d4/d2d/d3d/f5a [2382551,102606] 0 2024-09-18T21:12:50.053 INFO:tasks.workunit.client.1.smithi103.stdout:0/412: write d1/d9/f2b [4209066,58417] 0 2024-09-18T21:12:50.053 INFO:tasks.workunit.client.1.smithi103.stdout:8/464: chown d4/d81/d65/l51 442045747 1 2024-09-18T21:12:50.056 INFO:tasks.workunit.client.1.smithi103.stdout:3/432: truncate d1/d2/d18/f44 799740 0 2024-09-18T21:12:50.056 INFO:tasks.workunit.client.1.smithi103.stdout:8/465: write d4/de/f16 [478860,114066] 0 2024-09-18T21:12:50.060 INFO:tasks.workunit.client.0.smithi077.stdout:9/327: write d1/dd/d11/d15/f50 [1407294,60816] 0 2024-09-18T21:12:50.061 INFO:tasks.workunit.client.1.smithi103.stdout:0/413: dwrite d1/f12 [0,4194304] 0 2024-09-18T21:12:50.062 INFO:tasks.workunit.client.0.smithi077.stdout:9/328: mknod d1/dd/d1a/d42/d4b/c63 0 2024-09-18T21:12:50.063 INFO:tasks.workunit.client.0.smithi077.stdout:9/329: creat d1/d54/d27/f64 x:0 0 0 2024-09-18T21:12:50.064 INFO:tasks.workunit.client.1.smithi103.stdout:3/433: dread d1/d2/d18/f29 [4194304,4194304] 0 2024-09-18T21:12:50.065 INFO:tasks.workunit.client.1.smithi103.stdout:8/466: dwrite d4/d81/d71/f7e [0,4194304] 0 2024-09-18T21:12:50.066 INFO:tasks.workunit.client.1.smithi103.stdout:3/434: chown d1/d23/d25/d4f/d72/d7e 6209 1 2024-09-18T21:12:50.066 INFO:tasks.workunit.client.1.smithi103.stdout:3/435: fsync d1/da/df/f79 0 2024-09-18T21:12:50.068 INFO:tasks.workunit.client.0.smithi077.stdout:9/330: dread d1/dd/d11/f3e [0,4194304] 0 2024-09-18T21:12:50.069 INFO:tasks.workunit.client.1.smithi103.stdout:0/414: getdents d1/d5/de 0 2024-09-18T21:12:50.069 INFO:tasks.workunit.client.1.smithi103.stdout:4/409: sync 2024-09-18T21:12:50.069 INFO:tasks.workunit.client.1.smithi103.stdout:8/467: creat d4/d81/f92 x:0 0 0 2024-09-18T21:12:50.070 INFO:tasks.workunit.client.1.smithi103.stdout:3/436: mknod d1/d23/d25/d4f/d51/c8e 0 2024-09-18T21:12:50.070 INFO:tasks.workunit.client.1.smithi103.stdout:8/468: chown d4/de/f43 517063 1 2024-09-18T21:12:50.072 INFO:tasks.workunit.client.1.smithi103.stdout:8/469: truncate d4/de/f3b 761937 0 2024-09-18T21:12:50.073 INFO:tasks.workunit.client.1.smithi103.stdout:4/410: creat d9/d1f/f8d x:0 0 0 2024-09-18T21:12:50.074 INFO:tasks.workunit.client.1.smithi103.stdout:8/470: write d4/d81/d65/f83 [959145,5124] 0 2024-09-18T21:12:50.074 INFO:tasks.workunit.client.0.smithi077.stdout:9/331: dread d1/dd/f1f [0,4194304] 0 2024-09-18T21:12:50.075 INFO:tasks.workunit.client.1.smithi103.stdout:4/411: chown d9/d1a/d2b/f53 647588486 1 2024-09-18T21:12:50.077 INFO:tasks.workunit.client.1.smithi103.stdout:0/415: creat d1/d9/d3e/d6e/f94 x:0 0 0 2024-09-18T21:12:50.077 INFO:tasks.workunit.client.0.smithi077.stdout:9/332: symlink d1/dd/d1a/l65 0 2024-09-18T21:12:50.078 INFO:tasks.workunit.client.1.smithi103.stdout:8/471: mkdir d4/d2d/d4e/d73/d93 0 2024-09-18T21:12:50.078 INFO:tasks.workunit.client.0.smithi077.stdout:9/333: read d1/dd/d11/d2d/f32 [3356063,103656] 0 2024-09-18T21:12:50.078 INFO:tasks.workunit.client.1.smithi103.stdout:3/437: dwrite d1/d23/d47/f56 [4194304,4194304] 0 2024-09-18T21:12:50.080 INFO:tasks.workunit.client.0.smithi077.stdout:9/334: truncate d1/dd/d11/d1c/d38/d46/f5b 504907 0 2024-09-18T21:12:50.084 INFO:tasks.workunit.client.1.smithi103.stdout:4/412: rename d9/c16 to d9/d38/c8e 0 2024-09-18T21:12:50.084 INFO:tasks.workunit.client.1.smithi103.stdout:4/413: chown d9/d1a/d2b/f35 6976 1 2024-09-18T21:12:50.085 INFO:tasks.workunit.client.1.smithi103.stdout:8/472: symlink d4/d26/d56/d77/l94 0 2024-09-18T21:12:50.086 INFO:tasks.workunit.client.0.smithi077.stdout:9/335: rename d1/dd/d1a/d42/d4b/c4d to d1/dd/d11/d2d/d59/c66 0 2024-09-18T21:12:50.088 INFO:tasks.workunit.client.1.smithi103.stdout:3/438: unlink d1/l4 0 2024-09-18T21:12:50.089 INFO:tasks.workunit.client.1.smithi103.stdout:4/414: creat d9/d38/d72/f8f x:0 0 0 2024-09-18T21:12:50.091 INFO:tasks.workunit.client.1.smithi103.stdout:8/473: creat d4/d81/f95 x:0 0 0 2024-09-18T21:12:50.092 INFO:tasks.workunit.client.1.smithi103.stdout:0/416: truncate d1/d56/f79 1052093 0 2024-09-18T21:12:50.093 INFO:tasks.workunit.client.1.smithi103.stdout:4/415: stat d9/d1c/c2f 0 2024-09-18T21:12:50.095 INFO:tasks.workunit.client.0.smithi077.stdout:9/336: dwrite d1/dd/d11/d2d/f32 [0,4194304] 0 2024-09-18T21:12:50.096 INFO:tasks.workunit.client.1.smithi103.stdout:0/417: symlink d1/d5/de/d22/l95 0 2024-09-18T21:12:50.097 INFO:tasks.workunit.client.1.smithi103.stdout:0/418: stat d1/d5/f44 0 2024-09-18T21:12:50.099 INFO:tasks.workunit.client.0.smithi077.stdout:9/337: creat d1/dd/d11/d1c/d38/d46/f67 x:0 0 0 2024-09-18T21:12:50.099 INFO:tasks.workunit.client.1.smithi103.stdout:0/419: truncate d1/d9/d13/f71 768570 0 2024-09-18T21:12:50.099 INFO:tasks.workunit.client.1.smithi103.stdout:4/416: dwrite d9/d1a/f1e [0,4194304] 0 2024-09-18T21:12:50.101 INFO:tasks.workunit.client.1.smithi103.stdout:8/474: rename d4/d2d/d4e/l54 to d4/de/d4a/d59/l96 0 2024-09-18T21:12:50.104 INFO:tasks.workunit.client.1.smithi103.stdout:3/439: getdents d1/d2/d18 0 2024-09-18T21:12:50.105 INFO:tasks.workunit.client.1.smithi103.stdout:3/440: stat d1/da/df/f79 0 2024-09-18T21:12:50.106 INFO:tasks.workunit.client.1.smithi103.stdout:3/441: write d1/f24 [2367188,15701] 0 2024-09-18T21:12:50.107 INFO:tasks.workunit.client.1.smithi103.stdout:0/420: mkdir d1/d9/d3e/d6e/d96 0 2024-09-18T21:12:50.110 INFO:tasks.workunit.client.1.smithi103.stdout:8/475: creat d4/d26/f97 x:0 0 0 2024-09-18T21:12:50.111 INFO:tasks.workunit.client.1.smithi103.stdout:8/476: chown d4/de/l2b 0 1 2024-09-18T21:12:50.111 INFO:tasks.workunit.client.1.smithi103.stdout:3/442: dread d1/f24 [0,4194304] 0 2024-09-18T21:12:50.112 INFO:tasks.workunit.client.1.smithi103.stdout:3/443: fdatasync d1/d23/d25/d4f/d58/d68/f36 0 2024-09-18T21:12:50.114 INFO:tasks.workunit.client.1.smithi103.stdout:0/421: creat d1/d9/d3e/d6e/f97 x:0 0 0 2024-09-18T21:12:50.116 INFO:tasks.workunit.client.1.smithi103.stdout:0/422: readlink d1/l78 0 2024-09-18T21:12:50.117 INFO:tasks.workunit.client.1.smithi103.stdout:8/477: mkdir d4/d98 0 2024-09-18T21:12:50.117 INFO:tasks.workunit.client.1.smithi103.stdout:4/417: link d9/d38/f45 d9/d38/d72/d85/f90 0 2024-09-18T21:12:50.118 INFO:tasks.workunit.client.1.smithi103.stdout:8/478: fdatasync d4/d2d/d4e/f8c 0 2024-09-18T21:12:50.120 INFO:tasks.workunit.client.1.smithi103.stdout:8/479: mknod d4/de/d4a/d59/d5e/c99 0 2024-09-18T21:12:50.122 INFO:tasks.workunit.client.1.smithi103.stdout:8/480: unlink d4/d81/f7c 0 2024-09-18T21:12:50.123 INFO:tasks.workunit.client.0.smithi077.stdout:9/338: write d1/d54/f44 [1945006,103361] 0 2024-09-18T21:12:50.124 INFO:tasks.workunit.client.0.smithi077.stdout:9/339: readlink d1/dd/d11/d15/l3c 0 2024-09-18T21:12:50.125 INFO:tasks.workunit.client.1.smithi103.stdout:8/481: getdents d4/d2d/d87 0 2024-09-18T21:12:50.127 INFO:tasks.workunit.client.1.smithi103.stdout:8/482: rmdir d4/d26/d56/d77 39 2024-09-18T21:12:50.128 INFO:tasks.workunit.client.1.smithi103.stdout:8/483: read - d4/de/d4a/d59/d5e/f6a zero size 2024-09-18T21:12:50.128 INFO:tasks.workunit.client.0.smithi077.stdout:9/340: dread d1/dd/d1a/f1b [0,4194304] 0 2024-09-18T21:12:50.129 INFO:tasks.workunit.client.1.smithi103.stdout:8/484: write d4/de/f78 [742345,44222] 0 2024-09-18T21:12:50.129 INFO:tasks.workunit.client.1.smithi103.stdout:3/444: write d1/da/f6b [2108568,83207] 0 2024-09-18T21:12:50.136 INFO:tasks.workunit.client.1.smithi103.stdout:4/418: dread d9/d1a/d2b/f53 [4194304,4194304] 0 2024-09-18T21:12:50.136 INFO:tasks.workunit.client.1.smithi103.stdout:0/423: dwrite d1/d9/d13/f1b [0,4194304] 0 2024-09-18T21:12:50.136 INFO:tasks.workunit.client.1.smithi103.stdout:3/445: dread d1/d23/d25/f60 [0,4194304] 0 2024-09-18T21:12:50.138 INFO:tasks.workunit.client.0.smithi077.stdout:9/341: rename d1/dd/d11/d2d/d59/c66 to d1/dd/d11/c68 0 2024-09-18T21:12:50.139 INFO:tasks.workunit.client.0.smithi077.stdout:9/342: readlink d1/dd/d1a/l2a 0 2024-09-18T21:12:50.140 INFO:tasks.workunit.client.0.smithi077.stdout:9/343: fsync d1/dd/d11/d15/f50 0 2024-09-18T21:12:50.141 INFO:tasks.workunit.client.1.smithi103.stdout:8/485: rename d4/d26/d56/f62 to d4/d26/d56/f9a 0 2024-09-18T21:12:50.143 INFO:tasks.workunit.client.1.smithi103.stdout:8/486: chown d4/de/d4a/c6b 366925062 1 2024-09-18T21:12:50.143 INFO:tasks.workunit.client.1.smithi103.stdout:4/419: dwrite d9/d1c/f42 [0,4194304] 0 2024-09-18T21:12:50.144 INFO:tasks.workunit.client.1.smithi103.stdout:3/446: fdatasync d1/da/df/f77 0 2024-09-18T21:12:50.145 INFO:tasks.workunit.client.0.smithi077.stdout:9/344: unlink d1/dd/d11/d2d/l34 0 2024-09-18T21:12:50.146 INFO:tasks.workunit.client.1.smithi103.stdout:8/487: mkdir d4/d2d/d3d/d9b 0 2024-09-18T21:12:50.147 INFO:tasks.workunit.client.1.smithi103.stdout:4/420: mkdir d9/d2e/d61/d91 0 2024-09-18T21:12:50.147 INFO:tasks.workunit.client.1.smithi103.stdout:3/447: fsync d1/da/f16 0 2024-09-18T21:12:50.148 INFO:tasks.workunit.client.0.smithi077.stdout:9/345: rename d1/dd/d11/d15/f50 to d1/dd/d11/d15/f69 0 2024-09-18T21:12:50.149 INFO:tasks.workunit.client.1.smithi103.stdout:3/448: write d1/d23/d25/d4f/d58/d68/d50/f80 [682659,94078] 0 2024-09-18T21:12:50.150 INFO:tasks.workunit.client.1.smithi103.stdout:4/421: truncate d9/d1f/f5c 3110608 0 2024-09-18T21:12:50.151 INFO:tasks.workunit.client.1.smithi103.stdout:4/422: write d9/d1f/f20 [862042,106013] 0 2024-09-18T21:12:50.201 INFO:tasks.workunit.client.1.smithi103.stdout:1/411: sync 2024-09-18T21:12:50.201 INFO:tasks.workunit.client.1.smithi103.stdout:7/381: sync 2024-09-18T21:12:50.201 INFO:tasks.workunit.client.1.smithi103.stdout:2/352: sync 2024-09-18T21:12:50.202 INFO:tasks.workunit.client.1.smithi103.stdout:2/353: write d3/f21 [3411426,7204] 0 2024-09-18T21:12:50.205 INFO:tasks.workunit.client.1.smithi103.stdout:7/382: dwrite d1/fe [0,4194304] 0 2024-09-18T21:12:50.208 INFO:tasks.workunit.client.0.smithi077.stdout:3/372: sync 2024-09-18T21:12:50.211 INFO:tasks.workunit.client.1.smithi103.stdout:3/449: dread d1/d2/d18/d30/f3f [0,4194304] 0 2024-09-18T21:12:50.212 INFO:tasks.workunit.client.1.smithi103.stdout:7/383: dwrite d1/df/d42/d1f/d2e/f50 [0,4194304] 0 2024-09-18T21:12:50.244 INFO:tasks.workunit.client.1.smithi103.stdout:6/422: sync 2024-09-18T21:12:50.244 INFO:tasks.workunit.client.1.smithi103.stdout:5/448: sync 2024-09-18T21:12:50.250 INFO:tasks.workunit.client.1.smithi103.stdout:8/488: mkdir d4/de/d4a/d59/d9c 0 2024-09-18T21:12:50.253 INFO:tasks.workunit.client.0.smithi077.stdout:3/373: symlink db/d14/d22/d36/d39/l7a 0 2024-09-18T21:12:50.254 INFO:tasks.workunit.client.1.smithi103.stdout:8/489: dwrite d4/de/f43 [0,4194304] 0 2024-09-18T21:12:50.260 INFO:tasks.workunit.client.0.smithi077.stdout:3/374: dwrite db/d14/d22/d36/f73 [0,4194304] 0 2024-09-18T21:12:50.261 INFO:tasks.workunit.client.0.smithi077.stdout:3/375: dread - db/f28 zero size 2024-09-18T21:12:50.261 INFO:tasks.workunit.client.0.smithi077.stdout:3/376: fdatasync f3 0 2024-09-18T21:12:50.268 INFO:tasks.workunit.client.0.smithi077.stdout:3/377: dwrite db/d14/f1d [0,4194304] 0 2024-09-18T21:12:50.275 INFO:tasks.workunit.client.0.smithi077.stdout:3/378: dwrite db/d14/d32/d49/d4e/d6a/f46 [0,4194304] 0 2024-09-18T21:12:50.309 INFO:tasks.workunit.client.1.smithi103.stdout:9/432: sync 2024-09-18T21:12:50.309 INFO:tasks.workunit.client.1.smithi103.stdout:0/424: sync 2024-09-18T21:12:50.320 INFO:tasks.workunit.client.1.smithi103.stdout:9/433: dread d18/d8d/d2f/f50 [0,4194304] 0 2024-09-18T21:12:50.340 INFO:tasks.workunit.client.0.smithi077.stdout:9/346: rename d1/dd/d11/d15/f69 to d1/dd/d11/d2d/d59/f6a 0 2024-09-18T21:12:50.342 INFO:tasks.workunit.client.1.smithi103.stdout:1/412: rename d0/d11/d5f/l1c to d0/d3/l8c 0 2024-09-18T21:12:50.344 INFO:tasks.workunit.client.1.smithi103.stdout:2/354: creat d3/d5/d25/f85 x:0 0 0 2024-09-18T21:12:50.346 INFO:tasks.workunit.client.1.smithi103.stdout:3/450: write d1/f13 [554324,61644] 0 2024-09-18T21:12:50.349 INFO:tasks.workunit.client.0.smithi077.stdout:3/379: fsync db/d14/d32/d4f/d71/f67 0 2024-09-18T21:12:50.350 INFO:tasks.workunit.client.1.smithi103.stdout:6/423: fdatasync d2/d3/f6f 0 2024-09-18T21:12:50.350 INFO:tasks.workunit.client.0.smithi077.stdout:3/380: chown db/d14/d22/d36/d39/l7a 3202149 1 2024-09-18T21:12:50.350 INFO:tasks.workunit.client.0.smithi077.stdout:3/381: readlink db/le 0 2024-09-18T21:12:50.351 INFO:tasks.workunit.client.1.smithi103.stdout:6/424: readlink d2/d24/d5a/d67/d76/l32 0 2024-09-18T21:12:50.355 INFO:tasks.workunit.client.1.smithi103.stdout:4/423: link d9/d1c/d77/f59 d9/d38/d58/f92 0 2024-09-18T21:12:50.356 INFO:tasks.workunit.client.1.smithi103.stdout:7/384: write d1/df/d43/f4d [4336689,90142] 0 2024-09-18T21:12:50.357 INFO:tasks.workunit.client.1.smithi103.stdout:8/490: mkdir d4/d81/d71/d7f/d9d 0 2024-09-18T21:12:50.357 INFO:tasks.workunit.client.1.smithi103.stdout:8/491: fdatasync d4/de/f43 0 2024-09-18T21:12:50.358 INFO:tasks.workunit.client.1.smithi103.stdout:0/425: mkdir d1/d5/de/d22/d98 0 2024-09-18T21:12:50.358 INFO:tasks.workunit.client.1.smithi103.stdout:8/492: truncate d4/d81/f92 700093 0 2024-09-18T21:12:50.359 INFO:tasks.workunit.client.1.smithi103.stdout:9/434: chown d18/d8d/c39 602 1 2024-09-18T21:12:50.362 INFO:tasks.workunit.client.1.smithi103.stdout:3/451: truncate d1/d2/d18/d30/f45 1190196 0 2024-09-18T21:12:50.364 INFO:tasks.workunit.client.1.smithi103.stdout:5/449: creat de/d1f/d3b/d51/d57/d79/d8d/f8f x:0 0 0 2024-09-18T21:12:50.364 INFO:tasks.workunit.client.1.smithi103.stdout:0/426: dwrite d1/d9/d13/f71 [0,4194304] 0 2024-09-18T21:12:50.365 INFO:tasks.workunit.client.1.smithi103.stdout:0/427: write d1/f12 [596639,69196] 0 2024-09-18T21:12:50.367 INFO:tasks.workunit.client.0.smithi077.stdout:9/347: creat d1/d54/f6b x:0 0 0 2024-09-18T21:12:50.367 INFO:tasks.workunit.client.1.smithi103.stdout:7/385: fdatasync d1/df/f4c 0 2024-09-18T21:12:50.369 INFO:tasks.workunit.client.1.smithi103.stdout:7/386: dread - d1/df/d42/d29/d2f/d33/f6f zero size 2024-09-18T21:12:50.369 INFO:tasks.workunit.client.0.smithi077.stdout:8/343: sync 2024-09-18T21:12:50.369 INFO:tasks.workunit.client.0.smithi077.stdout:8/344: readlink d2/d5/d6/l59 0 2024-09-18T21:12:50.371 INFO:tasks.workunit.client.0.smithi077.stdout:3/382: link db/d14/d32/d4f/f53 db/d14/d32/f7b 0 2024-09-18T21:12:50.375 INFO:tasks.workunit.client.0.smithi077.stdout:3/383: dread db/f10 [0,4194304] 0 2024-09-18T21:12:50.376 INFO:tasks.workunit.client.0.smithi077.stdout:8/345: creat d2/d5/d6/d22/d4f/f79 x:0 0 0 2024-09-18T21:12:50.378 INFO:tasks.workunit.client.1.smithi103.stdout:9/435: rename d18/d29/c42 to d18/d52/d5e/c93 0 2024-09-18T21:12:50.379 INFO:tasks.workunit.client.0.smithi077.stdout:9/348: mkdir d1/dd/d11/d1c/d38/d46/d55/d6c 0 2024-09-18T21:12:50.380 INFO:tasks.workunit.client.1.smithi103.stdout:3/452: read d1/d23/f63 [545777,42651] 0 2024-09-18T21:12:50.381 INFO:tasks.workunit.client.0.smithi077.stdout:9/349: truncate d1/dd/d11/d1c/d38/f41 8581886 0 2024-09-18T21:12:50.381 INFO:tasks.workunit.client.0.smithi077.stdout:8/346: mkdir d2/d5f/d7a 0 2024-09-18T21:12:50.383 INFO:tasks.workunit.client.1.smithi103.stdout:5/450: fdatasync de/d3e/f17 0 2024-09-18T21:12:50.383 INFO:tasks.workunit.client.1.smithi103.stdout:5/451: stat de/d2d/d7f/f4c 0 2024-09-18T21:12:50.385 INFO:tasks.workunit.client.1.smithi103.stdout:4/424: unlink d9/f2c 0 2024-09-18T21:12:50.388 INFO:tasks.workunit.client.1.smithi103.stdout:0/428: rmdir d1/d5/de/d24/d43/d81 39 2024-09-18T21:12:50.388 INFO:tasks.workunit.client.1.smithi103.stdout:7/387: write d1/df/f18 [2396427,40951] 0 2024-09-18T21:12:50.390 INFO:tasks.workunit.client.1.smithi103.stdout:2/355: creat d3/d5/f86 x:0 0 0 2024-09-18T21:12:50.392 INFO:tasks.workunit.client.1.smithi103.stdout:9/436: creat d18/d52/d6f/d8e/f94 x:0 0 0 2024-09-18T21:12:50.394 INFO:tasks.workunit.client.1.smithi103.stdout:5/452: unlink de/d14/c48 0 2024-09-18T21:12:50.395 INFO:tasks.workunit.client.1.smithi103.stdout:0/429: dwrite d1/d5/de/d19/d1e/f21 [0,4194304] 0 2024-09-18T21:12:50.396 INFO:tasks.workunit.client.1.smithi103.stdout:9/437: read d18/f38 [100328,112487] 0 2024-09-18T21:12:50.397 INFO:tasks.workunit.client.1.smithi103.stdout:1/413: getdents d0/d2/d9/dc/d6e 0 2024-09-18T21:12:50.398 INFO:tasks.workunit.client.1.smithi103.stdout:8/493: dwrite d4/d81/d71/f84 [4194304,4194304] 0 2024-09-18T21:12:50.399 INFO:tasks.workunit.client.1.smithi103.stdout:7/388: dwrite d1/df/d42/f4e [0,4194304] 0 2024-09-18T21:12:50.400 INFO:tasks.workunit.client.1.smithi103.stdout:3/453: rename d1/d2/d18/d30/l43 to d1/d2/d18/l8f 0 2024-09-18T21:12:50.400 INFO:tasks.workunit.client.1.smithi103.stdout:8/494: chown d4/de/d4a/c6b 1337526 1 2024-09-18T21:12:50.403 INFO:tasks.workunit.client.1.smithi103.stdout:2/356: mknod d3/d5/d25/d40/c87 0 2024-09-18T21:12:50.404 INFO:tasks.workunit.client.1.smithi103.stdout:5/453: readlink de/d3e/l5e 0 2024-09-18T21:12:50.406 INFO:tasks.workunit.client.1.smithi103.stdout:1/414: mkdir d0/d2/d9/d10/d8d 0 2024-09-18T21:12:50.406 INFO:tasks.workunit.client.1.smithi103.stdout:9/438: read d18/d52/d5e/f5f [15872,53346] 0 2024-09-18T21:12:50.407 INFO:tasks.workunit.client.1.smithi103.stdout:7/389: stat d1/df/d54 0 2024-09-18T21:12:50.408 INFO:tasks.workunit.client.1.smithi103.stdout:3/454: symlink d1/d23/d25/d4f/d58/l90 0 2024-09-18T21:12:50.411 INFO:tasks.workunit.client.1.smithi103.stdout:9/439: unlink d18/d29/f43 0 2024-09-18T21:12:50.413 INFO:tasks.workunit.client.1.smithi103.stdout:9/440: stat d18/d29/l46 0 2024-09-18T21:12:50.413 INFO:tasks.workunit.client.1.smithi103.stdout:8/495: dwrite d4/d26/f8 [0,4194304] 0 2024-09-18T21:12:50.414 INFO:tasks.workunit.client.1.smithi103.stdout:7/390: unlink d1/f13 0 2024-09-18T21:12:50.416 INFO:tasks.workunit.client.1.smithi103.stdout:1/415: fsync d0/d2/d9/dc/f15 0 2024-09-18T21:12:50.416 INFO:tasks.workunit.client.1.smithi103.stdout:5/454: dread de/d3e/f19 [0,4194304] 0 2024-09-18T21:12:50.417 INFO:tasks.workunit.client.1.smithi103.stdout:9/441: mknod d18/d29/d62/c95 0 2024-09-18T21:12:50.417 INFO:tasks.workunit.client.1.smithi103.stdout:8/496: fsync d4/d81/d65/f31 0 2024-09-18T21:12:50.418 INFO:tasks.workunit.client.1.smithi103.stdout:1/416: fdatasync d0/d2/d9/d10/f67 0 2024-09-18T21:12:50.419 INFO:tasks.workunit.client.1.smithi103.stdout:5/455: unlink de/f36 0 2024-09-18T21:12:50.421 INFO:tasks.workunit.client.1.smithi103.stdout:5/456: write de/d2d/f75 [598092,90061] 0 2024-09-18T21:12:50.423 INFO:tasks.workunit.client.1.smithi103.stdout:1/417: fsync d0/d2/d9/f2f 0 2024-09-18T21:12:50.424 INFO:tasks.workunit.client.1.smithi103.stdout:1/418: chown d0/d2/d9/dc/d36/c3c 681995 1 2024-09-18T21:12:50.425 INFO:tasks.workunit.client.1.smithi103.stdout:5/457: creat de/d1f/d3b/d3c/f90 x:0 0 0 2024-09-18T21:12:50.426 INFO:tasks.workunit.client.1.smithi103.stdout:8/497: link d4/d2d/d4e/l63 d4/d2d/d87/l9e 0 2024-09-18T21:12:50.427 INFO:tasks.workunit.client.1.smithi103.stdout:1/419: fsync d0/d2/d9/f59 0 2024-09-18T21:12:50.427 INFO:tasks.workunit.client.1.smithi103.stdout:8/498: write d4/d81/d65/d39/f8a [936296,90305] 0 2024-09-18T21:12:50.429 INFO:tasks.workunit.client.1.smithi103.stdout:5/458: symlink de/d3e/l91 0 2024-09-18T21:12:50.430 INFO:tasks.workunit.client.1.smithi103.stdout:1/420: rmdir d0/d2/d9/dc/d36 39 2024-09-18T21:12:50.431 INFO:tasks.workunit.client.1.smithi103.stdout:8/499: fdatasync d4/de/d4a/f66 0 2024-09-18T21:12:50.432 INFO:tasks.workunit.client.1.smithi103.stdout:5/459: mknod de/d1f/d3b/d3c/d62/c92 0 2024-09-18T21:12:50.433 INFO:tasks.workunit.client.1.smithi103.stdout:5/460: dread - de/d1f/d3b/d51/d57/d79/d8d/f8f zero size 2024-09-18T21:12:50.434 INFO:tasks.workunit.client.1.smithi103.stdout:1/421: mknod d0/d2/d2b/d85/c8e 0 2024-09-18T21:12:50.438 INFO:tasks.workunit.client.0.smithi077.stdout:3/384: mknod db/d14/d32/d4f/c7c 0 2024-09-18T21:12:50.439 INFO:tasks.workunit.client.1.smithi103.stdout:8/500: mkdir d4/d26/d56/d77/d9f 0 2024-09-18T21:12:50.440 INFO:tasks.workunit.client.0.smithi077.stdout:8/347: dread - d2/d5/d6/d22/d4f/d5a/d2a/d67/f73 zero size 2024-09-18T21:12:50.441 INFO:tasks.workunit.client.1.smithi103.stdout:1/422: creat d0/d2/d2b/d3a/d42/d72/f8f x:0 0 0 2024-09-18T21:12:50.443 INFO:tasks.workunit.client.0.smithi077.stdout:9/350: dwrite d1/dd/f5a [0,4194304] 0 2024-09-18T21:12:50.445 INFO:tasks.workunit.client.1.smithi103.stdout:3/455: stat d1/d2/d18/d30/d4e/c57 0 2024-09-18T21:12:50.445 INFO:tasks.workunit.client.1.smithi103.stdout:8/501: dwrite d4/d26/f8 [0,4194304] 0 2024-09-18T21:12:50.446 INFO:tasks.workunit.client.1.smithi103.stdout:8/502: write d4/de/d4a/d59/d5e/f85 [425536,22730] 0 2024-09-18T21:12:50.454 INFO:tasks.workunit.client.1.smithi103.stdout:1/423: mknod d0/d2/d9/d10/d8d/c90 0 2024-09-18T21:12:50.455 INFO:tasks.workunit.client.1.smithi103.stdout:8/503: mkdir d4/d2d/d3d/da0 0 2024-09-18T21:12:50.455 INFO:tasks.workunit.client.1.smithi103.stdout:3/456: rename d1/d23/d25/d4f/c6f to d1/d23/d25/d4f/d58/d86/c91 0 2024-09-18T21:12:50.458 INFO:tasks.workunit.client.1.smithi103.stdout:1/424: write d0/d2/d9/d10/d5d/f88 [269234,72700] 0 2024-09-18T21:12:50.461 INFO:tasks.workunit.client.1.smithi103.stdout:1/425: fsync d0/d2/d9/dc/f69 0 2024-09-18T21:12:50.462 INFO:tasks.workunit.client.1.smithi103.stdout:0/430: dwrite d1/d5/de/d19/d1e/f1f [0,4194304] 0 2024-09-18T21:12:50.463 INFO:tasks.workunit.client.1.smithi103.stdout:2/357: dwrite d3/d5/d2f/d5b/f75 [0,4194304] 0 2024-09-18T21:12:50.464 INFO:tasks.workunit.client.1.smithi103.stdout:7/391: write d1/df/d42/d29/d2f/d33/f40 [146833,32867] 0 2024-09-18T21:12:50.465 INFO:tasks.workunit.client.1.smithi103.stdout:7/392: stat d1/c4 0 2024-09-18T21:12:50.466 INFO:tasks.workunit.client.1.smithi103.stdout:3/457: dread d1/d23/d25/f4c [0,4194304] 0 2024-09-18T21:12:50.467 INFO:tasks.workunit.client.1.smithi103.stdout:1/426: creat d0/d2/d2b/d3a/f91 x:0 0 0 2024-09-18T21:12:50.468 INFO:tasks.workunit.client.1.smithi103.stdout:2/358: rename d3/d5/f28 to d3/d5/d2c/f88 0 2024-09-18T21:12:50.470 INFO:tasks.workunit.client.1.smithi103.stdout:2/359: chown d3/d5/d2f/d32/f7d 3892 1 2024-09-18T21:12:50.472 INFO:tasks.workunit.client.1.smithi103.stdout:0/431: dwrite d1/d9/d3e/f67 [0,4194304] 0 2024-09-18T21:12:50.473 INFO:tasks.workunit.client.1.smithi103.stdout:3/458: readlink d1/d2/d18/d30/l8b 0 2024-09-18T21:12:50.473 INFO:tasks.workunit.client.1.smithi103.stdout:5/461: write de/d14/d33/d4f/f6a [1415470,90309] 0 2024-09-18T21:12:50.473 INFO:tasks.workunit.client.1.smithi103.stdout:2/360: truncate d3/d5/d25/d40/f49 4835509 0 2024-09-18T21:12:50.473 INFO:tasks.workunit.client.1.smithi103.stdout:0/432: read - d1/d5/de/d19/d1e/f5f zero size 2024-09-18T21:12:50.477 INFO:tasks.workunit.client.1.smithi103.stdout:7/393: truncate d1/df/f20 786578 0 2024-09-18T21:12:50.478 INFO:tasks.workunit.client.1.smithi103.stdout:7/394: chown d1/f21 0 1 2024-09-18T21:12:50.482 INFO:tasks.workunit.client.1.smithi103.stdout:2/361: fsync d3/d5/f61 0 2024-09-18T21:12:50.483 INFO:tasks.workunit.client.1.smithi103.stdout:2/362: write d3/d5/d2c/f50 [1248311,3144] 0 2024-09-18T21:12:50.483 INFO:tasks.workunit.client.1.smithi103.stdout:1/427: creat d0/d2/d9/f92 x:0 0 0 2024-09-18T21:12:50.484 INFO:tasks.workunit.client.1.smithi103.stdout:1/428: fsync d0/d3/f4c 0 2024-09-18T21:12:50.485 INFO:tasks.workunit.client.1.smithi103.stdout:1/429: dread - d0/d3/f66 zero size 2024-09-18T21:12:50.485 INFO:tasks.workunit.client.1.smithi103.stdout:1/430: readlink d0/d3/l5b 0 2024-09-18T21:12:50.490 INFO:tasks.workunit.client.1.smithi103.stdout:1/431: fsync d0/d11/f35 0 2024-09-18T21:12:50.491 INFO:tasks.workunit.client.1.smithi103.stdout:8/504: creat d4/d26/d56/d77/fa1 x:0 0 0 2024-09-18T21:12:50.492 INFO:tasks.workunit.client.1.smithi103.stdout:8/505: chown d4/d26/d56/c60 22212377 1 2024-09-18T21:12:50.492 INFO:tasks.workunit.client.1.smithi103.stdout:2/363: mkdir d3/d5/d89 0 2024-09-18T21:12:50.493 INFO:tasks.workunit.client.1.smithi103.stdout:8/506: chown d4/d2d/d4e/d73/l8e 182522 1 2024-09-18T21:12:50.493 INFO:tasks.workunit.client.1.smithi103.stdout:0/433: rename d1/d5/de/d19/d1e/c5e to d1/d5/de/d24/d43/d81/c99 0 2024-09-18T21:12:50.493 INFO:tasks.workunit.client.1.smithi103.stdout:2/364: write d3/d5/d2f/d5b/f6c [294953,126851] 0 2024-09-18T21:12:50.494 INFO:tasks.workunit.client.1.smithi103.stdout:0/434: chown d1/d9/d13/f71 3 1 2024-09-18T21:12:50.495 INFO:tasks.workunit.client.1.smithi103.stdout:1/432: creat d0/d11/d5f/f93 x:0 0 0 2024-09-18T21:12:50.495 INFO:tasks.workunit.client.1.smithi103.stdout:5/462: link c6 de/d1f/d3b/d58/c93 0 2024-09-18T21:12:50.497 INFO:tasks.workunit.client.1.smithi103.stdout:8/507: unlink d4/de/l35 0 2024-09-18T21:12:50.499 INFO:tasks.workunit.client.1.smithi103.stdout:8/508: chown d4/d81/d65/d39/l72 200972382 1 2024-09-18T21:12:50.500 INFO:tasks.workunit.client.1.smithi103.stdout:1/433: rmdir d0/d2/d2b/d3a/d42/d72 39 2024-09-18T21:12:50.501 INFO:tasks.workunit.client.1.smithi103.stdout:2/365: dwrite d3/d5/d25/f37 [0,4194304] 0 2024-09-18T21:12:50.501 INFO:tasks.workunit.client.1.smithi103.stdout:8/509: read d4/d81/f92 [49049,110344] 0 2024-09-18T21:12:50.502 INFO:tasks.workunit.client.1.smithi103.stdout:0/435: unlink d1/d5/de/d22/d42/f51 0 2024-09-18T21:12:50.502 INFO:tasks.workunit.client.1.smithi103.stdout:8/510: chown d4/d26/c7d 1307 1 2024-09-18T21:12:50.504 INFO:tasks.workunit.client.1.smithi103.stdout:8/511: dread d4/d81/f92 [0,4194304] 0 2024-09-18T21:12:50.506 INFO:tasks.workunit.client.1.smithi103.stdout:8/512: read d4/de/f78 [150441,52159] 0 2024-09-18T21:12:50.507 INFO:tasks.workunit.client.1.smithi103.stdout:3/459: dread d1/f3c [0,4194304] 0 2024-09-18T21:12:50.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:50 smithi103 ceph-mon[34827]: pgmap v16: 65 pgs: 65 active+clean; 1.5 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 43 MiB/s rd, 199 MiB/s wr, 353 op/s 2024-09-18T21:12:50.514 INFO:tasks.workunit.client.1.smithi103.stdout:3/460: readlink d1/da/d7a/l7c 0 2024-09-18T21:12:50.514 INFO:tasks.workunit.client.1.smithi103.stdout:8/513: dwrite d4/d81/d65/d39/f8a [0,4194304] 0 2024-09-18T21:12:50.516 INFO:tasks.workunit.client.1.smithi103.stdout:7/395: dwrite d1/df/d42/f2b [0,4194304] 0 2024-09-18T21:12:50.516 INFO:tasks.workunit.client.1.smithi103.stdout:7/396: fdatasync d1/f4b 0 2024-09-18T21:12:50.517 INFO:tasks.workunit.client.1.smithi103.stdout:7/397: chown d1/c2c 60 1 2024-09-18T21:12:50.539 INFO:tasks.workunit.client.0.smithi077.stdout:5/535: sync 2024-09-18T21:12:50.539 INFO:tasks.workunit.client.0.smithi077.stdout:6/403: sync 2024-09-18T21:12:50.544 INFO:tasks.workunit.client.1.smithi103.stdout:6/425: sync 2024-09-18T21:12:50.544 INFO:tasks.workunit.client.1.smithi103.stdout:6/426: readlink d2/d3/d8/d4c/d4e/l52 0 2024-09-18T21:12:50.546 INFO:tasks.workunit.client.1.smithi103.stdout:6/427: write d2/d3/d8/d4c/f71 [347527,101364] 0 2024-09-18T21:12:50.546 INFO:tasks.workunit.client.0.smithi077.stdout:8/348: fsync d2/d27/d29/f68 0 2024-09-18T21:12:50.547 INFO:tasks.workunit.client.0.smithi077.stdout:9/351: write d1/d54/f21 [2471542,113077] 0 2024-09-18T21:12:50.548 INFO:tasks.workunit.client.1.smithi103.stdout:2/366: rmdir d3/d5/d89 0 2024-09-18T21:12:50.549 INFO:tasks.workunit.client.0.smithi077.stdout:5/536: truncate d0/df/d10/f7 5446855 0 2024-09-18T21:12:50.551 INFO:tasks.workunit.client.0.smithi077.stdout:9/352: write d1/d54/f5c [776192,92133] 0 2024-09-18T21:12:50.552 INFO:tasks.workunit.client.1.smithi103.stdout:3/461: creat d1/d23/d25/f92 x:0 0 0 2024-09-18T21:12:50.553 INFO:tasks.workunit.client.1.smithi103.stdout:5/463: truncate de/d14/d33/d4f/f6a 506513 0 2024-09-18T21:12:50.553 INFO:tasks.workunit.client.1.smithi103.stdout:5/464: stat de/f2b 0 2024-09-18T21:12:50.556 INFO:tasks.workunit.client.0.smithi077.stdout:8/349: dwrite d2/d36/f6a [0,4194304] 0 2024-09-18T21:12:50.558 INFO:tasks.workunit.client.1.smithi103.stdout:7/398: creat d1/df/d43/d52/f76 x:0 0 0 2024-09-18T21:12:50.559 INFO:tasks.workunit.client.1.smithi103.stdout:6/428: dread d2/d24/d5a/f17 [0,4194304] 0 2024-09-18T21:12:50.559 INFO:tasks.workunit.client.0.smithi077.stdout:3/385: dread db/d14/d22/f75 [0,4194304] 0 2024-09-18T21:12:50.565 INFO:tasks.workunit.client.1.smithi103.stdout:2/367: creat d3/d5/d2c/d54/d68/f8a x:0 0 0 2024-09-18T21:12:50.565 INFO:tasks.workunit.client.1.smithi103.stdout:1/434: link d0/d2/l55 d0/d2/d9/dc/l94 0 2024-09-18T21:12:50.567 INFO:tasks.workunit.client.1.smithi103.stdout:7/399: dwrite d1/df/d43/d63/d67/d5b/f70 [0,4194304] 0 2024-09-18T21:12:50.568 INFO:tasks.workunit.client.1.smithi103.stdout:8/514: symlink d4/d26/d56/d77/d9f/la2 0 2024-09-18T21:12:50.568 INFO:tasks.workunit.client.0.smithi077.stdout:9/353: getdents d1/d54/d51 0 2024-09-18T21:12:50.569 INFO:tasks.workunit.client.1.smithi103.stdout:6/429: dwrite d2/d3/d8/d4c/d4e/f70 [0,4194304] 0 2024-09-18T21:12:50.570 INFO:tasks.workunit.client.0.smithi077.stdout:3/386: fsync db/d14/d32/f55 0 2024-09-18T21:12:50.571 INFO:tasks.workunit.client.1.smithi103.stdout:5/465: mknod de/d1f/d3b/d51/d57/d79/c94 0 2024-09-18T21:12:50.571 INFO:tasks.workunit.client.1.smithi103.stdout:6/430: chown d2/f28 18 1 2024-09-18T21:12:50.572 INFO:tasks.workunit.client.0.smithi077.stdout:6/404: link d7/d7e/d11/d25/l5e d7/d7e/d11/d1d/d5c/l89 0 2024-09-18T21:12:50.573 INFO:tasks.workunit.client.0.smithi077.stdout:3/387: write db/d14/d22/f2f [535005,58805] 0 2024-09-18T21:12:50.574 INFO:tasks.workunit.client.0.smithi077.stdout:8/350: mknod d2/d5f/d7a/c7b 0 2024-09-18T21:12:50.574 INFO:tasks.workunit.client.1.smithi103.stdout:0/436: getdents d1/d5/de/d24/d43 0 2024-09-18T21:12:50.575 INFO:tasks.workunit.client.0.smithi077.stdout:5/537: dwrite d0/d6/dd/f11 [0,4194304] 0 2024-09-18T21:12:50.575 INFO:tasks.workunit.client.1.smithi103.stdout:7/400: write d1/df/f4c [595986,57895] 0 2024-09-18T21:12:50.576 INFO:tasks.workunit.client.1.smithi103.stdout:0/437: chown d1/d5/de/d22/d42 15 1 2024-09-18T21:12:50.577 INFO:tasks.workunit.client.0.smithi077.stdout:9/354: fdatasync d1/dd/d1a/f23 0 2024-09-18T21:12:50.578 INFO:tasks.workunit.client.0.smithi077.stdout:5/538: fsync d0/d6/d3b/f4e 0 2024-09-18T21:12:50.582 INFO:tasks.workunit.client.0.smithi077.stdout:5/539: dread - d0/d6/d3b/f8f zero size 2024-09-18T21:12:50.584 INFO:tasks.workunit.client.1.smithi103.stdout:2/368: mknod d3/d5/d2c/d54/d68/c8b 0 2024-09-18T21:12:50.585 INFO:tasks.workunit.client.0.smithi077.stdout:6/405: creat d7/d7e/d11/d1d/d4c/f8a x:0 0 0 2024-09-18T21:12:50.585 INFO:tasks.workunit.client.0.smithi077.stdout:3/388: dwrite db/d14/d32/d4f/f60 [0,4194304] 0 2024-09-18T21:12:50.586 INFO:tasks.workunit.client.1.smithi103.stdout:1/435: creat d0/d2/d9/d10/d5d/f95 x:0 0 0 2024-09-18T21:12:50.587 INFO:tasks.workunit.client.1.smithi103.stdout:4/425: sync 2024-09-18T21:12:50.588 INFO:tasks.workunit.client.1.smithi103.stdout:7/401: dread d1/df/d42/d29/d2f/d33/f3e [0,4194304] 0 2024-09-18T21:12:50.588 INFO:tasks.workunit.client.1.smithi103.stdout:8/515: symlink d4/d26/d56/d77/d9f/la3 0 2024-09-18T21:12:50.589 INFO:tasks.workunit.client.1.smithi103.stdout:5/466: symlink de/d14/d33/l95 0 2024-09-18T21:12:50.590 INFO:tasks.workunit.client.1.smithi103.stdout:8/516: dread - d4/d26/f97 zero size 2024-09-18T21:12:50.592 INFO:tasks.workunit.client.0.smithi077.stdout:8/351: fdatasync d2/d27/d29/f43 0 2024-09-18T21:12:50.594 INFO:tasks.workunit.client.1.smithi103.stdout:0/438: unlink d1/d5/de/d19/d1e/d34/f5a 0 2024-09-18T21:12:50.595 INFO:tasks.workunit.client.0.smithi077.stdout:3/389: mknod db/d4d/c7d 0 2024-09-18T21:12:50.597 INFO:tasks.workunit.client.0.smithi077.stdout:6/406: creat d7/d7e/d11/d3e/d42/f8b x:0 0 0 2024-09-18T21:12:50.598 INFO:tasks.workunit.client.1.smithi103.stdout:0/439: dread - d1/d5/de/d24/f61 zero size 2024-09-18T21:12:50.598 INFO:tasks.workunit.client.0.smithi077.stdout:9/355: mknod d1/dd/d57/c6d 0 2024-09-18T21:12:50.599 INFO:tasks.workunit.client.1.smithi103.stdout:6/431: mknod d2/d24/d38/d68/d7c/c83 0 2024-09-18T21:12:50.599 INFO:tasks.workunit.client.1.smithi103.stdout:1/436: dwrite d0/d2/d9/d10/d5d/f95 [0,4194304] 0 2024-09-18T21:12:50.600 INFO:tasks.workunit.client.0.smithi077.stdout:3/390: creat db/d14/d32/d4f/d71/d3b/f7e x:0 0 0 2024-09-18T21:12:50.601 INFO:tasks.workunit.client.1.smithi103.stdout:0/440: fsync d1/d9/d3e/d6e/f94 0 2024-09-18T21:12:50.601 INFO:tasks.workunit.client.1.smithi103.stdout:7/402: dwrite d1/df/d42/d1f/d2e/d3f/f4a [0,4194304] 0 2024-09-18T21:12:50.601 INFO:tasks.workunit.client.1.smithi103.stdout:8/517: symlink d4/d81/d65/la4 0 2024-09-18T21:12:50.602 INFO:tasks.workunit.client.0.smithi077.stdout:8/352: mknod d2/d5/c7c 0 2024-09-18T21:12:50.602 INFO:tasks.workunit.client.1.smithi103.stdout:8/518: dread - d4/d26/f97 zero size 2024-09-18T21:12:50.604 INFO:tasks.workunit.client.0.smithi077.stdout:6/407: symlink d7/d7e/d11/d1d/d31/l8c 0 2024-09-18T21:12:50.606 INFO:tasks.workunit.client.0.smithi077.stdout:6/408: stat d7/d7e/d11/d3e/f78 0 2024-09-18T21:12:50.608 INFO:tasks.workunit.client.0.smithi077.stdout:9/356: rmdir d1/dd/d11/d1c/d38 39 2024-09-18T21:12:50.610 INFO:tasks.workunit.client.0.smithi077.stdout:3/391: dwrite db/d14/d32/d4f/d71/f67 [0,4194304] 0 2024-09-18T21:12:50.612 INFO:tasks.workunit.client.1.smithi103.stdout:2/369: mknod d3/d5/c8c 0 2024-09-18T21:12:50.614 INFO:tasks.workunit.client.0.smithi077.stdout:9/357: truncate d1/d54/d27/f64 976807 0 2024-09-18T21:12:50.614 INFO:tasks.workunit.client.0.smithi077.stdout:5/540: getdents d0/d6/d3b/d64/d95 0 2024-09-18T21:12:50.615 INFO:tasks.workunit.client.1.smithi103.stdout:1/437: rmdir d0/d2/d2b/d3a/d42 39 2024-09-18T21:12:50.615 INFO:tasks.workunit.client.1.smithi103.stdout:3/462: truncate d1/d23/d47/f56 8003904 0 2024-09-18T21:12:50.616 INFO:tasks.workunit.client.1.smithi103.stdout:1/438: dread - d0/d2/d2b/d3a/f91 zero size 2024-09-18T21:12:50.617 INFO:tasks.workunit.client.1.smithi103.stdout:0/441: fdatasync d1/d5/d4c/d4e/f85 0 2024-09-18T21:12:50.617 INFO:tasks.workunit.client.0.smithi077.stdout:6/409: symlink d7/d7e/d11/d25/l8d 0 2024-09-18T21:12:50.618 INFO:tasks.workunit.client.1.smithi103.stdout:4/426: dread d9/d38/f7a [0,4194304] 0 2024-09-18T21:12:50.618 INFO:tasks.workunit.client.0.smithi077.stdout:6/410: chown d7/d7e/d11/d1d/d49/d55/l73 7012 1 2024-09-18T21:12:50.619 INFO:tasks.workunit.client.1.smithi103.stdout:4/427: chown d9/f11 1515119 1 2024-09-18T21:12:50.619 INFO:tasks.workunit.client.1.smithi103.stdout:3/463: read d1/d2/f4b [333798,48843] 0 2024-09-18T21:12:50.619 INFO:tasks.workunit.client.0.smithi077.stdout:6/411: write d7/d7e/d11/d1d/d49/d55/f68 [769467,19541] 0 2024-09-18T21:12:50.620 INFO:tasks.workunit.client.0.smithi077.stdout:6/412: chown d7/d7e/c62 12 1 2024-09-18T21:12:50.621 INFO:tasks.workunit.client.0.smithi077.stdout:3/392: rename f5 to db/d14/d22/d36/f7f 0 2024-09-18T21:12:50.624 INFO:tasks.workunit.client.1.smithi103.stdout:2/370: creat d3/d5/d4a/d56/f8d x:0 0 0 2024-09-18T21:12:50.626 INFO:tasks.workunit.client.0.smithi077.stdout:8/353: creat d2/d5/d6/d22/d20/f7d x:0 0 0 2024-09-18T21:12:50.627 INFO:tasks.workunit.client.1.smithi103.stdout:8/519: unlink d4/c23 0 2024-09-18T21:12:50.628 INFO:tasks.workunit.client.1.smithi103.stdout:8/520: stat d4/de/l12 0 2024-09-18T21:12:50.629 INFO:tasks.workunit.client.0.smithi077.stdout:5/541: dread d0/d6/f3c [0,4194304] 0 2024-09-18T21:12:50.632 INFO:tasks.workunit.client.1.smithi103.stdout:8/521: dread d4/de/d4a/f66 [0,4194304] 0 2024-09-18T21:12:50.632 INFO:tasks.workunit.client.1.smithi103.stdout:8/522: chown d4/d81/d71/d7f/c91 2397460 1 2024-09-18T21:12:50.637 INFO:tasks.workunit.client.1.smithi103.stdout:2/371: truncate d3/d5/f18 4128813 0 2024-09-18T21:12:50.638 INFO:tasks.workunit.client.0.smithi077.stdout:8/354: mkdir d2/d5/d6/d7e 0 2024-09-18T21:12:50.638 INFO:tasks.workunit.client.1.smithi103.stdout:6/432: dread d2/d3/d8/f10 [0,4194304] 0 2024-09-18T21:12:50.639 INFO:tasks.workunit.client.0.smithi077.stdout:6/413: creat d7/d7e/d11/f8e x:0 0 0 2024-09-18T21:12:50.641 INFO:tasks.workunit.client.1.smithi103.stdout:2/372: dread d3/d5/d2f/d5b/f6c [0,4194304] 0 2024-09-18T21:12:50.641 INFO:tasks.workunit.client.1.smithi103.stdout:5/467: dread de/d14/d33/d4f/f6a [0,4194304] 0 2024-09-18T21:12:50.641 INFO:tasks.workunit.client.0.smithi077.stdout:5/542: getdents d0/d6/dd/d5d/d91 0 2024-09-18T21:12:50.642 INFO:tasks.workunit.client.1.smithi103.stdout:5/468: chown de/f16 3150 1 2024-09-18T21:12:50.642 INFO:tasks.workunit.client.0.smithi077.stdout:5/543: write d0/df/f27 [354458,59609] 0 2024-09-18T21:12:50.644 INFO:tasks.workunit.client.1.smithi103.stdout:3/464: unlink d1/da/f3d 0 2024-09-18T21:12:50.647 INFO:tasks.workunit.client.0.smithi077.stdout:6/414: mknod d7/d7e/d11/d1d/d4c/c8f 0 2024-09-18T21:12:50.650 INFO:tasks.workunit.client.0.smithi077.stdout:3/393: dread db/d14/d22/d36/d39/f47 [0,4194304] 0 2024-09-18T21:12:50.651 INFO:tasks.workunit.client.1.smithi103.stdout:0/442: creat d1/f9a x:0 0 0 2024-09-18T21:12:50.652 INFO:tasks.workunit.client.1.smithi103.stdout:1/439: write d0/ff [1288197,61701] 0 2024-09-18T21:12:50.654 INFO:tasks.workunit.client.1.smithi103.stdout:4/428: dwrite d9/f18 [0,4194304] 0 2024-09-18T21:12:50.657 INFO:tasks.workunit.client.1.smithi103.stdout:7/403: getdents d1/df/d54 0 2024-09-18T21:12:50.657 INFO:tasks.workunit.client.0.smithi077.stdout:3/394: mknod db/d14/d32/d4f/d71/d3b/c80 0 2024-09-18T21:12:50.659 INFO:tasks.workunit.client.0.smithi077.stdout:3/395: chown db/d14/d22/d36/d39/l48 162842 1 2024-09-18T21:12:50.660 INFO:tasks.workunit.client.0.smithi077.stdout:3/396: read db/f13 [2094494,40074] 0 2024-09-18T21:12:50.661 INFO:tasks.workunit.client.1.smithi103.stdout:2/373: creat d3/d5/d25/f8e x:0 0 0 2024-09-18T21:12:50.661 INFO:tasks.workunit.client.1.smithi103.stdout:3/465: dread d1/d23/d25/d4f/d58/d68/f36 [0,4194304] 0 2024-09-18T21:12:50.665 INFO:tasks.workunit.client.1.smithi103.stdout:0/443: read - d1/d5/d4c/f86 zero size 2024-09-18T21:12:50.665 INFO:tasks.workunit.client.1.smithi103.stdout:2/374: dread d3/d5/d2c/f65 [0,4194304] 0 2024-09-18T21:12:50.666 INFO:tasks.workunit.client.0.smithi077.stdout:3/397: unlink db/d14/d32/d49/f77 0 2024-09-18T21:12:50.668 INFO:tasks.workunit.client.0.smithi077.stdout:8/355: dwrite d2/d5/d6/d22/d18/f4c [4194304,4194304] 0 2024-09-18T21:12:50.668 INFO:tasks.workunit.client.0.smithi077.stdout:5/544: link d0/df/d10/l34 d0/d6/d3b/lb7 0 2024-09-18T21:12:50.669 INFO:tasks.workunit.client.1.smithi103.stdout:1/440: mknod d0/d2/d9/d10/d8d/c96 0 2024-09-18T21:12:50.670 INFO:tasks.workunit.client.0.smithi077.stdout:8/356: dread - d2/d5/d6/d22/d20/f7d zero size 2024-09-18T21:12:50.670 INFO:tasks.workunit.client.0.smithi077.stdout:3/398: read db/f29 [4021247,72283] 0 2024-09-18T21:12:50.674 INFO:tasks.workunit.client.0.smithi077.stdout:6/415: getdents d7/d7e/d11/d1d 0 2024-09-18T21:12:50.678 INFO:tasks.workunit.client.0.smithi077.stdout:8/357: symlink d2/d27/d29/l7f 0 2024-09-18T21:12:50.679 INFO:tasks.workunit.client.0.smithi077.stdout:3/399: symlink db/d4d/l81 0 2024-09-18T21:12:50.682 INFO:tasks.workunit.client.1.smithi103.stdout:9/442: sync 2024-09-18T21:12:50.683 INFO:tasks.workunit.client.0.smithi077.stdout:6/416: creat d7/d7e/d11/d3e/d42/d88/f90 x:0 0 0 2024-09-18T21:12:50.684 INFO:tasks.workunit.client.1.smithi103.stdout:2/375: creat d3/d5/d2f/d32/f8f x:0 0 0 2024-09-18T21:12:50.684 INFO:tasks.workunit.client.0.smithi077.stdout:6/417: dread - d7/d7e/d11/d3e/f76 zero size 2024-09-18T21:12:50.685 INFO:tasks.workunit.client.0.smithi077.stdout:3/400: creat db/d14/d32/d4f/f82 x:0 0 0 2024-09-18T21:12:50.685 INFO:tasks.workunit.client.1.smithi103.stdout:5/469: link de/d1f/d3b/d51/c73 de/d1f/d3b/d51/d57/c96 0 2024-09-18T21:12:50.687 INFO:tasks.workunit.client.1.smithi103.stdout:8/523: getdents d4/de/d4a 0 2024-09-18T21:12:50.688 INFO:tasks.workunit.client.0.smithi077.stdout:6/418: creat d7/d7e/d11/d1d/d5c/f91 x:0 0 0 2024-09-18T21:12:50.688 INFO:tasks.workunit.client.1.smithi103.stdout:1/441: dwrite d0/d2/d9/dc/f22 [0,4194304] 0 2024-09-18T21:12:50.688 INFO:tasks.workunit.client.1.smithi103.stdout:3/466: truncate d1/da/df/f19 4037910 0 2024-09-18T21:12:50.689 INFO:tasks.workunit.client.0.smithi077.stdout:6/419: fdatasync d7/d7e/d11/d1d/f77 0 2024-09-18T21:12:50.689 INFO:tasks.workunit.client.0.smithi077.stdout:3/401: symlink db/d14/d22/d36/d39/l83 0 2024-09-18T21:12:50.690 INFO:tasks.workunit.client.0.smithi077.stdout:3/402: write db/d14/d22/d36/d39/f45 [1071450,11524] 0 2024-09-18T21:12:50.691 INFO:tasks.workunit.client.1.smithi103.stdout:6/433: link d2/d3/c5c d2/d24/d5a/c84 0 2024-09-18T21:12:50.691 INFO:tasks.workunit.client.1.smithi103.stdout:1/442: dread - d0/d3/f66 zero size 2024-09-18T21:12:50.691 INFO:tasks.workunit.client.1.smithi103.stdout:9/443: mkdir d18/d52/d6f/d8e/d96 0 2024-09-18T21:12:50.691 INFO:tasks.workunit.client.0.smithi077.stdout:6/420: chown d7/d7e/c43 250 1 2024-09-18T21:12:50.691 INFO:tasks.workunit.client.1.smithi103.stdout:4/429: dwrite d9/d1a/d21/f33 [0,4194304] 0 2024-09-18T21:12:50.693 INFO:tasks.workunit.client.1.smithi103.stdout:9/444: stat d18/d52/c7a 0 2024-09-18T21:12:50.695 INFO:tasks.workunit.client.1.smithi103.stdout:5/470: creat de/d14/d33/f97 x:0 0 0 2024-09-18T21:12:50.695 INFO:tasks.workunit.client.1.smithi103.stdout:4/430: readlink d9/d1a/d41/l62 0 2024-09-18T21:12:50.697 INFO:tasks.workunit.client.0.smithi077.stdout:5/545: write d0/f18 [2974384,19934] 0 2024-09-18T21:12:50.697 INFO:tasks.workunit.client.1.smithi103.stdout:8/524: dread d4/de/d4a/d59/d5e/f85 [0,4194304] 0 2024-09-18T21:12:50.698 INFO:tasks.workunit.client.0.smithi077.stdout:6/421: truncate d7/d7e/d11/d25/f47 282854 0 2024-09-18T21:12:50.700 INFO:tasks.workunit.client.0.smithi077.stdout:6/422: write d7/d7e/d11/d3e/f51 [741130,57702] 0 2024-09-18T21:12:50.700 INFO:tasks.workunit.client.1.smithi103.stdout:8/525: write d4/d81/d71/f7e [3795187,37611] 0 2024-09-18T21:12:50.701 INFO:tasks.workunit.client.0.smithi077.stdout:6/423: chown d7/d7e/d11/d1d/d49/d55/l73 1 1 2024-09-18T21:12:50.704 INFO:tasks.workunit.client.1.smithi103.stdout:4/431: dwrite d9/d2e/d61/f76 [0,4194304] 0 2024-09-18T21:12:50.705 INFO:tasks.workunit.client.0.smithi077.stdout:6/424: fdatasync d7/d7e/d11/d25/f26 0 2024-09-18T21:12:50.708 INFO:tasks.workunit.client.1.smithi103.stdout:9/445: creat d18/d8d/d2f/f97 x:0 0 0 2024-09-18T21:12:50.709 INFO:tasks.workunit.client.0.smithi077.stdout:5/546: creat d0/d6/daa/fb8 x:0 0 0 2024-09-18T21:12:50.709 INFO:tasks.workunit.client.0.smithi077.stdout:8/358: dwrite d2/d5/d6/f2c [0,4194304] 0 2024-09-18T21:12:50.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:50 smithi077 ceph-mon[27689]: pgmap v16: 65 pgs: 65 active+clean; 1.5 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 43 MiB/s rd, 199 MiB/s wr, 353 op/s 2024-09-18T21:12:50.714 INFO:tasks.workunit.client.0.smithi077.stdout:6/425: unlink d7/d7e/d11/d25/f81 0 2024-09-18T21:12:50.717 INFO:tasks.workunit.client.1.smithi103.stdout:6/434: creat d2/d3/d7f/f85 x:0 0 0 2024-09-18T21:12:50.719 INFO:tasks.workunit.client.0.smithi077.stdout:8/359: mknod d2/d5f/c80 0 2024-09-18T21:12:50.720 INFO:tasks.workunit.client.0.smithi077.stdout:8/360: dread - d2/d27/f57 zero size 2024-09-18T21:12:50.720 INFO:tasks.workunit.client.0.smithi077.stdout:5/547: creat d0/d6/d40/fb9 x:0 0 0 2024-09-18T21:12:50.721 INFO:tasks.workunit.client.0.smithi077.stdout:3/403: write db/ff [4292512,19453] 0 2024-09-18T21:12:50.722 INFO:tasks.workunit.client.0.smithi077.stdout:5/548: dread - d0/d6/d3b/fb5 zero size 2024-09-18T21:12:50.722 INFO:tasks.workunit.client.0.smithi077.stdout:3/404: chown db/d14/c1b 37 1 2024-09-18T21:12:50.725 INFO:tasks.workunit.client.0.smithi077.stdout:6/426: mknod d7/d7e/d11/d3e/d42/d88/c92 0 2024-09-18T21:12:50.727 INFO:tasks.workunit.client.0.smithi077.stdout:8/361: fsync d2/d5/d6/d22/f1b 0 2024-09-18T21:12:50.731 INFO:tasks.workunit.client.0.smithi077.stdout:6/427: mknod d7/d7e/d11/d1d/c93 0 2024-09-18T21:12:50.731 INFO:tasks.workunit.client.0.smithi077.stdout:5/549: mknod d0/d6/dd/da5/cba 0 2024-09-18T21:12:50.732 INFO:tasks.workunit.client.0.smithi077.stdout:5/550: stat d0/d36/f75 0 2024-09-18T21:12:50.733 INFO:tasks.workunit.client.0.smithi077.stdout:3/405: symlink db/d14/d22/d36/d39/d50/d5c/l84 0 2024-09-18T21:12:50.733 INFO:tasks.workunit.client.0.smithi077.stdout:3/406: dread - db/d14/d32/d49/d4e/f79 zero size 2024-09-18T21:12:50.734 INFO:tasks.workunit.client.0.smithi077.stdout:3/407: fsync db/d14/d32/d4f/d71/f78 0 2024-09-18T21:12:50.735 INFO:tasks.workunit.client.0.smithi077.stdout:5/551: symlink d0/d6/daa/lbb 0 2024-09-18T21:12:50.735 INFO:tasks.workunit.client.0.smithi077.stdout:3/408: chown db/c2d 90864 1 2024-09-18T21:12:50.736 INFO:tasks.workunit.client.0.smithi077.stdout:5/552: write d0/df/f27 [359227,69390] 0 2024-09-18T21:12:50.736 INFO:tasks.workunit.client.0.smithi077.stdout:3/409: chown db/ld 24521 1 2024-09-18T21:12:50.737 INFO:tasks.workunit.client.0.smithi077.stdout:3/410: chown db/d14/d22/f75 83 1 2024-09-18T21:12:50.738 INFO:tasks.workunit.client.0.smithi077.stdout:3/411: write db/d14/d32/d49/d4e/d6a/f5d [926252,20351] 0 2024-09-18T21:12:50.742 INFO:tasks.workunit.client.0.smithi077.stdout:2/472: sync 2024-09-18T21:12:50.742 INFO:tasks.workunit.client.0.smithi077.stdout:1/406: sync 2024-09-18T21:12:50.742 INFO:tasks.workunit.client.0.smithi077.stdout:7/479: sync 2024-09-18T21:12:50.742 INFO:tasks.workunit.client.0.smithi077.stdout:4/408: sync 2024-09-18T21:12:50.742 INFO:tasks.workunit.client.0.smithi077.stdout:0/474: sync 2024-09-18T21:12:50.744 INFO:tasks.workunit.client.0.smithi077.stdout:6/428: dread d7/d7e/d11/d1d/f44 [0,4194304] 0 2024-09-18T21:12:50.744 INFO:tasks.workunit.client.0.smithi077.stdout:1/407: chown d3/d8/d13/f1f 1172 1 2024-09-18T21:12:50.746 INFO:tasks.workunit.client.0.smithi077.stdout:4/409: creat d3/dc/d20/f7d x:0 0 0 2024-09-18T21:12:50.746 INFO:tasks.workunit.client.0.smithi077.stdout:4/410: read - d3/f76 zero size 2024-09-18T21:12:50.748 INFO:tasks.workunit.client.0.smithi077.stdout:3/412: link db/d14/d32/l63 db/d14/d22/l85 0 2024-09-18T21:12:50.750 INFO:tasks.workunit.client.0.smithi077.stdout:3/413: dread - db/f54 zero size 2024-09-18T21:12:50.753 INFO:tasks.workunit.client.0.smithi077.stdout:2/473: write d1/d4/d9/d80/d8e/d66/f75 [2135193,73930] 0 2024-09-18T21:12:50.756 INFO:tasks.workunit.client.0.smithi077.stdout:1/408: dwrite d3/d8/d49/d4e/f57 [0,4194304] 0 2024-09-18T21:12:50.756 INFO:tasks.workunit.client.0.smithi077.stdout:7/480: mkdir d12/d31/d77/d93/d89/d99/da9 0 2024-09-18T21:12:50.758 INFO:tasks.workunit.client.0.smithi077.stdout:3/414: write db/d14/d32/d4f/d71/d3b/f66 [933453,50490] 0 2024-09-18T21:12:50.758 INFO:tasks.workunit.client.0.smithi077.stdout:5/553: dwrite d0/d36/f75 [0,4194304] 0 2024-09-18T21:12:50.763 INFO:tasks.workunit.client.0.smithi077.stdout:1/409: fdatasync d3/d8/f1c 0 2024-09-18T21:12:50.766 INFO:tasks.workunit.client.0.smithi077.stdout:6/429: dread d7/d7e/d11/d1d/d49/d55/f68 [0,4194304] 0 2024-09-18T21:12:50.767 INFO:tasks.workunit.client.0.smithi077.stdout:0/475: rename d8/d37/l53 to d8/d37/l99 0 2024-09-18T21:12:50.769 INFO:tasks.workunit.client.0.smithi077.stdout:6/430: readlink d7/d7e/d11/d1d/d49/d55/l73 0 2024-09-18T21:12:50.769 INFO:tasks.workunit.client.0.smithi077.stdout:5/554: mknod d0/d6/dd/da5/cbc 0 2024-09-18T21:12:50.770 INFO:tasks.workunit.client.0.smithi077.stdout:1/410: unlink d3/d1e/d68/l6b 0 2024-09-18T21:12:50.771 INFO:tasks.workunit.client.0.smithi077.stdout:7/481: mkdir d12/d22/daa 0 2024-09-18T21:12:50.771 INFO:tasks.workunit.client.0.smithi077.stdout:2/474: dwrite d1/d4/d5/d1a/d2e/d41/d2c/f88 [0,4194304] 0 2024-09-18T21:12:50.773 INFO:tasks.workunit.client.0.smithi077.stdout:7/482: dread - d12/d31/f7e zero size 2024-09-18T21:12:50.774 INFO:tasks.workunit.client.0.smithi077.stdout:3/415: creat db/d14/d32/f86 x:0 0 0 2024-09-18T21:12:50.775 INFO:tasks.workunit.client.0.smithi077.stdout:2/475: read d1/d4/f5f [2255171,20771] 0 2024-09-18T21:12:50.775 INFO:tasks.workunit.client.0.smithi077.stdout:1/411: mkdir d3/d38/d97 0 2024-09-18T21:12:50.776 INFO:tasks.workunit.client.0.smithi077.stdout:6/431: symlink d7/d7e/d11/l94 0 2024-09-18T21:12:50.778 INFO:tasks.workunit.client.0.smithi077.stdout:1/412: write d3/d8/d49/d4e/d50/f2c [528566,95174] 0 2024-09-18T21:12:50.778 INFO:tasks.workunit.client.0.smithi077.stdout:7/483: chown d12/c1d 126 1 2024-09-18T21:12:50.783 INFO:tasks.workunit.client.0.smithi077.stdout:3/416: dread db/d14/d22/d36/d39/f47 [0,4194304] 0 2024-09-18T21:12:50.783 INFO:tasks.workunit.client.0.smithi077.stdout:2/476: mknod d1/d4/c9a 0 2024-09-18T21:12:50.783 INFO:tasks.workunit.client.0.smithi077.stdout:1/413: dread d3/d8/d49/f62 [0,4194304] 0 2024-09-18T21:12:50.789 INFO:tasks.workunit.client.0.smithi077.stdout:0/476: write d8/f2d [1392850,86670] 0 2024-09-18T21:12:50.792 INFO:tasks.workunit.client.0.smithi077.stdout:7/484: symlink d12/d31/d77/d93/d89/d99/da9/lab 0 2024-09-18T21:12:50.792 INFO:tasks.workunit.client.0.smithi077.stdout:7/485: read - d12/d56/fa2 zero size 2024-09-18T21:12:50.793 INFO:tasks.workunit.client.1.smithi103.stdout:9/446: fsync d18/d8d/f28 0 2024-09-18T21:12:50.794 INFO:tasks.workunit.client.0.smithi077.stdout:3/417: mkdir db/d14/d32/d87 0 2024-09-18T21:12:50.794 INFO:tasks.workunit.client.0.smithi077.stdout:7/486: chown d12/d31/l6e 439249 1 2024-09-18T21:12:50.794 INFO:tasks.workunit.client.0.smithi077.stdout:5/555: write d0/df/d10/d4b/f65 [340335,47933] 0 2024-09-18T21:12:50.794 INFO:tasks.workunit.client.1.smithi103.stdout:8/526: unlink d4/d26/d56/f9a 0 2024-09-18T21:12:50.795 INFO:tasks.workunit.client.0.smithi077.stdout:0/477: fdatasync d8/d1d/d80/f84 0 2024-09-18T21:12:50.796 INFO:tasks.workunit.client.0.smithi077.stdout:3/418: fsync db/d14/d32/d4f/d71/f43 0 2024-09-18T21:12:50.796 INFO:tasks.workunit.client.1.smithi103.stdout:0/444: dwrite d1/d9/d13/f71 [4194304,4194304] 0 2024-09-18T21:12:50.796 INFO:tasks.workunit.client.1.smithi103.stdout:5/471: truncate de/d3e/f19 1464856 0 2024-09-18T21:12:50.797 INFO:tasks.workunit.client.0.smithi077.stdout:3/419: fdatasync db/f68 0 2024-09-18T21:12:50.797 INFO:tasks.workunit.client.1.smithi103.stdout:9/447: readlink d18/l6a 0 2024-09-18T21:12:50.800 INFO:tasks.workunit.client.0.smithi077.stdout:2/477: truncate d1/d4/d5/d1a/d2e/f37 303460 0 2024-09-18T21:12:50.800 INFO:tasks.workunit.client.0.smithi077.stdout:3/420: chown db/d14/d32/d49/c5e 3682 1 2024-09-18T21:12:50.800 INFO:tasks.workunit.client.0.smithi077.stdout:2/478: chown d1/d4/d5 413804383 1 2024-09-18T21:12:50.800 INFO:tasks.workunit.client.1.smithi103.stdout:2/376: dwrite d3/f16 [0,4194304] 0 2024-09-18T21:12:50.801 INFO:tasks.workunit.client.1.smithi103.stdout:0/445: dread - d1/d5/f31 zero size 2024-09-18T21:12:50.803 INFO:tasks.workunit.client.1.smithi103.stdout:9/448: write d18/d8d/f87 [275089,53271] 0 2024-09-18T21:12:50.804 INFO:tasks.workunit.client.1.smithi103.stdout:3/467: dwrite d1/d2/d18/d30/d4e/d62/f6a [0,4194304] 0 2024-09-18T21:12:50.805 INFO:tasks.workunit.client.1.smithi103.stdout:1/443: creat d0/d2/d2b/d3a/d42/f97 x:0 0 0 2024-09-18T21:12:50.807 INFO:tasks.workunit.client.0.smithi077.stdout:1/414: link d3/d8/d13/d18/f4d d3/d38/d97/f98 0 2024-09-18T21:12:50.810 INFO:tasks.workunit.client.1.smithi103.stdout:6/435: dread d2/d3/d8/f29 [0,4194304] 0 2024-09-18T21:12:50.811 INFO:tasks.workunit.client.1.smithi103.stdout:6/436: chown d2/d24/d38/d68/d7c/c83 2729 1 2024-09-18T21:12:50.812 INFO:tasks.workunit.client.1.smithi103.stdout:8/527: rename d4/de/l12 to d4/de/la5 0 2024-09-18T21:12:50.816 INFO:tasks.workunit.client.0.smithi077.stdout:3/421: dwrite f3 [0,4194304] 0 2024-09-18T21:12:50.816 INFO:tasks.workunit.client.0.smithi077.stdout:3/422: fsync db/d14/d32/d49/d4e/f79 0 2024-09-18T21:12:50.816 INFO:tasks.workunit.client.0.smithi077.stdout:7/487: mkdir d12/d22/d59/d5d/dac 0 2024-09-18T21:12:50.817 INFO:tasks.workunit.client.0.smithi077.stdout:0/478: dwrite d8/d26/f75 [0,4194304] 0 2024-09-18T21:12:50.817 INFO:tasks.workunit.client.0.smithi077.stdout:5/556: mkdir d0/d6/dbd 0 2024-09-18T21:12:50.820 INFO:tasks.workunit.client.1.smithi103.stdout:2/377: rmdir d3/d5 39 2024-09-18T21:12:50.820 INFO:tasks.workunit.client.0.smithi077.stdout:0/479: readlink d8/d37/d95/l98 0 2024-09-18T21:12:50.820 INFO:tasks.workunit.client.0.smithi077.stdout:0/480: stat d8/d1a/d39/d56 0 2024-09-18T21:12:50.825 INFO:tasks.workunit.client.0.smithi077.stdout:1/415: mkdir d3/d8/d13/d18/d99 0 2024-09-18T21:12:50.825 INFO:tasks.workunit.client.1.smithi103.stdout:9/449: rename d18/f1a to d18/d52/d6f/d8e/f98 0 2024-09-18T21:12:50.830 INFO:tasks.workunit.client.1.smithi103.stdout:0/446: creat d1/f9b x:0 0 0 2024-09-18T21:12:50.832 INFO:tasks.workunit.client.0.smithi077.stdout:5/557: dwrite d0/df/d3d/d85/f96 [4194304,4194304] 0 2024-09-18T21:12:50.832 INFO:tasks.workunit.client.0.smithi077.stdout:3/423: dwrite db/d14/d32/d49/d4e/d6a/f52 [0,4194304] 0 2024-09-18T21:12:50.833 INFO:tasks.workunit.client.1.smithi103.stdout:8/528: rename d4/d26/f25 to d4/d26/d56/d77/d9f/fa6 0 2024-09-18T21:12:50.834 INFO:tasks.workunit.client.1.smithi103.stdout:8/529: fdatasync d4/d81/d65/d39/f4f 0 2024-09-18T21:12:50.834 INFO:tasks.workunit.client.0.smithi077.stdout:1/416: rmdir d3/d38/d97 39 2024-09-18T21:12:50.838 INFO:tasks.workunit.client.0.smithi077.stdout:7/488: mkdir d12/d22/d59/d5d/dac/dad 0 2024-09-18T21:12:50.839 INFO:tasks.workunit.client.0.smithi077.stdout:0/481: mkdir d8/d1a/d39/d3b/d9a 0 2024-09-18T21:12:50.840 INFO:tasks.workunit.client.0.smithi077.stdout:5/558: mknod d0/d36/cbe 0 2024-09-18T21:12:50.841 INFO:tasks.workunit.client.1.smithi103.stdout:2/378: getdents d3/d5/d2c/d77 0 2024-09-18T21:12:50.841 INFO:tasks.workunit.client.0.smithi077.stdout:3/424: creat db/d14/d32/d49/d4e/d6a/f88 x:0 0 0 2024-09-18T21:12:50.842 INFO:tasks.workunit.client.0.smithi077.stdout:3/425: chown fa 94638835 1 2024-09-18T21:12:50.843 INFO:tasks.workunit.client.1.smithi103.stdout:8/530: rename d4/de/d4a/d59/d5e/f6a to d4/d2d/d87/fa7 0 2024-09-18T21:12:50.843 INFO:tasks.workunit.client.1.smithi103.stdout:1/444: dread d0/d11/f35 [0,4194304] 0 2024-09-18T21:12:50.845 INFO:tasks.workunit.client.0.smithi077.stdout:3/426: stat db/d14/d32/d49/d4e/d6a/f46 0 2024-09-18T21:12:50.845 INFO:tasks.workunit.client.0.smithi077.stdout:1/417: dread d3/d8/d49/f62 [0,4194304] 0 2024-09-18T21:12:50.846 INFO:tasks.workunit.client.0.smithi077.stdout:7/489: rename c8 to d12/d31/d77/d93/d89/d94/cae 0 2024-09-18T21:12:50.849 INFO:tasks.workunit.client.1.smithi103.stdout:2/379: write d3/d5/d2c/f3e [3404902,27944] 0 2024-09-18T21:12:50.849 INFO:tasks.workunit.client.0.smithi077.stdout:0/482: dwrite d8/d1a/d35/f82 [0,4194304] 0 2024-09-18T21:12:50.850 INFO:tasks.workunit.client.0.smithi077.stdout:1/418: read d3/d8/d13/f14 [726479,14023] 0 2024-09-18T21:12:50.851 INFO:tasks.workunit.client.0.smithi077.stdout:7/490: write d12/d22/d59/d72/f9b [263820,16909] 0 2024-09-18T21:12:50.853 INFO:tasks.workunit.client.1.smithi103.stdout:5/472: dread de/d3e/f19 [0,4194304] 0 2024-09-18T21:12:50.853 INFO:tasks.workunit.client.1.smithi103.stdout:1/445: mknod d0/c98 0 2024-09-18T21:12:50.855 INFO:tasks.workunit.client.1.smithi103.stdout:1/446: chown d0/d2/d9/d10/d5d/d6f/f8b 0 1 2024-09-18T21:12:50.856 INFO:tasks.workunit.client.1.smithi103.stdout:2/380: mkdir d3/d5/d2f/d32/d90 0 2024-09-18T21:12:50.857 INFO:tasks.workunit.client.0.smithi077.stdout:5/559: dwrite d0/df/d10/f7 [4194304,4194304] 0 2024-09-18T21:12:50.857 INFO:tasks.workunit.client.0.smithi077.stdout:0/483: write d8/d37/f63 [5086764,61008] 0 2024-09-18T21:12:50.858 INFO:tasks.workunit.client.0.smithi077.stdout:1/419: dread d3/f2e [0,4194304] 0 2024-09-18T21:12:50.861 INFO:tasks.workunit.client.1.smithi103.stdout:5/473: dwrite de/d3e/d15/f2e [0,4194304] 0 2024-09-18T21:12:50.861 INFO:tasks.workunit.client.1.smithi103.stdout:8/531: mknod d4/d26/d56/ca8 0 2024-09-18T21:12:50.862 INFO:tasks.workunit.client.0.smithi077.stdout:2/479: truncate d1/d4/d5/d1a/d2e/f34 1914487 0 2024-09-18T21:12:50.863 INFO:tasks.workunit.client.0.smithi077.stdout:7/491: creat d12/d31/d77/d93/d89/faf x:0 0 0 2024-09-18T21:12:50.867 INFO:tasks.workunit.client.1.smithi103.stdout:9/450: write d18/f38 [1800832,44093] 0 2024-09-18T21:12:50.869 INFO:tasks.workunit.client.1.smithi103.stdout:0/447: getdents d1/d56/d8c 0 2024-09-18T21:12:50.871 INFO:tasks.workunit.client.0.smithi077.stdout:7/492: dwrite d12/d31/d77/da0/fa8 [0,4194304] 0 2024-09-18T21:12:50.873 INFO:tasks.workunit.client.1.smithi103.stdout:8/532: unlink d4/d26/f8 0 2024-09-18T21:12:50.875 INFO:tasks.workunit.client.1.smithi103.stdout:0/448: dwrite d1/d5/de/d19/d1e/f1f [0,4194304] 0 2024-09-18T21:12:50.880 INFO:tasks.workunit.client.0.smithi077.stdout:1/420: symlink d3/d8/d49/l9a 0 2024-09-18T21:12:50.880 INFO:tasks.workunit.client.0.smithi077.stdout:1/421: stat d3/d8/d13/d18/f74 0 2024-09-18T21:12:50.882 INFO:tasks.workunit.client.1.smithi103.stdout:8/533: creat d4/d81/d65/d39/fa9 x:0 0 0 2024-09-18T21:12:50.884 INFO:tasks.workunit.client.1.smithi103.stdout:2/381: creat d3/d5/d2f/f91 x:0 0 0 2024-09-18T21:12:50.884 INFO:tasks.workunit.client.1.smithi103.stdout:0/449: dwrite d1/d5/de/d19/d1e/d34/f74 [0,4194304] 0 2024-09-18T21:12:50.884 INFO:tasks.workunit.client.1.smithi103.stdout:0/450: stat d1/d56/d62 0 2024-09-18T21:12:50.885 INFO:tasks.workunit.client.0.smithi077.stdout:0/484: creat d8/d1a/d39/d3b/f9b x:0 0 0 2024-09-18T21:12:50.886 INFO:tasks.workunit.client.1.smithi103.stdout:9/451: unlink d18/l1c 0 2024-09-18T21:12:50.888 INFO:tasks.workunit.client.0.smithi077.stdout:7/493: creat d12/d22/d59/d5d/dac/dad/fb0 x:0 0 0 2024-09-18T21:12:50.888 INFO:tasks.workunit.client.1.smithi103.stdout:5/474: creat de/f98 x:0 0 0 2024-09-18T21:12:50.888 INFO:tasks.workunit.client.1.smithi103.stdout:9/452: write d18/f3c [1561363,78619] 0 2024-09-18T21:12:50.889 INFO:tasks.workunit.client.1.smithi103.stdout:9/453: stat d18/d52/d6f/d8e/f98 0 2024-09-18T21:12:50.890 INFO:tasks.workunit.client.0.smithi077.stdout:1/422: rename d3/d1e to d3/d6a/d9b 0 2024-09-18T21:12:50.891 INFO:tasks.workunit.client.1.smithi103.stdout:8/534: creat d4/de/d4a/d59/d5e/faa x:0 0 0 2024-09-18T21:12:50.892 INFO:tasks.workunit.client.1.smithi103.stdout:8/535: fdatasync d4/d2d/f33 0 2024-09-18T21:12:50.892 INFO:tasks.workunit.client.0.smithi077.stdout:2/480: creat d1/d4/d5/d1a/d2e/d41/f9b x:0 0 0 2024-09-18T21:12:50.893 INFO:tasks.workunit.client.1.smithi103.stdout:2/382: symlink d3/d5/d4a/d56/l92 0 2024-09-18T21:12:50.893 INFO:tasks.workunit.client.0.smithi077.stdout:2/481: read - d1/d4/d5/d1a/f89 zero size 2024-09-18T21:12:50.894 INFO:tasks.workunit.client.0.smithi077.stdout:0/485: unlink d8/d1a/d35/d6d/f89 0 2024-09-18T21:12:50.896 INFO:tasks.workunit.client.0.smithi077.stdout:1/423: symlink d3/d8/d75/l9c 0 2024-09-18T21:12:50.897 INFO:tasks.workunit.client.1.smithi103.stdout:5/475: rmdir de/d1f/d3b/d58 39 2024-09-18T21:12:50.898 INFO:tasks.workunit.client.1.smithi103.stdout:8/536: dwrite d4/de/d4a/f79 [0,4194304] 0 2024-09-18T21:12:50.900 INFO:tasks.workunit.client.0.smithi077.stdout:2/482: symlink d1/d4/d5/d1a/d49/d6a/l9c 0 2024-09-18T21:12:50.900 INFO:tasks.workunit.client.1.smithi103.stdout:8/537: write d4/de/f1c [4249401,126966] 0 2024-09-18T21:12:50.902 INFO:tasks.workunit.client.0.smithi077.stdout:0/486: mknod d8/d1a/d39/d3b/d70/c9c 0 2024-09-18T21:12:50.904 INFO:tasks.workunit.client.1.smithi103.stdout:2/383: chown d3/d5/fe 39541502 1 2024-09-18T21:12:50.904 INFO:tasks.workunit.client.0.smithi077.stdout:1/424: chown d3/f10 248 1 2024-09-18T21:12:50.907 INFO:tasks.workunit.client.1.smithi103.stdout:5/476: mknod de/d1f/d3b/d51/c99 0 2024-09-18T21:12:50.909 INFO:tasks.workunit.client.1.smithi103.stdout:9/454: rename d18/d8d/f71 to d18/d29/d68/f99 0 2024-09-18T21:12:50.910 INFO:tasks.workunit.client.1.smithi103.stdout:2/384: dwrite d3/f16 [0,4194304] 0 2024-09-18T21:12:50.914 INFO:tasks.workunit.client.1.smithi103.stdout:5/477: creat de/d14/d33/f9a x:0 0 0 2024-09-18T21:12:50.915 INFO:tasks.workunit.client.1.smithi103.stdout:5/478: write de/d14/d33/f8e [912716,73738] 0 2024-09-18T21:12:50.916 INFO:tasks.workunit.client.1.smithi103.stdout:2/385: mkdir d3/d5/d2f/d93 0 2024-09-18T21:12:50.922 INFO:tasks.workunit.client.1.smithi103.stdout:2/386: rename d3/d5/d25/d40/c59 to d3/d5/d2f/d32/d90/c94 0 2024-09-18T21:12:50.923 INFO:tasks.workunit.client.1.smithi103.stdout:8/538: rmdir d4 39 2024-09-18T21:12:50.924 INFO:tasks.workunit.client.1.smithi103.stdout:2/387: mkdir d3/d5/d2f/d5b/d95 0 2024-09-18T21:12:50.926 INFO:tasks.workunit.client.1.smithi103.stdout:2/388: truncate d3/d5/d2f/f91 548441 0 2024-09-18T21:12:50.927 INFO:tasks.workunit.client.1.smithi103.stdout:8/539: mkdir d4/d2d/d3d/da0/dab 0 2024-09-18T21:12:50.928 INFO:tasks.workunit.client.1.smithi103.stdout:5/479: rmdir de/d1f 39 2024-09-18T21:12:50.928 INFO:tasks.workunit.client.1.smithi103.stdout:8/540: chown d4/d81/d71/d7f/c91 505806424 1 2024-09-18T21:12:50.930 INFO:tasks.workunit.client.1.smithi103.stdout:8/541: mknod d4/de/cac 0 2024-09-18T21:12:50.932 INFO:tasks.workunit.client.1.smithi103.stdout:2/389: dwrite d3/d5/d4a/d56/f8d [0,4194304] 0 2024-09-18T21:12:50.933 INFO:tasks.workunit.client.1.smithi103.stdout:8/542: dread - d4/d81/d65/d39/fa9 zero size 2024-09-18T21:12:50.934 INFO:tasks.workunit.client.1.smithi103.stdout:8/543: chown d4/d2d/d3d/f5a 483152 1 2024-09-18T21:12:50.934 INFO:tasks.workunit.client.1.smithi103.stdout:2/390: unlink d3/d5/d2c/d54/c80 0 2024-09-18T21:12:50.936 INFO:tasks.workunit.client.1.smithi103.stdout:2/391: chown d3/d5/d2c/f5c 24010155 1 2024-09-18T21:12:50.936 INFO:tasks.workunit.client.1.smithi103.stdout:8/544: mknod d4/d26/d56/d77/cad 0 2024-09-18T21:12:50.937 INFO:tasks.workunit.client.1.smithi103.stdout:2/392: fdatasync d3/f4d 0 2024-09-18T21:12:50.939 INFO:tasks.workunit.client.1.smithi103.stdout:8/545: write d4/d81/d65/d39/fa9 [858796,12197] 0 2024-09-18T21:12:50.940 INFO:tasks.workunit.client.1.smithi103.stdout:2/393: creat d3/d5/d2c/d54/f96 x:0 0 0 2024-09-18T21:12:50.941 INFO:tasks.workunit.client.0.smithi077.stdout:9/358: sync 2024-09-18T21:12:50.942 INFO:tasks.workunit.client.0.smithi077.stdout:1/425: chown d3/d8/l40 37765233 1 2024-09-18T21:12:50.942 INFO:tasks.workunit.client.1.smithi103.stdout:5/480: dwrite de/d1f/f24 [0,4194304] 0 2024-09-18T21:12:50.944 INFO:tasks.workunit.client.0.smithi077.stdout:2/483: creat d1/d4/d5/f9d x:0 0 0 2024-09-18T21:12:50.945 INFO:tasks.workunit.client.0.smithi077.stdout:5/560: dwrite d0/df/d10/d5c/f72 [0,4194304] 0 2024-09-18T21:12:50.945 INFO:tasks.workunit.client.1.smithi103.stdout:2/394: creat d3/d5/d4a/d56/f97 x:0 0 0 2024-09-18T21:12:50.949 INFO:tasks.workunit.client.1.smithi103.stdout:2/395: dread d3/d5/d2f/d5b/f75 [0,4194304] 0 2024-09-18T21:12:50.953 INFO:tasks.workunit.client.1.smithi103.stdout:8/546: truncate d4/d2d/f33 3250459 0 2024-09-18T21:12:50.956 INFO:tasks.workunit.client.1.smithi103.stdout:5/481: creat de/d1f/d3b/d58/f9b x:0 0 0 2024-09-18T21:12:50.956 INFO:tasks.workunit.client.1.smithi103.stdout:2/396: read - d3/d5/f38 zero size 2024-09-18T21:12:50.958 INFO:tasks.workunit.client.1.smithi103.stdout:5/482: truncate fb 4018490 0 2024-09-18T21:12:50.960 INFO:tasks.workunit.client.1.smithi103.stdout:5/483: chown de/d3e/l49 67039520 1 2024-09-18T21:12:50.960 INFO:tasks.workunit.client.1.smithi103.stdout:2/397: rmdir d3/d5/d2f/d5b/d95 0 2024-09-18T21:12:50.960 INFO:tasks.workunit.client.1.smithi103.stdout:5/484: write de/d2d/f88 [638396,57395] 0 2024-09-18T21:12:50.962 INFO:tasks.workunit.client.1.smithi103.stdout:2/398: mkdir d3/d5/d25/d98 0 2024-09-18T21:12:50.964 INFO:tasks.workunit.client.1.smithi103.stdout:2/399: symlink d3/d5/d2f/d5b/l99 0 2024-09-18T21:12:50.967 INFO:tasks.workunit.client.1.smithi103.stdout:7/404: sync 2024-09-18T21:12:50.967 INFO:tasks.workunit.client.1.smithi103.stdout:2/400: truncate d3/d5/d2f/d32/f8f 741458 0 2024-09-18T21:12:50.967 INFO:tasks.workunit.client.1.smithi103.stdout:5/485: dwrite de/d1f/d3b/d58/f67 [0,4194304] 0 2024-09-18T21:12:50.969 INFO:tasks.workunit.client.1.smithi103.stdout:8/547: truncate d4/d26/f1a 5932697 0 2024-09-18T21:12:50.970 INFO:tasks.workunit.client.1.smithi103.stdout:5/486: write de/d2d/d7f/f65 [389000,74778] 0 2024-09-18T21:12:50.971 INFO:tasks.workunit.client.1.smithi103.stdout:5/487: fdatasync de/d3e/d15/f2e 0 2024-09-18T21:12:50.972 INFO:tasks.workunit.client.1.smithi103.stdout:5/488: readlink de/d14/d33/l25 0 2024-09-18T21:12:50.976 INFO:tasks.workunit.client.1.smithi103.stdout:5/489: chown c6 4046 1 2024-09-18T21:12:50.977 INFO:tasks.workunit.client.1.smithi103.stdout:8/548: creat d4/d81/d71/d7f/d9d/fae x:0 0 0 2024-09-18T21:12:50.977 INFO:tasks.workunit.client.1.smithi103.stdout:7/405: read d1/df/d42/d1f/d2e/f37 [4066103,31096] 0 2024-09-18T21:12:50.997 INFO:tasks.workunit.client.0.smithi077.stdout:1/426: unlink d3/d8/d49/d4e/d5a/l84 0 2024-09-18T21:12:50.998 INFO:tasks.workunit.client.0.smithi077.stdout:2/484: read - d1/d4/d5/d1a/d49/f72 zero size 2024-09-18T21:12:50.998 INFO:tasks.workunit.client.0.smithi077.stdout:0/487: link c6 d8/d1a/d35/c9d 0 2024-09-18T21:12:50.998 INFO:tasks.workunit.client.0.smithi077.stdout:5/561: chown d0/df/d10/d4b/d80/l94 1167109 1 2024-09-18T21:12:51.000 INFO:tasks.workunit.client.0.smithi077.stdout:1/427: creat d3/d6a/d9b/d68/f9d x:0 0 0 2024-09-18T21:12:51.000 INFO:tasks.workunit.client.0.smithi077.stdout:0/488: fsync d8/d26/f1b 0 2024-09-18T21:12:51.001 INFO:tasks.workunit.client.0.smithi077.stdout:5/562: creat d0/fbf x:0 0 0 2024-09-18T21:12:51.002 INFO:tasks.workunit.client.0.smithi077.stdout:0/489: stat d8/d1d/d57/f8f 0 2024-09-18T21:12:51.003 INFO:tasks.workunit.client.0.smithi077.stdout:2/485: symlink d1/d4/d9/l9e 0 2024-09-18T21:12:51.006 INFO:tasks.workunit.client.0.smithi077.stdout:9/359: dwrite d1/dd/d11/d1c/d38/d46/f60 [0,4194304] 0 2024-09-18T21:12:51.007 INFO:tasks.workunit.client.0.smithi077.stdout:0/490: write d8/d37/d66/d87/f90 [980334,78160] 0 2024-09-18T21:12:51.010 INFO:tasks.workunit.client.0.smithi077.stdout:0/491: readlink d8/d1a/d39/d3b/l4a 0 2024-09-18T21:12:51.011 INFO:tasks.workunit.client.0.smithi077.stdout:5/563: dread - d0/df/f5f zero size 2024-09-18T21:12:51.012 INFO:tasks.workunit.client.0.smithi077.stdout:1/428: write d3/d8/d13/d18/f6c [712296,15990] 0 2024-09-18T21:12:51.016 INFO:tasks.workunit.client.0.smithi077.stdout:2/486: dwrite d1/d4/f2f [4194304,4194304] 0 2024-09-18T21:12:51.016 INFO:tasks.workunit.client.0.smithi077.stdout:1/429: fsync d3/d6a/d9b/f3b 0 2024-09-18T21:12:51.019 INFO:tasks.workunit.client.0.smithi077.stdout:0/492: dread d8/d26/f18 [0,4194304] 0 2024-09-18T21:12:51.019 INFO:tasks.workunit.client.1.smithi103.stdout:7/406: unlink d1/df/l31 0 2024-09-18T21:12:51.021 INFO:tasks.workunit.client.1.smithi103.stdout:8/549: symlink d4/de/d4a/d59/d9c/laf 0 2024-09-18T21:12:51.023 INFO:tasks.workunit.client.0.smithi077.stdout:9/360: dwrite d1/dd/f5d [0,4194304] 0 2024-09-18T21:12:51.023 INFO:tasks.workunit.client.0.smithi077.stdout:2/487: write d1/d4/d5/d1a/f89 [967315,118847] 0 2024-09-18T21:12:51.025 INFO:tasks.workunit.client.0.smithi077.stdout:0/493: mknod d8/d37/c9e 0 2024-09-18T21:12:51.026 INFO:tasks.workunit.client.1.smithi103.stdout:5/490: getdents de/d1f/d3b/d3c 0 2024-09-18T21:12:51.026 INFO:tasks.workunit.client.1.smithi103.stdout:7/407: stat d1/df/d54/c62 0 2024-09-18T21:12:51.027 INFO:tasks.workunit.client.0.smithi077.stdout:9/361: symlink d1/d54/d27/l6e 0 2024-09-18T21:12:51.028 INFO:tasks.workunit.client.0.smithi077.stdout:1/430: rename d3/d6a/d9b/f35 to d3/d6a/f9e 0 2024-09-18T21:12:51.033 INFO:tasks.workunit.client.1.smithi103.stdout:8/550: rename d4/l4b to d4/d81/lb0 0 2024-09-18T21:12:51.034 INFO:tasks.workunit.client.1.smithi103.stdout:5/491: mkdir de/d14/d9c 0 2024-09-18T21:12:51.034 INFO:tasks.workunit.client.1.smithi103.stdout:8/551: dread d4/d2d/d4e/f8c [0,4194304] 0 2024-09-18T21:12:51.035 INFO:tasks.workunit.client.1.smithi103.stdout:5/492: readlink de/d1f/l71 0 2024-09-18T21:12:51.035 INFO:tasks.workunit.client.1.smithi103.stdout:7/408: creat d1/df/d42/d29/d48/f77 x:0 0 0 2024-09-18T21:12:51.035 INFO:tasks.workunit.client.1.smithi103.stdout:3/468: sync 2024-09-18T21:12:51.036 INFO:tasks.workunit.client.1.smithi103.stdout:4/432: sync 2024-09-18T21:12:51.036 INFO:tasks.workunit.client.1.smithi103.stdout:6/437: sync 2024-09-18T21:12:51.036 INFO:tasks.workunit.client.1.smithi103.stdout:1/447: sync 2024-09-18T21:12:51.036 INFO:tasks.workunit.client.1.smithi103.stdout:8/552: creat d4/de/d4a/fb1 x:0 0 0 2024-09-18T21:12:51.038 INFO:tasks.workunit.client.1.smithi103.stdout:5/493: rename de/d14/d33/f97 to de/d14/d33/d4f/f9d 0 2024-09-18T21:12:51.038 INFO:tasks.workunit.client.0.smithi077.stdout:1/431: mknod d3/d8/d93/c9f 0 2024-09-18T21:12:51.039 INFO:tasks.workunit.client.0.smithi077.stdout:1/432: chown c0 3 1 2024-09-18T21:12:51.041 INFO:tasks.workunit.client.1.smithi103.stdout:4/433: creat d9/d38/d58/f93 x:0 0 0 2024-09-18T21:12:51.044 INFO:tasks.workunit.client.0.smithi077.stdout:1/433: rmdir d3/d8/d13/d77 39 2024-09-18T21:12:51.046 INFO:tasks.workunit.client.0.smithi077.stdout:1/434: write d3/d38/f60 [73248,8878] 0 2024-09-18T21:12:51.046 INFO:tasks.workunit.client.0.smithi077.stdout:9/362: link d1/dd/d11/c68 d1/dd/d11/d1c/d38/d46/c6f 0 2024-09-18T21:12:51.047 INFO:tasks.workunit.client.0.smithi077.stdout:5/564: dread d0/d6/d3b/f4e [0,4194304] 0 2024-09-18T21:12:51.048 INFO:tasks.workunit.client.0.smithi077.stdout:5/565: chown d0/df/d10/d47/f93 108673730 1 2024-09-18T21:12:51.050 INFO:tasks.workunit.client.0.smithi077.stdout:0/494: rename d8/d26/f88 to d8/d1a/f9f 0 2024-09-18T21:12:51.051 INFO:tasks.workunit.client.1.smithi103.stdout:7/409: creat d1/df/d43/d61/f78 x:0 0 0 2024-09-18T21:12:51.053 INFO:tasks.workunit.client.0.smithi077.stdout:2/488: dwrite d1/d4/d5/d1a/f4a [4194304,4194304] 0 2024-09-18T21:12:51.054 INFO:tasks.workunit.client.0.smithi077.stdout:2/489: write d1/d4/f2f [7733777,115742] 0 2024-09-18T21:12:51.055 INFO:tasks.workunit.client.1.smithi103.stdout:5/494: fdatasync de/d14/d33/d4f/f6a 0 2024-09-18T21:12:51.056 INFO:tasks.workunit.client.1.smithi103.stdout:5/495: stat de/d1f/l34 0 2024-09-18T21:12:51.058 INFO:tasks.workunit.client.1.smithi103.stdout:1/448: write d0/d3/f29 [1596680,77652] 0 2024-09-18T21:12:51.059 INFO:tasks.workunit.client.1.smithi103.stdout:4/434: mkdir d9/d38/d72/d94 0 2024-09-18T21:12:51.061 INFO:tasks.workunit.client.1.smithi103.stdout:9/455: sync 2024-09-18T21:12:51.061 INFO:tasks.workunit.client.1.smithi103.stdout:0/451: sync 2024-09-18T21:12:51.061 INFO:tasks.workunit.client.1.smithi103.stdout:4/435: write d9/d1a/d21/f33 [4985160,85045] 0 2024-09-18T21:12:51.067 INFO:tasks.workunit.client.1.smithi103.stdout:6/438: rename d2/d24/d5a/c66 to d2/d3/d8/d4c/d7a/c86 0 2024-09-18T21:12:51.067 INFO:tasks.workunit.client.0.smithi077.stdout:1/435: mknod d3/d6a/d9b/d7f/ca0 0 2024-09-18T21:12:51.067 INFO:tasks.workunit.client.1.smithi103.stdout:3/469: dwrite d1/d2/d18/d30/f3f [0,4194304] 0 2024-09-18T21:12:51.067 INFO:tasks.workunit.client.1.smithi103.stdout:8/553: dwrite d4/de/f11 [0,4194304] 0 2024-09-18T21:12:51.069 INFO:tasks.workunit.client.1.smithi103.stdout:3/470: chown d1/d23/d25/d4f/d51/f5c 216196905 1 2024-09-18T21:12:51.069 INFO:tasks.workunit.client.0.smithi077.stdout:2/490: rmdir d1/d4/d5/d1a/d2e 39 2024-09-18T21:12:51.073 INFO:tasks.workunit.client.0.smithi077.stdout:5/566: creat d0/df/d10/d47/da0/fc0 x:0 0 0 2024-09-18T21:12:51.076 INFO:tasks.workunit.client.0.smithi077.stdout:2/491: mknod d1/d4/d9/d80/d95/c9f 0 2024-09-18T21:12:51.079 INFO:tasks.workunit.client.0.smithi077.stdout:9/363: link d1/d54/f3b d1/d54/f70 0 2024-09-18T21:12:51.085 INFO:tasks.workunit.client.0.smithi077.stdout:5/567: dread d0/d6/dd/f19 [0,4194304] 0 2024-09-18T21:12:51.086 INFO:tasks.workunit.client.0.smithi077.stdout:9/364: mknod d1/dd/d1a/c71 0 2024-09-18T21:12:51.086 INFO:tasks.workunit.client.0.smithi077.stdout:9/365: write d1/dd/f5a [3632578,57781] 0 2024-09-18T21:12:51.086 INFO:tasks.workunit.client.0.smithi077.stdout:2/492: rmdir d1/d4/d5/d1a/d2e 39 2024-09-18T21:12:51.089 INFO:tasks.workunit.client.0.smithi077.stdout:5/568: write d0/d36/f75 [4875016,98441] 0 2024-09-18T21:12:51.091 INFO:tasks.workunit.client.0.smithi077.stdout:0/495: dread d8/d26/f8d [0,4194304] 0 2024-09-18T21:12:51.092 INFO:tasks.workunit.client.0.smithi077.stdout:2/493: fdatasync d1/d4/d5/d1a/d2e/d41/f3f 0 2024-09-18T21:12:51.092 INFO:tasks.workunit.client.0.smithi077.stdout:0/496: fdatasync d8/d1d/d80/f97 0 2024-09-18T21:12:51.093 INFO:tasks.workunit.client.0.smithi077.stdout:9/366: mkdir d1/dd/d11/d72 0 2024-09-18T21:12:51.094 INFO:tasks.workunit.client.0.smithi077.stdout:0/497: write d8/f6a [767623,76406] 0 2024-09-18T21:12:51.097 INFO:tasks.workunit.client.0.smithi077.stdout:0/498: mknod d8/d1a/d39/d3b/d4e/ca0 0 2024-09-18T21:12:51.099 INFO:tasks.workunit.client.0.smithi077.stdout:1/436: truncate d3/d6a/f9e 850406 0 2024-09-18T21:12:51.100 INFO:tasks.workunit.client.0.smithi077.stdout:2/494: dwrite d1/d4/d5/d1a/d2e/d41/f3f [0,4194304] 0 2024-09-18T21:12:51.100 INFO:tasks.workunit.client.0.smithi077.stdout:0/499: write d8/d1a/d39/d3b/d4e/f7f [232618,46595] 0 2024-09-18T21:12:51.101 INFO:tasks.workunit.client.0.smithi077.stdout:9/367: dread d1/dd/d11/d1c/d38/f41 [0,4194304] 0 2024-09-18T21:12:51.103 INFO:tasks.workunit.client.0.smithi077.stdout:1/437: mknod d3/d8/d49/d4e/d50/ca1 0 2024-09-18T21:12:51.104 INFO:tasks.workunit.client.0.smithi077.stdout:0/500: write d8/d1a/f7c [501683,14957] 0 2024-09-18T21:12:51.105 INFO:tasks.workunit.client.0.smithi077.stdout:9/368: rename d1/dd/d1a/l65 to d1/dd/d1a/l73 0 2024-09-18T21:12:51.106 INFO:tasks.workunit.client.0.smithi077.stdout:9/369: chown d1/dd/d11/d1c/f31 1 1 2024-09-18T21:12:51.109 INFO:tasks.workunit.client.0.smithi077.stdout:8/362: sync 2024-09-18T21:12:51.109 INFO:tasks.workunit.client.0.smithi077.stdout:9/370: rmdir d1/dd/d11/d1c/d38 39 2024-09-18T21:12:51.112 INFO:tasks.workunit.client.0.smithi077.stdout:0/501: creat d8/d1a/d39/d3b/d9a/fa1 x:0 0 0 2024-09-18T21:12:51.115 INFO:tasks.workunit.client.1.smithi103.stdout:4/436: mknod d9/d2e/d61/d91/c95 0 2024-09-18T21:12:51.115 INFO:tasks.workunit.client.1.smithi103.stdout:7/410: creat d1/df/f79 x:0 0 0 2024-09-18T21:12:51.116 INFO:tasks.workunit.client.0.smithi077.stdout:8/363: mkdir d2/d27/d29/d72/d81 0 2024-09-18T21:12:51.116 INFO:tasks.workunit.client.1.smithi103.stdout:3/471: mkdir d1/d23/d25/d4f/d72/d85/d93 0 2024-09-18T21:12:51.116 INFO:tasks.workunit.client.0.smithi077.stdout:0/502: dread d8/d26/f18 [0,4194304] 0 2024-09-18T21:12:51.117 INFO:tasks.workunit.client.1.smithi103.stdout:4/437: fsync d9/d38/f51 0 2024-09-18T21:12:51.118 INFO:tasks.workunit.client.0.smithi077.stdout:9/371: dwrite d1/dd/d11/d2d/f32 [0,4194304] 0 2024-09-18T21:12:51.119 INFO:tasks.workunit.client.1.smithi103.stdout:0/452: getdents d1 0 2024-09-18T21:12:51.119 INFO:tasks.workunit.client.1.smithi103.stdout:8/554: dwrite d4/ff [4194304,4194304] 0 2024-09-18T21:12:51.120 INFO:tasks.workunit.client.0.smithi077.stdout:9/372: write d1/dd/f5d [4928312,72989] 0 2024-09-18T21:12:51.122 INFO:tasks.workunit.client.0.smithi077.stdout:2/495: truncate d1/d4/d5/d1a/f6d 187633 0 2024-09-18T21:12:51.123 INFO:tasks.workunit.client.0.smithi077.stdout:2/496: fsync d1/f19 0 2024-09-18T21:12:51.123 INFO:tasks.workunit.client.1.smithi103.stdout:4/438: write d9/d1a/d21/f57 [1468840,76669] 0 2024-09-18T21:12:51.124 INFO:tasks.workunit.client.1.smithi103.stdout:4/439: stat d9/f6d 0 2024-09-18T21:12:51.124 INFO:tasks.workunit.client.0.smithi077.stdout:2/497: fdatasync d1/d4/d9/d80/f90 0 2024-09-18T21:12:51.128 INFO:tasks.workunit.client.1.smithi103.stdout:9/456: dwrite d18/d52/f60 [0,4194304] 0 2024-09-18T21:12:51.130 INFO:tasks.workunit.client.0.smithi077.stdout:9/373: creat d1/dd/d57/f74 x:0 0 0 2024-09-18T21:12:51.130 INFO:tasks.workunit.client.1.smithi103.stdout:9/457: dread - d18/d52/d6f/f88 zero size 2024-09-18T21:12:51.131 INFO:tasks.workunit.client.1.smithi103.stdout:7/411: mknod d1/df/d42/d1f/d2e/c7a 0 2024-09-18T21:12:51.131 INFO:tasks.workunit.client.1.smithi103.stdout:9/458: fdatasync d18/d29/f44 0 2024-09-18T21:12:51.132 INFO:tasks.workunit.client.1.smithi103.stdout:7/412: fsync d1/f12 0 2024-09-18T21:12:51.134 INFO:tasks.workunit.client.0.smithi077.stdout:0/503: rename d8/d26/f38 to d8/d1a/d39/d3b/d9a/fa2 0 2024-09-18T21:12:51.135 INFO:tasks.workunit.client.0.smithi077.stdout:0/504: fsync d8/f6a 0 2024-09-18T21:12:51.135 INFO:tasks.workunit.client.1.smithi103.stdout:4/440: dwrite d9/d1c/f42 [0,4194304] 0 2024-09-18T21:12:51.136 INFO:tasks.workunit.client.0.smithi077.stdout:0/505: write d8/d1a/f51 [4745225,1378] 0 2024-09-18T21:12:51.137 INFO:tasks.workunit.client.1.smithi103.stdout:4/441: fdatasync d9/d38/d58/f6b 0 2024-09-18T21:12:51.138 INFO:tasks.workunit.client.1.smithi103.stdout:3/472: rename d1/da/d7a/l7c to d1/da/df/l94 0 2024-09-18T21:12:51.138 INFO:tasks.workunit.client.1.smithi103.stdout:9/459: write d18/d52/d6f/f8a [799552,95488] 0 2024-09-18T21:12:51.139 INFO:tasks.workunit.client.1.smithi103.stdout:4/442: write d9/d38/d58/f93 [286215,80031] 0 2024-09-18T21:12:51.141 INFO:tasks.workunit.client.1.smithi103.stdout:9/460: dread - d18/d8d/d2f/f97 zero size 2024-09-18T21:12:51.148 INFO:tasks.workunit.client.0.smithi077.stdout:1/438: truncate d3/d6a/f9e 370408 0 2024-09-18T21:12:51.148 INFO:tasks.workunit.client.0.smithi077.stdout:0/506: rmdir d8/d1a/d35/d6d 39 2024-09-18T21:12:51.149 INFO:tasks.workunit.client.0.smithi077.stdout:8/364: link d2/d5/d6/l1c d2/d5/d6/d22/d4f/d5a/d2a/l82 0 2024-09-18T21:12:51.150 INFO:tasks.workunit.client.1.smithi103.stdout:0/453: truncate d1/d5/de/d24/f38 870671 0 2024-09-18T21:12:51.151 INFO:tasks.workunit.client.0.smithi077.stdout:8/365: chown d2/d36/f78 244735 1 2024-09-18T21:12:51.151 INFO:tasks.workunit.client.1.smithi103.stdout:2/401: sync 2024-09-18T21:12:51.152 INFO:tasks.workunit.client.1.smithi103.stdout:9/461: creat d18/d29/d68/f9a x:0 0 0 2024-09-18T21:12:51.154 INFO:tasks.workunit.client.1.smithi103.stdout:7/413: rename d1/df/f20 to d1/df/d42/d1f/f7b 0 2024-09-18T21:12:51.157 INFO:tasks.workunit.client.1.smithi103.stdout:4/443: mknod d9/d1a/d41/d64/c96 0 2024-09-18T21:12:51.157 INFO:tasks.workunit.client.1.smithi103.stdout:4/444: readlink d9/lf 0 2024-09-18T21:12:51.159 INFO:tasks.workunit.client.1.smithi103.stdout:2/402: dread d3/f22 [0,4194304] 0 2024-09-18T21:12:51.159 INFO:tasks.workunit.client.1.smithi103.stdout:4/445: truncate d9/d38/d72/f8f 97513 0 2024-09-18T21:12:51.159 INFO:tasks.workunit.client.1.smithi103.stdout:4/446: chown d9/d2e/d83 1007827 1 2024-09-18T21:12:51.160 INFO:tasks.workunit.client.1.smithi103.stdout:2/403: dread d3/d5/f6f [0,4194304] 0 2024-09-18T21:12:51.160 INFO:tasks.workunit.client.0.smithi077.stdout:8/366: rmdir d2/d5/d6/d22/d20/d35 39 2024-09-18T21:12:51.162 INFO:tasks.workunit.client.0.smithi077.stdout:0/507: dwrite d8/d37/f48 [0,4194304] 0 2024-09-18T21:12:51.162 INFO:tasks.workunit.client.0.smithi077.stdout:2/498: dread d1/d4/d5/d1a/f4a [0,4194304] 0 2024-09-18T21:12:51.163 INFO:tasks.workunit.client.1.smithi103.stdout:8/555: dread d4/d26/f4d [0,4194304] 0 2024-09-18T21:12:51.164 INFO:tasks.workunit.client.0.smithi077.stdout:2/499: chown d1/d4/d5/c48 1239 1 2024-09-18T21:12:51.164 INFO:tasks.workunit.client.1.smithi103.stdout:0/454: creat d1/d5/de/d24/d43/d76/f9c x:0 0 0 2024-09-18T21:12:51.166 INFO:tasks.workunit.client.1.smithi103.stdout:9/462: symlink d18/d8d/d2f/l9b 0 2024-09-18T21:12:51.166 INFO:tasks.workunit.client.1.smithi103.stdout:9/463: chown d18/d8d/d2f/f65 27805064 1 2024-09-18T21:12:51.168 INFO:tasks.workunit.client.1.smithi103.stdout:7/414: rename d1/df/d43/f6c to d1/f7c 0 2024-09-18T21:12:51.168 INFO:tasks.workunit.client.1.smithi103.stdout:9/464: read - d18/f64 zero size 2024-09-18T21:12:51.168 INFO:tasks.workunit.client.0.smithi077.stdout:1/439: symlink d3/d8/d49/la2 0 2024-09-18T21:12:51.170 INFO:tasks.workunit.client.0.smithi077.stdout:9/374: getdents d1/dd/d11/d15 0 2024-09-18T21:12:51.170 INFO:tasks.workunit.client.1.smithi103.stdout:7/415: write d1/df/d42/d1f/f2d [3132978,39064] 0 2024-09-18T21:12:51.170 INFO:tasks.workunit.client.1.smithi103.stdout:3/473: link d1/d2/d18/d30/d4e/f61 d1/d64/f95 0 2024-09-18T21:12:51.172 INFO:tasks.workunit.client.1.smithi103.stdout:1/449: sync 2024-09-18T21:12:51.172 INFO:tasks.workunit.client.1.smithi103.stdout:5/496: sync 2024-09-18T21:12:51.173 INFO:tasks.workunit.client.0.smithi077.stdout:9/375: dread d1/dd/d11/d1c/f31 [0,4194304] 0 2024-09-18T21:12:51.174 INFO:tasks.workunit.client.1.smithi103.stdout:1/450: chown d0/d3/c80 8537 1 2024-09-18T21:12:51.174 INFO:tasks.workunit.client.1.smithi103.stdout:2/404: fsync d3/d5/d2f/d48/f4f 0 2024-09-18T21:12:51.178 INFO:tasks.workunit.client.1.smithi103.stdout:3/474: dwrite d1/d23/d25/d4f/d58/f6d [0,4194304] 0 2024-09-18T21:12:51.179 INFO:tasks.workunit.client.0.smithi077.stdout:1/440: creat d3/d8/d49/d4e/d50/fa3 x:0 0 0 2024-09-18T21:12:51.179 INFO:tasks.workunit.client.1.smithi103.stdout:8/556: rmdir d4/d26 39 2024-09-18T21:12:51.180 INFO:tasks.workunit.client.1.smithi103.stdout:3/475: fdatasync d1/d23/d25/d4f/d51/f5d 0 2024-09-18T21:12:51.181 INFO:tasks.workunit.client.0.smithi077.stdout:8/367: creat d2/d5/d6/d22/d4f/d5a/d5e/f83 x:0 0 0 2024-09-18T21:12:51.186 INFO:tasks.workunit.client.1.smithi103.stdout:8/557: dwrite d4/d2d/d3d/f5a [0,4194304] 0 2024-09-18T21:12:51.186 INFO:tasks.workunit.client.1.smithi103.stdout:4/447: rename d9/f23 to d9/d1a/d21/d80/f97 0 2024-09-18T21:12:51.187 INFO:tasks.workunit.client.1.smithi103.stdout:4/448: readlink d9/d1c/d69/l82 0 2024-09-18T21:12:51.187 INFO:tasks.workunit.client.1.smithi103.stdout:4/449: chown d9/d38/d58/f93 52 1 2024-09-18T21:12:51.188 INFO:tasks.workunit.client.1.smithi103.stdout:9/465: readlink d18/l83 0 2024-09-18T21:12:51.189 INFO:tasks.workunit.client.0.smithi077.stdout:1/441: symlink d3/d5f/la4 0 2024-09-18T21:12:51.201 INFO:tasks.workunit.client.1.smithi103.stdout:5/497: creat de/d3e/d15/f9e x:0 0 0 2024-09-18T21:12:51.201 INFO:tasks.workunit.client.1.smithi103.stdout:5/498: fdatasync de/f2b 0 2024-09-18T21:12:51.203 INFO:tasks.workunit.client.0.smithi077.stdout:2/500: rename d1/d4/d5/d1a/f6c to d1/d4/d9/fa0 0 2024-09-18T21:12:51.204 INFO:tasks.workunit.client.0.smithi077.stdout:1/442: mkdir d3/d8/d75/d54/da5 0 2024-09-18T21:12:51.206 INFO:tasks.workunit.client.1.smithi103.stdout:2/405: unlink d3/d5/d25/d40/f4e 0 2024-09-18T21:12:51.207 INFO:tasks.workunit.client.1.smithi103.stdout:2/406: write d3/d5/d2c/d54/d68/f8a [142042,71344] 0 2024-09-18T21:12:51.207 INFO:tasks.workunit.client.1.smithi103.stdout:1/451: symlink d0/d2/d9/dc/d6e/l99 0 2024-09-18T21:12:51.208 INFO:tasks.workunit.client.1.smithi103.stdout:1/452: chown d0/d2/d2b/d85 74 1 2024-09-18T21:12:51.208 INFO:tasks.workunit.client.1.smithi103.stdout:1/453: chown d0/d3/f4b 3 1 2024-09-18T21:12:51.210 INFO:tasks.workunit.client.0.smithi077.stdout:0/508: link d8/d1a/d39/d56/f69 d8/d1a/fa3 0 2024-09-18T21:12:51.210 INFO:tasks.workunit.client.0.smithi077.stdout:9/376: dwrite d1/d54/f3b [0,4194304] 0 2024-09-18T21:12:51.212 INFO:tasks.workunit.client.0.smithi077.stdout:9/377: write d1/dd/d11/d2d/f32 [2445308,49651] 0 2024-09-18T21:12:51.216 INFO:tasks.workunit.client.0.smithi077.stdout:1/443: mkdir d3/d5f/da6 0 2024-09-18T21:12:51.220 INFO:tasks.workunit.client.1.smithi103.stdout:9/466: dread d18/f3c [0,4194304] 0 2024-09-18T21:12:51.221 INFO:tasks.workunit.client.1.smithi103.stdout:8/558: symlink d4/d2d/d4e/d73/lb2 0 2024-09-18T21:12:51.221 INFO:tasks.workunit.client.1.smithi103.stdout:4/450: creat d9/d38/d72/f98 x:0 0 0 2024-09-18T21:12:51.223 INFO:tasks.workunit.client.0.smithi077.stdout:0/509: rename d8/d1a/d35/f47 to d8/d37/d66/d87/fa4 0 2024-09-18T21:12:51.224 INFO:tasks.workunit.client.0.smithi077.stdout:1/444: dwrite d3/d8/d49/d4e/d50/f30 [0,4194304] 0 2024-09-18T21:12:51.224 INFO:tasks.workunit.client.0.smithi077.stdout:0/510: chown d8/d1a/d39 57192 1 2024-09-18T21:12:51.227 INFO:tasks.workunit.client.1.smithi103.stdout:7/416: truncate d1/df/f22 5023301 0 2024-09-18T21:12:51.229 INFO:tasks.workunit.client.0.smithi077.stdout:8/368: getdents d2/d5/d6/d22 0 2024-09-18T21:12:51.230 INFO:tasks.workunit.client.0.smithi077.stdout:2/501: dread d1/d4/f5f [0,4194304] 0 2024-09-18T21:12:51.233 INFO:tasks.workunit.client.0.smithi077.stdout:1/445: chown d3/d6a/d9b/d4c/f5c 1312560465 1 2024-09-18T21:12:51.234 INFO:tasks.workunit.client.0.smithi077.stdout:0/511: mknod d8/d1a/d39/d3b/d9a/ca5 0 2024-09-18T21:12:51.235 INFO:tasks.workunit.client.0.smithi077.stdout:9/378: mknod d1/dd/d11/d1c/d38/c75 0 2024-09-18T21:12:51.237 INFO:tasks.workunit.client.1.smithi103.stdout:0/455: link d1/d5/de/l4d d1/d5/de/d24/d43/l9d 0 2024-09-18T21:12:51.237 INFO:tasks.workunit.client.0.smithi077.stdout:2/502: dwrite d1/f11 [0,4194304] 0 2024-09-18T21:12:51.239 INFO:tasks.workunit.client.1.smithi103.stdout:3/476: rename d1/d2/l8a to d1/d23/d25/d4f/d72/d7e/l96 0 2024-09-18T21:12:51.242 INFO:tasks.workunit.client.1.smithi103.stdout:8/559: dread - d4/de/d4a/fb1 zero size 2024-09-18T21:12:51.243 INFO:tasks.workunit.client.0.smithi077.stdout:0/512: truncate d8/d1a/d39/d3b/d4e/f52 1275054 0 2024-09-18T21:12:51.243 INFO:tasks.workunit.client.0.smithi077.stdout:0/513: chown c6 127768886 1 2024-09-18T21:12:51.244 INFO:tasks.workunit.client.1.smithi103.stdout:4/451: creat d9/d2e/d61/f99 x:0 0 0 2024-09-18T21:12:51.245 INFO:tasks.workunit.client.0.smithi077.stdout:1/446: rename d3/d8/d49/d4e/d5a/l7e to d3/d8/d75/d54/la7 0 2024-09-18T21:12:51.248 INFO:tasks.workunit.client.0.smithi077.stdout:0/514: chown d8/d26/f6b 4 1 2024-09-18T21:12:51.249 INFO:tasks.workunit.client.1.smithi103.stdout:0/456: rmdir d1/d9/d3e 39 2024-09-18T21:12:51.249 INFO:tasks.workunit.client.0.smithi077.stdout:0/515: write d8/d1a/d39/d3b/d79/f7d [882522,108542] 0 2024-09-18T21:12:51.250 INFO:tasks.workunit.client.0.smithi077.stdout:0/516: stat d8/d26/f75 0 2024-09-18T21:12:51.250 INFO:tasks.workunit.client.0.smithi077.stdout:0/517: dread - d8/d1d/f74 zero size 2024-09-18T21:12:51.251 INFO:tasks.workunit.client.0.smithi077.stdout:2/503: rename d1/d4/d5/d1a/d2e/d86/c98 to d1/d4/d9/d4f/ca1 0 2024-09-18T21:12:51.251 INFO:tasks.workunit.client.1.smithi103.stdout:9/467: dwrite d18/d52/d5e/f5f [0,4194304] 0 2024-09-18T21:12:51.253 INFO:tasks.workunit.client.0.smithi077.stdout:0/518: truncate d8/d1a/d39/d3b/d9a/fa1 162495 0 2024-09-18T21:12:51.253 INFO:tasks.workunit.client.1.smithi103.stdout:5/499: rename de/f1c to de/d3e/d15/f9f 0 2024-09-18T21:12:51.253 INFO:tasks.workunit.client.0.smithi077.stdout:1/447: mknod d3/d8/d13/d18/ca8 0 2024-09-18T21:12:51.254 INFO:tasks.workunit.client.1.smithi103.stdout:4/452: dwrite d9/d1f/f44 [0,4194304] 0 2024-09-18T21:12:51.254 INFO:tasks.workunit.client.1.smithi103.stdout:7/417: rename d1/df/d42 to d1/df/d42/d29/d2f/d33/d7d 22 2024-09-18T21:12:51.254 INFO:tasks.workunit.client.1.smithi103.stdout:2/407: dread d3/d5/f11 [0,4194304] 0 2024-09-18T21:12:51.254 INFO:tasks.workunit.client.0.smithi077.stdout:1/448: write d3/f23 [1443417,70184] 0 2024-09-18T21:12:51.255 INFO:tasks.workunit.client.1.smithi103.stdout:3/477: symlink d1/d23/d25/d4f/d72/d85/l97 0 2024-09-18T21:12:51.256 INFO:tasks.workunit.client.1.smithi103.stdout:8/560: rmdir d4/de 39 2024-09-18T21:12:51.257 INFO:tasks.workunit.client.1.smithi103.stdout:7/418: dread - d1/df/d42/d1f/d5d/f71 zero size 2024-09-18T21:12:51.259 INFO:tasks.workunit.client.0.smithi077.stdout:2/504: write d1/d4/d5/d1a/f4c [719929,26809] 0 2024-09-18T21:12:51.265 INFO:tasks.workunit.client.0.smithi077.stdout:8/369: dwrite d2/d27/d29/f61 [0,4194304] 0 2024-09-18T21:12:51.270 INFO:tasks.workunit.client.0.smithi077.stdout:2/505: mknod d1/d4/d9/d80/d8e/ca2 0 2024-09-18T21:12:51.272 INFO:tasks.workunit.client.0.smithi077.stdout:2/506: write d1/d4/d5/d1a/d2e/d40/f99 [600926,25484] 0 2024-09-18T21:12:51.272 INFO:tasks.workunit.client.0.smithi077.stdout:8/370: chown d2/d5/d6/l1c 0 1 2024-09-18T21:12:51.273 INFO:tasks.workunit.client.1.smithi103.stdout:2/408: rmdir d3/d5/d25/d40 39 2024-09-18T21:12:51.274 INFO:tasks.workunit.client.0.smithi077.stdout:1/449: mknod d3/ca9 0 2024-09-18T21:12:51.277 INFO:tasks.workunit.client.1.smithi103.stdout:4/453: rename d9/d1a/f55 to d9/d38/f9a 0 2024-09-18T21:12:51.277 INFO:tasks.workunit.client.1.smithi103.stdout:6/439: sync 2024-09-18T21:12:51.278 INFO:tasks.workunit.client.1.smithi103.stdout:4/454: dread - d9/d2e/d61/f99 zero size 2024-09-18T21:12:51.278 INFO:tasks.workunit.client.0.smithi077.stdout:2/507: rename d1/c64 to d1/d4/d9/d4f/ca3 0 2024-09-18T21:12:51.280 INFO:tasks.workunit.client.1.smithi103.stdout:9/468: mkdir d18/d29/d68/d92/d9c 0 2024-09-18T21:12:51.281 INFO:tasks.workunit.client.1.smithi103.stdout:6/440: dread d2/d24/d5a/f17 [0,4194304] 0 2024-09-18T21:12:51.285 INFO:tasks.workunit.client.1.smithi103.stdout:9/469: dwrite d18/f38 [4194304,4194304] 0 2024-09-18T21:12:51.285 INFO:tasks.workunit.client.0.smithi077.stdout:1/450: dread d3/d6a/d9b/f5b [0,4194304] 0 2024-09-18T21:12:51.286 INFO:tasks.workunit.client.0.smithi077.stdout:2/508: dwrite d1/d4/d9/d80/f90 [0,4194304] 0 2024-09-18T21:12:51.288 INFO:tasks.workunit.client.0.smithi077.stdout:2/509: write d1/d4/d5/d1a/d2e/d41/f5d [1049529,67366] 0 2024-09-18T21:12:51.290 INFO:tasks.workunit.client.0.smithi077.stdout:2/510: chown d1/d4/d9/d80/d8e/l4b 49720 1 2024-09-18T21:12:51.291 INFO:tasks.workunit.client.1.smithi103.stdout:0/457: rename d1/d5/de/d19/d1e/d34/f70 to d1/d9/d3e/d6e/f9e 0 2024-09-18T21:12:51.291 INFO:tasks.workunit.client.0.smithi077.stdout:4/411: sync 2024-09-18T21:12:51.292 INFO:tasks.workunit.client.1.smithi103.stdout:0/458: chown d1/d9/d3e/d6e/f97 688145 1 2024-09-18T21:12:51.295 INFO:tasks.workunit.client.0.smithi077.stdout:8/371: write d2/d27/d29/f68 [1082318,66522] 0 2024-09-18T21:12:51.297 INFO:tasks.workunit.client.1.smithi103.stdout:0/459: dwrite d1/d5/de/d19/d1e/f1f [0,4194304] 0 2024-09-18T21:12:51.298 INFO:tasks.workunit.client.1.smithi103.stdout:4/455: creat d9/d1a/d21/f9b x:0 0 0 2024-09-18T21:12:51.299 INFO:tasks.workunit.client.1.smithi103.stdout:4/456: chown d9/d1c 21 1 2024-09-18T21:12:51.299 INFO:tasks.workunit.client.1.smithi103.stdout:4/457: dread - d9/f6d zero size 2024-09-18T21:12:51.300 INFO:tasks.workunit.client.0.smithi077.stdout:0/519: dwrite d8/d1a/d39/d3b/d4e/f52 [0,4194304] 0 2024-09-18T21:12:51.302 INFO:tasks.workunit.client.0.smithi077.stdout:1/451: dread d3/d8/f59 [0,4194304] 0 2024-09-18T21:12:51.303 INFO:tasks.workunit.client.0.smithi077.stdout:1/452: readlink d3/d5f/la4 0 2024-09-18T21:12:51.304 INFO:tasks.workunit.client.1.smithi103.stdout:4/458: dwrite d9/f14 [0,4194304] 0 2024-09-18T21:12:51.314 INFO:tasks.workunit.client.0.smithi077.stdout:1/453: dwrite d3/d8/d13/f26 [0,4194304] 0 2024-09-18T21:12:51.340 INFO:tasks.workunit.client.1.smithi103.stdout:4/459: dread d9/f11 [0,4194304] 0 2024-09-18T21:12:51.342 INFO:tasks.workunit.client.1.smithi103.stdout:1/454: sync 2024-09-18T21:12:51.359 INFO:tasks.workunit.client.0.smithi077.stdout:4/412: write d3/dc/f1b [1405598,22765] 0 2024-09-18T21:12:51.361 INFO:tasks.workunit.client.1.smithi103.stdout:5/500: truncate de/d1f/f52 147978 0 2024-09-18T21:12:51.363 INFO:tasks.workunit.client.1.smithi103.stdout:5/501: truncate de/d3e/d15/f7a 619436 0 2024-09-18T21:12:51.363 INFO:tasks.workunit.client.1.smithi103.stdout:2/409: creat d3/d5/d25/d98/f9a x:0 0 0 2024-09-18T21:12:51.364 INFO:tasks.workunit.client.1.smithi103.stdout:2/410: chown d3/d5/d2f/d5b 3401894 1 2024-09-18T21:12:51.366 INFO:tasks.workunit.client.1.smithi103.stdout:3/478: rmdir d1/da/d7a 0 2024-09-18T21:12:51.368 INFO:tasks.workunit.client.0.smithi077.stdout:8/372: creat d2/d5/d6/d22/d26/f84 x:0 0 0 2024-09-18T21:12:51.372 INFO:tasks.workunit.client.0.smithi077.stdout:0/520: dread d8/d37/d66/d87/fa4 [0,4194304] 0 2024-09-18T21:12:51.372 INFO:tasks.workunit.client.0.smithi077.stdout:0/521: chown d8/d1a/d35/c5a 14253 1 2024-09-18T21:12:51.373 INFO:tasks.workunit.client.0.smithi077.stdout:0/522: write d8/d1a/f51 [4414814,14149] 0 2024-09-18T21:12:51.383 INFO:tasks.workunit.client.1.smithi103.stdout:2/411: dread - d3/d5/d2f/d48/f4f zero size 2024-09-18T21:12:51.387 INFO:tasks.workunit.client.1.smithi103.stdout:6/441: rmdir d2/d24/d5a/d67/d76/d43 39 2024-09-18T21:12:51.393 INFO:tasks.workunit.client.1.smithi103.stdout:6/442: dread d2/f4a [0,4194304] 0 2024-09-18T21:12:51.393 INFO:tasks.workunit.client.1.smithi103.stdout:1/455: link d0/d3/c80 d0/d2/d9/dc/d6e/c9a 0 2024-09-18T21:12:51.395 INFO:tasks.workunit.client.1.smithi103.stdout:6/443: chown d2/d3/l7 31784189 1 2024-09-18T21:12:51.400 INFO:tasks.workunit.client.1.smithi103.stdout:1/456: creat d0/d11/d5f/d19/d70/d7a/f9b x:0 0 0 2024-09-18T21:12:51.401 INFO:tasks.workunit.client.1.smithi103.stdout:1/457: write d0/d2/d9/d10/d5d/f88 [1213788,104474] 0 2024-09-18T21:12:51.402 INFO:tasks.workunit.client.1.smithi103.stdout:1/458: truncate d0/d2/d2b/d3a/f91 188077 0 2024-09-18T21:12:51.404 INFO:tasks.workunit.client.1.smithi103.stdout:5/502: symlink de/d14/la0 0 2024-09-18T21:12:51.405 INFO:tasks.workunit.client.0.smithi077.stdout:4/413: symlink d3/dc/d32/d45/l7e 0 2024-09-18T21:12:51.407 INFO:tasks.workunit.client.0.smithi077.stdout:4/414: chown d3/d7/d42/c74 49 1 2024-09-18T21:12:51.407 INFO:tasks.workunit.client.0.smithi077.stdout:4/415: chown d3/fb 1 1 2024-09-18T21:12:51.407 INFO:tasks.workunit.client.0.smithi077.stdout:4/416: chown d3/d7/d73 6833742 1 2024-09-18T21:12:51.408 INFO:tasks.workunit.client.0.smithi077.stdout:4/417: dread - d3/d7/f70 zero size 2024-09-18T21:12:51.409 INFO:tasks.workunit.client.1.smithi103.stdout:5/503: dwrite de/d3e/d15/f8a [0,4194304] 0 2024-09-18T21:12:51.410 INFO:tasks.workunit.client.1.smithi103.stdout:6/444: dread d2/d24/d5a/f11 [0,4194304] 0 2024-09-18T21:12:51.411 INFO:tasks.workunit.client.1.smithi103.stdout:1/459: mkdir d0/d2/d2b/d3a/d42/d9c 0 2024-09-18T21:12:51.411 INFO:tasks.workunit.client.1.smithi103.stdout:1/460: stat d0/d2/d9/d10/d5d 0 2024-09-18T21:12:51.412 INFO:tasks.workunit.client.1.smithi103.stdout:1/461: fsync d0/d11/d5f/f93 0 2024-09-18T21:12:51.415 INFO:tasks.workunit.client.1.smithi103.stdout:5/504: mknod de/d1f/d3b/d51/ca1 0 2024-09-18T21:12:51.416 INFO:tasks.workunit.client.1.smithi103.stdout:6/445: mknod d2/d3/d8/d4c/d7a/c87 0 2024-09-18T21:12:51.417 INFO:tasks.workunit.client.1.smithi103.stdout:6/446: readlink d2/d24/d38/l46 0 2024-09-18T21:12:51.417 INFO:tasks.workunit.client.0.smithi077.stdout:0/523: symlink d8/d1a/d39/d3b/d79/la6 0 2024-09-18T21:12:51.418 INFO:tasks.workunit.client.1.smithi103.stdout:6/447: dread - d2/d3/d7f/f85 zero size 2024-09-18T21:12:51.419 INFO:tasks.workunit.client.1.smithi103.stdout:1/462: creat d0/f9d x:0 0 0 2024-09-18T21:12:51.422 INFO:tasks.workunit.client.1.smithi103.stdout:5/505: dwrite de/d14/f18 [0,4194304] 0 2024-09-18T21:12:51.423 INFO:tasks.workunit.client.0.smithi077.stdout:0/524: dread d8/d26/f1b [0,4194304] 0 2024-09-18T21:12:51.424 INFO:tasks.workunit.client.1.smithi103.stdout:6/448: symlink d2/d24/d38/l88 0 2024-09-18T21:12:51.426 INFO:tasks.workunit.client.1.smithi103.stdout:5/506: write de/d1f/d3b/f72 [809841,11739] 0 2024-09-18T21:12:51.427 INFO:tasks.workunit.client.0.smithi077.stdout:0/525: creat d8/fa7 x:0 0 0 2024-09-18T21:12:51.427 INFO:tasks.workunit.client.1.smithi103.stdout:6/449: dread d2/f4a [0,4194304] 0 2024-09-18T21:12:51.429 INFO:tasks.workunit.client.0.smithi077.stdout:0/526: write d8/f2d [3810917,69978] 0 2024-09-18T21:12:51.431 INFO:tasks.workunit.client.1.smithi103.stdout:5/507: creat de/d14/d33/d4f/fa2 x:0 0 0 2024-09-18T21:12:51.431 INFO:tasks.workunit.client.0.smithi077.stdout:0/527: dread d8/d1a/d39/d3b/d9a/fa1 [0,4194304] 0 2024-09-18T21:12:51.433 INFO:tasks.workunit.client.1.smithi103.stdout:6/450: creat d2/d24/d38/f89 x:0 0 0 2024-09-18T21:12:51.436 INFO:tasks.workunit.client.1.smithi103.stdout:5/508: creat de/d1f/d3b/d51/d57/d79/fa3 x:0 0 0 2024-09-18T21:12:51.439 INFO:tasks.workunit.client.0.smithi077.stdout:0/528: symlink d8/d1a/d35/d6d/la8 0 2024-09-18T21:12:51.441 INFO:tasks.workunit.client.0.smithi077.stdout:0/529: write d8/d37/d66/f6c [464075,37651] 0 2024-09-18T21:12:51.443 INFO:tasks.workunit.client.1.smithi103.stdout:6/451: symlink d2/d24/d5a/d67/d76/l8a 0 2024-09-18T21:12:51.444 INFO:tasks.workunit.client.0.smithi077.stdout:0/530: dread d8/d1a/d39/d3b/d4e/f7f [0,4194304] 0 2024-09-18T21:12:51.445 INFO:tasks.workunit.client.1.smithi103.stdout:5/509: link de/d14/f5b de/d14/d33/d4f/fa4 0 2024-09-18T21:12:51.446 INFO:tasks.workunit.client.1.smithi103.stdout:6/452: dread d2/f56 [0,4194304] 0 2024-09-18T21:12:51.452 INFO:tasks.workunit.client.1.smithi103.stdout:5/510: dwrite de/f81 [4194304,4194304] 0 2024-09-18T21:12:51.459 INFO:tasks.workunit.client.1.smithi103.stdout:5/511: truncate de/d14/d33/d4f/f9d 533367 0 2024-09-18T21:12:51.461 INFO:tasks.workunit.client.1.smithi103.stdout:5/512: write de/d1f/d3b/d3c/d62/f76 [385427,59259] 0 2024-09-18T21:12:51.462 INFO:tasks.workunit.client.1.smithi103.stdout:5/513: chown de/d2d/d7f 435242 1 2024-09-18T21:12:51.462 INFO:tasks.workunit.client.1.smithi103.stdout:7/419: sync 2024-09-18T21:12:51.463 INFO:tasks.workunit.client.1.smithi103.stdout:7/420: readlink d1/df/l74 0 2024-09-18T21:12:51.464 INFO:tasks.workunit.client.1.smithi103.stdout:7/421: dread - d1/df/d42/d29/d48/f77 zero size 2024-09-18T21:12:51.467 INFO:tasks.workunit.client.1.smithi103.stdout:5/514: creat de/d2d/fa5 x:0 0 0 2024-09-18T21:12:51.467 INFO:tasks.workunit.client.1.smithi103.stdout:7/422: creat d1/df/d43/d63/d67/d5b/f7e x:0 0 0 2024-09-18T21:12:51.468 INFO:tasks.workunit.client.1.smithi103.stdout:8/561: write d4/d26/f1a [26915,48592] 0 2024-09-18T21:12:51.470 INFO:tasks.workunit.client.1.smithi103.stdout:8/562: rmdir d4/d2d 39 2024-09-18T21:12:51.475 INFO:tasks.workunit.client.1.smithi103.stdout:0/460: truncate d1/d5/de/d19/d1e/d34/f69 4064986 0 2024-09-18T21:12:51.483 INFO:tasks.workunit.client.1.smithi103.stdout:2/412: dwrite d3/d5/f11 [0,4194304] 0 2024-09-18T21:12:51.484 INFO:tasks.workunit.client.1.smithi103.stdout:2/413: dread - d3/d5/d4a/f53 zero size 2024-09-18T21:12:51.487 INFO:tasks.workunit.client.1.smithi103.stdout:2/414: creat d3/d5/d2f/d48/f9b x:0 0 0 2024-09-18T21:12:51.489 INFO:tasks.workunit.client.1.smithi103.stdout:4/460: rename d9/f25 to d9/d1a/d2b/d48/f9c 0 2024-09-18T21:12:51.489 INFO:tasks.workunit.client.0.smithi077.stdout:1/454: truncate d3/d8/f67 2967173 0 2024-09-18T21:12:51.490 INFO:tasks.workunit.client.1.smithi103.stdout:4/461: write d9/d1a/d21/f9b [481850,126138] 0 2024-09-18T21:12:51.492 INFO:tasks.workunit.client.1.smithi103.stdout:2/415: mkdir d3/d5/d2c/d77/d9c 0 2024-09-18T21:12:51.496 INFO:tasks.workunit.client.1.smithi103.stdout:2/416: creat d3/d5/d2c/d54/d68/f9d x:0 0 0 2024-09-18T21:12:51.497 INFO:tasks.workunit.client.1.smithi103.stdout:2/417: read - d3/d5/d25/f8e zero size 2024-09-18T21:12:51.497 INFO:tasks.workunit.client.0.smithi077.stdout:1/455: dwrite d3/d8/d75/d54/f6f [0,4194304] 0 2024-09-18T21:12:51.498 INFO:tasks.workunit.client.1.smithi103.stdout:1/463: rename d0/d11/d5f/d19/d70 to d0/d2/d9/d9e 0 2024-09-18T21:12:51.500 INFO:tasks.workunit.client.1.smithi103.stdout:9/470: rmdir d18/d90 0 2024-09-18T21:12:51.503 INFO:tasks.workunit.client.0.smithi077.stdout:1/456: mknod d3/d8/d13/d18/d99/caa 0 2024-09-18T21:12:51.504 INFO:tasks.workunit.client.1.smithi103.stdout:1/464: rmdir d0/d2/d2b 39 2024-09-18T21:12:51.507 INFO:tasks.workunit.client.1.smithi103.stdout:9/471: link d18/f70 d18/d52/d5e/f9d 0 2024-09-18T21:12:51.508 INFO:tasks.workunit.client.1.smithi103.stdout:9/472: write d18/d8d/f28 [1757773,109380] 0 2024-09-18T21:12:51.510 INFO:tasks.workunit.client.0.smithi077.stdout:8/373: symlink d2/d27/d29/l85 0 2024-09-18T21:12:51.511 INFO:tasks.workunit.client.0.smithi077.stdout:8/374: readlink d2/d5/d6/d22/l5b 0 2024-09-18T21:12:51.511 INFO:tasks.workunit.client.0.smithi077.stdout:8/375: dread - d2/d5/d6/d22/d4f/f69 zero size 2024-09-18T21:12:51.512 INFO:tasks.workunit.client.1.smithi103.stdout:6/453: creat d2/d3/d8/d4c/f8b x:0 0 0 2024-09-18T21:12:51.512 INFO:tasks.workunit.client.1.smithi103.stdout:4/462: dread d9/d1a/f1e [0,4194304] 0 2024-09-18T21:12:51.516 INFO:tasks.workunit.client.0.smithi077.stdout:0/531: rename d8/d1a/d39/d3b/d9a/fa1 to d8/d1a/d39/d3b/d4e/fa9 0 2024-09-18T21:12:51.517 INFO:tasks.workunit.client.1.smithi103.stdout:4/463: rename d9/d1c/d77/f7f to d9/d1a/d21/d80/f9d 0 2024-09-18T21:12:51.519 INFO:tasks.workunit.client.0.smithi077.stdout:1/457: rename d3/d6a/d9b/d4c/c66 to d3/d5f/cab 0 2024-09-18T21:12:51.520 INFO:tasks.workunit.client.0.smithi077.stdout:6/432: sync 2024-09-18T21:12:51.521 INFO:tasks.workunit.client.0.smithi077.stdout:0/532: truncate d8/d1d/f68 2488554 0 2024-09-18T21:12:51.523 INFO:tasks.workunit.client.0.smithi077.stdout:2/511: symlink d1/d4/d5/d1a/d2e/d41/la4 0 2024-09-18T21:12:51.523 INFO:tasks.workunit.client.1.smithi103.stdout:6/454: getdents d2/d3 0 2024-09-18T21:12:51.523 INFO:tasks.workunit.client.0.smithi077.stdout:1/458: readlink d3/d8/d75/d54/la7 0 2024-09-18T21:12:51.524 INFO:tasks.workunit.client.1.smithi103.stdout:4/464: dwrite d9/f14 [0,4194304] 0 2024-09-18T21:12:51.524 INFO:tasks.workunit.client.1.smithi103.stdout:9/473: dread d18/d29/f4d [0,4194304] 0 2024-09-18T21:12:51.525 INFO:tasks.workunit.client.0.smithi077.stdout:6/433: truncate d7/d7e/f28 988211 0 2024-09-18T21:12:51.525 INFO:tasks.workunit.client.0.smithi077.stdout:1/459: read d3/d8/f88 [37739,26125] 0 2024-09-18T21:12:51.526 INFO:tasks.workunit.client.0.smithi077.stdout:0/533: unlink d8/d37/d66/d87/f90 0 2024-09-18T21:12:51.527 INFO:tasks.workunit.client.0.smithi077.stdout:0/534: readlink d8/d37/d66/l73 0 2024-09-18T21:12:51.528 INFO:tasks.workunit.client.0.smithi077.stdout:2/512: creat d1/d4/d5/d1a/d49/d6a/d81/fa5 x:0 0 0 2024-09-18T21:12:51.529 INFO:tasks.workunit.client.1.smithi103.stdout:6/455: write d2/d3/d8/d4c/f61 [1176802,45169] 0 2024-09-18T21:12:51.533 INFO:tasks.workunit.client.0.smithi077.stdout:1/460: dwrite d3/d8/d13/d18/f1a [4194304,4194304] 0 2024-09-18T21:12:51.535 INFO:tasks.workunit.client.0.smithi077.stdout:2/513: dread d1/d4/d5/d1a/d2e/d40/f99 [0,4194304] 0 2024-09-18T21:12:51.536 INFO:tasks.workunit.client.1.smithi103.stdout:9/474: link d18/d8d/d2f/f97 d18/d52/d6f/d8e/d96/f9e 0 2024-09-18T21:12:51.536 INFO:tasks.workunit.client.1.smithi103.stdout:9/475: fdatasync d18/d52/f85 0 2024-09-18T21:12:51.537 INFO:tasks.workunit.client.0.smithi077.stdout:6/434: creat d7/d7e/d11/d1d/d5c/f95 x:0 0 0 2024-09-18T21:12:51.537 INFO:tasks.workunit.client.0.smithi077.stdout:2/514: write d1/f19 [565597,116713] 0 2024-09-18T21:12:51.540 INFO:tasks.workunit.client.0.smithi077.stdout:0/535: dread d8/d26/f32 [0,4194304] 0 2024-09-18T21:12:51.540 INFO:tasks.workunit.client.1.smithi103.stdout:9/476: dread d18/d52/d5e/f9d [0,4194304] 0 2024-09-18T21:12:51.543 INFO:tasks.workunit.client.1.smithi103.stdout:6/456: creat d2/d24/d5a/d67/d76/f8c x:0 0 0 2024-09-18T21:12:51.545 INFO:tasks.workunit.client.1.smithi103.stdout:5/515: truncate de/d1f/d3b/d51/d57/d59/f5c 2091587 0 2024-09-18T21:12:51.548 INFO:tasks.workunit.client.0.smithi077.stdout:6/435: mkdir d7/d7e/d11/d1d/d49/d96 0 2024-09-18T21:12:51.549 INFO:tasks.workunit.client.1.smithi103.stdout:7/423: truncate d1/df/d42/d1f/d2e/d3f/f4a 2988825 0 2024-09-18T21:12:51.549 INFO:tasks.workunit.client.1.smithi103.stdout:7/424: fsync d1/f4b 0 2024-09-18T21:12:51.551 INFO:tasks.workunit.client.1.smithi103.stdout:9/477: mknod d18/d29/d68/c9f 0 2024-09-18T21:12:51.552 INFO:tasks.workunit.client.1.smithi103.stdout:4/465: rename d9/d1a/d2b to d9/d2e/d61/d91/d9e 0 2024-09-18T21:12:51.552 INFO:tasks.workunit.client.1.smithi103.stdout:6/457: dread d2/d3/d8/d4c/f61 [0,4194304] 0 2024-09-18T21:12:51.554 INFO:tasks.workunit.client.1.smithi103.stdout:6/458: chown d2/f34 40166 1 2024-09-18T21:12:51.555 INFO:tasks.workunit.client.1.smithi103.stdout:8/563: dwrite d4/d2d/f33 [0,4194304] 0 2024-09-18T21:12:51.556 INFO:tasks.workunit.client.1.smithi103.stdout:6/459: chown d2/d3/d8/d4c/f8b 0 1 2024-09-18T21:12:51.556 INFO:tasks.workunit.client.1.smithi103.stdout:5/516: mkdir de/d14/d33/d4f/da6 0 2024-09-18T21:12:51.556 INFO:tasks.workunit.client.1.smithi103.stdout:5/517: chown de 1157 1 2024-09-18T21:12:51.557 INFO:tasks.workunit.client.0.smithi077.stdout:1/461: symlink d3/d8/lac 0 2024-09-18T21:12:51.560 INFO:tasks.workunit.client.1.smithi103.stdout:7/425: creat d1/df/d42/d1f/d5d/f7f x:0 0 0 2024-09-18T21:12:51.561 INFO:tasks.workunit.client.0.smithi077.stdout:2/515: creat d1/d4/d5/d1a/d2e/d40/d69/fa6 x:0 0 0 2024-09-18T21:12:51.563 INFO:tasks.workunit.client.1.smithi103.stdout:9/478: creat d18/d52/d6f/d8e/fa0 x:0 0 0 2024-09-18T21:12:51.564 INFO:tasks.workunit.client.1.smithi103.stdout:4/466: fdatasync d9/d38/f81 0 2024-09-18T21:12:51.565 INFO:tasks.workunit.client.0.smithi077.stdout:6/436: creat d7/d7c/f97 x:0 0 0 2024-09-18T21:12:51.566 INFO:tasks.workunit.client.0.smithi077.stdout:1/462: truncate d3/d6a/d9b/d68/f3c 737143 0 2024-09-18T21:12:51.567 INFO:tasks.workunit.client.1.smithi103.stdout:7/426: dwrite d1/df/d42/f4e [0,4194304] 0 2024-09-18T21:12:51.567 INFO:tasks.workunit.client.0.smithi077.stdout:8/376: truncate d2/d5/d6/d22/d18/f4c 7212076 0 2024-09-18T21:12:51.568 INFO:tasks.workunit.client.0.smithi077.stdout:8/377: chown d2/d5/d6/d22/d4f/d5a/d5e/f83 24 1 2024-09-18T21:12:51.569 INFO:tasks.workunit.client.0.smithi077.stdout:2/516: fdatasync d1/d4/d9/f65 0 2024-09-18T21:12:51.571 INFO:tasks.workunit.client.1.smithi103.stdout:9/479: dwrite d18/f3e [0,4194304] 0 2024-09-18T21:12:51.573 INFO:tasks.workunit.client.1.smithi103.stdout:9/480: stat d18/d52/c6d 0 2024-09-18T21:12:51.574 INFO:tasks.workunit.client.1.smithi103.stdout:4/467: dwrite d9/f14 [0,4194304] 0 2024-09-18T21:12:51.575 INFO:tasks.workunit.client.1.smithi103.stdout:9/481: write d18/d52/f60 [4114262,85572] 0 2024-09-18T21:12:51.575 INFO:tasks.workunit.client.0.smithi077.stdout:1/463: dwrite d3/d8/d13/d18/f83 [0,4194304] 0 2024-09-18T21:12:51.577 INFO:tasks.workunit.client.1.smithi103.stdout:9/482: chown d18/f3e 6 1 2024-09-18T21:12:51.579 INFO:tasks.workunit.client.1.smithi103.stdout:9/483: read d18/d52/d6f/f80 [373804,13736] 0 2024-09-18T21:12:51.581 INFO:tasks.workunit.client.1.smithi103.stdout:4/468: dread d9/f14 [0,4194304] 0 2024-09-18T21:12:51.584 INFO:tasks.workunit.client.0.smithi077.stdout:2/517: fdatasync d1/d4/d5/d1a/d2e/d41/d2c/f35 0 2024-09-18T21:12:51.588 INFO:tasks.workunit.client.0.smithi077.stdout:1/464: readlink d3/l7 0 2024-09-18T21:12:51.590 INFO:tasks.workunit.client.0.smithi077.stdout:6/437: link d7/d7e/d11/d25/l8d d7/d7e/d11/d1d/d49/d55/l98 0 2024-09-18T21:12:51.591 INFO:tasks.workunit.client.0.smithi077.stdout:6/438: chown d7/d7e/d11/f57 7365062 1 2024-09-18T21:12:51.592 INFO:tasks.workunit.client.0.smithi077.stdout:3/427: sync 2024-09-18T21:12:51.594 INFO:tasks.workunit.client.0.smithi077.stdout:3/428: fdatasync db/d14/d32/d49/d4e/d6a/f61 0 2024-09-18T21:12:51.595 INFO:tasks.workunit.client.0.smithi077.stdout:2/518: fdatasync d1/d4/d9/fa0 0 2024-09-18T21:12:51.596 INFO:tasks.workunit.client.0.smithi077.stdout:2/519: fsync d1/d4/d5/d1a/d49/f72 0 2024-09-18T21:12:51.597 INFO:tasks.workunit.client.0.smithi077.stdout:8/378: dread d2/d27/d29/f58 [0,4194304] 0 2024-09-18T21:12:51.598 INFO:tasks.workunit.client.0.smithi077.stdout:2/520: chown d1/d4/d9/d80/d8e/l3b 2106981 1 2024-09-18T21:12:51.599 INFO:tasks.workunit.client.0.smithi077.stdout:8/379: readlink d2/d5/d6/d22/d20/d3e/l6c 0 2024-09-18T21:12:51.600 INFO:tasks.workunit.client.0.smithi077.stdout:8/380: write d2/d5/d6/d22/f1b [958074,108246] 0 2024-09-18T21:12:51.603 INFO:tasks.workunit.client.1.smithi103.stdout:1/465: dwrite d0/d2/d9/f65 [0,4194304] 0 2024-09-18T21:12:51.605 INFO:tasks.workunit.client.1.smithi103.stdout:6/460: rename d2/d3/d8/d4c/d4e/l52 to d2/l8d 0 2024-09-18T21:12:51.606 INFO:tasks.workunit.client.0.smithi077.stdout:2/521: mknod d1/d62/ca7 0 2024-09-18T21:12:51.607 INFO:tasks.workunit.client.0.smithi077.stdout:0/536: write d8/f3a [657070,29862] 0 2024-09-18T21:12:51.608 INFO:tasks.workunit.client.0.smithi077.stdout:6/439: rename d7/d7e/d11/d1d/d49/l7b to d7/d7e/d11/d3e/d42/d88/l99 0 2024-09-18T21:12:51.610 INFO:tasks.workunit.client.0.smithi077.stdout:6/440: write d7/d7e/d11/d25/f5b [404529,35276] 0 2024-09-18T21:12:51.612 INFO:tasks.workunit.client.1.smithi103.stdout:9/484: symlink d18/d8d/la1 0 2024-09-18T21:12:51.612 INFO:tasks.workunit.client.1.smithi103.stdout:9/485: chown d18/d29 8515 1 2024-09-18T21:12:51.619 INFO:tasks.workunit.client.0.smithi077.stdout:2/522: rename d1/f67 to d1/d4/d5/d1a/d49/d6a/d81/fa8 0 2024-09-18T21:12:51.621 INFO:tasks.workunit.client.1.smithi103.stdout:1/466: symlink d0/d11/d5f/d19/l9f 0 2024-09-18T21:12:51.623 INFO:tasks.workunit.client.1.smithi103.stdout:6/461: symlink d2/d24/d38/l8e 0 2024-09-18T21:12:51.623 INFO:tasks.workunit.client.1.smithi103.stdout:6/462: chown d2/d24/d5a/c2c 305 1 2024-09-18T21:12:51.624 INFO:tasks.workunit.client.1.smithi103.stdout:5/518: getdents de/d1f/d3b/d51/d57/d59 0 2024-09-18T21:12:51.626 INFO:tasks.workunit.client.1.smithi103.stdout:9/486: creat d18/d52/d6f/d8e/fa2 x:0 0 0 2024-09-18T21:12:51.626 INFO:tasks.workunit.client.1.smithi103.stdout:9/487: fsync d18/d52/d6f/f88 0 2024-09-18T21:12:51.627 INFO:tasks.workunit.client.1.smithi103.stdout:4/469: link d9/d1a/l89 d9/d1a/d41/l9f 0 2024-09-18T21:12:51.627 INFO:tasks.workunit.client.1.smithi103.stdout:9/488: write d18/d8d/f28 [4241679,111666] 0 2024-09-18T21:12:51.628 INFO:tasks.workunit.client.1.smithi103.stdout:8/564: creat d4/de/d4a/d59/fb3 x:0 0 0 2024-09-18T21:12:51.629 INFO:tasks.workunit.client.0.smithi077.stdout:2/523: mknod d1/d4/d9/d80/d8e/d66/ca9 0 2024-09-18T21:12:51.629 INFO:tasks.workunit.client.0.smithi077.stdout:0/537: dread d8/d37/f63 [0,4194304] 0 2024-09-18T21:12:51.629 INFO:tasks.workunit.client.1.smithi103.stdout:1/467: rmdir d0/d11/d5f 39 2024-09-18T21:12:51.629 INFO:tasks.workunit.client.1.smithi103.stdout:8/565: truncate d4/d2d/d87/fa7 385262 0 2024-09-18T21:12:51.630 INFO:tasks.workunit.client.0.smithi077.stdout:2/524: readlink d1/d4/d5/d1a/d2e/d41/d2c/l50 0 2024-09-18T21:12:51.630 INFO:tasks.workunit.client.0.smithi077.stdout:0/538: write d8/d37/f48 [2096739,12361] 0 2024-09-18T21:12:51.631 INFO:tasks.workunit.client.0.smithi077.stdout:6/441: mkdir d7/d7e/d11/d9a 0 2024-09-18T21:12:51.632 INFO:tasks.workunit.client.1.smithi103.stdout:6/463: fdatasync d2/d3/f2f 0 2024-09-18T21:12:51.632 INFO:tasks.workunit.client.0.smithi077.stdout:1/465: write d3/d8/d49/f65 [4370099,109791] 0 2024-09-18T21:12:51.634 INFO:tasks.workunit.client.1.smithi103.stdout:5/519: rename de/d14/l3a to de/d1f/d3b/d51/d57/d59/la7 0 2024-09-18T21:12:51.635 INFO:tasks.workunit.client.1.smithi103.stdout:5/520: dread - de/d14/d33/f53 zero size 2024-09-18T21:12:51.636 INFO:tasks.workunit.client.0.smithi077.stdout:3/429: getdents db/d14/d32/d49/d4e/d6a 0 2024-09-18T21:12:51.636 INFO:tasks.workunit.client.0.smithi077.stdout:3/430: chown db/f29 563 1 2024-09-18T21:12:51.637 INFO:tasks.workunit.client.1.smithi103.stdout:9/489: write d18/d52/d6f/d8e/f98 [6762338,95599] 0 2024-09-18T21:12:51.638 INFO:tasks.workunit.client.0.smithi077.stdout:9/379: sync 2024-09-18T21:12:51.638 INFO:tasks.workunit.client.0.smithi077.stdout:4/418: sync 2024-09-18T21:12:51.638 INFO:tasks.workunit.client.0.smithi077.stdout:7/494: sync 2024-09-18T21:12:51.638 INFO:tasks.workunit.client.0.smithi077.stdout:5/569: sync 2024-09-18T21:12:51.640 INFO:tasks.workunit.client.0.smithi077.stdout:9/380: write d1/d54/f44 [2478475,89210] 0 2024-09-18T21:12:51.643 INFO:tasks.workunit.client.0.smithi077.stdout:6/442: chown d7/d7e/d11/d25/f47 0 1 2024-09-18T21:12:51.643 INFO:tasks.workunit.client.1.smithi103.stdout:6/464: rmdir d2/d24/d5a/d67 39 2024-09-18T21:12:51.644 INFO:tasks.workunit.client.0.smithi077.stdout:1/466: mknod d3/d8/d13/d77/cad 0 2024-09-18T21:12:51.646 INFO:tasks.workunit.client.1.smithi103.stdout:4/470: rename d9/f14 to d9/d38/d72/fa0 0 2024-09-18T21:12:51.648 INFO:tasks.workunit.client.0.smithi077.stdout:3/431: mkdir db/d14/d32/d4f/d89 0 2024-09-18T21:12:51.649 INFO:tasks.workunit.client.1.smithi103.stdout:5/521: creat de/d3e/d15/fa8 x:0 0 0 2024-09-18T21:12:51.651 INFO:tasks.workunit.client.1.smithi103.stdout:8/566: symlink d4/de/d4a/lb4 0 2024-09-18T21:12:51.652 INFO:tasks.workunit.client.0.smithi077.stdout:7/495: truncate f1 2588611 0 2024-09-18T21:12:51.653 INFO:tasks.workunit.client.1.smithi103.stdout:6/465: creat d2/d24/d38/f8f x:0 0 0 2024-09-18T21:12:51.654 INFO:tasks.workunit.client.1.smithi103.stdout:4/471: truncate d9/d2e/d61/d91/d9e/d48/f56 681106 0 2024-09-18T21:12:51.654 INFO:tasks.workunit.client.1.smithi103.stdout:4/472: chown d9/c3c 13 1 2024-09-18T21:12:51.655 INFO:tasks.workunit.client.0.smithi077.stdout:9/381: creat d1/dd/d1a/f76 x:0 0 0 2024-09-18T21:12:51.659 INFO:tasks.workunit.client.1.smithi103.stdout:8/567: creat d4/d81/d65/d39/fb5 x:0 0 0 2024-09-18T21:12:51.660 INFO:tasks.workunit.client.0.smithi077.stdout:6/443: creat d7/d7e/d11/d3e/f9b x:0 0 0 2024-09-18T21:12:51.660 INFO:tasks.workunit.client.1.smithi103.stdout:6/466: creat d2/d24/d38/d68/f90 x:0 0 0 2024-09-18T21:12:51.661 INFO:tasks.workunit.client.1.smithi103.stdout:4/473: creat d9/d2e/d61/fa1 x:0 0 0 2024-09-18T21:12:51.662 INFO:tasks.workunit.client.0.smithi077.stdout:9/382: dwrite d1/dd/f5a [0,4194304] 0 2024-09-18T21:12:51.662 INFO:tasks.workunit.client.1.smithi103.stdout:4/474: chown d9/d38/f81 650 1 2024-09-18T21:12:51.662 INFO:tasks.workunit.client.0.smithi077.stdout:8/381: link d2/d5/d6/c3a d2/d27/c86 0 2024-09-18T21:12:51.663 INFO:tasks.workunit.client.0.smithi077.stdout:2/525: dwrite d1/d4/d5/f7 [0,4194304] 0 2024-09-18T21:12:51.663 INFO:tasks.workunit.client.1.smithi103.stdout:9/490: link d18/d29/f55 d18/d52/d6f/d8e/fa3 0 2024-09-18T21:12:51.665 INFO:tasks.workunit.client.0.smithi077.stdout:3/432: mkdir db/d14/d32/d4f/d8a 0 2024-09-18T21:12:51.665 INFO:tasks.workunit.client.0.smithi077.stdout:2/526: fsync d1/d4/d9/d80/f90 0 2024-09-18T21:12:51.666 INFO:tasks.workunit.client.0.smithi077.stdout:9/383: truncate d1/dd/d11/d1c/f53 1007628 0 2024-09-18T21:12:51.666 INFO:tasks.workunit.client.1.smithi103.stdout:8/568: write d4/de/d4a/f79 [1143741,39665] 0 2024-09-18T21:12:51.668 INFO:tasks.workunit.client.0.smithi077.stdout:5/570: write d0/f78 [402916,109357] 0 2024-09-18T21:12:51.668 INFO:tasks.workunit.client.1.smithi103.stdout:6/467: unlink d2/d3/c30 0 2024-09-18T21:12:51.669 INFO:tasks.workunit.client.1.smithi103.stdout:5/522: rename de/d1f/d3b/l70 to de/d1f/d3b/la9 0 2024-09-18T21:12:51.670 INFO:tasks.workunit.client.0.smithi077.stdout:3/433: write db/d14/d22/d36/f73 [4193948,125882] 0 2024-09-18T21:12:51.671 INFO:tasks.workunit.client.0.smithi077.stdout:4/419: symlink d3/dc/d51/d53/d66/l7f 0 2024-09-18T21:12:51.671 INFO:tasks.workunit.client.0.smithi077.stdout:3/434: read - db/d14/d32/d4f/d71/f78 zero size 2024-09-18T21:12:51.673 INFO:tasks.workunit.client.0.smithi077.stdout:2/527: read d1/d4/d5/d1a/d2e/f7f [180966,7922] 0 2024-09-18T21:12:51.673 INFO:tasks.workunit.client.0.smithi077.stdout:0/539: creat d8/d37/faa x:0 0 0 2024-09-18T21:12:51.673 INFO:tasks.workunit.client.0.smithi077.stdout:3/435: chown db/d14/d22/d36/d39/d50/l5b 1040 1 2024-09-18T21:12:51.674 INFO:tasks.workunit.client.0.smithi077.stdout:0/540: dread - d8/d1d/f55 zero size 2024-09-18T21:12:51.675 INFO:tasks.workunit.client.0.smithi077.stdout:1/467: link d3/d8/d13/d18/f5d d3/d6a/d9b/d4c/fae 0 2024-09-18T21:12:51.675 INFO:tasks.workunit.client.0.smithi077.stdout:0/541: readlink d8/d1a/d39/d3b/d79/l7e 0 2024-09-18T21:12:51.675 INFO:tasks.workunit.client.1.smithi103.stdout:8/569: dwrite d4/d2d/f33 [0,4194304] 0 2024-09-18T21:12:51.676 INFO:tasks.workunit.client.0.smithi077.stdout:6/444: creat d7/d7e/d11/d3e/d42/d88/f9c x:0 0 0 2024-09-18T21:12:51.677 INFO:tasks.workunit.client.0.smithi077.stdout:0/542: read - d8/d1d/f74 zero size 2024-09-18T21:12:51.678 INFO:tasks.workunit.client.1.smithi103.stdout:9/491: mkdir d18/da4 0 2024-09-18T21:12:51.681 INFO:tasks.workunit.client.1.smithi103.stdout:5/523: rename de/d14/d33/f8e to de/d1f/d3b/d58/faa 0 2024-09-18T21:12:51.683 INFO:tasks.workunit.client.1.smithi103.stdout:4/475: truncate d9/d2e/d61/d91/d9e/d48/f9c 1220536 0 2024-09-18T21:12:51.688 INFO:tasks.workunit.client.0.smithi077.stdout:5/571: creat d0/d6/d3b/fc1 x:0 0 0 2024-09-18T21:12:51.689 INFO:tasks.workunit.client.0.smithi077.stdout:5/572: dread - d0/d6/d40/fb9 zero size 2024-09-18T21:12:51.689 INFO:tasks.workunit.client.1.smithi103.stdout:5/524: rmdir de/d14/d33/d4f 39 2024-09-18T21:12:51.690 INFO:tasks.workunit.client.1.smithi103.stdout:5/525: write de/d1f/d3b/d3c/f90 [590820,21524] 0 2024-09-18T21:12:51.690 INFO:tasks.workunit.client.0.smithi077.stdout:5/573: write d0/df/d10/d5c/f72 [3916287,85033] 0 2024-09-18T21:12:51.691 INFO:tasks.workunit.client.0.smithi077.stdout:4/420: creat d3/dc/d51/f80 x:0 0 0 2024-09-18T21:12:51.696 INFO:tasks.workunit.client.1.smithi103.stdout:4/476: rename d9/d38/d58/f5e to d9/d2e/d61/fa2 0 2024-09-18T21:12:51.697 INFO:tasks.workunit.client.0.smithi077.stdout:3/436: mkdir db/d14/d32/d49/d4e/d8b 0 2024-09-18T21:12:51.698 INFO:tasks.workunit.client.1.smithi103.stdout:9/492: mknod d18/d29/d68/d78/ca5 0 2024-09-18T21:12:51.699 INFO:tasks.workunit.client.1.smithi103.stdout:9/493: readlink d18/l4a 0 2024-09-18T21:12:51.699 INFO:tasks.workunit.client.0.smithi077.stdout:1/468: rmdir d3/d38/d97 39 2024-09-18T21:12:51.699 INFO:tasks.workunit.client.0.smithi077.stdout:1/469: stat d3/d8/d13/d77 0 2024-09-18T21:12:51.701 INFO:tasks.workunit.client.1.smithi103.stdout:5/526: symlink de/d1f/lab 0 2024-09-18T21:12:51.702 INFO:tasks.workunit.client.0.smithi077.stdout:6/445: fsync d7/d7e/f58 0 2024-09-18T21:12:51.702 INFO:tasks.workunit.client.1.smithi103.stdout:5/527: dread - de/d2d/d7f/f78 zero size 2024-09-18T21:12:51.702 INFO:tasks.workunit.client.1.smithi103.stdout:4/477: dwrite d9/d1a/d21/f57 [0,4194304] 0 2024-09-18T21:12:51.703 INFO:tasks.workunit.client.0.smithi077.stdout:6/446: stat d7/d7e/d11/l94 0 2024-09-18T21:12:51.705 INFO:tasks.workunit.client.0.smithi077.stdout:0/543: rename d8/d1a/d39/d3b/d4e to d8/d37/d95/dab 0 2024-09-18T21:12:51.707 INFO:tasks.workunit.client.0.smithi077.stdout:7/496: write d12/d22/d59/d5d/d62/f6d [4068860,76689] 0 2024-09-18T21:12:51.707 INFO:tasks.workunit.client.0.smithi077.stdout:0/544: read d8/f6a [622789,117959] 0 2024-09-18T21:12:51.711 INFO:tasks.workunit.client.1.smithi103.stdout:3/479: sync 2024-09-18T21:12:51.713 INFO:tasks.workunit.client.1.smithi103.stdout:4/478: rmdir d9 39 2024-09-18T21:12:51.716 INFO:tasks.workunit.client.0.smithi077.stdout:5/574: dread d0/df/d3d/d85/f96 [0,4194304] 0 2024-09-18T21:12:51.717 INFO:tasks.workunit.client.0.smithi077.stdout:5/575: chown d0/df/d10/d4b/d98 33513 1 2024-09-18T21:12:51.717 INFO:tasks.workunit.client.0.smithi077.stdout:2/528: symlink d1/d4/d5/laa 0 2024-09-18T21:12:51.719 INFO:tasks.workunit.client.0.smithi077.stdout:1/470: dread d3/d8/d13/d18/f46 [0,4194304] 0 2024-09-18T21:12:51.719 INFO:tasks.workunit.client.1.smithi103.stdout:6/468: write d2/d3/d8/f75 [468044,12210] 0 2024-09-18T21:12:51.720 INFO:tasks.workunit.client.1.smithi103.stdout:9/494: creat d18/d29/d68/d92/d9c/fa6 x:0 0 0 2024-09-18T21:12:51.723 INFO:tasks.workunit.client.1.smithi103.stdout:3/480: rename d1/d2/c33 to d1/d64/c98 0 2024-09-18T21:12:51.725 INFO:tasks.workunit.client.1.smithi103.stdout:6/469: dwrite d2/d24/f65 [0,4194304] 0 2024-09-18T21:12:51.728 INFO:tasks.workunit.client.1.smithi103.stdout:8/570: write d4/de/d4a/f66 [3894723,121356] 0 2024-09-18T21:12:51.729 INFO:tasks.workunit.client.1.smithi103.stdout:8/571: fsync d4/d81/d65/d39/f4f 0 2024-09-18T21:12:51.730 INFO:tasks.workunit.client.1.smithi103.stdout:8/572: write d4/d81/d65/d39/fb5 [645528,848] 0 2024-09-18T21:12:51.731 INFO:tasks.workunit.client.1.smithi103.stdout:8/573: truncate d4/d2d/d87/fa7 790640 0 2024-09-18T21:12:51.732 INFO:tasks.workunit.client.0.smithi077.stdout:7/497: creat d12/d31/d77/da0/fb1 x:0 0 0 2024-09-18T21:12:51.733 INFO:tasks.workunit.client.1.smithi103.stdout:3/481: chown d1/da/f15 248 1 2024-09-18T21:12:51.735 INFO:tasks.workunit.client.1.smithi103.stdout:4/479: rmdir d9/d38/d72/d85 39 2024-09-18T21:12:51.737 INFO:tasks.workunit.client.1.smithi103.stdout:4/480: read d9/f6a [923746,96627] 0 2024-09-18T21:12:51.738 INFO:tasks.workunit.client.0.smithi077.stdout:3/437: creat db/d14/d32/d4f/d8a/f8c x:0 0 0 2024-09-18T21:12:51.738 INFO:tasks.workunit.client.1.smithi103.stdout:4/481: stat d9/d1c/d77/f59 0 2024-09-18T21:12:51.738 INFO:tasks.workunit.client.1.smithi103.stdout:5/528: link de/d3e/d15/f9e de/d3e/d85/fac 0 2024-09-18T21:12:51.740 INFO:tasks.workunit.client.0.smithi077.stdout:2/529: mkdir d1/d4/d5/d1a/d2e/d41/d2c/dab 0 2024-09-18T21:12:51.741 INFO:tasks.workunit.client.0.smithi077.stdout:2/530: write d1/d4/d9/fa0 [753217,112544] 0 2024-09-18T21:12:51.741 INFO:tasks.workunit.client.1.smithi103.stdout:9/495: creat d18/d52/d6f/d8e/d96/fa7 x:0 0 0 2024-09-18T21:12:51.743 INFO:tasks.workunit.client.0.smithi077.stdout:2/531: write d1/d4/d5/d1a/d49/d6a/f8b [1453609,49459] 0 2024-09-18T21:12:51.746 INFO:tasks.workunit.client.0.smithi077.stdout:8/382: getdents d2/d27 0 2024-09-18T21:12:51.749 INFO:tasks.workunit.client.1.smithi103.stdout:5/529: chown de/d14/d33/c40 24 1 2024-09-18T21:12:51.750 INFO:tasks.workunit.client.1.smithi103.stdout:5/530: fdatasync de/d1f/d3b/d51/d57/d59/f6e 0 2024-09-18T21:12:51.751 INFO:tasks.workunit.client.0.smithi077.stdout:0/545: dwrite d8/d1a/d35/f85 [0,4194304] 0 2024-09-18T21:12:51.752 INFO:tasks.workunit.client.0.smithi077.stdout:0/546: stat d8/d1d/c76 0 2024-09-18T21:12:51.752 INFO:tasks.workunit.client.1.smithi103.stdout:9/496: creat d18/d29/d68/d78/fa8 x:0 0 0 2024-09-18T21:12:51.752 INFO:tasks.workunit.client.1.smithi103.stdout:6/470: write d2/f56 [389081,62280] 0 2024-09-18T21:12:51.753 INFO:tasks.workunit.client.0.smithi077.stdout:7/498: mknod d12/d31/d77/d93/d2a/cb2 0 2024-09-18T21:12:51.753 INFO:tasks.workunit.client.1.smithi103.stdout:9/497: write d18/d29/f2a [1208702,68559] 0 2024-09-18T21:12:51.754 INFO:tasks.workunit.client.1.smithi103.stdout:9/498: write f1 [3310385,31577] 0 2024-09-18T21:12:51.755 INFO:tasks.workunit.client.0.smithi077.stdout:9/384: link d1/dd/d11/l28 d1/dd/l77 0 2024-09-18T21:12:51.756 INFO:tasks.workunit.client.1.smithi103.stdout:9/499: read d18/d52/d6f/f8a [521675,115550] 0 2024-09-18T21:12:51.758 INFO:tasks.workunit.client.0.smithi077.stdout:3/438: creat db/d14/d72/f8d x:0 0 0 2024-09-18T21:12:51.762 INFO:tasks.workunit.client.1.smithi103.stdout:4/482: fdatasync d9/d1f/f5c 0 2024-09-18T21:12:51.762 INFO:tasks.workunit.client.0.smithi077.stdout:9/385: dwrite d1/d54/f70 [0,4194304] 0 2024-09-18T21:12:51.763 INFO:tasks.workunit.client.1.smithi103.stdout:4/483: readlink d9/d1a/d41/l62 0 2024-09-18T21:12:51.763 INFO:tasks.workunit.client.0.smithi077.stdout:9/386: write d1/d54/f21 [2524108,59186] 0 2024-09-18T21:12:51.766 INFO:tasks.workunit.client.1.smithi103.stdout:5/531: readlink de/d1f/d3b/la9 0 2024-09-18T21:12:51.768 INFO:tasks.workunit.client.0.smithi077.stdout:2/532: creat d1/d4/d9/d80/fac x:0 0 0 2024-09-18T21:12:51.769 INFO:tasks.workunit.client.1.smithi103.stdout:6/471: write d2/d3/d7f/f85 [56139,55576] 0 2024-09-18T21:12:51.769 INFO:tasks.workunit.client.1.smithi103.stdout:3/482: write d1/d2/d18/d30/f45 [1193876,52739] 0 2024-09-18T21:12:51.771 INFO:tasks.workunit.client.0.smithi077.stdout:5/576: truncate d0/df/d10/f7 3535716 0 2024-09-18T21:12:51.771 INFO:tasks.workunit.client.0.smithi077.stdout:8/383: dread d2/d27/d29/d41/f45 [0,4194304] 0 2024-09-18T21:12:51.776 INFO:tasks.workunit.client.0.smithi077.stdout:0/547: read d8/d37/d95/dab/f7f [145881,108370] 0 2024-09-18T21:12:51.776 INFO:tasks.workunit.client.0.smithi077.stdout:1/471: truncate d3/ff 3739660 0 2024-09-18T21:12:51.776 INFO:tasks.workunit.client.0.smithi077.stdout:2/533: dwrite d1/f19 [0,4194304] 0 2024-09-18T21:12:51.777 INFO:tasks.workunit.client.1.smithi103.stdout:9/500: write d18/d29/f4d [937419,29580] 0 2024-09-18T21:12:51.777 INFO:tasks.workunit.client.0.smithi077.stdout:0/548: chown d8/d1a/d39/d3b 1 1 2024-09-18T21:12:51.778 INFO:tasks.workunit.client.0.smithi077.stdout:7/499: creat d12/d31/d77/d93/d2a/d7f/fb3 x:0 0 0 2024-09-18T21:12:51.782 INFO:tasks.workunit.client.1.smithi103.stdout:4/484: chown d9/d2e/d61/d91/d9e/d48/f9c 44 1 2024-09-18T21:12:51.782 INFO:tasks.workunit.client.1.smithi103.stdout:4/485: dread - d9/d1c/d77/f54 zero size 2024-09-18T21:12:51.782 INFO:tasks.workunit.client.0.smithi077.stdout:3/439: unlink db/d14/d32/d4f/d8a/f8c 0 2024-09-18T21:12:51.783 INFO:tasks.workunit.client.1.smithi103.stdout:0/461: sync 2024-09-18T21:12:51.783 INFO:tasks.workunit.client.1.smithi103.stdout:1/468: sync 2024-09-18T21:12:51.784 INFO:tasks.workunit.client.1.smithi103.stdout:2/418: sync 2024-09-18T21:12:51.784 INFO:tasks.workunit.client.1.smithi103.stdout:7/427: sync 2024-09-18T21:12:51.784 INFO:tasks.workunit.client.0.smithi077.stdout:3/440: chown db/d14/d32/d4f/f82 4364 1 2024-09-18T21:12:51.785 INFO:tasks.workunit.client.1.smithi103.stdout:2/419: read d3/d5/d2f/d32/f74 [82402,53215] 0 2024-09-18T21:12:51.786 INFO:tasks.workunit.client.1.smithi103.stdout:2/420: stat d3/d5/d2f/c3b 0 2024-09-18T21:12:51.787 INFO:tasks.workunit.client.0.smithi077.stdout:2/534: dwrite d1/d4/d5/d1a/f4c [0,4194304] 0 2024-09-18T21:12:51.789 INFO:tasks.workunit.client.1.smithi103.stdout:8/574: rename d4/d2d/d3d/l41 to d4/de/d4a/d59/lb6 0 2024-09-18T21:12:51.791 INFO:tasks.workunit.client.1.smithi103.stdout:7/428: dwrite d1/df/d42/d1f/f2d [0,4194304] 0 2024-09-18T21:12:51.792 INFO:tasks.workunit.client.0.smithi077.stdout:2/535: dread d1/d4/d5/d1a/d2e/d41/f5d [0,4194304] 0 2024-09-18T21:12:51.793 INFO:tasks.workunit.client.1.smithi103.stdout:6/472: chown d2/c1e 1791 1 2024-09-18T21:12:51.793 INFO:tasks.workunit.client.1.smithi103.stdout:7/429: chown d1/df/d43/d52 49 1 2024-09-18T21:12:51.793 INFO:tasks.workunit.client.0.smithi077.stdout:2/536: chown d1/d4/d9/fa0 90534 1 2024-09-18T21:12:51.794 INFO:tasks.workunit.client.1.smithi103.stdout:3/483: mknod d1/d23/d25/c99 0 2024-09-18T21:12:51.794 INFO:tasks.workunit.client.0.smithi077.stdout:2/537: readlink d1/d4/d9/l9e 0 2024-09-18T21:12:51.798 INFO:tasks.workunit.client.0.smithi077.stdout:6/447: link d7/d7e/d11/d1d/d49/d55/l98 d7/d7c/l9d 0 2024-09-18T21:12:51.799 INFO:tasks.workunit.client.0.smithi077.stdout:8/384: mknod d2/d5/d6/d22/c87 0 2024-09-18T21:12:51.800 INFO:tasks.workunit.client.0.smithi077.stdout:8/385: chown d2/c3 1 1 2024-09-18T21:12:51.801 INFO:tasks.workunit.client.1.smithi103.stdout:4/486: mknod d9/d38/d58/ca3 0 2024-09-18T21:12:51.802 INFO:tasks.workunit.client.0.smithi077.stdout:1/472: mknod d3/d5f/caf 0 2024-09-18T21:12:51.805 INFO:tasks.workunit.client.1.smithi103.stdout:1/469: mkdir d0/d2/d9/d10/da0 0 2024-09-18T21:12:51.805 INFO:tasks.workunit.client.1.smithi103.stdout:1/470: fsync d0/d2/d9/f59 0 2024-09-18T21:12:51.806 INFO:tasks.workunit.client.1.smithi103.stdout:1/471: truncate d0/f9d 344706 0 2024-09-18T21:12:51.811 INFO:tasks.workunit.client.1.smithi103.stdout:2/421: truncate d3/f1d 4863880 0 2024-09-18T21:12:51.814 INFO:tasks.workunit.client.0.smithi077.stdout:3/441: unlink db/d14/d72/c76 0 2024-09-18T21:12:51.814 INFO:tasks.workunit.client.1.smithi103.stdout:8/575: symlink d4/d81/d71/d7f/lb7 0 2024-09-18T21:12:51.816 INFO:tasks.workunit.client.1.smithi103.stdout:0/462: rename d1/d9/d13 to d1/d9/d3e/d6e/d96/d9f 0 2024-09-18T21:12:51.817 INFO:tasks.workunit.client.1.smithi103.stdout:6/473: mkdir d2/d3/d7f/d91 0 2024-09-18T21:12:51.819 INFO:tasks.workunit.client.0.smithi077.stdout:9/387: symlink d1/l78 0 2024-09-18T21:12:51.820 INFO:tasks.workunit.client.1.smithi103.stdout:8/576: dwrite d4/d26/f97 [0,4194304] 0 2024-09-18T21:12:51.821 INFO:tasks.workunit.client.0.smithi077.stdout:9/388: chown d1/dd/d11/d15/l3c 46298068 1 2024-09-18T21:12:51.821 INFO:tasks.workunit.client.0.smithi077.stdout:5/577: mknod d0/d43/d6d/cc2 0 2024-09-18T21:12:51.821 INFO:tasks.workunit.client.1.smithi103.stdout:9/501: mknod d18/d8d/ca9 0 2024-09-18T21:12:51.823 INFO:tasks.workunit.client.0.smithi077.stdout:3/442: dwrite db/d14/d72/f8d [0,4194304] 0 2024-09-18T21:12:51.823 INFO:tasks.workunit.client.0.smithi077.stdout:6/448: readlink d7/l3a 0 2024-09-18T21:12:51.823 INFO:tasks.workunit.client.1.smithi103.stdout:4/487: symlink d9/d2e/la4 0 2024-09-18T21:12:51.824 INFO:tasks.workunit.client.1.smithi103.stdout:9/502: dread d18/d8d/f87 [0,4194304] 0 2024-09-18T21:12:51.825 INFO:tasks.workunit.client.1.smithi103.stdout:1/472: read - d0/d2/d2b/d3a/d42/f97 zero size 2024-09-18T21:12:51.825 INFO:tasks.workunit.client.0.smithi077.stdout:5/578: write d0/df/d10/d4b/f65 [97119,15193] 0 2024-09-18T21:12:51.828 INFO:tasks.workunit.client.1.smithi103.stdout:5/532: link de/d14/d33/d4f/f9d de/d1f/d3b/d58/fad 0 2024-09-18T21:12:51.828 INFO:tasks.workunit.client.1.smithi103.stdout:2/422: fdatasync d3/d5/d2c/f88 0 2024-09-18T21:12:51.829 INFO:tasks.workunit.client.1.smithi103.stdout:7/430: dread d1/df/d42/d29/d2f/d33/f3e [0,4194304] 0 2024-09-18T21:12:51.839 INFO:tasks.workunit.client.1.smithi103.stdout:8/577: unlink d4/de/f3b 0 2024-09-18T21:12:51.840 INFO:tasks.workunit.client.1.smithi103.stdout:8/578: chown d4/d81/d65/d39/fa9 0 1 2024-09-18T21:12:51.840 INFO:tasks.workunit.client.0.smithi077.stdout:9/389: mkdir d1/dd/d11/d2d/d79 0 2024-09-18T21:12:51.841 INFO:tasks.workunit.client.0.smithi077.stdout:2/538: dread d1/d4/d9/d80/d8e/f55 [4194304,4194304] 0 2024-09-18T21:12:51.843 INFO:tasks.workunit.client.0.smithi077.stdout:3/443: unlink db/f29 0 2024-09-18T21:12:51.847 INFO:tasks.workunit.client.0.smithi077.stdout:1/473: write d3/d6a/d9b/f55 [448695,118320] 0 2024-09-18T21:12:51.848 INFO:tasks.workunit.client.0.smithi077.stdout:5/579: mknod d0/d6/d3b/d64/d67/cc3 0 2024-09-18T21:12:51.852 INFO:tasks.workunit.client.0.smithi077.stdout:6/449: dwrite d7/d7e/d11/d1d/d50/f5f [0,4194304] 0 2024-09-18T21:12:51.856 INFO:tasks.workunit.client.0.smithi077.stdout:6/450: stat d7/d7e/d11/d3e/l4a 0 2024-09-18T21:12:51.858 INFO:tasks.workunit.client.0.smithi077.stdout:5/580: dwrite d0/d6/dd/d5d/f7a [0,4194304] 0 2024-09-18T21:12:51.864 INFO:tasks.workunit.client.0.smithi077.stdout:9/390: dread d1/dd/d11/d1c/f25 [0,4194304] 0 2024-09-18T21:12:51.864 INFO:tasks.workunit.client.0.smithi077.stdout:3/444: dread db/d14/d32/d4f/d71/f3e [0,4194304] 0 2024-09-18T21:12:51.868 INFO:tasks.workunit.client.0.smithi077.stdout:8/386: unlink d2/d5/d6/d22/l2f 0 2024-09-18T21:12:51.871 INFO:tasks.workunit.client.0.smithi077.stdout:7/500: link d12/d31/d77/d93/d89/c9d d12/d22/d59/d72/cb4 0 2024-09-18T21:12:51.873 INFO:tasks.workunit.client.0.smithi077.stdout:0/549: dwrite d8/d1d/f68 [0,4194304] 0 2024-09-18T21:12:51.875 INFO:tasks.workunit.client.0.smithi077.stdout:5/581: creat d0/df/d10/d5c/d74/fc4 x:0 0 0 2024-09-18T21:12:51.877 INFO:tasks.workunit.client.0.smithi077.stdout:2/539: truncate d1/d4/d5/d1a/d2e/d41/d2c/f47 3849770 0 2024-09-18T21:12:51.878 INFO:tasks.workunit.client.0.smithi077.stdout:8/387: dwrite d2/d27/d29/f58 [0,4194304] 0 2024-09-18T21:12:51.881 INFO:tasks.workunit.client.0.smithi077.stdout:3/445: dread db/d14/d22/d36/d39/f45 [0,4194304] 0 2024-09-18T21:12:51.883 INFO:tasks.workunit.client.1.smithi103.stdout:2/423: readlink d3/d5/l14 0 2024-09-18T21:12:51.883 INFO:tasks.workunit.client.1.smithi103.stdout:6/474: creat d2/d3/d8/d4c/d7d/f92 x:0 0 0 2024-09-18T21:12:51.883 INFO:tasks.workunit.client.0.smithi077.stdout:8/388: dread d2/d27/d29/d41/f45 [0,4194304] 0 2024-09-18T21:12:51.886 INFO:tasks.workunit.client.1.smithi103.stdout:7/431: read d1/df/f4c [347321,83751] 0 2024-09-18T21:12:51.887 INFO:tasks.workunit.client.0.smithi077.stdout:5/582: dwrite d0/df/d10/d4b/f60 [0,4194304] 0 2024-09-18T21:12:51.888 INFO:tasks.workunit.client.0.smithi077.stdout:0/550: creat d8/d1a/d35/d6d/fac x:0 0 0 2024-09-18T21:12:51.896 INFO:tasks.workunit.client.0.smithi077.stdout:2/540: rename d1/d4/d9/d80/d8e/d66/f75 to d1/d4/d5/d1a/d2e/d86/fad 0 2024-09-18T21:12:51.897 INFO:tasks.workunit.client.0.smithi077.stdout:1/474: dwrite d3/d8/d13/d18/f46 [0,4194304] 0 2024-09-18T21:12:51.899 INFO:tasks.workunit.client.0.smithi077.stdout:7/501: write d12/d22/f7b [137956,42189] 0 2024-09-18T21:12:51.899 INFO:tasks.workunit.client.1.smithi103.stdout:3/484: dwrite d1/d23/d47/f56 [8388608,4194304] 0 2024-09-18T21:12:51.900 INFO:tasks.workunit.client.1.smithi103.stdout:1/473: rename d0/d2/d9/dc/d36/l54 to d0/d3/d68/la1 0 2024-09-18T21:12:51.900 INFO:tasks.workunit.client.1.smithi103.stdout:9/503: dwrite d18/d52/d6f/d8e/d96/f9e [0,4194304] 0 2024-09-18T21:12:51.900 INFO:tasks.workunit.client.1.smithi103.stdout:5/533: dwrite de/d1f/d3b/f61 [0,4194304] 0 2024-09-18T21:12:51.902 INFO:tasks.workunit.client.0.smithi077.stdout:6/451: write d7/d7e/d11/d1d/d31/f71 [1983971,68661] 0 2024-09-18T21:12:51.904 INFO:tasks.workunit.client.1.smithi103.stdout:3/485: chown d1/da/df/f77 30098722 1 2024-09-18T21:12:51.905 INFO:tasks.workunit.client.0.smithi077.stdout:5/583: unlink d0/df/d10/c7f 0 2024-09-18T21:12:51.905 INFO:tasks.workunit.client.0.smithi077.stdout:9/391: truncate d1/d54/f5c 740179 0 2024-09-18T21:12:51.906 INFO:tasks.workunit.client.0.smithi077.stdout:5/584: readlink d0/df/d84/l87 0 2024-09-18T21:12:51.908 INFO:tasks.workunit.client.0.smithi077.stdout:0/551: mknod d8/d37/d66/d87/cad 0 2024-09-18T21:12:51.910 INFO:tasks.workunit.client.1.smithi103.stdout:0/463: link d1/d9/l2d d1/d9/d3e/d6e/d96/d9f/la0 0 2024-09-18T21:12:51.911 INFO:tasks.workunit.client.0.smithi077.stdout:1/475: mknod d3/d6a/d9b/d7f/cb0 0 2024-09-18T21:12:51.920 INFO:tasks.workunit.client.0.smithi077.stdout:2/541: rename d1/f39 to d1/d4/d5/d1a/d2e/d86/fae 0 2024-09-18T21:12:51.920 INFO:tasks.workunit.client.0.smithi077.stdout:5/585: dwrite d0/f78 [0,4194304] 0 2024-09-18T21:12:51.921 INFO:tasks.workunit.client.0.smithi077.stdout:8/389: mkdir d2/d5/d6/d22/d4f/d5a/d2a/d88 0 2024-09-18T21:12:51.922 INFO:tasks.workunit.client.1.smithi103.stdout:9/504: unlink d18/f70 0 2024-09-18T21:12:51.923 INFO:tasks.workunit.client.0.smithi077.stdout:8/390: fsync d2/d27/d29/f58 0 2024-09-18T21:12:51.925 INFO:tasks.workunit.client.0.smithi077.stdout:3/446: dread db/f2e [0,4194304] 0 2024-09-18T21:12:51.925 INFO:tasks.workunit.client.0.smithi077.stdout:6/452: write d7/d7e/d11/d1d/f38 [1163763,90907] 0 2024-09-18T21:12:51.927 INFO:tasks.workunit.client.0.smithi077.stdout:3/447: write db/f54 [786645,100105] 0 2024-09-18T21:12:51.929 INFO:tasks.workunit.client.0.smithi077.stdout:3/448: write db/d14/d32/d4f/d71/d3b/f66 [1785571,20515] 0 2024-09-18T21:12:51.930 INFO:tasks.workunit.client.1.smithi103.stdout:2/424: rename d3/d5/d2f/d48/c73 to d3/d5/d4a/d56/c9e 0 2024-09-18T21:12:51.931 INFO:tasks.workunit.client.0.smithi077.stdout:5/586: fsync d0/d6/dd/f3a 0 2024-09-18T21:12:51.932 INFO:tasks.workunit.client.1.smithi103.stdout:6/475: creat d2/d3/d8/f93 x:0 0 0 2024-09-18T21:12:51.932 INFO:tasks.workunit.client.0.smithi077.stdout:0/552: dread d8/d37/f50 [0,4194304] 0 2024-09-18T21:12:51.933 INFO:tasks.workunit.client.1.smithi103.stdout:5/534: fsync de/d1f/d3b/d51/d57/d59/f5c 0 2024-09-18T21:12:51.934 INFO:tasks.workunit.client.0.smithi077.stdout:9/392: getdents d1/dd/d11/d1c/d38/d46/d55/d6c 0 2024-09-18T21:12:51.934 INFO:tasks.workunit.client.1.smithi103.stdout:9/505: fdatasync d18/d8d/f58 0 2024-09-18T21:12:51.935 INFO:tasks.workunit.client.0.smithi077.stdout:9/393: fdatasync d1/d54/f1e 0 2024-09-18T21:12:51.937 INFO:tasks.workunit.client.0.smithi077.stdout:8/391: symlink d2/d5f/l89 0 2024-09-18T21:12:51.937 INFO:tasks.workunit.client.1.smithi103.stdout:8/579: getdents d4/d2d/d3d/da0 0 2024-09-18T21:12:51.938 INFO:tasks.workunit.client.1.smithi103.stdout:1/474: mkdir d0/d3/d68/d81/da2 0 2024-09-18T21:12:51.939 INFO:tasks.workunit.client.1.smithi103.stdout:1/475: read - d0/d2/f6c zero size 2024-09-18T21:12:51.940 INFO:tasks.workunit.client.1.smithi103.stdout:3/486: mkdir d1/d9a 0 2024-09-18T21:12:51.943 INFO:tasks.workunit.client.0.smithi077.stdout:3/449: symlink db/d14/d72/l8e 0 2024-09-18T21:12:51.944 INFO:tasks.workunit.client.1.smithi103.stdout:5/535: unlink de/d3e/l8c 0 2024-09-18T21:12:51.947 INFO:tasks.workunit.client.1.smithi103.stdout:0/464: dwrite d1/d5/de/d24/d43/f8b [4194304,4194304] 0 2024-09-18T21:12:51.947 INFO:tasks.workunit.client.1.smithi103.stdout:7/432: link d1/df/d42/d1f/d2e/f37 d1/df/d42/d29/d2f/d33/d51/f80 0 2024-09-18T21:12:51.948 INFO:tasks.workunit.client.0.smithi077.stdout:5/587: dread d0/df/f25 [0,4194304] 0 2024-09-18T21:12:51.950 INFO:tasks.workunit.client.1.smithi103.stdout:5/536: dread de/d1f/d3b/d3c/f90 [0,4194304] 0 2024-09-18T21:12:51.950 INFO:tasks.workunit.client.0.smithi077.stdout:9/394: readlink d1/dd/d1a/l2c 0 2024-09-18T21:12:51.951 INFO:tasks.workunit.client.0.smithi077.stdout:6/453: dread d7/d7e/d11/f56 [0,4194304] 0 2024-09-18T21:12:51.952 INFO:tasks.workunit.client.1.smithi103.stdout:1/476: mknod d0/d2/d9/d10/d5d/ca3 0 2024-09-18T21:12:51.953 INFO:tasks.workunit.client.0.smithi077.stdout:8/392: dread - d2/d5/d6/d22/d26/f84 zero size 2024-09-18T21:12:51.957 INFO:tasks.workunit.client.1.smithi103.stdout:6/476: mkdir d2/d3/d8/d94 0 2024-09-18T21:12:51.958 INFO:tasks.workunit.client.1.smithi103.stdout:5/537: dwrite de/d1f/d3b/f72 [0,4194304] 0 2024-09-18T21:12:51.958 INFO:tasks.workunit.client.0.smithi077.stdout:3/450: fdatasync db/f10 0 2024-09-18T21:12:51.966 INFO:tasks.workunit.client.0.smithi077.stdout:3/451: dread db/d14/d32/f7b [0,4194304] 0 2024-09-18T21:12:51.966 INFO:tasks.workunit.client.1.smithi103.stdout:7/433: readlink d1/df/l2a 0 2024-09-18T21:12:51.968 INFO:tasks.workunit.client.1.smithi103.stdout:2/425: rmdir d3/d5/d4a/d56 39 2024-09-18T21:12:51.972 INFO:tasks.workunit.client.0.smithi077.stdout:2/542: write d1/f2a [778712,119577] 0 2024-09-18T21:12:51.974 INFO:tasks.workunit.client.0.smithi077.stdout:2/543: chown d1/d4/d9/d80/d95/l96 42 1 2024-09-18T21:12:51.974 INFO:tasks.workunit.client.0.smithi077.stdout:1/476: getdents d3/d8/d49/d4e 0 2024-09-18T21:12:51.977 INFO:tasks.workunit.client.1.smithi103.stdout:5/538: unlink de/d1f/d3b/d51/d57/d79/d8d/f8f 0 2024-09-18T21:12:51.980 INFO:tasks.workunit.client.1.smithi103.stdout:0/465: truncate d1/d5/f6 1719065 0 2024-09-18T21:12:51.980 INFO:tasks.workunit.client.1.smithi103.stdout:0/466: fdatasync d1/d9/d3e/f67 0 2024-09-18T21:12:51.982 INFO:tasks.workunit.client.1.smithi103.stdout:0/467: write d1/d5/de/d24/d43/f8b [4132362,80209] 0 2024-09-18T21:12:51.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:51.980+0000 7f5a5031b640 1 -- 172.21.15.77:0/92057341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a48066450 msgr2=0x7f5a480ff1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:51.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:51.980+0000 7f5a5031b640 1 --2- 172.21.15.77:0/92057341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a48066450 0x7f5a480ff1b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5a440048d0 tx=0x7f5a44009da0 comp rx=0 tx=0).stop 2024-09-18T21:12:51.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:51.980+0000 7f5a5031b640 1 -- 172.21.15.77:0/92057341 shutdown_connections 2024-09-18T21:12:51.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:51.980+0000 7f5a5031b640 1 --2- 172.21.15.77:0/92057341 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a480ff6f0 0x7f5a48101ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:51.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:51.980+0000 7f5a5031b640 1 --2- 172.21.15.77:0/92057341 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a48066450 0x7f5a480ff1b0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:51.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:51.980+0000 7f5a5031b640 1 -- 172.21.15.77:0/92057341 >> 172.21.15.77:0/92057341 conn(0x7f5a480f6c00 msgr2=0x7f5a480f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:12:51.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:51.980+0000 7f5a5031b640 1 -- 172.21.15.77:0/92057341 shutdown_connections 2024-09-18T21:12:51.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:51.980+0000 7f5a5031b640 1 -- 172.21.15.77:0/92057341 wait complete. 2024-09-18T21:12:51.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:51.981+0000 7f5a5031b640 1 Processor -- start 2024-09-18T21:12:51.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:51.981+0000 7f5a5031b640 1 -- start start 2024-09-18T21:12:51.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:51.981+0000 7f5a5031b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a48066450 0x7f5a4810d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:12:51.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:51.981+0000 7f5a5031b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a480ff6f0 0x7f5a4810d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:12:51.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:51.981+0000 7f5a5031b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4810e4c0 con 0x7f5a48066450 2024-09-18T21:12:51.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:51.981+0000 7f5a5031b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4810e630 con 0x7f5a480ff6f0 2024-09-18T21:12:51.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:51.982+0000 7f5a4e0b7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a48066450 0x7f5a4810d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:12:51.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:51.982+0000 7f5a4d8b6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a480ff6f0 0x7f5a4810d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:12:51.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:51.982+0000 7f5a4e0b7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a48066450 0x7f5a4810d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49516/0 (socket says 172.21.15.77:49516) 2024-09-18T21:12:51.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:51.982+0000 7f5a4e0b7640 1 -- 172.21.15.77:0/586458705 learned_addr learned my addr 172.21.15.77:0/586458705 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:12:51.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:51.982+0000 7f5a4e0b7640 1 -- 172.21.15.77:0/586458705 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a480ff6f0 msgr2=0x7f5a4810d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:51.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:51.982+0000 7f5a4e0b7640 1 --2- 172.21.15.77:0/586458705 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a480ff6f0 0x7f5a4810d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:51.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:51.982+0000 7f5a4e0b7640 1 -- 172.21.15.77:0/586458705 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a44005040 con 0x7f5a48066450 2024-09-18T21:12:51.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:51.983+0000 7f5a4e0b7640 1 --2- 172.21.15.77:0/586458705 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a48066450 0x7f5a4810d110 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5a440048a0 tx=0x7f5a44009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:12:51.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:51.983+0000 7f5a3effd640 1 -- 172.21.15.77:0/586458705 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a44038070 con 0x7f5a48066450 2024-09-18T21:12:51.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:51.983+0000 7f5a5031b640 1 -- 172.21.15.77:0/586458705 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a4810e8b0 con 0x7f5a48066450 2024-09-18T21:12:51.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:51.983+0000 7f5a5031b640 1 -- 172.21.15.77:0/586458705 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a4810ed70 con 0x7f5a48066450 2024-09-18T21:12:51.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:51.983+0000 7f5a3effd640 1 -- 172.21.15.77:0/586458705 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5a4402ae90 con 0x7f5a48066450 2024-09-18T21:12:51.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:51.983+0000 7f5a3effd640 1 -- 172.21.15.77:0/586458705 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a4402c8b0 con 0x7f5a48066450 2024-09-18T21:12:51.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:51.985+0000 7f5a5031b640 1 -- 172.21.15.77:0/586458705 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a2c005240 con 0x7f5a48066450 2024-09-18T21:12:51.987 INFO:tasks.workunit.client.1.smithi103.stdout:2/426: unlink d3/d5/d2f/d5b/l63 0 2024-09-18T21:12:51.987 INFO:tasks.workunit.client.1.smithi103.stdout:7/434: dwrite d1/df/f18 [0,4194304] 0 2024-09-18T21:12:51.988 INFO:tasks.workunit.client.0.smithi077.stdout:5/588: dread d0/d6/f48 [0,4194304] 0 2024-09-18T21:12:51.989 INFO:tasks.workunit.client.1.smithi103.stdout:7/435: stat d1/df/d42/d1f/l69 0 2024-09-18T21:12:51.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:51.987+0000 7f5a3effd640 1 -- 172.21.15.77:0/586458705 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 24) v1 ==== 91488+0+0 (secure 0 0 0) 0x7f5a44030020 con 0x7f5a48066450 2024-09-18T21:12:51.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:51.988+0000 7f5a3effd640 1 --2- 172.21.15.77:0/586458705 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f5a3406e4a0 0x7f5a34070950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:12:51.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:51.988+0000 7f5a3effd640 1 -- 172.21.15.77:0/586458705 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f5a440ae130 con 0x7f5a48066450 2024-09-18T21:12:51.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:51.988+0000 7f5a4d8b6640 1 --2- 172.21.15.77:0/586458705 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f5a3406e4a0 0x7f5a34070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:12:51.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:51.989+0000 7f5a4d8b6640 1 --2- 172.21.15.77:0/586458705 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f5a3406e4a0 0x7f5a34070950 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5a4810cec0 tx=0x7f5a38009120 comp rx=0 tx=0).ready entity=mgr.14578 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:12:51.991 INFO:tasks.workunit.client.0.smithi077.stdout:0/553: dwrite d8/d37/d95/dab/fa9 [0,4194304] 0 2024-09-18T21:12:51.991 INFO:tasks.workunit.client.0.smithi077.stdout:5/589: write d0/df/d10/f9d [1429805,24244] 0 2024-09-18T21:12:51.992 INFO:tasks.workunit.client.1.smithi103.stdout:6/477: creat d2/d24/d5a/d67/f95 x:0 0 0 2024-09-18T21:12:51.993 INFO:tasks.workunit.client.1.smithi103.stdout:8/580: dwrite d4/de/f78 [0,4194304] 0 2024-09-18T21:12:51.994 INFO:tasks.workunit.client.1.smithi103.stdout:9/506: truncate d18/d8d/d2f/f31 453932 0 2024-09-18T21:12:51.996 INFO:tasks.workunit.client.1.smithi103.stdout:6/478: truncate d2/d24/d5a/f64 751437 0 2024-09-18T21:12:51.997 INFO:tasks.workunit.client.0.smithi077.stdout:2/544: mknod d1/d4/caf 0 2024-09-18T21:12:51.998 INFO:tasks.workunit.client.1.smithi103.stdout:6/479: fdatasync d2/d3/d7f/f85 0 2024-09-18T21:12:51.998 INFO:tasks.workunit.client.0.smithi077.stdout:2/545: read - d1/d62/f94 zero size 2024-09-18T21:12:51.998 INFO:tasks.workunit.client.1.smithi103.stdout:7/436: dwrite d1/df/d43/d52/f75 [0,4194304] 0 2024-09-18T21:12:52.000 INFO:tasks.workunit.client.0.smithi077.stdout:1/477: rename d3/d5f to d3/d8/d13/d77/db1 0 2024-09-18T21:12:52.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:51.999+0000 7f5a3effd640 1 -- 172.21.15.77:0/586458705 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f5a44077e70 con 0x7f5a48066450 2024-09-18T21:12:52.002 INFO:tasks.workunit.client.0.smithi077.stdout:5/590: dwrite d0/df/d10/f44 [0,4194304] 0 2024-09-18T21:12:52.004 INFO:tasks.workunit.client.0.smithi077.stdout:2/546: truncate d1/d62/f94 158040 0 2024-09-18T21:12:52.004 INFO:tasks.workunit.client.1.smithi103.stdout:8/581: dwrite d4/de/d4a/d59/d5e/faa [0,4194304] 0 2024-09-18T21:12:52.005 INFO:tasks.workunit.client.0.smithi077.stdout:5/591: readlink d0/d6/daa/lbb 0 2024-09-18T21:12:52.006 INFO:tasks.workunit.client.0.smithi077.stdout:1/478: dread - d3/d8/d13/d77/db1/f96 zero size 2024-09-18T21:12:52.007 INFO:tasks.workunit.client.0.smithi077.stdout:3/452: symlink db/d14/d32/d4f/d71/l8f 0 2024-09-18T21:12:52.011 INFO:tasks.workunit.client.1.smithi103.stdout:0/468: mknod d1/d5/ca1 0 2024-09-18T21:12:52.013 INFO:tasks.workunit.client.0.smithi077.stdout:9/395: rmdir d1/dd/d11/d1c/d38/d46/d55/d6c 0 2024-09-18T21:12:52.018 INFO:tasks.workunit.client.0.smithi077.stdout:6/454: creat d7/d7e/d11/f9e x:0 0 0 2024-09-18T21:12:52.018 INFO:tasks.workunit.client.1.smithi103.stdout:0/469: dwrite d1/f29 [0,4194304] 0 2024-09-18T21:12:52.018 INFO:tasks.workunit.client.0.smithi077.stdout:6/455: stat d7/d7e/f1e 0 2024-09-18T21:12:52.020 INFO:tasks.workunit.client.1.smithi103.stdout:3/487: getdents d1/d23/d25/d4f/d51 0 2024-09-18T21:12:52.024 INFO:tasks.workunit.client.1.smithi103.stdout:9/507: creat d18/d29/faa x:0 0 0 2024-09-18T21:12:52.025 INFO:tasks.workunit.client.0.smithi077.stdout:8/393: link d2/d27/d29/f61 d2/d5/d6/d22/d20/d3e/f8a 0 2024-09-18T21:12:52.028 INFO:tasks.workunit.client.0.smithi077.stdout:0/554: rename d8/d1a/f4b to d8/d1a/d39/d3b/d79/fae 0 2024-09-18T21:12:52.029 INFO:tasks.workunit.client.0.smithi077.stdout:0/555: write d8/d1d/d80/f84 [4252993,14218] 0 2024-09-18T21:12:52.030 INFO:tasks.workunit.client.0.smithi077.stdout:0/556: stat c6 0 2024-09-18T21:12:52.030 INFO:tasks.workunit.client.1.smithi103.stdout:9/508: dwrite d18/d29/d68/f9a [0,4194304] 0 2024-09-18T21:12:52.031 INFO:tasks.workunit.client.0.smithi077.stdout:5/592: mkdir d0/df/d10/d4b/dc5 0 2024-09-18T21:12:52.031 INFO:tasks.workunit.client.1.smithi103.stdout:6/480: mknod d2/d24/d38/d68/d7c/c96 0 2024-09-18T21:12:52.032 INFO:tasks.workunit.client.0.smithi077.stdout:5/593: chown d0/d6/dd/f11 5 1 2024-09-18T21:12:52.034 INFO:tasks.workunit.client.0.smithi077.stdout:3/453: mkdir db/d14/d90 0 2024-09-18T21:12:52.035 INFO:tasks.workunit.client.1.smithi103.stdout:8/582: unlink d4/d2d/d3d/c76 0 2024-09-18T21:12:52.037 INFO:tasks.workunit.client.0.smithi077.stdout:2/547: symlink d1/d4/d5/d1a/d49/d6a/lb0 0 2024-09-18T21:12:52.040 INFO:tasks.workunit.client.0.smithi077.stdout:5/594: dread d0/d6/d3b/f55 [0,4194304] 0 2024-09-18T21:12:52.041 INFO:tasks.workunit.client.0.smithi077.stdout:6/456: unlink d7/d7e/d11/d3e/f9b 0 2024-09-18T21:12:52.043 INFO:tasks.workunit.client.0.smithi077.stdout:5/595: write d0/df/d10/d4b/f60 [2035971,57006] 0 2024-09-18T21:12:52.044 INFO:tasks.workunit.client.1.smithi103.stdout:0/470: rename d1/d5/de/l4d to d1/d5/de/d19/d1e/d34/la2 0 2024-09-18T21:12:52.045 INFO:tasks.workunit.client.0.smithi077.stdout:1/479: symlink d3/d8/d49/lb2 0 2024-09-18T21:12:52.046 INFO:tasks.workunit.client.1.smithi103.stdout:0/471: chown d1/d5/d4c/d4e/f66 6795668 1 2024-09-18T21:12:52.046 INFO:tasks.workunit.client.1.smithi103.stdout:0/472: chown d1/f12 522 1 2024-09-18T21:12:52.046 INFO:tasks.workunit.client.0.smithi077.stdout:1/480: truncate d3/d6a/d9b/d4c/fae 599405 0 2024-09-18T21:12:52.047 INFO:tasks.workunit.client.0.smithi077.stdout:0/557: truncate d8/d37/d66/d87/fa4 1746008 0 2024-09-18T21:12:52.048 INFO:tasks.workunit.client.0.smithi077.stdout:2/548: dread d1/f2a [0,4194304] 0 2024-09-18T21:12:52.049 INFO:tasks.workunit.client.0.smithi077.stdout:0/558: chown d8/d37/d95/dab/c60 0 1 2024-09-18T21:12:52.052 INFO:tasks.workunit.client.1.smithi103.stdout:6/481: chown d2/d3/d8/cc 5 1 2024-09-18T21:12:52.053 INFO:tasks.workunit.client.1.smithi103.stdout:8/583: rmdir d4/d2d/d4e 39 2024-09-18T21:12:52.056 INFO:tasks.workunit.client.1.smithi103.stdout:9/509: dread d18/d52/d6f/f80 [0,4194304] 0 2024-09-18T21:12:52.058 INFO:tasks.workunit.client.1.smithi103.stdout:9/510: read d18/d29/f2a [1811119,34714] 0 2024-09-18T21:12:52.059 INFO:tasks.workunit.client.1.smithi103.stdout:6/482: rename d2/d24/d38/c6b to d2/d3/d8/d4c/d79/c97 0 2024-09-18T21:12:52.060 INFO:tasks.workunit.client.1.smithi103.stdout:9/511: write d18/d52/f85 [3187344,7230] 0 2024-09-18T21:12:52.062 INFO:tasks.workunit.client.1.smithi103.stdout:8/584: mknod d4/de/d4a/d59/cb8 0 2024-09-18T21:12:52.065 INFO:tasks.workunit.client.1.smithi103.stdout:8/585: creat d4/de/d4a/d59/d5e/fb9 x:0 0 0 2024-09-18T21:12:52.066 INFO:tasks.workunit.client.0.smithi077.stdout:9/396: link d1/d54/d27/f39 d1/dd/d11/d1c/d38/d46/d55/f7a 0 2024-09-18T21:12:52.066 INFO:tasks.workunit.client.1.smithi103.stdout:9/512: dwrite d18/d8d/d2f/f97 [0,4194304] 0 2024-09-18T21:12:52.066 INFO:tasks.workunit.client.0.smithi077.stdout:5/596: creat d0/d6/d3b/d64/fc6 x:0 0 0 2024-09-18T21:12:52.067 INFO:tasks.workunit.client.0.smithi077.stdout:2/549: creat d1/d4/d9/d80/d95/fb1 x:0 0 0 2024-09-18T21:12:52.068 INFO:tasks.workunit.client.1.smithi103.stdout:2/427: write d3/d5/f6f [590121,73912] 0 2024-09-18T21:12:52.068 INFO:tasks.workunit.client.0.smithi077.stdout:3/454: dread db/d14/d32/f56 [0,4194304] 0 2024-09-18T21:12:52.069 INFO:tasks.workunit.client.1.smithi103.stdout:2/428: fdatasync d3/d5/d2c/f88 0 2024-09-18T21:12:52.069 INFO:tasks.workunit.client.1.smithi103.stdout:9/513: read d18/d29/f2a [198816,76100] 0 2024-09-18T21:12:52.070 INFO:tasks.workunit.client.0.smithi077.stdout:9/397: write d1/dd/f14 [4392894,67658] 0 2024-09-18T21:12:52.070 INFO:tasks.workunit.client.0.smithi077.stdout:3/455: chown db/c11 1767291 1 2024-09-18T21:12:52.071 INFO:tasks.workunit.client.0.smithi077.stdout:8/394: dread d2/d27/d29/f43 [0,4194304] 0 2024-09-18T21:12:52.072 INFO:tasks.workunit.client.1.smithi103.stdout:2/429: creat d3/d5/d2f/d32/f9f x:0 0 0 2024-09-18T21:12:52.073 INFO:tasks.workunit.client.0.smithi077.stdout:0/559: dread d8/d26/f8d [0,4194304] 0 2024-09-18T21:12:52.073 INFO:tasks.workunit.client.0.smithi077.stdout:3/456: dread - db/d14/d32/d4f/f82 zero size 2024-09-18T21:12:52.074 INFO:tasks.workunit.client.1.smithi103.stdout:2/430: read d3/d5/d2f/f91 [527218,42523] 0 2024-09-18T21:12:52.076 INFO:tasks.workunit.client.1.smithi103.stdout:8/586: dread d4/d81/d65/f31 [0,4194304] 0 2024-09-18T21:12:52.080 INFO:tasks.workunit.client.0.smithi077.stdout:5/597: mknod d0/df/d10/d4b/d80/cc7 0 2024-09-18T21:12:52.081 INFO:tasks.workunit.client.0.smithi077.stdout:2/550: dread d1/d4/f5f [8388608,4194304] 0 2024-09-18T21:12:52.082 INFO:tasks.workunit.client.0.smithi077.stdout:8/395: dread d2/d27/d29/f43 [4194304,4194304] 0 2024-09-18T21:12:52.083 INFO:tasks.workunit.client.1.smithi103.stdout:8/587: write d4/d2d/d4e/f8c [181102,22647] 0 2024-09-18T21:12:52.083 INFO:tasks.workunit.client.0.smithi077.stdout:8/396: chown d2/d5/d6/d22/d4f/d5a 191824 1 2024-09-18T21:12:52.084 INFO:tasks.workunit.client.0.smithi077.stdout:8/397: dread - d2/d5/d6/d22/d4f/f5d zero size 2024-09-18T21:12:52.085 INFO:tasks.workunit.client.1.smithi103.stdout:8/588: chown d4/d26/d56/d77/d9f/fa6 81246 1 2024-09-18T21:12:52.085 INFO:tasks.workunit.client.0.smithi077.stdout:9/398: symlink d1/l7b 0 2024-09-18T21:12:52.087 INFO:tasks.workunit.client.1.smithi103.stdout:7/437: dwrite d1/df/f4c [0,4194304] 0 2024-09-18T21:12:52.088 INFO:tasks.workunit.client.1.smithi103.stdout:8/589: read d4/d81/d65/d39/fa9 [178800,114369] 0 2024-09-18T21:12:52.088 INFO:tasks.workunit.client.1.smithi103.stdout:2/431: symlink d3/d5/d2f/d93/la0 0 2024-09-18T21:12:52.089 INFO:tasks.workunit.client.1.smithi103.stdout:2/432: dread - d3/d5/d2f/f7c zero size 2024-09-18T21:12:52.089 INFO:tasks.workunit.client.1.smithi103.stdout:8/590: write d4/d81/d71/f7e [4019771,7817] 0 2024-09-18T21:12:52.094 INFO:tasks.workunit.client.0.smithi077.stdout:8/398: mknod d2/d5f/d6f/c8b 0 2024-09-18T21:12:52.096 INFO:tasks.workunit.client.1.smithi103.stdout:4/488: sync 2024-09-18T21:12:52.099 INFO:tasks.workunit.client.0.smithi077.stdout:3/457: link db/d14/d32/d49/d4e/d6a/f5d db/d14/d72/f91 0 2024-09-18T21:12:52.100 INFO:tasks.workunit.client.1.smithi103.stdout:7/438: creat d1/df/d43/d63/d67/d5b/f81 x:0 0 0 2024-09-18T21:12:52.101 INFO:tasks.workunit.client.1.smithi103.stdout:9/514: dread d18/d52/f85 [0,4194304] 0 2024-09-18T21:12:52.102 INFO:tasks.workunit.client.1.smithi103.stdout:2/433: creat d3/d5/d2f/d93/fa1 x:0 0 0 2024-09-18T21:12:52.104 INFO:tasks.workunit.client.1.smithi103.stdout:8/591: mknod d4/de/d4a/d59/d5e/cba 0 2024-09-18T21:12:52.104 INFO:tasks.workunit.client.0.smithi077.stdout:2/551: symlink d1/lb2 0 2024-09-18T21:12:52.105 INFO:tasks.workunit.client.1.smithi103.stdout:8/592: chown d4/d81/d65/c70 545 1 2024-09-18T21:12:52.105 INFO:tasks.workunit.client.1.smithi103.stdout:3/488: dwrite d1/d23/d25/f4c [0,4194304] 0 2024-09-18T21:12:52.107 INFO:tasks.workunit.client.1.smithi103.stdout:7/439: dread d1/df/d54/f5a [0,4194304] 0 2024-09-18T21:12:52.107 INFO:tasks.workunit.client.0.smithi077.stdout:3/458: unlink db/ld 0 2024-09-18T21:12:52.108 INFO:tasks.workunit.client.1.smithi103.stdout:8/593: dread d4/d81/d65/f31 [0,4194304] 0 2024-09-18T21:12:52.108 INFO:tasks.workunit.client.1.smithi103.stdout:7/440: truncate d1/f7c 480364 0 2024-09-18T21:12:52.110 INFO:tasks.workunit.client.1.smithi103.stdout:4/489: fdatasync d9/f6a 0 2024-09-18T21:12:52.111 INFO:tasks.workunit.client.1.smithi103.stdout:0/473: write d1/f36 [497260,57633] 0 2024-09-18T21:12:52.114 INFO:tasks.workunit.client.0.smithi077.stdout:3/459: dwrite db/d14/f17 [0,4194304] 0 2024-09-18T21:12:52.115 INFO:tasks.workunit.client.1.smithi103.stdout:2/434: symlink d3/d5/d2f/d5b/la2 0 2024-09-18T21:12:52.118 INFO:tasks.workunit.client.1.smithi103.stdout:3/489: write d1/f24 [4856292,11662] 0 2024-09-18T21:12:52.119 INFO:tasks.workunit.client.0.smithi077.stdout:9/399: rename d1/dd/d11/d1c/d38/f41 to d1/f7c 0 2024-09-18T21:12:52.121 INFO:tasks.workunit.client.1.smithi103.stdout:8/594: mkdir d4/d2d/d87/dbb 0 2024-09-18T21:12:52.121 INFO:tasks.workunit.client.0.smithi077.stdout:5/598: getdents d0/d6/daa 0 2024-09-18T21:12:52.122 INFO:tasks.workunit.client.1.smithi103.stdout:8/595: write d4/d81/f95 [636907,14316] 0 2024-09-18T21:12:52.126 INFO:tasks.workunit.client.0.smithi077.stdout:8/399: rename d2/d5/d6/d22/d4f/d5a/d2a/d67/f75 to d2/d27/d29/d72/f8c 0 2024-09-18T21:12:52.127 INFO:tasks.workunit.client.0.smithi077.stdout:8/400: chown d2/d36 116 1 2024-09-18T21:12:52.127 INFO:tasks.workunit.client.0.smithi077.stdout:1/481: dwrite d3/d8/f67 [0,4194304] 0 2024-09-18T21:12:52.127 INFO:tasks.workunit.client.1.smithi103.stdout:4/490: creat d9/d1a/d41/fa5 x:0 0 0 2024-09-18T21:12:52.127 INFO:tasks.workunit.client.1.smithi103.stdout:4/491: stat d9/d1c/l6c 0 2024-09-18T21:12:52.128 INFO:tasks.workunit.client.0.smithi077.stdout:8/401: dread - d2/d5/d6/d22/d4f/f69 zero size 2024-09-18T21:12:52.130 INFO:tasks.workunit.client.0.smithi077.stdout:8/402: read d2/d27/d29/f58 [288585,53167] 0 2024-09-18T21:12:52.130 INFO:tasks.workunit.client.0.smithi077.stdout:3/460: mknod db/c92 0 2024-09-18T21:12:52.131 INFO:tasks.workunit.client.1.smithi103.stdout:0/474: fsync d1/d9/d3e/d6e/f9e 0 2024-09-18T21:12:52.132 INFO:tasks.workunit.client.0.smithi077.stdout:3/461: chown db/d14/d32 45470148 1 2024-09-18T21:12:52.132 INFO:tasks.workunit.client.0.smithi077.stdout:8/403: write d2/d27/f57 [743272,80232] 0 2024-09-18T21:12:52.133 INFO:tasks.workunit.client.1.smithi103.stdout:9/515: symlink d18/d8d/lab 0 2024-09-18T21:12:52.134 INFO:tasks.workunit.client.0.smithi077.stdout:2/552: rename d1/d4/d5/d1a/d49/d6a/l9c to d1/d4/d5/d1a/d2e/d7e/lb3 0 2024-09-18T21:12:52.136 INFO:tasks.workunit.client.0.smithi077.stdout:5/599: mkdir d0/df/d10/d47/db6/dc8 0 2024-09-18T21:12:52.137 INFO:tasks.workunit.client.1.smithi103.stdout:2/435: creat d3/d5/d2c/d77/fa3 x:0 0 0 2024-09-18T21:12:52.140 INFO:tasks.workunit.client.1.smithi103.stdout:3/490: creat d1/d23/d25/d4f/d51/f9b x:0 0 0 2024-09-18T21:12:52.141 INFO:tasks.workunit.client.0.smithi077.stdout:3/462: mkdir db/d14/d93 0 2024-09-18T21:12:52.144 INFO:tasks.workunit.client.1.smithi103.stdout:7/441: truncate d1/f4b 2479966 0 2024-09-18T21:12:52.147 INFO:tasks.workunit.client.0.smithi077.stdout:2/553: write d1/d4/d9/d80/d8e/f55 [4313512,115185] 0 2024-09-18T21:12:52.149 INFO:tasks.workunit.client.0.smithi077.stdout:2/554: write d1/d4/d5/d1a/d2e/d41/f3f [3980687,109508] 0 2024-09-18T21:12:52.150 INFO:tasks.workunit.client.0.smithi077.stdout:1/482: truncate d3/d6a/d9b/d68/f44 1929684 0 2024-09-18T21:12:52.153 INFO:tasks.workunit.client.0.smithi077.stdout:3/463: chown db/d14/d22/d36/d39/d50/l59 210117 1 2024-09-18T21:12:52.154 INFO:tasks.workunit.client.1.smithi103.stdout:9/516: unlink d18/f38 0 2024-09-18T21:12:52.159 INFO:tasks.workunit.client.1.smithi103.stdout:7/442: creat d1/f82 x:0 0 0 2024-09-18T21:12:52.162 INFO:tasks.workunit.client.0.smithi077.stdout:9/400: rename d1/d54/f70 to d1/dd/d11/d1c/f7d 0 2024-09-18T21:12:52.163 INFO:tasks.workunit.client.1.smithi103.stdout:4/492: creat d9/d38/d72/d85/fa6 x:0 0 0 2024-09-18T21:12:52.163 INFO:tasks.workunit.client.1.smithi103.stdout:0/475: chown d1/d5/de/d22 2201 1 2024-09-18T21:12:52.164 INFO:tasks.workunit.client.1.smithi103.stdout:4/493: truncate d9/d1a/d21/d80/f9d 23730 0 2024-09-18T21:12:52.164 INFO:tasks.workunit.client.1.smithi103.stdout:4/494: dread - d9/d1c/f68 zero size 2024-09-18T21:12:52.165 INFO:tasks.workunit.client.0.smithi077.stdout:3/464: mknod db/d14/d32/d4f/d71/c94 0 2024-09-18T21:12:52.165 INFO:tasks.workunit.client.1.smithi103.stdout:2/436: symlink d3/d5/d25/la4 0 2024-09-18T21:12:52.168 INFO:tasks.workunit.client.0.smithi077.stdout:8/404: rename d2/d5/d6/l1c to d2/d5/d6/d22/d20/d35/l8d 0 2024-09-18T21:12:52.169 INFO:tasks.workunit.client.1.smithi103.stdout:7/443: truncate d1/df/d42/d29/d2f/d33/f3e 1448263 0 2024-09-18T21:12:52.173 INFO:tasks.workunit.client.0.smithi077.stdout:1/483: creat d3/d38/fb3 x:0 0 0 2024-09-18T21:12:52.174 INFO:tasks.workunit.client.1.smithi103.stdout:4/495: creat d9/d38/d58/fa7 x:0 0 0 2024-09-18T21:12:52.174 INFO:tasks.workunit.client.1.smithi103.stdout:4/496: truncate d9/d1f/f44 4283279 0 2024-09-18T21:12:52.177 INFO:tasks.workunit.client.0.smithi077.stdout:9/401: getdents d1/d54/d51 0 2024-09-18T21:12:52.179 INFO:tasks.workunit.client.0.smithi077.stdout:9/402: fsync d1/dd/d11/d1c/f53 0 2024-09-18T21:12:52.179 INFO:tasks.workunit.client.0.smithi077.stdout:8/405: unlink d2/d5/d6/d22/d20/f7d 0 2024-09-18T21:12:52.179 INFO:tasks.workunit.client.1.smithi103.stdout:8/596: getdents d4/d81/d71/d7f/d9d 0 2024-09-18T21:12:52.181 INFO:tasks.workunit.client.0.smithi077.stdout:2/555: link d1/d4/d9/l9e d1/lb4 0 2024-09-18T21:12:52.181 INFO:tasks.workunit.client.1.smithi103.stdout:3/491: write d1/d2/d18/d30/d4e/f84 [165556,10383] 0 2024-09-18T21:12:52.181 INFO:tasks.workunit.client.0.smithi077.stdout:3/465: dwrite db/f2e [4194304,4194304] 0 2024-09-18T21:12:52.182 INFO:tasks.workunit.client.0.smithi077.stdout:9/403: read d1/d54/d27/f64 [701113,111131] 0 2024-09-18T21:12:52.183 INFO:tasks.workunit.client.0.smithi077.stdout:8/406: dread d2/d27/d29/d41/f45 [0,4194304] 0 2024-09-18T21:12:52.190 INFO:tasks.workunit.client.1.smithi103.stdout:8/597: creat d4/de/fbc x:0 0 0 2024-09-18T21:12:52.192 INFO:tasks.workunit.client.1.smithi103.stdout:8/598: write d4/de/d4a/d59/fb3 [762847,74120] 0 2024-09-18T21:12:52.193 INFO:tasks.workunit.client.0.smithi077.stdout:1/484: dwrite d3/d6a/d9b/f5b [0,4194304] 0 2024-09-18T21:12:52.193 INFO:tasks.workunit.client.1.smithi103.stdout:2/437: dwrite d3/f9 [0,4194304] 0 2024-09-18T21:12:52.194 INFO:tasks.workunit.client.1.smithi103.stdout:2/438: fdatasync d3/f16 0 2024-09-18T21:12:52.195 INFO:tasks.workunit.client.1.smithi103.stdout:3/492: rmdir d1/d2/d18 39 2024-09-18T21:12:52.196 INFO:tasks.workunit.client.1.smithi103.stdout:4/497: dread d9/d2e/d61/d91/d9e/d48/f7e [0,4194304] 0 2024-09-18T21:12:52.197 INFO:tasks.workunit.client.1.smithi103.stdout:4/498: readlink d9/d1c/l6c 0 2024-09-18T21:12:52.197 INFO:tasks.workunit.client.0.smithi077.stdout:2/556: rename d1/d4/d9/d80/d8e/ca2 to d1/d62/cb5 0 2024-09-18T21:12:52.198 INFO:tasks.workunit.client.0.smithi077.stdout:8/407: symlink d2/d5/d6/d22/d4f/d5a/l8e 0 2024-09-18T21:12:52.200 INFO:tasks.workunit.client.0.smithi077.stdout:8/408: dread - d2/d5/d6/d22/d4f/f79 zero size 2024-09-18T21:12:52.201 INFO:tasks.workunit.client.0.smithi077.stdout:8/409: readlink d2/d5/d6/d22/d26/l6b 0 2024-09-18T21:12:52.202 INFO:tasks.workunit.client.0.smithi077.stdout:8/410: chown d2/d5/d6/d22/d20/f56 2 1 2024-09-18T21:12:52.203 INFO:tasks.workunit.client.1.smithi103.stdout:7/444: link d1/df/d43/d52/f75 d1/df/d42/f83 0 2024-09-18T21:12:52.204 INFO:tasks.workunit.client.0.smithi077.stdout:1/485: read - d3/d8/f47 zero size 2024-09-18T21:12:52.208 INFO:tasks.workunit.client.1.smithi103.stdout:2/439: readlink d3/d5/l24 0 2024-09-18T21:12:52.209 INFO:tasks.workunit.client.0.smithi077.stdout:2/557: stat d1/d62/cb5 0 2024-09-18T21:12:52.210 INFO:tasks.workunit.client.0.smithi077.stdout:3/466: creat db/f95 x:0 0 0 2024-09-18T21:12:52.215 INFO:tasks.workunit.client.1.smithi103.stdout:7/445: mknod d1/df/d43/d63/d67/d5b/c84 0 2024-09-18T21:12:52.215 INFO:tasks.workunit.client.1.smithi103.stdout:0/476: dwrite d1/d5/de/d24/f38 [0,4194304] 0 2024-09-18T21:12:52.215 INFO:tasks.workunit.client.0.smithi077.stdout:9/404: dwrite d1/dd/d1a/f1b [0,4194304] 0 2024-09-18T21:12:52.217 INFO:tasks.workunit.client.0.smithi077.stdout:1/486: read d3/d6a/d9b/d68/f44 [336447,125053] 0 2024-09-18T21:12:52.217 INFO:tasks.workunit.client.1.smithi103.stdout:8/599: link d4/de/d4a/f66 d4/d98/fbd 0 2024-09-18T21:12:52.218 INFO:tasks.workunit.client.0.smithi077.stdout:9/405: chown d1/d54/d27 108 1 2024-09-18T21:12:52.219 INFO:tasks.workunit.client.1.smithi103.stdout:3/493: symlink d1/d9a/l9c 0 2024-09-18T21:12:52.219 INFO:tasks.workunit.client.1.smithi103.stdout:4/499: dwrite d9/d1c/d77/f87 [0,4194304] 0 2024-09-18T21:12:52.219 INFO:tasks.workunit.client.0.smithi077.stdout:9/406: chown d1/d54 1669 1 2024-09-18T21:12:52.221 INFO:tasks.workunit.client.0.smithi077.stdout:3/467: dread db/f2e [0,4194304] 0 2024-09-18T21:12:52.222 INFO:tasks.workunit.client.1.smithi103.stdout:7/446: truncate d1/df/d42/d1f/d5d/f71 679911 0 2024-09-18T21:12:52.222 INFO:tasks.workunit.client.0.smithi077.stdout:8/411: getdents d2 0 2024-09-18T21:12:52.222 INFO:tasks.workunit.client.1.smithi103.stdout:8/600: dread - d4/d26/d56/d77/fa1 zero size 2024-09-18T21:12:52.223 INFO:tasks.workunit.client.0.smithi077.stdout:2/558: dwrite d1/d4/d9/d80/d8e/d66/f8a [0,4194304] 0 2024-09-18T21:12:52.223 INFO:tasks.workunit.client.1.smithi103.stdout:0/477: creat d1/d9/d3e/d6e/d96/d9f/d4f/d68/fa3 x:0 0 0 2024-09-18T21:12:52.224 INFO:tasks.workunit.client.0.smithi077.stdout:2/559: chown d1/d4/d9/d80/d83 882 1 2024-09-18T21:12:52.225 INFO:tasks.workunit.client.0.smithi077.stdout:9/407: creat d1/dd/d1a/f7e x:0 0 0 2024-09-18T21:12:52.227 INFO:tasks.workunit.client.0.smithi077.stdout:4/421: sync 2024-09-18T21:12:52.227 INFO:tasks.workunit.client.0.smithi077.stdout:7/502: sync 2024-09-18T21:12:52.227 INFO:tasks.workunit.client.1.smithi103.stdout:7/447: chown d1/df/d42/f26 44811 1 2024-09-18T21:12:52.230 INFO:tasks.workunit.client.0.smithi077.stdout:3/468: creat db/d14/d93/f96 x:0 0 0 2024-09-18T21:12:52.231 INFO:tasks.workunit.client.1.smithi103.stdout:3/494: dread d1/d2/f8 [0,4194304] 0 2024-09-18T21:12:52.231 INFO:tasks.workunit.client.0.smithi077.stdout:9/408: write d1/d54/d27/f64 [1971182,107615] 0 2024-09-18T21:12:52.233 INFO:tasks.workunit.client.0.smithi077.stdout:8/412: rename d2/d5/d6/d22/d20/d35 to d2/d5/d6/d22/d4f/d5a/d5e/d8f 0 2024-09-18T21:12:52.234 INFO:tasks.workunit.client.1.smithi103.stdout:2/440: rename d3/d5/f6f to d3/fa5 0 2024-09-18T21:12:52.235 INFO:tasks.workunit.client.1.smithi103.stdout:7/448: mkdir d1/df/d42/d1f/d5d/d85 0 2024-09-18T21:12:52.236 INFO:tasks.workunit.client.0.smithi077.stdout:4/422: symlink d3/dc/d51/d53/d66/l81 0 2024-09-18T21:12:52.236 INFO:tasks.workunit.client.0.smithi077.stdout:8/413: readlink d2/d27/d29/l7f 0 2024-09-18T21:12:52.236 INFO:tasks.workunit.client.1.smithi103.stdout:7/449: stat d1/df/d42/d29/c3d 0 2024-09-18T21:12:52.237 INFO:tasks.workunit.client.1.smithi103.stdout:7/450: chown d1/fe 55501 1 2024-09-18T21:12:52.240 INFO:tasks.workunit.client.0.smithi077.stdout:7/503: mknod d12/d22/d59/cb5 0 2024-09-18T21:12:52.242 INFO:tasks.workunit.client.1.smithi103.stdout:8/601: link d4/d81/d71/f84 d4/d2d/d87/fbe 0 2024-09-18T21:12:52.243 INFO:tasks.workunit.client.0.smithi077.stdout:9/409: dwrite d1/dd/d57/f74 [0,4194304] 0 2024-09-18T21:12:52.246 INFO:tasks.workunit.client.0.smithi077.stdout:3/469: creat db/d14/d90/f97 x:0 0 0 2024-09-18T21:12:52.247 INFO:tasks.workunit.client.0.smithi077.stdout:3/470: write db/f35 [7180445,63804] 0 2024-09-18T21:12:52.247 INFO:tasks.workunit.client.1.smithi103.stdout:2/441: creat d3/d5/d2f/d48/fa6 x:0 0 0 2024-09-18T21:12:52.247 INFO:tasks.workunit.client.0.smithi077.stdout:3/471: chown db/d14/f17 17939840 1 2024-09-18T21:12:52.248 INFO:tasks.workunit.client.0.smithi077.stdout:8/414: creat d2/d27/d29/f90 x:0 0 0 2024-09-18T21:12:52.252 INFO:tasks.workunit.client.1.smithi103.stdout:7/451: mkdir d1/df/d43/d63/d67/d5b/d86 0 2024-09-18T21:12:52.253 INFO:tasks.workunit.client.1.smithi103.stdout:7/452: chown d1/df/d42/f26 223816480 1 2024-09-18T21:12:52.254 INFO:tasks.workunit.client.1.smithi103.stdout:7/453: write d1/df/d43/d52/f76 [669640,72839] 0 2024-09-18T21:12:52.254 INFO:tasks.workunit.client.0.smithi077.stdout:7/504: mkdir d12/d56/da1/db6 0 2024-09-18T21:12:52.256 INFO:tasks.workunit.client.1.smithi103.stdout:0/478: dread d1/d9/d3e/d6e/f9e [0,4194304] 0 2024-09-18T21:12:52.256 INFO:tasks.workunit.client.0.smithi077.stdout:1/487: write d3/d8/d13/f14 [3889109,76476] 0 2024-09-18T21:12:52.256 INFO:tasks.workunit.client.0.smithi077.stdout:7/505: chown d12/d31/d77/d93/d2a/d6c/f96 285970780 1 2024-09-18T21:12:52.257 INFO:tasks.workunit.client.1.smithi103.stdout:4/500: getdents d9/d1a/d41 0 2024-09-18T21:12:52.257 INFO:tasks.workunit.client.0.smithi077.stdout:9/410: mkdir d1/dd/d11/d1c/d38/d46/d55/d7f 0 2024-09-18T21:12:52.258 INFO:tasks.workunit.client.0.smithi077.stdout:9/411: dread - d1/dd/f62 zero size 2024-09-18T21:12:52.259 INFO:tasks.workunit.client.1.smithi103.stdout:0/479: chown d1/d5/de/d22/f5b 319894956 1 2024-09-18T21:12:52.259 INFO:tasks.workunit.client.1.smithi103.stdout:1/477: sync 2024-09-18T21:12:52.259 INFO:tasks.workunit.client.1.smithi103.stdout:5/539: sync 2024-09-18T21:12:52.259 INFO:tasks.workunit.client.1.smithi103.stdout:4/501: read d9/f6a [305621,38584] 0 2024-09-18T21:12:52.260 INFO:tasks.workunit.client.0.smithi077.stdout:3/472: write db/d14/d22/f75 [62093,71515] 0 2024-09-18T21:12:52.261 INFO:tasks.workunit.client.0.smithi077.stdout:3/473: dread - db/d14/d32/f86 zero size 2024-09-18T21:12:52.262 INFO:tasks.workunit.client.1.smithi103.stdout:1/478: write d0/d2/f6c [852626,100639] 0 2024-09-18T21:12:52.263 INFO:tasks.workunit.client.0.smithi077.stdout:8/415: creat d2/d5f/d6f/f91 x:0 0 0 2024-09-18T21:12:52.263 INFO:tasks.workunit.client.1.smithi103.stdout:7/454: dwrite d1/df/d42/f2b [0,4194304] 0 2024-09-18T21:12:52.266 INFO:tasks.workunit.client.0.smithi077.stdout:2/560: rename d1/d4/d5/d1a/d49/l4d to d1/d4/d5/lb6 0 2024-09-18T21:12:52.267 INFO:tasks.workunit.client.1.smithi103.stdout:1/479: write d0/d2/d9/d10/f67 [4056244,20142] 0 2024-09-18T21:12:52.269 INFO:tasks.workunit.client.1.smithi103.stdout:0/480: dwrite d1/d9/d3e/d6e/d96/d9f/f46 [0,4194304] 0 2024-09-18T21:12:52.271 INFO:tasks.workunit.client.0.smithi077.stdout:4/423: dread d3/dc/d24/f43 [0,4194304] 0 2024-09-18T21:12:52.276 INFO:tasks.workunit.client.1.smithi103.stdout:5/540: write de/d3e/f12 [1318801,107763] 0 2024-09-18T21:12:52.277 INFO:tasks.workunit.client.0.smithi077.stdout:3/474: mknod db/d14/d32/d4f/d71/d3b/c98 0 2024-09-18T21:12:52.278 INFO:tasks.workunit.client.1.smithi103.stdout:3/495: truncate d1/d2/fb 7386677 0 2024-09-18T21:12:52.278 INFO:tasks.workunit.client.0.smithi077.stdout:3/475: chown db/d14/d32/d4f/d71/d3b/f7e 161788 1 2024-09-18T21:12:52.279 INFO:tasks.workunit.client.1.smithi103.stdout:7/455: dwrite d1/df/d43/f4d [4194304,4194304] 0 2024-09-18T21:12:52.279 INFO:tasks.workunit.client.1.smithi103.stdout:1/480: dwrite d0/d2/d9/d10/d5d/f95 [0,4194304] 0 2024-09-18T21:12:52.281 INFO:tasks.workunit.client.1.smithi103.stdout:1/481: fsync d0/d2/d9/d10/d5d/f79 0 2024-09-18T21:12:52.281 INFO:tasks.workunit.client.1.smithi103.stdout:3/496: chown d1/da/df/d70/l7b 351537 1 2024-09-18T21:12:52.283 INFO:tasks.workunit.client.1.smithi103.stdout:1/482: read d0/d2/d9/dc/f28 [22899,33640] 0 2024-09-18T21:12:52.283 INFO:tasks.workunit.client.0.smithi077.stdout:7/506: rmdir d12/d56 39 2024-09-18T21:12:52.285 INFO:tasks.workunit.client.1.smithi103.stdout:9/517: sync 2024-09-18T21:12:52.285 INFO:tasks.workunit.client.1.smithi103.stdout:6/483: sync 2024-09-18T21:12:52.286 INFO:tasks.workunit.client.1.smithi103.stdout:9/518: dread - d18/d52/f82 zero size 2024-09-18T21:12:52.288 INFO:tasks.workunit.client.1.smithi103.stdout:9/519: write fa [4450730,127006] 0 2024-09-18T21:12:52.288 INFO:tasks.workunit.client.1.smithi103.stdout:8/602: truncate d4/ff 1895754 0 2024-09-18T21:12:52.290 INFO:tasks.workunit.client.1.smithi103.stdout:1/483: dwrite d0/d2/d9/dc/f69 [0,4194304] 0 2024-09-18T21:12:52.298 INFO:tasks.workunit.client.0.smithi077.stdout:6/457: sync 2024-09-18T21:12:52.299 INFO:tasks.workunit.client.1.smithi103.stdout:1/484: dwrite d0/d2/d9/d10/d5d/f8a [0,4194304] 0 2024-09-18T21:12:52.299 INFO:tasks.workunit.client.0.smithi077.stdout:9/412: dwrite d1/d54/d27/f39 [0,4194304] 0 2024-09-18T21:12:52.301 INFO:tasks.workunit.client.1.smithi103.stdout:1/485: write d0/d2/d9/d10/d5d/f88 [114118,105743] 0 2024-09-18T21:12:52.302 INFO:tasks.workunit.client.1.smithi103.stdout:1/486: dread - d0/d3/f4c zero size 2024-09-18T21:12:52.310 INFO:tasks.workunit.client.1.smithi103.stdout:6/484: dwrite d2/d3/f55 [0,4194304] 0 2024-09-18T21:12:52.313 INFO:tasks.workunit.client.0.smithi077.stdout:3/476: dwrite db/f2e [0,4194304] 0 2024-09-18T21:12:52.313 INFO:tasks.workunit.client.0.smithi077.stdout:2/561: dwrite d1/d4/d5/d1a/d2e/f7f [0,4194304] 0 2024-09-18T21:12:52.313 INFO:tasks.workunit.client.0.smithi077.stdout:9/413: mkdir d1/dd/d11/d15/d80 0 2024-09-18T21:12:52.315 INFO:tasks.workunit.client.1.smithi103.stdout:0/481: truncate d1/d9/d3e/d6e/d96/d9f/f71 1243566 0 2024-09-18T21:12:52.316 INFO:tasks.workunit.client.0.smithi077.stdout:7/507: mknod d12/d22/cb7 0 2024-09-18T21:12:52.317 INFO:tasks.workunit.client.1.smithi103.stdout:0/482: fsync d1/d9/d3e/d6e/f9e 0 2024-09-18T21:12:52.317 INFO:tasks.workunit.client.1.smithi103.stdout:2/442: getdents d3/d5/d2f 0 2024-09-18T21:12:52.318 INFO:tasks.workunit.client.1.smithi103.stdout:2/443: chown d3/d5/d25/f33 329064 1 2024-09-18T21:12:52.318 INFO:tasks.workunit.client.0.smithi077.stdout:1/488: getdents d3/d8/d49/d4e/d50 0 2024-09-18T21:12:52.320 INFO:tasks.workunit.client.0.smithi077.stdout:6/458: dwrite d7/f2d [4194304,4194304] 0 2024-09-18T21:12:52.320 INFO:tasks.workunit.client.0.smithi077.stdout:8/416: rename d2/d5/d6/d22/d18/c70 to d2/d5/d6/d22/d20/c92 0 2024-09-18T21:12:52.326 INFO:tasks.workunit.client.0.smithi077.stdout:6/459: write d7/d7e/d11/d1d/d5c/f91 [148082,98416] 0 2024-09-18T21:12:52.329 INFO:tasks.workunit.client.1.smithi103.stdout:4/502: link d9/d2e/d61/d91/d9e/f35 d9/d38/d72/fa8 0 2024-09-18T21:12:52.330 INFO:tasks.workunit.client.1.smithi103.stdout:1/487: unlink d0/d2/d2b/d3a/f51 0 2024-09-18T21:12:52.332 INFO:tasks.workunit.client.0.smithi077.stdout:9/414: mkdir d1/d54/d81 0 2024-09-18T21:12:52.333 INFO:tasks.workunit.client.0.smithi077.stdout:4/424: rename d3/dc/d32/d5b/f67 to d3/d7/f82 0 2024-09-18T21:12:52.334 INFO:tasks.workunit.client.1.smithi103.stdout:6/485: write d2/d3/f6f [737760,18166] 0 2024-09-18T21:12:52.335 INFO:tasks.workunit.client.0.smithi077.stdout:7/508: unlink d12/l13 0 2024-09-18T21:12:52.336 INFO:tasks.workunit.client.1.smithi103.stdout:8/603: fdatasync d4/ff 0 2024-09-18T21:12:52.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.334+0000 7f5a5031b640 1 -- 172.21.15.77:0/586458705 --> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5a2c000bf0 con 0x7f5a3406e4a0 2024-09-18T21:12:52.337 INFO:tasks.workunit.client.0.smithi077.stdout:6/460: dread d7/d7e/d11/f57 [0,4194304] 0 2024-09-18T21:12:52.337 INFO:tasks.workunit.client.1.smithi103.stdout:8/604: read d4/d81/d65/d39/f4f [911943,23679] 0 2024-09-18T21:12:52.338 INFO:tasks.workunit.client.0.smithi077.stdout:6/461: write d7/d7e/d11/d3e/f78 [248939,59404] 0 2024-09-18T21:12:52.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.337+0000 7f5a3effd640 1 -- 172.21.15.77:0/586458705 <== mgr.14578 v2:172.21.15.103:6828/1199124716 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f5a2c000bf0 con 0x7f5a3406e4a0 2024-09-18T21:12:52.342 INFO:tasks.workunit.client.1.smithi103.stdout:5/541: creat de/fae x:0 0 0 2024-09-18T21:12:52.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.340+0000 7f5a5031b640 1 -- 172.21.15.77:0/586458705 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f5a3406e4a0 msgr2=0x7f5a34070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:52.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.340+0000 7f5a5031b640 1 --2- 172.21.15.77:0/586458705 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f5a3406e4a0 0x7f5a34070950 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5a4810cec0 tx=0x7f5a38009120 comp rx=0 tx=0).stop 2024-09-18T21:12:52.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.341+0000 7f5a5031b640 1 -- 172.21.15.77:0/586458705 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a48066450 msgr2=0x7f5a4810d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:52.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.341+0000 7f5a5031b640 1 --2- 172.21.15.77:0/586458705 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a48066450 0x7f5a4810d110 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5a440048a0 tx=0x7f5a44009da0 comp rx=0 tx=0).stop 2024-09-18T21:12:52.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.341+0000 7f5a5031b640 1 -- 172.21.15.77:0/586458705 shutdown_connections 2024-09-18T21:12:52.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.341+0000 7f5a5031b640 1 --2- 172.21.15.77:0/586458705 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f5a3406e4a0 0x7f5a34070950 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:52.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.341+0000 7f5a5031b640 1 --2- 172.21.15.77:0/586458705 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a480ff6f0 0x7f5a4810d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:52.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.341+0000 7f5a5031b640 1 --2- 172.21.15.77:0/586458705 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a48066450 0x7f5a4810d110 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:52.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.341+0000 7f5a5031b640 1 -- 172.21.15.77:0/586458705 >> 172.21.15.77:0/586458705 conn(0x7f5a480f6c00 msgr2=0x7f5a480f6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:12:52.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.341+0000 7f5a5031b640 1 -- 172.21.15.77:0/586458705 shutdown_connections 2024-09-18T21:12:52.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.341+0000 7f5a5031b640 1 -- 172.21.15.77:0/586458705 wait complete. 2024-09-18T21:12:52.345 INFO:tasks.workunit.client.0.smithi077.stdout:4/425: creat d3/dc/d32/d5b/f83 x:0 0 0 2024-09-18T21:12:52.346 INFO:tasks.workunit.client.1.smithi103.stdout:4/503: mkdir d9/d1a/d41/d64/da9 0 2024-09-18T21:12:52.347 INFO:tasks.workunit.client.1.smithi103.stdout:4/504: dread - d9/d2e/d61/f99 zero size 2024-09-18T21:12:52.350 INFO:tasks.workunit.client.1.smithi103.stdout:8/605: rmdir d4/de/d4a/d59 39 2024-09-18T21:12:52.351 INFO:tasks.workunit.client.0.smithi077.stdout:5/600: sync 2024-09-18T21:12:52.352 INFO:tasks.workunit.client.0.smithi077.stdout:0/560: sync 2024-09-18T21:12:52.354 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-09-18T21:12:52.355 INFO:tasks.workunit.client.1.smithi103.stdout:2/444: unlink d3/d5/d4a/c51 0 2024-09-18T21:12:52.359 INFO:tasks.workunit.client.1.smithi103.stdout:9/520: dwrite d18/d8d/f87 [0,4194304] 0 2024-09-18T21:12:52.359 INFO:tasks.workunit.client.0.smithi077.stdout:0/561: write d8/d26/f96 [972329,53063] 0 2024-09-18T21:12:52.359 INFO:tasks.workunit.client.0.smithi077.stdout:1/489: truncate d3/d38/d97/f98 1574650 0 2024-09-18T21:12:52.360 INFO:tasks.workunit.client.1.smithi103.stdout:7/456: rename d1/df/d42/d29/d2f/d33/f3e to d1/df/d42/d1f/d2e/f87 0 2024-09-18T21:12:52.361 INFO:tasks.workunit.client.0.smithi077.stdout:8/417: creat d2/d5/f93 x:0 0 0 2024-09-18T21:12:52.361 INFO:tasks.workunit.client.1.smithi103.stdout:9/521: chown d18/d8d/lab 0 1 2024-09-18T21:12:52.361 INFO:tasks.workunit.client.0.smithi077.stdout:6/462: symlink d7/d7e/d11/d9a/l9f 0 2024-09-18T21:12:52.363 INFO:tasks.workunit.client.0.smithi077.stdout:2/562: link d1/d4/d5/d1a/d2e/c93 d1/d4/d5/d1a/d2e/cb7 0 2024-09-18T21:12:52.364 INFO:tasks.workunit.client.0.smithi077.stdout:0/562: dread - d8/d1a/d39/f8e zero size 2024-09-18T21:12:52.364 INFO:tasks.workunit.client.1.smithi103.stdout:1/488: mkdir d0/d3/d68/d81/da2/da4 0 2024-09-18T21:12:52.364 INFO:tasks.workunit.client.1.smithi103.stdout:4/505: mkdir d9/d2e/d61/d91/daa 0 2024-09-18T21:12:52.365 INFO:tasks.workunit.client.1.smithi103.stdout:6/486: creat d2/d24/d5a/d67/d76/d43/d44/f98 x:0 0 0 2024-09-18T21:12:52.365 INFO:tasks.workunit.client.0.smithi077.stdout:8/418: write d2/d5/d6/d22/d4f/f79 [34707,82369] 0 2024-09-18T21:12:52.365 INFO:tasks.workunit.client.0.smithi077.stdout:6/463: write d7/d7e/d11/f9e [682840,4020] 0 2024-09-18T21:12:52.367 INFO:tasks.workunit.client.0.smithi077.stdout:0/563: dread - d8/d1d/f74 zero size 2024-09-18T21:12:52.368 INFO:tasks.workunit.client.1.smithi103.stdout:2/445: dwrite d3/d5/d2c/d54/d68/f8a [0,4194304] 0 2024-09-18T21:12:52.369 INFO:tasks.workunit.client.1.smithi103.stdout:2/446: stat d3/d5/d2c/c3f 0 2024-09-18T21:12:52.369 INFO:tasks.workunit.client.0.smithi077.stdout:3/477: dread db/f13 [0,4194304] 0 2024-09-18T21:12:52.370 INFO:tasks.workunit.client.1.smithi103.stdout:0/483: creat d1/d5/d4c/fa4 x:0 0 0 2024-09-18T21:12:52.372 INFO:tasks.workunit.client.0.smithi077.stdout:6/464: chown d7/d7e/d11/f57 132 1 2024-09-18T21:12:52.377 INFO:tasks.workunit.client.1.smithi103.stdout:5/542: dread de/d14/d33/f5d [4194304,4194304] 0 2024-09-18T21:12:52.383 INFO:tasks.workunit.client.1.smithi103.stdout:1/489: unlink d0/d2/d2b/c33 0 2024-09-18T21:12:52.385 INFO:tasks.workunit.client.0.smithi077.stdout:7/509: dwrite d12/d31/d77/d93/f7c [0,4194304] 0 2024-09-18T21:12:52.387 INFO:tasks.workunit.client.1.smithi103.stdout:8/606: readlink d4/de/d4a/d59/lb6 0 2024-09-18T21:12:52.388 INFO:tasks.workunit.client.1.smithi103.stdout:8/607: chown d4/d26/d56/d77 2640688 1 2024-09-18T21:12:52.391 INFO:tasks.workunit.client.1.smithi103.stdout:6/487: symlink d2/d24/d38/l99 0 2024-09-18T21:12:52.393 INFO:tasks.workunit.client.1.smithi103.stdout:6/488: chown d2/d24/d38/l88 18963486 1 2024-09-18T21:12:52.393 INFO:tasks.workunit.client.1.smithi103.stdout:8/608: dwrite d4/d2d/f33 [0,4194304] 0 2024-09-18T21:12:52.394 INFO:tasks.workunit.client.1.smithi103.stdout:2/447: creat d3/d5/d2f/d48/fa7 x:0 0 0 2024-09-18T21:12:52.394 INFO:tasks.workunit.client.0.smithi077.stdout:4/426: dwrite d3/dc/f47 [0,4194304] 0 2024-09-18T21:12:52.401 INFO:tasks.workunit.client.1.smithi103.stdout:3/497: rename d1/da/f22 to d1/d23/d25/d4f/d58/d68/d50/d54/f9d 0 2024-09-18T21:12:52.403 INFO:tasks.workunit.client.1.smithi103.stdout:7/457: unlink d1/df/c16 0 2024-09-18T21:12:52.405 INFO:tasks.workunit.client.1.smithi103.stdout:0/484: dwrite d1/d5/de/d24/d43/d76/f77 [0,4194304] 0 2024-09-18T21:12:52.406 INFO:tasks.workunit.client.1.smithi103.stdout:4/506: creat d9/d2e/d83/fab x:0 0 0 2024-09-18T21:12:52.406 INFO:tasks.workunit.client.1.smithi103.stdout:4/507: chown d9/d38/d58/ca3 5056460 1 2024-09-18T21:12:52.407 INFO:tasks.workunit.client.1.smithi103.stdout:4/508: chown d9/d1a/c65 115656 1 2024-09-18T21:12:52.411 INFO:tasks.workunit.client.1.smithi103.stdout:8/609: creat d4/d26/d56/d77/d9f/fbf x:0 0 0 2024-09-18T21:12:52.412 INFO:tasks.workunit.client.1.smithi103.stdout:0/485: dwrite d1/d9/d3e/d6e/f94 [0,4194304] 0 2024-09-18T21:12:52.414 INFO:tasks.workunit.client.1.smithi103.stdout:8/610: truncate d4/d81/d71/d7f/d9d/fae 1030643 0 2024-09-18T21:12:52.414 INFO:tasks.workunit.client.0.smithi077.stdout:9/415: creat d1/d54/f82 x:0 0 0 2024-09-18T21:12:52.418 INFO:tasks.workunit.client.0.smithi077.stdout:2/563: creat d1/d4/d5/d1a/d2e/d86/fb8 x:0 0 0 2024-09-18T21:12:52.418 INFO:tasks.workunit.client.1.smithi103.stdout:7/458: symlink d1/df/d42/d29/d2f/d33/l88 0 2024-09-18T21:12:52.419 INFO:tasks.workunit.client.0.smithi077.stdout:8/419: chown d2/d5/d6/d22/d4f/d5a/d5e/d8f/l8d 3 1 2024-09-18T21:12:52.423 INFO:tasks.workunit.client.0.smithi077.stdout:3/478: mkdir db/d14/d32/d4f/d8a/d99 0 2024-09-18T21:12:52.426 INFO:tasks.workunit.client.0.smithi077.stdout:6/465: creat d7/d7e/d11/d1d/d31/fa0 x:0 0 0 2024-09-18T21:12:52.427 INFO:tasks.workunit.client.0.smithi077.stdout:8/420: dwrite d2/d5/d6/d22/d4f/d5a/d5e/f83 [0,4194304] 0 2024-09-18T21:12:52.429 INFO:tasks.workunit.client.0.smithi077.stdout:6/466: truncate d7/d7e/d11/d3e/f65 1730347 0 2024-09-18T21:12:52.432 INFO:tasks.workunit.client.0.smithi077.stdout:7/510: unlink d12/d31/la5 0 2024-09-18T21:12:52.433 INFO:tasks.workunit.client.0.smithi077.stdout:7/511: readlink d12/d31/d77/d93/d2a/d6c/l8f 0 2024-09-18T21:12:52.442 INFO:tasks.workunit.client.0.smithi077.stdout:3/479: fdatasync db/d14/d72/f91 0 2024-09-18T21:12:52.442 INFO:tasks.workunit.client.0.smithi077.stdout:3/480: fdatasync f3 0 2024-09-18T21:12:52.443 INFO:tasks.workunit.client.0.smithi077.stdout:6/467: dread - d7/d7e/d11/d1d/d4c/f8a zero size 2024-09-18T21:12:52.448 INFO:tasks.workunit.client.0.smithi077.stdout:2/564: symlink d1/d4/d5/d7d/lb9 0 2024-09-18T21:12:52.450 INFO:tasks.workunit.client.0.smithi077.stdout:8/421: symlink d2/d5/l94 0 2024-09-18T21:12:52.452 INFO:tasks.workunit.client.0.smithi077.stdout:7/512: fsync d12/f73 0 2024-09-18T21:12:52.453 INFO:tasks.workunit.client.0.smithi077.stdout:5/601: link d0/df/d10/d47/la3 d0/df/d10/d5c/lc9 0 2024-09-18T21:12:52.456 INFO:tasks.workunit.client.0.smithi077.stdout:9/416: creat d1/dd/d11/f83 x:0 0 0 2024-09-18T21:12:52.458 INFO:tasks.workunit.client.0.smithi077.stdout:3/481: creat db/d14/d32/d49/d6b/f9a x:0 0 0 2024-09-18T21:12:52.460 INFO:tasks.workunit.client.0.smithi077.stdout:8/422: creat d2/d5f/d6f/f95 x:0 0 0 2024-09-18T21:12:52.463 INFO:tasks.workunit.client.0.smithi077.stdout:1/490: link d3/d6a/d9b/l21 d3/d8/d49/lb4 0 2024-09-18T21:12:52.464 INFO:tasks.workunit.client.0.smithi077.stdout:0/564: dwrite d8/d1d/d57/f65 [0,4194304] 0 2024-09-18T21:12:52.464 INFO:tasks.workunit.client.0.smithi077.stdout:2/565: mkdir d1/d4/d9/d80/d83/dba 0 2024-09-18T21:12:52.467 INFO:tasks.workunit.client.0.smithi077.stdout:1/491: chown d3/d8/d13/d18/d99 2134087 1 2024-09-18T21:12:52.477 INFO:tasks.workunit.client.0.smithi077.stdout:7/513: creat d12/d56/da1/db6/fb8 x:0 0 0 2024-09-18T21:12:52.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.476+0000 7f8e4fefe640 1 -- 172.21.15.77:0/194756941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e48104940 msgr2=0x7f8e48104d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:52.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.476+0000 7f8e4fefe640 1 --2- 172.21.15.77:0/194756941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e48104940 0x7f8e48104d50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8e440048d0 tx=0x7f8e44009da0 comp rx=0 tx=0).stop 2024-09-18T21:12:52.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.476+0000 7f8e4fefe640 1 -- 172.21.15.77:0/194756941 shutdown_connections 2024-09-18T21:12:52.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.476+0000 7f8e4fefe640 1 --2- 172.21.15.77:0/194756941 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e48105320 0x7f8e4806e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:52.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.476+0000 7f8e4fefe640 1 --2- 172.21.15.77:0/194756941 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e48104940 0x7f8e48104d50 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:52.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.476+0000 7f8e4fefe640 1 -- 172.21.15.77:0/194756941 >> 172.21.15.77:0/194756941 conn(0x7f8e48069b00 msgr2=0x7f8e4806bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:12:52.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.476+0000 7f8e4fefe640 1 -- 172.21.15.77:0/194756941 shutdown_connections 2024-09-18T21:12:52.479 INFO:tasks.workunit.client.0.smithi077.stdout:1/492: rename d3/f2e to d3/d8/d13/d18/d99/fb5 0 2024-09-18T21:12:52.479 INFO:tasks.workunit.client.0.smithi077.stdout:3/482: dwrite db/f2e [4194304,4194304] 0 2024-09-18T21:12:52.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.477+0000 7f8e4fefe640 1 -- 172.21.15.77:0/194756941 wait complete. 2024-09-18T21:12:52.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.478+0000 7f8e4fefe640 1 Processor -- start 2024-09-18T21:12:52.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.478+0000 7f8e4fefe640 1 -- start start 2024-09-18T21:12:52.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.478+0000 7f8e4fefe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e48104940 0x7f8e48116420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:12:52.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.478+0000 7f8e4fefe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e48105320 0x7f8e48118970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:12:52.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.478+0000 7f8e4fefe640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4810a720 con 0x7f8e48105320 2024-09-18T21:12:52.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.478+0000 7f8e4fefe640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4810a890 con 0x7f8e48104940 2024-09-18T21:12:52.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.478+0000 7f8e4d499640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e48105320 0x7f8e48118970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:12:52.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.478+0000 7f8e4d499640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e48105320 0x7f8e48118970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49532/0 (socket says 172.21.15.77:49532) 2024-09-18T21:12:52.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.478+0000 7f8e4d499640 1 -- 172.21.15.77:0/3497197947 learned_addr learned my addr 172.21.15.77:0/3497197947 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:12:52.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.478+0000 7f8e4dc9a640 1 --2- 172.21.15.77:0/3497197947 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e48104940 0x7f8e48116420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:12:52.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.479+0000 7f8e4d499640 1 -- 172.21.15.77:0/3497197947 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e48104940 msgr2=0x7f8e48116420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:52.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.479+0000 7f8e4d499640 1 --2- 172.21.15.77:0/3497197947 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e48104940 0x7f8e48116420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:52.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.479+0000 7f8e4d499640 1 -- 172.21.15.77:0/3497197947 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e44005040 con 0x7f8e48105320 2024-09-18T21:12:52.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.480+0000 7f8e4d499640 1 --2- 172.21.15.77:0/3497197947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e48105320 0x7f8e48118970 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8e3800b560 tx=0x7f8e380090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:12:52.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.480+0000 7f8e3e7fc640 1 -- 172.21.15.77:0/3497197947 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e3800f6f0 con 0x7f8e48105320 2024-09-18T21:12:52.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.480+0000 7f8e3e7fc640 1 -- 172.21.15.77:0/3497197947 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8e3800fcf0 con 0x7f8e48105320 2024-09-18T21:12:52.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.480+0000 7f8e3e7fc640 1 -- 172.21.15.77:0/3497197947 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e38011e10 con 0x7f8e48105320 2024-09-18T21:12:52.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.480+0000 7f8e4fefe640 1 -- 172.21.15.77:0/3497197947 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e48118fd0 con 0x7f8e48105320 2024-09-18T21:12:52.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.480+0000 7f8e4fefe640 1 -- 172.21.15.77:0/3497197947 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e481194f0 con 0x7f8e48105320 2024-09-18T21:12:52.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.482+0000 7f8e4fefe640 1 -- 172.21.15.77:0/3497197947 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e4806d650 con 0x7f8e48105320 2024-09-18T21:12:52.484 INFO:tasks.workunit.client.0.smithi077.stdout:8/423: creat d2/d5/d6/d22/d20/f96 x:0 0 0 2024-09-18T21:12:52.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.483+0000 7f8e3e7fc640 1 -- 172.21.15.77:0/3497197947 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 24) v1 ==== 91488+0+0 (secure 0 0 0) 0x7f8e38011600 con 0x7f8e48105320 2024-09-18T21:12:52.485 INFO:tasks.workunit.client.0.smithi077.stdout:9/417: dread d1/dd/f14 [0,4194304] 0 2024-09-18T21:12:52.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.484+0000 7f8e3e7fc640 1 --2- 172.21.15.77:0/3497197947 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f8e3406e570 0x7f8e34070a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:12:52.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.484+0000 7f8e3e7fc640 1 -- 172.21.15.77:0/3497197947 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f8e3808d5d0 con 0x7f8e48105320 2024-09-18T21:12:52.486 INFO:tasks.workunit.client.1.smithi103.stdout:6/489: link d2/d24/d5a/f64 d2/d3/d8/d4c/d4e/f9a 0 2024-09-18T21:12:52.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.484+0000 7f8e4dc9a640 1 --2- 172.21.15.77:0/3497197947 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f8e3406e570 0x7f8e34070a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:12:52.487 INFO:tasks.workunit.client.0.smithi077.stdout:4/427: dwrite d3/dc/d32/f44 [0,4194304] 0 2024-09-18T21:12:52.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.485+0000 7f8e4dc9a640 1 --2- 172.21.15.77:0/3497197947 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f8e3406e570 0x7f8e34070a20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8e44000c00 tx=0x7f8e44035040 comp rx=0 tx=0).ready entity=mgr.14578 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:12:52.488 INFO:tasks.workunit.client.1.smithi103.stdout:2/448: readlink d3/d5/d25/d40/l7a 0 2024-09-18T21:12:52.488 INFO:tasks.workunit.client.1.smithi103.stdout:3/498: dread d1/d2/d18/d30/d4e/f84 [0,4194304] 0 2024-09-18T21:12:52.488 INFO:tasks.workunit.client.1.smithi103.stdout:8/611: mknod d4/d2d/d4e/cc0 0 2024-09-18T21:12:52.490 INFO:tasks.workunit.client.1.smithi103.stdout:0/486: dwrite d1/d5/de/d24/f32 [0,4194304] 0 2024-09-18T21:12:52.490 INFO:tasks.workunit.client.0.smithi077.stdout:2/566: dwrite d1/d4/d5/d1a/d49/d6a/f8b [0,4194304] 0 2024-09-18T21:12:52.491 INFO:tasks.workunit.client.1.smithi103.stdout:3/499: fdatasync d1/f24 0 2024-09-18T21:12:52.494 INFO:tasks.workunit.client.0.smithi077.stdout:4/428: read d3/f5 [1834826,76283] 0 2024-09-18T21:12:52.496 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.494+0000 7f8e3e7fc640 1 -- 172.21.15.77:0/3497197947 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f8e38057310 con 0x7f8e48105320 2024-09-18T21:12:52.496 INFO:tasks.workunit.client.0.smithi077.stdout:1/493: mkdir d3/db6 0 2024-09-18T21:12:52.497 INFO:tasks.workunit.client.0.smithi077.stdout:0/565: dwrite d8/d1a/d39/d3b/d9a/fa2 [0,4194304] 0 2024-09-18T21:12:52.503 INFO:tasks.workunit.client.1.smithi103.stdout:5/543: dwrite de/d14/f22 [0,4194304] 0 2024-09-18T21:12:52.503 INFO:tasks.workunit.client.1.smithi103.stdout:4/509: dwrite d9/f6e [0,4194304] 0 2024-09-18T21:12:52.504 INFO:tasks.workunit.client.0.smithi077.stdout:0/566: write d8/d1a/d39/f86 [167021,113866] 0 2024-09-18T21:12:52.504 INFO:tasks.workunit.client.0.smithi077.stdout:6/468: dwrite d7/d7e/f28 [0,4194304] 0 2024-09-18T21:12:52.506 INFO:tasks.workunit.client.1.smithi103.stdout:0/487: dwrite d1/d5/d4c/fa4 [0,4194304] 0 2024-09-18T21:12:52.506 INFO:tasks.workunit.client.0.smithi077.stdout:6/469: readlink d7/l37 0 2024-09-18T21:12:52.510 INFO:tasks.workunit.client.1.smithi103.stdout:9/522: creat d18/d52/d5e/fac x:0 0 0 2024-09-18T21:12:52.511 INFO:tasks.workunit.client.0.smithi077.stdout:1/494: mknod d3/d8/d13/d18/d99/cb7 0 2024-09-18T21:12:52.512 INFO:tasks.workunit.client.0.smithi077.stdout:8/424: truncate d2/d5/d6/d22/d4f/d5a/f5c 1721793 0 2024-09-18T21:12:52.513 INFO:tasks.workunit.client.0.smithi077.stdout:9/418: creat d1/d54/f84 x:0 0 0 2024-09-18T21:12:52.517 INFO:tasks.workunit.client.1.smithi103.stdout:2/449: dread d3/d5/f27 [0,4194304] 0 2024-09-18T21:12:52.518 INFO:tasks.workunit.client.1.smithi103.stdout:6/490: mkdir d2/d3/d8/d4c/d7d/d9b 0 2024-09-18T21:12:52.520 INFO:tasks.workunit.client.1.smithi103.stdout:9/523: dread d18/d29/f4d [0,4194304] 0 2024-09-18T21:12:52.520 INFO:tasks.workunit.client.0.smithi077.stdout:7/514: rename d12/d22/d59/d72/c3e to d12/d31/d77/d93/cb9 0 2024-09-18T21:12:52.521 INFO:tasks.workunit.client.0.smithi077.stdout:0/567: rmdir d8/d37/d95 39 2024-09-18T21:12:52.522 INFO:tasks.workunit.client.1.smithi103.stdout:9/524: truncate d18/d52/f82 235160 0 2024-09-18T21:12:52.523 INFO:tasks.workunit.client.0.smithi077.stdout:7/515: chown d12/d22/d59/d5a/f69 856193288 1 2024-09-18T21:12:52.525 INFO:tasks.workunit.client.0.smithi077.stdout:8/425: mknod d2/d5/d6/d22/d4f/d5a/c97 0 2024-09-18T21:12:52.526 INFO:tasks.workunit.client.0.smithi077.stdout:1/495: write d3/d8/f88 [260788,60398] 0 2024-09-18T21:12:52.531 INFO:tasks.workunit.client.1.smithi103.stdout:5/544: mknod de/d3e/d85/caf 0 2024-09-18T21:12:52.532 INFO:tasks.workunit.client.0.smithi077.stdout:7/516: creat d12/d22/d59/d5d/d62/fba x:0 0 0 2024-09-18T21:12:52.533 INFO:tasks.workunit.client.1.smithi103.stdout:7/459: symlink d1/df/d42/l89 0 2024-09-18T21:12:52.533 INFO:tasks.workunit.client.0.smithi077.stdout:9/419: mkdir d1/dd/d11/d15/d80/d85 0 2024-09-18T21:12:52.535 INFO:tasks.workunit.client.0.smithi077.stdout:8/426: rmdir d2/d5/d6/d22/d4f/d5a/d5e/d8f 39 2024-09-18T21:12:52.535 INFO:tasks.workunit.client.0.smithi077.stdout:1/496: dwrite d3/d8/f17 [8388608,4194304] 0 2024-09-18T21:12:52.536 INFO:tasks.workunit.client.1.smithi103.stdout:6/491: mknod d2/d24/d5a/d67/c9c 0 2024-09-18T21:12:52.538 INFO:tasks.workunit.client.0.smithi077.stdout:7/517: fsync f10 0 2024-09-18T21:12:52.539 INFO:tasks.workunit.client.0.smithi077.stdout:4/429: dread d3/f2b [0,4194304] 0 2024-09-18T21:12:52.540 INFO:tasks.workunit.client.1.smithi103.stdout:4/510: mknod d9/d1a/cac 0 2024-09-18T21:12:52.541 INFO:tasks.workunit.client.0.smithi077.stdout:9/420: creat d1/dd/d11/d15/f86 x:0 0 0 2024-09-18T21:12:52.541 INFO:tasks.workunit.client.1.smithi103.stdout:2/450: dwrite d3/f20 [0,4194304] 0 2024-09-18T21:12:52.541 INFO:tasks.workunit.client.1.smithi103.stdout:2/451: stat d3/d5/d2f/d5b/la2 0 2024-09-18T21:12:52.542 INFO:tasks.workunit.client.0.smithi077.stdout:2/567: rename d1/d4/d9/d80/d95/c9f to d1/d4/d5/d1a/cbb 0 2024-09-18T21:12:52.542 INFO:tasks.workunit.client.1.smithi103.stdout:0/488: mkdir d1/d5/de/d19/da5 0 2024-09-18T21:12:52.543 INFO:tasks.workunit.client.1.smithi103.stdout:5/545: mkdir de/d1f/d3b/d51/db0 0 2024-09-18T21:12:52.551 INFO:tasks.workunit.client.1.smithi103.stdout:2/452: mknod d3/d5/d25/d40/ca8 0 2024-09-18T21:12:52.554 INFO:tasks.workunit.client.0.smithi077.stdout:2/568: creat d1/d62/fbc x:0 0 0 2024-09-18T21:12:52.555 INFO:tasks.workunit.client.1.smithi103.stdout:0/489: dwrite d1/d9/d3e/d6e/f97 [0,4194304] 0 2024-09-18T21:12:52.555 INFO:tasks.workunit.client.0.smithi077.stdout:8/427: mknod d2/d5/d6/d22/d4f/d5a/d5e/c98 0 2024-09-18T21:12:52.557 INFO:tasks.workunit.client.1.smithi103.stdout:6/492: dwrite d2/d3/f74 [0,4194304] 0 2024-09-18T21:12:52.557 INFO:tasks.workunit.client.0.smithi077.stdout:3/483: write db/d14/f34 [2919027,59817] 0 2024-09-18T21:12:52.558 INFO:tasks.workunit.client.0.smithi077.stdout:9/421: dwrite d1/dd/d11/d1c/f31 [0,4194304] 0 2024-09-18T21:12:52.558 INFO:tasks.workunit.client.1.smithi103.stdout:5/546: fdatasync de/d3e/f19 0 2024-09-18T21:12:52.559 INFO:tasks.workunit.client.0.smithi077.stdout:0/568: getdents d8/d1a/d39/d3b/d70 0 2024-09-18T21:12:52.559 INFO:tasks.workunit.client.1.smithi103.stdout:8/612: getdents d4/de/d4a/d59 0 2024-09-18T21:12:52.560 INFO:tasks.workunit.client.1.smithi103.stdout:5/547: chown de/d1f/d3b/d3c/d62/f76 210707108 1 2024-09-18T21:12:52.561 INFO:tasks.workunit.client.1.smithi103.stdout:9/525: link d18/f3c d18/d29/d68/d92/d9c/fad 0 2024-09-18T21:12:52.562 INFO:tasks.workunit.client.0.smithi077.stdout:8/428: read d2/d5/d6/f2c [1141358,18831] 0 2024-09-18T21:12:52.563 INFO:tasks.workunit.client.0.smithi077.stdout:2/569: creat d1/d4/fbd x:0 0 0 2024-09-18T21:12:52.567 INFO:tasks.workunit.client.0.smithi077.stdout:0/569: mknod d8/d1d/d57/caf 0 2024-09-18T21:12:52.568 INFO:tasks.workunit.client.1.smithi103.stdout:5/548: read de/d2d/f88 [137586,89556] 0 2024-09-18T21:12:52.572 INFO:tasks.workunit.client.1.smithi103.stdout:7/460: rmdir d1/df/d43/d63/d67/d5b/d86 0 2024-09-18T21:12:52.573 INFO:tasks.workunit.client.0.smithi077.stdout:4/430: dread d3/d7/f4f [0,4194304] 0 2024-09-18T21:12:52.575 INFO:tasks.workunit.client.1.smithi103.stdout:5/549: dwrite de/d1f/f24 [0,4194304] 0 2024-09-18T21:12:52.577 INFO:tasks.workunit.client.1.smithi103.stdout:3/500: dread d1/d2/d18/f29 [0,4194304] 0 2024-09-18T21:12:52.579 INFO:tasks.workunit.client.0.smithi077.stdout:8/429: link d2/d27/d29/d41/c6d d2/d27/d29/d72/c99 0 2024-09-18T21:12:52.579 INFO:tasks.workunit.client.0.smithi077.stdout:2/570: dwrite d1/d4/d9/fa0 [0,4194304] 0 2024-09-18T21:12:52.585 INFO:tasks.workunit.client.1.smithi103.stdout:6/493: dwrite d2/d24/d5a/f17 [4194304,4194304] 0 2024-09-18T21:12:52.585 INFO:tasks.workunit.client.0.smithi077.stdout:0/570: dwrite d8/d1a/f7c [0,4194304] 0 2024-09-18T21:12:52.588 INFO:tasks.workunit.client.0.smithi077.stdout:0/571: truncate d8/fa7 323202 0 2024-09-18T21:12:52.591 INFO:tasks.workunit.client.0.smithi077.stdout:8/430: write d2/d5/d6/f2c [3533280,105397] 0 2024-09-18T21:12:52.592 INFO:tasks.workunit.client.0.smithi077.stdout:4/431: dwrite d3/dc/d20/f40 [0,4194304] 0 2024-09-18T21:12:52.595 INFO:tasks.workunit.client.0.smithi077.stdout:2/571: truncate d1/d4/f5f 4243013 0 2024-09-18T21:12:52.595 INFO:tasks.workunit.client.1.smithi103.stdout:3/501: read d1/f3c [2540367,20546] 0 2024-09-18T21:12:52.595 INFO:tasks.workunit.client.1.smithi103.stdout:1/490: sync 2024-09-18T21:12:52.598 INFO:tasks.workunit.client.1.smithi103.stdout:4/511: rename d9/d2e/d61/d91/d9e/d48/c70 to d9/d38/d72/cad 0 2024-09-18T21:12:52.602 INFO:tasks.workunit.client.1.smithi103.stdout:7/461: truncate d1/df/d42/d1f/d2e/f37 1218818 0 2024-09-18T21:12:52.602 INFO:tasks.workunit.client.1.smithi103.stdout:0/490: fsync d1/d9/d3e/d6e/f97 0 2024-09-18T21:12:52.602 INFO:tasks.workunit.client.1.smithi103.stdout:7/462: chown d1/df/d42/d1f 4299 1 2024-09-18T21:12:52.604 INFO:tasks.workunit.client.0.smithi077.stdout:4/432: fsync d3/f2b 0 2024-09-18T21:12:52.605 INFO:tasks.workunit.client.0.smithi077.stdout:6/470: truncate d7/d7e/d11/d25/f5b 565641 0 2024-09-18T21:12:52.607 INFO:tasks.workunit.client.0.smithi077.stdout:2/572: creat d1/d4/d5/d1a/d2e/d40/d69/fbe x:0 0 0 2024-09-18T21:12:52.608 INFO:tasks.workunit.client.0.smithi077.stdout:2/573: truncate d1/d62/fbc 134081 0 2024-09-18T21:12:52.609 INFO:tasks.workunit.client.0.smithi077.stdout:0/572: symlink d8/d1a/lb0 0 2024-09-18T21:12:52.611 INFO:tasks.workunit.client.1.smithi103.stdout:9/526: rename d18/d52/f85 to d18/d29/d68/d92/d9c/fae 0 2024-09-18T21:12:52.614 INFO:tasks.workunit.client.0.smithi077.stdout:4/433: creat d3/dc/d32/d45/d5e/f84 x:0 0 0 2024-09-18T21:12:52.617 INFO:tasks.workunit.client.1.smithi103.stdout:9/527: dwrite d18/d52/d6f/d8e/f94 [0,4194304] 0 2024-09-18T21:12:52.619 INFO:tasks.workunit.client.1.smithi103.stdout:7/463: mknod d1/df/d42/d1f/d6b/c8a 0 2024-09-18T21:12:52.620 INFO:tasks.workunit.client.1.smithi103.stdout:8/613: getdents d4 0 2024-09-18T21:12:52.620 INFO:tasks.workunit.client.0.smithi077.stdout:6/471: fsync d7/d7e/d11/d1d/f53 0 2024-09-18T21:12:52.624 INFO:tasks.workunit.client.1.smithi103.stdout:1/491: unlink d0/d11/d5f/l58 0 2024-09-18T21:12:52.627 INFO:tasks.workunit.client.0.smithi077.stdout:4/434: dwrite d3/d77/f7a [0,4194304] 0 2024-09-18T21:12:52.628 INFO:tasks.workunit.client.0.smithi077.stdout:8/431: rename d2/d5/d6/d22/d18/c64 to d2/d5/c9a 0 2024-09-18T21:12:52.629 INFO:tasks.workunit.client.0.smithi077.stdout:0/573: chown d8/d37/d95/dab/fa9 6 1 2024-09-18T21:12:52.629 INFO:tasks.workunit.client.1.smithi103.stdout:6/494: rename d2/d24/d5a/d67/d76/d43/d44/c63 to d2/d3/d8/d4c/d7d/c9d 0 2024-09-18T21:12:52.631 INFO:tasks.workunit.client.0.smithi077.stdout:4/435: chown d3/d7/f1a 0 1 2024-09-18T21:12:52.634 INFO:tasks.workunit.client.0.smithi077.stdout:1/497: dwrite d3/d8/d49/d4e/f57 [0,4194304] 0 2024-09-18T21:12:52.635 INFO:tasks.workunit.client.0.smithi077.stdout:4/436: write d3/dc/d20/f27 [2551237,57077] 0 2024-09-18T21:12:52.636 INFO:tasks.workunit.client.0.smithi077.stdout:4/437: chown d3/l6 14 1 2024-09-18T21:12:52.638 INFO:tasks.workunit.client.1.smithi103.stdout:9/528: fdatasync d18/d8d/d2f/f41 0 2024-09-18T21:12:52.639 INFO:tasks.workunit.client.1.smithi103.stdout:9/529: fsync d18/d29/d68/f9a 0 2024-09-18T21:12:52.639 INFO:tasks.workunit.client.1.smithi103.stdout:9/530: fdatasync f12 0 2024-09-18T21:12:52.644 INFO:tasks.workunit.client.1.smithi103.stdout:2/453: write d3/d5/d4a/f53 [377139,30626] 0 2024-09-18T21:12:52.644 INFO:tasks.workunit.client.0.smithi077.stdout:6/472: dread d7/d7e/d11/d3e/f51 [0,4194304] 0 2024-09-18T21:12:52.644 INFO:tasks.workunit.client.0.smithi077.stdout:8/432: fsync d2/d5/d6/d22/d26/f60 0 2024-09-18T21:12:52.646 INFO:tasks.workunit.client.1.smithi103.stdout:0/491: dread d1/d9/d48/f75 [0,4194304] 0 2024-09-18T21:12:52.646 INFO:tasks.workunit.client.0.smithi077.stdout:2/574: dread d1/d4/d5/d1a/d2e/d86/fad [0,4194304] 0 2024-09-18T21:12:52.646 INFO:tasks.workunit.client.1.smithi103.stdout:1/492: symlink d0/d2/d2b/d85/la5 0 2024-09-18T21:12:52.650 INFO:tasks.workunit.client.1.smithi103.stdout:6/495: mkdir d2/d3/d8/d4c/d79/d9e 0 2024-09-18T21:12:52.651 INFO:tasks.workunit.client.0.smithi077.stdout:9/422: dwrite d1/dd/d11/d1c/f25 [0,4194304] 0 2024-09-18T21:12:52.651 INFO:tasks.workunit.client.0.smithi077.stdout:4/438: rename d3/dc/d24/l5a to d3/d7/d7b/l85 0 2024-09-18T21:12:52.654 INFO:tasks.workunit.client.1.smithi103.stdout:5/550: dwrite de/ff [0,4194304] 0 2024-09-18T21:12:52.655 INFO:tasks.workunit.client.0.smithi077.stdout:0/574: symlink d8/d1a/d35/lb1 0 2024-09-18T21:12:52.655 INFO:tasks.workunit.client.0.smithi077.stdout:0/575: readlink d8/d1d/d57/l92 0 2024-09-18T21:12:52.657 INFO:tasks.workunit.client.1.smithi103.stdout:6/496: dwrite d2/d3/d7f/f85 [0,4194304] 0 2024-09-18T21:12:52.665 INFO:tasks.workunit.client.0.smithi077.stdout:8/433: unlink d2/d5/l94 0 2024-09-18T21:12:52.668 INFO:tasks.workunit.client.0.smithi077.stdout:2/575: truncate d1/d4/f76 715998 0 2024-09-18T21:12:52.674 INFO:tasks.workunit.client.1.smithi103.stdout:4/512: dwrite d9/d1c/d69/f71 [0,4194304] 0 2024-09-18T21:12:52.674 INFO:tasks.workunit.client.1.smithi103.stdout:4/513: chown d9/d1c/f42 1 1 2024-09-18T21:12:52.675 INFO:tasks.workunit.client.1.smithi103.stdout:4/514: stat d9/d38/d58/f92 0 2024-09-18T21:12:52.675 INFO:tasks.workunit.client.1.smithi103.stdout:4/515: dread - d9/d1c/f68 zero size 2024-09-18T21:12:52.675 INFO:tasks.workunit.client.1.smithi103.stdout:0/492: fdatasync d1/f4 0 2024-09-18T21:12:52.675 INFO:tasks.workunit.client.1.smithi103.stdout:1/493: rmdir d0/d2/d9/d9e 39 2024-09-18T21:12:52.679 INFO:tasks.workunit.client.1.smithi103.stdout:5/551: mknod de/d14/d7e/cb1 0 2024-09-18T21:12:52.680 INFO:tasks.workunit.client.0.smithi077.stdout:4/439: rename d3/dc/d32/c36 to d3/dc/d32/d5b/c86 0 2024-09-18T21:12:52.682 INFO:tasks.workunit.client.1.smithi103.stdout:6/497: unlink d2/d24/d5a/c2c 0 2024-09-18T21:12:52.682 INFO:tasks.workunit.client.1.smithi103.stdout:6/498: write d2/d24/d38/f8f [950705,90576] 0 2024-09-18T21:12:52.683 INFO:tasks.workunit.client.1.smithi103.stdout:6/499: fsync d2/d24/d5a/f17 0 2024-09-18T21:12:52.684 INFO:tasks.workunit.client.1.smithi103.stdout:6/500: fsync d2/f34 0 2024-09-18T21:12:52.685 INFO:tasks.workunit.client.0.smithi077.stdout:8/434: creat d2/d5f/f9b x:0 0 0 2024-09-18T21:12:52.689 INFO:tasks.workunit.client.1.smithi103.stdout:6/501: dread d2/d3/d8/f75 [0,4194304] 0 2024-09-18T21:12:52.691 INFO:tasks.workunit.client.0.smithi077.stdout:6/473: write d7/d7e/d11/d1d/d5c/f6f [848502,98802] 0 2024-09-18T21:12:52.691 INFO:tasks.workunit.client.0.smithi077.stdout:4/440: truncate d3/d7/f4f 1470350 0 2024-09-18T21:12:52.693 INFO:tasks.workunit.client.1.smithi103.stdout:8/614: rename d4/d2d/d4e/d73/d93 to d4/d2d/dc1 0 2024-09-18T21:12:52.700 INFO:tasks.workunit.client.0.smithi077.stdout:4/441: dwrite d3/dc/f60 [0,4194304] 0 2024-09-18T21:12:52.700 INFO:tasks.workunit.client.1.smithi103.stdout:4/516: dwrite d9/d1a/d21/d80/f9d [0,4194304] 0 2024-09-18T21:12:52.700 INFO:tasks.workunit.client.0.smithi077.stdout:6/474: dwrite d7/d7e/d11/d1d/d50/f5f [0,4194304] 0 2024-09-18T21:12:52.703 INFO:tasks.workunit.client.0.smithi077.stdout:1/498: truncate d3/d8/f17 2818371 0 2024-09-18T21:12:52.705 INFO:tasks.workunit.client.0.smithi077.stdout:6/475: write d7/d7e/f28 [2673407,54936] 0 2024-09-18T21:12:52.706 INFO:tasks.workunit.client.1.smithi103.stdout:2/454: creat d3/d5/fa9 x:0 0 0 2024-09-18T21:12:52.707 INFO:tasks.workunit.client.1.smithi103.stdout:2/455: fdatasync d3/d5/fe 0 2024-09-18T21:12:52.711 INFO:tasks.workunit.client.0.smithi077.stdout:8/435: dwrite d2/d5/d6/d22/f1b [0,4194304] 0 2024-09-18T21:12:52.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:52 smithi077 ceph-mon[27689]: pgmap v17: 65 pgs: 65 active+clean; 1.9 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 61 MiB/s rd, 258 MiB/s wr, 441 op/s 2024-09-18T21:12:52.713 INFO:tasks.workunit.client.1.smithi103.stdout:7/464: getdents d1/df/d43/d63 0 2024-09-18T21:12:52.719 INFO:tasks.workunit.client.0.smithi077.stdout:9/423: truncate d1/dd/d11/d1c/d38/d46/f60 2406153 0 2024-09-18T21:12:52.719 INFO:tasks.workunit.client.0.smithi077.stdout:2/576: dwrite d1/f1c [0,4194304] 0 2024-09-18T21:12:52.724 INFO:tasks.workunit.client.1.smithi103.stdout:0/493: rename d1/d5/de/d19/d1e/d34/f74 to d1/d5/de/d19/fa6 0 2024-09-18T21:12:52.726 INFO:tasks.workunit.client.0.smithi077.stdout:1/499: mknod d3/d6a/d9b/d68/d3e/cb8 0 2024-09-18T21:12:52.728 INFO:tasks.workunit.client.1.smithi103.stdout:8/615: write d4/d26/d56/d77/d9f/fa6 [4504057,117250] 0 2024-09-18T21:12:52.729 INFO:tasks.workunit.client.0.smithi077.stdout:0/576: rename d8/d1a/c43 to d8/d1a/d39/d3b/cb2 0 2024-09-18T21:12:52.730 INFO:tasks.workunit.client.1.smithi103.stdout:1/494: mknod d0/d2/d9/ca6 0 2024-09-18T21:12:52.731 INFO:tasks.workunit.client.0.smithi077.stdout:8/436: creat d2/d27/d29/f9c x:0 0 0 2024-09-18T21:12:52.732 INFO:tasks.workunit.client.1.smithi103.stdout:1/495: write d0/d2/d9/d10/d5d/d6f/f8b [384510,19381] 0 2024-09-18T21:12:52.732 INFO:tasks.workunit.client.0.smithi077.stdout:6/476: fdatasync d7/d7e/f28 0 2024-09-18T21:12:52.735 INFO:tasks.workunit.client.0.smithi077.stdout:6/477: truncate d7/d7e/d11/d3e/d42/f8b 973239 0 2024-09-18T21:12:52.737 INFO:tasks.workunit.client.1.smithi103.stdout:5/552: mknod de/d14/cb2 0 2024-09-18T21:12:52.737 INFO:tasks.workunit.client.1.smithi103.stdout:5/553: chown de/d14/d9c 3604 1 2024-09-18T21:12:52.738 INFO:tasks.workunit.client.1.smithi103.stdout:9/531: link d18/d8d/d2f/l51 d18/d8d/laf 0 2024-09-18T21:12:52.739 INFO:tasks.workunit.client.0.smithi077.stdout:4/442: dread d3/d7/f1a [0,4194304] 0 2024-09-18T21:12:52.740 INFO:tasks.workunit.client.0.smithi077.stdout:2/577: unlink d1/d4/d5/d1a/l3e 0 2024-09-18T21:12:52.741 INFO:tasks.workunit.client.1.smithi103.stdout:6/502: write d2/d24/d5a/d67/d76/d43/f45 [725108,97393] 0 2024-09-18T21:12:52.742 INFO:tasks.workunit.client.1.smithi103.stdout:6/503: dread - d2/d3/d8/d4c/f8b zero size 2024-09-18T21:12:52.743 INFO:tasks.workunit.client.0.smithi077.stdout:0/577: mknod d8/d37/d66/cb3 0 2024-09-18T21:12:52.744 INFO:tasks.workunit.client.0.smithi077.stdout:6/478: dwrite d7/d7e/d11/d3e/d42/f8b [0,4194304] 0 2024-09-18T21:12:52.744 INFO:tasks.workunit.client.0.smithi077.stdout:1/500: write d3/d8/d13/d18/d99/fb5 [1227868,48721] 0 2024-09-18T21:12:52.745 INFO:tasks.workunit.client.1.smithi103.stdout:9/532: dwrite d18/d52/d6f/d8e/f94 [0,4194304] 0 2024-09-18T21:12:52.746 INFO:tasks.workunit.client.0.smithi077.stdout:8/437: creat d2/d27/d29/d72/f9d x:0 0 0 2024-09-18T21:12:52.747 INFO:tasks.workunit.client.1.smithi103.stdout:7/465: symlink d1/l8b 0 2024-09-18T21:12:52.751 INFO:tasks.workunit.client.1.smithi103.stdout:0/494: rename d1/d5/de/d22/d42 to d1/d9/d3e/d6e/d96/d9f/d8d/da7 0 2024-09-18T21:12:52.753 INFO:tasks.workunit.client.0.smithi077.stdout:9/424: dread d1/d54/f21 [0,4194304] 0 2024-09-18T21:12:52.753 INFO:tasks.workunit.client.0.smithi077.stdout:1/501: dread - d3/d6a/d9b/d4c/f5c zero size 2024-09-18T21:12:52.758 INFO:tasks.workunit.client.0.smithi077.stdout:2/578: dwrite d1/d4/d5/d1a/d2e/f97 [0,4194304] 0 2024-09-18T21:12:52.760 INFO:tasks.workunit.client.1.smithi103.stdout:1/496: mkdir d0/d2/d2b/d85/da7 0 2024-09-18T21:12:52.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:52 smithi103 ceph-mon[34827]: pgmap v17: 65 pgs: 65 active+clean; 1.9 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 61 MiB/s rd, 258 MiB/s wr, 441 op/s 2024-09-18T21:12:52.765 INFO:tasks.workunit.client.0.smithi077.stdout:2/579: chown d1/d4/d9/d4f 2281499 1 2024-09-18T21:12:52.767 INFO:tasks.workunit.client.1.smithi103.stdout:4/517: mknod d9/d1a/d41/d64/da9/cae 0 2024-09-18T21:12:52.769 INFO:tasks.workunit.client.0.smithi077.stdout:1/502: dwrite d3/d6a/d9b/f3b [0,4194304] 0 2024-09-18T21:12:52.770 INFO:tasks.workunit.client.1.smithi103.stdout:6/504: mknod d2/d24/d38/c9f 0 2024-09-18T21:12:52.775 INFO:tasks.workunit.client.0.smithi077.stdout:9/425: creat d1/dd/d11/d1c/d38/d46/d55/f87 x:0 0 0 2024-09-18T21:12:52.777 INFO:tasks.workunit.client.0.smithi077.stdout:9/426: write d1/dd/f5d [4707863,59024] 0 2024-09-18T21:12:52.779 INFO:tasks.workunit.client.1.smithi103.stdout:3/502: sync 2024-09-18T21:12:52.780 INFO:tasks.workunit.client.1.smithi103.stdout:7/466: mknod d1/df/d43/d52/c8c 0 2024-09-18T21:12:52.781 INFO:tasks.workunit.client.0.smithi077.stdout:0/578: write d8/d1a/f42 [765087,80756] 0 2024-09-18T21:12:52.781 INFO:tasks.workunit.client.1.smithi103.stdout:7/467: dread - d1/df/d43/d63/d67/d5b/f7e zero size 2024-09-18T21:12:52.785 INFO:tasks.workunit.client.1.smithi103.stdout:0/495: rename d1/d9/d3e/d6e/d96 to d1/d5/de/d19/d1e/d34/da8 0 2024-09-18T21:12:52.787 INFO:tasks.workunit.client.0.smithi077.stdout:2/580: creat d1/d4/d9/d80/d83/fbf x:0 0 0 2024-09-18T21:12:52.789 INFO:tasks.workunit.client.0.smithi077.stdout:6/479: link d7/c33 d7/d7e/d11/d9a/ca1 0 2024-09-18T21:12:52.791 INFO:tasks.workunit.client.0.smithi077.stdout:1/503: symlink d3/d8/d13/d18/d99/lb9 0 2024-09-18T21:12:52.793 INFO:tasks.workunit.client.1.smithi103.stdout:5/554: fsync de/d3e/f43 0 2024-09-18T21:12:52.795 INFO:tasks.workunit.client.1.smithi103.stdout:4/518: symlink d9/d1a/d41/laf 0 2024-09-18T21:12:52.795 INFO:tasks.workunit.client.0.smithi077.stdout:8/438: creat d2/d5/d6/d22/d4f/d5a/d5e/f9e x:0 0 0 2024-09-18T21:12:52.797 INFO:tasks.workunit.client.0.smithi077.stdout:8/439: write d2/d36/f78 [759235,94761] 0 2024-09-18T21:12:52.797 INFO:tasks.workunit.client.1.smithi103.stdout:6/505: creat d2/d24/d5a/d67/fa0 x:0 0 0 2024-09-18T21:12:52.797 INFO:tasks.workunit.client.1.smithi103.stdout:6/506: write d2/d24/d38/f89 [566987,43180] 0 2024-09-18T21:12:52.798 INFO:tasks.workunit.client.0.smithi077.stdout:9/427: mknod d1/dd/d11/d1c/d38/d46/c88 0 2024-09-18T21:12:52.798 INFO:tasks.workunit.client.1.smithi103.stdout:6/507: stat d2/d3/d8/d4c/d7d/d9b 0 2024-09-18T21:12:52.800 INFO:tasks.workunit.client.1.smithi103.stdout:2/456: mknod d3/d5/d2f/d32/d90/caa 0 2024-09-18T21:12:52.801 INFO:tasks.workunit.client.1.smithi103.stdout:2/457: dread - d3/d5/d2c/f66 zero size 2024-09-18T21:12:52.803 INFO:tasks.workunit.client.0.smithi077.stdout:0/579: mkdir d8/d37/d66/db4 0 2024-09-18T21:12:52.805 INFO:tasks.workunit.client.0.smithi077.stdout:2/581: rename d1/d4/d9/d80/d8e/d66 to d1/d4/d5/d1a/d2e/d86/dc0 0 2024-09-18T21:12:52.805 INFO:tasks.workunit.client.1.smithi103.stdout:6/508: dwrite d2/d3/d8/f93 [0,4194304] 0 2024-09-18T21:12:52.806 INFO:tasks.workunit.client.1.smithi103.stdout:1/497: dread d0/d2/fb [0,4194304] 0 2024-09-18T21:12:52.806 INFO:tasks.workunit.client.1.smithi103.stdout:7/468: fdatasync d1/df/d42/f45 0 2024-09-18T21:12:52.807 INFO:tasks.workunit.client.0.smithi077.stdout:6/480: fdatasync d7/d7e/d11/d3e/f7f 0 2024-09-18T21:12:52.807 INFO:tasks.workunit.client.0.smithi077.stdout:0/580: dread d8/d1d/d57/f65 [0,4194304] 0 2024-09-18T21:12:52.809 INFO:tasks.workunit.client.1.smithi103.stdout:6/509: dread d2/d3/d8/d4c/d4e/f9a [0,4194304] 0 2024-09-18T21:12:52.810 INFO:tasks.workunit.client.0.smithi077.stdout:1/504: symlink d3/d8/d13/d18/d99/lba 0 2024-09-18T21:12:52.810 INFO:tasks.workunit.client.1.smithi103.stdout:6/510: write d2/f34 [277575,69298] 0 2024-09-18T21:12:52.810 INFO:tasks.workunit.client.0.smithi077.stdout:1/505: fdatasync d3/d8/d49/f65 0 2024-09-18T21:12:52.811 INFO:tasks.workunit.client.1.smithi103.stdout:8/616: creat d4/d26/d56/fc2 x:0 0 0 2024-09-18T21:12:52.817 INFO:tasks.workunit.client.1.smithi103.stdout:5/555: creat de/d1f/d3b/d51/d57/d59/fb3 x:0 0 0 2024-09-18T21:12:52.819 INFO:tasks.workunit.client.1.smithi103.stdout:5/556: write de/d14/d33/d4f/fa2 [872514,11650] 0 2024-09-18T21:12:52.820 INFO:tasks.workunit.client.1.smithi103.stdout:5/557: write de/d14/d33/d4f/f68 [3777197,44805] 0 2024-09-18T21:12:52.821 INFO:tasks.workunit.client.1.smithi103.stdout:4/519: mknod d9/d1a/d41/d64/cb0 0 2024-09-18T21:12:52.822 INFO:tasks.workunit.client.0.smithi077.stdout:2/582: chown d1/d4/d9/d4f/ca1 1 1 2024-09-18T21:12:52.823 INFO:tasks.workunit.client.1.smithi103.stdout:2/458: rmdir d3/d5/d2c 39 2024-09-18T21:12:52.824 INFO:tasks.workunit.client.1.smithi103.stdout:9/533: write fc [2112021,84347] 0 2024-09-18T21:12:52.827 INFO:tasks.workunit.client.1.smithi103.stdout:3/503: symlink d1/d23/d25/d4f/d58/d68/d50/d54/d8c/l9e 0 2024-09-18T21:12:52.829 INFO:tasks.workunit.client.0.smithi077.stdout:1/506: mkdir d3/d8/d75/d89/dbb 0 2024-09-18T21:12:52.832 INFO:tasks.workunit.client.0.smithi077.stdout:8/440: mkdir d2/d5/d6/d9f 0 2024-09-18T21:12:52.832 INFO:tasks.workunit.client.1.smithi103.stdout:7/469: mknod d1/df/d42/d29/c8d 0 2024-09-18T21:12:52.835 INFO:tasks.workunit.client.0.smithi077.stdout:0/581: symlink d8/d1a/d35/lb5 0 2024-09-18T21:12:52.836 INFO:tasks.workunit.client.1.smithi103.stdout:8/617: mknod d4/d2d/d4e/d73/cc3 0 2024-09-18T21:12:52.837 INFO:tasks.workunit.client.1.smithi103.stdout:8/618: chown d4/de/d4a/d59/lb6 3 1 2024-09-18T21:12:52.838 INFO:tasks.workunit.client.0.smithi077.stdout:9/428: creat d1/dd/d1a/d42/f89 x:0 0 0 2024-09-18T21:12:52.839 INFO:tasks.workunit.client.0.smithi077.stdout:1/507: dread d3/d6a/d9b/f31 [0,4194304] 0 2024-09-18T21:12:52.840 INFO:tasks.workunit.client.1.smithi103.stdout:5/558: fsync de/d14/d33/f53 0 2024-09-18T21:12:52.842 INFO:tasks.workunit.client.1.smithi103.stdout:4/520: mkdir d9/d1c/db1 0 2024-09-18T21:12:52.843 INFO:tasks.workunit.client.0.smithi077.stdout:6/481: creat d7/d7e/d11/fa2 x:0 0 0 2024-09-18T21:12:52.843 INFO:tasks.workunit.client.0.smithi077.stdout:2/583: write d1/d4/d5/d1a/d2e/d41/d2c/f35 [4434843,95290] 0 2024-09-18T21:12:52.844 INFO:tasks.workunit.client.1.smithi103.stdout:2/459: mkdir d3/d5/d2f/d48/dab 0 2024-09-18T21:12:52.845 INFO:tasks.workunit.client.0.smithi077.stdout:6/482: chown d7/d7e/d11/f56 1 1 2024-09-18T21:12:52.845 INFO:tasks.workunit.client.0.smithi077.stdout:0/582: creat d8/d1a/d39/d56/fb6 x:0 0 0 2024-09-18T21:12:52.846 INFO:tasks.workunit.client.1.smithi103.stdout:9/534: fdatasync d18/d29/f2a 0 2024-09-18T21:12:52.847 INFO:tasks.workunit.client.0.smithi077.stdout:1/508: dwrite d3/d8/d49/f65 [0,4194304] 0 2024-09-18T21:12:52.849 INFO:tasks.workunit.client.1.smithi103.stdout:1/498: mkdir d0/d2/da8 0 2024-09-18T21:12:52.850 INFO:tasks.workunit.client.0.smithi077.stdout:0/583: read d8/d26/f18 [57416,53133] 0 2024-09-18T21:12:52.854 INFO:tasks.workunit.client.1.smithi103.stdout:7/470: chown d1/df/l47 7527 1 2024-09-18T21:12:52.855 INFO:tasks.workunit.client.0.smithi077.stdout:1/509: rename d3/d8/d13/d77/cad to d3/d8/d49/d4e/cbc 0 2024-09-18T21:12:52.855 INFO:tasks.workunit.client.1.smithi103.stdout:7/471: stat d1/df/d42/d1f/d2e/c7a 0 2024-09-18T21:12:52.857 INFO:tasks.workunit.client.1.smithi103.stdout:0/496: rmdir d1/d5/de/d19/da5 0 2024-09-18T21:12:52.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.855+0000 7f8e4fefe640 1 -- 172.21.15.77:0/3497197947 --> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8e48108b30 con 0x7f8e3406e570 2024-09-18T21:12:52.857 INFO:tasks.workunit.client.0.smithi077.stdout:8/441: link d2/d5/d6/d22/d20/d3e/c62 d2/d5f/d7a/ca0 0 2024-09-18T21:12:52.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.857+0000 7f8e3e7fc640 1 -- 172.21.15.77:0/3497197947 <== mgr.14578 v2:172.21.15.103:6828/1199124716 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f8e48108b30 con 0x7f8e3406e570 2024-09-18T21:12:52.859 INFO:tasks.workunit.client.1.smithi103.stdout:0/497: truncate d1/d5/de/d24/d43/d76/f9c 956780 0 2024-09-18T21:12:52.859 INFO:tasks.workunit.client.1.smithi103.stdout:6/511: mkdir d2/d3/d8/da1 0 2024-09-18T21:12:52.860 INFO:tasks.workunit.client.0.smithi077.stdout:9/429: link d1/dd/d11/f83 d1/dd/d11/d1c/d38/d46/f8a 0 2024-09-18T21:12:52.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.859+0000 7f8e4fefe640 1 -- 172.21.15.77:0/3497197947 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f8e3406e570 msgr2=0x7f8e34070a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:52.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.859+0000 7f8e4fefe640 1 --2- 172.21.15.77:0/3497197947 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f8e3406e570 0x7f8e34070a20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8e44000c00 tx=0x7f8e44035040 comp rx=0 tx=0).stop 2024-09-18T21:12:52.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.859+0000 7f8e4fefe640 1 -- 172.21.15.77:0/3497197947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e48105320 msgr2=0x7f8e48118970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:52.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.859+0000 7f8e4fefe640 1 --2- 172.21.15.77:0/3497197947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e48105320 0x7f8e48118970 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8e3800b560 tx=0x7f8e380090f0 comp rx=0 tx=0).stop 2024-09-18T21:12:52.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.859+0000 7f8e4fefe640 1 -- 172.21.15.77:0/3497197947 shutdown_connections 2024-09-18T21:12:52.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.860+0000 7f8e4fefe640 1 --2- 172.21.15.77:0/3497197947 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f8e3406e570 0x7f8e34070a20 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:52.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.860+0000 7f8e4fefe640 1 --2- 172.21.15.77:0/3497197947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e48105320 0x7f8e48118970 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:52.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.860+0000 7f8e4fefe640 1 --2- 172.21.15.77:0/3497197947 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e48104940 0x7f8e48116420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:52.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.860+0000 7f8e4fefe640 1 -- 172.21.15.77:0/3497197947 >> 172.21.15.77:0/3497197947 conn(0x7f8e48069b00 msgr2=0x7f8e4806c2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:12:52.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.860+0000 7f8e4fefe640 1 -- 172.21.15.77:0/3497197947 shutdown_connections 2024-09-18T21:12:52.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.860+0000 7f8e4fefe640 1 -- 172.21.15.77:0/3497197947 wait complete. 2024-09-18T21:12:52.863 INFO:tasks.workunit.client.1.smithi103.stdout:8/619: creat d4/d81/d71/fc4 x:0 0 0 2024-09-18T21:12:52.863 INFO:tasks.workunit.client.0.smithi077.stdout:9/430: read d1/f48 [2401474,71439] 0 2024-09-18T21:12:52.863 INFO:tasks.workunit.client.0.smithi077.stdout:9/431: chown d1/d54/f1e 2 1 2024-09-18T21:12:52.864 INFO:tasks.workunit.client.0.smithi077.stdout:0/584: rename d8/d37/f50 to d8/d1a/d39/d3b/d9a/fb7 0 2024-09-18T21:12:52.864 INFO:tasks.workunit.client.1.smithi103.stdout:9/535: dread d18/d52/d6f/f81 [0,4194304] 0 2024-09-18T21:12:52.864 INFO:tasks.workunit.client.0.smithi077.stdout:9/432: read d1/dd/d11/d1c/f25 [2055874,82781] 0 2024-09-18T21:12:52.865 INFO:tasks.workunit.client.0.smithi077.stdout:1/510: mkdir d3/d8/d49/d4e/dbd 0 2024-09-18T21:12:52.866 INFO:tasks.workunit.client.1.smithi103.stdout:4/521: mknod d9/d2e/d61/cb2 0 2024-09-18T21:12:52.867 INFO:tasks.workunit.client.1.smithi103.stdout:2/460: fsync d3/d5/d2c/d77/fa3 0 2024-09-18T21:12:52.869 INFO:tasks.workunit.client.1.smithi103.stdout:3/504: symlink d1/d23/d25/d4f/l9f 0 2024-09-18T21:12:52.873 INFO:tasks.workunit.client.0.smithi077.stdout:2/584: dread d1/d4/d5/f7 [0,4194304] 0 2024-09-18T21:12:52.875 INFO:tasks.workunit.client.1.smithi103.stdout:0/498: rename d1/d5/de/d19/d1e/f5f to d1/d5/de/d22/d6a/fa9 0 2024-09-18T21:12:52.875 INFO:tasks.workunit.client.1.smithi103.stdout:0/499: stat d1/d9 0 2024-09-18T21:12:52.875 INFO:tasks.workunit.client.1.smithi103.stdout:0/500: read d1/f29 [3383348,96488] 0 2024-09-18T21:12:52.877 INFO:tasks.workunit.client.1.smithi103.stdout:8/620: symlink d4/d81/d71/lc5 0 2024-09-18T21:12:52.879 INFO:tasks.workunit.client.0.smithi077.stdout:9/433: creat d1/d54/d81/f8b x:0 0 0 2024-09-18T21:12:52.880 INFO:tasks.workunit.client.0.smithi077.stdout:9/434: stat d1/dd/d1a/d42/f5e 0 2024-09-18T21:12:52.881 INFO:tasks.workunit.client.0.smithi077.stdout:9/435: truncate d1/dd/f62 946491 0 2024-09-18T21:12:52.881 INFO:tasks.workunit.client.1.smithi103.stdout:9/536: creat d18/d29/d62/fb0 x:0 0 0 2024-09-18T21:12:52.882 INFO:tasks.workunit.client.1.smithi103.stdout:0/501: dwrite d1/d5/de/d24/f32 [0,4194304] 0 2024-09-18T21:12:52.882 INFO:tasks.workunit.client.0.smithi077.stdout:8/442: creat d2/d5/d6/d22/d20/fa1 x:0 0 0 2024-09-18T21:12:52.883 INFO:tasks.workunit.client.1.smithi103.stdout:9/537: chown d18/d29/c7f 1 1 2024-09-18T21:12:52.883 INFO:tasks.workunit.client.1.smithi103.stdout:8/621: dwrite f2 [0,4194304] 0 2024-09-18T21:12:52.884 INFO:tasks.workunit.client.1.smithi103.stdout:9/538: write d18/d52/f82 [184562,89167] 0 2024-09-18T21:12:52.890 INFO:tasks.workunit.client.0.smithi077.stdout:8/443: dwrite d2/d5/d6/d22/d26/f84 [0,4194304] 0 2024-09-18T21:12:52.892 INFO:tasks.workunit.client.1.smithi103.stdout:4/522: dwrite d9/d1a/d21/d80/f97 [0,4194304] 0 2024-09-18T21:12:52.893 INFO:tasks.workunit.client.0.smithi077.stdout:0/585: rename d8/c10 to d8/d26/cb8 0 2024-09-18T21:12:52.894 INFO:tasks.workunit.client.0.smithi077.stdout:9/436: write d1/dd/d1a/d42/f5e [4709630,48425] 0 2024-09-18T21:12:52.895 INFO:tasks.workunit.client.1.smithi103.stdout:1/499: symlink d0/d2/d2b/d3a/d42/d87/la9 0 2024-09-18T21:12:52.897 INFO:tasks.workunit.client.0.smithi077.stdout:1/511: dwrite d3/ff [0,4194304] 0 2024-09-18T21:12:52.898 INFO:tasks.workunit.client.1.smithi103.stdout:3/505: unlink d1/d23/c40 0 2024-09-18T21:12:52.899 INFO:tasks.workunit.client.1.smithi103.stdout:3/506: fsync d1/d23/d47/f56 0 2024-09-18T21:12:52.904 INFO:tasks.workunit.client.1.smithi103.stdout:7/472: link d1/df/d42/d1f/d5d/f71 d1/f8e 0 2024-09-18T21:12:52.908 INFO:tasks.workunit.client.1.smithi103.stdout:6/512: mkdir d2/d3/d7f/d91/da2 0 2024-09-18T21:12:52.909 INFO:tasks.workunit.client.1.smithi103.stdout:2/461: write d3/d5/d2c/f64 [921363,80086] 0 2024-09-18T21:12:52.910 INFO:tasks.workunit.client.0.smithi077.stdout:0/586: write d8/d26/f34 [370536,112622] 0 2024-09-18T21:12:52.911 INFO:tasks.workunit.client.1.smithi103.stdout:2/462: truncate d3/d5/d2f/d48/fa6 505980 0 2024-09-18T21:12:52.912 INFO:tasks.workunit.client.0.smithi077.stdout:9/437: creat d1/dd/d11/d15/d80/f8c x:0 0 0 2024-09-18T21:12:52.912 INFO:tasks.workunit.client.1.smithi103.stdout:2/463: dread - d3/d5/d2c/d54/f7b zero size 2024-09-18T21:12:52.913 INFO:tasks.workunit.client.1.smithi103.stdout:2/464: chown d3/d5/d2f/d5b/c5d 452537 1 2024-09-18T21:12:52.914 INFO:tasks.workunit.client.1.smithi103.stdout:2/465: truncate d3/d5/d2f/d48/f9b 983911 0 2024-09-18T21:12:52.915 INFO:tasks.workunit.client.0.smithi077.stdout:0/587: chown d8/d37/f6f 1241953 1 2024-09-18T21:12:52.916 INFO:tasks.workunit.client.1.smithi103.stdout:0/502: rmdir d1/d5/de 39 2024-09-18T21:12:52.918 INFO:tasks.workunit.client.1.smithi103.stdout:8/622: creat d4/d2d/d4e/d73/fc6 x:0 0 0 2024-09-18T21:12:52.918 INFO:tasks.workunit.client.0.smithi077.stdout:1/512: dwrite d3/d8/d49/f79 [0,4194304] 0 2024-09-18T21:12:52.921 INFO:tasks.workunit.client.1.smithi103.stdout:4/523: mknod d9/d2e/d61/d91/cb3 0 2024-09-18T21:12:52.921 INFO:tasks.workunit.client.0.smithi077.stdout:8/444: dread d2/d27/d29/f3f [0,4194304] 0 2024-09-18T21:12:52.921 INFO:tasks.workunit.client.0.smithi077.stdout:1/513: write d3/d8/d49/d4e/d50/f30 [4073244,76630] 0 2024-09-18T21:12:52.923 INFO:tasks.workunit.client.1.smithi103.stdout:3/507: mkdir d1/d23/d25/d4f/d58/d68/da0 0 2024-09-18T21:12:52.926 INFO:tasks.workunit.client.1.smithi103.stdout:6/513: dread d2/d3/d8/f75 [0,4194304] 0 2024-09-18T21:12:52.927 INFO:tasks.workunit.client.1.smithi103.stdout:6/514: write d2/d3/f55 [4704010,120891] 0 2024-09-18T21:12:52.928 INFO:tasks.workunit.client.0.smithi077.stdout:1/514: mkdir d3/d6a/d9b/dbe 0 2024-09-18T21:12:52.929 INFO:tasks.workunit.client.1.smithi103.stdout:5/559: getdents de/d1f/d3b 0 2024-09-18T21:12:52.931 INFO:tasks.workunit.client.1.smithi103.stdout:8/623: rename d4/de/f11 to d4/de/d4a/d59/d5e/fc7 0 2024-09-18T21:12:52.931 INFO:tasks.workunit.client.1.smithi103.stdout:7/473: dread d1/df/d42/f4e [0,4194304] 0 2024-09-18T21:12:52.931 INFO:tasks.workunit.client.1.smithi103.stdout:1/500: unlink d0/d3/c27 0 2024-09-18T21:12:52.932 INFO:tasks.workunit.client.1.smithi103.stdout:8/624: chown d4/d81/d71/f7e 35867269 1 2024-09-18T21:12:52.932 INFO:tasks.workunit.client.1.smithi103.stdout:3/508: mkdir d1/d23/d25/da1 0 2024-09-18T21:12:52.932 INFO:tasks.workunit.client.1.smithi103.stdout:7/474: write d1/df/d42/d1f/d5d/f7f [497144,107174] 0 2024-09-18T21:12:52.933 INFO:tasks.workunit.client.1.smithi103.stdout:0/503: mkdir d1/d93/daa 0 2024-09-18T21:12:52.934 INFO:tasks.workunit.client.1.smithi103.stdout:2/466: mknod d3/d5/d25/cac 0 2024-09-18T21:12:52.934 INFO:tasks.workunit.client.1.smithi103.stdout:9/539: link d18/d29/f4d d18/d29/d68/fb1 0 2024-09-18T21:12:52.936 INFO:tasks.workunit.client.1.smithi103.stdout:5/560: mkdir de/d1f/d3b/db4 0 2024-09-18T21:12:52.936 INFO:tasks.workunit.client.1.smithi103.stdout:7/475: chown d1/df/d43/d63/d67/d5b/f70 45488 1 2024-09-18T21:12:52.937 INFO:tasks.workunit.client.1.smithi103.stdout:5/561: dread - de/d14/d33/f9a zero size 2024-09-18T21:12:52.938 INFO:tasks.workunit.client.1.smithi103.stdout:6/515: creat d2/d3/d8/da1/fa3 x:0 0 0 2024-09-18T21:12:52.939 INFO:tasks.workunit.client.1.smithi103.stdout:8/625: fdatasync d4/de/d4a/f66 0 2024-09-18T21:12:52.941 INFO:tasks.workunit.client.1.smithi103.stdout:1/501: creat d0/d3/d68/d81/faa x:0 0 0 2024-09-18T21:12:52.943 INFO:tasks.workunit.client.1.smithi103.stdout:7/476: dwrite d1/df/d43/d63/d67/d5b/f70 [0,4194304] 0 2024-09-18T21:12:52.944 INFO:tasks.workunit.client.0.smithi077.stdout:2/585: dwrite d1/d4/f5f [4194304,4194304] 0 2024-09-18T21:12:52.945 INFO:tasks.workunit.client.1.smithi103.stdout:3/509: rename d1/da/df/d70/c89 to d1/d23/d25/d4f/d58/d86/ca2 0 2024-09-18T21:12:52.946 INFO:tasks.workunit.client.1.smithi103.stdout:9/540: symlink d18/d52/d6f/d8e/d96/lb2 0 2024-09-18T21:12:52.953 INFO:tasks.workunit.client.0.smithi077.stdout:9/438: truncate d1/dd/d11/f3e 5823464 0 2024-09-18T21:12:52.954 INFO:tasks.workunit.client.1.smithi103.stdout:2/467: creat d3/d5/d2f/d48/dab/fad x:0 0 0 2024-09-18T21:12:52.955 INFO:tasks.workunit.client.1.smithi103.stdout:1/502: symlink d0/d2/d9/d10/d8d/lab 0 2024-09-18T21:12:52.957 INFO:tasks.workunit.client.1.smithi103.stdout:7/477: symlink d1/df/d54/l8f 0 2024-09-18T21:12:52.958 INFO:tasks.workunit.client.0.smithi077.stdout:9/439: symlink d1/dd/d11/d15/d80/l8d 0 2024-09-18T21:12:52.959 INFO:tasks.workunit.client.1.smithi103.stdout:3/510: symlink d1/d23/d25/d4f/d72/d85/la3 0 2024-09-18T21:12:52.961 INFO:tasks.workunit.client.1.smithi103.stdout:0/504: symlink d1/d5/de/d24/d43/d81/lab 0 2024-09-18T21:12:52.963 INFO:tasks.workunit.client.0.smithi077.stdout:8/445: write d2/d5/d6/d22/d26/f60 [1936433,46057] 0 2024-09-18T21:12:52.963 INFO:tasks.workunit.client.1.smithi103.stdout:2/468: mkdir d3/d5/d2f/d32/dae 0 2024-09-18T21:12:52.965 INFO:tasks.workunit.client.1.smithi103.stdout:1/503: mkdir d0/d2/d9/dc/d6e/dac 0 2024-09-18T21:12:52.970 INFO:tasks.workunit.client.1.smithi103.stdout:7/478: symlink d1/df/d43/d61/l90 0 2024-09-18T21:12:52.971 INFO:tasks.workunit.client.0.smithi077.stdout:8/446: dwrite d2/d5/d6/d22/d20/f56 [4194304,4194304] 0 2024-09-18T21:12:52.972 INFO:tasks.workunit.client.0.smithi077.stdout:8/447: dread - d2/d5/d6/d22/d4f/f69 zero size 2024-09-18T21:12:52.973 INFO:tasks.workunit.client.1.smithi103.stdout:9/541: unlink d18/d8d/d2f/f31 0 2024-09-18T21:12:52.974 INFO:tasks.workunit.client.0.smithi077.stdout:8/448: fsync d2/d5/d6/d22/d20/f24 0 2024-09-18T21:12:52.974 INFO:tasks.workunit.client.1.smithi103.stdout:8/626: dread d4/de/d4a/d59/d5e/fc7 [0,4194304] 0 2024-09-18T21:12:52.975 INFO:tasks.workunit.client.1.smithi103.stdout:8/627: chown d4/de/d4a/f79 15310214 1 2024-09-18T21:12:52.979 INFO:tasks.workunit.client.1.smithi103.stdout:3/511: dread d1/d2/f3e [0,4194304] 0 2024-09-18T21:12:52.979 INFO:tasks.workunit.client.1.smithi103.stdout:2/469: unlink d3/ff 0 2024-09-18T21:12:52.979 INFO:tasks.workunit.client.0.smithi077.stdout:8/449: dread d2/d5/d6/d22/f1b [0,4194304] 0 2024-09-18T21:12:52.980 INFO:tasks.workunit.client.1.smithi103.stdout:1/504: mknod d0/d3/cad 0 2024-09-18T21:12:52.981 INFO:tasks.workunit.client.0.smithi077.stdout:8/450: write d2/d5f/d6f/f91 [797919,119741] 0 2024-09-18T21:12:52.981 INFO:tasks.workunit.client.1.smithi103.stdout:4/524: truncate d9/d2e/f3f 810651 0 2024-09-18T21:12:52.982 INFO:tasks.workunit.client.1.smithi103.stdout:1/505: write d0/d2/d9/dc/f7e [383991,128620] 0 2024-09-18T21:12:52.985 INFO:tasks.workunit.client.1.smithi103.stdout:6/516: rename d2/d3/d8/da1 to d2/d24/d5a/d67/d76/da4 0 2024-09-18T21:12:52.987 INFO:tasks.workunit.client.0.smithi077.stdout:8/451: creat d2/d5/d6/d22/d26/fa2 x:0 0 0 2024-09-18T21:12:52.988 INFO:tasks.workunit.client.0.smithi077.stdout:8/452: write d2/d27/d29/f9c [255437,101611] 0 2024-09-18T21:12:52.989 INFO:tasks.workunit.client.1.smithi103.stdout:7/479: dread d1/df/d42/d1f/d2e/f41 [0,4194304] 0 2024-09-18T21:12:52.994 INFO:tasks.workunit.client.1.smithi103.stdout:8/628: mknod d4/d26/cc8 0 2024-09-18T21:12:52.994 INFO:tasks.workunit.client.1.smithi103.stdout:1/506: dread d0/d2/d9/d10/d5d/f88 [0,4194304] 0 2024-09-18T21:12:52.996 INFO:tasks.workunit.client.1.smithi103.stdout:2/470: mkdir d3/d5/d2c/d54/daf 0 2024-09-18T21:12:52.997 INFO:tasks.workunit.client.1.smithi103.stdout:4/525: mkdir d9/d38/db4 0 2024-09-18T21:12:52.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.996+0000 7f69c45fb640 1 -- 172.21.15.77:0/2376986553 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69bc0fdb70 msgr2=0x7f69bc0fdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:52.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.996+0000 7f69c45fb640 1 --2- 172.21.15.77:0/2376986553 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69bc0fdb70 0x7f69bc0fdf80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f69b80048d0 tx=0x7f69b8009da0 comp rx=0 tx=0).stop 2024-09-18T21:12:52.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.996+0000 7f69c45fb640 1 -- 172.21.15.77:0/2376986553 shutdown_connections 2024-09-18T21:12:52.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.996+0000 7f69c45fb640 1 --2- 172.21.15.77:0/2376986553 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69bc0fe4c0 0x7f69bc0fa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:52.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.996+0000 7f69c45fb640 1 --2- 172.21.15.77:0/2376986553 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69bc0fdb70 0x7f69bc0fdf80 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:52.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.996+0000 7f69c45fb640 1 -- 172.21.15.77:0/2376986553 >> 172.21.15.77:0/2376986553 conn(0x7f69bc0f6390 msgr2=0x7f69bc0f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:12:52.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.996+0000 7f69c45fb640 1 -- 172.21.15.77:0/2376986553 shutdown_connections 2024-09-18T21:12:52.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.996+0000 7f69c45fb640 1 -- 172.21.15.77:0/2376986553 wait complete. 2024-09-18T21:12:53.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.997+0000 7f69c45fb640 1 Processor -- start 2024-09-18T21:12:53.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.997+0000 7f69c45fb640 1 -- start start 2024-09-18T21:12:53.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.997+0000 7f69c45fb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69bc0fdb70 0x7f69bc10d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:12:53.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.997+0000 7f69c45fb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69bc0fe4c0 0x7f69bc10d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:12:53.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.997+0000 7f69c45fb640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69bc10dc20 con 0x7f69bc0fe4c0 2024-09-18T21:12:53.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.997+0000 7f69c45fb640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69bc10e440 con 0x7f69bc0fdb70 2024-09-18T21:12:53.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.997+0000 7f69c1b96640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69bc0fe4c0 0x7f69bc10d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:12:53.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.997+0000 7f69c1b96640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69bc0fe4c0 0x7f69bc10d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49546/0 (socket says 172.21.15.77:49546) 2024-09-18T21:12:53.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.997+0000 7f69c2397640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69bc0fdb70 0x7f69bc10d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:12:53.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.997+0000 7f69c1b96640 1 -- 172.21.15.77:0/4125676614 learned_addr learned my addr 172.21.15.77:0/4125676614 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:12:53.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.998+0000 7f69c2397640 1 -- 172.21.15.77:0/4125676614 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69bc0fe4c0 msgr2=0x7f69bc10d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:53.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.998+0000 7f69c2397640 1 --2- 172.21.15.77:0/4125676614 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69bc0fe4c0 0x7f69bc10d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:53.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.998+0000 7f69c2397640 1 -- 172.21.15.77:0/4125676614 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b8005040 con 0x7f69bc0fdb70 2024-09-18T21:12:53.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.998+0000 7f69c1b96640 1 --2- 172.21.15.77:0/4125676614 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69bc0fe4c0 0x7f69bc10d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T21:12:53.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.998+0000 7f69c2397640 1 --2- 172.21.15.77:0/4125676614 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69bc0fdb70 0x7f69bc10d090 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f69b80048a0 tx=0x7f69b8009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:12:53.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.998+0000 7f69b2ffd640 1 -- 172.21.15.77:0/4125676614 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69b8038070 con 0x7f69bc0fdb70 2024-09-18T21:12:53.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.998+0000 7f69b2ffd640 1 -- 172.21.15.77:0/4125676614 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f69b8004290 con 0x7f69bc0fdb70 2024-09-18T21:12:53.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.998+0000 7f69b2ffd640 1 -- 172.21.15.77:0/4125676614 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69b802c8b0 con 0x7f69bc0fdb70 2024-09-18T21:12:53.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.998+0000 7f69c45fb640 1 -- 172.21.15.77:0/4125676614 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69bc10e670 con 0x7f69bc0fdb70 2024-09-18T21:12:53.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:52.998+0000 7f69c45fb640 1 -- 172.21.15.77:0/4125676614 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69bc10ec10 con 0x7f69bc0fdb70 2024-09-18T21:12:53.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.000+0000 7f69c45fb640 1 -- 172.21.15.77:0/4125676614 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69bc0fa010 con 0x7f69bc0fdb70 2024-09-18T21:12:53.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.000+0000 7f69b2ffd640 1 -- 172.21.15.77:0/4125676614 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 24) v1 ==== 91488+0+0 (secure 0 0 0) 0x7f69b8030020 con 0x7f69bc0fdb70 2024-09-18T21:12:53.004 INFO:tasks.workunit.client.0.smithi077.stdout:9/440: truncate d1/d54/f3b 1740230 0 2024-09-18T21:12:53.004 INFO:tasks.workunit.client.1.smithi103.stdout:9/542: creat d18/d52/d6f/d8e/d8f/fb3 x:0 0 0 2024-09-18T21:12:53.004 INFO:tasks.workunit.client.1.smithi103.stdout:9/543: dread - d18/d29/f44 zero size 2024-09-18T21:12:53.004 INFO:tasks.workunit.client.1.smithi103.stdout:7/480: creat d1/df/d42/d1f/d2e/d3f/f91 x:0 0 0 2024-09-18T21:12:53.004 INFO:tasks.workunit.client.1.smithi103.stdout:0/505: creat d1/d9/d3e/fac x:0 0 0 2024-09-18T21:12:53.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.001+0000 7f69b2ffd640 1 --2- 172.21.15.77:0/4125676614 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f69a806e4a0 0x7f69a8070950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:12:53.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.001+0000 7f69b2ffd640 1 -- 172.21.15.77:0/4125676614 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f69b80adb30 con 0x7f69bc0fdb70 2024-09-18T21:12:53.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.001+0000 7f69c1b96640 1 --2- 172.21.15.77:0/4125676614 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f69a806e4a0 0x7f69a8070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:12:53.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.002+0000 7f69c1b96640 1 --2- 172.21.15.77:0/4125676614 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f69a806e4a0 0x7f69a8070950 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f69bc10ce40 tx=0x7f69ac00b040 comp rx=0 tx=0).ready entity=mgr.14578 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:12:53.006 INFO:tasks.workunit.client.1.smithi103.stdout:0/506: fdatasync d1/d56/f72 0 2024-09-18T21:12:53.006 INFO:tasks.workunit.client.1.smithi103.stdout:5/562: mkdir de/d1f/d3b/d51/d57/db5 0 2024-09-18T21:12:53.007 INFO:tasks.workunit.client.0.smithi077.stdout:9/441: rename d1/dd/d1a/f7e to d1/dd/d11/d2d/f8e 0 2024-09-18T21:12:53.007 INFO:tasks.workunit.client.1.smithi103.stdout:3/512: dread d1/d23/d47/f56 [4194304,4194304] 0 2024-09-18T21:12:53.008 INFO:tasks.workunit.client.1.smithi103.stdout:2/471: truncate d3/f1e 3651724 0 2024-09-18T21:12:53.009 INFO:tasks.workunit.client.1.smithi103.stdout:9/544: dwrite d18/d8d/d2f/f41 [0,4194304] 0 2024-09-18T21:12:53.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.007+0000 7f69b2ffd640 1 -- 172.21.15.77:0/4125676614 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f69b8077880 con 0x7f69bc0fdb70 2024-09-18T21:12:53.014 INFO:tasks.workunit.client.1.smithi103.stdout:6/517: mknod d2/d24/ca5 0 2024-09-18T21:12:53.016 INFO:tasks.workunit.client.0.smithi077.stdout:9/442: mkdir d1/d54/d8f 0 2024-09-18T21:12:53.017 INFO:tasks.workunit.client.1.smithi103.stdout:7/481: symlink d1/df/d43/d52/l92 0 2024-09-18T21:12:53.021 INFO:tasks.workunit.client.0.smithi077.stdout:9/443: symlink d1/dd/d11/d1c/d38/d46/d55/l90 0 2024-09-18T21:12:53.022 INFO:tasks.workunit.client.0.smithi077.stdout:9/444: chown d1/d54/f82 63840 1 2024-09-18T21:12:53.022 INFO:tasks.workunit.client.1.smithi103.stdout:9/545: dread f1 [0,4194304] 0 2024-09-18T21:12:53.024 INFO:tasks.workunit.client.0.smithi077.stdout:9/445: creat d1/dd/d11/d15/d80/f91 x:0 0 0 2024-09-18T21:12:53.026 INFO:tasks.workunit.client.1.smithi103.stdout:0/507: symlink d1/d5/de/d19/d1e/d34/da8/d9f/lad 0 2024-09-18T21:12:53.027 INFO:tasks.workunit.client.1.smithi103.stdout:2/472: rename d3/d5/f18 to d3/d5/d2f/d32/d46/fb0 0 2024-09-18T21:12:53.028 INFO:tasks.workunit.client.1.smithi103.stdout:2/473: dread - d3/d5/f38 zero size 2024-09-18T21:12:53.028 INFO:tasks.workunit.client.0.smithi077.stdout:9/446: mkdir d1/d54/d81/d92 0 2024-09-18T21:12:53.029 INFO:tasks.workunit.client.0.smithi077.stdout:9/447: write d1/dd/f1f [3057609,71042] 0 2024-09-18T21:12:53.030 INFO:tasks.workunit.client.0.smithi077.stdout:9/448: chown d1/d54/d81/d92 4190569 1 2024-09-18T21:12:53.030 INFO:tasks.workunit.client.1.smithi103.stdout:6/518: creat d2/d24/d38/d68/fa6 x:0 0 0 2024-09-18T21:12:53.031 INFO:tasks.workunit.client.1.smithi103.stdout:6/519: chown d2 184 1 2024-09-18T21:12:53.031 INFO:tasks.workunit.client.1.smithi103.stdout:6/520: write d2/d3/f74 [3336492,87555] 0 2024-09-18T21:12:53.032 INFO:tasks.workunit.client.1.smithi103.stdout:7/482: mknod d1/df/d54/c93 0 2024-09-18T21:12:53.033 INFO:tasks.workunit.client.1.smithi103.stdout:6/521: write d2/d24/d5a/d67/d76/d43/d44/f6e [4767259,22017] 0 2024-09-18T21:12:53.036 INFO:tasks.workunit.client.0.smithi077.stdout:9/449: read d1/f7c [5603387,68377] 0 2024-09-18T21:12:53.036 INFO:tasks.workunit.client.1.smithi103.stdout:1/507: mkdir d0/d2/d9/d9e/d86/dae 0 2024-09-18T21:12:53.037 INFO:tasks.workunit.client.1.smithi103.stdout:7/483: dread d1/df/d43/d63/d67/d5b/f70 [0,4194304] 0 2024-09-18T21:12:53.041 INFO:tasks.workunit.client.1.smithi103.stdout:5/563: creat de/d1f/d3b/d3c/fb6 x:0 0 0 2024-09-18T21:12:53.044 INFO:tasks.workunit.client.0.smithi077.stdout:9/450: link d1/d54/l47 d1/dd/d11/d15/d80/l93 0 2024-09-18T21:12:53.052 INFO:tasks.workunit.client.0.smithi077.stdout:9/451: creat d1/dd/f94 x:0 0 0 2024-09-18T21:12:53.053 INFO:tasks.workunit.client.0.smithi077.stdout:9/452: fdatasync d1/dd/d1a/f23 0 2024-09-18T21:12:53.053 INFO:tasks.workunit.client.1.smithi103.stdout:8/629: getdents d4/d2d/d4e/d73 0 2024-09-18T21:12:53.053 INFO:tasks.workunit.client.1.smithi103.stdout:4/526: write d9/d2e/d61/d91/d9e/d48/f56 [1594113,72472] 0 2024-09-18T21:12:53.054 INFO:tasks.workunit.client.1.smithi103.stdout:8/630: chown d4/de/d4a/d59 9409 1 2024-09-18T21:12:53.054 INFO:tasks.workunit.client.1.smithi103.stdout:4/527: dread - d9/d1c/d77/f59 zero size 2024-09-18T21:12:53.055 INFO:tasks.workunit.client.1.smithi103.stdout:4/528: chown d9/d1c/c37 15957 1 2024-09-18T21:12:53.056 INFO:tasks.workunit.client.1.smithi103.stdout:7/484: creat d1/df/d42/d29/f94 x:0 0 0 2024-09-18T21:12:53.058 INFO:tasks.workunit.client.1.smithi103.stdout:9/546: write d18/d52/d5e/f7b [1024030,117420] 0 2024-09-18T21:12:53.060 INFO:tasks.workunit.client.0.smithi077.stdout:9/453: dwrite d1/dd/d11/d2d/f56 [0,4194304] 0 2024-09-18T21:12:53.060 INFO:tasks.workunit.client.1.smithi103.stdout:3/513: creat d1/d2/d18/fa4 x:0 0 0 2024-09-18T21:12:53.065 INFO:tasks.workunit.client.1.smithi103.stdout:2/474: mknod d3/d5/d4a/d56/cb1 0 2024-09-18T21:12:53.067 INFO:tasks.workunit.client.0.smithi077.stdout:9/454: dwrite d1/dd/f94 [0,4194304] 0 2024-09-18T21:12:53.068 INFO:tasks.workunit.client.1.smithi103.stdout:6/522: mknod d2/d24/d5a/d67/d76/ca7 0 2024-09-18T21:12:53.071 INFO:tasks.workunit.client.1.smithi103.stdout:4/529: symlink d9/d2e/d61/d91/lb5 0 2024-09-18T21:12:53.072 INFO:tasks.workunit.client.1.smithi103.stdout:7/485: dread d1/f12 [0,4194304] 0 2024-09-18T21:12:53.075 INFO:tasks.workunit.client.0.smithi077.stdout:9/455: creat d1/dd/d11/d2d/d59/f95 x:0 0 0 2024-09-18T21:12:53.075 INFO:tasks.workunit.client.1.smithi103.stdout:7/486: read d1/df/d42/d1f/f2d [458324,79718] 0 2024-09-18T21:12:53.076 INFO:tasks.workunit.client.1.smithi103.stdout:9/547: mkdir d18/d52/d6f/d8e/db4 0 2024-09-18T21:12:53.078 INFO:tasks.workunit.client.0.smithi077.stdout:9/456: chown d1/d54/d27/l35 35885 1 2024-09-18T21:12:53.081 INFO:tasks.workunit.client.0.smithi077.stdout:9/457: creat d1/dd/d11/d2d/d59/f96 x:0 0 0 2024-09-18T21:12:53.083 INFO:tasks.workunit.client.1.smithi103.stdout:1/508: mknod d0/d2/d2b/d3a/d42/d87/caf 0 2024-09-18T21:12:53.084 INFO:tasks.workunit.client.0.smithi077.stdout:9/458: mkdir d1/dd/d57/d97 0 2024-09-18T21:12:53.085 INFO:tasks.workunit.client.1.smithi103.stdout:1/509: stat d0/d2/d9/dc/d6e 0 2024-09-18T21:12:53.087 INFO:tasks.workunit.client.1.smithi103.stdout:1/510: readlink d0/d2/d9/dc/d6e/l99 0 2024-09-18T21:12:53.087 INFO:tasks.workunit.client.1.smithi103.stdout:3/514: mkdir d1/d23/d25/da1/da5 0 2024-09-18T21:12:53.088 INFO:tasks.workunit.client.1.smithi103.stdout:0/508: dwrite d1/d9/f52 [4194304,4194304] 0 2024-09-18T21:12:53.090 INFO:tasks.workunit.client.0.smithi077.stdout:9/459: creat d1/dd/d11/d72/f98 x:0 0 0 2024-09-18T21:12:53.090 INFO:tasks.workunit.client.1.smithi103.stdout:7/487: mkdir d1/df/d43/d52/d95 0 2024-09-18T21:12:53.092 INFO:tasks.workunit.client.1.smithi103.stdout:9/548: mkdir d18/d52/d6f/d8e/d8f/db5 0 2024-09-18T21:12:53.094 INFO:tasks.workunit.client.1.smithi103.stdout:2/475: dread d3/d5/fe [0,4194304] 0 2024-09-18T21:12:53.097 INFO:tasks.workunit.client.0.smithi077.stdout:7/518: sync 2024-09-18T21:12:53.098 INFO:tasks.workunit.client.0.smithi077.stdout:5/602: sync 2024-09-18T21:12:53.098 INFO:tasks.workunit.client.0.smithi077.stdout:3/484: sync 2024-09-18T21:12:53.098 INFO:tasks.workunit.client.1.smithi103.stdout:4/530: dread d9/d38/f4c [4194304,4194304] 0 2024-09-18T21:12:53.099 INFO:tasks.workunit.client.0.smithi077.stdout:9/460: truncate d1/dd/d1a/f23 425123 0 2024-09-18T21:12:53.102 INFO:tasks.workunit.client.1.smithi103.stdout:3/515: write d1/d2/d18/d30/d4e/f61 [398579,71863] 0 2024-09-18T21:12:53.103 INFO:tasks.workunit.client.0.smithi077.stdout:3/485: mknod db/d14/d22/d36/d39/d50/d5c/c9b 0 2024-09-18T21:12:53.104 INFO:tasks.workunit.client.1.smithi103.stdout:0/509: truncate d1/d5/f44 797655 0 2024-09-18T21:12:53.105 INFO:tasks.workunit.client.1.smithi103.stdout:5/564: link de/d14/d33/l26 de/d1f/d3b/lb7 0 2024-09-18T21:12:53.112 INFO:tasks.workunit.client.0.smithi077.stdout:7/519: dwrite d12/d22/d59/d5a/f8c [0,4194304] 0 2024-09-18T21:12:53.113 INFO:tasks.workunit.client.0.smithi077.stdout:5/603: dwrite d0/d6/d40/fb9 [0,4194304] 0 2024-09-18T21:12:53.114 INFO:tasks.workunit.client.1.smithi103.stdout:0/510: dwrite d1/f12 [4194304,4194304] 0 2024-09-18T21:12:53.114 INFO:tasks.workunit.client.0.smithi077.stdout:3/486: dread db/d14/d32/d4f/f53 [0,4194304] 0 2024-09-18T21:12:53.115 INFO:tasks.workunit.client.0.smithi077.stdout:5/604: readlink d0/df/l88 0 2024-09-18T21:12:53.117 INFO:tasks.workunit.client.1.smithi103.stdout:5/565: dwrite de/d2d/f75 [0,4194304] 0 2024-09-18T21:12:53.118 INFO:tasks.workunit.client.1.smithi103.stdout:0/511: stat d1/d5/de/d24/d43/d76/f9c 0 2024-09-18T21:12:53.121 INFO:tasks.workunit.client.0.smithi077.stdout:9/461: dwrite d1/dd/d11/d2d/f8e [0,4194304] 0 2024-09-18T21:12:53.122 INFO:tasks.workunit.client.1.smithi103.stdout:1/511: write d0/d2/f4e [400049,55151] 0 2024-09-18T21:12:53.125 INFO:tasks.workunit.client.1.smithi103.stdout:4/531: dwrite d9/d38/f7a [4194304,4194304] 0 2024-09-18T21:12:53.126 INFO:tasks.workunit.client.1.smithi103.stdout:9/549: write d18/d29/f5b [204282,125303] 0 2024-09-18T21:12:53.126 INFO:tasks.workunit.client.1.smithi103.stdout:6/523: getdents d2/d3/d8/d4c/d4e 0 2024-09-18T21:12:53.127 INFO:tasks.workunit.client.0.smithi077.stdout:5/605: write d0/d6/d3b/f55 [31178,6234] 0 2024-09-18T21:12:53.128 INFO:tasks.workunit.client.1.smithi103.stdout:5/566: chown de/d14/d33/d4f/fa2 1699914 1 2024-09-18T21:12:53.130 INFO:tasks.workunit.client.1.smithi103.stdout:4/532: truncate d9/d38/d58/f93 673623 0 2024-09-18T21:12:53.131 INFO:tasks.workunit.client.1.smithi103.stdout:7/488: creat d1/df/d42/d1f/d2e/f96 x:0 0 0 2024-09-18T21:12:53.131 INFO:tasks.workunit.client.1.smithi103.stdout:5/567: chown de/d3e/d15/fa8 13135 1 2024-09-18T21:12:53.133 INFO:tasks.workunit.client.1.smithi103.stdout:0/512: readlink d1/d5/de/d24/d43/d81/l92 0 2024-09-18T21:12:53.133 INFO:tasks.workunit.client.1.smithi103.stdout:7/489: readlink d1/df/d54/l8f 0 2024-09-18T21:12:53.133 INFO:tasks.workunit.client.1.smithi103.stdout:5/568: chown de/d1f/l4e 3 1 2024-09-18T21:12:53.135 INFO:tasks.workunit.client.0.smithi077.stdout:3/487: dwrite db/d14/d72/f8d [0,4194304] 0 2024-09-18T21:12:53.135 INFO:tasks.workunit.client.0.smithi077.stdout:7/520: dwrite d12/d22/d59/d5a/f8a [0,4194304] 0 2024-09-18T21:12:53.137 INFO:tasks.workunit.client.1.smithi103.stdout:6/524: stat d2/d3/f2f 0 2024-09-18T21:12:53.137 INFO:tasks.workunit.client.1.smithi103.stdout:2/476: creat d3/d5/d25/fb2 x:0 0 0 2024-09-18T21:12:53.139 INFO:tasks.workunit.client.0.smithi077.stdout:3/488: dread - db/d14/d32/d49/d4e/d6a/f88 zero size 2024-09-18T21:12:53.140 INFO:tasks.workunit.client.0.smithi077.stdout:9/462: mknod d1/dd/d11/c99 0 2024-09-18T21:12:53.141 INFO:tasks.workunit.client.1.smithi103.stdout:1/512: getdents d0/d2/da8 0 2024-09-18T21:12:53.142 INFO:tasks.workunit.client.1.smithi103.stdout:1/513: dread - d0/d2/d9/f92 zero size 2024-09-18T21:12:53.144 INFO:tasks.workunit.client.1.smithi103.stdout:6/525: dread d2/d24/d5a/d67/d76/d43/f45 [0,4194304] 0 2024-09-18T21:12:53.146 INFO:tasks.workunit.client.1.smithi103.stdout:4/533: rename d9/d1a to d9/d2e/d83/db6 0 2024-09-18T21:12:53.147 INFO:tasks.workunit.client.0.smithi077.stdout:7/521: rename d12/f1f to d12/d22/d59/d72/fbb 0 2024-09-18T21:12:53.149 INFO:tasks.workunit.client.0.smithi077.stdout:9/463: mknod d1/dd/d11/d1c/d38/d46/d55/c9a 0 2024-09-18T21:12:53.151 INFO:tasks.workunit.client.1.smithi103.stdout:0/513: fsync d1/f29 0 2024-09-18T21:12:53.153 INFO:tasks.workunit.client.0.smithi077.stdout:9/464: unlink d1/dd/d11/d1c/d38/c75 0 2024-09-18T21:12:53.153 INFO:tasks.workunit.client.1.smithi103.stdout:9/550: mknod d18/d8d/cb6 0 2024-09-18T21:12:53.153 INFO:tasks.workunit.client.1.smithi103.stdout:7/490: stat d1/df/d42/d1f/d2e/f37 0 2024-09-18T21:12:53.154 INFO:tasks.workunit.client.0.smithi077.stdout:9/465: chown d1/dd/d11/d1c 0 1 2024-09-18T21:12:53.154 INFO:tasks.workunit.client.1.smithi103.stdout:2/477: readlink d3/d5/d25/l41 0 2024-09-18T21:12:53.154 INFO:tasks.workunit.client.1.smithi103.stdout:6/526: dwrite d2/d3/d8/f93 [0,4194304] 0 2024-09-18T21:12:53.156 INFO:tasks.workunit.client.1.smithi103.stdout:3/516: link d1/d2/d18/f46 d1/d23/fa6 0 2024-09-18T21:12:53.157 INFO:tasks.workunit.client.0.smithi077.stdout:9/466: creat d1/d54/d27/f9b x:0 0 0 2024-09-18T21:12:53.157 INFO:tasks.workunit.client.1.smithi103.stdout:9/551: stat d18/d52/d6f/d8e/d96 0 2024-09-18T21:12:53.158 INFO:tasks.workunit.client.0.smithi077.stdout:9/467: dread - d1/dd/d1a/f76 zero size 2024-09-18T21:12:53.158 INFO:tasks.workunit.client.1.smithi103.stdout:4/534: mknod d9/d2e/cb7 0 2024-09-18T21:12:53.159 INFO:tasks.workunit.client.1.smithi103.stdout:6/527: readlink d2/d3/d8/d4c/d4e/l53 0 2024-09-18T21:12:53.160 INFO:tasks.workunit.client.1.smithi103.stdout:0/514: fdatasync d1/f4 0 2024-09-18T21:12:53.161 INFO:tasks.workunit.client.1.smithi103.stdout:5/569: mknod de/d14/d33/cb8 0 2024-09-18T21:12:53.161 INFO:tasks.workunit.client.1.smithi103.stdout:1/514: rename d0/d2/d2b/d85 to d0/d2/d2b/d3a/d42/d72/db0 0 2024-09-18T21:12:53.163 INFO:tasks.workunit.client.1.smithi103.stdout:6/528: readlink d2/l8d 0 2024-09-18T21:12:53.164 INFO:tasks.workunit.client.1.smithi103.stdout:5/570: fdatasync de/d2d/fa5 0 2024-09-18T21:12:53.166 INFO:tasks.workunit.client.1.smithi103.stdout:4/535: symlink d9/d2e/d83/lb8 0 2024-09-18T21:12:53.168 INFO:tasks.workunit.client.1.smithi103.stdout:4/536: stat d9/d38/f4c 0 2024-09-18T21:12:53.168 INFO:tasks.workunit.client.1.smithi103.stdout:2/478: dwrite d3/f16 [0,4194304] 0 2024-09-18T21:12:53.168 INFO:tasks.workunit.client.1.smithi103.stdout:6/529: mknod d2/d24/d38/d68/d7c/ca8 0 2024-09-18T21:12:53.169 INFO:tasks.workunit.client.1.smithi103.stdout:0/515: symlink d1/d5/d4c/lae 0 2024-09-18T21:12:53.170 INFO:tasks.workunit.client.1.smithi103.stdout:3/517: getdents d1/d2/d18/d30/d4e 0 2024-09-18T21:12:53.170 INFO:tasks.workunit.client.1.smithi103.stdout:1/515: mknod d0/d11/d5f/d19/cb1 0 2024-09-18T21:12:53.171 INFO:tasks.workunit.client.1.smithi103.stdout:5/571: mknod de/d1f/d3b/d51/d57/cb9 0 2024-09-18T21:12:53.172 INFO:tasks.workunit.client.1.smithi103.stdout:4/537: chown d9/fc 31528475 1 2024-09-18T21:12:53.173 INFO:tasks.workunit.client.1.smithi103.stdout:5/572: chown de/d14/d33/cb8 3 1 2024-09-18T21:12:53.174 INFO:tasks.workunit.client.1.smithi103.stdout:0/516: rmdir d1/d5/de/d19/d1e/d34 39 2024-09-18T21:12:53.177 INFO:tasks.workunit.client.1.smithi103.stdout:5/573: symlink de/d3e/d15/lba 0 2024-09-18T21:12:53.179 INFO:tasks.workunit.client.1.smithi103.stdout:0/517: mkdir d1/daf 0 2024-09-18T21:12:53.180 INFO:tasks.workunit.client.1.smithi103.stdout:5/574: fsync de/d2d/d7f/f45 0 2024-09-18T21:12:53.181 INFO:tasks.workunit.client.1.smithi103.stdout:3/518: truncate d1/d23/d47/f56 2311467 0 2024-09-18T21:12:53.181 INFO:tasks.workunit.client.1.smithi103.stdout:4/538: dwrite d9/f18 [0,4194304] 0 2024-09-18T21:12:53.183 INFO:tasks.workunit.client.0.smithi077.stdout:5/606: dread d0/d6/dd/d5d/f7a [0,4194304] 0 2024-09-18T21:12:53.183 INFO:tasks.workunit.client.1.smithi103.stdout:7/491: dread d1/df/d42/d29/d2f/d33/d51/f80 [0,4194304] 0 2024-09-18T21:12:53.188 INFO:tasks.workunit.client.0.smithi077.stdout:5/607: read d0/d6/dd/f30 [4302470,90108] 0 2024-09-18T21:12:53.188 INFO:tasks.workunit.client.1.smithi103.stdout:6/530: link d2/d24/d38/d68/d7c/c96 d2/d3/d8/d4c/ca9 0 2024-09-18T21:12:53.189 INFO:tasks.workunit.client.1.smithi103.stdout:7/492: write d1/df/d43/d52/f76 [213236,41310] 0 2024-09-18T21:12:53.191 INFO:tasks.workunit.client.0.smithi077.stdout:3/489: fdatasync db/d14/d72/f8d 0 2024-09-18T21:12:53.191 INFO:tasks.workunit.client.0.smithi077.stdout:3/490: symlink db/d14/d22/d36/d39/d50/l9c 2 2024-09-18T21:12:53.192 INFO:tasks.workunit.client.1.smithi103.stdout:3/519: read d1/d2/d18/d30/f38 [2110450,126750] 0 2024-09-18T21:12:53.194 INFO:tasks.workunit.client.1.smithi103.stdout:6/531: dread d2/d24/d5a/d67/d76/d43/f45 [0,4194304] 0 2024-09-18T21:12:53.196 INFO:tasks.workunit.client.0.smithi077.stdout:3/491: creat db/d14/d22/f9d x:0 0 0 2024-09-18T21:12:53.196 INFO:tasks.workunit.client.1.smithi103.stdout:6/532: write d2/f28 [3194907,54867] 0 2024-09-18T21:12:53.197 INFO:tasks.workunit.client.1.smithi103.stdout:2/479: dread d3/d5/f61 [0,4194304] 0 2024-09-18T21:12:53.197 INFO:tasks.workunit.client.0.smithi077.stdout:3/492: fsync db/f10 0 2024-09-18T21:12:53.201 INFO:tasks.workunit.client.0.smithi077.stdout:3/493: unlink db/c2d 0 2024-09-18T21:12:53.202 INFO:tasks.workunit.client.1.smithi103.stdout:2/480: mkdir d3/db3 0 2024-09-18T21:12:53.204 INFO:tasks.workunit.client.1.smithi103.stdout:6/533: symlink d2/d24/d5a/d67/d76/d43/laa 0 2024-09-18T21:12:53.205 INFO:tasks.workunit.client.0.smithi077.stdout:7/522: truncate d12/d22/f28 1795846 0 2024-09-18T21:12:53.207 INFO:tasks.workunit.client.1.smithi103.stdout:6/534: mknod d2/d3/d8/d4c/d7a/cab 0 2024-09-18T21:12:53.207 INFO:tasks.workunit.client.1.smithi103.stdout:2/481: dread d3/f9 [0,4194304] 0 2024-09-18T21:12:53.209 INFO:tasks.workunit.client.0.smithi077.stdout:3/494: dwrite db/d14/d32/d49/d4e/d6a/f6c [0,4194304] 0 2024-09-18T21:12:53.211 INFO:tasks.workunit.client.0.smithi077.stdout:3/495: write db/d14/d32/d49/d4e/f79 [249981,3494] 0 2024-09-18T21:12:53.212 INFO:tasks.workunit.client.1.smithi103.stdout:6/535: chown d2/d3/c23 204077390 1 2024-09-18T21:12:53.212 INFO:tasks.workunit.client.0.smithi077.stdout:7/523: truncate d12/d56/f3a 3638462 0 2024-09-18T21:12:53.214 INFO:tasks.workunit.client.1.smithi103.stdout:7/493: dread d1/df/d43/d61/f64 [0,4194304] 0 2024-09-18T21:12:53.214 INFO:tasks.workunit.client.1.smithi103.stdout:2/482: creat d3/d5/d2f/d32/d46/fb4 x:0 0 0 2024-09-18T21:12:53.215 INFO:tasks.workunit.client.1.smithi103.stdout:6/536: write d2/f4a [314997,57800] 0 2024-09-18T21:12:53.218 INFO:tasks.workunit.client.0.smithi077.stdout:7/524: dwrite d12/d22/d59/d72/f57 [0,4194304] 0 2024-09-18T21:12:53.220 INFO:tasks.workunit.client.1.smithi103.stdout:6/537: mkdir d2/d24/d38/d68/dac 0 2024-09-18T21:12:53.223 INFO:tasks.workunit.client.1.smithi103.stdout:2/483: rename d3/d5/fa9 to d3/d5/d2f/d48/dab/fb5 0 2024-09-18T21:12:53.223 INFO:tasks.workunit.client.1.smithi103.stdout:5/575: dread de/d3e/d15/f2e [0,4194304] 0 2024-09-18T21:12:53.224 INFO:tasks.workunit.client.0.smithi077.stdout:7/525: dread - d12/d22/d59/f79 zero size 2024-09-18T21:12:53.225 INFO:tasks.workunit.client.0.smithi077.stdout:7/526: truncate d12/d31/f83 1057663 0 2024-09-18T21:12:53.226 INFO:tasks.workunit.client.0.smithi077.stdout:4/443: sync 2024-09-18T21:12:53.227 INFO:tasks.workunit.client.0.smithi077.stdout:7/527: write d12/f45 [2353740,121015] 0 2024-09-18T21:12:53.229 INFO:tasks.workunit.client.1.smithi103.stdout:5/576: chown de/d2d/f56 33631 1 2024-09-18T21:12:53.230 INFO:tasks.workunit.client.1.smithi103.stdout:9/552: dwrite d18/d29/d68/fb1 [0,4194304] 0 2024-09-18T21:12:53.230 INFO:tasks.workunit.client.1.smithi103.stdout:7/494: dread d1/df/d42/d29/d2f/d33/f40 [0,4194304] 0 2024-09-18T21:12:53.231 INFO:tasks.workunit.client.0.smithi077.stdout:4/444: creat d3/dc/d32/d45/d5e/f87 x:0 0 0 2024-09-18T21:12:53.233 INFO:tasks.workunit.client.0.smithi077.stdout:4/445: write d3/fb [6771725,104823] 0 2024-09-18T21:12:53.234 INFO:tasks.workunit.client.0.smithi077.stdout:7/528: unlink d12/d22/d59/d5d/d62/f6d 0 2024-09-18T21:12:53.234 INFO:tasks.workunit.client.1.smithi103.stdout:4/539: write d9/d38/d72/fa8 [4756515,34479] 0 2024-09-18T21:12:53.235 INFO:tasks.workunit.client.0.smithi077.stdout:7/529: chown d12/d22/d59/d5d/d62/fba 956205 1 2024-09-18T21:12:53.236 INFO:tasks.workunit.client.0.smithi077.stdout:5/608: write d0/f2 [2646412,102299] 0 2024-09-18T21:12:53.236 INFO:tasks.workunit.client.1.smithi103.stdout:6/538: dwrite d2/d3/d8/d4c/d7d/f92 [0,4194304] 0 2024-09-18T21:12:53.236 INFO:tasks.workunit.client.1.smithi103.stdout:9/553: truncate d18/f64 940682 0 2024-09-18T21:12:53.237 INFO:tasks.workunit.client.1.smithi103.stdout:3/520: dread d1/da/df/f14 [0,4194304] 0 2024-09-18T21:12:53.239 INFO:tasks.workunit.client.1.smithi103.stdout:4/540: fdatasync d9/d1c/f42 0 2024-09-18T21:12:53.242 INFO:tasks.workunit.client.0.smithi077.stdout:5/609: symlink d0/d6/dd/d5d/d91/lca 0 2024-09-18T21:12:53.244 INFO:tasks.workunit.client.0.smithi077.stdout:7/530: mkdir d12/d22/daa/dbc 0 2024-09-18T21:12:53.247 INFO:tasks.workunit.client.0.smithi077.stdout:5/610: creat d0/df/d10/d5c/d74/d89/fcb x:0 0 0 2024-09-18T21:12:53.249 INFO:tasks.workunit.client.0.smithi077.stdout:7/531: chown d12/d22/d59/d72/cb4 511 1 2024-09-18T21:12:53.251 INFO:tasks.workunit.client.0.smithi077.stdout:3/496: dread db/d14/d32/f56 [0,4194304] 0 2024-09-18T21:12:53.251 INFO:tasks.workunit.client.0.smithi077.stdout:5/611: fdatasync d0/d6/dd/f3a 0 2024-09-18T21:12:53.254 INFO:tasks.workunit.client.0.smithi077.stdout:7/532: rmdir d12/d31/d77/d93/d2a/d7f 39 2024-09-18T21:12:53.256 INFO:tasks.workunit.client.0.smithi077.stdout:7/533: write d12/d31/d77/d93/f8e [782898,72821] 0 2024-09-18T21:12:53.256 INFO:tasks.workunit.client.0.smithi077.stdout:7/534: fsync d12/d56/da1/db6/fb8 0 2024-09-18T21:12:53.260 INFO:tasks.workunit.client.1.smithi103.stdout:7/495: write d1/df/d54/f5a [865158,44730] 0 2024-09-18T21:12:53.261 INFO:tasks.workunit.client.0.smithi077.stdout:7/535: mkdir d12/d56/da1/db6/dbd 0 2024-09-18T21:12:53.262 INFO:tasks.workunit.client.1.smithi103.stdout:7/496: fsync d1/df/d43/d63/d67/d5b/f81 0 2024-09-18T21:12:53.263 INFO:tasks.workunit.client.1.smithi103.stdout:2/484: rename d3/d5/l24 to d3/d5/lb6 0 2024-09-18T21:12:53.264 INFO:tasks.workunit.client.0.smithi077.stdout:3/497: mkdir db/d14/d32/d87/d9e 0 2024-09-18T21:12:53.266 INFO:tasks.workunit.client.1.smithi103.stdout:0/518: rmdir d1/d93/daa 0 2024-09-18T21:12:53.270 INFO:tasks.workunit.client.0.smithi077.stdout:5/612: write d0/d6/dd/f24 [701469,10867] 0 2024-09-18T21:12:53.270 INFO:tasks.workunit.client.0.smithi077.stdout:7/536: truncate d12/d22/d59/d72/f81 60436 0 2024-09-18T21:12:53.272 INFO:tasks.workunit.client.1.smithi103.stdout:9/554: link d18/d29/d62/fb0 d18/d52/d6f/d8e/d96/fb7 0 2024-09-18T21:12:53.272 INFO:tasks.workunit.client.1.smithi103.stdout:9/555: dread - d18/d29/d68/d92/d9c/fa6 zero size 2024-09-18T21:12:53.273 INFO:tasks.workunit.client.1.smithi103.stdout:9/556: write d18/d8d/f58 [343548,121738] 0 2024-09-18T21:12:53.273 INFO:tasks.workunit.client.1.smithi103.stdout:4/541: mknod d9/d2e/d61/d91/daa/cb9 0 2024-09-18T21:12:53.274 INFO:tasks.workunit.client.1.smithi103.stdout:4/542: chown d9/f18 73 1 2024-09-18T21:12:53.274 INFO:tasks.workunit.client.1.smithi103.stdout:9/557: read - d18/d52/d5e/fac zero size 2024-09-18T21:12:53.275 INFO:tasks.workunit.client.0.smithi077.stdout:3/498: mknod db/d14/d32/d49/d6b/c9f 0 2024-09-18T21:12:53.275 INFO:tasks.workunit.client.1.smithi103.stdout:9/558: fsync d18/d52/d6f/d8e/f98 0 2024-09-18T21:12:53.275 INFO:tasks.workunit.client.1.smithi103.stdout:4/543: chown d9/d38/f9a 7 1 2024-09-18T21:12:53.276 INFO:tasks.workunit.client.1.smithi103.stdout:4/544: chown d9/d38/d58/ca3 14905050 1 2024-09-18T21:12:53.276 INFO:tasks.workunit.client.0.smithi077.stdout:3/499: fsync db/d14/d32/d49/d4e/d6a/f61 0 2024-09-18T21:12:53.277 INFO:tasks.workunit.client.1.smithi103.stdout:6/539: dread d2/d3/f48 [0,4194304] 0 2024-09-18T21:12:53.278 INFO:tasks.workunit.client.0.smithi077.stdout:5/613: rmdir d0/d6/d8a 39 2024-09-18T21:12:53.284 INFO:tasks.workunit.client.0.smithi077.stdout:5/614: creat d0/d6/d3b/d64/d67/fcc x:0 0 0 2024-09-18T21:12:53.286 INFO:tasks.workunit.client.0.smithi077.stdout:7/537: symlink d12/d22/d59/lbe 0 2024-09-18T21:12:53.287 INFO:tasks.workunit.client.1.smithi103.stdout:3/521: truncate d1/d2/d18/d30/f45 772972 0 2024-09-18T21:12:53.290 INFO:tasks.workunit.client.0.smithi077.stdout:5/615: dwrite d0/d36/f75 [0,4194304] 0 2024-09-18T21:12:53.290 INFO:tasks.workunit.client.1.smithi103.stdout:9/559: readlink d18/d52/l5a 0 2024-09-18T21:12:53.291 INFO:tasks.workunit.client.1.smithi103.stdout:9/560: stat d18/f24 0 2024-09-18T21:12:53.291 INFO:tasks.workunit.client.0.smithi077.stdout:5/616: fsync d0/df/d10/d5c/d74/d89/fcb 0 2024-09-18T21:12:53.292 INFO:tasks.workunit.client.1.smithi103.stdout:4/545: creat d9/d38/fba x:0 0 0 2024-09-18T21:12:53.293 INFO:tasks.workunit.client.1.smithi103.stdout:5/577: getdents de/d2d 0 2024-09-18T21:12:53.294 INFO:tasks.workunit.client.0.smithi077.stdout:5/617: symlink d0/d43/lcd 0 2024-09-18T21:12:53.295 INFO:tasks.workunit.client.1.smithi103.stdout:0/519: mkdir d1/d56/db0 0 2024-09-18T21:12:53.295 INFO:tasks.workunit.client.0.smithi077.stdout:5/618: stat d0/d6/d8a/fab 0 2024-09-18T21:12:53.296 INFO:tasks.workunit.client.0.smithi077.stdout:5/619: fdatasync d0/f78 0 2024-09-18T21:12:53.297 INFO:tasks.workunit.client.1.smithi103.stdout:8/631: sync 2024-09-18T21:12:53.298 INFO:tasks.workunit.client.1.smithi103.stdout:3/522: rename d1/d23/d25/d4f/d58/l8d to d1/d2/d18/d30/d4e/la7 0 2024-09-18T21:12:53.298 INFO:tasks.workunit.client.1.smithi103.stdout:9/561: creat d18/d29/d68/d92/d9c/fb8 x:0 0 0 2024-09-18T21:12:53.300 INFO:tasks.workunit.client.0.smithi077.stdout:5/620: mknod d0/d6/d8a/cce 0 2024-09-18T21:12:53.301 INFO:tasks.workunit.client.0.smithi077.stdout:5/621: fdatasync d0/d6/d3b/d64/fb2 0 2024-09-18T21:12:53.303 INFO:tasks.workunit.client.1.smithi103.stdout:0/520: chown d1/f9a 226681 1 2024-09-18T21:12:53.305 INFO:tasks.workunit.client.1.smithi103.stdout:9/562: dwrite d18/d8d/d2f/f63 [0,4194304] 0 2024-09-18T21:12:53.307 INFO:tasks.workunit.client.1.smithi103.stdout:8/632: truncate d4/d81/d65/f31 2283032 0 2024-09-18T21:12:53.307 INFO:tasks.workunit.client.1.smithi103.stdout:5/578: truncate de/d3e/f2f 472882 0 2024-09-18T21:12:53.309 INFO:tasks.workunit.client.1.smithi103.stdout:7/497: link d1/df/c32 d1/df/d43/d63/d67/d5b/c97 0 2024-09-18T21:12:53.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.309+0000 7f69c45fb640 1 -- 172.21.15.77:0/4125676614 --> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f69bc10ef90 con 0x7f69a806e4a0 2024-09-18T21:12:53.311 INFO:tasks.workunit.client.1.smithi103.stdout:7/498: write d1/df/d54/f5a [1071984,104575] 0 2024-09-18T21:12:53.317 INFO:tasks.workunit.client.0.smithi077.stdout:7/538: truncate d12/d31/d77/d93/d2a/f32 574761 0 2024-09-18T21:12:53.318 INFO:tasks.workunit.client.0.smithi077.stdout:7/539: chown d12/l1c 8356 1 2024-09-18T21:12:53.320 INFO:tasks.workunit.client.0.smithi077.stdout:5/622: write d0/d36/f70 [821083,22757] 0 2024-09-18T21:12:53.321 INFO:tasks.workunit.client.0.smithi077.stdout:7/540: mknod d12/d31/d77/da3/cbf 0 2024-09-18T21:12:53.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.320+0000 7f69b2ffd640 1 -- 172.21.15.77:0/4125676614 <== mgr.14578 v2:172.21.15.103:6828/1199124716 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f69bc10ef90 con 0x7f69a806e4a0 2024-09-18T21:12:53.322 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T21:12:53.322 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager.smithi077 smithi077 *:9093,9094 running (6m) 11s ago 7m 25.5M - 0.25.0 c8568f914cd2 e1881e21423c 2024-09-18T21:12:53.322 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi077 smithi077 running (7m) 11s ago 7m 6899k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 0beb64a8c2ea 2024-09-18T21:12:53.322 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi103 smithi103 running (6m) 7s ago 6m 6891k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 04981ca7bf34 2024-09-18T21:12:53.322 INFO:teuthology.orchestra.run.smithi077.stdout:grafana.smithi077 smithi077 *:3000 running (6m) 11s ago 7m 84.1M - 9.4.7 954c08fa6188 620f52934182 2024-09-18T21:12:53.322 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.cqfhlw smithi077 running (2m) 11s ago 2m 12.7M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 a7ec3b7701b6 2024-09-18T21:12:53.322 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.vruydi smithi077 running (2m) 11s ago 2m 171M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 affbba097d3b 2024-09-18T21:12:53.322 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi103.opftmf smithi103 running (2m) 7s ago 2m 14.8M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 111f884c5a34 2024-09-18T21:12:53.322 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi103.zhdmdg smithi103 running (2m) 7s ago 2m 14.8M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 50b77d0edda5 2024-09-18T21:12:53.322 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi077.utkpjg smithi077 *:9283,8765,8443 running (8m) 11s ago 8m 224M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 5d334eb01bea 2024-09-18T21:12:53.322 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi103.zjztqc smithi103 *:8443,9283 running (38s) 7s ago 6m 483M - 19.1.1-17-g06b1b1de f79f744f586d 0fe6f5f18bf6 2024-09-18T21:12:53.323 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi077 smithi077 running (8m) 11s ago 9m 50.7M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bcbf289fe027 2024-09-18T21:12:53.323 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi103 smithi103 running (6m) 7s ago 6m 40.8M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 d6ae2062e5e3 2024-09-18T21:12:53.323 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi077 smithi077 *:9100 running (7m) 11s ago 7m 16.6M - 1.5.0 0da6a335fe13 ee48144962b4 2024-09-18T21:12:53.323 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi103 smithi103 *:9100 running (6m) 7s ago 6m 16.7M - 1.5.0 0da6a335fe13 f7a4da7753f2 2024-09-18T21:12:53.323 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (6m) 11s ago 6m 120M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 2e3563c32cf5 2024-09-18T21:12:53.323 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi077 running (5m) 11s ago 5m 122M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 39c2ccbb7603 2024-09-18T21:12:53.323 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi077 running (5m) 11s ago 5m 110M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 2ff2728057e2 2024-09-18T21:12:53.323 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi103 running (4m) 7s ago 4m 128M 5312M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 0e72b1bbb8ce 2024-09-18T21:12:53.323 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi103 running (4m) 7s ago 4m 117M 5312M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 85f1ce1e8bee 2024-09-18T21:12:53.323 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi103 running (4m) 7s ago 3m 110M 5312M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 cf8964b3ac6d 2024-09-18T21:12:53.323 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus.smithi077 smithi077 *:9095 running (6m) 11s ago 7m 56.5M - 2.43.0 a07b618ecd1d 81e0f3809b2f 2024-09-18T21:12:53.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.323+0000 7f69c45fb640 1 -- 172.21.15.77:0/4125676614 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f69a806e4a0 msgr2=0x7f69a8070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:53.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.323+0000 7f69c45fb640 1 --2- 172.21.15.77:0/4125676614 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f69a806e4a0 0x7f69a8070950 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f69bc10ce40 tx=0x7f69ac00b040 comp rx=0 tx=0).stop 2024-09-18T21:12:53.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.323+0000 7f69c45fb640 1 -- 172.21.15.77:0/4125676614 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69bc0fdb70 msgr2=0x7f69bc10d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:53.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.323+0000 7f69c45fb640 1 --2- 172.21.15.77:0/4125676614 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69bc0fdb70 0x7f69bc10d090 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f69b80048a0 tx=0x7f69b8009da0 comp rx=0 tx=0).stop 2024-09-18T21:12:53.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.324+0000 7f69c45fb640 1 -- 172.21.15.77:0/4125676614 shutdown_connections 2024-09-18T21:12:53.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.324+0000 7f69c45fb640 1 --2- 172.21.15.77:0/4125676614 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f69a806e4a0 0x7f69a8070950 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:53.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.324+0000 7f69c45fb640 1 --2- 172.21.15.77:0/4125676614 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69bc0fe4c0 0x7f69bc10d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:53.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.324+0000 7f69c45fb640 1 --2- 172.21.15.77:0/4125676614 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69bc0fdb70 0x7f69bc10d090 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:53.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.324+0000 7f69c45fb640 1 -- 172.21.15.77:0/4125676614 >> 172.21.15.77:0/4125676614 conn(0x7f69bc0f6390 msgr2=0x7f69bc0f7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:12:53.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.324+0000 7f69c45fb640 1 -- 172.21.15.77:0/4125676614 shutdown_connections 2024-09-18T21:12:53.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.324+0000 7f69c45fb640 1 -- 172.21.15.77:0/4125676614 wait complete. 2024-09-18T21:12:53.328 INFO:tasks.workunit.client.0.smithi077.stdout:7/541: dwrite d12/d22/d59/d5a/f70 [0,4194304] 0 2024-09-18T21:12:53.336 INFO:tasks.workunit.client.0.smithi077.stdout:5/623: dwrite d0/d6/d3b/f7e [0,4194304] 0 2024-09-18T21:12:53.337 INFO:tasks.workunit.client.0.smithi077.stdout:7/542: dwrite d12/d22/f7b [0,4194304] 0 2024-09-18T21:12:53.337 INFO:tasks.workunit.client.0.smithi077.stdout:5/624: chown d0/d36 458 1 2024-09-18T21:12:53.344 INFO:tasks.workunit.client.0.smithi077.stdout:7/543: rename d12/d22/d59/d5d to d12/d22/daa/dc0 0 2024-09-18T21:12:53.347 INFO:tasks.workunit.client.0.smithi077.stdout:5/625: unlink d0/d6/d3b/d64/f6c 0 2024-09-18T21:12:53.353 INFO:tasks.workunit.client.0.smithi077.stdout:5/626: dread d0/df/d10/f45 [0,4194304] 0 2024-09-18T21:12:53.353 INFO:tasks.workunit.client.0.smithi077.stdout:5/627: stat d0/d6/dd/f19 0 2024-09-18T21:12:53.363 INFO:tasks.workunit.client.0.smithi077.stdout:5/628: dwrite d0/df/d10/d5c/f72 [0,4194304] 0 2024-09-18T21:12:53.368 INFO:tasks.workunit.client.0.smithi077.stdout:5/629: truncate d0/df/d10/d4b/f60 4904973 0 2024-09-18T21:12:53.370 INFO:tasks.workunit.client.0.smithi077.stdout:7/544: dwrite d12/d22/d59/d72/f81 [0,4194304] 0 2024-09-18T21:12:53.371 INFO:tasks.workunit.client.0.smithi077.stdout:7/545: fsync d12/f78 0 2024-09-18T21:12:53.376 INFO:tasks.workunit.client.0.smithi077.stdout:7/546: symlink d12/d22/daa/dc0/lc1 0 2024-09-18T21:12:53.380 INFO:tasks.workunit.client.0.smithi077.stdout:5/630: dwrite d0/df/d10/fac [0,4194304] 0 2024-09-18T21:12:53.382 INFO:tasks.workunit.client.0.smithi077.stdout:7/547: creat d12/d22/fc2 x:0 0 0 2024-09-18T21:12:53.383 INFO:tasks.workunit.client.0.smithi077.stdout:7/548: write d12/d31/d77/d93/f8e [1612752,33765] 0 2024-09-18T21:12:53.385 INFO:tasks.workunit.client.0.smithi077.stdout:7/549: write d12/d31/f41 [4181520,19734] 0 2024-09-18T21:12:53.387 INFO:tasks.workunit.client.0.smithi077.stdout:5/631: creat d0/fcf x:0 0 0 2024-09-18T21:12:53.388 INFO:tasks.workunit.client.0.smithi077.stdout:7/550: rmdir d12/d22/d59/d72/d68 39 2024-09-18T21:12:53.393 INFO:tasks.workunit.client.0.smithi077.stdout:5/632: rename d0/df/d3d/c6f to d0/df/d10/d4b/d80/cd0 0 2024-09-18T21:12:53.395 INFO:tasks.workunit.client.0.smithi077.stdout:7/551: getdents d12/d31/d77/d93/d2a 0 2024-09-18T21:12:53.397 INFO:tasks.workunit.client.0.smithi077.stdout:5/633: write d0/d36/f75 [2941541,54769] 0 2024-09-18T21:12:53.398 INFO:tasks.workunit.client.0.smithi077.stdout:7/552: dread d12/d31/f48 [4194304,4194304] 0 2024-09-18T21:12:53.399 INFO:tasks.workunit.client.0.smithi077.stdout:5/634: fdatasync d0/d6/d3b/f7e 0 2024-09-18T21:12:53.400 INFO:tasks.workunit.client.0.smithi077.stdout:7/553: write d12/d31/f7e [26412,109105] 0 2024-09-18T21:12:53.405 INFO:tasks.workunit.client.0.smithi077.stdout:7/554: dread d12/d31/f83 [0,4194304] 0 2024-09-18T21:12:53.407 INFO:tasks.workunit.client.0.smithi077.stdout:7/555: dread - d12/d22/d59/d72/f80 zero size 2024-09-18T21:12:53.408 INFO:tasks.workunit.client.0.smithi077.stdout:7/556: fdatasync d12/d22/d59/d5a/f69 0 2024-09-18T21:12:53.410 INFO:tasks.workunit.client.0.smithi077.stdout:7/557: readlink d12/l2e 0 2024-09-18T21:12:53.410 INFO:tasks.workunit.client.0.smithi077.stdout:5/635: dwrite d0/df/d10/f7 [0,4194304] 0 2024-09-18T21:12:53.412 INFO:tasks.workunit.client.0.smithi077.stdout:5/636: stat d0/df/d10/c2f 0 2024-09-18T21:12:53.413 INFO:tasks.workunit.client.0.smithi077.stdout:7/558: truncate d12/f24 5222304 0 2024-09-18T21:12:53.415 INFO:tasks.workunit.client.0.smithi077.stdout:5/637: rename d0/fcf to d0/d6/d3b/d64/fd1 0 2024-09-18T21:12:53.416 INFO:tasks.workunit.client.0.smithi077.stdout:7/559: dread d12/d22/d59/d72/f86 [0,4194304] 0 2024-09-18T21:12:53.417 INFO:tasks.workunit.client.0.smithi077.stdout:5/638: mkdir d0/df/dd2 0 2024-09-18T21:12:53.418 INFO:tasks.workunit.client.0.smithi077.stdout:7/560: symlink d12/d56/da1/db6/lc3 0 2024-09-18T21:12:53.420 INFO:tasks.workunit.client.0.smithi077.stdout:5/639: creat d0/df/d3d/fd3 x:0 0 0 2024-09-18T21:12:53.422 INFO:tasks.workunit.client.0.smithi077.stdout:5/640: mknod d0/d6/d3b/d64/d95/cd4 0 2024-09-18T21:12:53.424 INFO:tasks.workunit.client.0.smithi077.stdout:7/561: dwrite d12/d31/d77/d93/f7c [0,4194304] 0 2024-09-18T21:12:53.426 INFO:tasks.workunit.client.0.smithi077.stdout:5/641: creat d0/fd5 x:0 0 0 2024-09-18T21:12:53.433 INFO:tasks.workunit.client.0.smithi077.stdout:7/562: unlink d12/d31/d77/d93/d89/d94/cae 0 2024-09-18T21:12:53.435 INFO:tasks.workunit.client.1.smithi103.stdout:0/521: symlink d1/d56/lb1 0 2024-09-18T21:12:53.436 INFO:tasks.workunit.client.1.smithi103.stdout:9/563: mkdir d18/d52/d6f/db9 0 2024-09-18T21:12:53.437 INFO:tasks.workunit.client.1.smithi103.stdout:6/540: getdents d2/d24/d5a/d67/d76 0 2024-09-18T21:12:53.437 INFO:tasks.workunit.client.1.smithi103.stdout:9/564: readlink d18/d52/d6f/l7e 0 2024-09-18T21:12:53.437 INFO:tasks.workunit.client.1.smithi103.stdout:5/579: rename de/d14/d33/d4f/fa2 to de/d2d/d7f/fbb 0 2024-09-18T21:12:53.438 INFO:tasks.workunit.client.0.smithi077.stdout:5/642: getdents d0/df/d10/d5c/d74/d89 0 2024-09-18T21:12:53.441 INFO:tasks.workunit.client.0.smithi077.stdout:7/563: dread d12/d31/d77/da0/fa7 [0,4194304] 0 2024-09-18T21:12:53.443 INFO:tasks.workunit.client.0.smithi077.stdout:5/643: rmdir d0/d6/d3b/d64 39 2024-09-18T21:12:53.447 INFO:tasks.workunit.client.1.smithi103.stdout:4/546: dwrite d9/d38/d58/f92 [0,4194304] 0 2024-09-18T21:12:53.447 INFO:tasks.workunit.client.1.smithi103.stdout:3/523: dwrite d1/d23/f63 [0,4194304] 0 2024-09-18T21:12:53.447 INFO:tasks.workunit.client.0.smithi077.stdout:5/644: dread - d0/d6/d3b/d64/fb2 zero size 2024-09-18T21:12:53.448 INFO:tasks.workunit.client.1.smithi103.stdout:4/547: readlink d9/d1c/d77/l3a 0 2024-09-18T21:12:53.449 INFO:tasks.workunit.client.1.smithi103.stdout:4/548: truncate d9/d38/d72/fa8 5319349 0 2024-09-18T21:12:53.449 INFO:tasks.workunit.client.1.smithi103.stdout:5/580: symlink de/d3e/d15/lbc 0 2024-09-18T21:12:53.449 INFO:tasks.workunit.client.0.smithi077.stdout:7/564: symlink d12/d22/d59/d72/d68/lc4 0 2024-09-18T21:12:53.451 INFO:tasks.workunit.client.1.smithi103.stdout:8/633: write d4/d81/d65/f31 [223717,45595] 0 2024-09-18T21:12:53.451 INFO:tasks.workunit.client.1.smithi103.stdout:4/549: dread - d9/d2e/d61/fa1 zero size 2024-09-18T21:12:53.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.451+0000 7effc478d640 1 -- 172.21.15.77:0/250709169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effbc0fc700 msgr2=0x7effbc0fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:53.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.451+0000 7effc478d640 1 --2- 172.21.15.77:0/250709169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effbc0fc700 0x7effbc0fcb70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7effac0048d0 tx=0x7effac009da0 comp rx=0 tx=0).stop 2024-09-18T21:12:53.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.452+0000 7effc478d640 1 -- 172.21.15.77:0/250709169 shutdown_connections 2024-09-18T21:12:53.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.452+0000 7effc478d640 1 --2- 172.21.15.77:0/250709169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effbc0fc700 0x7effbc0fcb70 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:53.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.452+0000 7effc478d640 1 --2- 172.21.15.77:0/250709169 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effbc0fb430 0x7effbc0fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:53.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.452+0000 7effc478d640 1 -- 172.21.15.77:0/250709169 >> 172.21.15.77:0/250709169 conn(0x7effbc0f6c10 msgr2=0x7effbc0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:12:53.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.452+0000 7effc478d640 1 -- 172.21.15.77:0/250709169 shutdown_connections 2024-09-18T21:12:53.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.452+0000 7effc478d640 1 -- 172.21.15.77:0/250709169 wait complete. 2024-09-18T21:12:53.455 INFO:tasks.workunit.client.0.smithi077.stdout:7/565: creat d12/d31/d77/d93/d89/d99/da9/fc5 x:0 0 0 2024-09-18T21:12:53.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.453+0000 7effc478d640 1 Processor -- start 2024-09-18T21:12:53.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.453+0000 7effc478d640 1 -- start start 2024-09-18T21:12:53.456 INFO:tasks.workunit.client.1.smithi103.stdout:0/522: creat d1/d5/de/d24/d43/d81/fb2 x:0 0 0 2024-09-18T21:12:53.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.454+0000 7effc478d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effbc0fb430 0x7effbc103570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:12:53.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.454+0000 7effc478d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effbc0fc700 0x7effbc101a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:12:53.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.454+0000 7effc478d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc102080 con 0x7effbc0fc700 2024-09-18T21:12:53.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.454+0000 7effc478d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc1021c0 con 0x7effbc0fb430 2024-09-18T21:12:53.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.454+0000 7effc1d28640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effbc0fc700 0x7effbc101a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:12:53.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.454+0000 7effc1d28640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effbc0fc700 0x7effbc101a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49560/0 (socket says 172.21.15.77:49560) 2024-09-18T21:12:53.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.454+0000 7effc1d28640 1 -- 172.21.15.77:0/636720715 learned_addr learned my addr 172.21.15.77:0/636720715 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:12:53.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.454+0000 7effc2529640 1 --2- 172.21.15.77:0/636720715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effbc0fb430 0x7effbc103570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:12:53.457 INFO:tasks.workunit.client.0.smithi077.stdout:5/645: creat d0/df/d10/d4b/d98/fd6 x:0 0 0 2024-09-18T21:12:53.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.455+0000 7effc1d28640 1 -- 172.21.15.77:0/636720715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effbc0fb430 msgr2=0x7effbc103570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:53.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.455+0000 7effc1d28640 1 --2- 172.21.15.77:0/636720715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effbc0fb430 0x7effbc103570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:53.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.455+0000 7effc1d28640 1 -- 172.21.15.77:0/636720715 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effac005040 con 0x7effbc0fc700 2024-09-18T21:12:53.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.455+0000 7effc2529640 1 --2- 172.21.15.77:0/636720715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effbc0fb430 0x7effbc103570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T21:12:53.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.456+0000 7effc1d28640 1 --2- 172.21.15.77:0/636720715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effbc0fc700 0x7effbc101a60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7effac003080 tx=0x7effac009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:12:53.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.457+0000 7effb2ffd640 1 -- 172.21.15.77:0/636720715 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effac038070 con 0x7effbc0fc700 2024-09-18T21:12:53.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.457+0000 7effb2ffd640 1 -- 172.21.15.77:0/636720715 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7effac02abd0 con 0x7effbc0fc700 2024-09-18T21:12:53.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.458+0000 7effb2ffd640 1 -- 172.21.15.77:0/636720715 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effac03d660 con 0x7effbc0fc700 2024-09-18T21:12:53.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.458+0000 7effc478d640 1 -- 172.21.15.77:0/636720715 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effbc102440 con 0x7effbc0fc700 2024-09-18T21:12:53.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.458+0000 7effc478d640 1 -- 172.21.15.77:0/636720715 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effbc115130 con 0x7effbc0fc700 2024-09-18T21:12:53.460 INFO:tasks.workunit.client.1.smithi103.stdout:9/565: fdatasync d18/d52/d6f/d8e/fa3 0 2024-09-18T21:12:53.461 INFO:tasks.workunit.client.0.smithi077.stdout:6/483: sync 2024-09-18T21:12:53.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.460+0000 7effc478d640 1 -- 172.21.15.77:0/636720715 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effbc0fa890 con 0x7effbc0fc700 2024-09-18T21:12:53.464 INFO:tasks.workunit.client.1.smithi103.stdout:5/581: creat de/d14/d33/d4f/fbd x:0 0 0 2024-09-18T21:12:53.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.461+0000 7effb2ffd640 1 -- 172.21.15.77:0/636720715 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 24) v1 ==== 91488+0+0 (secure 0 0 0) 0x7effac030020 con 0x7effbc0fc700 2024-09-18T21:12:53.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.461+0000 7effb2ffd640 1 --2- 172.21.15.77:0/636720715 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7effa806e570 0x7effa8070a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:12:53.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.461+0000 7effc2529640 1 --2- 172.21.15.77:0/636720715 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7effa806e570 0x7effa8070a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:12:53.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.462+0000 7effb2ffd640 1 -- 172.21.15.77:0/636720715 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5722+0+0 (secure 0 0 0) 0x7effac0adc90 con 0x7effbc0fc700 2024-09-18T21:12:53.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.462+0000 7effc2529640 1 --2- 172.21.15.77:0/636720715 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7effa806e570 0x7effa8070a20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7effbc103320 tx=0x7effb8009120 comp rx=0 tx=0).ready entity=mgr.14578 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:12:53.465 INFO:tasks.workunit.client.0.smithi077.stdout:6/484: symlink d7/d7e/d11/d3e/d42/la3 0 2024-09-18T21:12:53.466 INFO:tasks.workunit.client.1.smithi103.stdout:8/634: creat d4/d2d/d87/fc9 x:0 0 0 2024-09-18T21:12:53.466 INFO:tasks.workunit.client.1.smithi103.stdout:8/635: write d4/de/d4a/f79 [146679,41223] 0 2024-09-18T21:12:53.467 INFO:tasks.workunit.client.1.smithi103.stdout:9/566: creat d18/d29/d68/d78/fba x:0 0 0 2024-09-18T21:12:53.468 INFO:tasks.workunit.client.1.smithi103.stdout:8/636: dread - d4/de/f80 zero size 2024-09-18T21:12:53.468 INFO:tasks.workunit.client.0.smithi077.stdout:6/485: rename d7/d7e/d11/d25 to d7/d7e/d11/d3e/d42/d88/da4 0 2024-09-18T21:12:53.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.468+0000 7effb2ffd640 1 -- 172.21.15.77:0/636720715 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7effac077890 con 0x7effbc0fc700 2024-09-18T21:12:53.470 INFO:tasks.workunit.client.1.smithi103.stdout:8/637: readlink d4/d81/d65/d39/l40 0 2024-09-18T21:12:53.471 INFO:tasks.workunit.client.1.smithi103.stdout:7/499: rename d1/df/d42/d1f/d2e/l36 to d1/df/l98 0 2024-09-18T21:12:53.472 INFO:tasks.workunit.client.1.smithi103.stdout:8/638: write d4/d26/d56/d77/d9f/fbf [336120,84251] 0 2024-09-18T21:12:53.472 INFO:tasks.workunit.client.1.smithi103.stdout:4/550: truncate d9/fa 67555 0 2024-09-18T21:12:53.474 INFO:tasks.workunit.client.1.smithi103.stdout:7/500: chown d1/df/d43/d61/l90 0 1 2024-09-18T21:12:53.475 INFO:tasks.workunit.client.1.smithi103.stdout:9/567: dwrite d18/f3e [4194304,4194304] 0 2024-09-18T21:12:53.477 INFO:tasks.workunit.client.1.smithi103.stdout:0/523: chown d1/d9/f54 1504792425 1 2024-09-18T21:12:53.477 INFO:tasks.workunit.client.1.smithi103.stdout:9/568: readlink d18/l6a 0 2024-09-18T21:12:53.479 INFO:tasks.workunit.client.1.smithi103.stdout:5/582: creat de/d1f/d3b/d51/db0/fbe x:0 0 0 2024-09-18T21:12:53.479 INFO:tasks.workunit.client.0.smithi077.stdout:5/646: write d0/d6/d3b/fa8 [800772,75462] 0 2024-09-18T21:12:53.479 INFO:tasks.workunit.client.1.smithi103.stdout:5/583: readlink de/d1f/l71 0 2024-09-18T21:12:53.480 INFO:tasks.workunit.client.1.smithi103.stdout:6/541: rename d2/d24/d38/l99 to d2/d24/d38/d68/dac/lad 0 2024-09-18T21:12:53.482 INFO:tasks.workunit.client.1.smithi103.stdout:6/542: fsync d2/d24/d5a/d67/d76/d43/d44/f98 0 2024-09-18T21:12:53.483 INFO:tasks.workunit.client.0.smithi077.stdout:5/647: truncate d0/d43/d6d/fa1 194328 0 2024-09-18T21:12:53.484 INFO:tasks.workunit.client.1.smithi103.stdout:4/551: creat d9/d38/d58/fbb x:0 0 0 2024-09-18T21:12:53.484 INFO:tasks.workunit.client.0.smithi077.stdout:7/566: dread f5 [0,4194304] 0 2024-09-18T21:12:53.486 INFO:tasks.workunit.client.0.smithi077.stdout:7/567: dread - d12/d22/d59/d72/f80 zero size 2024-09-18T21:12:53.487 INFO:tasks.workunit.client.0.smithi077.stdout:5/648: rmdir d0/d36 39 2024-09-18T21:12:53.488 INFO:tasks.workunit.client.0.smithi077.stdout:5/649: stat d0/df/d3d/d85 0 2024-09-18T21:12:53.488 INFO:tasks.workunit.client.1.smithi103.stdout:7/501: creat d1/df/d43/d52/f99 x:0 0 0 2024-09-18T21:12:53.489 INFO:tasks.workunit.client.1.smithi103.stdout:3/524: getdents d1/d23/d25/d4f/d72/d85 0 2024-09-18T21:12:53.490 INFO:tasks.workunit.client.1.smithi103.stdout:4/552: dread d9/d38/d72/f8f [0,4194304] 0 2024-09-18T21:12:53.491 INFO:tasks.workunit.client.1.smithi103.stdout:7/502: chown d1/df/d54/l60 50329 1 2024-09-18T21:12:53.492 INFO:tasks.workunit.client.0.smithi077.stdout:5/650: write d0/f18 [1263676,15599] 0 2024-09-18T21:12:53.493 INFO:tasks.workunit.client.1.smithi103.stdout:9/569: rename d18/l6a to d18/d52/lbb 0 2024-09-18T21:12:53.494 INFO:tasks.workunit.client.1.smithi103.stdout:8/639: dread d4/d2d/d87/fbe [0,4194304] 0 2024-09-18T21:12:53.495 INFO:tasks.workunit.client.1.smithi103.stdout:5/584: symlink de/d1f/d3b/d51/d57/d59/lbf 0 2024-09-18T21:12:53.498 INFO:tasks.workunit.client.1.smithi103.stdout:5/585: dread de/d14/d33/f7c [0,4194304] 0 2024-09-18T21:12:53.499 INFO:tasks.workunit.client.1.smithi103.stdout:5/586: chown de/d14/d33/d4f/f68 1372896539 1 2024-09-18T21:12:53.499 INFO:tasks.workunit.client.1.smithi103.stdout:5/587: readlink de/d3e/l5e 0 2024-09-18T21:12:53.500 INFO:tasks.workunit.client.1.smithi103.stdout:5/588: chown de/d14/c3f 8818770 1 2024-09-18T21:12:53.504 INFO:tasks.workunit.client.1.smithi103.stdout:0/524: symlink d1/d5/de/d19/d1e/d6d/lb3 0 2024-09-18T21:12:53.510 INFO:tasks.workunit.client.1.smithi103.stdout:0/525: write d1/d5/de/d19/fa6 [4074451,13459] 0 2024-09-18T21:12:53.511 INFO:tasks.workunit.client.1.smithi103.stdout:4/553: unlink d9/d2e/f3f 0 2024-09-18T21:12:53.513 INFO:tasks.workunit.client.0.smithi077.stdout:7/568: dwrite d12/d31/d77/da0/fa7 [0,4194304] 0 2024-09-18T21:12:53.514 INFO:tasks.workunit.client.1.smithi103.stdout:9/570: creat d18/d52/d6f/db9/fbc x:0 0 0 2024-09-18T21:12:53.515 INFO:tasks.workunit.client.1.smithi103.stdout:5/589: dwrite de/d2d/d7f/fbb [0,4194304] 0 2024-09-18T21:12:53.516 INFO:tasks.workunit.client.0.smithi077.stdout:5/651: dwrite d0/d6/d3b/d64/fc6 [0,4194304] 0 2024-09-18T21:12:53.518 INFO:tasks.workunit.client.1.smithi103.stdout:5/590: dread - de/d3e/d15/fa8 zero size 2024-09-18T21:12:53.519 INFO:tasks.workunit.client.0.smithi077.stdout:5/652: write d0/df/d10/f7 [852255,86806] 0 2024-09-18T21:12:53.519 INFO:tasks.workunit.client.1.smithi103.stdout:6/543: creat d2/d24/d5a/d67/d76/d43/fae x:0 0 0 2024-09-18T21:12:53.522 INFO:tasks.workunit.client.1.smithi103.stdout:0/526: dwrite d1/d5/d4c/f86 [0,4194304] 0 2024-09-18T21:12:53.523 INFO:tasks.workunit.client.1.smithi103.stdout:7/503: creat d1/df/d42/d29/d2f/f9a x:0 0 0 2024-09-18T21:12:53.527 INFO:tasks.workunit.client.1.smithi103.stdout:9/571: dwrite d18/d8d/f87 [0,4194304] 0 2024-09-18T21:12:53.528 INFO:tasks.workunit.client.1.smithi103.stdout:9/572: chown d18/d52/f60 34 1 2024-09-18T21:12:53.529 INFO:tasks.workunit.client.0.smithi077.stdout:7/569: dwrite d12/d31/d77/da0/fb1 [0,4194304] 0 2024-09-18T21:12:53.529 INFO:tasks.workunit.client.1.smithi103.stdout:9/573: write d18/d29/d68/d78/fba [150799,86082] 0 2024-09-18T21:12:53.533 INFO:tasks.workunit.client.1.smithi103.stdout:4/554: creat d9/d1c/d77/fbc x:0 0 0 2024-09-18T21:12:53.533 INFO:tasks.workunit.client.0.smithi077.stdout:5/653: dwrite d0/d6/d40/fb9 [0,4194304] 0 2024-09-18T21:12:53.537 INFO:tasks.workunit.client.0.smithi077.stdout:5/654: chown d0/df/d10/d4b/f60 5 1 2024-09-18T21:12:53.538 INFO:tasks.workunit.client.0.smithi077.stdout:5/655: write d0/df/d10/f44 [2076662,2033] 0 2024-09-18T21:12:53.541 INFO:tasks.workunit.client.0.smithi077.stdout:7/570: mknod d12/d56/da1/cc6 0 2024-09-18T21:12:53.542 INFO:tasks.workunit.client.1.smithi103.stdout:3/525: getdents d1/d2/d18/d30/d4e/d62 0 2024-09-18T21:12:53.542 INFO:tasks.workunit.client.0.smithi077.stdout:7/571: chown d12/d22/d59/lbe 2000 1 2024-09-18T21:12:53.542 INFO:tasks.workunit.client.0.smithi077.stdout:5/656: read d0/d6/dd/f1e [3903145,84215] 0 2024-09-18T21:12:53.543 INFO:tasks.workunit.client.1.smithi103.stdout:3/526: chown d1/da/df/f14 0 1 2024-09-18T21:12:53.544 INFO:tasks.workunit.client.1.smithi103.stdout:5/591: chown de/d3e/f2f 12340063 1 2024-09-18T21:12:53.547 INFO:tasks.workunit.client.1.smithi103.stdout:5/592: read de/d2d/d7f/f6b [209121,61221] 0 2024-09-18T21:12:53.549 INFO:tasks.workunit.client.1.smithi103.stdout:6/544: truncate d2/f22 869411 0 2024-09-18T21:12:53.552 INFO:tasks.workunit.client.1.smithi103.stdout:4/555: creat d9/d2e/d61/fbd x:0 0 0 2024-09-18T21:12:53.553 INFO:tasks.workunit.client.1.smithi103.stdout:4/556: write d9/d2e/d61/fa1 [417917,66630] 0 2024-09-18T21:12:53.553 INFO:tasks.workunit.client.1.smithi103.stdout:4/557: chown d9/d2e/d61 22782 1 2024-09-18T21:12:53.556 INFO:tasks.workunit.client.0.smithi077.stdout:5/657: link d0/d6/d3b/d64/fb2 d0/d6/dbd/fd7 0 2024-09-18T21:12:53.556 INFO:tasks.workunit.client.0.smithi077.stdout:5/658: dread - d0/d6/daa/fb8 zero size 2024-09-18T21:12:53.558 INFO:tasks.workunit.client.1.smithi103.stdout:0/527: symlink d1/d5/lb4 0 2024-09-18T21:12:53.559 INFO:tasks.workunit.client.1.smithi103.stdout:0/528: write d1/d9/f2b [1720005,88687] 0 2024-09-18T21:12:53.560 INFO:tasks.workunit.client.1.smithi103.stdout:8/640: truncate d4/d2d/d87/fa7 235462 0 2024-09-18T21:12:53.561 INFO:tasks.workunit.client.0.smithi077.stdout:5/659: write d0/d6/dbd/fd7 [26357,22471] 0 2024-09-18T21:12:53.568 INFO:tasks.workunit.client.1.smithi103.stdout:5/593: creat de/d1f/d3b/db4/fc0 x:0 0 0 2024-09-18T21:12:53.568 INFO:tasks.workunit.client.1.smithi103.stdout:8/641: dwrite d4/d81/d65/f83 [0,4194304] 0 2024-09-18T21:12:53.569 INFO:tasks.workunit.client.1.smithi103.stdout:0/529: readlink d1/d5/de/d19/d1e/d34/da8/d9f/lad 0 2024-09-18T21:12:53.572 INFO:tasks.workunit.client.1.smithi103.stdout:5/594: chown de/d1f/f24 46092895 1 2024-09-18T21:12:53.573 INFO:tasks.workunit.client.1.smithi103.stdout:8/642: write f2 [3191312,118892] 0 2024-09-18T21:12:53.575 INFO:tasks.workunit.client.1.smithi103.stdout:4/558: dwrite f3 [4194304,4194304] 0 2024-09-18T21:12:53.578 INFO:tasks.workunit.client.1.smithi103.stdout:5/595: symlink de/d14/d7e/lc1 0 2024-09-18T21:12:53.581 INFO:tasks.workunit.client.1.smithi103.stdout:4/559: truncate d9/d1f/f50 918634 0 2024-09-18T21:12:53.582 INFO:tasks.workunit.client.1.smithi103.stdout:4/560: stat d9/d1c/d77/f6f 0 2024-09-18T21:12:53.582 INFO:tasks.workunit.client.0.smithi077.stdout:7/572: dwrite d12/d56/f3a [0,4194304] 0 2024-09-18T21:12:53.584 INFO:tasks.workunit.client.1.smithi103.stdout:7/504: truncate d1/f21 5375958 0 2024-09-18T21:12:53.586 INFO:tasks.workunit.client.1.smithi103.stdout:1/516: sync 2024-09-18T21:12:53.587 INFO:tasks.workunit.client.1.smithi103.stdout:0/530: link d1/f36 d1/d9/fb5 0 2024-09-18T21:12:53.590 INFO:tasks.workunit.client.1.smithi103.stdout:5/596: creat de/d14/d33/d4f/da6/fc2 x:0 0 0 2024-09-18T21:12:53.593 INFO:tasks.workunit.client.1.smithi103.stdout:1/517: fdatasync d0/d2/fb 0 2024-09-18T21:12:53.594 INFO:tasks.workunit.client.1.smithi103.stdout:8/643: getdents d4/d2d 0 2024-09-18T21:12:53.597 INFO:tasks.workunit.client.1.smithi103.stdout:4/561: mknod d9/cbe 0 2024-09-18T21:12:53.597 INFO:tasks.workunit.client.1.smithi103.stdout:0/531: dread - d1/f9b zero size 2024-09-18T21:12:53.597 INFO:tasks.workunit.client.1.smithi103.stdout:7/505: dwrite d1/df/d43/d52/f76 [0,4194304] 0 2024-09-18T21:12:53.598 INFO:tasks.workunit.client.0.smithi077.stdout:5/660: dread d0/f37 [0,4194304] 0 2024-09-18T21:12:53.599 INFO:tasks.workunit.client.0.smithi077.stdout:5/661: chown d0/df/l2c 121471 1 2024-09-18T21:12:53.603 INFO:tasks.workunit.client.0.smithi077.stdout:5/662: rename d0/d43/lcd to d0/df/d10/d4b/d80/ld8 0 2024-09-18T21:12:53.604 INFO:tasks.workunit.client.1.smithi103.stdout:0/532: fdatasync d1/d9/f54 0 2024-09-18T21:12:53.604 INFO:tasks.workunit.client.1.smithi103.stdout:9/574: dwrite d18/d29/f4b [0,4194304] 0 2024-09-18T21:12:53.605 INFO:tasks.workunit.client.1.smithi103.stdout:6/545: dwrite d2/d24/d5a/d67/d76/d43/f45 [0,4194304] 0 2024-09-18T21:12:53.606 INFO:tasks.workunit.client.1.smithi103.stdout:4/562: chown d9/d2e/d83/fab 4660279 1 2024-09-18T21:12:53.606 INFO:tasks.workunit.client.1.smithi103.stdout:1/518: creat d0/d2/d9/d9e/d7a/fb2 x:0 0 0 2024-09-18T21:12:53.606 INFO:tasks.workunit.client.0.smithi077.stdout:5/663: symlink d0/df/d10/d4b/d98/ld9 0 2024-09-18T21:12:53.609 INFO:tasks.workunit.client.1.smithi103.stdout:5/597: mknod de/d1f/d3b/d3c/cc3 0 2024-09-18T21:12:53.609 INFO:tasks.workunit.client.1.smithi103.stdout:3/527: dwrite d1/da/df/f19 [0,4194304] 0 2024-09-18T21:12:53.612 INFO:tasks.workunit.client.1.smithi103.stdout:0/533: readlink d1/d5/de/d22/l4b 0 2024-09-18T21:12:53.613 INFO:tasks.workunit.client.1.smithi103.stdout:9/575: fdatasync d18/d52/d6f/d8e/d96/fa7 0 2024-09-18T21:12:53.614 INFO:tasks.workunit.client.1.smithi103.stdout:3/528: write d1/d23/d25/d4f/d58/f6d [2436725,22250] 0 2024-09-18T21:12:53.615 INFO:tasks.workunit.client.0.smithi077.stdout:5/664: dwrite d0/d6/daa/fb8 [0,4194304] 0 2024-09-18T21:12:53.615 INFO:tasks.workunit.client.1.smithi103.stdout:2/485: sync 2024-09-18T21:12:53.621 INFO:tasks.workunit.client.1.smithi103.stdout:1/519: dread - d0/d2/d9/dc/d36/f6d zero size 2024-09-18T21:12:53.625 INFO:tasks.workunit.client.1.smithi103.stdout:3/529: dread d1/d23/f2a [0,4194304] 0 2024-09-18T21:12:53.626 INFO:tasks.workunit.client.0.smithi077.stdout:5/665: mknod d0/df/d10/d5c/d74/cda 0 2024-09-18T21:12:53.627 INFO:tasks.workunit.client.0.smithi077.stdout:5/666: write d0/f18 [3484019,29288] 0 2024-09-18T21:12:53.627 INFO:tasks.workunit.client.1.smithi103.stdout:3/530: write d1/d23/d25/f92 [49504,42777] 0 2024-09-18T21:12:53.629 INFO:tasks.workunit.client.1.smithi103.stdout:4/563: rename d9/d1c/d77/f87 to d9/d38/db4/fbf 0 2024-09-18T21:12:53.630 INFO:tasks.workunit.client.1.smithi103.stdout:4/564: stat d9/d38/f45 0 2024-09-18T21:12:53.631 INFO:tasks.workunit.client.1.smithi103.stdout:0/534: read - d1/d5/de/d19/d1e/d34/f45 zero size 2024-09-18T21:12:53.634 INFO:tasks.workunit.client.0.smithi077.stdout:5/667: dwrite d0/d43/d6d/fa1 [0,4194304] 0 2024-09-18T21:12:53.635 INFO:tasks.workunit.client.1.smithi103.stdout:9/576: mkdir d18/d52/d6f/d8e/d8f/dbd 0 2024-09-18T21:12:53.637 INFO:tasks.workunit.client.1.smithi103.stdout:9/577: truncate d18/d29/f44 201839 0 2024-09-18T21:12:53.638 INFO:tasks.workunit.client.1.smithi103.stdout:7/506: dread d1/f5f [0,4194304] 0 2024-09-18T21:12:53.641 INFO:tasks.workunit.client.1.smithi103.stdout:8/644: link d4/de/d4a/f66 d4/d26/d56/d77/d9f/fca 0 2024-09-18T21:12:53.641 INFO:tasks.workunit.client.0.smithi077.stdout:5/668: dwrite d0/df/d10/f9d [4194304,4194304] 0 2024-09-18T21:12:53.643 INFO:tasks.workunit.client.0.smithi077.stdout:5/669: fsync d0/df/d10/d5c/d74/faf 0 2024-09-18T21:12:53.647 INFO:tasks.workunit.client.1.smithi103.stdout:5/598: rmdir de 39 2024-09-18T21:12:53.649 INFO:tasks.workunit.client.1.smithi103.stdout:4/565: fdatasync f6 0 2024-09-18T21:12:53.651 INFO:tasks.workunit.client.1.smithi103.stdout:2/486: mkdir d3/d5/d2c/d77/d9c/db7 0 2024-09-18T21:12:53.653 INFO:tasks.workunit.client.1.smithi103.stdout:9/578: symlink d18/d52/d6f/d8e/d96/lbe 0 2024-09-18T21:12:53.656 INFO:tasks.workunit.client.1.smithi103.stdout:8/645: creat d4/d2d/fcb x:0 0 0 2024-09-18T21:12:53.658 INFO:tasks.workunit.client.1.smithi103.stdout:6/546: dread d2/d24/d5a/f11 [0,4194304] 0 2024-09-18T21:12:53.659 INFO:tasks.workunit.client.1.smithi103.stdout:7/507: truncate d1/df/f22 4006122 0 2024-09-18T21:12:53.661 INFO:tasks.workunit.client.1.smithi103.stdout:9/579: rename d18/d52/d6f/f8a to d18/d52/fbf 0 2024-09-18T21:12:53.661 INFO:tasks.workunit.client.1.smithi103.stdout:6/547: chown d2/d3/d8/d4c/d79/d9e 8479 1 2024-09-18T21:12:53.663 INFO:tasks.workunit.client.1.smithi103.stdout:8/646: chown d4/d81/c64 25703 1 2024-09-18T21:12:53.663 INFO:tasks.workunit.client.1.smithi103.stdout:1/520: getdents d0/d2 0 2024-09-18T21:12:53.664 INFO:tasks.workunit.client.1.smithi103.stdout:2/487: getdents d3/d5/d2f/d93 0 2024-09-18T21:12:53.665 INFO:tasks.workunit.client.1.smithi103.stdout:9/580: mknod d18/d52/cc0 0 2024-09-18T21:12:53.668 INFO:tasks.workunit.client.1.smithi103.stdout:7/508: symlink d1/df/d43/d63/l9b 0 2024-09-18T21:12:53.668 INFO:tasks.workunit.client.1.smithi103.stdout:5/599: dwrite de/d14/d7e/f82 [0,4194304] 0 2024-09-18T21:12:53.669 INFO:tasks.workunit.client.1.smithi103.stdout:3/531: truncate d1/da/f15 4598666 0 2024-09-18T21:12:53.669 INFO:tasks.workunit.client.1.smithi103.stdout:2/488: unlink d3/d5/d25/f85 0 2024-09-18T21:12:53.670 INFO:tasks.workunit.client.0.smithi077.stdout:5/670: dread d0/df/f27 [0,4194304] 0 2024-09-18T21:12:53.674 INFO:tasks.workunit.client.1.smithi103.stdout:1/521: creat d0/d2/d9/dc/d36/fb3 x:0 0 0 2024-09-18T21:12:53.677 INFO:tasks.workunit.client.1.smithi103.stdout:3/532: symlink d1/d64/la8 0 2024-09-18T21:12:53.679 INFO:tasks.workunit.client.0.smithi077.stdout:5/671: dwrite d0/d6/d3b/fb5 [0,4194304] 0 2024-09-18T21:12:53.679 INFO:tasks.workunit.client.1.smithi103.stdout:7/509: fdatasync d1/df/d42/d29/d2f/f4f 0 2024-09-18T21:12:53.680 INFO:tasks.workunit.client.1.smithi103.stdout:4/566: dread d9/d1f/f5c [0,4194304] 0 2024-09-18T21:12:53.681 INFO:tasks.workunit.client.1.smithi103.stdout:8/647: getdents d4/d26 0 2024-09-18T21:12:53.682 INFO:tasks.workunit.client.1.smithi103.stdout:2/489: mkdir d3/d5/d2c/d77/d9c/db8 0 2024-09-18T21:12:53.682 INFO:tasks.workunit.client.1.smithi103.stdout:6/548: dwrite d2/d24/f80 [0,4194304] 0 2024-09-18T21:12:53.684 INFO:tasks.workunit.client.0.smithi077.stdout:5/672: dread d0/d6/d40/fb9 [0,4194304] 0 2024-09-18T21:12:53.687 INFO:tasks.workunit.client.1.smithi103.stdout:1/522: dread d0/d2/d9/f2f [8388608,4194304] 0 2024-09-18T21:12:53.688 INFO:tasks.workunit.client.1.smithi103.stdout:5/600: dwrite de/d3e/d15/f8a [0,4194304] 0 2024-09-18T21:12:53.688 INFO:tasks.workunit.client.1.smithi103.stdout:3/533: symlink d1/d2/d18/d30/la9 0 2024-09-18T21:12:53.689 INFO:tasks.workunit.client.0.smithi077.stdout:5/673: symlink d0/df/d3d/d85/ldb 0 2024-09-18T21:12:53.689 INFO:tasks.workunit.client.1.smithi103.stdout:9/581: dwrite d18/d8d/f58 [4194304,4194304] 0 2024-09-18T21:12:53.690 INFO:tasks.workunit.client.1.smithi103.stdout:6/549: read d2/d3/d8/d4c/d4e/f9a [376529,122473] 0 2024-09-18T21:12:53.694 INFO:tasks.workunit.client.0.smithi077.stdout:5/674: rmdir d0/df/d10/d4b 39 2024-09-18T21:12:53.696 INFO:tasks.workunit.client.1.smithi103.stdout:3/534: stat d1/d2/d18/d30/d4e/l52 0 2024-09-18T21:12:53.696 INFO:tasks.workunit.client.1.smithi103.stdout:7/510: dread d1/df/d42/d29/d2f/d33/d51/f80 [0,4194304] 0 2024-09-18T21:12:53.697 INFO:tasks.workunit.client.1.smithi103.stdout:4/567: dwrite d9/d1f/f44 [0,4194304] 0 2024-09-18T21:12:53.699 INFO:tasks.workunit.client.1.smithi103.stdout:5/601: write de/d3e/f29 [2338003,21381] 0 2024-09-18T21:12:53.701 INFO:tasks.workunit.client.1.smithi103.stdout:4/568: readlink d9/d2e/d83/db6/d21/l2d 0 2024-09-18T21:12:53.703 INFO:tasks.workunit.client.1.smithi103.stdout:3/535: rmdir d1/d23/d25/d4f/d72/d7e 39 2024-09-18T21:12:53.704 INFO:tasks.workunit.client.1.smithi103.stdout:2/490: creat d3/d5/d4a/fb9 x:0 0 0 2024-09-18T21:12:53.705 INFO:tasks.workunit.client.1.smithi103.stdout:2/491: read - d3/d5/d2f/d48/dab/fad zero size 2024-09-18T21:12:53.706 INFO:tasks.workunit.client.1.smithi103.stdout:2/492: dread - d3/d5/f86 zero size 2024-09-18T21:12:53.707 INFO:tasks.workunit.client.1.smithi103.stdout:7/511: rename d1/df/l74 to d1/df/d42/d1f/d6b/d72/l9c 0 2024-09-18T21:12:53.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:53 smithi077 ceph-mon[27689]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:12:53.713 INFO:tasks.workunit.client.1.smithi103.stdout:4/569: creat d9/d2e/d61/d91/daa/fc0 x:0 0 0 2024-09-18T21:12:53.714 INFO:tasks.workunit.client.1.smithi103.stdout:3/536: readlink d1/da/l81 0 2024-09-18T21:12:53.714 INFO:tasks.workunit.client.1.smithi103.stdout:4/570: write d9/d2e/d61/f99 [100795,87379] 0 2024-09-18T21:12:53.716 INFO:tasks.workunit.client.1.smithi103.stdout:8/648: creat d4/d2d/d3d/da0/dab/fcc x:0 0 0 2024-09-18T21:12:53.717 INFO:tasks.workunit.client.1.smithi103.stdout:7/512: mkdir d1/df/d42/d29/d2f/d33/d9d 0 2024-09-18T21:12:53.718 INFO:tasks.workunit.client.1.smithi103.stdout:6/550: getdents d2/d24/d5a/d67 0 2024-09-18T21:12:53.719 INFO:tasks.workunit.client.1.smithi103.stdout:6/551: write d2/d24/d5a/d67/f95 [767334,86461] 0 2024-09-18T21:12:53.720 INFO:tasks.workunit.client.1.smithi103.stdout:5/602: rename de/d14 to de/d1f/d3b/d58/dc4 0 2024-09-18T21:12:53.721 INFO:tasks.workunit.client.1.smithi103.stdout:8/649: rmdir d4/de 39 2024-09-18T21:12:53.722 INFO:tasks.workunit.client.1.smithi103.stdout:7/513: readlink d1/df/l3b 0 2024-09-18T21:12:53.723 INFO:tasks.workunit.client.1.smithi103.stdout:4/571: rename d9/d2e/d83/db6/d41/laf to d9/d38/db4/lc1 0 2024-09-18T21:12:53.726 INFO:tasks.workunit.client.1.smithi103.stdout:7/514: getdents d1/df/d43/d61 0 2024-09-18T21:12:53.727 INFO:tasks.workunit.client.1.smithi103.stdout:5/603: rename de/d3e/l54 to de/d3e/lc5 0 2024-09-18T21:12:53.728 INFO:tasks.workunit.client.1.smithi103.stdout:8/650: truncate d4/d98/fbd 2716963 0 2024-09-18T21:12:53.729 INFO:tasks.workunit.client.1.smithi103.stdout:4/572: rename d9/d2e/d83/db6/d41/l73 to d9/d1c/lc2 0 2024-09-18T21:12:53.730 INFO:tasks.workunit.client.1.smithi103.stdout:6/552: dwrite d2/d24/d5a/d67/d76/d43/fae [0,4194304] 0 2024-09-18T21:12:53.732 INFO:tasks.workunit.client.1.smithi103.stdout:5/604: creat de/d1f/d3b/d3c/fc6 x:0 0 0 2024-09-18T21:12:53.732 INFO:tasks.workunit.client.1.smithi103.stdout:5/605: stat de/c13 0 2024-09-18T21:12:53.734 INFO:tasks.workunit.client.1.smithi103.stdout:4/573: symlink d9/d1f/lc3 0 2024-09-18T21:12:53.734 INFO:tasks.workunit.client.1.smithi103.stdout:8/651: symlink d4/d2d/d3d/da0/dab/lcd 0 2024-09-18T21:12:53.737 INFO:tasks.workunit.client.1.smithi103.stdout:7/515: creat d1/df/d42/d29/d2f/d33/d51/f9e x:0 0 0 2024-09-18T21:12:53.741 INFO:tasks.workunit.client.1.smithi103.stdout:6/553: truncate d2/d3/f19 3849463 0 2024-09-18T21:12:53.741 INFO:tasks.workunit.client.1.smithi103.stdout:4/574: mknod d9/d38/d72/d94/cc4 0 2024-09-18T21:12:53.745 INFO:tasks.workunit.client.1.smithi103.stdout:8/652: dwrite d4/d81/d65/d39/fb5 [0,4194304] 0 2024-09-18T21:12:53.745 INFO:tasks.workunit.client.1.smithi103.stdout:7/516: rename d1/df/d54/c93 to d1/df/d43/d63/d67/d5b/c9f 0 2024-09-18T21:12:53.746 INFO:tasks.workunit.client.1.smithi103.stdout:6/554: dread - d2/d3/d8/d4c/d79/f82 zero size 2024-09-18T21:12:53.747 INFO:tasks.workunit.client.1.smithi103.stdout:5/606: link de/d1f/d3b/d51/d57/d59/la7 de/d1f/d3b/d51/d57/d79/lc7 0 2024-09-18T21:12:53.748 INFO:tasks.workunit.client.1.smithi103.stdout:2/493: dwrite d3/d5/d2c/d54/d68/f8a [4194304,4194304] 0 2024-09-18T21:12:53.750 INFO:tasks.workunit.client.1.smithi103.stdout:5/607: stat de/d2d/f75 0 2024-09-18T21:12:53.752 INFO:tasks.workunit.client.1.smithi103.stdout:7/517: dread - d1/df/d42/d1f/d2e/f96 zero size 2024-09-18T21:12:53.754 INFO:tasks.workunit.client.1.smithi103.stdout:3/537: dwrite d1/d2/fb [4194304,4194304] 0 2024-09-18T21:12:53.756 INFO:tasks.workunit.client.1.smithi103.stdout:2/494: symlink d3/lba 0 2024-09-18T21:12:53.759 INFO:tasks.workunit.client.1.smithi103.stdout:6/555: symlink d2/d3/d8/d4c/d7d/d9b/laf 0 2024-09-18T21:12:53.761 INFO:tasks.workunit.client.1.smithi103.stdout:4/575: dwrite d9/d38/d72/fa0 [0,4194304] 0 2024-09-18T21:12:53.762 INFO:tasks.workunit.client.1.smithi103.stdout:6/556: truncate d2/d24/d5a/f17 8471482 0 2024-09-18T21:12:53.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:53 smithi103 ceph-mon[34827]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:12:53.768 INFO:tasks.workunit.client.1.smithi103.stdout:6/557: mknod d2/cb0 0 2024-09-18T21:12:53.770 INFO:tasks.workunit.client.1.smithi103.stdout:4/576: link d9/d38/d58/f93 d9/d2e/d83/db6/d41/d64/fc5 0 2024-09-18T21:12:53.770 INFO:tasks.workunit.client.1.smithi103.stdout:7/518: getdents d1/df/d43 0 2024-09-18T21:12:53.770 INFO:tasks.workunit.client.1.smithi103.stdout:6/558: fdatasync d2/d3/d8/d4c/f71 0 2024-09-18T21:12:53.772 INFO:tasks.workunit.client.1.smithi103.stdout:6/559: fdatasync d2/d3/f48 0 2024-09-18T21:12:53.773 INFO:tasks.workunit.client.1.smithi103.stdout:7/519: dread d1/df/d42/d1f/d2e/f41 [0,4194304] 0 2024-09-18T21:12:53.774 INFO:tasks.workunit.client.1.smithi103.stdout:4/577: dread d9/d1f/f50 [0,4194304] 0 2024-09-18T21:12:53.777 INFO:tasks.workunit.client.1.smithi103.stdout:6/560: rename d2/d3/c5c to d2/d3/d8/d94/cb1 0 2024-09-18T21:12:53.781 INFO:tasks.workunit.client.1.smithi103.stdout:4/578: dwrite d9/d2e/d83/db6/d41/fa5 [0,4194304] 0 2024-09-18T21:12:53.781 INFO:tasks.workunit.client.1.smithi103.stdout:6/561: rename d2/le to d2/d24/d5a/d67/d76/d43/d44/lb2 0 2024-09-18T21:12:53.782 INFO:tasks.workunit.client.1.smithi103.stdout:4/579: chown d9/lf 1330357100 1 2024-09-18T21:12:53.783 INFO:tasks.workunit.client.1.smithi103.stdout:4/580: dread - d9/d38/d58/fa7 zero size 2024-09-18T21:12:53.787 INFO:tasks.workunit.client.1.smithi103.stdout:3/538: truncate d1/da/df/f19 649643 0 2024-09-18T21:12:53.792 INFO:tasks.workunit.client.1.smithi103.stdout:2/495: dwrite d3/d5/d2c/f5c [0,4194304] 0 2024-09-18T21:12:53.793 INFO:tasks.workunit.client.1.smithi103.stdout:3/539: symlink d1/da/df/d70/laa 0 2024-09-18T21:12:53.797 INFO:tasks.workunit.client.1.smithi103.stdout:2/496: creat d3/d5/d25/d98/fbb x:0 0 0 2024-09-18T21:12:53.797 INFO:tasks.workunit.client.1.smithi103.stdout:5/608: dread de/d1f/d3b/d58/dc4/f22 [0,4194304] 0 2024-09-18T21:12:53.801 INFO:tasks.workunit.client.1.smithi103.stdout:4/581: link d9/d2e/d83/db6/l22 d9/d2e/d83/db6/lc6 0 2024-09-18T21:12:53.805 INFO:tasks.workunit.client.1.smithi103.stdout:4/582: dread - d9/d1c/f68 zero size 2024-09-18T21:12:53.805 INFO:tasks.workunit.client.1.smithi103.stdout:7/520: dread d1/df/d42/f45 [0,4194304] 0 2024-09-18T21:12:53.805 INFO:tasks.workunit.client.1.smithi103.stdout:6/562: unlink d2/d3/d8/d4c/f71 0 2024-09-18T21:12:53.807 INFO:tasks.workunit.client.1.smithi103.stdout:5/609: dwrite de/f81 [0,4194304] 0 2024-09-18T21:12:53.808 INFO:tasks.workunit.client.1.smithi103.stdout:2/497: dwrite d3/d5/f11 [0,4194304] 0 2024-09-18T21:12:53.817 INFO:tasks.workunit.client.1.smithi103.stdout:6/563: dread d2/d24/d5a/d67/f95 [0,4194304] 0 2024-09-18T21:12:53.819 INFO:tasks.workunit.client.1.smithi103.stdout:2/498: dwrite d3/d5/d2c/d54/d68/f84 [0,4194304] 0 2024-09-18T21:12:53.819 INFO:tasks.workunit.client.1.smithi103.stdout:6/564: write d2/d3/d8/f62 [374234,66535] 0 2024-09-18T21:12:53.820 INFO:tasks.workunit.client.1.smithi103.stdout:2/499: read - d3/d5/d2c/d77/fa3 zero size 2024-09-18T21:12:53.824 INFO:tasks.workunit.client.1.smithi103.stdout:7/521: unlink d1/df/d43/d61/f64 0 2024-09-18T21:12:53.827 INFO:tasks.workunit.client.1.smithi103.stdout:4/583: write d9/d2e/d61/d91/d9e/f53 [1656150,125970] 0 2024-09-18T21:12:53.830 INFO:tasks.workunit.client.1.smithi103.stdout:5/610: chown de/d3e/d15/c37 28445868 1 2024-09-18T21:12:53.832 INFO:tasks.workunit.client.1.smithi103.stdout:6/565: write d2/d3/f6f [488767,9892] 0 2024-09-18T21:12:53.833 INFO:tasks.workunit.client.1.smithi103.stdout:2/500: unlink d3/d5/d2f/d32/d46/c81 0 2024-09-18T21:12:53.834 INFO:tasks.workunit.client.1.smithi103.stdout:2/501: dread - d3/d5/d2f/d32/d46/fb4 zero size 2024-09-18T21:12:53.836 INFO:tasks.workunit.client.1.smithi103.stdout:4/584: creat d9/d2e/d83/db6/d41/fc7 x:0 0 0 2024-09-18T21:12:53.838 INFO:tasks.workunit.client.1.smithi103.stdout:6/566: dread d2/d3/d8/d4c/d7d/f92 [0,4194304] 0 2024-09-18T21:12:53.838 INFO:tasks.workunit.client.1.smithi103.stdout:5/611: mkdir de/d1f/d3b/d51/d57/dc8 0 2024-09-18T21:12:53.841 INFO:tasks.workunit.client.1.smithi103.stdout:3/540: dwrite d1/d2/d18/f44 [0,4194304] 0 2024-09-18T21:12:53.842 INFO:tasks.workunit.client.1.smithi103.stdout:2/502: dread - d3/d5/d4a/f5e zero size 2024-09-18T21:12:53.842 INFO:tasks.workunit.client.1.smithi103.stdout:6/567: fsync d2/d3/d8/d4c/f8b 0 2024-09-18T21:12:53.846 INFO:tasks.workunit.client.1.smithi103.stdout:7/522: creat d1/df/d44/fa0 x:0 0 0 2024-09-18T21:12:53.846 INFO:tasks.workunit.client.1.smithi103.stdout:3/541: readlink d1/da/l10 0 2024-09-18T21:12:53.846 INFO:tasks.workunit.client.0.smithi077.stdout:0/588: sync 2024-09-18T21:12:53.847 INFO:tasks.workunit.client.0.smithi077.stdout:0/589: stat d8/d37/d95/dab/ca0 0 2024-09-18T21:12:53.848 INFO:tasks.workunit.client.1.smithi103.stdout:3/542: read d1/d2/d18/f46 [829889,90476] 0 2024-09-18T21:12:53.849 INFO:tasks.workunit.client.1.smithi103.stdout:5/612: mknod de/d3e/cc9 0 2024-09-18T21:12:53.856 INFO:tasks.workunit.client.1.smithi103.stdout:7/523: dwrite d1/df/d42/d1f/f5e [0,4194304] 0 2024-09-18T21:12:53.857 INFO:tasks.workunit.client.1.smithi103.stdout:3/543: write d1/d23/d25/f4c [4130565,44560] 0 2024-09-18T21:12:53.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.873+0000 7effc478d640 1 -- 172.21.15.77:0/636720715 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7effbc104fb0 con 0x7effbc0fc700 2024-09-18T21:12:53.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.873+0000 7effb2ffd640 1 -- 172.21.15.77:0/636720715 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+853 (secure 0 0 0) 0x7effac07af50 con 0x7effbc0fc700 2024-09-18T21:12:53.875 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-18T21:12:53.875 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": { 2024-09-18T21:12:53.875 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 2 2024-09-18T21:12:53.875 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:12:53.876 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": { 2024-09-18T21:12:53.876 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 1, 2024-09-18T21:12:53.876 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 1 2024-09-18T21:12:53.876 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:12:53.876 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": { 2024-09-18T21:12:53.876 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 6 2024-09-18T21:12:53.876 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:12:53.876 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-09-18T21:12:53.876 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4 2024-09-18T21:12:53.876 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:12:53.876 INFO:teuthology.orchestra.run.smithi077.stdout: "overall": { 2024-09-18T21:12:53.876 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 13, 2024-09-18T21:12:53.876 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 1 2024-09-18T21:12:53.877 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-18T21:12:53.877 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-18T21:12:53.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.875+0000 7effc478d640 1 -- 172.21.15.77:0/636720715 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7effa806e570 msgr2=0x7effa8070a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:53.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.875+0000 7effc478d640 1 --2- 172.21.15.77:0/636720715 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7effa806e570 0x7effa8070a20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7effbc103320 tx=0x7effb8009120 comp rx=0 tx=0).stop 2024-09-18T21:12:53.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.875+0000 7effc478d640 1 -- 172.21.15.77:0/636720715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effbc0fc700 msgr2=0x7effbc101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:53.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.875+0000 7effc478d640 1 --2- 172.21.15.77:0/636720715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effbc0fc700 0x7effbc101a60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7effac003080 tx=0x7effac009da0 comp rx=0 tx=0).stop 2024-09-18T21:12:53.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.875+0000 7effc478d640 1 -- 172.21.15.77:0/636720715 shutdown_connections 2024-09-18T21:12:53.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.875+0000 7effc478d640 1 --2- 172.21.15.77:0/636720715 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7effa806e570 0x7effa8070a20 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:53.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.875+0000 7effc478d640 1 --2- 172.21.15.77:0/636720715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effbc0fc700 0x7effbc101a60 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:53.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.875+0000 7effc478d640 1 --2- 172.21.15.77:0/636720715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effbc0fb430 0x7effbc103570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:53.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.875+0000 7effc478d640 1 -- 172.21.15.77:0/636720715 >> 172.21.15.77:0/636720715 conn(0x7effbc0f6c10 msgr2=0x7effbc0f83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:12:53.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.875+0000 7effc478d640 1 -- 172.21.15.77:0/636720715 shutdown_connections 2024-09-18T21:12:53.879 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.876+0000 7effc478d640 1 -- 172.21.15.77:0/636720715 wait complete. 2024-09-18T21:12:53.917 INFO:tasks.workunit.client.1.smithi103.stdout:0/535: sync 2024-09-18T21:12:53.917 INFO:tasks.workunit.client.1.smithi103.stdout:1/523: sync 2024-09-18T21:12:53.932 INFO:tasks.workunit.client.1.smithi103.stdout:0/536: dread d1/d5/de/d19/d1e/f21 [0,4194304] 0 2024-09-18T21:12:53.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.954+0000 7f9f5a3e9640 1 -- 172.21.15.77:0/2067966348 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f540ff740 msgr2=0x7f9f54101b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:53.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.954+0000 7f9f5a3e9640 1 --2- 172.21.15.77:0/2067966348 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f540ff740 0x7f9f54101b20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c0048d0 tx=0x7f9f3c009da0 comp rx=0 tx=0).stop 2024-09-18T21:12:53.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.954+0000 7f9f5a3e9640 1 -- 172.21.15.77:0/2067966348 shutdown_connections 2024-09-18T21:12:53.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.954+0000 7f9f5a3e9640 1 --2- 172.21.15.77:0/2067966348 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f540ff740 0x7f9f54101b20 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:53.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.954+0000 7f9f5a3e9640 1 --2- 172.21.15.77:0/2067966348 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f540666b0 0x7f9f540ff200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:53.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.954+0000 7f9f5a3e9640 1 -- 172.21.15.77:0/2067966348 >> 172.21.15.77:0/2067966348 conn(0x7f9f540f6c30 msgr2=0x7f9f540f9060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:12:53.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.954+0000 7f9f5a3e9640 1 -- 172.21.15.77:0/2067966348 shutdown_connections 2024-09-18T21:12:53.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.954+0000 7f9f5a3e9640 1 -- 172.21.15.77:0/2067966348 wait complete. 2024-09-18T21:12:53.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.955+0000 7f9f5a3e9640 1 Processor -- start 2024-09-18T21:12:53.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.955+0000 7f9f5a3e9640 1 -- start start 2024-09-18T21:12:53.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.955+0000 7f9f5a3e9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f540666b0 0x7f9f5410d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:12:53.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.955+0000 7f9f5a3e9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f540ff740 0x7f9f5410d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:12:53.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.955+0000 7f9f5a3e9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5410e580 con 0x7f9f540ff740 2024-09-18T21:12:53.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.955+0000 7f9f5a3e9640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5410e6f0 con 0x7f9f540666b0 2024-09-18T21:12:53.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.955+0000 7f9f537fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f540ff740 0x7f9f5410d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:12:53.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.955+0000 7f9f537fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f540ff740 0x7f9f5410d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49576/0 (socket says 172.21.15.77:49576) 2024-09-18T21:12:53.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.955+0000 7f9f537fe640 1 -- 172.21.15.77:0/912364756 learned_addr learned my addr 172.21.15.77:0/912364756 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:12:53.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.955+0000 7f9f53fff640 1 --2- 172.21.15.77:0/912364756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f540666b0 0x7f9f5410d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:12:53.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.956+0000 7f9f537fe640 1 -- 172.21.15.77:0/912364756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f540666b0 msgr2=0x7f9f5410d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:53.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.956+0000 7f9f537fe640 1 --2- 172.21.15.77:0/912364756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f540666b0 0x7f9f5410d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:53.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.956+0000 7f9f537fe640 1 -- 172.21.15.77:0/912364756 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f3c005040 con 0x7f9f540ff740 2024-09-18T21:12:53.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.956+0000 7f9f537fe640 1 --2- 172.21.15.77:0/912364756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f540ff740 0x7f9f5410d760 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c0094f0 tx=0x7f9f3c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:12:53.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.956+0000 7f9f50ff9640 1 -- 172.21.15.77:0/912364756 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f3c038070 con 0x7f9f540ff740 2024-09-18T21:12:53.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.956+0000 7f9f50ff9640 1 -- 172.21.15.77:0/912364756 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9f3c02abd0 con 0x7f9f540ff740 2024-09-18T21:12:53.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.956+0000 7f9f5a3e9640 1 -- 172.21.15.77:0/912364756 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f5410e970 con 0x7f9f540ff740 2024-09-18T21:12:53.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.956+0000 7f9f50ff9640 1 -- 172.21.15.77:0/912364756 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f3c03e670 con 0x7f9f540ff740 2024-09-18T21:12:53.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.956+0000 7f9f5a3e9640 1 -- 172.21.15.77:0/912364756 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f5410ee90 con 0x7f9f540ff740 2024-09-18T21:12:53.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.957+0000 7f9f5a3e9640 1 -- 172.21.15.77:0/912364756 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f540fa8d0 con 0x7f9f540ff740 2024-09-18T21:12:53.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.958+0000 7f9f50ff9640 1 -- 172.21.15.77:0/912364756 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 24) v1 ==== 91488+0+0 (secure 0 0 0) 0x7f9f3c030020 con 0x7f9f540ff740 2024-09-18T21:12:53.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.958+0000 7f9f50ff9640 1 --2- 172.21.15.77:0/912364756 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f9f4006e4a0 0x7f9f40070950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:12:53.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.958+0000 7f9f50ff9640 1 -- 172.21.15.77:0/912364756 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f9f3c0adc30 con 0x7f9f540ff740 2024-09-18T21:12:53.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.958+0000 7f9f53fff640 1 --2- 172.21.15.77:0/912364756 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f9f4006e4a0 0x7f9f40070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:12:53.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.959+0000 7f9f53fff640 1 --2- 172.21.15.77:0/912364756 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f9f4006e4a0 0x7f9f40070950 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9f54066410 tx=0x7f9f44009120 comp rx=0 tx=0).ready entity=mgr.14578 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:12:53.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:53.962+0000 7f9f50ff9640 1 -- 172.21.15.77:0/912364756 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f9f3c077980 con 0x7f9f540ff740 2024-09-18T21:12:54.012 INFO:tasks.workunit.client.1.smithi103.stdout:5/613: creat de/d1f/d3b/d51/db0/fca x:0 0 0 2024-09-18T21:12:54.012 INFO:tasks.workunit.client.1.smithi103.stdout:5/614: truncate de/d3e/d15/fa8 394652 0 2024-09-18T21:12:54.013 INFO:tasks.workunit.client.0.smithi077.stdout:0/590: creat d8/d1a/d35/fb9 x:0 0 0 2024-09-18T21:12:54.014 INFO:tasks.workunit.client.0.smithi077.stdout:0/591: chown d8/d1a/d35/l4f 7 1 2024-09-18T21:12:54.015 INFO:tasks.workunit.client.1.smithi103.stdout:2/503: creat d3/fbc x:0 0 0 2024-09-18T21:12:54.016 INFO:tasks.workunit.client.1.smithi103.stdout:7/524: creat d1/df/d42/d29/d2f/d33/fa1 x:0 0 0 2024-09-18T21:12:54.021 INFO:tasks.workunit.client.0.smithi077.stdout:0/592: mkdir d8/d1a/d35/dba 0 2024-09-18T21:12:54.022 INFO:tasks.workunit.client.1.smithi103.stdout:0/537: symlink d1/d56/d8c/lb6 0 2024-09-18T21:12:54.022 INFO:tasks.workunit.client.1.smithi103.stdout:0/538: dread - d1/d5/de/d22/d6a/f91 zero size 2024-09-18T21:12:54.023 INFO:tasks.workunit.client.1.smithi103.stdout:5/615: fsync de/d1f/d3b/d51/d57/d59/f5c 0 2024-09-18T21:12:54.026 INFO:tasks.workunit.client.1.smithi103.stdout:8/653: sync 2024-09-18T21:12:54.027 INFO:tasks.workunit.client.1.smithi103.stdout:9/582: sync 2024-09-18T21:12:54.027 INFO:tasks.workunit.client.1.smithi103.stdout:7/525: chown d1/df/d42/d1f/d6b/d72/l9c 11 1 2024-09-18T21:12:54.028 INFO:tasks.workunit.client.1.smithi103.stdout:7/526: chown d1/df/d42/d1f/d5d/c68 1416923152 1 2024-09-18T21:12:54.029 INFO:tasks.workunit.client.1.smithi103.stdout:7/527: chown d1/df/d43/d63/d67 3 1 2024-09-18T21:12:54.030 INFO:tasks.workunit.client.1.smithi103.stdout:5/616: rename de/d2d/f88 to de/d1f/d3b/d58/dc4/d33/d4f/fcb 0 2024-09-18T21:12:54.031 INFO:tasks.workunit.client.1.smithi103.stdout:4/585: write d9/d2e/d83/db6/d41/f5f [461789,35390] 0 2024-09-18T21:12:54.032 INFO:tasks.workunit.client.1.smithi103.stdout:9/583: symlink d18/d52/d6f/d8e/lc1 0 2024-09-18T21:12:54.034 INFO:tasks.workunit.client.1.smithi103.stdout:3/544: rmdir d1/d64/d7d 0 2024-09-18T21:12:54.035 INFO:tasks.workunit.client.1.smithi103.stdout:7/528: symlink d1/df/d43/d61/la2 0 2024-09-18T21:12:54.037 INFO:tasks.workunit.client.1.smithi103.stdout:8/654: creat d4/de/d4a/d59/fce x:0 0 0 2024-09-18T21:12:54.040 INFO:tasks.workunit.client.1.smithi103.stdout:0/539: mknod d1/d5/de/d19/d1e/d58/cb7 0 2024-09-18T21:12:54.041 INFO:tasks.workunit.client.1.smithi103.stdout:0/540: fdatasync d1/d5/de/d24/d43/d76/f90 0 2024-09-18T21:12:54.044 INFO:tasks.workunit.client.1.smithi103.stdout:4/586: mknod d9/d2e/d83/db6/d86/cc8 0 2024-09-18T21:12:54.045 INFO:tasks.workunit.client.1.smithi103.stdout:4/587: readlink d9/d2e/d83/db6/d41/l62 0 2024-09-18T21:12:54.045 INFO:tasks.workunit.client.1.smithi103.stdout:4/588: chown d9/d1c/l36 1133 1 2024-09-18T21:12:54.046 INFO:tasks.workunit.client.1.smithi103.stdout:9/584: symlink d18/d52/d6f/d8e/db4/lc2 0 2024-09-18T21:12:54.046 INFO:tasks.workunit.client.1.smithi103.stdout:8/655: dread d4/d81/f92 [0,4194304] 0 2024-09-18T21:12:54.047 INFO:tasks.workunit.client.1.smithi103.stdout:6/568: truncate d2/d3/f55 2693061 0 2024-09-18T21:12:54.047 INFO:tasks.workunit.client.1.smithi103.stdout:4/589: write d9/d2e/f49 [3103113,44481] 0 2024-09-18T21:12:54.048 INFO:tasks.workunit.client.1.smithi103.stdout:5/617: creat de/fcc x:0 0 0 2024-09-18T21:12:54.049 INFO:tasks.workunit.client.0.smithi077.stdout:0/593: dwrite d8/d26/f54 [4194304,4194304] 0 2024-09-18T21:12:54.050 INFO:tasks.workunit.client.1.smithi103.stdout:7/529: symlink d1/df/d42/d29/d2f/la3 0 2024-09-18T21:12:54.050 INFO:tasks.workunit.client.1.smithi103.stdout:2/504: truncate d3/d5/d4a/d56/f8d 2376995 0 2024-09-18T21:12:54.054 INFO:tasks.workunit.client.0.smithi077.stdout:1/515: sync 2024-09-18T21:12:54.055 INFO:tasks.workunit.client.0.smithi077.stdout:0/594: creat d8/d37/d66/db4/fbb x:0 0 0 2024-09-18T21:12:54.056 INFO:tasks.workunit.client.1.smithi103.stdout:3/545: write d1/d23/d25/d4f/d51/f5c [50106,57290] 0 2024-09-18T21:12:54.058 INFO:tasks.workunit.client.0.smithi077.stdout:1/516: symlink d3/d8/d49/d4e/lbf 0 2024-09-18T21:12:54.061 INFO:tasks.workunit.client.1.smithi103.stdout:9/585: rename d18/d52/d6f/d8e/d96 to d18/d52/d6f/d8e/d8f/dbd/dc3 0 2024-09-18T21:12:54.066 INFO:tasks.workunit.client.0.smithi077.stdout:1/517: dwrite d3/d6a/d9b/d68/f9d [0,4194304] 0 2024-09-18T21:12:54.067 INFO:tasks.workunit.client.1.smithi103.stdout:3/546: dread d1/d2/d18/f29 [0,4194304] 0 2024-09-18T21:12:54.067 INFO:tasks.workunit.client.1.smithi103.stdout:8/656: dread f2 [4194304,4194304] 0 2024-09-18T21:12:54.068 INFO:tasks.workunit.client.0.smithi077.stdout:1/518: dread - d3/d8/d75/d89/f8c zero size 2024-09-18T21:12:54.068 INFO:tasks.workunit.client.1.smithi103.stdout:0/541: creat d1/d5/de/d19/d1e/fb8 x:0 0 0 2024-09-18T21:12:54.069 INFO:tasks.workunit.client.1.smithi103.stdout:3/547: write d1/d2/d18/d30/d4e/f61 [664518,58814] 0 2024-09-18T21:12:54.073 INFO:tasks.workunit.client.0.smithi077.stdout:0/595: creat d8/fbc x:0 0 0 2024-09-18T21:12:54.073 INFO:tasks.workunit.client.0.smithi077.stdout:1/519: dread d3/d8/d49/f65 [0,4194304] 0 2024-09-18T21:12:54.074 INFO:tasks.workunit.client.0.smithi077.stdout:0/596: chown d8/d1a/d35 458941712 1 2024-09-18T21:12:54.074 INFO:tasks.workunit.client.1.smithi103.stdout:2/505: rename d3/d5/d2f/c3b to d3/d5/d2c/cbd 0 2024-09-18T21:12:54.076 INFO:tasks.workunit.client.1.smithi103.stdout:9/586: unlink d18/d8d/c84 0 2024-09-18T21:12:54.077 INFO:tasks.workunit.client.0.smithi077.stdout:0/597: rmdir d8/d37/d95 39 2024-09-18T21:12:54.078 INFO:tasks.workunit.client.1.smithi103.stdout:9/587: dread - d18/d52/d6f/db9/fbc zero size 2024-09-18T21:12:54.078 INFO:tasks.workunit.client.1.smithi103.stdout:4/590: dwrite d9/d1f/f5c [0,4194304] 0 2024-09-18T21:12:54.080 INFO:tasks.workunit.client.1.smithi103.stdout:5/618: mkdir de/d1f/d3b/dcd 0 2024-09-18T21:12:54.081 INFO:tasks.workunit.client.1.smithi103.stdout:5/619: chown de/l38 34810219 1 2024-09-18T21:12:54.082 INFO:tasks.workunit.client.1.smithi103.stdout:6/569: getdents d2/d24/d5a/d67 0 2024-09-18T21:12:54.082 INFO:tasks.workunit.client.1.smithi103.stdout:5/620: write de/fcc [879169,65400] 0 2024-09-18T21:12:54.084 INFO:tasks.workunit.client.1.smithi103.stdout:4/591: dread d9/d38/d58/f6b [0,4194304] 0 2024-09-18T21:12:54.084 INFO:tasks.workunit.client.1.smithi103.stdout:7/530: rename d1/df/d42/d1f/c38 to d1/df/d42/d29/d2f/d33/d51/ca4 0 2024-09-18T21:12:54.085 INFO:tasks.workunit.client.0.smithi077.stdout:1/520: getdents d3/d8/d13/d77/db1 0 2024-09-18T21:12:54.086 INFO:tasks.workunit.client.1.smithi103.stdout:2/506: creat d3/d5/d2c/d54/d68/fbe x:0 0 0 2024-09-18T21:12:54.087 INFO:tasks.workunit.client.1.smithi103.stdout:7/531: stat d1/df/d42/d29/d2f 0 2024-09-18T21:12:54.088 INFO:tasks.workunit.client.1.smithi103.stdout:8/657: creat d4/d98/fcf x:0 0 0 2024-09-18T21:12:54.089 INFO:tasks.workunit.client.1.smithi103.stdout:2/507: fsync d3/d5/d2c/d54/d68/f8a 0 2024-09-18T21:12:54.091 INFO:tasks.workunit.client.0.smithi077.stdout:0/598: write d8/d1a/f20 [3703233,64240] 0 2024-09-18T21:12:54.092 INFO:tasks.workunit.client.1.smithi103.stdout:4/592: write d9/d38/db4/fbf [4018316,74082] 0 2024-09-18T21:12:54.092 INFO:tasks.workunit.client.1.smithi103.stdout:8/658: readlink d4/d26/d56/d77/d9f/la2 0 2024-09-18T21:12:54.093 INFO:tasks.workunit.client.1.smithi103.stdout:6/570: read d2/d3/d7f/f85 [3090927,57562] 0 2024-09-18T21:12:54.093 INFO:tasks.workunit.client.1.smithi103.stdout:3/548: truncate d1/da/df/f19 1104536 0 2024-09-18T21:12:54.093 INFO:tasks.workunit.client.1.smithi103.stdout:5/621: dwrite de/fae [0,4194304] 0 2024-09-18T21:12:54.094 INFO:tasks.workunit.client.0.smithi077.stdout:0/599: rmdir d8/d37/d66 39 2024-09-18T21:12:54.096 INFO:tasks.workunit.client.1.smithi103.stdout:7/532: creat d1/df/d43/d61/fa5 x:0 0 0 2024-09-18T21:12:54.097 INFO:tasks.workunit.client.1.smithi103.stdout:8/659: truncate d4/de/fbc 371365 0 2024-09-18T21:12:54.098 INFO:tasks.workunit.client.0.smithi077.stdout:0/600: mkdir d8/d1a/d39/d3b/d9a/dbd 0 2024-09-18T21:12:54.099 INFO:tasks.workunit.client.1.smithi103.stdout:9/588: link d18/d52/d6f/f80 d18/d52/d6f/d8e/d8f/dbd/dc3/fc4 0 2024-09-18T21:12:54.101 INFO:tasks.workunit.client.1.smithi103.stdout:4/593: rename d9/d1f to d9/d2e/d61/dc9 0 2024-09-18T21:12:54.104 INFO:tasks.workunit.client.1.smithi103.stdout:6/571: fsync d2/d3/d8/f20 0 2024-09-18T21:12:54.104 INFO:tasks.workunit.client.1.smithi103.stdout:2/508: dwrite d3/d5/d2f/d48/fa7 [0,4194304] 0 2024-09-18T21:12:54.106 INFO:tasks.workunit.client.1.smithi103.stdout:6/572: write d2/d24/d5a/d67/d76/f8c [722420,63768] 0 2024-09-18T21:12:54.106 INFO:tasks.workunit.client.1.smithi103.stdout:0/542: write d1/d5/de/d19/d1e/d34/da8/d9f/f71 [408561,101031] 0 2024-09-18T21:12:54.107 INFO:tasks.workunit.client.0.smithi077.stdout:0/601: rmdir d8/d1a/d35/dba 0 2024-09-18T21:12:54.109 INFO:tasks.workunit.client.1.smithi103.stdout:7/533: creat d1/df/d42/d29/fa6 x:0 0 0 2024-09-18T21:12:54.110 INFO:tasks.workunit.client.1.smithi103.stdout:1/524: sync 2024-09-18T21:12:54.110 INFO:tasks.workunit.client.1.smithi103.stdout:9/589: write d18/d29/d68/d92/d9c/fae [524227,31908] 0 2024-09-18T21:12:54.112 INFO:tasks.workunit.client.1.smithi103.stdout:2/509: mknod d3/d5/d2c/d54/d68/cbf 0 2024-09-18T21:12:54.112 INFO:tasks.workunit.client.1.smithi103.stdout:1/525: read - d0/d2/d2b/d3a/d42/d72/f8f zero size 2024-09-18T21:12:54.113 INFO:tasks.workunit.client.1.smithi103.stdout:2/510: readlink d3/d5/d2c/d54/l58 0 2024-09-18T21:12:54.113 INFO:tasks.workunit.client.1.smithi103.stdout:2/511: fdatasync d3/f16 0 2024-09-18T21:12:54.115 INFO:tasks.workunit.client.1.smithi103.stdout:2/512: dread - d3/d5/d4a/f5e zero size 2024-09-18T21:12:54.115 INFO:tasks.workunit.client.1.smithi103.stdout:6/573: creat d2/d3/d7f/fb3 x:0 0 0 2024-09-18T21:12:54.116 INFO:tasks.workunit.client.1.smithi103.stdout:0/543: mknod d1/d5/d4c/d4e/cb9 0 2024-09-18T21:12:54.116 INFO:tasks.workunit.client.1.smithi103.stdout:2/513: chown d3/d5/d2f/d32/f60 18972213 1 2024-09-18T21:12:54.117 INFO:tasks.workunit.client.1.smithi103.stdout:2/514: dread - d3/d5/d2f/f7c zero size 2024-09-18T21:12:54.117 INFO:tasks.workunit.client.0.smithi077.stdout:0/602: getdents d8/d37/d66/db4 0 2024-09-18T21:12:54.118 INFO:tasks.workunit.client.0.smithi077.stdout:0/603: chown d8/d1d/d80/f97 314609944 1 2024-09-18T21:12:54.118 INFO:tasks.workunit.client.1.smithi103.stdout:8/660: read d4/d2d/d87/fa7 [99577,96095] 0 2024-09-18T21:12:54.119 INFO:tasks.workunit.client.1.smithi103.stdout:8/661: chown d4/d26/d56 114707385 1 2024-09-18T21:12:54.119 INFO:tasks.workunit.client.1.smithi103.stdout:5/622: link de/d1f/l21 de/d1f/d3b/d58/dc4/d7e/lce 0 2024-09-18T21:12:54.121 INFO:tasks.workunit.client.1.smithi103.stdout:1/526: rename d0/d2/f6c to d0/d2/d9/d9e/d86/dae/fb4 0 2024-09-18T21:12:54.122 INFO:tasks.workunit.client.1.smithi103.stdout:6/574: chown d2/d3/f74 1378 1 2024-09-18T21:12:54.125 INFO:tasks.workunit.client.1.smithi103.stdout:8/662: fdatasync d4/d2d/d87/fa7 0 2024-09-18T21:12:54.126 INFO:tasks.workunit.client.1.smithi103.stdout:6/575: read d2/d3/f74 [1794055,99864] 0 2024-09-18T21:12:54.126 INFO:tasks.workunit.client.1.smithi103.stdout:4/594: write d9/d38/d72/d85/f90 [1360188,56851] 0 2024-09-18T21:12:54.128 INFO:tasks.workunit.client.1.smithi103.stdout:3/549: dread d1/da/f15 [0,4194304] 0 2024-09-18T21:12:54.129 INFO:tasks.workunit.client.1.smithi103.stdout:3/550: fdatasync d1/f13 0 2024-09-18T21:12:54.130 INFO:tasks.workunit.client.1.smithi103.stdout:7/534: write d1/df/d42/d1f/d5d/f71 [182144,34007] 0 2024-09-18T21:12:54.133 INFO:tasks.workunit.client.1.smithi103.stdout:9/590: dread d18/d8d/d2f/f97 [0,4194304] 0 2024-09-18T21:12:54.133 INFO:tasks.workunit.client.1.smithi103.stdout:6/576: symlink d2/d24/d5a/d67/lb4 0 2024-09-18T21:12:54.138 INFO:tasks.workunit.client.1.smithi103.stdout:3/551: rename d1/d2/d18/fa4 to d1/d23/d25/d4f/d72/d85/fab 0 2024-09-18T21:12:54.138 INFO:tasks.workunit.client.1.smithi103.stdout:0/544: link d1/d5/de/d24/d43/l7b d1/d5/de/d19/d1e/d6d/lba 0 2024-09-18T21:12:54.139 INFO:tasks.workunit.client.1.smithi103.stdout:7/535: mknod d1/df/d42/d29/d2f/ca7 0 2024-09-18T21:12:54.140 INFO:tasks.workunit.client.1.smithi103.stdout:3/552: fdatasync d1/f24 0 2024-09-18T21:12:54.143 INFO:tasks.workunit.client.1.smithi103.stdout:9/591: rename d18/d8d/f28 to d18/d52/d6f/d8e/fc5 0 2024-09-18T21:12:54.143 INFO:tasks.workunit.client.1.smithi103.stdout:8/663: link d4/c75 d4/d26/d56/d77/cd0 0 2024-09-18T21:12:54.146 INFO:tasks.workunit.client.1.smithi103.stdout:5/623: dwrite fb [4194304,4194304] 0 2024-09-18T21:12:54.146 INFO:tasks.workunit.client.1.smithi103.stdout:4/595: dread d9/d1c/f42 [0,4194304] 0 2024-09-18T21:12:54.148 INFO:tasks.workunit.client.1.smithi103.stdout:7/536: write d1/df/d42/d29/d2f/d33/d51/f9e [764206,109274] 0 2024-09-18T21:12:54.150 INFO:tasks.workunit.client.1.smithi103.stdout:9/592: creat d18/d8d/fc6 x:0 0 0 2024-09-18T21:12:54.153 INFO:tasks.workunit.client.1.smithi103.stdout:4/596: chown d9/d38/d58/fa7 1015048484 1 2024-09-18T21:12:54.153 INFO:tasks.workunit.client.1.smithi103.stdout:3/553: truncate d1/d23/d25/d4f/d72/d85/fab 866111 0 2024-09-18T21:12:54.155 INFO:tasks.workunit.client.1.smithi103.stdout:1/527: dwrite d0/d2/d9/dc/f7e [0,4194304] 0 2024-09-18T21:12:54.155 INFO:tasks.workunit.client.1.smithi103.stdout:8/664: rename d4/de/d4a/c6b to d4/d81/d71/d7f/cd1 0 2024-09-18T21:12:54.156 INFO:tasks.workunit.client.1.smithi103.stdout:3/554: fdatasync d1/d2/f3e 0 2024-09-18T21:12:54.157 INFO:tasks.workunit.client.1.smithi103.stdout:9/593: symlink d18/d29/d62/lc7 0 2024-09-18T21:12:54.158 INFO:tasks.workunit.client.1.smithi103.stdout:0/545: dwrite d1/d5/fc [4194304,4194304] 0 2024-09-18T21:12:54.160 INFO:tasks.workunit.client.1.smithi103.stdout:4/597: unlink d9/d2e/d61/d91/daa/cb9 0 2024-09-18T21:12:54.161 INFO:tasks.workunit.client.1.smithi103.stdout:5/624: creat de/d1f/d3b/d58/dc4/d33/fcf x:0 0 0 2024-09-18T21:12:54.163 INFO:tasks.workunit.client.1.smithi103.stdout:3/555: creat d1/d23/d25/d4f/d58/d68/fac x:0 0 0 2024-09-18T21:12:54.165 INFO:tasks.workunit.client.1.smithi103.stdout:0/546: symlink d1/d5/de/d19/d1e/d34/da8/d9f/lbb 0 2024-09-18T21:12:54.166 INFO:tasks.workunit.client.1.smithi103.stdout:3/556: write d1/da/f6b [4487851,16279] 0 2024-09-18T21:12:54.166 INFO:tasks.workunit.client.1.smithi103.stdout:7/537: link d1/df/d42/d29/fa6 d1/df/d42/d1f/d2e/fa8 0 2024-09-18T21:12:54.167 INFO:tasks.workunit.client.1.smithi103.stdout:1/528: dwrite d0/d11/f35 [4194304,4194304] 0 2024-09-18T21:12:54.168 INFO:tasks.workunit.client.1.smithi103.stdout:0/547: chown d1/d5/de/d19/d1e/l39 144 1 2024-09-18T21:12:54.169 INFO:tasks.workunit.client.1.smithi103.stdout:0/548: fsync d1/f9b 0 2024-09-18T21:12:54.171 INFO:tasks.workunit.client.1.smithi103.stdout:3/557: write d1/d23/d25/d4f/d58/f6d [420440,81361] 0 2024-09-18T21:12:54.172 INFO:tasks.workunit.client.1.smithi103.stdout:7/538: unlink d1/df/d42/c46 0 2024-09-18T21:12:54.173 INFO:tasks.workunit.client.1.smithi103.stdout:0/549: chown d1/d5/d4c/d4e/c5d 1011605576 1 2024-09-18T21:12:54.173 INFO:tasks.workunit.client.1.smithi103.stdout:1/529: mknod d0/d2/d9/d9e/d86/dae/cb5 0 2024-09-18T21:12:54.174 INFO:tasks.workunit.client.1.smithi103.stdout:4/598: getdents d9/d2e/d61/dc9 0 2024-09-18T21:12:54.176 INFO:tasks.workunit.client.1.smithi103.stdout:3/558: getdents d1/d23/d25/da1/da5 0 2024-09-18T21:12:54.177 INFO:tasks.workunit.client.1.smithi103.stdout:7/539: chown d1/df/d42/d29/c3d 11 1 2024-09-18T21:12:54.178 INFO:tasks.workunit.client.1.smithi103.stdout:5/625: dwrite de/d1f/d3b/d58/dc4/d33/f5d [4194304,4194304] 0 2024-09-18T21:12:54.179 INFO:tasks.workunit.client.1.smithi103.stdout:3/559: stat d1/d23/d25/d4f/l9f 0 2024-09-18T21:12:54.179 INFO:tasks.workunit.client.1.smithi103.stdout:7/540: readlink d1/df/d43/d61/la2 0 2024-09-18T21:12:54.182 INFO:tasks.workunit.client.1.smithi103.stdout:1/530: rename d0/d3/f4c to d0/d2/d9/d9e/d86/fb6 0 2024-09-18T21:12:54.184 INFO:tasks.workunit.client.1.smithi103.stdout:5/626: write de/f81 [6318494,10086] 0 2024-09-18T21:12:54.185 INFO:tasks.workunit.client.1.smithi103.stdout:4/599: getdents d9/d38/db4 0 2024-09-18T21:12:54.186 INFO:tasks.workunit.client.1.smithi103.stdout:3/560: symlink d1/d23/d25/d4f/d72/d85/lad 0 2024-09-18T21:12:54.189 INFO:tasks.workunit.client.1.smithi103.stdout:4/600: dread - d9/d2e/d61/fa2 zero size 2024-09-18T21:12:54.190 INFO:tasks.workunit.client.1.smithi103.stdout:1/531: symlink d0/d2/d9/dc/d6e/lb7 0 2024-09-18T21:12:54.190 INFO:tasks.workunit.client.1.smithi103.stdout:3/561: write d1/da/df/f79 [369589,9077] 0 2024-09-18T21:12:54.192 INFO:tasks.workunit.client.1.smithi103.stdout:0/550: dwrite d1/d5/de/d19/d1e/d34/da8/d9f/f1b [0,4194304] 0 2024-09-18T21:12:54.195 INFO:tasks.workunit.client.1.smithi103.stdout:4/601: truncate d9/d2e/d61/dc9/f8d 274861 0 2024-09-18T21:12:54.197 INFO:tasks.workunit.client.1.smithi103.stdout:9/594: dread d18/f3e [0,4194304] 0 2024-09-18T21:12:54.197 INFO:tasks.workunit.client.1.smithi103.stdout:3/562: creat d1/d9a/fae x:0 0 0 2024-09-18T21:12:54.197 INFO:tasks.workunit.client.0.smithi077.stdout:2/586: sync 2024-09-18T21:12:54.198 INFO:tasks.workunit.client.0.smithi077.stdout:4/446: sync 2024-09-18T21:12:54.198 INFO:tasks.workunit.client.0.smithi077.stdout:9/468: sync 2024-09-18T21:12:54.198 INFO:tasks.workunit.client.0.smithi077.stdout:8/453: sync 2024-09-18T21:12:54.199 INFO:tasks.workunit.client.1.smithi103.stdout:7/541: rename d1/df/d42/d1f/d2e/l55 to d1/df/d42/d29/d48/la9 0 2024-09-18T21:12:54.200 INFO:tasks.workunit.client.1.smithi103.stdout:4/602: symlink d9/d2e/d83/lca 0 2024-09-18T21:12:54.202 INFO:tasks.workunit.client.0.smithi077.stdout:9/469: chown d1/dd/d11/d15/d80/l93 8 1 2024-09-18T21:12:54.203 INFO:tasks.workunit.client.1.smithi103.stdout:7/542: read - d1/df/d43/d61/f78 zero size 2024-09-18T21:12:54.206 INFO:tasks.workunit.client.1.smithi103.stdout:7/543: stat d1/f8e 0 2024-09-18T21:12:54.206 INFO:tasks.workunit.client.1.smithi103.stdout:9/595: chown d18/d52/d6f/d8e/d8f/dbd/dc3/fb7 715 1 2024-09-18T21:12:54.206 INFO:tasks.workunit.client.1.smithi103.stdout:8/665: truncate f2 964834 0 2024-09-18T21:12:54.207 INFO:tasks.workunit.client.0.smithi077.stdout:9/470: mkdir d1/dd/d11/d1c/d38/d46/d55/d9c 0 2024-09-18T21:12:54.208 INFO:tasks.workunit.client.0.smithi077.stdout:9/471: write d1/dd/d1a/d42/f89 [962713,63149] 0 2024-09-18T21:12:54.210 INFO:tasks.workunit.client.1.smithi103.stdout:6/577: dwrite d2/d3/f19 [0,4194304] 0 2024-09-18T21:12:54.210 INFO:tasks.workunit.client.0.smithi077.stdout:8/454: creat d2/d5/d6/d22/d4f/d5a/d2a/d88/fa3 x:0 0 0 2024-09-18T21:12:54.211 INFO:tasks.workunit.client.0.smithi077.stdout:8/455: dread - d2/d5/d6/d22/d20/f96 zero size 2024-09-18T21:12:54.213 INFO:tasks.workunit.client.1.smithi103.stdout:8/666: dread - d4/d2d/d87/fc9 zero size 2024-09-18T21:12:54.213 INFO:tasks.workunit.client.1.smithi103.stdout:0/551: dwrite d1/d5/de/d24/d43/d76/f77 [0,4194304] 0 2024-09-18T21:12:54.214 INFO:tasks.workunit.client.0.smithi077.stdout:9/472: creat d1/d54/d51/f9d x:0 0 0 2024-09-18T21:12:54.215 INFO:tasks.workunit.client.1.smithi103.stdout:9/596: write d18/d52/d6f/d8e/fa2 [24452,33759] 0 2024-09-18T21:12:54.215 INFO:tasks.workunit.client.1.smithi103.stdout:1/532: dwrite d0/d2/d2b/d3a/d42/d72/db0/f7f [0,4194304] 0 2024-09-18T21:12:54.217 INFO:tasks.workunit.client.1.smithi103.stdout:6/578: write d2/d3/d7f/fb3 [171868,100950] 0 2024-09-18T21:12:54.219 INFO:tasks.workunit.client.0.smithi077.stdout:8/456: mkdir d2/d5/d6/d9f/da4 0 2024-09-18T21:12:54.219 INFO:tasks.workunit.client.1.smithi103.stdout:7/544: unlink d1/df/d42/d1f/f2d 0 2024-09-18T21:12:54.220 INFO:tasks.workunit.client.0.smithi077.stdout:8/457: write d2/d27/d29/f9c [610676,118230] 0 2024-09-18T21:12:54.223 INFO:tasks.workunit.client.1.smithi103.stdout:1/533: chown d0/d2/d9/d9e/d7a/f9b 100056438 1 2024-09-18T21:12:54.225 INFO:tasks.workunit.client.1.smithi103.stdout:7/545: read - d1/df/d43/d52/f99 zero size 2024-09-18T21:12:54.227 INFO:tasks.workunit.client.1.smithi103.stdout:7/546: readlink d1/l8b 0 2024-09-18T21:12:54.227 INFO:tasks.workunit.client.1.smithi103.stdout:9/597: chown d18/d29/d68/d92/d9c/fae 1 1 2024-09-18T21:12:54.228 INFO:tasks.workunit.client.1.smithi103.stdout:0/552: mknod d1/d5/de/d24/cbc 0 2024-09-18T21:12:54.228 INFO:tasks.workunit.client.0.smithi077.stdout:8/458: symlink d2/d5/d6/d22/d4f/la5 0 2024-09-18T21:12:54.229 INFO:tasks.workunit.client.1.smithi103.stdout:5/627: dread de/ff [0,4194304] 0 2024-09-18T21:12:54.231 INFO:tasks.workunit.client.0.smithi077.stdout:8/459: mkdir d2/d5/d6/d9f/da6 0 2024-09-18T21:12:54.232 INFO:tasks.workunit.client.0.smithi077.stdout:9/473: getdents d1/dd/d11/d1c 0 2024-09-18T21:12:54.233 INFO:tasks.workunit.client.0.smithi077.stdout:4/447: dread d3/dc/d32/f44 [0,4194304] 0 2024-09-18T21:12:54.234 INFO:tasks.workunit.client.1.smithi103.stdout:9/598: mkdir d18/d29/d68/d92/d9c/dc8 0 2024-09-18T21:12:54.235 INFO:tasks.workunit.client.1.smithi103.stdout:1/534: mknod d0/d2/cb8 0 2024-09-18T21:12:54.236 INFO:tasks.workunit.client.0.smithi077.stdout:8/460: mknod d2/d5f/ca7 0 2024-09-18T21:12:54.236 INFO:tasks.workunit.client.1.smithi103.stdout:5/628: rmdir de/d1f/d3b/d51/d57/d79 39 2024-09-18T21:12:54.236 INFO:tasks.workunit.client.1.smithi103.stdout:6/579: dwrite d2/d24/d5a/d67/d76/f8c [0,4194304] 0 2024-09-18T21:12:54.237 INFO:tasks.workunit.client.1.smithi103.stdout:1/535: dread - d0/d3/f66 zero size 2024-09-18T21:12:54.237 INFO:tasks.workunit.client.0.smithi077.stdout:9/474: rename d1/d54/d27/l35 to d1/dd/d11/d1c/d38/d46/d55/d9c/l9e 0 2024-09-18T21:12:54.238 INFO:tasks.workunit.client.0.smithi077.stdout:9/475: chown d1/dd/d11/d15 162 1 2024-09-18T21:12:54.240 INFO:tasks.workunit.client.1.smithi103.stdout:8/667: dwrite d4/d2d/d87/fbe [4194304,4194304] 0 2024-09-18T21:12:54.242 INFO:tasks.workunit.client.1.smithi103.stdout:4/603: dread d9/d1c/d77/f6f [0,4194304] 0 2024-09-18T21:12:54.243 INFO:tasks.workunit.client.1.smithi103.stdout:3/563: dread d1/d23/d25/d4f/d58/f6d [0,4194304] 0 2024-09-18T21:12:54.243 INFO:tasks.workunit.client.1.smithi103.stdout:4/604: write d9/d1c/f68 [234404,115705] 0 2024-09-18T21:12:54.245 INFO:tasks.workunit.client.0.smithi077.stdout:8/461: getdents d2/d5/d6/d22/d4f/d5a/d2a/d67 0 2024-09-18T21:12:54.249 INFO:tasks.workunit.client.0.smithi077.stdout:8/462: read d2/d27/d29/d41/f45 [3013,117512] 0 2024-09-18T21:12:54.250 INFO:tasks.workunit.client.0.smithi077.stdout:9/476: creat d1/dd/d1a/d42/f9f x:0 0 0 2024-09-18T21:12:54.250 INFO:tasks.workunit.client.1.smithi103.stdout:1/536: write d0/d2/d9/dc/f7e [1554197,79773] 0 2024-09-18T21:12:54.251 INFO:tasks.workunit.client.0.smithi077.stdout:9/477: chown d1/d54/d81/d92 494 1 2024-09-18T21:12:54.251 INFO:tasks.workunit.client.1.smithi103.stdout:5/629: rmdir de/d1f/d3b/d58/dc4/d33/d4f 39 2024-09-18T21:12:54.252 INFO:tasks.workunit.client.1.smithi103.stdout:1/537: chown d0/d2/d9/d10/d5d/d6f/f8b 309167919 1 2024-09-18T21:12:54.255 INFO:tasks.workunit.client.1.smithi103.stdout:6/580: symlink d2/d24/d38/d68/d7c/lb5 0 2024-09-18T21:12:54.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.254+0000 7f9f5a3e9640 1 -- 172.21.15.77:0/912364756 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9f5404b720 con 0x7f9f540ff740 2024-09-18T21:12:54.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.255+0000 7f9f50ff9640 1 -- 172.21.15.77:0/912364756 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1807 (secure 0 0 0) 0x7f9f3c07b040 con 0x7f9f540ff740 2024-09-18T21:12:54.257 INFO:teuthology.orchestra.run.smithi077.stdout:e13 2024-09-18T21:12:54.257 INFO:teuthology.orchestra.run.smithi077.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T21:12:54.257 INFO:teuthology.orchestra.run.smithi077.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T21:12:54.257 INFO:teuthology.orchestra.run.smithi077.stdout:legacy client fscid: 1 2024-09-18T21:12:54.257 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:12:54.257 INFO:teuthology.orchestra.run.smithi077.stdout:Filesystem 'cephfs' (1) 2024-09-18T21:12:54.257 INFO:teuthology.orchestra.run.smithi077.stdout:fs_name cephfs 2024-09-18T21:12:54.257 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 13 2024-09-18T21:12:54.257 INFO:teuthology.orchestra.run.smithi077.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T21:12:54.258 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-09-18T21:10:17.230179+0000 2024-09-18T21:12:54.258 INFO:teuthology.orchestra.run.smithi077.stdout:modified 2024-09-18T21:10:33.373241+0000 2024-09-18T21:12:54.258 INFO:teuthology.orchestra.run.smithi077.stdout:tableserver 0 2024-09-18T21:12:54.258 INFO:teuthology.orchestra.run.smithi077.stdout:root 0 2024-09-18T21:12:54.258 INFO:teuthology.orchestra.run.smithi077.stdout:session_timeout 60 2024-09-18T21:12:54.258 INFO:teuthology.orchestra.run.smithi077.stdout:session_autoclose 300 2024-09-18T21:12:54.258 INFO:teuthology.orchestra.run.smithi077.stdout:max_file_size 1099511627776 2024-09-18T21:12:54.258 INFO:teuthology.orchestra.run.smithi077.stdout:required_client_features {} 2024-09-18T21:12:54.258 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure 0 2024-09-18T21:12:54.258 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure_osd_epoch 0 2024-09-18T21:12:54.258 INFO:teuthology.orchestra.run.smithi077.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T21:12:54.258 INFO:teuthology.orchestra.run.smithi077.stdout:max_mds 1 2024-09-18T21:12:54.258 INFO:teuthology.orchestra.run.smithi077.stdout:in 0 2024-09-18T21:12:54.258 INFO:teuthology.orchestra.run.smithi077.stdout:up {0=14446} 2024-09-18T21:12:54.258 INFO:teuthology.orchestra.run.smithi077.stdout:failed 2024-09-18T21:12:54.259 INFO:teuthology.orchestra.run.smithi077.stdout:damaged 2024-09-18T21:12:54.259 INFO:teuthology.orchestra.run.smithi077.stdout:stopped 2024-09-18T21:12:54.259 INFO:teuthology.orchestra.run.smithi077.stdout:data_pools [3] 2024-09-18T21:12:54.259 INFO:teuthology.orchestra.run.smithi077.stdout:metadata_pool 2 2024-09-18T21:12:54.259 INFO:teuthology.orchestra.run.smithi077.stdout:inline_data disabled 2024-09-18T21:12:54.259 INFO:teuthology.orchestra.run.smithi077.stdout:balancer 2024-09-18T21:12:54.259 INFO:teuthology.orchestra.run.smithi077.stdout:standby_count_wanted 1 2024-09-18T21:12:54.259 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.vruydi{0:14446} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.77:6826/334039954,v1:172.21.15.77:6827/334039954] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:12:54.259 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:12:54.259 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:12:54.259 INFO:teuthology.orchestra.run.smithi077.stdout:Standby daemons: 2024-09-18T21:12:54.259 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:12:54.259 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.cqfhlw{-1:14458} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.77:6828/862540650,v1:172.21.15.77:6829/862540650] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:12:54.260 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi103.zhdmdg{-1:24255} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.103:6824/2170237078,v1:172.21.15.103:6825/2170237078] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:12:54.260 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi103.opftmf{-1:24267} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.103:6826/4241818403,v1:172.21.15.103:6827/4241818403] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:12:54.260 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 13 2024-09-18T21:12:54.260 INFO:tasks.workunit.client.0.smithi077.stdout:8/463: dwrite d2/d5/d6/d22/d4f/d5a/d5e/f83 [0,4194304] 0 2024-09-18T21:12:54.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.258+0000 7f9f5a3e9640 1 -- 172.21.15.77:0/912364756 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f9f4006e4a0 msgr2=0x7f9f40070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:54.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.258+0000 7f9f5a3e9640 1 --2- 172.21.15.77:0/912364756 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f9f4006e4a0 0x7f9f40070950 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9f54066410 tx=0x7f9f44009120 comp rx=0 tx=0).stop 2024-09-18T21:12:54.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.258+0000 7f9f5a3e9640 1 -- 172.21.15.77:0/912364756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f540ff740 msgr2=0x7f9f5410d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:54.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.258+0000 7f9f5a3e9640 1 --2- 172.21.15.77:0/912364756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f540ff740 0x7f9f5410d760 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c0094f0 tx=0x7f9f3c009da0 comp rx=0 tx=0).stop 2024-09-18T21:12:54.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.258+0000 7f9f5a3e9640 1 -- 172.21.15.77:0/912364756 shutdown_connections 2024-09-18T21:12:54.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.258+0000 7f9f5a3e9640 1 --2- 172.21.15.77:0/912364756 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f9f4006e4a0 0x7f9f40070950 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9f54066410 tx=0x7f9f44009120 comp rx=0 tx=0).stop 2024-09-18T21:12:54.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.258+0000 7f9f5a3e9640 1 --2- 172.21.15.77:0/912364756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f540ff740 0x7f9f5410d760 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:54.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.258+0000 7f9f5a3e9640 1 --2- 172.21.15.77:0/912364756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f540666b0 0x7f9f5410d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:54.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.258+0000 7f9f5a3e9640 1 -- 172.21.15.77:0/912364756 >> 172.21.15.77:0/912364756 conn(0x7f9f540f6c30 msgr2=0x7f9f540f7050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:12:54.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.259+0000 7f9f5a3e9640 1 -- 172.21.15.77:0/912364756 shutdown_connections 2024-09-18T21:12:54.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.259+0000 7f9f5a3e9640 1 -- 172.21.15.77:0/912364756 wait complete. 2024-09-18T21:12:54.265 INFO:tasks.workunit.client.0.smithi077.stdout:8/464: rename d2/d5/d6/d22 to d2/d5f/da8 0 2024-09-18T21:12:54.265 INFO:tasks.workunit.client.0.smithi077.stdout:8/465: readlink d2/l74 0 2024-09-18T21:12:54.270 INFO:tasks.workunit.client.1.smithi103.stdout:8/668: mknod d4/d2d/d4e/cd2 0 2024-09-18T21:12:54.271 INFO:tasks.workunit.client.1.smithi103.stdout:0/553: truncate d1/d5/de/d24/d43/f8b 4082715 0 2024-09-18T21:12:54.271 INFO:tasks.workunit.client.1.smithi103.stdout:8/669: write d4/d2d/d3d/f5a [1613396,89550] 0 2024-09-18T21:12:54.273 INFO:tasks.workunit.client.0.smithi077.stdout:8/466: dwrite d2/d5f/da8/d26/fa2 [0,4194304] 0 2024-09-18T21:12:54.276 INFO:tasks.workunit.client.1.smithi103.stdout:9/599: getdents d18/d52 0 2024-09-18T21:12:54.276 INFO:tasks.workunit.client.1.smithi103.stdout:4/605: write d9/d38/d58/f93 [63737,112686] 0 2024-09-18T21:12:54.279 INFO:tasks.workunit.client.1.smithi103.stdout:1/538: fsync d0/d2/d9/d10/f44 0 2024-09-18T21:12:54.284 INFO:tasks.workunit.client.1.smithi103.stdout:5/630: truncate de/d1f/f86 4924942 0 2024-09-18T21:12:54.285 INFO:tasks.workunit.client.1.smithi103.stdout:5/631: dread - de/f77 zero size 2024-09-18T21:12:54.285 INFO:tasks.workunit.client.1.smithi103.stdout:9/600: dwrite d18/f64 [0,4194304] 0 2024-09-18T21:12:54.286 INFO:tasks.workunit.client.0.smithi077.stdout:8/467: rename d2/d5f/da8/d4f/d5a/c71 to d2/d5f/da8/ca9 0 2024-09-18T21:12:54.286 INFO:tasks.workunit.client.1.smithi103.stdout:5/632: chown de/d1f/d3b/d51/db0/fca 33625918 1 2024-09-18T21:12:54.290 INFO:tasks.workunit.client.1.smithi103.stdout:0/554: symlink d1/d5/de/d19/d1e/d34/da8/d9f/lbd 0 2024-09-18T21:12:54.291 INFO:tasks.workunit.client.0.smithi077.stdout:8/468: rename d2/d36/l65 to d2/d5/d6/d9f/laa 0 2024-09-18T21:12:54.292 INFO:tasks.workunit.client.1.smithi103.stdout:4/606: readlink d9/d2e/d83/db6/d41/l9f 0 2024-09-18T21:12:54.342 INFO:tasks.workunit.client.0.smithi077.stdout:6/486: sync 2024-09-18T21:12:54.342 INFO:tasks.workunit.client.0.smithi077.stdout:7/573: sync 2024-09-18T21:12:54.342 INFO:tasks.workunit.client.0.smithi077.stdout:3/500: sync 2024-09-18T21:12:54.343 INFO:tasks.workunit.client.0.smithi077.stdout:6/487: chown d7/d7e/d11/d1d/f44 230533240 1 2024-09-18T21:12:54.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.351+0000 7f4297f40640 1 -- 172.21.15.77:0/4180259971 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42900fc700 msgr2=0x7f42900fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:54.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.351+0000 7f4297f40640 1 --2- 172.21.15.77:0/4180259971 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42900fc700 0x7f42900fcb70 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f42800048d0 tx=0x7f4280009da0 comp rx=0 tx=0).stop 2024-09-18T21:12:54.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.351+0000 7f4297f40640 1 -- 172.21.15.77:0/4180259971 shutdown_connections 2024-09-18T21:12:54.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.351+0000 7f4297f40640 1 --2- 172.21.15.77:0/4180259971 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42900fc700 0x7f42900fcb70 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:54.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.351+0000 7f4297f40640 1 --2- 172.21.15.77:0/4180259971 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42900fb430 0x7f42900fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:54.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.351+0000 7f4297f40640 1 -- 172.21.15.77:0/4180259971 >> 172.21.15.77:0/4180259971 conn(0x7f42900f6c10 msgr2=0x7f42900f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:12:54.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.351+0000 7f4297f40640 1 -- 172.21.15.77:0/4180259971 shutdown_connections 2024-09-18T21:12:54.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.351+0000 7f4297f40640 1 -- 172.21.15.77:0/4180259971 wait complete. 2024-09-18T21:12:54.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.352+0000 7f4297f40640 1 Processor -- start 2024-09-18T21:12:54.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.352+0000 7f4297f40640 1 -- start start 2024-09-18T21:12:54.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.352+0000 7f4297f40640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42900fb430 0x7f429010fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:12:54.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.352+0000 7f4297f40640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42900fc700 0x7f4290112330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:12:54.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.352+0000 7f4297f40640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4290065d10 con 0x7f42900fb430 2024-09-18T21:12:54.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.352+0000 7f4297f40640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4290065e80 con 0x7f42900fc700 2024-09-18T21:12:54.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.352+0000 7f4295cdc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42900fb430 0x7f429010fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:12:54.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.352+0000 7f4295cdc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42900fb430 0x7f429010fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49596/0 (socket says 172.21.15.77:49596) 2024-09-18T21:12:54.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.352+0000 7f4295cdc640 1 -- 172.21.15.77:0/4154944299 learned_addr learned my addr 172.21.15.77:0/4154944299 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:12:54.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.352+0000 7f42954db640 1 --2- 172.21.15.77:0/4154944299 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42900fc700 0x7f4290112330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:12:54.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.353+0000 7f4295cdc640 1 -- 172.21.15.77:0/4154944299 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42900fc700 msgr2=0x7f4290112330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:54.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.353+0000 7f4295cdc640 1 --2- 172.21.15.77:0/4154944299 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42900fc700 0x7f4290112330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:54.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.353+0000 7f4295cdc640 1 -- 172.21.15.77:0/4154944299 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4280005040 con 0x7f42900fb430 2024-09-18T21:12:54.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.353+0000 7f42954db640 1 --2- 172.21.15.77:0/4154944299 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42900fc700 0x7f4290112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T21:12:54.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.353+0000 7f4295cdc640 1 --2- 172.21.15.77:0/4154944299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42900fb430 0x7f429010fde0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f428c00b790 tx=0x7f428c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:12:54.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.353+0000 7f42867fc640 1 -- 172.21.15.77:0/4154944299 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f428c00c700 con 0x7f42900fb430 2024-09-18T21:12:54.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.353+0000 7f42867fc640 1 -- 172.21.15.77:0/4154944299 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f428c00cd00 con 0x7f42900fb430 2024-09-18T21:12:54.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.353+0000 7f4297f40640 1 -- 172.21.15.77:0/4154944299 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4290112990 con 0x7f42900fb430 2024-09-18T21:12:54.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.353+0000 7f42867fc640 1 -- 172.21.15.77:0/4154944299 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f428c015e70 con 0x7f42900fb430 2024-09-18T21:12:54.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.353+0000 7f4297f40640 1 -- 172.21.15.77:0/4154944299 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4290112e60 con 0x7f42900fb430 2024-09-18T21:12:54.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.354+0000 7f4297f40640 1 -- 172.21.15.77:0/4154944299 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42900fa890 con 0x7f42900fb430 2024-09-18T21:12:54.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.355+0000 7f42867fc640 1 -- 172.21.15.77:0/4154944299 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 24) v1 ==== 91488+0+0 (secure 0 0 0) 0x7f428c012070 con 0x7f42900fb430 2024-09-18T21:12:54.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.355+0000 7f42867fc640 1 --2- 172.21.15.77:0/4154944299 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f427c06e4a0 0x7f427c070950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:12:54.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.355+0000 7f42867fc640 1 -- 172.21.15.77:0/4154944299 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f428c08d5f0 con 0x7f42900fb430 2024-09-18T21:12:54.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.355+0000 7f42954db640 1 --2- 172.21.15.77:0/4154944299 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f427c06e4a0 0x7f427c070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:12:54.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.356+0000 7f42954db640 1 --2- 172.21.15.77:0/4154944299 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f427c06e4a0 0x7f427c070950 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f428000b020 tx=0x7f4280009da0 comp rx=0 tx=0).ready entity=mgr.14578 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:12:54.359 INFO:tasks.workunit.client.1.smithi103.stdout:6/581: link d2/d24/d5a/d67/d76/d43/f45 d2/d24/fb6 0 2024-09-18T21:12:54.363 INFO:tasks.workunit.client.1.smithi103.stdout:9/601: creat d18/d29/d68/fc9 x:0 0 0 2024-09-18T21:12:54.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.362+0000 7f42867fc640 1 -- 172.21.15.77:0/4154944299 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f428c057290 con 0x7f42900fb430 2024-09-18T21:12:54.364 INFO:tasks.workunit.client.1.smithi103.stdout:8/670: write d4/d81/d65/d39/fa9 [1560425,35119] 0 2024-09-18T21:12:54.364 INFO:tasks.workunit.client.1.smithi103.stdout:3/564: link d1/da/df/c1c d1/d23/d25/d4f/d58/d68/d50/d54/caf 0 2024-09-18T21:12:54.366 INFO:tasks.workunit.client.1.smithi103.stdout:8/671: readlink d4/de/d4a/lb4 0 2024-09-18T21:12:54.366 INFO:tasks.workunit.client.0.smithi077.stdout:6/488: symlink d7/d7e/d11/d1d/d5c/la5 0 2024-09-18T21:12:54.367 INFO:tasks.workunit.client.0.smithi077.stdout:6/489: write d7/d7e/d11/d1d/d5c/f95 [351713,4951] 0 2024-09-18T21:12:54.372 INFO:tasks.workunit.client.1.smithi103.stdout:0/555: dread d1/d9/f33 [0,4194304] 0 2024-09-18T21:12:54.373 INFO:tasks.workunit.client.1.smithi103.stdout:4/607: unlink d9/d2e/d61/dc9/f20 0 2024-09-18T21:12:54.375 INFO:tasks.workunit.client.1.smithi103.stdout:2/515: sync 2024-09-18T21:12:54.376 INFO:tasks.workunit.client.1.smithi103.stdout:6/582: fsync d2/d24/d5a/d67/f95 0 2024-09-18T21:12:54.381 INFO:tasks.workunit.client.1.smithi103.stdout:3/565: rename d1/da/l81 to d1/d23/d25/d4f/d58/d86/lb0 0 2024-09-18T21:12:54.383 INFO:tasks.workunit.client.1.smithi103.stdout:6/583: dread d2/d24/d38/f8f [0,4194304] 0 2024-09-18T21:12:54.383 INFO:tasks.workunit.client.1.smithi103.stdout:2/516: dwrite d3/d5/d4a/d56/f97 [0,4194304] 0 2024-09-18T21:12:54.385 INFO:tasks.workunit.client.1.smithi103.stdout:2/517: write d3/f20 [1795660,74662] 0 2024-09-18T21:12:54.388 INFO:tasks.workunit.client.1.smithi103.stdout:1/539: creat d0/d2/d2b/d3a/d42/d72/db0/da7/fb9 x:0 0 0 2024-09-18T21:12:54.391 INFO:tasks.workunit.client.1.smithi103.stdout:6/584: dwrite d2/d3/d8/d4c/d4e/f70 [0,4194304] 0 2024-09-18T21:12:54.391 INFO:tasks.workunit.client.1.smithi103.stdout:6/585: chown d2/d3/d8 879201531 1 2024-09-18T21:12:54.444 INFO:tasks.workunit.client.1.smithi103.stdout:5/633: sync 2024-09-18T21:12:54.444 INFO:tasks.workunit.client.1.smithi103.stdout:7/547: sync 2024-09-18T21:12:54.525 INFO:tasks.workunit.client.0.smithi077.stdout:5/675: sync 2024-09-18T21:12:54.526 INFO:tasks.workunit.client.0.smithi077.stdout:5/676: dread - d0/d6/d3b/fc1 zero size 2024-09-18T21:12:54.531 INFO:tasks.workunit.client.1.smithi103.stdout:3/566: mkdir d1/d2/d18/d30/d4e/db1 0 2024-09-18T21:12:54.532 INFO:tasks.workunit.client.1.smithi103.stdout:3/567: write d1/da/df/f77 [12968,46686] 0 2024-09-18T21:12:54.540 INFO:tasks.workunit.client.1.smithi103.stdout:1/540: mknod d0/d11/d5f/d19/cba 0 2024-09-18T21:12:54.541 INFO:tasks.workunit.client.1.smithi103.stdout:6/586: symlink d2/d3/d8/d4c/d79/lb7 0 2024-09-18T21:12:54.543 INFO:tasks.workunit.client.1.smithi103.stdout:7/548: creat d1/df/d42/d29/faa x:0 0 0 2024-09-18T21:12:54.549 INFO:tasks.workunit.client.1.smithi103.stdout:8/672: rename d4/d81/l6e to d4/d81/d71/d7f/d9d/ld3 0 2024-09-18T21:12:54.554 INFO:tasks.workunit.client.1.smithi103.stdout:1/541: dread d0/d2/d2b/d3a/d42/d72/db0/f6b [0,4194304] 0 2024-09-18T21:12:54.555 INFO:tasks.workunit.client.1.smithi103.stdout:2/518: sync 2024-09-18T21:12:54.556 INFO:tasks.workunit.client.1.smithi103.stdout:2/519: fsync d3/d5/d2f/d32/f8f 0 2024-09-18T21:12:54.556 INFO:tasks.workunit.client.1.smithi103.stdout:2/520: read - d3/d5/f38 zero size 2024-09-18T21:12:54.563 INFO:tasks.workunit.client.0.smithi077.stdout:3/501: truncate db/f13 3385773 0 2024-09-18T21:12:54.563 INFO:tasks.workunit.client.0.smithi077.stdout:3/502: fdatasync db/f68 0 2024-09-18T21:12:54.565 INFO:tasks.workunit.client.0.smithi077.stdout:6/490: mkdir d7/d7e/da6 0 2024-09-18T21:12:54.568 INFO:tasks.workunit.client.1.smithi103.stdout:0/556: creat d1/d9/d3e/fbe x:0 0 0 2024-09-18T21:12:54.568 INFO:tasks.workunit.client.1.smithi103.stdout:0/557: write d1/f9a [700724,73846] 0 2024-09-18T21:12:54.569 INFO:tasks.workunit.client.1.smithi103.stdout:4/608: link d9/d2e/d61/d91/cb3 d9/d2e/ccb 0 2024-09-18T21:12:54.569 INFO:tasks.workunit.client.1.smithi103.stdout:4/609: fdatasync d9/d38/d72/fa0 0 2024-09-18T21:12:54.571 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.569+0000 7f4297f40640 1 -- 172.21.15.77:0/4154944299 --> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4290100b00 con 0x7f427c06e4a0 2024-09-18T21:12:54.571 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:54 smithi077 ceph-mon[27689]: from='client.14638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:12:54.571 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:54 smithi077 ceph-mon[27689]: from='client.24435 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:12:54.571 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:54 smithi077 ceph-mon[27689]: pgmap v18: 65 pgs: 65 active+clean; 1.9 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 61 MiB/s rd, 252 MiB/s wr, 414 op/s 2024-09-18T21:12:54.571 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:54 smithi077 ceph-mon[27689]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:12:54.571 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:54 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/636720715' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:12:54.571 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:54 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/912364756' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T21:12:54.572 INFO:tasks.workunit.client.1.smithi103.stdout:6/587: creat d2/d24/d5a/d67/fb8 x:0 0 0 2024-09-18T21:12:54.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.570+0000 7f42867fc640 1 -- 172.21.15.77:0/4154944299 <== mgr.14578 v2:172.21.15.103:6828/1199124716 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f4290100b00 con 0x7f427c06e4a0 2024-09-18T21:12:54.573 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-18T21:12:54.573 INFO:teuthology.orchestra.run.smithi077.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a", 2024-09-18T21:12:54.573 INFO:teuthology.orchestra.run.smithi077.stdout: "in_progress": true, 2024-09-18T21:12:54.573 INFO:teuthology.orchestra.run.smithi077.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T21:12:54.573 INFO:teuthology.orchestra.run.smithi077.stdout: "services_complete": [], 2024-09-18T21:12:54.573 INFO:teuthology.orchestra.run.smithi077.stdout: "progress": "1/21 daemons upgraded", 2024-09-18T21:12:54.573 INFO:teuthology.orchestra.run.smithi077.stdout: "message": "", 2024-09-18T21:12:54.573 INFO:teuthology.orchestra.run.smithi077.stdout: "is_paused": false 2024-09-18T21:12:54.573 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-18T21:12:54.574 INFO:tasks.workunit.client.0.smithi077.stdout:6/491: mknod d7/d7e/d11/d1d/d49/d55/ca7 0 2024-09-18T21:12:54.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.572+0000 7f4297f40640 1 -- 172.21.15.77:0/4154944299 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f427c06e4a0 msgr2=0x7f427c070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:54.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.572+0000 7f4297f40640 1 --2- 172.21.15.77:0/4154944299 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f427c06e4a0 0x7f427c070950 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f428000b020 tx=0x7f4280009da0 comp rx=0 tx=0).stop 2024-09-18T21:12:54.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.572+0000 7f4297f40640 1 -- 172.21.15.77:0/4154944299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42900fb430 msgr2=0x7f429010fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:54.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.572+0000 7f4297f40640 1 --2- 172.21.15.77:0/4154944299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42900fb430 0x7f429010fde0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f428c00b790 tx=0x7f428c0091d0 comp rx=0 tx=0).stop 2024-09-18T21:12:54.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.572+0000 7f4297f40640 1 -- 172.21.15.77:0/4154944299 shutdown_connections 2024-09-18T21:12:54.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.572+0000 7f4297f40640 1 --2- 172.21.15.77:0/4154944299 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f427c06e4a0 0x7f427c070950 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:54.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.572+0000 7f4297f40640 1 --2- 172.21.15.77:0/4154944299 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42900fc700 0x7f4290112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:54.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.572+0000 7f4297f40640 1 --2- 172.21.15.77:0/4154944299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42900fb430 0x7f429010fde0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:54.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.572+0000 7f4297f40640 1 -- 172.21.15.77:0/4154944299 >> 172.21.15.77:0/4154944299 conn(0x7f42900f6c10 msgr2=0x7f42900f83a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:12:54.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.572+0000 7f4297f40640 1 -- 172.21.15.77:0/4154944299 shutdown_connections 2024-09-18T21:12:54.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.572+0000 7f4297f40640 1 -- 172.21.15.77:0/4154944299 wait complete. 2024-09-18T21:12:54.576 INFO:tasks.workunit.client.1.smithi103.stdout:9/602: link d18/d8d/l75 d18/d52/d6f/d8e/db4/lca 0 2024-09-18T21:12:54.576 INFO:tasks.workunit.client.0.smithi077.stdout:7/574: rename cf to d12/d31/d77/d93/d2a/d6c/cc7 0 2024-09-18T21:12:54.578 INFO:tasks.workunit.client.1.smithi103.stdout:8/673: chown d4/d81/lb0 340 1 2024-09-18T21:12:54.579 INFO:tasks.workunit.client.1.smithi103.stdout:1/542: chown d0/d3/d68/la1 0 1 2024-09-18T21:12:54.582 INFO:tasks.workunit.client.0.smithi077.stdout:7/575: stat d12/d31/d77/d93/d2a/f32 0 2024-09-18T21:12:54.583 INFO:tasks.workunit.client.1.smithi103.stdout:2/521: mknod d3/d5/d2f/d32/cc0 0 2024-09-18T21:12:54.583 INFO:tasks.workunit.client.0.smithi077.stdout:7/576: dread - d12/d31/d77/d93/d89/faf zero size 2024-09-18T21:12:54.584 INFO:tasks.workunit.client.1.smithi103.stdout:1/543: dread d0/d2/d9/d9e/d86/dae/fb4 [0,4194304] 0 2024-09-18T21:12:54.585 INFO:tasks.workunit.client.1.smithi103.stdout:3/568: mkdir d1/d23/d25/d4f/d72/d7e/db2 0 2024-09-18T21:12:54.588 INFO:tasks.workunit.client.1.smithi103.stdout:6/588: chown d2/d3/f55 38 1 2024-09-18T21:12:54.588 INFO:tasks.workunit.client.1.smithi103.stdout:6/589: dread - d2/d24/d5a/d67/fb8 zero size 2024-09-18T21:12:54.589 INFO:tasks.workunit.client.1.smithi103.stdout:9/603: rmdir d18/d8d 39 2024-09-18T21:12:54.589 INFO:tasks.workunit.client.1.smithi103.stdout:6/590: chown d2/d24/c72 6 1 2024-09-18T21:12:54.591 INFO:tasks.workunit.client.1.smithi103.stdout:5/634: rename de/d3e/c74 to de/d1f/d3b/d51/d57/d59/cd0 0 2024-09-18T21:12:54.591 INFO:tasks.workunit.client.1.smithi103.stdout:6/591: truncate d2/d24/d38/d68/f90 944193 0 2024-09-18T21:12:54.591 INFO:tasks.workunit.client.0.smithi077.stdout:7/577: dread d12/d22/f28 [0,4194304] 0 2024-09-18T21:12:54.592 INFO:tasks.workunit.client.1.smithi103.stdout:8/674: creat d4/d2d/d4e/d73/fd4 x:0 0 0 2024-09-18T21:12:54.592 INFO:tasks.workunit.client.1.smithi103.stdout:6/592: chown d2/d24/d5a/d67/d76/d43/f45 1902 1 2024-09-18T21:12:54.593 INFO:tasks.workunit.client.0.smithi077.stdout:7/578: write fb [4198279,27110] 0 2024-09-18T21:12:54.593 INFO:tasks.workunit.client.1.smithi103.stdout:2/522: truncate d3/d5/f35 4444203 0 2024-09-18T21:12:54.593 INFO:tasks.workunit.client.1.smithi103.stdout:1/544: fsync d0/d2/d9/d9e/d86/dae/fb4 0 2024-09-18T21:12:54.594 INFO:tasks.workunit.client.1.smithi103.stdout:2/523: readlink d3/d5/d4a/d56/l92 0 2024-09-18T21:12:54.594 INFO:tasks.workunit.client.0.smithi077.stdout:7/579: truncate d12/d31/d77/da0/fa8 4938815 0 2024-09-18T21:12:54.594 INFO:tasks.workunit.client.1.smithi103.stdout:9/604: rmdir d18/d52/d6f/d8e/db4 39 2024-09-18T21:12:54.595 INFO:tasks.workunit.client.0.smithi077.stdout:7/580: write d12/d56/fa2 [218844,41694] 0 2024-09-18T21:12:54.595 INFO:tasks.workunit.client.1.smithi103.stdout:9/605: stat fa 0 2024-09-18T21:12:54.595 INFO:tasks.workunit.client.1.smithi103.stdout:1/545: dread d0/d2/d9/dc/f28 [0,4194304] 0 2024-09-18T21:12:54.596 INFO:tasks.workunit.client.1.smithi103.stdout:9/606: write d18/d29/f4d [4063929,86660] 0 2024-09-18T21:12:54.598 INFO:tasks.workunit.client.1.smithi103.stdout:0/558: rename d1/d5/d4c to d1/d56/dbf 0 2024-09-18T21:12:54.600 INFO:tasks.workunit.client.0.smithi077.stdout:7/581: rename l9 to d12/d31/d77/d93/d89/lc8 0 2024-09-18T21:12:54.601 INFO:tasks.workunit.client.1.smithi103.stdout:8/675: creat d4/d2d/d3d/da0/dab/fd5 x:0 0 0 2024-09-18T21:12:54.602 INFO:tasks.workunit.client.0.smithi077.stdout:1/521: sync 2024-09-18T21:12:54.602 INFO:tasks.workunit.client.1.smithi103.stdout:2/524: mknod d3/d5/d2c/cc1 0 2024-09-18T21:12:54.602 INFO:tasks.workunit.client.1.smithi103.stdout:8/676: read - d4/d2d/d3d/da0/dab/fd5 zero size 2024-09-18T21:12:54.604 INFO:tasks.workunit.client.1.smithi103.stdout:9/607: unlink d18/d29/d68/fc9 0 2024-09-18T21:12:54.606 INFO:tasks.workunit.client.0.smithi077.stdout:1/522: creat d3/d6a/d9b/d68/d3e/fc0 x:0 0 0 2024-09-18T21:12:54.607 INFO:tasks.workunit.client.0.smithi077.stdout:7/582: creat d12/d22/fc9 x:0 0 0 2024-09-18T21:12:54.608 INFO:tasks.workunit.client.1.smithi103.stdout:2/525: fsync d3/d5/d25/f5f 0 2024-09-18T21:12:54.611 INFO:tasks.workunit.client.1.smithi103.stdout:2/526: dread d3/d5/d2f/d48/fa6 [0,4194304] 0 2024-09-18T21:12:54.611 INFO:tasks.workunit.client.1.smithi103.stdout:8/677: mknod d4/d81/d71/d7f/d9d/cd6 0 2024-09-18T21:12:54.611 INFO:tasks.workunit.client.1.smithi103.stdout:8/678: chown d4/d2d/d87/dbb 0 1 2024-09-18T21:12:54.613 INFO:tasks.workunit.client.0.smithi077.stdout:7/583: creat d12/d22/daa/dc0/dac/dad/fca x:0 0 0 2024-09-18T21:12:54.613 INFO:tasks.workunit.client.0.smithi077.stdout:1/523: dread d3/d8/d49/d4e/d5a/f78 [0,4194304] 0 2024-09-18T21:12:54.615 INFO:tasks.workunit.client.1.smithi103.stdout:1/546: creat d0/d2/d2b/d3a/d42/d9c/fbb x:0 0 0 2024-09-18T21:12:54.619 INFO:tasks.workunit.client.0.smithi077.stdout:1/524: mkdir d3/d8/d13/d18/dc1 0 2024-09-18T21:12:54.621 INFO:tasks.workunit.client.0.smithi077.stdout:7/584: symlink d12/d31/lcb 0 2024-09-18T21:12:54.621 INFO:tasks.workunit.client.0.smithi077.stdout:7/585: chown d12/d31/d77/d93/d89/d99 26 1 2024-09-18T21:12:54.622 INFO:tasks.workunit.client.0.smithi077.stdout:7/586: fdatasync d12/f9a 0 2024-09-18T21:12:54.622 INFO:tasks.workunit.client.1.smithi103.stdout:2/527: creat d3/d5/d2c/fc2 x:0 0 0 2024-09-18T21:12:54.623 INFO:tasks.workunit.client.1.smithi103.stdout:2/528: dread - d3/d5/d2c/d54/f7b zero size 2024-09-18T21:12:54.623 INFO:tasks.workunit.client.1.smithi103.stdout:6/593: rmdir d2/d24/d5a/d67 39 2024-09-18T21:12:54.624 INFO:tasks.workunit.client.1.smithi103.stdout:6/594: read - d2/d3/d8/d4c/d79/f82 zero size 2024-09-18T21:12:54.625 INFO:tasks.workunit.client.1.smithi103.stdout:6/595: readlink d2/d24/d38/l46 0 2024-09-18T21:12:54.627 INFO:tasks.workunit.client.1.smithi103.stdout:8/679: dread d4/d81/d71/f7e [0,4194304] 0 2024-09-18T21:12:54.627 INFO:tasks.workunit.client.0.smithi077.stdout:3/503: truncate db/d14/d32/d4f/f60 3517031 0 2024-09-18T21:12:54.628 INFO:tasks.workunit.client.1.smithi103.stdout:8/680: stat d4/d26/d56/d77/d9f/fa6 0 2024-09-18T21:12:54.628 INFO:tasks.workunit.client.0.smithi077.stdout:3/504: write db/d14/f1d [3510678,13278] 0 2024-09-18T21:12:54.630 INFO:tasks.workunit.client.1.smithi103.stdout:4/610: rename d9/d2e/d61/dc9/f2a to d9/fcc 0 2024-09-18T21:12:54.633 INFO:tasks.workunit.client.0.smithi077.stdout:7/587: mknod d12/d22/d59/d72/d68/ccc 0 2024-09-18T21:12:54.633 INFO:tasks.workunit.client.1.smithi103.stdout:8/681: dwrite d4/d2d/d4e/d73/fd4 [0,4194304] 0 2024-09-18T21:12:54.634 INFO:tasks.workunit.client.0.smithi077.stdout:3/505: dread db/d14/d72/f91 [0,4194304] 0 2024-09-18T21:12:54.634 INFO:tasks.workunit.client.1.smithi103.stdout:2/529: readlink d3/d5/l2b 0 2024-09-18T21:12:54.637 INFO:tasks.workunit.client.0.smithi077.stdout:6/492: dwrite d7/d7e/d11/d3e/d42/d88/da4/f2b [0,4194304] 0 2024-09-18T21:12:54.638 INFO:tasks.workunit.client.1.smithi103.stdout:6/596: truncate d2/d24/f5f 929043 0 2024-09-18T21:12:54.641 INFO:tasks.workunit.client.1.smithi103.stdout:1/547: symlink d0/d2/d9/lbc 0 2024-09-18T21:12:54.649 INFO:tasks.workunit.client.1.smithi103.stdout:4/611: mkdir d9/d1c/dcd 0 2024-09-18T21:12:54.651 INFO:tasks.workunit.client.1.smithi103.stdout:8/682: mkdir d4/d81/dd7 0 2024-09-18T21:12:54.652 INFO:tasks.workunit.client.0.smithi077.stdout:6/493: unlink d7/l13 0 2024-09-18T21:12:54.653 INFO:tasks.workunit.client.1.smithi103.stdout:4/612: truncate d9/d1c/d77/f3d 1963879 0 2024-09-18T21:12:54.655 INFO:tasks.workunit.client.0.smithi077.stdout:6/494: symlink d7/d7e/d11/d1d/d31/la8 0 2024-09-18T21:12:54.655 INFO:tasks.workunit.client.1.smithi103.stdout:2/530: creat d3/d5/d2c/d77/d9c/db8/fc3 x:0 0 0 2024-09-18T21:12:54.657 INFO:tasks.workunit.client.1.smithi103.stdout:0/559: rename d1/d56 to d1/d5/de/dc0 0 2024-09-18T21:12:54.658 INFO:tasks.workunit.client.0.smithi077.stdout:6/495: creat d7/fa9 x:0 0 0 2024-09-18T21:12:54.659 INFO:tasks.workunit.client.1.smithi103.stdout:2/531: truncate d3/d5/d2f/f91 561935 0 2024-09-18T21:12:54.663 INFO:tasks.workunit.client.1.smithi103.stdout:9/608: rename d18/d29/d62 to d18/d52/d6f/db9/dcb 0 2024-09-18T21:12:54.666 INFO:tasks.workunit.client.1.smithi103.stdout:8/683: getdents d4/d2d/dc1 0 2024-09-18T21:12:54.667 INFO:tasks.workunit.client.1.smithi103.stdout:8/684: chown d4/d26/d56/d77/cad 31176 1 2024-09-18T21:12:54.668 INFO:tasks.workunit.client.0.smithi077.stdout:3/506: dread db/f35 [4194304,4194304] 0 2024-09-18T21:12:54.668 INFO:tasks.workunit.client.1.smithi103.stdout:8/685: write d4/de/f46 [4048015,93961] 0 2024-09-18T21:12:54.669 INFO:tasks.workunit.client.0.smithi077.stdout:3/507: dread - db/f28 zero size 2024-09-18T21:12:54.669 INFO:tasks.workunit.client.0.smithi077.stdout:3/508: readlink db/d14/l23 0 2024-09-18T21:12:54.670 INFO:tasks.workunit.client.1.smithi103.stdout:2/532: readlink d3/l19 0 2024-09-18T21:12:54.670 INFO:tasks.workunit.client.0.smithi077.stdout:6/496: getdents d7/d7c 0 2024-09-18T21:12:54.670 INFO:tasks.workunit.client.1.smithi103.stdout:9/609: dwrite d18/d29/d68/d78/fba [0,4194304] 0 2024-09-18T21:12:54.670 INFO:tasks.workunit.client.0.smithi077.stdout:1/525: write d3/d8/f47 [377701,117705] 0 2024-09-18T21:12:54.671 INFO:tasks.workunit.client.1.smithi103.stdout:8/686: read - d4/d2d/d3d/da0/dab/fd5 zero size 2024-09-18T21:12:54.672 INFO:tasks.workunit.client.1.smithi103.stdout:8/687: chown d4/de/c88 16 1 2024-09-18T21:12:54.672 INFO:tasks.workunit.client.0.smithi077.stdout:3/509: write db/d14/d32/d49/d4e/d6a/f88 [449678,7147] 0 2024-09-18T21:12:54.673 INFO:tasks.workunit.client.0.smithi077.stdout:3/510: readlink db/d14/l23 0 2024-09-18T21:12:54.675 INFO:tasks.workunit.client.0.smithi077.stdout:3/511: truncate db/d14/f34 4261263 0 2024-09-18T21:12:54.676 INFO:tasks.workunit.client.0.smithi077.stdout:6/497: dread d7/f1f [0,4194304] 0 2024-09-18T21:12:54.676 INFO:tasks.workunit.client.1.smithi103.stdout:4/613: link d9/d2e/la4 d9/d2e/lce 0 2024-09-18T21:12:54.677 INFO:tasks.workunit.client.0.smithi077.stdout:6/498: chown d7/d7e/l3b 483 1 2024-09-18T21:12:54.683 INFO:tasks.workunit.client.1.smithi103.stdout:9/610: creat d18/d29/d68/d92/d9c/fcc x:0 0 0 2024-09-18T21:12:54.683 INFO:tasks.workunit.client.0.smithi077.stdout:3/512: dwrite db/d14/f34 [0,4194304] 0 2024-09-18T21:12:54.684 INFO:tasks.workunit.client.1.smithi103.stdout:9/611: write d18/d29/d68/d78/fba [1292260,82798] 0 2024-09-18T21:12:54.684 INFO:tasks.workunit.client.0.smithi077.stdout:3/513: write db/d14/d32/d4f/f82 [496340,92090] 0 2024-09-18T21:12:54.687 INFO:tasks.workunit.client.1.smithi103.stdout:6/597: rename d2/d3/c23 to d2/d24/d38/d68/cb9 0 2024-09-18T21:12:54.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.688+0000 7f8f9e5b9640 1 -- 172.21.15.77:0/2841096964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f9806e540 msgr2=0x7f8f98108730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:54.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.688+0000 7f8f9e5b9640 1 --2- 172.21.15.77:0/2841096964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f9806e540 0x7f8f98108730 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8f800048d0 tx=0x7f8f80009da0 comp rx=0 tx=0).stop 2024-09-18T21:12:54.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.688+0000 7f8f9e5b9640 1 -- 172.21.15.77:0/2841096964 shutdown_connections 2024-09-18T21:12:54.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.688+0000 7f8f9e5b9640 1 --2- 172.21.15.77:0/2841096964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f9806e540 0x7f8f98108730 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:54.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.688+0000 7f8f9e5b9640 1 --2- 172.21.15.77:0/2841096964 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f9806dbf0 0x7f8f9806e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:54.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.688+0000 7f8f9e5b9640 1 -- 172.21.15.77:0/2841096964 >> 172.21.15.77:0/2841096964 conn(0x7f8f98069560 msgr2=0x7f8f9806b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:12:54.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.689+0000 7f8f9e5b9640 1 -- 172.21.15.77:0/2841096964 shutdown_connections 2024-09-18T21:12:54.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.689+0000 7f8f9e5b9640 1 -- 172.21.15.77:0/2841096964 wait complete. 2024-09-18T21:12:54.691 INFO:tasks.workunit.client.1.smithi103.stdout:8/688: creat d4/d2d/d4e/fd8 x:0 0 0 2024-09-18T21:12:54.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.689+0000 7f8f9e5b9640 1 Processor -- start 2024-09-18T21:12:54.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.689+0000 7f8f9e5b9640 1 -- start start 2024-09-18T21:12:54.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.690+0000 7f8f9e5b9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f9806dbf0 0x7f8f9811bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:12:54.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.690+0000 7f8f9e5b9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f9806e540 0x7f8f9811c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:12:54.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.690+0000 7f8f9e5b9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9811ca90 con 0x7f8f9806e540 2024-09-18T21:12:54.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.690+0000 7f8f9e5b9640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9811d1d0 con 0x7f8f9806dbf0 2024-09-18T21:12:54.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.690+0000 7f8f8f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f9806e540 0x7f8f9811c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:12:54.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.690+0000 7f8f8f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f9806e540 0x7f8f9811c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49614/0 (socket says 172.21.15.77:49614) 2024-09-18T21:12:54.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.690+0000 7f8f8f7fe640 1 -- 172.21.15.77:0/2774712536 learned_addr learned my addr 172.21.15.77:0/2774712536 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:12:54.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.690+0000 7f8f97fff640 1 --2- 172.21.15.77:0/2774712536 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f9806dbf0 0x7f8f9811bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:12:54.693 INFO:tasks.workunit.client.0.smithi077.stdout:3/514: dwrite db/d14/d32/f86 [0,4194304] 0 2024-09-18T21:12:54.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.691+0000 7f8f8f7fe640 1 -- 172.21.15.77:0/2774712536 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f9806dbf0 msgr2=0x7f8f9811bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:54.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.691+0000 7f8f8f7fe640 1 --2- 172.21.15.77:0/2774712536 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f9806dbf0 0x7f8f9811bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:54.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.691+0000 7f8f8f7fe640 1 -- 172.21.15.77:0/2774712536 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f80005040 con 0x7f8f9806e540 2024-09-18T21:12:54.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.691+0000 7f8f8f7fe640 1 --2- 172.21.15.77:0/2774712536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f9806e540 0x7f8f9811c440 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8f800043d0 tx=0x7f8f80009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:12:54.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.692+0000 7f8f957fa640 1 -- 172.21.15.77:0/2774712536 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f80038070 con 0x7f8f9806e540 2024-09-18T21:12:54.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.692+0000 7f8f9e5b9640 1 -- 172.21.15.77:0/2774712536 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f9811d400 con 0x7f8f9806e540 2024-09-18T21:12:54.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.692+0000 7f8f9e5b9640 1 -- 172.21.15.77:0/2774712536 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f9811d9a0 con 0x7f8f9806e540 2024-09-18T21:12:54.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.693+0000 7f8f957fa640 1 -- 172.21.15.77:0/2774712536 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8f80009800 con 0x7f8f9806e540 2024-09-18T21:12:54.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.693+0000 7f8f957fa640 1 -- 172.21.15.77:0/2774712536 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f8003e430 con 0x7f8f9806e540 2024-09-18T21:12:54.695 INFO:tasks.workunit.client.0.smithi077.stdout:6/499: mknod d7/d7e/d11/caa 0 2024-09-18T21:12:54.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.695+0000 7f8f9e5b9640 1 -- 172.21.15.77:0/2774712536 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f78005240 con 0x7f8f9806e540 2024-09-18T21:12:54.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.695+0000 7f8f957fa640 1 -- 172.21.15.77:0/2774712536 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 24) v1 ==== 91488+0+0 (secure 0 0 0) 0x7f8f80030020 con 0x7f8f9806e540 2024-09-18T21:12:54.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.696+0000 7f8f957fa640 1 --2- 172.21.15.77:0/2774712536 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f8f8406e4a0 0x7f8f84070950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:12:54.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.696+0000 7f8f957fa640 1 -- 172.21.15.77:0/2774712536 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f8f800adc80 con 0x7f8f9806e540 2024-09-18T21:12:54.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.696+0000 7f8f97fff640 1 --2- 172.21.15.77:0/2774712536 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f8f8406e4a0 0x7f8f84070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:12:54.699 INFO:tasks.workunit.client.1.smithi103.stdout:4/614: creat d9/d2e/d83/db6/d41/d64/fcf x:0 0 0 2024-09-18T21:12:54.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.698+0000 7f8f97fff640 1 --2- 172.21.15.77:0/2774712536 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f8f8406e4a0 0x7f8f84070950 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8f88009fd0 tx=0x7f8f88009e50 comp rx=0 tx=0).ready entity=mgr.14578 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:12:54.700 INFO:tasks.workunit.client.1.smithi103.stdout:2/533: mkdir d3/d5/d2c/d77/d9c/db7/dc4 0 2024-09-18T21:12:54.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:54.701+0000 7f8f957fa640 1 -- 172.21.15.77:0/2774712536 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f8f80077920 con 0x7f8f9806e540 2024-09-18T21:12:54.704 INFO:tasks.workunit.client.0.smithi077.stdout:6/500: creat d7/fab x:0 0 0 2024-09-18T21:12:54.704 INFO:tasks.workunit.client.1.smithi103.stdout:1/548: dwrite d0/d2/d9/f63 [0,4194304] 0 2024-09-18T21:12:54.705 INFO:tasks.workunit.client.0.smithi077.stdout:6/501: dread - d7/d7e/d11/fa2 zero size 2024-09-18T21:12:54.707 INFO:tasks.workunit.client.1.smithi103.stdout:1/549: write d0/d2/d9/f65 [2726969,115630] 0 2024-09-18T21:12:54.708 INFO:tasks.workunit.client.1.smithi103.stdout:6/598: fdatasync d2/f12 0 2024-09-18T21:12:54.709 INFO:tasks.workunit.client.0.smithi077.stdout:1/526: getdents d3/d6a/d9b/d68 0 2024-09-18T21:12:54.712 INFO:tasks.workunit.client.0.smithi077.stdout:1/527: read d3/d8/d13/f14 [1036515,87308] 0 2024-09-18T21:12:54.713 INFO:tasks.workunit.client.0.smithi077.stdout:6/502: mknod d7/d7e/d11/d1d/d4c/cac 0 2024-09-18T21:12:54.714 INFO:tasks.workunit.client.1.smithi103.stdout:4/615: creat d9/d2e/d61/d91/fd0 x:0 0 0 2024-09-18T21:12:54.714 INFO:tasks.workunit.client.1.smithi103.stdout:2/534: dread d3/d5/d2c/f88 [0,4194304] 0 2024-09-18T21:12:54.718 INFO:tasks.workunit.client.0.smithi077.stdout:1/528: mknod d3/d6a/cc2 0 2024-09-18T21:12:54.720 INFO:tasks.workunit.client.0.smithi077.stdout:6/503: rename d7/d7e/d11/d1d/d49/l52 to d7/d7e/d11/d1d/d4c/lad 0 2024-09-18T21:12:54.724 INFO:tasks.workunit.client.1.smithi103.stdout:1/550: creat d0/fbd x:0 0 0 2024-09-18T21:12:54.725 INFO:tasks.workunit.client.1.smithi103.stdout:1/551: write d0/d2/d2b/d3a/d42/d9c/fbb [511888,82674] 0 2024-09-18T21:12:54.726 INFO:tasks.workunit.client.0.smithi077.stdout:1/529: creat d3/d8/d75/d89/dbb/fc3 x:0 0 0 2024-09-18T21:12:54.734 INFO:tasks.workunit.client.1.smithi103.stdout:2/535: truncate d3/d5/d2f/d32/f7d 324918 0 2024-09-18T21:12:54.735 INFO:tasks.workunit.client.1.smithi103.stdout:2/536: chown d3/d5/d2f/d32/f60 10584988 1 2024-09-18T21:12:54.735 INFO:tasks.workunit.client.0.smithi077.stdout:6/504: getdents d7/d7e/d11/d1d/d5c 0 2024-09-18T21:12:54.736 INFO:tasks.workunit.client.1.smithi103.stdout:0/560: symlink d1/d5/de/d19/d1e/d34/da8/d9f/d8d/da7/lc1 0 2024-09-18T21:12:54.737 INFO:tasks.workunit.client.0.smithi077.stdout:1/530: write d3/d38/d97/f98 [2498533,43876] 0 2024-09-18T21:12:54.738 INFO:tasks.workunit.client.0.smithi077.stdout:1/531: fdatasync d3/d8/f67 0 2024-09-18T21:12:54.739 INFO:tasks.workunit.client.1.smithi103.stdout:5/635: sync 2024-09-18T21:12:54.739 INFO:tasks.workunit.client.1.smithi103.stdout:7/549: sync 2024-09-18T21:12:54.739 INFO:tasks.workunit.client.1.smithi103.stdout:3/569: sync 2024-09-18T21:12:54.741 INFO:tasks.workunit.client.0.smithi077.stdout:6/505: dread - d7/d7e/d11/d3e/f7f zero size 2024-09-18T21:12:54.742 INFO:tasks.workunit.client.0.smithi077.stdout:6/506: readlink d7/d7e/d11/d1d/d31/la8 0 2024-09-18T21:12:54.743 INFO:tasks.workunit.client.1.smithi103.stdout:6/599: read d2/d3/d8/f75 [444933,71679] 0 2024-09-18T21:12:54.743 INFO:tasks.workunit.client.0.smithi077.stdout:1/532: rename d3/d6a/d9b/d68/c43 to d3/d6a/cc4 0 2024-09-18T21:12:54.744 INFO:tasks.workunit.client.1.smithi103.stdout:4/616: mkdir d9/d1c/dcd/dd1 0 2024-09-18T21:12:54.745 INFO:tasks.workunit.client.0.smithi077.stdout:6/507: unlink d7/l7d 0 2024-09-18T21:12:54.746 INFO:tasks.workunit.client.0.smithi077.stdout:6/508: truncate d7/d7e/f28 4395234 0 2024-09-18T21:12:54.747 INFO:tasks.workunit.client.1.smithi103.stdout:2/537: creat d3/d5/d2f/fc5 x:0 0 0 2024-09-18T21:12:54.747 INFO:tasks.workunit.client.0.smithi077.stdout:1/533: rmdir d3/d8/d13/d18/d99 39 2024-09-18T21:12:54.748 INFO:tasks.workunit.client.0.smithi077.stdout:6/509: truncate d7/d7e/d11/d1d/d4c/f8a 85631 0 2024-09-18T21:12:54.748 INFO:tasks.workunit.client.0.smithi077.stdout:1/534: chown d3/d38/fb3 702946 1 2024-09-18T21:12:54.749 INFO:tasks.workunit.client.1.smithi103.stdout:0/561: mknod d1/d5/de/d24/cc2 0 2024-09-18T21:12:54.749 INFO:tasks.workunit.client.1.smithi103.stdout:9/612: link d18/d8d/laf d18/d52/lcd 0 2024-09-18T21:12:54.749 INFO:tasks.workunit.client.0.smithi077.stdout:1/535: write d3/d6a/d9b/f3b [4390428,117651] 0 2024-09-18T21:12:54.750 INFO:tasks.workunit.client.1.smithi103.stdout:3/570: creat d1/d23/d25/d4f/d72/d85/fb3 x:0 0 0 2024-09-18T21:12:54.752 INFO:tasks.workunit.client.1.smithi103.stdout:1/552: dwrite d0/d2/d9/d10/d5d/f88 [0,4194304] 0 2024-09-18T21:12:54.753 INFO:tasks.workunit.client.1.smithi103.stdout:7/550: symlink d1/df/d42/d1f/d5d/lab 0 2024-09-18T21:12:54.753 INFO:tasks.workunit.client.1.smithi103.stdout:3/571: write d1/d23/d25/d4f/d51/f5d [218008,17276] 0 2024-09-18T21:12:54.753 INFO:tasks.workunit.client.1.smithi103.stdout:1/553: stat d0/d3/f29 0 2024-09-18T21:12:54.754 INFO:tasks.workunit.client.1.smithi103.stdout:9/613: dread d18/d52/f82 [0,4194304] 0 2024-09-18T21:12:54.754 INFO:tasks.workunit.client.1.smithi103.stdout:7/551: readlink d1/df/d43/d61/l90 0 2024-09-18T21:12:54.754 INFO:tasks.workunit.client.0.smithi077.stdout:1/536: unlink d3/d6a/d9b/l58 0 2024-09-18T21:12:54.758 INFO:tasks.workunit.client.1.smithi103.stdout:4/617: rename d9/d2e/d61/dc9 to d9/d2e/d61/d91/dd2 0 2024-09-18T21:12:54.760 INFO:tasks.workunit.client.1.smithi103.stdout:2/538: creat d3/d5/d2c/d77/d9c/db7/fc6 x:0 0 0 2024-09-18T21:12:54.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:54 smithi103 ceph-mon[34827]: from='client.14638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:12:54.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:54 smithi103 ceph-mon[34827]: from='client.24435 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:12:54.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:54 smithi103 ceph-mon[34827]: pgmap v18: 65 pgs: 65 active+clean; 1.9 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 61 MiB/s rd, 252 MiB/s wr, 414 op/s 2024-09-18T21:12:54.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:54 smithi103 ceph-mon[34827]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:12:54.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:54 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/636720715' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:12:54.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:54 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/912364756' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T21:12:54.768 INFO:tasks.workunit.client.0.smithi077.stdout:1/537: creat d3/d6a/d9b/fc5 x:0 0 0 2024-09-18T21:12:54.768 INFO:tasks.workunit.client.1.smithi103.stdout:8/689: link d4/d81/c5f d4/de/d4a/d59/d9c/cd9 0 2024-09-18T21:12:54.768 INFO:tasks.workunit.client.1.smithi103.stdout:3/572: dread d1/f24 [0,4194304] 0 2024-09-18T21:12:54.770 INFO:tasks.workunit.client.1.smithi103.stdout:5/636: unlink de/d1f/d3b/d58/dc4/d33/d4f/fbd 0 2024-09-18T21:12:54.770 INFO:tasks.workunit.client.1.smithi103.stdout:6/600: dwrite d2/d3/d8/f2a [0,4194304] 0 2024-09-18T21:12:54.771 INFO:tasks.workunit.client.0.smithi077.stdout:1/538: creat d3/d8/d75/d89/dbb/fc6 x:0 0 0 2024-09-18T21:12:54.771 INFO:tasks.workunit.client.1.smithi103.stdout:2/539: dwrite d3/d5/d2f/d32/d46/fb4 [0,4194304] 0 2024-09-18T21:12:54.772 INFO:tasks.workunit.client.1.smithi103.stdout:1/554: creat d0/d2/d9/dc/d6e/fbe x:0 0 0 2024-09-18T21:12:54.775 INFO:tasks.workunit.client.1.smithi103.stdout:1/555: write d0/d2/d9/d10/d5d/f8a [3288017,83898] 0 2024-09-18T21:12:54.780 INFO:tasks.workunit.client.1.smithi103.stdout:9/614: creat d18/da4/fce x:0 0 0 2024-09-18T21:12:54.781 INFO:tasks.workunit.client.0.smithi077.stdout:1/539: write d3/d6a/f81 [500324,119292] 0 2024-09-18T21:12:54.782 INFO:tasks.workunit.client.1.smithi103.stdout:9/615: write d18/d52/d6f/d8e/d8f/dbd/dc3/fa7 [1011534,31041] 0 2024-09-18T21:12:54.783 INFO:tasks.workunit.client.0.smithi077.stdout:1/540: write d3/d8/f67 [3509682,71620] 0 2024-09-18T21:12:54.783 INFO:tasks.workunit.client.1.smithi103.stdout:9/616: stat d18/d8d/d2f/f63 0 2024-09-18T21:12:54.783 INFO:tasks.workunit.client.1.smithi103.stdout:9/617: stat f17 0 2024-09-18T21:12:54.784 INFO:tasks.workunit.client.1.smithi103.stdout:5/637: mkdir de/d1f/d3b/d58/dd1 0 2024-09-18T21:12:54.785 INFO:tasks.workunit.client.1.smithi103.stdout:9/618: chown d18/d8d/d2f/f50 1853631 1 2024-09-18T21:12:54.786 INFO:tasks.workunit.client.1.smithi103.stdout:5/638: write de/d1f/d3b/d58/f67 [4929296,32460] 0 2024-09-18T21:12:54.787 INFO:tasks.workunit.client.0.smithi077.stdout:1/541: symlink d3/d6a/d9b/d68/lc7 0 2024-09-18T21:12:54.790 INFO:tasks.workunit.client.1.smithi103.stdout:5/639: dread de/ff [0,4194304] 0 2024-09-18T21:12:54.791 INFO:tasks.workunit.client.1.smithi103.stdout:0/562: symlink d1/d9/d3e/lc3 0 2024-09-18T21:12:54.792 INFO:tasks.workunit.client.1.smithi103.stdout:5/640: dread - de/d1f/d3b/d58/dc4/d33/d4f/fa4 zero size 2024-09-18T21:12:54.793 INFO:tasks.workunit.client.1.smithi103.stdout:0/563: read - d1/d5/de/dc0/dbf/d4e/f85 zero size 2024-09-18T21:12:54.793 INFO:tasks.workunit.client.1.smithi103.stdout:6/601: fsync d2/d24/d5a/d67/d76/d43/d44/f54 0 2024-09-18T21:12:54.794 INFO:tasks.workunit.client.1.smithi103.stdout:9/619: rename d18/f3e to d18/d29/fcf 0 2024-09-18T21:12:54.796 INFO:tasks.workunit.client.1.smithi103.stdout:0/564: write d1/d5/de/d19/d1e/d34/da8/d9f/f46 [1234228,120083] 0 2024-09-18T21:12:54.797 INFO:tasks.workunit.client.1.smithi103.stdout:3/573: rmdir d1/d2/d18/d30/d4e/d83 0 2024-09-18T21:12:54.799 INFO:tasks.workunit.client.1.smithi103.stdout:6/602: dread d2/d24/d38/f89 [0,4194304] 0 2024-09-18T21:12:54.800 INFO:tasks.workunit.client.1.smithi103.stdout:5/641: dwrite de/d1f/f24 [0,4194304] 0 2024-09-18T21:12:54.803 INFO:tasks.workunit.client.1.smithi103.stdout:6/603: symlink d2/d24/d38/d68/lba 0 2024-09-18T21:12:54.805 INFO:tasks.workunit.client.1.smithi103.stdout:9/620: mknod d18/d52/d6f/d8e/db4/cd0 0 2024-09-18T21:12:54.805 INFO:tasks.workunit.client.1.smithi103.stdout:5/642: symlink de/d1f/d3b/d51/ld2 0 2024-09-18T21:12:54.806 INFO:tasks.workunit.client.1.smithi103.stdout:3/574: mkdir d1/d23/d25/da1/da5/db4 0 2024-09-18T21:12:54.808 INFO:tasks.workunit.client.1.smithi103.stdout:8/690: dread d4/de/d4a/d59/d5e/fc7 [0,4194304] 0 2024-09-18T21:12:54.808 INFO:tasks.workunit.client.1.smithi103.stdout:9/621: mkdir d18/d29/d68/d92/dd1 0 2024-09-18T21:12:54.809 INFO:tasks.workunit.client.1.smithi103.stdout:5/643: mknod de/d1f/d3b/d51/d57/d59/cd3 0 2024-09-18T21:12:54.812 INFO:tasks.workunit.client.1.smithi103.stdout:6/604: creat d2/d24/d5a/d67/d76/d43/fbb x:0 0 0 2024-09-18T21:12:54.813 INFO:tasks.workunit.client.1.smithi103.stdout:3/575: dwrite d1/d23/d25/f92 [0,4194304] 0 2024-09-18T21:12:54.814 INFO:tasks.workunit.client.1.smithi103.stdout:9/622: creat d18/d52/d6f/d8e/db4/fd2 x:0 0 0 2024-09-18T21:12:54.814 INFO:tasks.workunit.client.1.smithi103.stdout:9/623: fdatasync fc 0 2024-09-18T21:12:54.815 INFO:tasks.workunit.client.1.smithi103.stdout:6/605: creat d2/d24/d38/d68/fbc x:0 0 0 2024-09-18T21:12:54.819 INFO:tasks.workunit.client.1.smithi103.stdout:6/606: read d2/d3/d8/d4c/d7d/f92 [479275,79779] 0 2024-09-18T21:12:54.824 INFO:tasks.workunit.client.1.smithi103.stdout:6/607: unlink d2/d3/f2f 0 2024-09-18T21:12:54.826 INFO:tasks.workunit.client.1.smithi103.stdout:5/644: getdents de/d1f/d3b/d58 0 2024-09-18T21:12:54.827 INFO:tasks.workunit.client.1.smithi103.stdout:7/552: truncate d1/f7c 386715 0 2024-09-18T21:12:54.828 INFO:tasks.workunit.client.1.smithi103.stdout:6/608: fdatasync d2/f22 0 2024-09-18T21:12:54.828 INFO:tasks.workunit.client.1.smithi103.stdout:7/553: chown d1/df/d42/f4e 2018 1 2024-09-18T21:12:54.829 INFO:tasks.workunit.client.1.smithi103.stdout:5/645: rmdir de/d1f/d3b/d58 39 2024-09-18T21:12:54.830 INFO:tasks.workunit.client.1.smithi103.stdout:7/554: chown d1/df/d42/d1f/d2e/d3f/f56 3 1 2024-09-18T21:12:54.831 INFO:tasks.workunit.client.1.smithi103.stdout:5/646: truncate de/d1f/d3b/d3c/f89 790450 0 2024-09-18T21:12:54.831 INFO:tasks.workunit.client.1.smithi103.stdout:5/647: fdatasync de/f77 0 2024-09-18T21:12:54.832 INFO:tasks.workunit.client.0.smithi077.stdout:1/542: write d3/f10 [5708970,73673] 0 2024-09-18T21:12:54.833 INFO:tasks.workunit.client.0.smithi077.stdout:1/543: stat d3/d6a/d9b/d68/d3e/l4b 0 2024-09-18T21:12:54.836 INFO:tasks.workunit.client.0.smithi077.stdout:1/544: symlink d3/d8/d49/lc8 0 2024-09-18T21:12:54.839 INFO:tasks.workunit.client.0.smithi077.stdout:1/545: unlink d3/d8/f7b 0 2024-09-18T21:12:54.843 INFO:tasks.workunit.client.0.smithi077.stdout:1/546: link d3/d6a/d9b/d68/c52 d3/d38/d97/cc9 0 2024-09-18T21:12:54.846 INFO:tasks.workunit.client.0.smithi077.stdout:1/547: unlink d3/d8/d13/d18/d99/caa 0 2024-09-18T21:12:54.847 INFO:tasks.workunit.client.0.smithi077.stdout:1/548: readlink d3/d6a/d9b/d68/d3e/l4b 0 2024-09-18T21:12:54.849 INFO:tasks.workunit.client.0.smithi077.stdout:0/604: sync 2024-09-18T21:12:54.849 INFO:tasks.workunit.client.0.smithi077.stdout:9/478: sync 2024-09-18T21:12:54.849 INFO:tasks.workunit.client.0.smithi077.stdout:2/587: sync 2024-09-18T21:12:54.849 INFO:tasks.workunit.client.0.smithi077.stdout:8/469: sync 2024-09-18T21:12:54.849 INFO:tasks.workunit.client.0.smithi077.stdout:4/448: sync 2024-09-18T21:12:54.849 INFO:tasks.workunit.client.0.smithi077.stdout:5/677: sync 2024-09-18T21:12:54.850 INFO:tasks.workunit.client.0.smithi077.stdout:1/549: mknod d3/d8/d49/d4e/dbd/cca 0 2024-09-18T21:12:54.852 INFO:tasks.workunit.client.0.smithi077.stdout:5/678: creat d0/df/d10/d5c/fdc x:0 0 0 2024-09-18T21:12:54.854 INFO:tasks.workunit.client.0.smithi077.stdout:4/449: mkdir d3/d7/d7b/d88 0 2024-09-18T21:12:54.855 INFO:tasks.workunit.client.0.smithi077.stdout:0/605: mknod d8/d1a/cbe 0 2024-09-18T21:12:54.858 INFO:tasks.workunit.client.0.smithi077.stdout:9/479: symlink d1/dd/d11/d1c/d38/d46/d55/d9c/la0 0 2024-09-18T21:12:54.859 INFO:tasks.workunit.client.0.smithi077.stdout:1/550: dwrite d3/d6a/d9b/d68/d3e/fc0 [0,4194304] 0 2024-09-18T21:12:54.859 INFO:tasks.workunit.client.0.smithi077.stdout:5/679: fdatasync d0/df/d10/f26 0 2024-09-18T21:12:54.862 INFO:tasks.workunit.client.0.smithi077.stdout:9/480: chown d1/dd/d11/d1c/d38/d46/d55/d9c/la0 3979 1 2024-09-18T21:12:54.863 INFO:tasks.workunit.client.0.smithi077.stdout:8/470: mknod d2/d5f/da8/d4f/d5a/d5e/cab 0 2024-09-18T21:12:54.866 INFO:tasks.workunit.client.0.smithi077.stdout:8/471: write d2/d27/d29/f90 [429203,46720] 0 2024-09-18T21:12:54.867 INFO:tasks.workunit.client.0.smithi077.stdout:8/472: chown d2/d5f/da8/d4f/f5d 1680897 1 2024-09-18T21:12:54.872 INFO:tasks.workunit.client.0.smithi077.stdout:5/680: dread - d0/df/d84/f90 zero size 2024-09-18T21:12:54.873 INFO:tasks.workunit.client.0.smithi077.stdout:9/481: rename d1/f16 to d1/dd/d11/d15/d80/d85/fa1 0 2024-09-18T21:12:54.878 INFO:tasks.workunit.client.0.smithi077.stdout:1/551: truncate d3/d6a/f9e 185019 0 2024-09-18T21:12:54.878 INFO:tasks.workunit.client.0.smithi077.stdout:8/473: read d2/d5f/da8/d18/f4c [4612079,37479] 0 2024-09-18T21:12:54.881 INFO:tasks.workunit.client.0.smithi077.stdout:5/681: chown d0/l76 16138417 1 2024-09-18T21:12:54.882 INFO:tasks.workunit.client.0.smithi077.stdout:9/482: dwrite d1/d54/d27/f64 [0,4194304] 0 2024-09-18T21:12:54.882 INFO:tasks.workunit.client.0.smithi077.stdout:4/450: write d3/dc/d32/f62 [4311577,69782] 0 2024-09-18T21:12:54.883 INFO:tasks.workunit.client.0.smithi077.stdout:2/588: getdents d1/d4/d5/d1a 0 2024-09-18T21:12:54.885 INFO:tasks.workunit.client.0.smithi077.stdout:4/451: readlink d3/dc/d20/l4b 0 2024-09-18T21:12:54.886 INFO:tasks.workunit.client.0.smithi077.stdout:9/483: fsync d1/dd/d11/d15/d80/f8c 0 2024-09-18T21:12:54.887 INFO:tasks.workunit.client.0.smithi077.stdout:0/606: write d8/d37/d95/dab/f7f [86379,92402] 0 2024-09-18T21:12:54.887 INFO:tasks.workunit.client.0.smithi077.stdout:1/552: unlink d3/d8/d49/d4e/d50/f30 0 2024-09-18T21:12:54.888 INFO:tasks.workunit.client.0.smithi077.stdout:5/682: truncate d0/df/f1c 895563 0 2024-09-18T21:12:54.892 INFO:tasks.workunit.client.0.smithi077.stdout:4/452: rmdir d3/dc/d51/d53/d66 39 2024-09-18T21:12:54.892 INFO:tasks.workunit.client.0.smithi077.stdout:2/589: rename d1/d4/d5/laa to d1/lc1 0 2024-09-18T21:12:54.892 INFO:tasks.workunit.client.0.smithi077.stdout:9/484: chown d1/dd/d1a/l73 24 1 2024-09-18T21:12:54.893 INFO:tasks.workunit.client.0.smithi077.stdout:0/607: mknod d8/d1a/d39/d64/cbf 0 2024-09-18T21:12:54.897 INFO:tasks.workunit.client.0.smithi077.stdout:4/453: mkdir d3/dc/d51/d53/d89 0 2024-09-18T21:12:54.897 INFO:tasks.workunit.client.0.smithi077.stdout:1/553: dread d3/d6a/d9b/f31 [0,4194304] 0 2024-09-18T21:12:54.900 INFO:tasks.workunit.client.1.smithi103.stdout:2/540: truncate d3/d5/d2c/f50 1220427 0 2024-09-18T21:12:54.901 INFO:tasks.workunit.client.0.smithi077.stdout:4/454: symlink d3/d7/l8a 0 2024-09-18T21:12:54.902 INFO:tasks.workunit.client.1.smithi103.stdout:0/565: truncate d1/d9/f52 2880778 0 2024-09-18T21:12:54.903 INFO:tasks.workunit.client.1.smithi103.stdout:8/691: dread d4/de/d4a/d59/d5e/faa [0,4194304] 0 2024-09-18T21:12:54.904 INFO:tasks.workunit.client.0.smithi077.stdout:2/590: dwrite d1/d4/d5/d1a/d2e/d40/d69/fa6 [0,4194304] 0 2024-09-18T21:12:54.905 INFO:tasks.workunit.client.1.smithi103.stdout:9/624: write d18/d29/f2a [82496,118930] 0 2024-09-18T21:12:54.906 INFO:tasks.workunit.client.1.smithi103.stdout:8/692: chown d4/d26/d56/ca8 689512 1 2024-09-18T21:12:54.906 INFO:tasks.workunit.client.1.smithi103.stdout:4/618: dwrite d9/d2e/d61/d91/d9e/f79 [4194304,4194304] 0 2024-09-18T21:12:54.907 INFO:tasks.workunit.client.1.smithi103.stdout:7/555: truncate d1/df/d43/d63/d67/d5b/f70 4064975 0 2024-09-18T21:12:54.907 INFO:tasks.workunit.client.0.smithi077.stdout:1/554: dread d3/d6a/d9b/d68/f9d [0,4194304] 0 2024-09-18T21:12:54.909 INFO:tasks.workunit.client.1.smithi103.stdout:8/693: write d4/d2d/d4e/d73/fc6 [820867,38164] 0 2024-09-18T21:12:54.909 INFO:tasks.workunit.client.0.smithi077.stdout:9/485: getdents d1/dd/d11/d2d/d59 0 2024-09-18T21:12:54.909 INFO:tasks.workunit.client.0.smithi077.stdout:8/474: dread d2/d5f/da8/d26/f39 [0,4194304] 0 2024-09-18T21:12:54.912 INFO:tasks.workunit.client.1.smithi103.stdout:2/541: rename d3/d5/d2c/fc2 to d3/d5/d4a/d56/fc7 0 2024-09-18T21:12:54.914 INFO:tasks.workunit.client.1.smithi103.stdout:6/609: dread d2/f34 [0,4194304] 0 2024-09-18T21:12:54.915 INFO:tasks.workunit.client.1.smithi103.stdout:0/566: creat d1/d5/de/dc0/fc4 x:0 0 0 2024-09-18T21:12:54.916 INFO:tasks.workunit.client.0.smithi077.stdout:5/683: truncate d0/df/d10/fac 2761130 0 2024-09-18T21:12:54.917 INFO:tasks.workunit.client.0.smithi077.stdout:2/591: symlink d1/d4/d5/d1a/lc2 0 2024-09-18T21:12:54.920 INFO:tasks.workunit.client.0.smithi077.stdout:0/608: write d8/d1a/d39/d3b/f44 [1381330,54595] 0 2024-09-18T21:12:54.922 INFO:tasks.workunit.client.0.smithi077.stdout:9/486: rename d1/dd/d11/d2d/d59/f96 to d1/dd/d1a/fa2 0 2024-09-18T21:12:54.923 INFO:tasks.workunit.client.0.smithi077.stdout:9/487: readlink d1/dd/d11/d15/d80/l8d 0 2024-09-18T21:12:54.925 INFO:tasks.workunit.client.1.smithi103.stdout:5/648: mknod de/d1f/d3b/d51/d57/db5/cd4 0 2024-09-18T21:12:54.930 INFO:tasks.workunit.client.1.smithi103.stdout:4/619: creat d9/d2e/d61/d91/fd3 x:0 0 0 2024-09-18T21:12:54.931 INFO:tasks.workunit.client.0.smithi077.stdout:5/684: unlink d0/df/d10/l39 0 2024-09-18T21:12:54.933 INFO:tasks.workunit.client.1.smithi103.stdout:8/694: readlink d4/d2d/d87/l9e 0 2024-09-18T21:12:54.934 INFO:tasks.workunit.client.0.smithi077.stdout:4/455: dwrite d3/d7/f68 [4194304,4194304] 0 2024-09-18T21:12:54.934 INFO:tasks.workunit.client.1.smithi103.stdout:2/542: unlink d3/d5/d4a/c69 0 2024-09-18T21:12:54.935 INFO:tasks.workunit.client.0.smithi077.stdout:7/588: sync 2024-09-18T21:12:54.936 INFO:tasks.workunit.client.0.smithi077.stdout:0/609: creat d8/d1d/fc0 x:0 0 0 2024-09-18T21:12:54.937 INFO:tasks.workunit.client.0.smithi077.stdout:0/610: write d8/d37/f48 [1339469,121860] 0 2024-09-18T21:12:54.937 INFO:tasks.workunit.client.1.smithi103.stdout:6/610: symlink d2/d24/d38/lbd 0 2024-09-18T21:12:54.943 INFO:tasks.workunit.client.0.smithi077.stdout:9/488: mkdir d1/d54/d51/da3 0 2024-09-18T21:12:54.943 INFO:tasks.workunit.client.0.smithi077.stdout:1/555: write d3/d6a/d9b/d68/f42 [517321,87243] 0 2024-09-18T21:12:54.945 INFO:tasks.workunit.client.0.smithi077.stdout:9/489: dread - d1/dd/d1a/d42/f9f zero size 2024-09-18T21:12:54.946 INFO:tasks.workunit.client.1.smithi103.stdout:9/625: mknod d18/d52/d5e/cd3 0 2024-09-18T21:12:54.947 INFO:tasks.workunit.client.0.smithi077.stdout:5/685: fdatasync d0/d6/f3c 0 2024-09-18T21:12:54.951 INFO:tasks.workunit.client.1.smithi103.stdout:7/556: symlink d1/df/d42/d1f/d5d/d85/lac 0 2024-09-18T21:12:54.953 INFO:tasks.workunit.client.0.smithi077.stdout:4/456: fsync d3/d35/f56 0 2024-09-18T21:12:54.957 INFO:tasks.workunit.client.0.smithi077.stdout:0/611: symlink d8/d1d/d57/lc1 0 2024-09-18T21:12:54.958 INFO:tasks.workunit.client.0.smithi077.stdout:0/612: dread - d8/d1a/d39/f59 zero size 2024-09-18T21:12:54.961 INFO:tasks.workunit.client.1.smithi103.stdout:5/649: symlink de/d1f/d3b/d51/d57/d79/ld5 0 2024-09-18T21:12:54.962 INFO:tasks.workunit.client.0.smithi077.stdout:1/556: fsync d3/d8/d49/d4e/d5a/f78 0 2024-09-18T21:12:54.963 INFO:tasks.workunit.client.1.smithi103.stdout:9/626: creat d18/d29/d68/fd4 x:0 0 0 2024-09-18T21:12:54.964 INFO:tasks.workunit.client.0.smithi077.stdout:9/490: fdatasync d1/f7c 0 2024-09-18T21:12:54.965 INFO:tasks.workunit.client.0.smithi077.stdout:9/491: chown d1/dd/d11/d15/l4a 1423365 1 2024-09-18T21:12:54.966 INFO:tasks.workunit.client.1.smithi103.stdout:4/620: symlink d9/d1c/db1/ld4 0 2024-09-18T21:12:54.966 INFO:tasks.workunit.client.1.smithi103.stdout:4/621: fdatasync d9/d2e/d61/d91/fd3 0 2024-09-18T21:12:54.971 INFO:tasks.workunit.client.1.smithi103.stdout:2/543: truncate d3/d5/d2c/f64 673152 0 2024-09-18T21:12:54.972 INFO:tasks.workunit.client.1.smithi103.stdout:6/611: unlink d2/d24/d38/d68/d7c/c96 0 2024-09-18T21:12:54.973 INFO:tasks.workunit.client.0.smithi077.stdout:0/613: creat d8/d1a/d35/d6d/fc2 x:0 0 0 2024-09-18T21:12:54.974 INFO:tasks.workunit.client.1.smithi103.stdout:6/612: stat d2/d24/d5a/d67/d76/c5d 0 2024-09-18T21:12:54.975 INFO:tasks.workunit.client.1.smithi103.stdout:7/557: dwrite d1/df/d42/d1f/d2e/f41 [0,4194304] 0 2024-09-18T21:12:54.975 INFO:tasks.workunit.client.1.smithi103.stdout:0/567: getdents d1/d5/de/d19/d1e/d34/da8/d9f/d4f 0 2024-09-18T21:12:54.976 INFO:tasks.workunit.client.0.smithi077.stdout:8/475: rename d2/d5f/da8/d20/d3e/f47 to d2/d5/d6/fac 0 2024-09-18T21:12:54.978 INFO:tasks.workunit.client.0.smithi077.stdout:8/476: dread - d2/d5f/da8/d4f/d5a/d2a/d88/fa3 zero size 2024-09-18T21:12:54.979 INFO:tasks.workunit.client.1.smithi103.stdout:5/650: creat de/d1f/d3b/d51/d57/d79/d8d/fd6 x:0 0 0 2024-09-18T21:12:54.979 INFO:tasks.workunit.client.1.smithi103.stdout:5/651: write de/f2b [1003716,120018] 0 2024-09-18T21:12:54.985 INFO:tasks.workunit.client.1.smithi103.stdout:4/622: mkdir d9/d1c/db1/dd5 0 2024-09-18T21:12:54.986 INFO:tasks.workunit.client.0.smithi077.stdout:9/492: creat d1/d54/d51/fa4 x:0 0 0 2024-09-18T21:12:54.987 INFO:tasks.workunit.client.0.smithi077.stdout:5/686: mkdir d0/ddd 0 2024-09-18T21:12:54.989 INFO:tasks.workunit.client.0.smithi077.stdout:9/493: dread d1/dd/d11/d15/f45 [0,4194304] 0 2024-09-18T21:12:54.992 INFO:tasks.workunit.client.0.smithi077.stdout:0/614: symlink d8/d1d/d57/lc3 0 2024-09-18T21:12:54.992 INFO:tasks.workunit.client.0.smithi077.stdout:0/615: chown d8/f19 1336 1 2024-09-18T21:12:54.993 INFO:tasks.workunit.client.1.smithi103.stdout:5/652: mkdir de/d1f/dd7 0 2024-09-18T21:12:54.995 INFO:tasks.workunit.client.0.smithi077.stdout:7/589: rename f5 to d12/d56/da1/db6/fcd 0 2024-09-18T21:12:54.997 INFO:tasks.workunit.client.1.smithi103.stdout:2/544: dread d3/f9 [0,4194304] 0 2024-09-18T21:12:55.000 INFO:tasks.workunit.client.0.smithi077.stdout:0/616: dwrite d8/d26/f54 [4194304,4194304] 0 2024-09-18T21:12:55.002 INFO:tasks.workunit.client.1.smithi103.stdout:0/568: dread d1/d5/de/dc0/dbf/f86 [0,4194304] 0 2024-09-18T21:12:55.002 INFO:tasks.workunit.client.1.smithi103.stdout:4/623: mknod d9/d2e/cd6 0 2024-09-18T21:12:55.003 INFO:tasks.workunit.client.0.smithi077.stdout:7/590: dread d12/d22/d59/d5a/f8a [0,4194304] 0 2024-09-18T21:12:55.005 INFO:tasks.workunit.client.1.smithi103.stdout:8/695: getdents d4/d81 0 2024-09-18T21:12:55.008 INFO:tasks.workunit.client.1.smithi103.stdout:6/613: symlink d2/d24/lbe 0 2024-09-18T21:12:55.010 INFO:tasks.workunit.client.0.smithi077.stdout:5/687: chown d0/df/d10/d4b/d98/ld9 1723 1 2024-09-18T21:12:55.011 INFO:tasks.workunit.client.0.smithi077.stdout:4/457: dwrite d3/d7/f4f [0,4194304] 0 2024-09-18T21:12:55.012 INFO:tasks.workunit.client.1.smithi103.stdout:7/558: dread d1/df/f22 [0,4194304] 0 2024-09-18T21:12:55.013 INFO:tasks.workunit.client.0.smithi077.stdout:9/494: creat d1/dd/d11/d15/d80/fa5 x:0 0 0 2024-09-18T21:12:55.013 INFO:tasks.workunit.client.0.smithi077.stdout:5/688: fsync d0/d6/d3b/f55 0 2024-09-18T21:12:55.013 INFO:tasks.workunit.client.1.smithi103.stdout:7/559: dread - d1/df/d42/d29/f94 zero size 2024-09-18T21:12:55.013 INFO:tasks.workunit.client.1.smithi103.stdout:5/653: mknod de/d1f/d3b/d3c/cd8 0 2024-09-18T21:12:55.015 INFO:tasks.workunit.client.0.smithi077.stdout:9/495: write d1/dd/d11/d1c/d38/d46/f67 [924734,41986] 0 2024-09-18T21:12:55.015 INFO:tasks.workunit.client.1.smithi103.stdout:2/545: creat d3/d5/d2c/d77/d9c/fc8 x:0 0 0 2024-09-18T21:12:55.016 INFO:tasks.workunit.client.0.smithi077.stdout:9/496: readlink d1/dd/d1a/l2c 0 2024-09-18T21:12:55.017 INFO:tasks.workunit.client.1.smithi103.stdout:4/624: rmdir d9/d38/d72 39 2024-09-18T21:12:55.018 INFO:tasks.workunit.client.0.smithi077.stdout:0/617: stat d8/d37/l99 0 2024-09-18T21:12:55.022 INFO:tasks.workunit.client.1.smithi103.stdout:7/560: unlink d1/df/f4c 0 2024-09-18T21:12:55.023 INFO:tasks.workunit.client.1.smithi103.stdout:6/614: dread d2/d3/d7f/fb3 [0,4194304] 0 2024-09-18T21:12:55.024 INFO:tasks.workunit.client.1.smithi103.stdout:6/615: stat d2/d24/d38/d68/dac 0 2024-09-18T21:12:55.024 INFO:tasks.workunit.client.1.smithi103.stdout:5/654: stat de/d1f/d3b/d58/dc4/d7e/lc1 0 2024-09-18T21:12:55.025 INFO:tasks.workunit.client.1.smithi103.stdout:9/627: link d18/d8d/d2f/l77 d18/d8d/ld5 0 2024-09-18T21:12:55.026 INFO:tasks.workunit.client.1.smithi103.stdout:9/628: dread - d18/d29/d68/d78/fa8 zero size 2024-09-18T21:12:55.029 INFO:tasks.workunit.client.0.smithi077.stdout:4/458: creat d3/d77/f8b x:0 0 0 2024-09-18T21:12:55.033 INFO:tasks.workunit.client.1.smithi103.stdout:8/696: creat d4/d81/dd7/fda x:0 0 0 2024-09-18T21:12:55.033 INFO:tasks.workunit.client.0.smithi077.stdout:8/477: dread d2/d5/f16 [0,4194304] 0 2024-09-18T21:12:55.034 INFO:tasks.workunit.client.1.smithi103.stdout:8/697: chown d4/d81/d65/d39/l3a 105 1 2024-09-18T21:12:55.034 INFO:tasks.workunit.client.0.smithi077.stdout:3/515: sync 2024-09-18T21:12:55.035 INFO:tasks.workunit.client.1.smithi103.stdout:0/569: truncate d1/d5/de/d24/f32 3120552 0 2024-09-18T21:12:55.037 INFO:tasks.workunit.client.1.smithi103.stdout:7/561: rmdir d1/df/d43/d52 39 2024-09-18T21:12:55.037 INFO:tasks.workunit.client.0.smithi077.stdout:0/618: read f5 [559444,28685] 0 2024-09-18T21:12:55.038 INFO:tasks.workunit.client.0.smithi077.stdout:1/557: getdents d3/d8/d93 0 2024-09-18T21:12:55.039 INFO:tasks.workunit.client.0.smithi077.stdout:0/619: read d8/fa7 [106383,126928] 0 2024-09-18T21:12:55.040 INFO:tasks.workunit.client.1.smithi103.stdout:6/616: dread d2/d24/d38/f8f [0,4194304] 0 2024-09-18T21:12:55.042 INFO:tasks.workunit.client.0.smithi077.stdout:5/689: dwrite d0/d6/f50 [4194304,4194304] 0 2024-09-18T21:12:55.043 INFO:tasks.workunit.client.0.smithi077.stdout:5/690: chown d0/df/d10/fb0 13 1 2024-09-18T21:12:55.045 INFO:tasks.workunit.client.1.smithi103.stdout:9/629: unlink d18/c48 0 2024-09-18T21:12:55.049 INFO:tasks.workunit.client.0.smithi077.stdout:9/497: creat d1/dd/d11/d2d/d79/fa6 x:0 0 0 2024-09-18T21:12:55.050 INFO:tasks.workunit.client.1.smithi103.stdout:0/570: write d1/f9a [1334280,42660] 0 2024-09-18T21:12:55.053 INFO:tasks.workunit.client.1.smithi103.stdout:6/617: truncate d2/d24/f6a 700949 0 2024-09-18T21:12:55.054 INFO:tasks.workunit.client.0.smithi077.stdout:7/591: link d12/d31/d77/d93/c2c d12/d22/daa/dc0/dac/dad/cce 0 2024-09-18T21:12:55.057 INFO:tasks.workunit.client.0.smithi077.stdout:9/498: dwrite d1/dd/d1a/d42/f9f [0,4194304] 0 2024-09-18T21:12:55.057 INFO:tasks.workunit.client.0.smithi077.stdout:0/620: unlink d8/d1a/d39/d3b/d79/f7d 0 2024-09-18T21:12:55.058 INFO:tasks.workunit.client.1.smithi103.stdout:9/630: creat d18/d52/d6f/db9/dcb/fd6 x:0 0 0 2024-09-18T21:12:55.062 INFO:tasks.workunit.client.0.smithi077.stdout:2/592: rename d1/d4/f76 to d1/d4/d5/d1a/d2e/d41/fc3 0 2024-09-18T21:12:55.063 INFO:tasks.workunit.client.1.smithi103.stdout:6/618: rmdir d2/d24/d5a 39 2024-09-18T21:12:55.063 INFO:tasks.workunit.client.0.smithi077.stdout:8/478: mkdir d2/d5f/da8/d4f/d5a/d5e/d8f/dad 0 2024-09-18T21:12:55.064 INFO:tasks.workunit.client.0.smithi077.stdout:9/499: read d1/dd/d11/d2d/f56 [1159946,71009] 0 2024-09-18T21:12:55.065 INFO:tasks.workunit.client.1.smithi103.stdout:5/655: rename de/d3e/d15/f9f to de/fd9 0 2024-09-18T21:12:55.066 INFO:tasks.workunit.client.1.smithi103.stdout:7/562: dwrite d1/df/d42/d1f/d2e/fa8 [0,4194304] 0 2024-09-18T21:12:55.068 INFO:tasks.workunit.client.0.smithi077.stdout:1/558: mknod d3/d8/ccb 0 2024-09-18T21:12:55.069 INFO:tasks.workunit.client.1.smithi103.stdout:9/631: unlink d18/d52/d6f/db9/dcb/c6b 0 2024-09-18T21:12:55.069 INFO:tasks.workunit.client.1.smithi103.stdout:4/625: link d9/d2e/lce d9/d1c/ld7 0 2024-09-18T21:12:55.074 INFO:tasks.workunit.client.1.smithi103.stdout:9/632: dwrite f12 [0,4194304] 0 2024-09-18T21:12:55.075 INFO:tasks.workunit.client.0.smithi077.stdout:7/592: truncate d12/d22/f65 174605 0 2024-09-18T21:12:55.077 INFO:tasks.workunit.client.1.smithi103.stdout:0/571: rename d1/d5/de/d19/d1e/d6d to d1/d5/de/d24/d43/d76/dc5 0 2024-09-18T21:12:55.078 INFO:tasks.workunit.client.0.smithi077.stdout:4/459: truncate d3/dc/d20/f27 3658470 0 2024-09-18T21:12:55.079 INFO:tasks.workunit.client.0.smithi077.stdout:4/460: dread - d3/dc/d20/f7d zero size 2024-09-18T21:12:55.081 INFO:tasks.workunit.client.1.smithi103.stdout:7/563: truncate d1/f1c 3222534 0 2024-09-18T21:12:55.082 INFO:tasks.workunit.client.1.smithi103.stdout:9/633: dwrite d18/d8d/f87 [0,4194304] 0 2024-09-18T21:12:55.082 INFO:tasks.workunit.client.0.smithi077.stdout:3/516: dread db/d14/d32/d4f/f60 [0,4194304] 0 2024-09-18T21:12:55.083 INFO:tasks.workunit.client.1.smithi103.stdout:7/564: readlink d1/df/d42/d1f/d5d/lab 0 2024-09-18T21:12:55.085 INFO:tasks.workunit.client.1.smithi103.stdout:4/626: readlink d9/d1c/lc2 0 2024-09-18T21:12:55.085 INFO:tasks.workunit.client.0.smithi077.stdout:5/691: mkdir d0/d6/dde 0 2024-09-18T21:12:55.089 INFO:tasks.workunit.client.0.smithi077.stdout:8/479: symlink d2/d5f/da8/d26/lae 0 2024-09-18T21:12:55.091 INFO:tasks.workunit.client.1.smithi103.stdout:3/576: sync 2024-09-18T21:12:55.091 INFO:tasks.workunit.client.1.smithi103.stdout:1/556: sync 2024-09-18T21:12:55.093 INFO:tasks.workunit.client.1.smithi103.stdout:4/627: dwrite d9/d38/d58/f93 [0,4194304] 0 2024-09-18T21:12:55.095 INFO:tasks.workunit.client.1.smithi103.stdout:3/577: read d1/f2e [2664754,31569] 0 2024-09-18T21:12:55.101 INFO:tasks.workunit.client.1.smithi103.stdout:6/619: symlink d2/d3/d8/d4c/lbf 0 2024-09-18T21:12:55.102 INFO:tasks.workunit.client.0.smithi077.stdout:0/621: dwrite d8/d1d/f8b [0,4194304] 0 2024-09-18T21:12:55.104 INFO:tasks.workunit.client.0.smithi077.stdout:0/622: chown d8/d1a/d35/f82 26646 1 2024-09-18T21:12:55.105 INFO:tasks.workunit.client.0.smithi077.stdout:6/510: sync 2024-09-18T21:12:55.106 INFO:tasks.workunit.client.0.smithi077.stdout:6/511: stat d7/d7e/d11/d1d/d5c/f6f 0 2024-09-18T21:12:55.106 INFO:tasks.workunit.client.1.smithi103.stdout:0/572: write d1/d9/f33 [1279098,80275] 0 2024-09-18T21:12:55.107 INFO:tasks.workunit.client.0.smithi077.stdout:3/517: creat db/d14/d32/d49/fa0 x:0 0 0 2024-09-18T21:12:55.107 INFO:tasks.workunit.client.1.smithi103.stdout:0/573: chown d1/d5/de/d24/d43/d76 132116 1 2024-09-18T21:12:55.109 INFO:tasks.workunit.client.1.smithi103.stdout:1/557: creat d0/d2/d2b/d3a/d42/d87/fbf x:0 0 0 2024-09-18T21:12:55.109 INFO:tasks.workunit.client.1.smithi103.stdout:7/565: dread d1/f17 [0,4194304] 0 2024-09-18T21:12:55.110 INFO:tasks.workunit.client.0.smithi077.stdout:2/593: rename d1/d4/d5/d1a/d2e/d86 to d1/d4/d5/d1a/d49/d6a/d81/dc4 0 2024-09-18T21:12:55.112 INFO:tasks.workunit.client.0.smithi077.stdout:8/480: creat d2/d5f/da8/d26/faf x:0 0 0 2024-09-18T21:12:55.114 INFO:tasks.workunit.client.0.smithi077.stdout:8/481: truncate d2/d27/d29/d72/f8c 206158 0 2024-09-18T21:12:55.114 INFO:tasks.workunit.client.0.smithi077.stdout:9/500: symlink d1/d54/d8f/la7 0 2024-09-18T21:12:55.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:55.113+0000 7f8f9e5b9640 1 -- 172.21.15.77:0/2774712536 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f8f780057c0 con 0x7f8f9806e540 2024-09-18T21:12:55.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:55.113+0000 7f8f957fa640 1 -- 172.21.15.77:0/2774712536 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f8f8007afe0 con 0x7f8f9806e540 2024-09-18T21:12:55.115 INFO:teuthology.orchestra.run.smithi077.stdout:HEALTH_OK 2024-09-18T21:12:55.115 INFO:tasks.workunit.client.0.smithi077.stdout:9/501: write d1/dd/f5a [990909,87726] 0 2024-09-18T21:12:55.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:55.117+0000 7f8f9e5b9640 1 -- 172.21.15.77:0/2774712536 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f8f8406e4a0 msgr2=0x7f8f84070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:55.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:55.117+0000 7f8f9e5b9640 1 --2- 172.21.15.77:0/2774712536 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f8f8406e4a0 0x7f8f84070950 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8f88009fd0 tx=0x7f8f88009e50 comp rx=0 tx=0).stop 2024-09-18T21:12:55.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:55.117+0000 7f8f9e5b9640 1 -- 172.21.15.77:0/2774712536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f9806e540 msgr2=0x7f8f9811c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:12:55.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:55.117+0000 7f8f9e5b9640 1 --2- 172.21.15.77:0/2774712536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f9806e540 0x7f8f9811c440 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8f800043d0 tx=0x7f8f80009da0 comp rx=0 tx=0).stop 2024-09-18T21:12:55.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:55.117+0000 7f8f9e5b9640 1 -- 172.21.15.77:0/2774712536 shutdown_connections 2024-09-18T21:12:55.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:55.117+0000 7f8f9e5b9640 1 --2- 172.21.15.77:0/2774712536 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f8f8406e4a0 0x7f8f84070950 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:55.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:55.117+0000 7f8f9e5b9640 1 --2- 172.21.15.77:0/2774712536 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f9806e540 0x7f8f9811c440 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:55.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:55.117+0000 7f8f9e5b9640 1 --2- 172.21.15.77:0/2774712536 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f9806dbf0 0x7f8f9811bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:12:55.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:55.117+0000 7f8f9e5b9640 1 -- 172.21.15.77:0/2774712536 >> 172.21.15.77:0/2774712536 conn(0x7f8f98069560 msgr2=0x7f8f98106890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:12:55.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:55.117+0000 7f8f9e5b9640 1 -- 172.21.15.77:0/2774712536 shutdown_connections 2024-09-18T21:12:55.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:12:55.117+0000 7f8f9e5b9640 1 -- 172.21.15.77:0/2774712536 wait complete. 2024-09-18T21:12:55.123 INFO:tasks.workunit.client.1.smithi103.stdout:4/628: rename d9/d2e/d61/d91/dd2 to d9/d38/d72/d85/dd8 0 2024-09-18T21:12:55.125 INFO:tasks.workunit.client.1.smithi103.stdout:4/629: write d9/d2e/d61/d91/d9e/f79 [4298289,82281] 0 2024-09-18T21:12:55.130 INFO:tasks.workunit.client.0.smithi077.stdout:4/461: truncate d3/dc/f16 3016285 0 2024-09-18T21:12:55.131 INFO:tasks.workunit.client.0.smithi077.stdout:4/462: chown d3 37 1 2024-09-18T21:12:55.131 INFO:tasks.workunit.client.1.smithi103.stdout:3/578: dwrite d1/da/f15 [0,4194304] 0 2024-09-18T21:12:55.133 INFO:tasks.workunit.client.0.smithi077.stdout:3/518: unlink db/d14/d32/d49/d4e/f79 0 2024-09-18T21:12:55.135 INFO:tasks.workunit.client.0.smithi077.stdout:2/594: symlink d1/d4/d5/d1a/d2e/d41/d2c/lc5 0 2024-09-18T21:12:55.140 INFO:tasks.workunit.client.1.smithi103.stdout:4/630: creat d9/d2e/d83/db6/d86/fd9 x:0 0 0 2024-09-18T21:12:55.144 INFO:tasks.workunit.client.0.smithi077.stdout:0/623: dwrite d8/d37/d95/dab/f8c [0,4194304] 0 2024-09-18T21:12:55.144 INFO:tasks.workunit.client.1.smithi103.stdout:9/634: link d18/d52/d6f/d8e/d8f/dbd/dc3/lb2 d18/ld7 0 2024-09-18T21:12:55.146 INFO:tasks.workunit.client.1.smithi103.stdout:9/635: write d18/d52/d6f/d8e/d8f/dbd/dc3/fa7 [1216683,69118] 0 2024-09-18T21:12:55.146 INFO:tasks.workunit.client.1.smithi103.stdout:0/574: dread d1/f12 [0,4194304] 0 2024-09-18T21:12:55.148 INFO:tasks.workunit.client.0.smithi077.stdout:3/519: dwrite db/d14/d22/f58 [4194304,4194304] 0 2024-09-18T21:12:55.149 INFO:tasks.workunit.client.0.smithi077.stdout:9/502: symlink d1/dd/d11/d1c/d38/d46/d55/d9c/la8 0 2024-09-18T21:12:55.149 INFO:tasks.workunit.client.0.smithi077.stdout:6/512: dread d7/d7e/d11/d3e/d42/f8b [0,4194304] 0 2024-09-18T21:12:55.152 INFO:tasks.workunit.client.0.smithi077.stdout:3/520: dread - db/d14/d32/d4f/d71/d3b/f7e zero size 2024-09-18T21:12:55.156 INFO:tasks.workunit.client.1.smithi103.stdout:3/579: symlink d1/d23/d25/da1/da5/lb5 0 2024-09-18T21:12:55.156 INFO:tasks.workunit.client.0.smithi077.stdout:3/521: readlink db/d14/d22/d36/d39/d50/d5c/l84 0 2024-09-18T21:12:55.156 INFO:tasks.workunit.client.0.smithi077.stdout:0/624: dwrite d8/d26/f96 [0,4194304] 0 2024-09-18T21:12:55.157 INFO:tasks.workunit.client.1.smithi103.stdout:6/620: mknod d2/d3/d8/d4c/d79/cc0 0 2024-09-18T21:12:55.158 INFO:tasks.workunit.client.0.smithi077.stdout:0/625: chown d8/d1a/f20 9097 1 2024-09-18T21:12:55.158 INFO:tasks.workunit.client.1.smithi103.stdout:6/621: chown d2/c1e 435723105 1 2024-09-18T21:12:55.164 INFO:tasks.workunit.client.1.smithi103.stdout:9/636: symlink d18/d52/d6f/d8e/d8f/ld8 0 2024-09-18T21:12:55.167 INFO:tasks.workunit.client.1.smithi103.stdout:0/575: unlink d1/d5/de/d24/cc2 0 2024-09-18T21:12:55.167 INFO:tasks.workunit.client.0.smithi077.stdout:8/482: creat d2/d5/d6/d7e/fb0 x:0 0 0 2024-09-18T21:12:55.167 INFO:tasks.workunit.client.0.smithi077.stdout:1/559: dwrite d3/d6a/d9b/d68/f4a [0,4194304] 0 2024-09-18T21:12:55.169 INFO:tasks.workunit.client.1.smithi103.stdout:7/566: link d1/df/d42/d29/d2f/l35 d1/df/d43/d63/d67/d5b/lad 0 2024-09-18T21:12:55.172 INFO:tasks.workunit.client.0.smithi077.stdout:7/593: creat d12/d31/d77/d93/d2a/d6c/fcf x:0 0 0 2024-09-18T21:12:55.173 INFO:tasks.workunit.client.1.smithi103.stdout:1/558: getdents d0/d2/d9/dc/d36/d52 0 2024-09-18T21:12:55.175 INFO:tasks.workunit.client.1.smithi103.stdout:3/580: dwrite d1/d23/d25/d4f/d72/d85/fab [0,4194304] 0 2024-09-18T21:12:55.175 INFO:tasks.workunit.client.0.smithi077.stdout:9/503: symlink d1/dd/d11/d2d/d59/la9 0 2024-09-18T21:12:55.179 INFO:tasks.workunit.client.0.smithi077.stdout:5/692: getdents d0/df/d3d/d85 0 2024-09-18T21:12:55.180 INFO:tasks.workunit.client.0.smithi077.stdout:9/504: write d1/d54/d27/f39 [1034653,120669] 0 2024-09-18T21:12:55.181 INFO:tasks.workunit.client.0.smithi077.stdout:5/693: chown d0/d6/f50 86133145 1 2024-09-18T21:12:55.182 INFO:tasks.workunit.client.0.smithi077.stdout:7/594: dwrite d12/d56/fa2 [0,4194304] 0 2024-09-18T21:12:55.183 INFO:tasks.workunit.client.0.smithi077.stdout:5/694: readlink d0/d6/l17 0 2024-09-18T21:12:55.189 INFO:tasks.workunit.client.0.smithi077.stdout:9/505: truncate d1/dd/d11/d2d/f8e 4274442 0 2024-09-18T21:12:55.189 INFO:tasks.workunit.client.0.smithi077.stdout:0/626: dread d8/d1a/f20 [0,4194304] 0 2024-09-18T21:12:55.189 INFO:tasks.workunit.client.0.smithi077.stdout:4/463: rename d3/d7/d6c/f71 to d3/dc/d51/d53/d66/f8c 0 2024-09-18T21:12:55.190 INFO:tasks.workunit.client.0.smithi077.stdout:9/506: fsync d1/dd/d11/d2d/f8e 0 2024-09-18T21:12:55.190 INFO:tasks.workunit.client.1.smithi103.stdout:0/576: dread d1/d5/de/d19/d1e/d34/f69 [0,4194304] 0 2024-09-18T21:12:55.191 INFO:tasks.workunit.client.0.smithi077.stdout:1/560: creat d3/d6a/fcc x:0 0 0 2024-09-18T21:12:55.192 INFO:tasks.workunit.client.0.smithi077.stdout:2/595: truncate d1/d4/d5/d1a/d49/d6a/d81/fa8 590568 0 2024-09-18T21:12:55.193 INFO:tasks.workunit.client.0.smithi077.stdout:6/513: getdents d7/d7e/da6 0 2024-09-18T21:12:55.193 INFO:tasks.workunit.client.1.smithi103.stdout:4/631: getdents d9/d38/d58 0 2024-09-18T21:12:55.194 INFO:tasks.workunit.client.0.smithi077.stdout:1/561: dread d3/d8/d13/d18/f5d [0,4194304] 0 2024-09-18T21:12:55.195 INFO:tasks.workunit.client.1.smithi103.stdout:0/577: mknod d1/d5/de/dc0/d62/cc6 0 2024-09-18T21:12:55.196 INFO:tasks.workunit.client.1.smithi103.stdout:0/578: read - d1/d5/de/dc0/fc4 zero size 2024-09-18T21:12:55.197 INFO:tasks.workunit.client.1.smithi103.stdout:4/632: readlink d9/d2e/d83/db6/lc6 0 2024-09-18T21:12:55.197 INFO:tasks.workunit.client.0.smithi077.stdout:3/522: creat db/d14/d32/d4f/d8a/d99/fa1 x:0 0 0 2024-09-18T21:12:55.198 INFO:tasks.workunit.client.0.smithi077.stdout:5/695: symlink d0/d6/d3b/d64/ldf 0 2024-09-18T21:12:55.198 INFO:tasks.workunit.client.1.smithi103.stdout:4/633: chown d9/d2e/d83/db6/d41/d64/fc5 27164 1 2024-09-18T21:12:55.198 INFO:tasks.workunit.client.0.smithi077.stdout:5/696: fdatasync d0/d6/d3b/fc1 0 2024-09-18T21:12:55.200 INFO:tasks.workunit.client.1.smithi103.stdout:9/637: dread d18/d52/d6f/d8e/fa3 [0,4194304] 0 2024-09-18T21:12:55.201 INFO:tasks.workunit.client.0.smithi077.stdout:4/464: chown d3/d7/d7b/l85 2 1 2024-09-18T21:12:55.202 INFO:tasks.workunit.client.0.smithi077.stdout:9/507: unlink d1/d54/d27/f64 0 2024-09-18T21:12:55.203 INFO:tasks.workunit.client.0.smithi077.stdout:9/508: write d1/d54/f84 [722048,65597] 0 2024-09-18T21:12:55.203 INFO:tasks.workunit.client.0.smithi077.stdout:8/483: mknod d2/d5f/da8/d20/cb1 0 2024-09-18T21:12:55.205 INFO:tasks.workunit.client.1.smithi103.stdout:0/579: dwrite d1/f9b [0,4194304] 0 2024-09-18T21:12:55.213 INFO:tasks.workunit.client.0.smithi077.stdout:2/596: rename d1/d4/d9/d80/d8e/l3b to d1/d4/d5/d1a/d2e/d40/d69/lc6 0 2024-09-18T21:12:55.214 INFO:tasks.workunit.client.1.smithi103.stdout:0/580: dwrite d1/d5/de/dc0/fc4 [0,4194304] 0 2024-09-18T21:12:55.215 INFO:tasks.workunit.client.0.smithi077.stdout:1/562: fsync d3/d8/d49/d4e/d50/f8d 0 2024-09-18T21:12:55.215 INFO:tasks.workunit.client.0.smithi077.stdout:7/595: dread d12/d31/d77/d93/f88 [0,4194304] 0 2024-09-18T21:12:55.217 INFO:tasks.workunit.client.0.smithi077.stdout:1/563: write d3/d8/d13/d18/d99/fb5 [332398,107177] 0 2024-09-18T21:12:55.217 INFO:tasks.workunit.client.1.smithi103.stdout:9/638: truncate d18/d29/d68/f9a 3221421 0 2024-09-18T21:12:55.219 INFO:tasks.workunit.client.0.smithi077.stdout:3/523: creat db/d14/d22/d36/fa2 x:0 0 0 2024-09-18T21:12:55.219 INFO:tasks.workunit.client.1.smithi103.stdout:1/559: write d0/d2/d9/d10/f44 [4659709,44481] 0 2024-09-18T21:12:55.220 INFO:tasks.workunit.client.0.smithi077.stdout:3/524: readlink db/d14/d32/l63 0 2024-09-18T21:12:55.222 INFO:tasks.workunit.client.1.smithi103.stdout:7/567: dwrite d1/df/d42/d1f/d2e/f37 [0,4194304] 0 2024-09-18T21:12:55.223 INFO:tasks.workunit.client.0.smithi077.stdout:5/697: dwrite d0/f78 [0,4194304] 0 2024-09-18T21:12:55.225 INFO:tasks.workunit.client.1.smithi103.stdout:1/560: readlink d0/d11/d5f/d19/l1f 0 2024-09-18T21:12:55.225 INFO:tasks.workunit.client.0.smithi077.stdout:9/509: mknod d1/dd/d11/d15/d80/d85/caa 0 2024-09-18T21:12:55.225 INFO:tasks.workunit.client.1.smithi103.stdout:6/622: dwrite d2/d24/d5a/f64 [0,4194304] 0 2024-09-18T21:12:55.229 INFO:tasks.workunit.client.1.smithi103.stdout:1/561: write d0/d2/d9/d9e/d86/dae/fb4 [596269,107751] 0 2024-09-18T21:12:55.230 INFO:tasks.workunit.client.0.smithi077.stdout:4/465: rename d3/d7/f7c to d3/d7/d7b/d88/f8d 0 2024-09-18T21:12:55.231 INFO:tasks.workunit.client.1.smithi103.stdout:6/623: read d2/d24/d5a/f17 [613729,6456] 0 2024-09-18T21:12:55.232 INFO:tasks.workunit.client.1.smithi103.stdout:4/634: write d9/fcc [837204,108342] 0 2024-09-18T21:12:55.233 INFO:tasks.workunit.client.1.smithi103.stdout:7/568: creat d1/df/d42/d29/d2f/d33/fae x:0 0 0 2024-09-18T21:12:55.238 INFO:tasks.workunit.client.1.smithi103.stdout:4/635: write d9/d2e/d61/d91/d9e/f35 [5515910,56333] 0 2024-09-18T21:12:55.239 INFO:tasks.workunit.client.1.smithi103.stdout:1/562: mknod d0/d2/d9/dc/d36/d52/cc0 0 2024-09-18T21:12:55.239 INFO:tasks.workunit.client.1.smithi103.stdout:9/639: dwrite d18/d52/d6f/d8e/fc5 [0,4194304] 0 2024-09-18T21:12:55.240 INFO:tasks.workunit.client.1.smithi103.stdout:9/640: fsync f12 0 2024-09-18T21:12:55.241 INFO:tasks.workunit.client.0.smithi077.stdout:3/525: symlink db/d14/d90/la3 0 2024-09-18T21:12:55.242 INFO:tasks.workunit.client.1.smithi103.stdout:1/563: read - d0/d2/d2b/d3a/d42/d72/f8f zero size 2024-09-18T21:12:55.244 INFO:tasks.workunit.client.0.smithi077.stdout:8/484: truncate f1 1770484 0 2024-09-18T21:12:55.245 INFO:tasks.workunit.client.0.smithi077.stdout:8/485: write d2/d27/d29/f3f [2842563,112653] 0 2024-09-18T21:12:55.246 INFO:tasks.workunit.client.1.smithi103.stdout:3/581: dread d1/d23/d47/f56 [0,4194304] 0 2024-09-18T21:12:55.246 INFO:tasks.workunit.client.0.smithi077.stdout:0/627: dread d8/d1a/d35/f7a [0,4194304] 0 2024-09-18T21:12:55.248 INFO:tasks.workunit.client.0.smithi077.stdout:9/510: rename d1/dd/d11/d15/f45 to d1/dd/d11/d2d/d59/fab 0 2024-09-18T21:12:55.249 INFO:tasks.workunit.client.1.smithi103.stdout:9/641: fdatasync f1 0 2024-09-18T21:12:55.249 INFO:tasks.workunit.client.1.smithi103.stdout:6/624: symlink d2/d24/d5a/d67/d76/d43/lc1 0 2024-09-18T21:12:55.250 INFO:tasks.workunit.client.1.smithi103.stdout:7/569: link d1/f8e d1/df/d42/d1f/d5d/faf 0 2024-09-18T21:12:55.252 INFO:tasks.workunit.client.1.smithi103.stdout:7/570: write d1/df/d42/d29/d2f/d33/d51/f9e [1675779,56986] 0 2024-09-18T21:12:55.252 INFO:tasks.workunit.client.1.smithi103.stdout:1/564: rename d0/d2/d9/dc/d36/l7d to d0/d11/d5f/d19/lc1 0 2024-09-18T21:12:55.253 INFO:tasks.workunit.client.0.smithi077.stdout:7/596: truncate d12/d56/da1/db6/fcd 3578695 0 2024-09-18T21:12:55.254 INFO:tasks.workunit.client.1.smithi103.stdout:7/571: stat d1/df/l47 0 2024-09-18T21:12:55.254 INFO:tasks.workunit.client.1.smithi103.stdout:4/636: link d9/fc d9/d2e/d83/db6/d41/fda 0 2024-09-18T21:12:55.257 INFO:tasks.workunit.client.1.smithi103.stdout:4/637: truncate d9/d2e/d61/d91/d9e/d48/f7e 4330102 0 2024-09-18T21:12:55.259 INFO:tasks.workunit.client.0.smithi077.stdout:6/514: getdents d7/d7e/d11/d1d/d4c 0 2024-09-18T21:12:55.261 INFO:tasks.workunit.client.1.smithi103.stdout:3/582: rename d1/d23/d25/d4f/d58/d68/d50/f80 to d1/d23/d47/fb6 0 2024-09-18T21:12:55.261 INFO:tasks.workunit.client.1.smithi103.stdout:6/625: rename d2/d24/d38 to d2/d24/d38/d68/d7c/dc2 22 2024-09-18T21:12:55.261 INFO:tasks.workunit.client.1.smithi103.stdout:3/583: chown d1/d23/d25/c99 0 1 2024-09-18T21:12:55.261 INFO:tasks.workunit.client.0.smithi077.stdout:8/486: mknod d2/d5f/d7a/cb2 0 2024-09-18T21:12:55.262 INFO:tasks.workunit.client.0.smithi077.stdout:8/487: write d2/d27/d29/f43 [1837087,109188] 0 2024-09-18T21:12:55.263 INFO:tasks.workunit.client.0.smithi077.stdout:1/564: dread d3/f23 [0,4194304] 0 2024-09-18T21:12:55.263 INFO:tasks.workunit.client.1.smithi103.stdout:7/572: mkdir d1/df/d42/d1f/d5d/d85/db0 0 2024-09-18T21:12:55.264 INFO:tasks.workunit.client.1.smithi103.stdout:7/573: fdatasync d1/df/d42/d1f/f7b 0 2024-09-18T21:12:55.264 INFO:tasks.workunit.client.0.smithi077.stdout:4/466: rename d3/dc/f46 to d3/dc/d24/f8e 0 2024-09-18T21:12:55.265 INFO:tasks.workunit.client.0.smithi077.stdout:2/597: link d1/d4/d5/d1a/d49/c5e d1/d62/cc7 0 2024-09-18T21:12:55.265 INFO:tasks.workunit.client.0.smithi077.stdout:9/511: stat d1/dd/d11/d1c/d38/d46/c6f 0 2024-09-18T21:12:55.273 INFO:tasks.workunit.client.1.smithi103.stdout:7/574: mkdir d1/df/d43/db1 0 2024-09-18T21:12:55.274 INFO:tasks.workunit.client.1.smithi103.stdout:3/584: dread d1/da/df/f19 [0,4194304] 0 2024-09-18T21:12:55.276 INFO:tasks.workunit.client.1.smithi103.stdout:3/585: mknod d1/cb7 0 2024-09-18T21:12:55.279 INFO:tasks.workunit.client.1.smithi103.stdout:3/586: chown d1/d9a/fae 29230 1 2024-09-18T21:12:55.280 INFO:tasks.workunit.client.1.smithi103.stdout:0/581: dwrite d1/d5/de/d19/d1e/d34/da8/d9f/f3d [0,4194304] 0 2024-09-18T21:12:55.282 INFO:tasks.workunit.client.1.smithi103.stdout:0/582: chown d1/d5/de/dc0/dbf/d4e/c5d 824591 1 2024-09-18T21:12:55.284 INFO:tasks.workunit.client.1.smithi103.stdout:0/583: read - d1/d5/de/d24/d43/d76/f90 zero size 2024-09-18T21:12:55.284 INFO:tasks.workunit.client.1.smithi103.stdout:6/626: dread d2/d3/d8/f10 [4194304,4194304] 0 2024-09-18T21:12:55.285 INFO:tasks.workunit.client.1.smithi103.stdout:4/638: dread d9/d38/f51 [0,4194304] 0 2024-09-18T21:12:55.286 INFO:tasks.workunit.client.0.smithi077.stdout:5/698: creat d0/d6/d3b/fe0 x:0 0 0 2024-09-18T21:12:55.289 INFO:tasks.workunit.client.0.smithi077.stdout:6/515: rename d7/c1a to d7/d7e/d11/d1d/d4c/cae 0 2024-09-18T21:12:55.290 INFO:tasks.workunit.client.0.smithi077.stdout:4/467: rmdir d3/d77 39 2024-09-18T21:12:55.290 INFO:tasks.workunit.client.1.smithi103.stdout:3/587: dwrite d1/d23/d25/d4f/d58/d68/d50/d54/f9d [4194304,4194304] 0 2024-09-18T21:12:55.291 INFO:tasks.workunit.client.0.smithi077.stdout:2/598: read d1/d4/d5/d1a/d2e/d40/d69/fa6 [2182646,84230] 0 2024-09-18T21:12:55.291 INFO:tasks.workunit.client.1.smithi103.stdout:0/584: fsync d1/d5/de/d19/d1e/f21 0 2024-09-18T21:12:55.292 INFO:tasks.workunit.client.1.smithi103.stdout:2/546: sync 2024-09-18T21:12:55.293 INFO:tasks.workunit.client.0.smithi077.stdout:1/565: dwrite d3/ff [0,4194304] 0 2024-09-18T21:12:55.295 INFO:tasks.workunit.client.0.smithi077.stdout:2/599: fdatasync d1/d4/d5/d1a/d2e/d41/f9b 0 2024-09-18T21:12:55.297 INFO:tasks.workunit.client.1.smithi103.stdout:6/627: creat d2/d3/d8/d4c/d4e/fc3 x:0 0 0 2024-09-18T21:12:55.299 INFO:tasks.workunit.client.1.smithi103.stdout:9/642: dwrite d18/d8d/d2f/f65 [0,4194304] 0 2024-09-18T21:12:55.303 INFO:tasks.workunit.client.1.smithi103.stdout:9/643: truncate d18/f64 4556645 0 2024-09-18T21:12:55.304 INFO:tasks.workunit.client.0.smithi077.stdout:4/468: dwrite d3/dc/d32/d5b/f83 [0,4194304] 0 2024-09-18T21:12:55.304 INFO:tasks.workunit.client.1.smithi103.stdout:1/565: dwrite d0/d2/d9/dc/f28 [0,4194304] 0 2024-09-18T21:12:55.305 INFO:tasks.workunit.client.0.smithi077.stdout:9/512: rename d1/dd/d11/d2d/f8e to d1/dd/d11/d1c/d38/d46/fac 0 2024-09-18T21:12:55.308 INFO:tasks.workunit.client.0.smithi077.stdout:3/526: getdents db/d14/d32/d4f/d8a/d99 0 2024-09-18T21:12:55.311 INFO:tasks.workunit.client.1.smithi103.stdout:0/585: stat d1/d5/de/d24/d43/l7b 0 2024-09-18T21:12:55.312 INFO:tasks.workunit.client.1.smithi103.stdout:9/644: dwrite d18/d29/d68/fd4 [0,4194304] 0 2024-09-18T21:12:55.314 INFO:tasks.workunit.client.0.smithi077.stdout:0/628: dread d8/d1d/f2b [0,4194304] 0 2024-09-18T21:12:55.314 INFO:tasks.workunit.client.1.smithi103.stdout:3/588: creat d1/d2/d18/d30/fb8 x:0 0 0 2024-09-18T21:12:55.316 INFO:tasks.workunit.client.1.smithi103.stdout:3/589: chown d1/d2/d18/d30/d4e/d62/f6a 177069653 1 2024-09-18T21:12:55.316 INFO:tasks.workunit.client.0.smithi077.stdout:0/629: chown d8/d1a/d39/d3b/d9a/fa2 16261 1 2024-09-18T21:12:55.317 INFO:tasks.workunit.client.1.smithi103.stdout:3/590: stat d1/d23/d25/d4f/d72/d85 0 2024-09-18T21:12:55.319 INFO:tasks.workunit.client.1.smithi103.stdout:7/575: truncate d1/df/d42/f4e 2098500 0 2024-09-18T21:12:55.326 INFO:tasks.workunit.client.0.smithi077.stdout:0/630: dwrite d8/d37/d95/dab/f8c [0,4194304] 0 2024-09-18T21:12:55.329 INFO:tasks.workunit.client.0.smithi077.stdout:6/516: dread d7/d7e/d11/d3e/f51 [0,4194304] 0 2024-09-18T21:12:55.330 INFO:tasks.workunit.client.0.smithi077.stdout:5/699: dwrite d0/d6/dd/f3a [0,4194304] 0 2024-09-18T21:12:55.332 INFO:tasks.workunit.client.0.smithi077.stdout:3/527: rename db/d14/d32/d4f to db/d14/d32/d49/da4 0 2024-09-18T21:12:55.333 INFO:tasks.workunit.client.0.smithi077.stdout:8/488: link d2/d27/d29/l7f d2/d5/lb3 0 2024-09-18T21:12:55.333 INFO:tasks.workunit.client.1.smithi103.stdout:2/547: dread d3/f16 [0,4194304] 0 2024-09-18T21:12:55.333 INFO:tasks.workunit.client.1.smithi103.stdout:7/576: symlink d1/df/d42/d1f/d5d/lb2 0 2024-09-18T21:12:55.335 INFO:tasks.workunit.client.1.smithi103.stdout:7/577: chown d1/df/d42/d29/d2f 366539620 1 2024-09-18T21:12:55.335 INFO:tasks.workunit.client.0.smithi077.stdout:1/566: creat d3/d8/d13/d77/db1/da6/fcd x:0 0 0 2024-09-18T21:12:55.337 INFO:tasks.workunit.client.1.smithi103.stdout:4/639: getdents d9/d2e/d83/db6/d86 0 2024-09-18T21:12:55.339 INFO:tasks.workunit.client.1.smithi103.stdout:9/645: rename d18/d52/d5e/l73 to d18/da4/ld9 0 2024-09-18T21:12:55.340 INFO:tasks.workunit.client.1.smithi103.stdout:9/646: truncate d18/d29/faa 993022 0 2024-09-18T21:12:55.340 INFO:tasks.workunit.client.0.smithi077.stdout:2/600: mknod d1/d4/d9/d80/d83/dba/cc8 0 2024-09-18T21:12:55.342 INFO:tasks.workunit.client.1.smithi103.stdout:3/591: truncate d1/da/f16 2674351 0 2024-09-18T21:12:55.343 INFO:tasks.workunit.client.1.smithi103.stdout:2/548: fdatasync d3/d5/d2f/d32/f76 0 2024-09-18T21:12:55.346 INFO:tasks.workunit.client.1.smithi103.stdout:7/578: fdatasync d1/df/d43/d52/f99 0 2024-09-18T21:12:55.346 INFO:tasks.workunit.client.1.smithi103.stdout:4/640: symlink d9/d2e/d83/db6/d41/ldb 0 2024-09-18T21:12:55.348 INFO:tasks.workunit.client.0.smithi077.stdout:0/631: rename d8/d1d/fc0 to d8/d1a/d39/d3b/d9a/fc4 0 2024-09-18T21:12:55.350 INFO:tasks.workunit.client.0.smithi077.stdout:8/489: mkdir d2/d5f/da8/d20/d3e/db4 0 2024-09-18T21:12:55.351 INFO:tasks.workunit.client.0.smithi077.stdout:8/490: chown d2/d5f/da8/d4f/d5a/d5e 516629833 1 2024-09-18T21:12:55.351 INFO:tasks.workunit.client.1.smithi103.stdout:3/592: dwrite d1/d23/d25/d4f/d58/d68/d50/d54/f9d [4194304,4194304] 0 2024-09-18T21:12:55.352 INFO:tasks.workunit.client.0.smithi077.stdout:8/491: write d2/d36/f78 [777106,55901] 0 2024-09-18T21:12:55.353 INFO:tasks.workunit.client.1.smithi103.stdout:2/549: creat d3/d5/d2f/d32/d46/fc9 x:0 0 0 2024-09-18T21:12:55.356 INFO:tasks.workunit.client.1.smithi103.stdout:2/550: dread - d3/d5/d25/fb2 zero size 2024-09-18T21:12:55.356 INFO:tasks.workunit.client.0.smithi077.stdout:9/513: creat d1/dd/d11/fad x:0 0 0 2024-09-18T21:12:55.357 INFO:tasks.workunit.client.1.smithi103.stdout:2/551: chown d3/d5/d2f/d48 57765204 1 2024-09-18T21:12:55.357 INFO:tasks.workunit.client.0.smithi077.stdout:6/517: symlink d7/d7e/d11/d3e/laf 0 2024-09-18T21:12:55.360 INFO:tasks.workunit.client.1.smithi103.stdout:3/593: rename d1/d2/d18/d30/d4e/d62/c6c to d1/d23/d25/d4f/d58/d68/d50/d54/d8c/cb9 0 2024-09-18T21:12:55.361 INFO:tasks.workunit.client.1.smithi103.stdout:6/628: write d2/d24/d5a/d67/d76/d43/f45 [3190307,41241] 0 2024-09-18T21:12:55.362 INFO:tasks.workunit.client.0.smithi077.stdout:0/632: rmdir d8/d1a/d39 39 2024-09-18T21:12:55.366 INFO:tasks.workunit.client.1.smithi103.stdout:1/566: dwrite d0/d2/d2b/f41 [0,4194304] 0 2024-09-18T21:12:55.367 INFO:tasks.workunit.client.1.smithi103.stdout:0/586: dread d1/f29 [0,4194304] 0 2024-09-18T21:12:55.371 INFO:tasks.workunit.client.0.smithi077.stdout:8/492: unlink d2/d5/d6/d7e/fb0 0 2024-09-18T21:12:55.373 INFO:tasks.workunit.client.0.smithi077.stdout:8/493: chown d2/d27/d29/f3f 69645850 1 2024-09-18T21:12:55.375 INFO:tasks.workunit.client.0.smithi077.stdout:9/514: read d1/d54/f3b [98938,35245] 0 2024-09-18T21:12:55.376 INFO:tasks.workunit.client.0.smithi077.stdout:1/567: link d3/d38/fb3 d3/d6a/d9b/dbe/fce 0 2024-09-18T21:12:55.377 INFO:tasks.workunit.client.0.smithi077.stdout:4/469: write d3/d7/f1a [7206,58636] 0 2024-09-18T21:12:55.378 INFO:tasks.workunit.client.0.smithi077.stdout:9/515: fsync d1/dd/d11/d1c/d38/d46/d55/f87 0 2024-09-18T21:12:55.378 INFO:tasks.workunit.client.0.smithi077.stdout:1/568: chown d3/d8/d49/d4e/d5a/f78 503390533 1 2024-09-18T21:12:55.379 INFO:tasks.workunit.client.0.smithi077.stdout:9/516: fdatasync d1/dd/d57/f74 0 2024-09-18T21:12:55.379 INFO:tasks.workunit.client.1.smithi103.stdout:1/567: mkdir d0/d3/d68/d81/da2/da4/dc2 0 2024-09-18T21:12:55.380 INFO:tasks.workunit.client.1.smithi103.stdout:1/568: chown d0/d2/d2b/d3a/d42/d9c 3 1 2024-09-18T21:12:55.380 INFO:tasks.workunit.client.0.smithi077.stdout:4/470: write d3/d7/f4f [322108,66045] 0 2024-09-18T21:12:55.381 INFO:tasks.workunit.client.0.smithi077.stdout:5/700: dread d0/df/d10/fb0 [0,4194304] 0 2024-09-18T21:12:55.382 INFO:tasks.workunit.client.1.smithi103.stdout:0/587: mknod d1/d5/de/d22/d98/cc7 0 2024-09-18T21:12:55.382 INFO:tasks.workunit.client.0.smithi077.stdout:5/701: truncate d0/fd5 267572 0 2024-09-18T21:12:55.385 INFO:tasks.workunit.client.1.smithi103.stdout:6/629: getdents d2/d24 0 2024-09-18T21:12:55.386 INFO:tasks.workunit.client.1.smithi103.stdout:9/647: dwrite d18/f24 [4194304,4194304] 0 2024-09-18T21:12:55.386 INFO:tasks.workunit.client.1.smithi103.stdout:7/579: write d1/df/d42/f26 [5020510,101541] 0 2024-09-18T21:12:55.387 INFO:tasks.workunit.client.1.smithi103.stdout:1/569: creat d0/d2/d9/dc/d36/fc3 x:0 0 0 2024-09-18T21:12:55.389 INFO:tasks.workunit.client.1.smithi103.stdout:7/580: readlink d1/df/d42/d1f/d5d/d85/lac 0 2024-09-18T21:12:55.389 INFO:tasks.workunit.client.1.smithi103.stdout:0/588: creat d1/d5/de/d19/d1e/d34/da8/d9f/d4f/d68/fc8 x:0 0 0 2024-09-18T21:12:55.391 INFO:tasks.workunit.client.1.smithi103.stdout:3/594: write d1/d2/d18/d30/f38 [3442295,350] 0 2024-09-18T21:12:55.392 INFO:tasks.workunit.client.1.smithi103.stdout:6/630: mknod d2/d24/d5a/d67/d76/cc4 0 2024-09-18T21:12:55.394 INFO:tasks.workunit.client.1.smithi103.stdout:6/631: stat d2/d3/d8/d4c/d4e/c51 0 2024-09-18T21:12:55.394 INFO:tasks.workunit.client.1.smithi103.stdout:9/648: chown d18/d52/d6f/d8e/d8f/dbd/dc3/fc4 249106 1 2024-09-18T21:12:55.396 INFO:tasks.workunit.client.1.smithi103.stdout:0/589: dwrite d1/d5/de/d19/fa6 [0,4194304] 0 2024-09-18T21:12:55.398 INFO:tasks.workunit.client.1.smithi103.stdout:9/649: dread d18/d29/f44 [0,4194304] 0 2024-09-18T21:12:55.398 INFO:tasks.workunit.client.1.smithi103.stdout:1/570: creat d0/d2/d2b/d3a/d42/d72/db0/da7/fc4 x:0 0 0 2024-09-18T21:12:55.399 INFO:tasks.workunit.client.1.smithi103.stdout:7/581: creat d1/df/d42/d29/d2f/d33/fb3 x:0 0 0 2024-09-18T21:12:55.401 INFO:tasks.workunit.client.1.smithi103.stdout:3/595: creat d1/d23/d25/d4f/d51/fba x:0 0 0 2024-09-18T21:12:55.401 INFO:tasks.workunit.client.1.smithi103.stdout:6/632: dread d2/f22 [0,4194304] 0 2024-09-18T21:12:55.402 INFO:tasks.workunit.client.1.smithi103.stdout:6/633: readlink d2/d24/d5a/d67/lb4 0 2024-09-18T21:12:55.404 INFO:tasks.workunit.client.1.smithi103.stdout:9/650: rmdir d18/d52/d5e 39 2024-09-18T21:12:55.406 INFO:tasks.workunit.client.1.smithi103.stdout:1/571: creat d0/d2/d9/d9e/fc5 x:0 0 0 2024-09-18T21:12:55.408 INFO:tasks.workunit.client.1.smithi103.stdout:7/582: mkdir d1/df/d44/db4 0 2024-09-18T21:12:55.410 INFO:tasks.workunit.client.0.smithi077.stdout:6/518: creat d7/d7e/d11/d1d/d49/d96/fb0 x:0 0 0 2024-09-18T21:12:55.410 INFO:tasks.workunit.client.1.smithi103.stdout:9/651: dwrite d18/f24 [0,4194304] 0 2024-09-18T21:12:55.410 INFO:tasks.workunit.client.1.smithi103.stdout:9/652: stat fa 0 2024-09-18T21:12:55.410 INFO:tasks.workunit.client.1.smithi103.stdout:0/590: symlink d1/d5/lc9 0 2024-09-18T21:12:55.413 INFO:tasks.workunit.client.0.smithi077.stdout:8/494: symlink d2/d5f/da8/d4f/d5a/d2a/lb5 0 2024-09-18T21:12:55.415 INFO:tasks.workunit.client.1.smithi103.stdout:1/572: symlink d0/d2/d2b/d3a/d42/d9c/lc6 0 2024-09-18T21:12:55.416 INFO:tasks.workunit.client.1.smithi103.stdout:1/573: fdatasync d0/d2/d9/dc/f7e 0 2024-09-18T21:12:55.416 INFO:tasks.workunit.client.0.smithi077.stdout:1/569: creat d3/d8/d75/d89/dbb/fcf x:0 0 0 2024-09-18T21:12:55.417 INFO:tasks.workunit.client.1.smithi103.stdout:7/583: symlink d1/lb5 0 2024-09-18T21:12:55.419 INFO:tasks.workunit.client.1.smithi103.stdout:0/591: symlink d1/d5/de/dc0/lca 0 2024-09-18T21:12:55.420 INFO:tasks.workunit.client.0.smithi077.stdout:9/517: mkdir d1/dd/d11/d1c/d38/dae 0 2024-09-18T21:12:55.424 INFO:tasks.workunit.client.0.smithi077.stdout:2/601: getdents d1/d4/d5/d1a/d49/d6a/d81/dc4 0 2024-09-18T21:12:55.425 INFO:tasks.workunit.client.1.smithi103.stdout:0/592: dwrite d1/d5/f6 [0,4194304] 0 2024-09-18T21:12:55.428 INFO:tasks.workunit.client.1.smithi103.stdout:7/584: creat d1/df/d54/fb6 x:0 0 0 2024-09-18T21:12:55.429 INFO:tasks.workunit.client.1.smithi103.stdout:7/585: chown d1/df/d42/d1f/d5d/f71 406085 1 2024-09-18T21:12:55.429 INFO:tasks.workunit.client.0.smithi077.stdout:9/518: dread d1/dd/d11/d2d/d59/f6a [0,4194304] 0 2024-09-18T21:12:55.430 INFO:tasks.workunit.client.0.smithi077.stdout:4/471: truncate d3/dc/d24/f8e 850302 0 2024-09-18T21:12:55.431 INFO:tasks.workunit.client.0.smithi077.stdout:9/519: stat d1/dd/d11/d1c/d38/d46/d55/d9c/la8 0 2024-09-18T21:12:55.432 INFO:tasks.workunit.client.0.smithi077.stdout:2/602: rmdir d1/d4/d9/d4f 39 2024-09-18T21:12:55.435 INFO:tasks.workunit.client.0.smithi077.stdout:6/519: dread d7/d7e/d11/d1d/d5c/f6b [0,4194304] 0 2024-09-18T21:12:55.440 INFO:tasks.workunit.client.0.smithi077.stdout:4/472: mknod d3/dc/d51/c8f 0 2024-09-18T21:12:55.441 INFO:tasks.workunit.client.0.smithi077.stdout:9/520: dwrite d1/dd/d11/d1c/d38/d46/d55/f87 [0,4194304] 0 2024-09-18T21:12:55.441 INFO:tasks.workunit.client.1.smithi103.stdout:7/586: creat d1/df/d43/d52/fb7 x:0 0 0 2024-09-18T21:12:55.443 INFO:tasks.workunit.client.1.smithi103.stdout:6/634: link d2/d24/d38/d68/d7c/lb5 d2/d3/d8/d4c/lc5 0 2024-09-18T21:12:55.443 INFO:tasks.workunit.client.0.smithi077.stdout:2/603: creat d1/d4/d5/d1a/d49/fc9 x:0 0 0 2024-09-18T21:12:55.446 INFO:tasks.workunit.client.0.smithi077.stdout:8/495: link d2/d5/d6/l59 d2/d36/lb6 0 2024-09-18T21:12:55.446 INFO:tasks.workunit.client.1.smithi103.stdout:0/593: mknod d1/d5/de/dc0/db0/ccb 0 2024-09-18T21:12:55.447 INFO:tasks.workunit.client.1.smithi103.stdout:0/594: write d1/d5/de/d19/d1e/d34/da8/d9f/f1b [1847153,95075] 0 2024-09-18T21:12:55.448 INFO:tasks.workunit.client.0.smithi077.stdout:0/633: dwrite d8/d1a/fa3 [0,4194304] 0 2024-09-18T21:12:55.449 INFO:tasks.workunit.client.1.smithi103.stdout:1/574: link d0/l32 d0/d2/d2b/d3a/d42/d72/db0/da7/lc7 0 2024-09-18T21:12:55.450 INFO:tasks.workunit.client.0.smithi077.stdout:0/634: write d8/d1d/d80/f84 [59804,77722] 0 2024-09-18T21:12:55.452 INFO:tasks.workunit.client.1.smithi103.stdout:7/587: creat d1/df/d43/d61/fb8 x:0 0 0 2024-09-18T21:12:55.452 INFO:tasks.workunit.client.1.smithi103.stdout:9/653: write d18/d52/d6f/d8e/fa3 [1341057,74425] 0 2024-09-18T21:12:55.457 INFO:tasks.workunit.client.1.smithi103.stdout:1/575: dwrite d0/d11/d5f/d19/f34 [0,4194304] 0 2024-09-18T21:12:55.459 INFO:tasks.workunit.client.0.smithi077.stdout:8/496: creat d2/d27/d29/d41/fb7 x:0 0 0 2024-09-18T21:12:55.459 INFO:tasks.workunit.client.0.smithi077.stdout:1/570: dwrite d3/d8/d49/d4e/d5a/f69 [0,4194304] 0 2024-09-18T21:12:55.464 INFO:tasks.workunit.client.0.smithi077.stdout:0/635: symlink d8/d37/d66/lc5 0 2024-09-18T21:12:55.466 INFO:tasks.workunit.client.1.smithi103.stdout:5/656: sync 2024-09-18T21:12:55.466 INFO:tasks.workunit.client.1.smithi103.stdout:8/698: sync 2024-09-18T21:12:55.468 INFO:tasks.workunit.client.1.smithi103.stdout:6/635: unlink d2/d3/d8/d4c/d79/lb7 0 2024-09-18T21:12:55.469 INFO:tasks.workunit.client.1.smithi103.stdout:6/636: truncate d2/d24/d38/d68/fa6 134190 0 2024-09-18T21:12:55.470 INFO:tasks.workunit.client.0.smithi077.stdout:4/473: unlink d3/dc/d20/l4e 0 2024-09-18T21:12:55.472 INFO:tasks.workunit.client.0.smithi077.stdout:4/474: fsync d3/dc/d32/d45/d5e/f84 0 2024-09-18T21:12:55.476 INFO:tasks.workunit.client.0.smithi077.stdout:8/497: unlink d2/d5f/d6f/f91 0 2024-09-18T21:12:55.478 INFO:tasks.workunit.client.0.smithi077.stdout:0/636: mknod d8/d1d/cc6 0 2024-09-18T21:12:55.478 INFO:tasks.workunit.client.0.smithi077.stdout:4/475: dwrite d3/fb [0,4194304] 0 2024-09-18T21:12:55.480 INFO:tasks.workunit.client.1.smithi103.stdout:9/654: rename d18/d29/l26 to d18/d52/lda 0 2024-09-18T21:12:55.481 INFO:tasks.workunit.client.1.smithi103.stdout:9/655: chown d18/d29/faa 2993177 1 2024-09-18T21:12:55.481 INFO:tasks.workunit.client.1.smithi103.stdout:0/595: getdents d1/d5/de/d24/d43/d76 0 2024-09-18T21:12:55.482 INFO:tasks.workunit.client.1.smithi103.stdout:9/656: chown d18/d8d/laf 541952 1 2024-09-18T21:12:55.482 INFO:tasks.workunit.client.0.smithi077.stdout:8/498: symlink d2/d5f/d7a/lb8 0 2024-09-18T21:12:55.483 INFO:tasks.workunit.client.1.smithi103.stdout:5/657: creat de/d1f/d3b/fda x:0 0 0 2024-09-18T21:12:55.484 INFO:tasks.workunit.client.1.smithi103.stdout:5/658: chown de/d1f/d3b/d3c 30500371 1 2024-09-18T21:12:55.484 INFO:tasks.workunit.client.0.smithi077.stdout:8/499: write d2/d5f/da8/d4f/f79 [1114976,30585] 0 2024-09-18T21:12:55.485 INFO:tasks.workunit.client.1.smithi103.stdout:8/699: creat d4/de/d4a/d59/fdb x:0 0 0 2024-09-18T21:12:55.485 INFO:tasks.workunit.client.0.smithi077.stdout:2/604: dread d1/d4/d5/d1a/d2e/f43 [4194304,4194304] 0 2024-09-18T21:12:55.486 INFO:tasks.workunit.client.0.smithi077.stdout:0/637: rmdir d8/d1d/d57 39 2024-09-18T21:12:55.486 INFO:tasks.workunit.client.1.smithi103.stdout:7/588: dread d1/df/d42/f83 [0,4194304] 0 2024-09-18T21:12:55.487 INFO:tasks.workunit.client.0.smithi077.stdout:0/638: read d8/d26/f18 [123279,31398] 0 2024-09-18T21:12:55.491 INFO:tasks.workunit.client.0.smithi077.stdout:2/605: symlink d1/d4/d5/d1a/d49/d6a/d81/dc4/lca 0 2024-09-18T21:12:55.492 INFO:tasks.workunit.client.0.smithi077.stdout:2/606: write d1/d4/d9/d80/d95/fb1 [590717,72353] 0 2024-09-18T21:12:55.493 INFO:tasks.workunit.client.0.smithi077.stdout:8/500: creat d2/d5f/da8/d4f/d5a/d2a/d88/fb9 x:0 0 0 2024-09-18T21:12:55.494 INFO:tasks.workunit.client.0.smithi077.stdout:0/639: creat d8/d37/d66/db4/fc7 x:0 0 0 2024-09-18T21:12:55.495 INFO:tasks.workunit.client.0.smithi077.stdout:1/571: getdents d3/d8/d75/d54 0 2024-09-18T21:12:55.496 INFO:tasks.workunit.client.0.smithi077.stdout:8/501: read d2/d27/d29/f58 [4151582,59013] 0 2024-09-18T21:12:55.497 INFO:tasks.workunit.client.1.smithi103.stdout:8/700: unlink d4/de/d4a/d59/d5e/fb9 0 2024-09-18T21:12:55.503 INFO:tasks.workunit.client.0.smithi077.stdout:0/640: symlink d8/d1a/d39/d3b/d70/lc8 0 2024-09-18T21:12:55.504 INFO:tasks.workunit.client.0.smithi077.stdout:2/607: creat d1/d4/d5/d1a/d2e/d41/fcb x:0 0 0 2024-09-18T21:12:55.505 INFO:tasks.workunit.client.0.smithi077.stdout:2/608: write d1/d4/fbd [732754,89086] 0 2024-09-18T21:12:55.508 INFO:tasks.workunit.client.0.smithi077.stdout:9/521: truncate d1/dd/f94 108574 0 2024-09-18T21:12:55.519 INFO:tasks.workunit.client.1.smithi103.stdout:9/657: write d18/d8d/d2f/f4e [331864,80433] 0 2024-09-18T21:12:55.519 INFO:tasks.workunit.client.1.smithi103.stdout:9/658: stat d18/d52/d6f 0 2024-09-18T21:12:55.522 INFO:tasks.workunit.client.0.smithi077.stdout:4/476: dwrite d3/dc/d32/f48 [0,4194304] 0 2024-09-18T21:12:55.523 INFO:tasks.workunit.client.1.smithi103.stdout:5/659: truncate de/fd9 5716163 0 2024-09-18T21:12:55.529 INFO:tasks.workunit.client.0.smithi077.stdout:2/609: rename d1/d4/d9/d4f/f8f to d1/d4/d5/d1a/d2e/fcc 0 2024-09-18T21:12:55.532 INFO:tasks.workunit.client.0.smithi077.stdout:1/572: dwrite d3/d8/d13/f1f [4194304,4194304] 0 2024-09-18T21:12:55.535 INFO:tasks.workunit.client.1.smithi103.stdout:1/576: rename d0/d2/d9/f63 to d0/d2/fc8 0 2024-09-18T21:12:55.535 INFO:tasks.workunit.client.0.smithi077.stdout:8/502: dwrite d2/d5f/da8/d26/f32 [0,4194304] 0 2024-09-18T21:12:55.545 INFO:tasks.workunit.client.1.smithi103.stdout:8/701: symlink d4/d81/d65/d39/ldc 0 2024-09-18T21:12:55.546 INFO:tasks.workunit.client.1.smithi103.stdout:8/702: dread - d4/d98/fcf zero size 2024-09-18T21:12:55.547 INFO:tasks.workunit.client.1.smithi103.stdout:8/703: stat d4/d2d/d87/fc9 0 2024-09-18T21:12:55.548 INFO:tasks.workunit.client.1.smithi103.stdout:9/659: creat d18/d52/d6f/fdb x:0 0 0 2024-09-18T21:12:55.549 INFO:tasks.workunit.client.0.smithi077.stdout:9/522: truncate d1/dd/f62 405449 0 2024-09-18T21:12:55.551 INFO:tasks.workunit.client.0.smithi077.stdout:1/573: unlink d3/d6a/d9b/d68/c36 0 2024-09-18T21:12:55.554 INFO:tasks.workunit.client.0.smithi077.stdout:4/477: chown d3/dc/f6b 8132162 1 2024-09-18T21:12:55.554 INFO:tasks.workunit.client.0.smithi077.stdout:2/610: dread d1/d4/d5/d1a/d49/d6a/d81/dc4/dc0/f8a [0,4194304] 0 2024-09-18T21:12:55.555 INFO:tasks.workunit.client.1.smithi103.stdout:0/596: rename d1/d5/de/d19/f7e to d1/d5/de/dc0/d62/fcc 0 2024-09-18T21:12:55.556 INFO:tasks.workunit.client.1.smithi103.stdout:8/704: dwrite d4/de/d4a/d59/fce [0,4194304] 0 2024-09-18T21:12:55.557 INFO:tasks.workunit.client.1.smithi103.stdout:8/705: write d4/d98/fcf [548477,41481] 0 2024-09-18T21:12:55.557 INFO:tasks.workunit.client.1.smithi103.stdout:1/577: symlink d0/d3/d68/d81/da2/lc9 0 2024-09-18T21:12:55.558 INFO:tasks.workunit.client.1.smithi103.stdout:1/578: chown d0/d2/d9/l45 22 1 2024-09-18T21:12:55.559 INFO:tasks.workunit.client.1.smithi103.stdout:1/579: readlink d0/d3/l8 0 2024-09-18T21:12:55.560 INFO:tasks.workunit.client.0.smithi077.stdout:9/523: fsync d1/d54/f12 0 2024-09-18T21:12:55.563 INFO:tasks.workunit.client.0.smithi077.stdout:1/574: creat d3/d6a/d9b/d68/fd0 x:0 0 0 2024-09-18T21:12:55.564 INFO:tasks.workunit.client.1.smithi103.stdout:5/660: symlink de/d3e/ldb 0 2024-09-18T21:12:55.567 INFO:tasks.workunit.client.1.smithi103.stdout:0/597: readlink d1/d5/de/l10 0 2024-09-18T21:12:55.567 INFO:tasks.workunit.client.1.smithi103.stdout:9/660: fsync d18/d52/d6f/fdb 0 2024-09-18T21:12:55.571 INFO:tasks.workunit.client.1.smithi103.stdout:7/589: dwrite d1/df/d43/f4d [0,4194304] 0 2024-09-18T21:12:55.572 INFO:tasks.workunit.client.1.smithi103.stdout:7/590: chown d1/df/d44/fa0 56888127 1 2024-09-18T21:12:55.573 INFO:tasks.workunit.client.1.smithi103.stdout:5/661: mknod de/d1f/d3b/d51/db0/cdc 0 2024-09-18T21:12:55.573 INFO:tasks.workunit.client.0.smithi077.stdout:9/524: dread d1/d54/f5c [0,4194304] 0 2024-09-18T21:12:55.575 INFO:tasks.workunit.client.0.smithi077.stdout:8/503: write f1 [2012297,34309] 0 2024-09-18T21:12:55.576 INFO:tasks.workunit.client.1.smithi103.stdout:9/661: creat d18/d52/d6f/d8e/db4/fdc x:0 0 0 2024-09-18T21:12:55.577 INFO:tasks.workunit.client.0.smithi077.stdout:8/504: write d2/d5f/da8/d4f/f69 [38342,114245] 0 2024-09-18T21:12:55.578 INFO:tasks.workunit.client.1.smithi103.stdout:0/598: mknod d1/d5/de/d19/d1e/d34/da8/d9f/d8d/ccd 0 2024-09-18T21:12:55.579 INFO:tasks.workunit.client.0.smithi077.stdout:1/575: rmdir d3/d6a/d9b/d4c 39 2024-09-18T21:12:55.581 INFO:tasks.workunit.client.1.smithi103.stdout:1/580: unlink d0/d2/d9/c2c 0 2024-09-18T21:12:55.582 INFO:tasks.workunit.client.1.smithi103.stdout:1/581: chown d0/d2/d9/d9e/d86 934615 1 2024-09-18T21:12:55.582 INFO:tasks.workunit.client.1.smithi103.stdout:4/641: sync 2024-09-18T21:12:55.583 INFO:tasks.workunit.client.0.smithi077.stdout:9/525: mkdir d1/dd/d11/d1c/d38/d46/daf 0 2024-09-18T21:12:55.584 INFO:tasks.workunit.client.0.smithi077.stdout:9/526: write d1/d54/f84 [63851,55906] 0 2024-09-18T21:12:55.584 INFO:tasks.workunit.client.1.smithi103.stdout:7/591: truncate d1/fe 5278757 0 2024-09-18T21:12:55.585 INFO:tasks.workunit.client.0.smithi077.stdout:4/478: creat d3/d7/d6c/f90 x:0 0 0 2024-09-18T21:12:55.585 INFO:tasks.workunit.client.0.smithi077.stdout:9/527: read - d1/dd/d1a/fa2 zero size 2024-09-18T21:12:55.586 INFO:tasks.workunit.client.1.smithi103.stdout:7/592: truncate d1/df/d44/fa0 142573 0 2024-09-18T21:12:55.586 INFO:tasks.workunit.client.0.smithi077.stdout:8/505: creat d2/d5f/da8/d26/fba x:0 0 0 2024-09-18T21:12:55.587 INFO:tasks.workunit.client.0.smithi077.stdout:1/576: symlink d3/d8/d75/d54/ld1 0 2024-09-18T21:12:55.587 INFO:tasks.workunit.client.0.smithi077.stdout:8/506: chown d2/d5f/da8/d4f/f79 60 1 2024-09-18T21:12:55.588 INFO:tasks.workunit.client.0.smithi077.stdout:1/577: chown d3/d8/d49/l9a 0 1 2024-09-18T21:12:55.589 INFO:tasks.workunit.client.1.smithi103.stdout:9/662: mkdir d18/d8d/d2f/ddd 0 2024-09-18T21:12:55.590 INFO:tasks.workunit.client.0.smithi077.stdout:8/507: stat d2/d5f/da8/d4f/d5a/d2a/d88/fa3 0 2024-09-18T21:12:55.591 INFO:tasks.workunit.client.1.smithi103.stdout:7/593: fdatasync d1/df/d42/d29/d2f/d33/f40 0 2024-09-18T21:12:55.594 INFO:tasks.workunit.client.1.smithi103.stdout:8/706: getdents d4/de 0 2024-09-18T21:12:55.595 INFO:tasks.workunit.client.0.smithi077.stdout:9/528: dwrite d1/d54/d51/f9d [0,4194304] 0 2024-09-18T21:12:55.596 INFO:tasks.workunit.client.0.smithi077.stdout:9/529: dread - d1/dd/d11/d72/f98 zero size 2024-09-18T21:12:55.598 INFO:tasks.workunit.client.1.smithi103.stdout:4/642: truncate d9/fc 1168961 0 2024-09-18T21:12:55.599 INFO:tasks.workunit.client.0.smithi077.stdout:9/530: write d1/dd/d11/d15/d80/f91 [134210,51781] 0 2024-09-18T21:12:55.599 INFO:tasks.workunit.client.1.smithi103.stdout:5/662: link de/d3e/ldb de/d1f/d3b/d3c/d62/ldd 0 2024-09-18T21:12:55.600 INFO:tasks.workunit.client.0.smithi077.stdout:8/508: dwrite d2/d27/d29/f9c [0,4194304] 0 2024-09-18T21:12:55.600 INFO:tasks.workunit.client.0.smithi077.stdout:8/509: stat d2/d27/d29/d72/f8c 0 2024-09-18T21:12:55.601 INFO:tasks.workunit.client.1.smithi103.stdout:8/707: dwrite d4/de/f46 [4194304,4194304] 0 2024-09-18T21:12:55.601 INFO:tasks.workunit.client.0.smithi077.stdout:8/510: write d2/d36/f78 [1449339,117663] 0 2024-09-18T21:12:55.604 INFO:tasks.workunit.client.0.smithi077.stdout:9/531: symlink d1/d54/d81/lb0 0 2024-09-18T21:12:55.604 INFO:tasks.workunit.client.0.smithi077.stdout:9/532: dread - d1/d54/d51/fa4 zero size 2024-09-18T21:12:55.610 INFO:tasks.workunit.client.0.smithi077.stdout:8/511: unlink d2/d5f/d7a/cb2 0 2024-09-18T21:12:55.611 INFO:tasks.workunit.client.0.smithi077.stdout:9/533: rename d1/dd/d1a/l2a to d1/d54/d51/da3/lb1 0 2024-09-18T21:12:55.612 INFO:tasks.workunit.client.0.smithi077.stdout:9/534: chown d1/dd/d11/d72/f98 2487238 1 2024-09-18T21:12:55.614 INFO:tasks.workunit.client.0.smithi077.stdout:8/512: creat d2/d27/d29/d72/d81/fbb x:0 0 0 2024-09-18T21:12:55.615 INFO:tasks.workunit.client.0.smithi077.stdout:9/535: chown d1/dd/d11/d1c/d38/d46/d55/f87 78 1 2024-09-18T21:12:55.615 INFO:tasks.workunit.client.0.smithi077.stdout:8/513: readlink d2/lb 0 2024-09-18T21:12:55.619 INFO:tasks.workunit.client.0.smithi077.stdout:9/536: symlink d1/d54/d27/lb2 0 2024-09-18T21:12:55.623 INFO:tasks.workunit.client.0.smithi077.stdout:4/479: dwrite d3/d7/d42/f5d [0,4194304] 0 2024-09-18T21:12:55.623 INFO:tasks.workunit.client.0.smithi077.stdout:1/578: dwrite d3/d6a/d9b/d68/f3c [0,4194304] 0 2024-09-18T21:12:55.628 INFO:tasks.workunit.client.0.smithi077.stdout:8/514: dwrite d2/d5f/f9b [0,4194304] 0 2024-09-18T21:12:55.630 INFO:tasks.workunit.client.0.smithi077.stdout:9/537: creat d1/dd/d11/d1c/d38/d46/d55/d7f/fb3 x:0 0 0 2024-09-18T21:12:55.633 INFO:tasks.workunit.client.0.smithi077.stdout:8/515: dread d2/d27/d29/d41/f45 [0,4194304] 0 2024-09-18T21:12:55.635 INFO:tasks.workunit.client.0.smithi077.stdout:4/480: rename d3/dc/c65 to d3/c91 0 2024-09-18T21:12:55.635 INFO:tasks.workunit.client.0.smithi077.stdout:1/579: dwrite d3/d8/f88 [0,4194304] 0 2024-09-18T21:12:55.640 INFO:tasks.workunit.client.0.smithi077.stdout:1/580: creat d3/d6a/d9b/d7f/fd2 x:0 0 0 2024-09-18T21:12:55.647 INFO:tasks.workunit.client.0.smithi077.stdout:1/581: dwrite d3/d6a/d9b/f55 [0,4194304] 0 2024-09-18T21:12:55.648 INFO:tasks.workunit.client.0.smithi077.stdout:1/582: write d3/d8/d13/d18/f6c [1644353,53206] 0 2024-09-18T21:12:55.671 INFO:tasks.workunit.client.0.smithi077.stdout:4/481: getdents d3/dc 0 2024-09-18T21:12:55.673 INFO:tasks.workunit.client.0.smithi077.stdout:4/482: write d3/d77/f8b [241524,29412] 0 2024-09-18T21:12:55.673 INFO:tasks.workunit.client.0.smithi077.stdout:1/583: truncate d3/d8/d13/f1f 741808 0 2024-09-18T21:12:55.674 INFO:tasks.workunit.client.0.smithi077.stdout:9/538: dread d1/dd/d11/f3e [0,4194304] 0 2024-09-18T21:12:55.675 INFO:tasks.workunit.client.1.smithi103.stdout:1/582: creat d0/d2/fca x:0 0 0 2024-09-18T21:12:55.675 INFO:tasks.workunit.client.1.smithi103.stdout:4/643: rmdir d9/d2e/d61/d91/daa 39 2024-09-18T21:12:55.676 INFO:tasks.workunit.client.0.smithi077.stdout:4/483: creat d3/d7/d7b/f92 x:0 0 0 2024-09-18T21:12:55.676 INFO:tasks.workunit.client.0.smithi077.stdout:8/516: dread d2/d5f/da8/f1b [0,4194304] 0 2024-09-18T21:12:55.677 INFO:tasks.workunit.client.1.smithi103.stdout:9/663: write d18/d29/d68/f99 [4092452,54673] 0 2024-09-18T21:12:55.677 INFO:tasks.workunit.client.0.smithi077.stdout:9/539: creat d1/dd/d11/d2d/d59/fb4 x:0 0 0 2024-09-18T21:12:55.678 INFO:tasks.workunit.client.0.smithi077.stdout:9/540: fsync d1/dd/d11/d2d/f32 0 2024-09-18T21:12:55.679 INFO:tasks.workunit.client.1.smithi103.stdout:8/708: write d4/de/d4a/fb1 [523849,14182] 0 2024-09-18T21:12:55.682 INFO:tasks.workunit.client.0.smithi077.stdout:4/484: dwrite d3/d7/f68 [4194304,4194304] 0 2024-09-18T21:12:55.683 INFO:tasks.workunit.client.1.smithi103.stdout:5/663: dwrite de/d1f/d3b/fda [0,4194304] 0 2024-09-18T21:12:55.684 INFO:tasks.workunit.client.1.smithi103.stdout:5/664: write de/d1f/d3b/d58/f9b [9782,88379] 0 2024-09-18T21:12:55.705 INFO:tasks.workunit.client.1.smithi103.stdout:2/552: sync 2024-09-18T21:12:55.705 INFO:tasks.workunit.client.1.smithi103.stdout:3/596: sync 2024-09-18T21:12:55.706 INFO:tasks.workunit.client.1.smithi103.stdout:2/553: fsync d3/d5/d2c/f5c 0 2024-09-18T21:12:55.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:55 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/2774712536' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T21:12:55.753 INFO:tasks.workunit.client.1.smithi103.stdout:6/637: sync 2024-09-18T21:12:55.758 INFO:tasks.workunit.client.1.smithi103.stdout:6/638: dwrite d2/d24/d5a/f64 [0,4194304] 0 2024-09-18T21:12:55.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:55 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/2774712536' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T21:12:55.779 INFO:tasks.workunit.client.0.smithi077.stdout:1/584: fsync d3/d6a/f9e 0 2024-09-18T21:12:55.781 INFO:tasks.workunit.client.0.smithi077.stdout:9/541: fdatasync d1/dd/d11/f3e 0 2024-09-18T21:12:55.815 INFO:tasks.workunit.client.1.smithi103.stdout:0/599: sync 2024-09-18T21:12:55.815 INFO:tasks.workunit.client.1.smithi103.stdout:7/594: sync 2024-09-18T21:12:55.832 INFO:tasks.workunit.client.0.smithi077.stdout:7/597: sync 2024-09-18T21:12:55.833 INFO:tasks.workunit.client.0.smithi077.stdout:7/598: chown d12/d22/daa/dc0/dac/dad/fb0 29073865 1 2024-09-18T21:12:55.834 INFO:tasks.workunit.client.0.smithi077.stdout:7/599: write d12/d31/f41 [1440826,44056] 0 2024-09-18T21:12:55.836 INFO:tasks.workunit.client.0.smithi077.stdout:4/485: mknod d3/dc/d51/d53/d66/c93 0 2024-09-18T21:12:55.838 INFO:tasks.workunit.client.1.smithi103.stdout:9/664: symlink d18/d8d/d2f/lde 0 2024-09-18T21:12:55.840 INFO:tasks.workunit.client.1.smithi103.stdout:1/583: rename d0/d2/d2b/d3a/d42/c4f to d0/d2/d9/d10/ccb 0 2024-09-18T21:12:55.842 INFO:tasks.workunit.client.0.smithi077.stdout:1/585: rename d3/d8/d13/d18 to d3/d8/d93/dd3 0 2024-09-18T21:12:55.844 INFO:tasks.workunit.client.1.smithi103.stdout:8/709: creat d4/d81/d71/d7f/fdd x:0 0 0 2024-09-18T21:12:55.852 INFO:tasks.workunit.client.1.smithi103.stdout:6/639: creat d2/d24/d38/d68/dac/fc6 x:0 0 0 2024-09-18T21:12:55.854 INFO:tasks.workunit.client.1.smithi103.stdout:6/640: chown d2/d24/d5a/d67/d76/d43/d44/f6e 0 1 2024-09-18T21:12:55.856 INFO:tasks.workunit.client.0.smithi077.stdout:1/586: rename d3/d8/d93/dd3/l3f to d3/d8/d93/dd3/dc1/ld4 0 2024-09-18T21:12:55.859 INFO:tasks.workunit.client.1.smithi103.stdout:3/597: rename d1/d23/d25/d4f/d51 to d1/d23/d47/dbb 0 2024-09-18T21:12:55.862 INFO:tasks.workunit.client.0.smithi077.stdout:4/486: creat d3/dc/d24/d72/f94 x:0 0 0 2024-09-18T21:12:55.865 INFO:tasks.workunit.client.0.smithi077.stdout:9/542: link d1/l7b d1/dd/d11/d1c/d38/d46/lb5 0 2024-09-18T21:12:55.867 INFO:tasks.workunit.client.0.smithi077.stdout:9/543: chown d1/dd/d1a/l40 101 1 2024-09-18T21:12:55.867 INFO:tasks.workunit.client.1.smithi103.stdout:6/641: mkdir d2/d24/d5a/d67/d76/da4/dc7 0 2024-09-18T21:12:55.868 INFO:tasks.workunit.client.1.smithi103.stdout:4/644: write d9/d38/f45 [1954417,11892] 0 2024-09-18T21:12:55.869 INFO:tasks.workunit.client.1.smithi103.stdout:9/665: symlink d18/d8d/d2f/ddd/ldf 0 2024-09-18T21:12:55.869 INFO:tasks.workunit.client.1.smithi103.stdout:6/642: stat d2/d24/d38/d68/dac/fc6 0 2024-09-18T21:12:55.869 INFO:tasks.workunit.client.0.smithi077.stdout:4/487: dwrite d3/d7/d6c/f90 [0,4194304] 0 2024-09-18T21:12:55.870 INFO:tasks.workunit.client.0.smithi077.stdout:7/600: getdents d12/d56/da1 0 2024-09-18T21:12:55.871 INFO:tasks.workunit.client.0.smithi077.stdout:4/488: dread - d3/dc/d20/f7d zero size 2024-09-18T21:12:55.873 INFO:tasks.workunit.client.1.smithi103.stdout:7/595: rename d1/df/d42/d1f/d6b to d1/df/d43/d63/db9 0 2024-09-18T21:12:55.874 INFO:tasks.workunit.client.1.smithi103.stdout:1/584: creat d0/d3/d68/d81/da2/da4/dc2/fcc x:0 0 0 2024-09-18T21:12:55.875 INFO:tasks.workunit.client.0.smithi077.stdout:1/587: dread d3/d8/d93/dd3/f1a [4194304,4194304] 0 2024-09-18T21:12:55.875 INFO:tasks.workunit.client.0.smithi077.stdout:9/544: creat d1/dd/d11/d2d/fb6 x:0 0 0 2024-09-18T21:12:55.876 INFO:tasks.workunit.client.1.smithi103.stdout:5/665: truncate de/d1f/d3b/d58/f67 1885604 0 2024-09-18T21:12:55.877 INFO:tasks.workunit.client.0.smithi077.stdout:1/588: write d3/d38/d97/f98 [3129621,78698] 0 2024-09-18T21:12:55.878 INFO:tasks.workunit.client.1.smithi103.stdout:3/598: fdatasync d1/d23/d47/f56 0 2024-09-18T21:12:55.880 INFO:tasks.workunit.client.1.smithi103.stdout:5/666: write de/d1f/d3b/d51/db0/fbe [255683,114247] 0 2024-09-18T21:12:55.880 INFO:tasks.workunit.client.1.smithi103.stdout:2/554: symlink d3/d5/d2f/d32/d90/lca 0 2024-09-18T21:12:55.883 INFO:tasks.workunit.client.1.smithi103.stdout:2/555: chown d3/d5/d2f/c62 805172 1 2024-09-18T21:12:55.885 INFO:tasks.workunit.client.1.smithi103.stdout:1/585: dwrite d0/d2/d9/d9e/d7a/fb2 [0,4194304] 0 2024-09-18T21:12:55.885 INFO:tasks.workunit.client.1.smithi103.stdout:4/645: creat d9/d1c/d69/fdc x:0 0 0 2024-09-18T21:12:55.885 INFO:tasks.workunit.client.1.smithi103.stdout:5/667: write de/d1f/d3b/d51/d57/d59/f6e [4553340,43327] 0 2024-09-18T21:12:55.886 INFO:tasks.workunit.client.1.smithi103.stdout:5/668: chown de/d3e 1293 1 2024-09-18T21:12:55.888 INFO:tasks.workunit.client.1.smithi103.stdout:0/600: rename d1/d5/de/d19/d1e/d34/da8 to d1/d5/de/dc0/d8c/dce 0 2024-09-18T21:12:55.891 INFO:tasks.workunit.client.1.smithi103.stdout:7/596: mkdir d1/df/d44/dba 0 2024-09-18T21:12:55.895 INFO:tasks.workunit.client.1.smithi103.stdout:8/710: getdents d4/d2d 0 2024-09-18T21:12:55.896 INFO:tasks.workunit.client.1.smithi103.stdout:3/599: unlink d1/d9a/fae 0 2024-09-18T21:12:55.898 INFO:tasks.workunit.client.0.smithi077.stdout:7/601: getdents d12/d22/daa/dc0 0 2024-09-18T21:12:55.898 INFO:tasks.workunit.client.0.smithi077.stdout:4/489: link d3/d35/l52 d3/d77/l95 0 2024-09-18T21:12:55.901 INFO:tasks.workunit.client.0.smithi077.stdout:1/589: dwrite d3/d6a/d9b/d68/f37 [0,4194304] 0 2024-09-18T21:12:55.901 INFO:tasks.workunit.client.1.smithi103.stdout:2/556: unlink d3/l44 0 2024-09-18T21:12:55.902 INFO:tasks.workunit.client.1.smithi103.stdout:7/597: dwrite d1/df/d42/d29/d2f/d33/fb3 [0,4194304] 0 2024-09-18T21:12:55.903 INFO:tasks.workunit.client.0.smithi077.stdout:4/490: creat d3/d7/d73/f96 x:0 0 0 2024-09-18T21:12:55.905 INFO:tasks.workunit.client.1.smithi103.stdout:1/586: symlink d0/d2/d9/d10/d5d/lcd 0 2024-09-18T21:12:55.905 INFO:tasks.workunit.client.0.smithi077.stdout:7/602: mknod d12/d22/daa/dc0/dac/cd0 0 2024-09-18T21:12:55.907 INFO:tasks.workunit.client.1.smithi103.stdout:6/643: dwrite d2/d24/d5a/d67/f95 [0,4194304] 0 2024-09-18T21:12:55.907 INFO:tasks.workunit.client.0.smithi077.stdout:9/545: truncate d1/d54/f44 2027493 0 2024-09-18T21:12:55.915 INFO:tasks.workunit.client.1.smithi103.stdout:9/666: truncate d18/f24 2538833 0 2024-09-18T21:12:55.915 INFO:tasks.workunit.client.1.smithi103.stdout:9/667: chown d18/d8d/d2f 260340484 1 2024-09-18T21:12:55.918 INFO:tasks.workunit.client.1.smithi103.stdout:8/711: rename d4/de/d4a to d4/d81/dd7/dde 0 2024-09-18T21:12:55.919 INFO:tasks.workunit.client.1.smithi103.stdout:8/712: fdatasync d4/d2d/d87/fc9 0 2024-09-18T21:12:55.920 INFO:tasks.workunit.client.1.smithi103.stdout:3/600: rmdir d1/d2/d18/d30 39 2024-09-18T21:12:55.920 INFO:tasks.workunit.client.0.smithi077.stdout:9/546: mknod d1/d54/d81/d92/cb7 0 2024-09-18T21:12:55.921 INFO:tasks.workunit.client.0.smithi077.stdout:7/603: link d12/d22/c4d d12/d22/daa/dc0/dac/dad/cd1 0 2024-09-18T21:12:55.926 INFO:tasks.workunit.client.1.smithi103.stdout:5/669: unlink de/d1f/d3b/d58/dc4/d33/l25 0 2024-09-18T21:12:55.927 INFO:tasks.workunit.client.1.smithi103.stdout:1/587: mknod d0/d2/d9/dc/d6e/cce 0 2024-09-18T21:12:55.930 INFO:tasks.workunit.client.1.smithi103.stdout:0/601: mkdir d1/dcf 0 2024-09-18T21:12:55.930 INFO:tasks.workunit.client.1.smithi103.stdout:6/644: truncate d2/d3/d8/f59 174308 0 2024-09-18T21:12:55.930 INFO:tasks.workunit.client.1.smithi103.stdout:4/646: write d9/d1c/d77/f6f [3982776,84496] 0 2024-09-18T21:12:55.931 INFO:tasks.workunit.client.1.smithi103.stdout:9/668: mkdir d18/d52/d6f/db9/de0 0 2024-09-18T21:12:55.935 INFO:tasks.workunit.client.1.smithi103.stdout:3/601: truncate d1/d23/d47/f56 432175 0 2024-09-18T21:12:55.936 INFO:tasks.workunit.client.1.smithi103.stdout:5/670: dwrite de/d3e/d15/f8a [0,4194304] 0 2024-09-18T21:12:55.939 INFO:tasks.workunit.client.0.smithi077.stdout:4/491: dwrite d3/dc/d51/d53/d66/f8c [0,4194304] 0 2024-09-18T21:12:55.940 INFO:tasks.workunit.client.1.smithi103.stdout:1/588: creat d0/d2/d2b/fcf x:0 0 0 2024-09-18T21:12:55.945 INFO:tasks.workunit.client.0.smithi077.stdout:7/604: write d12/d22/f65 [1152501,9837] 0 2024-09-18T21:12:55.945 INFO:tasks.workunit.client.1.smithi103.stdout:9/669: creat d18/d8d/d2f/ddd/fe1 x:0 0 0 2024-09-18T21:12:55.946 INFO:tasks.workunit.client.1.smithi103.stdout:1/589: fsync d0/d2/fca 0 2024-09-18T21:12:55.946 INFO:tasks.workunit.client.1.smithi103.stdout:4/647: dwrite d9/d38/d72/fa8 [0,4194304] 0 2024-09-18T21:12:55.948 INFO:tasks.workunit.client.1.smithi103.stdout:3/602: truncate d1/d23/d47/dbb/f5d 837240 0 2024-09-18T21:12:55.953 INFO:tasks.workunit.client.1.smithi103.stdout:8/713: dread d4/d2d/f33 [0,4194304] 0 2024-09-18T21:12:55.953 INFO:tasks.workunit.client.1.smithi103.stdout:6/645: write d2/d3/d8/d4c/d4e/f70 [1124372,17152] 0 2024-09-18T21:12:55.954 INFO:tasks.workunit.client.0.smithi077.stdout:7/605: dwrite d12/d31/f7e [0,4194304] 0 2024-09-18T21:12:55.955 INFO:tasks.workunit.client.1.smithi103.stdout:5/671: creat de/d1f/d3b/d51/d57/db5/fde x:0 0 0 2024-09-18T21:12:55.957 INFO:tasks.workunit.client.0.smithi077.stdout:7/606: truncate d12/d31/d77/d93/d89/d99/da9/fc5 113382 0 2024-09-18T21:12:55.958 INFO:tasks.workunit.client.1.smithi103.stdout:9/670: unlink d18/d29/f44 0 2024-09-18T21:12:55.959 INFO:tasks.workunit.client.1.smithi103.stdout:2/557: creat d3/d5/d2f/d32/d90/fcb x:0 0 0 2024-09-18T21:12:55.961 INFO:tasks.workunit.client.1.smithi103.stdout:7/598: getdents d1/df/d43/d63/db9 0 2024-09-18T21:12:55.963 INFO:tasks.workunit.client.0.smithi077.stdout:7/607: rename d12/d31/d77/d93/d2a/f4f to d12/d56/fd2 0 2024-09-18T21:12:55.964 INFO:tasks.workunit.client.0.smithi077.stdout:7/608: readlink d12/l1c 0 2024-09-18T21:12:55.965 INFO:tasks.workunit.client.1.smithi103.stdout:1/590: mkdir d0/d2/d9/d9e/d7a/dd0 0 2024-09-18T21:12:55.965 INFO:tasks.workunit.client.0.smithi077.stdout:7/609: readlink d12/d31/d77/d93/l42 0 2024-09-18T21:12:55.966 INFO:tasks.workunit.client.0.smithi077.stdout:4/492: dread d3/d35/f56 [0,4194304] 0 2024-09-18T21:12:55.966 INFO:tasks.workunit.client.0.smithi077.stdout:7/610: write d12/d22/f65 [1363674,103863] 0 2024-09-18T21:12:55.969 INFO:tasks.workunit.client.1.smithi103.stdout:3/603: rmdir d1/d23/d25/d4f/d58/d68/d50 39 2024-09-18T21:12:55.976 INFO:tasks.workunit.client.1.smithi103.stdout:4/648: write d9/d1c/f39 [1172107,40989] 0 2024-09-18T21:12:55.976 INFO:tasks.workunit.client.1.smithi103.stdout:4/649: readlink d9/l17 0 2024-09-18T21:12:55.977 INFO:tasks.workunit.client.1.smithi103.stdout:9/671: symlink d18/d29/d68/le2 0 2024-09-18T21:12:55.978 INFO:tasks.workunit.client.1.smithi103.stdout:4/650: write d9/d38/d58/f92 [1388825,115346] 0 2024-09-18T21:12:55.979 INFO:tasks.workunit.client.1.smithi103.stdout:1/591: creat d0/d2/d2b/fd1 x:0 0 0 2024-09-18T21:12:55.982 INFO:tasks.workunit.client.1.smithi103.stdout:8/714: mkdir d4/ddf 0 2024-09-18T21:12:55.983 INFO:tasks.workunit.client.1.smithi103.stdout:5/672: getdents de/d1f/d3b/d58/dc4/d9c 0 2024-09-18T21:12:55.986 INFO:tasks.workunit.client.0.smithi077.stdout:4/493: dread d3/d77/f41 [0,4194304] 0 2024-09-18T21:12:55.986 INFO:tasks.workunit.client.1.smithi103.stdout:5/673: dread de/d1f/d3b/d51/db0/fbe [0,4194304] 0 2024-09-18T21:12:55.988 INFO:tasks.workunit.client.1.smithi103.stdout:4/651: rmdir d9/d1c/db1 39 2024-09-18T21:12:55.988 INFO:tasks.workunit.client.0.smithi077.stdout:7/611: write d12/d22/f5e [3191430,59949] 0 2024-09-18T21:12:55.989 INFO:tasks.workunit.client.0.smithi077.stdout:4/494: unlink d3/dc/d51/d53/d66/l7f 0 2024-09-18T21:12:55.989 INFO:tasks.workunit.client.0.smithi077.stdout:7/612: chown d12/d22/daa/dc0/d62 395565 1 2024-09-18T21:12:55.989 INFO:tasks.workunit.client.1.smithi103.stdout:4/652: write d9/d2e/d83/db6/d41/d64/fcf [1035523,81294] 0 2024-09-18T21:12:55.995 INFO:tasks.workunit.client.1.smithi103.stdout:6/646: dwrite d2/d24/d5a/d67/d76/d43/d44/f54 [0,4194304] 0 2024-09-18T21:12:55.995 INFO:tasks.workunit.client.0.smithi077.stdout:4/495: rename d3/dc/f16 to d3/dc/d20/f97 0 2024-09-18T21:12:55.999 INFO:tasks.workunit.client.1.smithi103.stdout:0/602: rename d1/d5/de/dc0/d8c/dce/d9f/f1b to d1/d9/d3e/fd0 0 2024-09-18T21:12:56.000 INFO:tasks.workunit.client.1.smithi103.stdout:0/603: chown d1/d9/d3e/lc3 5868 1 2024-09-18T21:12:56.001 INFO:tasks.workunit.client.1.smithi103.stdout:0/604: dread - d1/d5/de/d19/d1e/fb8 zero size 2024-09-18T21:12:56.005 INFO:tasks.workunit.client.1.smithi103.stdout:5/674: creat de/d1f/d3b/d3c/fdf x:0 0 0 2024-09-18T21:12:56.007 INFO:tasks.workunit.client.1.smithi103.stdout:2/558: mknod d3/d5/d2f/d32/d90/ccc 0 2024-09-18T21:12:56.007 INFO:tasks.workunit.client.0.smithi077.stdout:7/613: dwrite d12/d56/da1/db6/fcd [0,4194304] 0 2024-09-18T21:12:56.008 INFO:tasks.workunit.client.1.smithi103.stdout:4/653: creat d9/d2e/d83/db6/d41/d64/da9/fdd x:0 0 0 2024-09-18T21:12:56.008 INFO:tasks.workunit.client.1.smithi103.stdout:2/559: chown d3/l19 34451 1 2024-09-18T21:12:56.009 INFO:tasks.workunit.client.0.smithi077.stdout:4/496: getdents d3/d7/d42 0 2024-09-18T21:12:56.010 INFO:tasks.workunit.client.1.smithi103.stdout:1/592: symlink d0/d2/d9/ld2 0 2024-09-18T21:12:56.011 INFO:tasks.workunit.client.1.smithi103.stdout:3/604: creat d1/d2/d18/fbc x:0 0 0 2024-09-18T21:12:56.012 INFO:tasks.workunit.client.0.smithi077.stdout:7/614: rmdir d12/d31/d77/d93/d89/d99/da9 39 2024-09-18T21:12:56.012 INFO:tasks.workunit.client.1.smithi103.stdout:1/593: fdatasync d0/d2/d9/dc/f7e 0 2024-09-18T21:12:56.014 INFO:tasks.workunit.client.0.smithi077.stdout:4/497: fdatasync d3/d35/f69 0 2024-09-18T21:12:56.014 INFO:tasks.workunit.client.1.smithi103.stdout:9/672: truncate d18/d29/f4b 1059757 0 2024-09-18T21:12:56.017 INFO:tasks.workunit.client.1.smithi103.stdout:0/605: dread d1/d5/de/dc0/f72 [0,4194304] 0 2024-09-18T21:12:56.017 INFO:tasks.workunit.client.1.smithi103.stdout:7/599: rename d1/df/d42/d29/d2f to d1/df/d42/d29/d48/dbb 0 2024-09-18T21:12:56.018 INFO:tasks.workunit.client.0.smithi077.stdout:4/498: creat d3/d77/f98 x:0 0 0 2024-09-18T21:12:56.018 INFO:tasks.workunit.client.0.smithi077.stdout:3/528: sync 2024-09-18T21:12:56.019 INFO:tasks.workunit.client.0.smithi077.stdout:7/615: link d12/d31/d77/d93/d2a/f82 d12/d31/d77/fd3 0 2024-09-18T21:12:56.020 INFO:tasks.workunit.client.1.smithi103.stdout:8/715: creat d4/d2d/d3d/d9b/fe0 x:0 0 0 2024-09-18T21:12:56.020 INFO:tasks.workunit.client.1.smithi103.stdout:5/675: creat de/d3e/d85/fe0 x:0 0 0 2024-09-18T21:12:56.021 INFO:tasks.workunit.client.0.smithi077.stdout:4/499: dread d3/d77/f8b [0,4194304] 0 2024-09-18T21:12:56.022 INFO:tasks.workunit.client.0.smithi077.stdout:7/616: truncate d12/d31/d77/d93/d2a/d7f/fb3 206499 0 2024-09-18T21:12:56.023 INFO:tasks.workunit.client.0.smithi077.stdout:4/500: write d3/d7/d73/f96 [928323,27017] 0 2024-09-18T21:12:56.023 INFO:tasks.workunit.client.1.smithi103.stdout:6/647: dwrite d2/d3/f6f [0,4194304] 0 2024-09-18T21:12:56.024 INFO:tasks.workunit.client.0.smithi077.stdout:4/501: write d3/dc/d20/f40 [2998293,112023] 0 2024-09-18T21:12:56.026 INFO:tasks.workunit.client.1.smithi103.stdout:2/560: unlink d3/d5/d2c/d54/d68/f8a 0 2024-09-18T21:12:56.027 INFO:tasks.workunit.client.0.smithi077.stdout:3/529: truncate db/f13 2999731 0 2024-09-18T21:12:56.028 INFO:tasks.workunit.client.0.smithi077.stdout:7/617: fsync d12/d31/f83 0 2024-09-18T21:12:56.033 INFO:tasks.workunit.client.0.smithi077.stdout:4/502: mknod d3/d7/d7b/c99 0 2024-09-18T21:12:56.035 INFO:tasks.workunit.client.0.smithi077.stdout:3/530: symlink db/d14/d93/la5 0 2024-09-18T21:12:56.036 INFO:tasks.workunit.client.0.smithi077.stdout:3/531: dread - db/d14/d32/d49/fa0 zero size 2024-09-18T21:12:56.037 INFO:tasks.workunit.client.1.smithi103.stdout:4/654: mknod d9/d38/d72/cde 0 2024-09-18T21:12:56.039 INFO:tasks.workunit.client.1.smithi103.stdout:4/655: chown d9/d38/d72/d85/dd8/f5c 29817 1 2024-09-18T21:12:56.039 INFO:tasks.workunit.client.1.smithi103.stdout:5/676: mknod de/d2d/d7f/ce1 0 2024-09-18T21:12:56.040 INFO:tasks.workunit.client.0.smithi077.stdout:4/503: mknod d3/d7/d6c/c9a 0 2024-09-18T21:12:56.041 INFO:tasks.workunit.client.1.smithi103.stdout:5/677: truncate de/d1f/d3b/d3c/fb6 327154 0 2024-09-18T21:12:56.041 INFO:tasks.workunit.client.0.smithi077.stdout:4/504: chown d3/dc/d51/c6e 20572833 1 2024-09-18T21:12:56.042 INFO:tasks.workunit.client.0.smithi077.stdout:3/532: mknod db/d14/d32/d49/da4/ca6 0 2024-09-18T21:12:56.043 INFO:tasks.workunit.client.1.smithi103.stdout:6/648: creat d2/d24/d38/d68/dac/fc8 x:0 0 0 2024-09-18T21:12:56.045 INFO:tasks.workunit.client.1.smithi103.stdout:2/561: symlink d3/d5/d2f/lcd 0 2024-09-18T21:12:56.046 INFO:tasks.workunit.client.1.smithi103.stdout:2/562: dread - d3/d5/d2f/f7c zero size 2024-09-18T21:12:56.047 INFO:tasks.workunit.client.0.smithi077.stdout:3/533: creat db/d14/d32/d49/da4/d8a/fa7 x:0 0 0 2024-09-18T21:12:56.050 INFO:tasks.workunit.client.1.smithi103.stdout:3/605: mknod d1/d23/d25/d4f/d58/d68/d50/d54/d8c/cbd 0 2024-09-18T21:12:56.051 INFO:tasks.workunit.client.1.smithi103.stdout:3/606: write d1/da/df/f14 [6949233,80411] 0 2024-09-18T21:12:56.053 INFO:tasks.workunit.client.0.smithi077.stdout:4/505: rename d3/f57 to d3/dc/d32/d45/f9b 0 2024-09-18T21:12:56.053 INFO:tasks.workunit.client.0.smithi077.stdout:3/534: dwrite db/d14/d32/d49/da4/d71/d3b/f7e [0,4194304] 0 2024-09-18T21:12:56.054 INFO:tasks.workunit.client.1.smithi103.stdout:7/600: rename d1/f7c to d1/df/d43/d52/d95/fbc 0 2024-09-18T21:12:56.055 INFO:tasks.workunit.client.0.smithi077.stdout:3/535: fdatasync db/d14/d32/d49/d4e/d6a/f61 0 2024-09-18T21:12:56.056 INFO:tasks.workunit.client.0.smithi077.stdout:7/618: getdents d12/d22/d59/d5a 0 2024-09-18T21:12:56.057 INFO:tasks.workunit.client.1.smithi103.stdout:8/716: mknod d4/ce1 0 2024-09-18T21:12:56.061 INFO:tasks.workunit.client.1.smithi103.stdout:7/601: dwrite d1/df/d43/d52/f99 [0,4194304] 0 2024-09-18T21:12:56.061 INFO:tasks.workunit.client.0.smithi077.stdout:7/619: dread d12/d22/d59/d72/f86 [0,4194304] 0 2024-09-18T21:12:56.062 INFO:tasks.workunit.client.0.smithi077.stdout:4/506: mkdir d3/d77/d9c 0 2024-09-18T21:12:56.063 INFO:tasks.workunit.client.1.smithi103.stdout:6/649: chown d2/d3/d8/d4c/d7d/d9b 13 1 2024-09-18T21:12:56.066 INFO:tasks.workunit.client.0.smithi077.stdout:7/620: symlink d12/d56/ld4 0 2024-09-18T21:12:56.067 INFO:tasks.workunit.client.1.smithi103.stdout:1/594: symlink d0/d2/da8/ld3 0 2024-09-18T21:12:56.068 INFO:tasks.workunit.client.0.smithi077.stdout:3/536: rmdir db/d14/d32/d49/da4/d8a 39 2024-09-18T21:12:56.069 INFO:tasks.workunit.client.1.smithi103.stdout:6/650: dwrite d2/d3/d8/d4c/d4e/f70 [0,4194304] 0 2024-09-18T21:12:56.070 INFO:tasks.workunit.client.0.smithi077.stdout:4/507: rename d3/dc/d24/l31 to d3/dc/d32/d5b/l9d 0 2024-09-18T21:12:56.076 INFO:tasks.workunit.client.0.smithi077.stdout:3/537: mknod db/d14/d32/d49/ca8 0 2024-09-18T21:12:56.079 INFO:tasks.workunit.client.0.smithi077.stdout:7/621: mkdir d12/dd5 0 2024-09-18T21:12:56.080 INFO:tasks.workunit.client.1.smithi103.stdout:0/606: rename d1/d9/d3e/d6e/f94 to d1/d5/de/dc0/d8c/fd1 0 2024-09-18T21:12:56.081 INFO:tasks.workunit.client.1.smithi103.stdout:8/717: symlink d4/d98/le2 0 2024-09-18T21:12:56.082 INFO:tasks.workunit.client.0.smithi077.stdout:7/622: dread - d12/d22/f8b zero size 2024-09-18T21:12:56.083 INFO:tasks.workunit.client.1.smithi103.stdout:7/602: creat d1/df/d42/d29/fbd x:0 0 0 2024-09-18T21:12:56.083 INFO:tasks.workunit.client.1.smithi103.stdout:5/678: write de/d1f/d3b/d58/dc4/d33/f53 [364013,111714] 0 2024-09-18T21:12:56.085 INFO:tasks.workunit.client.1.smithi103.stdout:1/595: fsync d0/d2/f4e 0 2024-09-18T21:12:56.085 INFO:tasks.workunit.client.1.smithi103.stdout:9/673: link d18/d52/c6d d18/d8d/ce3 0 2024-09-18T21:12:56.087 INFO:tasks.workunit.client.1.smithi103.stdout:4/656: rename d9/fcc to d9/d1c/dcd/fdf 0 2024-09-18T21:12:56.087 INFO:tasks.workunit.client.1.smithi103.stdout:8/718: mkdir d4/de/de3 0 2024-09-18T21:12:56.090 INFO:tasks.workunit.client.1.smithi103.stdout:5/679: stat de/d1f/d3b/d58/dc4/d33/d4f/f6a 0 2024-09-18T21:12:56.091 INFO:tasks.workunit.client.1.smithi103.stdout:7/603: mkdir d1/df/d42/d1f/d5d/dbe 0 2024-09-18T21:12:56.092 INFO:tasks.workunit.client.0.smithi077.stdout:7/623: dread d12/d22/f64 [0,4194304] 0 2024-09-18T21:12:56.093 INFO:tasks.workunit.client.1.smithi103.stdout:6/651: fdatasync d2/d3/d8/d4c/d4e/f70 0 2024-09-18T21:12:56.094 INFO:tasks.workunit.client.1.smithi103.stdout:9/674: rmdir d18/d52/d6f/d8e/d8f/dbd 39 2024-09-18T21:12:56.095 INFO:tasks.workunit.client.1.smithi103.stdout:1/596: rename d0/d2/d9/d9e/d86 to d0/d2/d9/d10/d5d/dd4 0 2024-09-18T21:12:56.096 INFO:tasks.workunit.client.0.smithi077.stdout:5/702: sync 2024-09-18T21:12:56.096 INFO:tasks.workunit.client.0.smithi077.stdout:6/520: sync 2024-09-18T21:12:56.099 INFO:tasks.workunit.client.1.smithi103.stdout:2/563: dread d3/f1d [0,4194304] 0 2024-09-18T21:12:56.102 INFO:tasks.workunit.client.1.smithi103.stdout:4/657: dwrite d9/d1c/d77/f54 [0,4194304] 0 2024-09-18T21:12:56.103 INFO:tasks.workunit.client.0.smithi077.stdout:6/521: creat d7/d7e/d11/d3e/d42/d88/da4/fb1 x:0 0 0 2024-09-18T21:12:56.106 INFO:tasks.workunit.client.1.smithi103.stdout:9/675: write d18/d8d/d2f/f97 [1411477,83402] 0 2024-09-18T21:12:56.107 INFO:tasks.workunit.client.0.smithi077.stdout:4/508: write d3/f63 [189837,93582] 0 2024-09-18T21:12:56.111 INFO:tasks.workunit.client.0.smithi077.stdout:3/538: dwrite db/d4d/f69 [0,4194304] 0 2024-09-18T21:12:56.111 INFO:tasks.workunit.client.1.smithi103.stdout:3/607: dwrite d1/d2/d18/f46 [0,4194304] 0 2024-09-18T21:12:56.112 INFO:tasks.workunit.client.1.smithi103.stdout:8/719: dread d4/de/f1c [0,4194304] 0 2024-09-18T21:12:56.115 INFO:tasks.workunit.client.0.smithi077.stdout:5/703: getdents d0/df/d10/d47/da0 0 2024-09-18T21:12:56.116 INFO:tasks.workunit.client.0.smithi077.stdout:5/704: write d0/d6/d3b/fe0 [8994,1789] 0 2024-09-18T21:12:56.117 INFO:tasks.workunit.client.1.smithi103.stdout:5/680: truncate de/d1f/d3b/d58/dc4/d33/f7c 1304043 0 2024-09-18T21:12:56.120 INFO:tasks.workunit.client.1.smithi103.stdout:4/658: chown d9/d2e/d61/d91/daa 14975 1 2024-09-18T21:12:56.123 INFO:tasks.workunit.client.0.smithi077.stdout:4/509: unlink d3/c91 0 2024-09-18T21:12:56.123 INFO:tasks.workunit.client.0.smithi077.stdout:7/624: write d12/d31/d77/d93/d2a/f32 [1210146,89865] 0 2024-09-18T21:12:56.123 INFO:tasks.workunit.client.0.smithi077.stdout:4/510: stat d3/dc/d20/f40 0 2024-09-18T21:12:56.124 INFO:tasks.workunit.client.1.smithi103.stdout:0/607: dwrite d1/fd [0,4194304] 0 2024-09-18T21:12:56.125 INFO:tasks.workunit.client.0.smithi077.stdout:7/625: write d12/d22/daa/dc0/d62/fba [103567,66476] 0 2024-09-18T21:12:56.126 INFO:tasks.workunit.client.0.smithi077.stdout:4/511: truncate d3/dc/d20/f97 3347366 0 2024-09-18T21:12:56.127 INFO:tasks.workunit.client.0.smithi077.stdout:6/522: getdents d7/d7e/d11/d3e/d42/d88 0 2024-09-18T21:12:56.128 INFO:tasks.workunit.client.0.smithi077.stdout:7/626: dread - d12/d56/da1/db6/fb8 zero size 2024-09-18T21:12:56.129 INFO:tasks.workunit.client.1.smithi103.stdout:8/720: symlink d4/d81/d71/d7f/d9d/le4 0 2024-09-18T21:12:56.130 INFO:tasks.workunit.client.0.smithi077.stdout:5/705: mkdir d0/df/d10/de1 0 2024-09-18T21:12:56.131 INFO:tasks.workunit.client.0.smithi077.stdout:5/706: fsync d0/d6/d3b/d64/fb2 0 2024-09-18T21:12:56.133 INFO:tasks.workunit.client.1.smithi103.stdout:2/564: fdatasync d3/d5/d2f/d48/f4f 0 2024-09-18T21:12:56.133 INFO:tasks.workunit.client.0.smithi077.stdout:6/523: fdatasync d7/d7e/f58 0 2024-09-18T21:12:56.135 INFO:tasks.workunit.client.1.smithi103.stdout:7/604: dwrite d1/df/d42/f45 [4194304,4194304] 0 2024-09-18T21:12:56.135 INFO:tasks.workunit.client.0.smithi077.stdout:3/539: link db/d14/d93/f96 db/d14/d32/d49/da4/d8a/d99/fa9 0 2024-09-18T21:12:56.137 INFO:tasks.workunit.client.1.smithi103.stdout:2/565: chown d3/d5/f86 15487 1 2024-09-18T21:12:56.139 INFO:tasks.workunit.client.1.smithi103.stdout:1/597: rename d0/d3/c30 to d0/d2/cd5 0 2024-09-18T21:12:56.141 INFO:tasks.workunit.client.1.smithi103.stdout:8/721: dread d4/d81/dd7/dde/d59/fce [0,4194304] 0 2024-09-18T21:12:56.141 INFO:tasks.workunit.client.1.smithi103.stdout:9/676: creat d18/d52/d6f/d8e/d8f/db5/fe4 x:0 0 0 2024-09-18T21:12:56.142 INFO:tasks.workunit.client.0.smithi077.stdout:5/707: mknod d0/df/d3d/d85/ce2 0 2024-09-18T21:12:56.143 INFO:tasks.workunit.client.1.smithi103.stdout:9/677: fsync d18/d29/f55 0 2024-09-18T21:12:56.143 INFO:tasks.workunit.client.0.smithi077.stdout:5/708: dread - d0/df/d3d/d85/f86 zero size 2024-09-18T21:12:56.143 INFO:tasks.workunit.client.1.smithi103.stdout:3/608: write d1/d23/d25/d4f/d72/f87 [814832,65626] 0 2024-09-18T21:12:56.144 INFO:tasks.workunit.client.1.smithi103.stdout:0/608: creat d1/d5/de/d19/fd2 x:0 0 0 2024-09-18T21:12:56.145 INFO:tasks.workunit.client.1.smithi103.stdout:8/722: chown d4/d2d/d3d/da0/dab/fcc 651312996 1 2024-09-18T21:12:56.146 INFO:tasks.workunit.client.1.smithi103.stdout:0/609: fdatasync d1/d5/de/d22/f57 0 2024-09-18T21:12:56.146 INFO:tasks.workunit.client.1.smithi103.stdout:6/652: truncate d2/d24/d5a/d67/f95 2265167 0 2024-09-18T21:12:56.146 INFO:tasks.workunit.client.1.smithi103.stdout:3/609: readlink d1/d64/la8 0 2024-09-18T21:12:56.147 INFO:tasks.workunit.client.0.smithi077.stdout:2/611: sync 2024-09-18T21:12:56.147 INFO:tasks.workunit.client.0.smithi077.stdout:1/590: sync 2024-09-18T21:12:56.147 INFO:tasks.workunit.client.0.smithi077.stdout:0/641: sync 2024-09-18T21:12:56.148 INFO:tasks.workunit.client.0.smithi077.stdout:8/517: sync 2024-09-18T21:12:56.148 INFO:tasks.workunit.client.0.smithi077.stdout:9/547: sync 2024-09-18T21:12:56.148 INFO:tasks.workunit.client.0.smithi077.stdout:6/524: fdatasync d7/d7e/d11/d3e/f78 0 2024-09-18T21:12:56.150 INFO:tasks.workunit.client.0.smithi077.stdout:3/540: rename c0 to db/d14/d32/d49/d4e/d6a/caa 0 2024-09-18T21:12:56.150 INFO:tasks.workunit.client.0.smithi077.stdout:1/591: write d3/d38/f60 [30157,105356] 0 2024-09-18T21:12:56.151 INFO:tasks.workunit.client.0.smithi077.stdout:0/642: stat d8/d1a/d39/d3b/d70/lc8 0 2024-09-18T21:12:56.152 INFO:tasks.workunit.client.1.smithi103.stdout:7/605: dread d1/df/d42/f45 [0,4194304] 0 2024-09-18T21:12:56.153 INFO:tasks.workunit.client.0.smithi077.stdout:6/525: dread - d7/d7e/d11/d3e/f7f zero size 2024-09-18T21:12:56.154 INFO:tasks.workunit.client.1.smithi103.stdout:5/681: dwrite de/d1f/d3b/d58/fad [0,4194304] 0 2024-09-18T21:12:56.156 INFO:tasks.workunit.client.1.smithi103.stdout:7/606: truncate d1/df/d42/d1f/f7b 4253283 0 2024-09-18T21:12:56.156 INFO:tasks.workunit.client.0.smithi077.stdout:4/512: dwrite d3/dc/f6b [0,4194304] 0 2024-09-18T21:12:56.157 INFO:tasks.workunit.client.0.smithi077.stdout:6/526: readlink d7/d7e/d11/d1d/d4c/lad 0 2024-09-18T21:12:56.158 INFO:tasks.workunit.client.0.smithi077.stdout:9/548: dread d1/dd/d11/f3e [4194304,4194304] 0 2024-09-18T21:12:56.162 INFO:tasks.workunit.client.1.smithi103.stdout:2/566: creat d3/d5/d4a/d56/fce x:0 0 0 2024-09-18T21:12:56.163 INFO:tasks.workunit.client.1.smithi103.stdout:2/567: chown d3/f21 21899 1 2024-09-18T21:12:56.163 INFO:tasks.workunit.client.0.smithi077.stdout:9/549: read - d1/dd/d11/d15/d80/fa5 zero size 2024-09-18T21:12:56.163 INFO:tasks.workunit.client.0.smithi077.stdout:6/527: chown d7/f1c 2992348 1 2024-09-18T21:12:56.167 INFO:tasks.workunit.client.0.smithi077.stdout:5/709: link d0/d6/dd/f30 d0/d6/dd/d5d/d91/fe3 0 2024-09-18T21:12:56.167 INFO:tasks.workunit.client.0.smithi077.stdout:7/627: dwrite d12/d22/f28 [0,4194304] 0 2024-09-18T21:12:56.168 INFO:tasks.workunit.client.1.smithi103.stdout:1/598: rename d0/d2/d9/d10/d8d/lab to d0/d11/d5f/ld6 0 2024-09-18T21:12:56.169 INFO:tasks.workunit.client.0.smithi077.stdout:0/643: rmdir d8/d1a/d39/d3b/d79 39 2024-09-18T21:12:56.171 INFO:tasks.workunit.client.0.smithi077.stdout:5/710: write d0/df/f5f [383338,46471] 0 2024-09-18T21:12:56.172 INFO:tasks.workunit.client.0.smithi077.stdout:3/541: creat db/d14/d32/d49/fab x:0 0 0 2024-09-18T21:12:56.172 INFO:tasks.workunit.client.0.smithi077.stdout:1/592: dwrite d3/d8/d49/d4e/d5a/f69 [0,4194304] 0 2024-09-18T21:12:56.175 INFO:tasks.workunit.client.1.smithi103.stdout:1/599: dwrite d0/d2/d9/dc/f28 [0,4194304] 0 2024-09-18T21:12:56.176 INFO:tasks.workunit.client.0.smithi077.stdout:1/593: dread d3/d8/d49/f62 [0,4194304] 0 2024-09-18T21:12:56.179 INFO:tasks.workunit.client.0.smithi077.stdout:1/594: dread - d3/d8/d13/d77/db1/f96 zero size 2024-09-18T21:12:56.180 INFO:tasks.workunit.client.1.smithi103.stdout:8/723: unlink d4/d26/l47 0 2024-09-18T21:12:56.182 INFO:tasks.workunit.client.0.smithi077.stdout:4/513: chown d3/c30 198175 1 2024-09-18T21:12:56.184 INFO:tasks.workunit.client.0.smithi077.stdout:2/612: dwrite d1/d4/d5/d1a/d2e/d41/f68 [0,4194304] 0 2024-09-18T21:12:56.186 INFO:tasks.workunit.client.0.smithi077.stdout:6/528: symlink d7/d7c/lb2 0 2024-09-18T21:12:56.187 INFO:tasks.workunit.client.1.smithi103.stdout:0/610: symlink d1/d5/de/dc0/d8c/dce/d9f/d8d/da7/ld3 0 2024-09-18T21:12:56.189 INFO:tasks.workunit.client.0.smithi077.stdout:4/514: dread d3/dc/d32/f3e [0,4194304] 0 2024-09-18T21:12:56.189 INFO:tasks.workunit.client.0.smithi077.stdout:5/711: rmdir d0/df/d10/d5c 39 2024-09-18T21:12:56.192 INFO:tasks.workunit.client.1.smithi103.stdout:4/659: creat d9/d38/fe0 x:0 0 0 2024-09-18T21:12:56.193 INFO:tasks.workunit.client.1.smithi103.stdout:5/682: rmdir de/d1f/d3b/d58/dc4/d33/d4f 39 2024-09-18T21:12:56.194 INFO:tasks.workunit.client.0.smithi077.stdout:7/628: creat d12/d56/da1/db6/dbd/fd6 x:0 0 0 2024-09-18T21:12:56.195 INFO:tasks.workunit.client.0.smithi077.stdout:7/629: readlink d12/d31/l6e 0 2024-09-18T21:12:56.196 INFO:tasks.workunit.client.0.smithi077.stdout:7/630: fdatasync d12/d56/fa2 0 2024-09-18T21:12:56.196 INFO:tasks.workunit.client.0.smithi077.stdout:2/613: mkdir d1/d4/d9/d80/d83/dba/dcd 0 2024-09-18T21:12:56.197 INFO:tasks.workunit.client.1.smithi103.stdout:0/611: dwrite d1/d5/de/d24/d43/d81/fb2 [0,4194304] 0 2024-09-18T21:12:56.197 INFO:tasks.workunit.client.0.smithi077.stdout:7/631: chown d12/d31/f41 374 1 2024-09-18T21:12:56.198 INFO:tasks.workunit.client.0.smithi077.stdout:2/614: write d1/d4/d5/d1a/d2e/f97 [276119,96452] 0 2024-09-18T21:12:56.198 INFO:tasks.workunit.client.0.smithi077.stdout:0/644: mkdir d8/d26/dc9 0 2024-09-18T21:12:56.199 INFO:tasks.workunit.client.1.smithi103.stdout:0/612: stat d1/d5/de/dc0/d8c/dce/d9f/d8d 0 2024-09-18T21:12:56.201 INFO:tasks.workunit.client.0.smithi077.stdout:9/550: link d1/dd/d11/d2d/d59/f6a d1/dd/d11/d1c/d38/d46/d55/d9c/fb8 0 2024-09-18T21:12:56.201 INFO:tasks.workunit.client.1.smithi103.stdout:5/683: dwrite de/f2b [0,4194304] 0 2024-09-18T21:12:56.204 INFO:tasks.workunit.client.1.smithi103.stdout:9/678: mknod d18/d52/d6f/d8e/d8f/dbd/ce5 0 2024-09-18T21:12:56.206 INFO:tasks.workunit.client.0.smithi077.stdout:2/615: dread d1/d4/fbd [0,4194304] 0 2024-09-18T21:12:56.208 INFO:tasks.workunit.client.1.smithi103.stdout:1/600: rmdir d0/d2/d2b 39 2024-09-18T21:12:56.209 INFO:tasks.workunit.client.1.smithi103.stdout:1/601: dread - d0/d2/d9/dc/d6e/fbe zero size 2024-09-18T21:12:56.212 INFO:tasks.workunit.client.1.smithi103.stdout:8/724: rename d4/d2d/d4e/d73/lb2 to d4/d81/le5 0 2024-09-18T21:12:56.215 INFO:tasks.workunit.client.0.smithi077.stdout:5/712: symlink d0/d6/dd/d5d/le4 0 2024-09-18T21:12:56.219 INFO:tasks.workunit.client.0.smithi077.stdout:6/529: dread d7/d7e/d11/d1d/d31/f71 [0,4194304] 0 2024-09-18T21:12:56.224 INFO:tasks.workunit.client.1.smithi103.stdout:7/607: unlink d1/df/d42/d29/d48/dbb/d33/d51/ca4 0 2024-09-18T21:12:56.225 INFO:tasks.workunit.client.1.smithi103.stdout:4/660: rmdir d9/d2e/d83/db6/d21/d80 39 2024-09-18T21:12:56.226 INFO:tasks.workunit.client.0.smithi077.stdout:9/551: read d1/dd/d11/d1c/d38/d46/f5b [202858,114362] 0 2024-09-18T21:12:56.228 INFO:tasks.workunit.client.0.smithi077.stdout:2/616: unlink d1/d4/d9/d80/d95/fb1 0 2024-09-18T21:12:56.229 INFO:tasks.workunit.client.0.smithi077.stdout:2/617: dread - d1/d4/d5/f9d zero size 2024-09-18T21:12:56.229 INFO:tasks.workunit.client.0.smithi077.stdout:4/515: unlink d3/f1f 0 2024-09-18T21:12:56.233 INFO:tasks.workunit.client.1.smithi103.stdout:6/653: creat d2/d3/d8/fc9 x:0 0 0 2024-09-18T21:12:56.233 INFO:tasks.workunit.client.0.smithi077.stdout:1/595: rename d3/d8/d75/d54 to d3/d38/dd5 0 2024-09-18T21:12:56.240 INFO:tasks.workunit.client.1.smithi103.stdout:4/661: dread f3 [8388608,4194304] 0 2024-09-18T21:12:56.240 INFO:tasks.workunit.client.1.smithi103.stdout:9/679: symlink d18/d29/d68/d92/dd1/le6 0 2024-09-18T21:12:56.241 INFO:tasks.workunit.client.0.smithi077.stdout:4/516: mknod d3/d7/d7b/c9e 0 2024-09-18T21:12:56.242 INFO:tasks.workunit.client.1.smithi103.stdout:1/602: symlink d0/d2/d2b/d3a/d42/d9c/ld7 0 2024-09-18T21:12:56.243 INFO:tasks.workunit.client.0.smithi077.stdout:3/542: getdents db/d14/d32 0 2024-09-18T21:12:56.243 INFO:tasks.workunit.client.0.smithi077.stdout:5/713: dwrite d0/d6/fb [0,4194304] 0 2024-09-18T21:12:56.244 INFO:tasks.workunit.client.1.smithi103.stdout:8/725: mkdir d4/d81/dd7/dde/d59/d9c/de6 0 2024-09-18T21:12:56.247 INFO:tasks.workunit.client.0.smithi077.stdout:7/632: rename d12/d31/d77/d93/l30 to d12/d22/daa/dc0/dac/ld7 0 2024-09-18T21:12:56.247 INFO:tasks.workunit.client.1.smithi103.stdout:3/610: getdents d1/d23/d25/d4f/d72/d85 0 2024-09-18T21:12:56.251 INFO:tasks.workunit.client.1.smithi103.stdout:8/726: dwrite d4/de/f80 [0,4194304] 0 2024-09-18T21:12:56.251 INFO:tasks.workunit.client.1.smithi103.stdout:7/608: fdatasync d1/f1c 0 2024-09-18T21:12:56.252 INFO:tasks.workunit.client.0.smithi077.stdout:0/645: creat d8/d1d/fca x:0 0 0 2024-09-18T21:12:56.253 INFO:tasks.workunit.client.0.smithi077.stdout:7/633: dwrite d12/f45 [0,4194304] 0 2024-09-18T21:12:56.254 INFO:tasks.workunit.client.1.smithi103.stdout:2/568: getdents d3/d5/d2f/d32/d90 0 2024-09-18T21:12:56.254 INFO:tasks.workunit.client.0.smithi077.stdout:9/552: fsync d1/dd/d11/d2d/d59/fab 0 2024-09-18T21:12:56.256 INFO:tasks.workunit.client.0.smithi077.stdout:9/553: readlink d1/d54/d27/lb2 0 2024-09-18T21:12:56.257 INFO:tasks.workunit.client.1.smithi103.stdout:2/569: write d3/d5/d2c/d54/f7b [1018448,18459] 0 2024-09-18T21:12:56.257 INFO:tasks.workunit.client.0.smithi077.stdout:4/517: fdatasync d3/fb 0 2024-09-18T21:12:56.258 INFO:tasks.workunit.client.0.smithi077.stdout:7/634: write d12/d22/d59/d5a/f8c [3767326,97380] 0 2024-09-18T21:12:56.261 INFO:tasks.workunit.client.1.smithi103.stdout:8/727: dread d4/d26/d56/d77/d9f/fbf [0,4194304] 0 2024-09-18T21:12:56.261 INFO:tasks.workunit.client.1.smithi103.stdout:4/662: mknod d9/d38/db4/ce1 0 2024-09-18T21:12:56.262 INFO:tasks.workunit.client.0.smithi077.stdout:2/618: rename d1/d4/d5/d1a/d2e/d41/d2c/f35 to d1/d4/d5/d1a/d49/d6a/d81/fce 0 2024-09-18T21:12:56.264 INFO:tasks.workunit.client.0.smithi077.stdout:6/530: link d7/d7e/d11/d1d/d49/d55/l73 d7/d7e/d11/d1d/d31/lb3 0 2024-09-18T21:12:56.264 INFO:tasks.workunit.client.0.smithi077.stdout:5/714: dread d0/d6/f50 [4194304,4194304] 0 2024-09-18T21:12:56.265 INFO:tasks.workunit.client.0.smithi077.stdout:4/518: dread d3/dc/d51/d53/d66/f8c [0,4194304] 0 2024-09-18T21:12:56.265 INFO:tasks.workunit.client.0.smithi077.stdout:2/619: readlink d1/d4/d9/d80/d8e/l4b 0 2024-09-18T21:12:56.265 INFO:tasks.workunit.client.1.smithi103.stdout:7/609: dread d1/df/d42/d1f/d5d/faf [0,4194304] 0 2024-09-18T21:12:56.269 INFO:tasks.workunit.client.0.smithi077.stdout:1/596: truncate d3/d8/f1c 5567933 0 2024-09-18T21:12:56.269 INFO:tasks.workunit.client.1.smithi103.stdout:3/611: dread d1/d23/d47/f56 [0,4194304] 0 2024-09-18T21:12:56.275 INFO:tasks.workunit.client.1.smithi103.stdout:9/680: mkdir d18/d52/d6f/db9/de0/de7 0 2024-09-18T21:12:56.275 INFO:tasks.workunit.client.1.smithi103.stdout:9/681: readlink d18/d29/l37 0 2024-09-18T21:12:56.277 INFO:tasks.workunit.client.1.smithi103.stdout:4/663: symlink d9/d2e/d61/le2 0 2024-09-18T21:12:56.278 INFO:tasks.workunit.client.1.smithi103.stdout:8/728: rename d4/d81/d65/d39 to d4/d2d/d3d/da0/dab/de7 0 2024-09-18T21:12:56.280 INFO:tasks.workunit.client.1.smithi103.stdout:0/613: truncate d1/f9a 334678 0 2024-09-18T21:12:56.282 INFO:tasks.workunit.client.1.smithi103.stdout:9/682: dread d18/d52/fbf [0,4194304] 0 2024-09-18T21:12:56.282 INFO:tasks.workunit.client.0.smithi077.stdout:7/635: symlink d12/d22/daa/dc0/dac/dad/ld8 0 2024-09-18T21:12:56.283 INFO:tasks.workunit.client.1.smithi103.stdout:6/654: write d2/d3/f74 [3710864,126694] 0 2024-09-18T21:12:56.286 INFO:tasks.workunit.client.1.smithi103.stdout:9/683: write d18/d52/d6f/d8e/fc5 [349475,99710] 0 2024-09-18T21:12:56.290 INFO:tasks.workunit.client.0.smithi077.stdout:5/715: rename d0/d6/dd/d5d/f7a to d0/d6/d3b/d64/fe5 0 2024-09-18T21:12:56.291 INFO:tasks.workunit.client.0.smithi077.stdout:5/716: truncate d0/fbf 95312 0 2024-09-18T21:12:56.295 INFO:tasks.workunit.client.0.smithi077.stdout:4/519: mkdir d3/d7/d73/d9f 0 2024-09-18T21:12:56.300 INFO:tasks.workunit.client.0.smithi077.stdout:4/520: symlink d3/dc/d24/la0 0 2024-09-18T21:12:56.300 INFO:tasks.workunit.client.0.smithi077.stdout:3/543: getdents db 0 2024-09-18T21:12:56.301 INFO:tasks.workunit.client.1.smithi103.stdout:4/664: dwrite d9/d2e/d61/d91/d9e/f53 [0,4194304] 0 2024-09-18T21:12:56.303 INFO:tasks.workunit.client.1.smithi103.stdout:8/729: symlink d4/d81/dd7/dde/d59/d5e/le8 0 2024-09-18T21:12:56.304 INFO:tasks.workunit.client.1.smithi103.stdout:0/614: mknod d1/d5/de/dc0/d8c/cd4 0 2024-09-18T21:12:56.306 INFO:tasks.workunit.client.1.smithi103.stdout:9/684: truncate d18/d52/d6f/d8e/fa2 621708 0 2024-09-18T21:12:56.308 INFO:tasks.workunit.client.1.smithi103.stdout:9/685: truncate d18/d29/d68/d92/d9c/fb8 622860 0 2024-09-18T21:12:56.311 INFO:tasks.workunit.client.1.smithi103.stdout:1/603: dread d0/f7 [4194304,4194304] 0 2024-09-18T21:12:56.312 INFO:tasks.workunit.client.1.smithi103.stdout:1/604: readlink d0/d2/da8/ld3 0 2024-09-18T21:12:56.313 INFO:tasks.workunit.client.1.smithi103.stdout:3/612: dread d1/f13 [4194304,4194304] 0 2024-09-18T21:12:56.349 INFO:tasks.workunit.client.0.smithi077.stdout:0/646: getdents d8/d37/d66/d87 0 2024-09-18T21:12:56.353 INFO:tasks.workunit.client.0.smithi077.stdout:9/554: write d1/dd/d11/f83 [360687,97164] 0 2024-09-18T21:12:56.354 INFO:tasks.workunit.client.0.smithi077.stdout:3/544: symlink db/d4d/lac 0 2024-09-18T21:12:56.356 INFO:tasks.workunit.client.0.smithi077.stdout:4/521: rename d3/dc/d20/l75 to d3/dc/d32/d45/d5e/la1 0 2024-09-18T21:12:56.359 INFO:tasks.workunit.client.1.smithi103.stdout:0/615: creat d1/d5/de/dc0/db0/fd5 x:0 0 0 2024-09-18T21:12:56.360 INFO:tasks.workunit.client.0.smithi077.stdout:2/620: link d1/d4/d9/l9e d1/d4/d9/lcf 0 2024-09-18T21:12:56.362 INFO:tasks.workunit.client.0.smithi077.stdout:2/621: write d1/d4/d5/d1a/d2e/d41/f3f [935681,15266] 0 2024-09-18T21:12:56.364 INFO:tasks.workunit.client.0.smithi077.stdout:6/531: dwrite d7/d7e/d11/d1d/d4c/f86 [0,4194304] 0 2024-09-18T21:12:56.364 INFO:tasks.workunit.client.0.smithi077.stdout:1/597: write d3/d6a/f9e [1157398,46067] 0 2024-09-18T21:12:56.365 INFO:tasks.workunit.client.1.smithi103.stdout:9/686: dread d18/f24 [0,4194304] 0 2024-09-18T21:12:56.366 INFO:tasks.workunit.client.1.smithi103.stdout:7/610: truncate d1/df/d42/d1f/d2e/f37 2832531 0 2024-09-18T21:12:56.367 INFO:tasks.workunit.client.0.smithi077.stdout:3/545: creat db/d14/d32/d49/da4/d8a/d99/fad x:0 0 0 2024-09-18T21:12:56.368 INFO:tasks.workunit.client.1.smithi103.stdout:7/611: truncate d1/df/d42/d1f/d2e/f96 401270 0 2024-09-18T21:12:56.368 INFO:tasks.workunit.client.1.smithi103.stdout:3/613: fdatasync d1/d23/d25/d4f/d58/f6d 0 2024-09-18T21:12:56.370 INFO:tasks.workunit.client.0.smithi077.stdout:4/522: creat d3/d7/d73/fa2 x:0 0 0 2024-09-18T21:12:56.373 INFO:tasks.workunit.client.1.smithi103.stdout:6/655: rename d2/d3/d8/d4c/d79/c97 to d2/d3/d7f/d91/cca 0 2024-09-18T21:12:56.375 INFO:tasks.workunit.client.1.smithi103.stdout:4/665: mkdir d9/de3 0 2024-09-18T21:12:56.376 INFO:tasks.workunit.client.1.smithi103.stdout:6/656: truncate d2/d24/d5a/d67/d76/d43/fbb 163295 0 2024-09-18T21:12:56.379 INFO:tasks.workunit.client.0.smithi077.stdout:8/518: sync 2024-09-18T21:12:56.379 INFO:tasks.workunit.client.1.smithi103.stdout:9/687: mkdir d18/d29/d68/d78/de8 0 2024-09-18T21:12:56.380 INFO:tasks.workunit.client.0.smithi077.stdout:9/555: symlink d1/dd/d11/lb9 0 2024-09-18T21:12:56.382 INFO:tasks.workunit.client.0.smithi077.stdout:2/622: symlink d1/d4/d5/d1a/d2e/d41/d2c/ld0 0 2024-09-18T21:12:56.384 INFO:tasks.workunit.client.1.smithi103.stdout:3/614: creat d1/d23/d25/da1/fbe x:0 0 0 2024-09-18T21:12:56.385 INFO:tasks.workunit.client.1.smithi103.stdout:4/666: mknod d9/d1c/d69/ce4 0 2024-09-18T21:12:56.386 INFO:tasks.workunit.client.0.smithi077.stdout:1/598: read - d3/d8/d93/dd3/f74 zero size 2024-09-18T21:12:56.386 INFO:tasks.workunit.client.0.smithi077.stdout:9/556: dwrite d1/dd/d1a/d42/f9f [0,4194304] 0 2024-09-18T21:12:56.387 INFO:tasks.workunit.client.1.smithi103.stdout:4/667: write d9/d2e/d83/db6/d41/f5f [149376,584] 0 2024-09-18T21:12:56.389 INFO:tasks.workunit.client.1.smithi103.stdout:4/668: truncate d9/d38/d58/fa7 459305 0 2024-09-18T21:12:56.389 INFO:tasks.workunit.client.0.smithi077.stdout:3/546: mkdir db/d14/d22/dae 0 2024-09-18T21:12:56.391 INFO:tasks.workunit.client.1.smithi103.stdout:0/616: dread d1/d9/d3e/fd0 [0,4194304] 0 2024-09-18T21:12:56.393 INFO:tasks.workunit.client.1.smithi103.stdout:7/612: mkdir d1/df/dbf 0 2024-09-18T21:12:56.394 INFO:tasks.workunit.client.0.smithi077.stdout:1/599: dwrite d3/d38/f60 [0,4194304] 0 2024-09-18T21:12:56.394 INFO:tasks.workunit.client.1.smithi103.stdout:7/613: chown d1/df/d42/d29/c3d 28644036 1 2024-09-18T21:12:56.396 INFO:tasks.workunit.client.0.smithi077.stdout:7/636: sync 2024-09-18T21:12:56.396 INFO:tasks.workunit.client.1.smithi103.stdout:7/614: chown d1/df/d42/d29/d48/dbb/d33/fae 232434 1 2024-09-18T21:12:56.397 INFO:tasks.workunit.client.1.smithi103.stdout:7/615: chown d1/df/d43/d52/f99 6983501 1 2024-09-18T21:12:56.400 INFO:tasks.workunit.client.1.smithi103.stdout:4/669: write d9/d38/f4c [13563899,96103] 0 2024-09-18T21:12:56.402 INFO:tasks.workunit.client.1.smithi103.stdout:9/688: creat d18/d29/d68/d92/d9c/dc8/fe9 x:0 0 0 2024-09-18T21:12:56.403 INFO:tasks.workunit.client.1.smithi103.stdout:0/617: mknod d1/d5/de/dc0/d8c/dce/d9f/d4f/d68/cd6 0 2024-09-18T21:12:56.406 INFO:tasks.workunit.client.1.smithi103.stdout:4/670: creat d9/d2e/d83/fe5 x:0 0 0 2024-09-18T21:12:56.407 INFO:tasks.workunit.client.1.smithi103.stdout:4/671: write d9/d38/f45 [142604,21142] 0 2024-09-18T21:12:56.409 INFO:tasks.workunit.client.1.smithi103.stdout:0/618: mknod d1/d5/de/d22/d98/cd7 0 2024-09-18T21:12:56.414 INFO:tasks.workunit.client.1.smithi103.stdout:9/689: truncate f1 8465 0 2024-09-18T21:12:56.416 INFO:tasks.workunit.client.1.smithi103.stdout:4/672: creat d9/d2e/d83/db6/d41/fe6 x:0 0 0 2024-09-18T21:12:56.417 INFO:tasks.workunit.client.1.smithi103.stdout:4/673: fsync d9/d2e/d61/f76 0 2024-09-18T21:12:56.425 INFO:tasks.workunit.client.1.smithi103.stdout:4/674: dwrite d9/d1c/f68 [0,4194304] 0 2024-09-18T21:12:56.425 INFO:tasks.workunit.client.1.smithi103.stdout:0/619: creat d1/d5/fd8 x:0 0 0 2024-09-18T21:12:56.429 INFO:tasks.workunit.client.1.smithi103.stdout:0/620: mknod d1/d93/cd9 0 2024-09-18T21:12:56.431 INFO:tasks.workunit.client.1.smithi103.stdout:4/675: symlink d9/d2e/d61/d91/daa/le7 0 2024-09-18T21:12:56.433 INFO:tasks.workunit.client.1.smithi103.stdout:9/690: getdents d18/d52/d6f/d8e 0 2024-09-18T21:12:56.433 INFO:tasks.workunit.client.1.smithi103.stdout:4/676: write d9/d2e/d83/db6/d21/f88 [2110539,32328] 0 2024-09-18T21:12:56.436 INFO:tasks.workunit.client.1.smithi103.stdout:4/677: truncate d9/d38/d58/fbb 167186 0 2024-09-18T21:12:56.438 INFO:tasks.workunit.client.1.smithi103.stdout:0/621: creat d1/daf/fda x:0 0 0 2024-09-18T21:12:56.441 INFO:tasks.workunit.client.1.smithi103.stdout:9/691: rename d18/d8d/d2f/c53 to d18/d52/d6f/db9/de0/de7/cea 0 2024-09-18T21:12:56.442 INFO:tasks.workunit.client.1.smithi103.stdout:4/678: mknod d9/d38/d72/d94/ce8 0 2024-09-18T21:12:56.445 INFO:tasks.workunit.client.1.smithi103.stdout:0/622: creat d1/d5/de/dc0/d62/fdb x:0 0 0 2024-09-18T21:12:56.445 INFO:tasks.workunit.client.0.smithi077.stdout:0/647: creat d8/d1a/d39/d3b/fcb x:0 0 0 2024-09-18T21:12:56.449 INFO:tasks.workunit.client.1.smithi103.stdout:9/692: dwrite d18/d29/d68/d92/d9c/dc8/fe9 [0,4194304] 0 2024-09-18T21:12:56.450 INFO:tasks.workunit.client.0.smithi077.stdout:2/623: dread d1/d4/fbd [0,4194304] 0 2024-09-18T21:12:56.452 INFO:tasks.workunit.client.1.smithi103.stdout:0/623: creat d1/d5/de/d19/fdc x:0 0 0 2024-09-18T21:12:56.456 INFO:tasks.workunit.client.1.smithi103.stdout:0/624: mknod d1/d5/de/dc0/db0/cdd 0 2024-09-18T21:12:56.460 INFO:tasks.workunit.client.0.smithi077.stdout:0/648: rmdir d8/d37/d95/dab 39 2024-09-18T21:12:56.463 INFO:tasks.workunit.client.1.smithi103.stdout:0/625: dwrite d1/fd [0,4194304] 0 2024-09-18T21:12:56.464 INFO:tasks.workunit.client.1.smithi103.stdout:8/730: mkdir d4/d2d/d4e/de9 0 2024-09-18T21:12:56.466 INFO:tasks.workunit.client.0.smithi077.stdout:1/600: dread d3/d8/d13/f1f [0,4194304] 0 2024-09-18T21:12:56.469 INFO:tasks.workunit.client.1.smithi103.stdout:0/626: mknod d1/d9/d3e/cde 0 2024-09-18T21:12:56.471 INFO:tasks.workunit.client.1.smithi103.stdout:8/731: mkdir d4/d2d/d87/dbb/dea 0 2024-09-18T21:12:56.472 INFO:tasks.workunit.client.0.smithi077.stdout:0/649: getdents d8/d1a/d39/d56 0 2024-09-18T21:12:56.472 INFO:tasks.workunit.client.0.smithi077.stdout:1/601: dwrite d3/d6a/d9b/d68/d3e/fc0 [0,4194304] 0 2024-09-18T21:12:56.473 INFO:tasks.workunit.client.1.smithi103.stdout:0/627: read d1/d5/de/dc0/d8c/dce/d9f/f71 [1038492,72761] 0 2024-09-18T21:12:56.475 INFO:tasks.workunit.client.0.smithi077.stdout:1/602: write d3/d8/d75/d89/dbb/fc3 [286639,21107] 0 2024-09-18T21:12:56.477 INFO:tasks.workunit.client.0.smithi077.stdout:1/603: write d3/d8/d93/dd3/d99/fb5 [1816325,124538] 0 2024-09-18T21:12:56.478 INFO:tasks.workunit.client.0.smithi077.stdout:1/604: chown d3/d38/d97/f98 9875 1 2024-09-18T21:12:56.479 INFO:tasks.workunit.client.0.smithi077.stdout:1/605: chown d3/d38/dd5/ld1 326989 1 2024-09-18T21:12:56.480 INFO:tasks.workunit.client.1.smithi103.stdout:8/732: mknod d4/d81/dd7/dde/d59/d9c/de6/ceb 0 2024-09-18T21:12:56.483 INFO:tasks.workunit.client.0.smithi077.stdout:1/606: creat d3/d8/d93/dd3/dc1/fd6 x:0 0 0 2024-09-18T21:12:56.484 INFO:tasks.workunit.client.1.smithi103.stdout:8/733: symlink d4/d2d/d87/dbb/lec 0 2024-09-18T21:12:56.484 INFO:tasks.workunit.client.0.smithi077.stdout:1/607: symlink d3/d8/d49/d4e/d5a/ld7 0 2024-09-18T21:12:56.486 INFO:tasks.workunit.client.0.smithi077.stdout:1/608: mknod d3/d6a/d9b/d68/d3e/cd8 0 2024-09-18T21:12:56.489 INFO:tasks.workunit.client.0.smithi077.stdout:1/609: mknod d3/d8/d13/d77/db1/cd9 0 2024-09-18T21:12:56.495 INFO:tasks.workunit.client.1.smithi103.stdout:1/605: write d0/d2/fb [1187208,2311] 0 2024-09-18T21:12:56.495 INFO:tasks.workunit.client.0.smithi077.stdout:1/610: dread d3/d8/d93/dd3/f64 [0,4194304] 0 2024-09-18T21:12:56.497 INFO:tasks.workunit.client.0.smithi077.stdout:1/611: chown d3/d8/d13/c19 2 1 2024-09-18T21:12:56.504 INFO:tasks.workunit.client.0.smithi077.stdout:6/532: dwrite d7/d7e/d11/d3e/d42/f72 [0,4194304] 0 2024-09-18T21:12:56.507 INFO:tasks.workunit.client.0.smithi077.stdout:6/533: dread d7/d7e/d11/d1d/d4c/f8a [0,4194304] 0 2024-09-18T21:12:56.514 INFO:tasks.workunit.client.0.smithi077.stdout:6/534: dwrite d7/d7e/d11/d1d/d4c/f86 [4194304,4194304] 0 2024-09-18T21:12:56.517 INFO:tasks.workunit.client.1.smithi103.stdout:6/657: mkdir d2/d3/dcb 0 2024-09-18T21:12:56.524 INFO:tasks.workunit.client.0.smithi077.stdout:6/535: dread d7/d7e/d11/d3e/f65 [0,4194304] 0 2024-09-18T21:12:56.524 INFO:tasks.workunit.client.1.smithi103.stdout:7/616: write d1/df/d43/d52/f75 [1884258,24915] 0 2024-09-18T21:12:56.531 INFO:tasks.workunit.client.1.smithi103.stdout:6/658: creat d2/d24/d38/d68/dac/fcc x:0 0 0 2024-09-18T21:12:56.532 INFO:tasks.workunit.client.1.smithi103.stdout:7/617: stat d1/l8 0 2024-09-18T21:12:56.540 INFO:tasks.workunit.client.1.smithi103.stdout:7/618: dwrite d1/df/d42/d1f/d5d/f7f [0,4194304] 0 2024-09-18T21:12:56.540 INFO:tasks.workunit.client.0.smithi077.stdout:5/717: mkdir d0/de6 0 2024-09-18T21:12:56.541 INFO:tasks.workunit.client.0.smithi077.stdout:5/718: creat d0/df/d3d/fe7 x:0 0 0 2024-09-18T21:12:56.546 INFO:tasks.workunit.client.1.smithi103.stdout:7/619: creat d1/df/d42/d1f/d2e/fc0 x:0 0 0 2024-09-18T21:12:56.548 INFO:tasks.workunit.client.0.smithi077.stdout:5/719: symlink d0/df/d10/d5c/d9b/le8 0 2024-09-18T21:12:56.550 INFO:tasks.workunit.client.1.smithi103.stdout:7/620: truncate d1/df/d42/d1f/d2e/f50 1506901 0 2024-09-18T21:12:56.551 INFO:tasks.workunit.client.0.smithi077.stdout:4/523: link d3/dc/l3a d3/la3 0 2024-09-18T21:12:56.553 INFO:tasks.workunit.client.1.smithi103.stdout:7/621: creat d1/df/d44/db4/fc1 x:0 0 0 2024-09-18T21:12:56.554 INFO:tasks.workunit.client.0.smithi077.stdout:4/524: truncate d3/d77/f8b 581986 0 2024-09-18T21:12:56.555 INFO:tasks.workunit.client.1.smithi103.stdout:7/622: fsync d1/df/d42/d1f/d2e/d3f/f91 0 2024-09-18T21:12:56.556 INFO:tasks.workunit.client.1.smithi103.stdout:2/570: creat d3/fcf x:0 0 0 2024-09-18T21:12:56.556 INFO:tasks.workunit.client.1.smithi103.stdout:7/623: dread - d1/df/d42/d1f/d2e/fc0 zero size 2024-09-18T21:12:56.557 INFO:tasks.workunit.client.1.smithi103.stdout:7/624: dread - d1/df/d42/d29/fbd zero size 2024-09-18T21:12:56.560 INFO:tasks.workunit.client.0.smithi077.stdout:4/525: dwrite d3/d7/d73/fa2 [0,4194304] 0 2024-09-18T21:12:56.565 INFO:tasks.workunit.client.0.smithi077.stdout:9/557: write d1/f49 [651811,90782] 0 2024-09-18T21:12:56.566 INFO:tasks.workunit.client.1.smithi103.stdout:7/625: dwrite d1/df/d43/d61/f78 [0,4194304] 0 2024-09-18T21:12:56.566 INFO:tasks.workunit.client.1.smithi103.stdout:9/693: write d18/d52/f82 [760476,58810] 0 2024-09-18T21:12:56.566 INFO:tasks.workunit.client.0.smithi077.stdout:7/637: write d12/d22/d59/d72/f86 [2060079,109311] 0 2024-09-18T21:12:56.568 INFO:tasks.workunit.client.0.smithi077.stdout:2/624: write d1/d4/d9/d80/d8e/f74 [4967793,86613] 0 2024-09-18T21:12:56.569 INFO:tasks.workunit.client.0.smithi077.stdout:7/638: truncate d12/d56/da1/db6/dbd/fd6 390306 0 2024-09-18T21:12:56.570 INFO:tasks.workunit.client.0.smithi077.stdout:2/625: stat d1/d62/cc7 0 2024-09-18T21:12:56.570 INFO:tasks.workunit.client.1.smithi103.stdout:9/694: write d18/d52/d6f/d8e/db4/fd2 [941083,3333] 0 2024-09-18T21:12:56.571 INFO:tasks.workunit.client.0.smithi077.stdout:2/626: chown d1/d4/d9/d80/f90 0 1 2024-09-18T21:12:56.571 INFO:tasks.workunit.client.0.smithi077.stdout:7/639: rmdir d12/d22/d59/d72 39 2024-09-18T21:12:56.573 INFO:tasks.workunit.client.1.smithi103.stdout:7/626: mkdir d1/df/d42/d1f/d5d/d85/db0/dc2 0 2024-09-18T21:12:56.575 INFO:tasks.workunit.client.1.smithi103.stdout:9/695: mkdir d18/d29/d68/d92/d9c/dc8/deb 0 2024-09-18T21:12:56.576 INFO:tasks.workunit.client.1.smithi103.stdout:9/696: fsync d18/d8d/d2f/f97 0 2024-09-18T21:12:56.576 INFO:tasks.workunit.client.0.smithi077.stdout:0/650: write d8/d37/f6f [247746,55181] 0 2024-09-18T21:12:56.578 INFO:tasks.workunit.client.1.smithi103.stdout:7/627: mkdir d1/df/d43/d63/d67/dc3 0 2024-09-18T21:12:56.581 INFO:tasks.workunit.client.1.smithi103.stdout:9/697: dread d18/d29/d68/fd4 [0,4194304] 0 2024-09-18T21:12:56.581 INFO:tasks.workunit.client.1.smithi103.stdout:7/628: dread d1/df/d42/d1f/d5d/f71 [0,4194304] 0 2024-09-18T21:12:56.583 INFO:tasks.workunit.client.0.smithi077.stdout:2/627: creat d1/d4/d5/d1a/d2e/fd1 x:0 0 0 2024-09-18T21:12:56.584 INFO:tasks.workunit.client.0.smithi077.stdout:0/651: creat d8/d1d/d57/fcc x:0 0 0 2024-09-18T21:12:56.587 INFO:tasks.workunit.client.0.smithi077.stdout:2/628: symlink d1/d4/d5/d1a/d49/d6a/d81/ld2 0 2024-09-18T21:12:56.588 INFO:tasks.workunit.client.1.smithi103.stdout:9/698: symlink d18/d29/d68/d92/dd1/lec 0 2024-09-18T21:12:56.589 INFO:tasks.workunit.client.1.smithi103.stdout:9/699: fsync d18/d29/f5b 0 2024-09-18T21:12:56.589 INFO:tasks.workunit.client.0.smithi077.stdout:0/652: creat d8/d1a/d39/d3b/d70/fcd x:0 0 0 2024-09-18T21:12:56.591 INFO:tasks.workunit.client.1.smithi103.stdout:4/679: rename d9/d2e/d61/cb2 to d9/d1c/d69/ce9 0 2024-09-18T21:12:56.592 INFO:tasks.workunit.client.1.smithi103.stdout:7/629: creat d1/df/d43/db1/fc4 x:0 0 0 2024-09-18T21:12:56.595 INFO:tasks.workunit.client.1.smithi103.stdout:7/630: write d1/df/d42/d29/d48/dbb/d33/d51/f9e [1622791,110378] 0 2024-09-18T21:12:56.596 INFO:tasks.workunit.client.0.smithi077.stdout:0/653: dwrite d8/d1d/fca [0,4194304] 0 2024-09-18T21:12:56.597 INFO:tasks.workunit.client.1.smithi103.stdout:9/700: dwrite d18/d29/d68/d78/fa8 [0,4194304] 0 2024-09-18T21:12:56.597 INFO:tasks.workunit.client.1.smithi103.stdout:1/606: rename d0/d2/d9/d10/d5d/dd4 to d0/d3/d68/d81/da2/da4/dc2/dd8 0 2024-09-18T21:12:56.599 INFO:tasks.workunit.client.1.smithi103.stdout:4/680: mknod d9/d2e/d83/db6/d86/cea 0 2024-09-18T21:12:56.600 INFO:tasks.workunit.client.1.smithi103.stdout:4/681: fsync d9/d38/d72/fa8 0 2024-09-18T21:12:56.600 INFO:tasks.workunit.client.1.smithi103.stdout:7/631: read d1/df/d42/d29/fa6 [2087994,60452] 0 2024-09-18T21:12:56.600 INFO:tasks.workunit.client.0.smithi077.stdout:7/640: dread d12/d56/fd2 [0,4194304] 0 2024-09-18T21:12:56.601 INFO:tasks.workunit.client.0.smithi077.stdout:0/654: mkdir d8/d1d/d57/dce 0 2024-09-18T21:12:56.603 INFO:tasks.workunit.client.0.smithi077.stdout:0/655: write d8/d1a/d35/d6d/fc2 [394664,16758] 0 2024-09-18T21:12:56.605 INFO:tasks.workunit.client.0.smithi077.stdout:7/641: creat d12/d56/da1/db6/dbd/fd9 x:0 0 0 2024-09-18T21:12:56.607 INFO:tasks.workunit.client.1.smithi103.stdout:6/659: rename d2/f34 to d2/d3/d7f/fcd 0 2024-09-18T21:12:56.607 INFO:tasks.workunit.client.0.smithi077.stdout:0/656: dread - d8/d1d/d80/f97 zero size 2024-09-18T21:12:56.609 INFO:tasks.workunit.client.0.smithi077.stdout:7/642: rmdir d12/d22/daa/dc0/d62 39 2024-09-18T21:12:56.610 INFO:tasks.workunit.client.0.smithi077.stdout:3/547: sync 2024-09-18T21:12:56.610 INFO:tasks.workunit.client.1.smithi103.stdout:1/607: symlink d0/d2/d9/d9e/d7a/ld9 0 2024-09-18T21:12:56.611 INFO:tasks.workunit.client.0.smithi077.stdout:3/548: chown db/l4a 44 1 2024-09-18T21:12:56.611 INFO:tasks.workunit.client.1.smithi103.stdout:6/660: dread d2/d3/d8/d4c/d4e/f9a [0,4194304] 0 2024-09-18T21:12:56.611 INFO:tasks.workunit.client.0.smithi077.stdout:7/643: fsync d12/d31/d77/d93/f88 0 2024-09-18T21:12:56.614 INFO:tasks.workunit.client.0.smithi077.stdout:0/657: mkdir d8/d1d/d57/dce/dcf 0 2024-09-18T21:12:56.614 INFO:tasks.workunit.client.1.smithi103.stdout:6/661: truncate d2/d24/d5a/d67/d76/d43/fbb 1089154 0 2024-09-18T21:12:56.615 INFO:tasks.workunit.client.1.smithi103.stdout:7/632: mkdir d1/df/d42/d1f/d5d/d85/db0/dc5 0 2024-09-18T21:12:56.616 INFO:tasks.workunit.client.0.smithi077.stdout:3/549: mkdir db/d14/d32/d49/da4/d8a/d99/daf 0 2024-09-18T21:12:56.616 INFO:tasks.workunit.client.1.smithi103.stdout:6/662: fsync d2/d3/d8/d4c/d4e/fc3 0 2024-09-18T21:12:56.618 INFO:tasks.workunit.client.1.smithi103.stdout:1/608: dwrite d0/d2/d9/d10/d5d/f79 [0,4194304] 0 2024-09-18T21:12:56.618 INFO:tasks.workunit.client.1.smithi103.stdout:7/633: fsync d1/df/d42/d29/d48/dbb/d33/fa1 0 2024-09-18T21:12:56.619 INFO:tasks.workunit.client.0.smithi077.stdout:8/519: rename d2/d36 to d2/d27/d29/d41/dbc 0 2024-09-18T21:12:56.619 INFO:tasks.workunit.client.0.smithi077.stdout:7/644: truncate d12/d31/f61 4948816 0 2024-09-18T21:12:56.621 INFO:tasks.workunit.client.0.smithi077.stdout:0/658: mkdir d8/d1a/d39/dd0 0 2024-09-18T21:12:56.625 INFO:tasks.workunit.client.0.smithi077.stdout:5/720: rename d0/d6/dd/d5d/d91 to d0/df/d10/d4b/d80/de9 0 2024-09-18T21:12:56.627 INFO:tasks.workunit.client.0.smithi077.stdout:8/520: symlink d2/d5f/da8/d4f/d5a/d2a/lbd 0 2024-09-18T21:12:56.628 INFO:tasks.workunit.client.0.smithi077.stdout:0/659: dwrite d8/d37/d66/db4/fc7 [0,4194304] 0 2024-09-18T21:12:56.628 INFO:tasks.workunit.client.1.smithi103.stdout:6/663: mknod d2/d3/d7f/cce 0 2024-09-18T21:12:56.631 INFO:tasks.workunit.client.0.smithi077.stdout:3/550: creat db/d14/d32/d49/da4/d8a/d99/daf/fb0 x:0 0 0 2024-09-18T21:12:56.633 INFO:tasks.workunit.client.0.smithi077.stdout:0/660: dread d8/d1a/d39/d56/f69 [0,4194304] 0 2024-09-18T21:12:56.635 INFO:tasks.workunit.client.1.smithi103.stdout:8/734: mknod d4/d81/ced 0 2024-09-18T21:12:56.635 INFO:tasks.workunit.client.0.smithi077.stdout:5/721: rmdir d0/d6 39 2024-09-18T21:12:56.637 INFO:tasks.workunit.client.1.smithi103.stdout:4/682: creat d9/d1c/db1/dd5/feb x:0 0 0 2024-09-18T21:12:56.638 INFO:tasks.workunit.client.1.smithi103.stdout:4/683: write d9/d1c/d77/f54 [103627,12541] 0 2024-09-18T21:12:56.641 INFO:tasks.workunit.client.0.smithi077.stdout:6/536: write d7/d7e/d11/f57 [1258498,42863] 0 2024-09-18T21:12:56.643 INFO:tasks.workunit.client.0.smithi077.stdout:8/521: rename d2/d27/d29/d41/dbc/l50 to d2/d27/d29/d72/lbe 0 2024-09-18T21:12:56.644 INFO:tasks.workunit.client.1.smithi103.stdout:6/664: symlink d2/d3/dcb/lcf 0 2024-09-18T21:12:56.647 INFO:tasks.workunit.client.1.smithi103.stdout:4/684: mkdir d9/d38/db4/dec 0 2024-09-18T21:12:56.649 INFO:tasks.workunit.client.0.smithi077.stdout:7/645: link d12/d31/d77/da0/fb1 d12/d31/fda 0 2024-09-18T21:12:56.649 INFO:tasks.workunit.client.1.smithi103.stdout:7/634: link d1/df/d43/d61/c6e d1/df/d43/d63/d67/d5b/cc6 0 2024-09-18T21:12:56.650 INFO:tasks.workunit.client.0.smithi077.stdout:6/537: creat d7/d7e/d11/d1d/d31/fb4 x:0 0 0 2024-09-18T21:12:56.651 INFO:tasks.workunit.client.1.smithi103.stdout:8/735: truncate d4/d26/d56/d77/d9f/fca 417311 0 2024-09-18T21:12:56.651 INFO:tasks.workunit.client.1.smithi103.stdout:8/736: stat d4/d2d/d3d/da0/dab/lcd 0 2024-09-18T21:12:56.653 INFO:tasks.workunit.client.1.smithi103.stdout:6/665: mkdir d2/d3/d8/d4c/d7d/d9b/dd0 0 2024-09-18T21:12:56.655 INFO:tasks.workunit.client.1.smithi103.stdout:4/685: rename d9/d38/f9a to d9/d2e/d83/fed 0 2024-09-18T21:12:56.656 INFO:tasks.workunit.client.0.smithi077.stdout:5/722: creat d0/d6/dd/d5d/fea x:0 0 0 2024-09-18T21:12:56.658 INFO:tasks.workunit.client.1.smithi103.stdout:2/571: write d3/d5/f35 [5294846,115292] 0 2024-09-18T21:12:56.659 INFO:tasks.workunit.client.1.smithi103.stdout:8/737: mkdir d4/d2d/dc1/dee 0 2024-09-18T21:12:56.660 INFO:tasks.workunit.client.0.smithi077.stdout:4/526: truncate d3/dc/f47 3936111 0 2024-09-18T21:12:56.660 INFO:tasks.workunit.client.1.smithi103.stdout:8/738: write d4/d98/fcf [17313,110356] 0 2024-09-18T21:12:56.661 INFO:tasks.workunit.client.1.smithi103.stdout:6/666: creat d2/d3/d8/d4c/d79/fd1 x:0 0 0 2024-09-18T21:12:56.662 INFO:tasks.workunit.client.0.smithi077.stdout:9/558: write d1/f48 [386701,4214] 0 2024-09-18T21:12:56.662 INFO:tasks.workunit.client.1.smithi103.stdout:8/739: readlink d4/d26/d56/d77/d9f/la3 0 2024-09-18T21:12:56.663 INFO:tasks.workunit.client.0.smithi077.stdout:9/559: write d1/d54/d51/fa4 [911454,36223] 0 2024-09-18T21:12:56.663 INFO:tasks.workunit.client.1.smithi103.stdout:8/740: chown d4/d81/dd7/dde/d59/d5e/l6d 28161 1 2024-09-18T21:12:56.667 INFO:tasks.workunit.client.1.smithi103.stdout:4/686: symlink d9/d1c/dcd/dd1/lee 0 2024-09-18T21:12:56.669 INFO:tasks.workunit.client.0.smithi077.stdout:9/560: dwrite d1/dd/d11/d15/f86 [0,4194304] 0 2024-09-18T21:12:56.669 INFO:tasks.workunit.client.0.smithi077.stdout:4/527: creat d3/dc/d51/fa4 x:0 0 0 2024-09-18T21:12:56.671 INFO:tasks.workunit.client.1.smithi103.stdout:8/741: creat d4/de/fef x:0 0 0 2024-09-18T21:12:56.672 INFO:tasks.workunit.client.1.smithi103.stdout:8/742: chown d4/d26/d56/d77 202257297 1 2024-09-18T21:12:56.675 INFO:tasks.workunit.client.0.smithi077.stdout:0/661: getdents d8/d1a/d39/d3b/d70 0 2024-09-18T21:12:56.675 INFO:tasks.workunit.client.0.smithi077.stdout:9/561: dread d1/d54/d51/fa4 [0,4194304] 0 2024-09-18T21:12:56.676 INFO:tasks.workunit.client.0.smithi077.stdout:5/723: creat d0/de6/feb x:0 0 0 2024-09-18T21:12:56.677 INFO:tasks.workunit.client.0.smithi077.stdout:5/724: readlink d0/df/d10/l69 0 2024-09-18T21:12:56.677 INFO:tasks.workunit.client.0.smithi077.stdout:9/562: read d1/dd/d11/d1c/d38/d46/d55/d9c/fb8 [445959,107217] 0 2024-09-18T21:12:56.678 INFO:tasks.workunit.client.0.smithi077.stdout:2/629: truncate d1/d4/d9/fa0 3165151 0 2024-09-18T21:12:56.682 INFO:tasks.workunit.client.1.smithi103.stdout:2/572: rename d3/d5/d2f/d32/f76 to d3/d5/fd0 0 2024-09-18T21:12:56.684 INFO:tasks.workunit.client.0.smithi077.stdout:4/528: symlink d3/dc/la5 0 2024-09-18T21:12:56.684 INFO:tasks.workunit.client.0.smithi077.stdout:4/529: chown d3/dc/d51 1972141953 1 2024-09-18T21:12:56.684 INFO:tasks.workunit.client.0.smithi077.stdout:4/530: chown d3/d7/f68 43 1 2024-09-18T21:12:56.685 INFO:tasks.workunit.client.1.smithi103.stdout:4/687: mknod d9/d2e/d61/d91/cef 0 2024-09-18T21:12:56.687 INFO:tasks.workunit.client.1.smithi103.stdout:2/573: fsync d3/d5/d2f/d5b/f75 0 2024-09-18T21:12:56.689 INFO:tasks.workunit.client.1.smithi103.stdout:8/743: link d4/d81/d71/d7f/fdd d4/d81/d71/d7f/ff0 0 2024-09-18T21:12:56.691 INFO:tasks.workunit.client.0.smithi077.stdout:9/563: creat d1/d54/d51/da3/fba x:0 0 0 2024-09-18T21:12:56.692 INFO:tasks.workunit.client.0.smithi077.stdout:9/564: chown d1/d54/d27/f39 5 1 2024-09-18T21:12:56.694 INFO:tasks.workunit.client.1.smithi103.stdout:2/574: symlink d3/d5/d25/d40/ld1 0 2024-09-18T21:12:56.695 INFO:tasks.workunit.client.0.smithi077.stdout:6/538: getdents d7/d7e/d11/d9a 0 2024-09-18T21:12:56.697 INFO:tasks.workunit.client.1.smithi103.stdout:8/744: unlink d4/d26/d56/d77/fa1 0 2024-09-18T21:12:56.699 INFO:tasks.workunit.client.0.smithi077.stdout:4/531: unlink d3/d77/f41 0 2024-09-18T21:12:56.700 INFO:tasks.workunit.client.1.smithi103.stdout:2/575: write d3/d5/d2f/d32/d46/fb0 [224088,112815] 0 2024-09-18T21:12:56.701 INFO:tasks.workunit.client.1.smithi103.stdout:2/576: chown d3/d5/d2f 1593 1 2024-09-18T21:12:56.701 INFO:tasks.workunit.client.0.smithi077.stdout:0/662: mknod d8/d37/cd1 0 2024-09-18T21:12:56.703 INFO:tasks.workunit.client.1.smithi103.stdout:9/701: write d18/d52/d5e/f9d [504903,99975] 0 2024-09-18T21:12:56.705 INFO:tasks.workunit.client.1.smithi103.stdout:9/702: write fa [7334636,86258] 0 2024-09-18T21:12:56.706 INFO:tasks.workunit.client.1.smithi103.stdout:8/745: read d4/d26/d56/d77/f8f [1313248,59081] 0 2024-09-18T21:12:56.710 INFO:tasks.workunit.client.0.smithi077.stdout:6/539: rename d7/d7e/l4e to d7/d7e/d11/d1d/d50/lb5 0 2024-09-18T21:12:56.711 INFO:tasks.workunit.client.1.smithi103.stdout:8/746: dwrite d4/d2d/d3d/da0/dab/de7/fb5 [0,4194304] 0 2024-09-18T21:12:56.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:56 smithi077 ceph-mon[27689]: from='client.14654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:12:56.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:56 smithi077 ceph-mon[27689]: pgmap v19: 65 pgs: 65 active+clean; 2.5 GiB data, 9.0 GiB used, 527 GiB / 536 GiB avail; 101 MiB/s rd, 372 MiB/s wr, 640 op/s 2024-09-18T21:12:56.713 INFO:tasks.workunit.client.1.smithi103.stdout:9/703: mkdir d18/d52/d6f/db9/dcb/ded 0 2024-09-18T21:12:56.713 INFO:tasks.workunit.client.0.smithi077.stdout:4/532: symlink d3/dc/d32/d5b/la6 0 2024-09-18T21:12:56.714 INFO:tasks.workunit.client.0.smithi077.stdout:4/533: readlink d3/dc/d32/d45/l7e 0 2024-09-18T21:12:56.716 INFO:tasks.workunit.client.0.smithi077.stdout:0/663: write d8/d1a/f20 [4192470,13916] 0 2024-09-18T21:12:56.716 INFO:tasks.workunit.client.1.smithi103.stdout:8/747: mknod d4/d81/dd7/dde/d59/d9c/de6/cf1 0 2024-09-18T21:12:56.718 INFO:tasks.workunit.client.1.smithi103.stdout:9/704: dwrite d18/f64 [0,4194304] 0 2024-09-18T21:12:56.723 INFO:tasks.workunit.client.0.smithi077.stdout:4/534: dwrite d3/d7/d6c/f90 [0,4194304] 0 2024-09-18T21:12:56.726 INFO:tasks.workunit.client.1.smithi103.stdout:8/748: creat d4/d81/dd7/dde/d59/d9c/de6/ff2 x:0 0 0 2024-09-18T21:12:56.726 INFO:tasks.workunit.client.1.smithi103.stdout:9/705: dwrite d18/d8d/fc6 [0,4194304] 0 2024-09-18T21:12:56.727 INFO:tasks.workunit.client.0.smithi077.stdout:8/522: write d2/d5/f16 [3341675,122568] 0 2024-09-18T21:12:56.727 INFO:tasks.workunit.client.0.smithi077.stdout:0/664: dwrite d8/d1a/f20 [0,4194304] 0 2024-09-18T21:12:56.729 INFO:tasks.workunit.client.0.smithi077.stdout:8/523: truncate d2/d27/d29/d72/f9d 98448 0 2024-09-18T21:12:56.730 INFO:tasks.workunit.client.0.smithi077.stdout:8/524: fdatasync d2/d27/d29/f9c 0 2024-09-18T21:12:56.735 INFO:tasks.workunit.client.1.smithi103.stdout:5/684: sync 2024-09-18T21:12:56.737 INFO:tasks.workunit.client.1.smithi103.stdout:5/685: chown de/d1f/d3b/d51/d57/d79/d8d 2017 1 2024-09-18T21:12:56.739 INFO:tasks.workunit.client.1.smithi103.stdout:7/635: dwrite d1/df/f79 [0,4194304] 0 2024-09-18T21:12:56.740 INFO:tasks.workunit.client.0.smithi077.stdout:7/646: dwrite d12/d22/d59/f79 [0,4194304] 0 2024-09-18T21:12:56.745 INFO:tasks.workunit.client.0.smithi077.stdout:0/665: mkdir d8/d37/dd2 0 2024-09-18T21:12:56.745 INFO:tasks.workunit.client.0.smithi077.stdout:0/666: chown d8/f19 196 1 2024-09-18T21:12:56.747 INFO:tasks.workunit.client.0.smithi077.stdout:0/667: write d8/d37/d66/f6c [1524839,91342] 0 2024-09-18T21:12:56.749 INFO:tasks.workunit.client.1.smithi103.stdout:6/667: truncate d2/d3/f74 2668167 0 2024-09-18T21:12:56.750 INFO:tasks.workunit.client.1.smithi103.stdout:6/668: chown d2/d3/d7f/cce 0 1 2024-09-18T21:12:56.751 INFO:tasks.workunit.client.1.smithi103.stdout:5/686: unlink de/d1f/d3b/d58/dc4/d7e/lc1 0 2024-09-18T21:12:56.756 INFO:tasks.workunit.client.1.smithi103.stdout:4/688: rename d9/d2e to d9/d38/d72/df0 0 2024-09-18T21:12:56.756 INFO:tasks.workunit.client.1.smithi103.stdout:6/669: fsync d2/d3/d7f/fcd 0 2024-09-18T21:12:56.757 INFO:tasks.workunit.client.1.smithi103.stdout:4/689: chown d9/d38/f4c 37099 1 2024-09-18T21:12:56.758 INFO:tasks.workunit.client.1.smithi103.stdout:4/690: chown d9/d38/f45 1861414 1 2024-09-18T21:12:56.760 INFO:tasks.workunit.client.1.smithi103.stdout:7/636: mkdir d1/df/dc7 0 2024-09-18T21:12:56.761 INFO:tasks.workunit.client.1.smithi103.stdout:6/670: symlink d2/d3/d8/d4c/d7d/d9b/ld2 0 2024-09-18T21:12:56.762 INFO:tasks.workunit.client.1.smithi103.stdout:4/691: creat d9/d38/d72/df0/d83/db6/d41/d64/ff1 x:0 0 0 2024-09-18T21:12:56.762 INFO:tasks.workunit.client.1.smithi103.stdout:6/671: truncate d2/d24/d38/d68/fa6 629935 0 2024-09-18T21:12:56.762 INFO:tasks.workunit.client.1.smithi103.stdout:2/577: rmdir d3/d5/d25 39 2024-09-18T21:12:56.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:56 smithi103 ceph-mon[34827]: from='client.14654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:12:56.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:56 smithi103 ceph-mon[34827]: pgmap v19: 65 pgs: 65 active+clean; 2.5 GiB data, 9.0 GiB used, 527 GiB / 536 GiB avail; 101 MiB/s rd, 372 MiB/s wr, 640 op/s 2024-09-18T21:12:56.764 INFO:tasks.workunit.client.1.smithi103.stdout:2/578: readlink d3/d5/d2f/l83 0 2024-09-18T21:12:56.765 INFO:tasks.workunit.client.0.smithi077.stdout:2/630: dwrite d1/d4/d9/d80/d8e/f82 [0,4194304] 0 2024-09-18T21:12:56.765 INFO:tasks.workunit.client.1.smithi103.stdout:5/687: read de/d3e/f43 [3043561,65228] 0 2024-09-18T21:12:56.767 INFO:tasks.workunit.client.1.smithi103.stdout:6/672: write d2/d3/f48 [2570145,125742] 0 2024-09-18T21:12:56.767 INFO:tasks.workunit.client.0.smithi077.stdout:2/631: readlink d1/d4/d5/d1a/d2e/d40/l59 0 2024-09-18T21:12:56.767 INFO:tasks.workunit.client.0.smithi077.stdout:5/725: write d0/df/d3d/f9a [2808329,129498] 0 2024-09-18T21:12:56.771 INFO:tasks.workunit.client.1.smithi103.stdout:8/749: dread d4/d81/dd7/dde/f79 [0,4194304] 0 2024-09-18T21:12:56.772 INFO:tasks.workunit.client.0.smithi077.stdout:4/535: dread d3/dc/d32/f62 [0,4194304] 0 2024-09-18T21:12:56.773 INFO:tasks.workunit.client.1.smithi103.stdout:4/692: dwrite d9/d38/d72/df0/d61/f76 [0,4194304] 0 2024-09-18T21:12:56.773 INFO:tasks.workunit.client.1.smithi103.stdout:6/673: stat d2/d24/d38/c81 0 2024-09-18T21:12:56.774 INFO:tasks.workunit.client.0.smithi077.stdout:2/632: truncate d1/f92 949308 0 2024-09-18T21:12:56.777 INFO:tasks.workunit.client.1.smithi103.stdout:4/693: read d9/d38/d72/df0/d61/d91/d9e/f35 [3554010,56279] 0 2024-09-18T21:12:56.777 INFO:tasks.workunit.client.0.smithi077.stdout:5/726: creat d0/df/d10/d4b/d80/fec x:0 0 0 2024-09-18T21:12:56.778 INFO:tasks.workunit.client.0.smithi077.stdout:6/540: dwrite d7/d7e/d11/d1d/d49/d55/f68 [0,4194304] 0 2024-09-18T21:12:56.779 INFO:tasks.workunit.client.0.smithi077.stdout:4/536: chown d3/c15 736 1 2024-09-18T21:12:56.779 INFO:tasks.workunit.client.0.smithi077.stdout:5/727: write d0/d6/d3b/d64/fc6 [2976930,5109] 0 2024-09-18T21:12:56.781 INFO:tasks.workunit.client.1.smithi103.stdout:8/750: dwrite d4/d81/f95 [0,4194304] 0 2024-09-18T21:12:56.782 INFO:tasks.workunit.client.0.smithi077.stdout:5/728: truncate d0/d6/d3b/fc1 406457 0 2024-09-18T21:12:56.785 INFO:tasks.workunit.client.0.smithi077.stdout:7/647: dread d12/f9a [0,4194304] 0 2024-09-18T21:12:56.787 INFO:tasks.workunit.client.1.smithi103.stdout:5/688: fsync de/d1f/d3b/d58/dc4/d33/f46 0 2024-09-18T21:12:56.790 INFO:tasks.workunit.client.1.smithi103.stdout:6/674: fdatasync d2/d3/d8/d4c/d7d/f92 0 2024-09-18T21:12:56.792 INFO:tasks.workunit.client.0.smithi077.stdout:6/541: mknod d7/d7c/cb6 0 2024-09-18T21:12:56.794 INFO:tasks.workunit.client.1.smithi103.stdout:9/706: truncate fa 4575004 0 2024-09-18T21:12:56.795 INFO:tasks.workunit.client.0.smithi077.stdout:4/537: creat d3/d7/d73/fa7 x:0 0 0 2024-09-18T21:12:56.796 INFO:tasks.workunit.client.1.smithi103.stdout:8/751: mknod d4/d81/dd7/dde/d59/d9c/de6/cf3 0 2024-09-18T21:12:56.798 INFO:tasks.workunit.client.1.smithi103.stdout:8/752: chown d4/d26/d56/d77/d9f 13500699 1 2024-09-18T21:12:56.798 INFO:tasks.workunit.client.0.smithi077.stdout:5/729: chown d0/df/f1c 310424897 1 2024-09-18T21:12:56.799 INFO:tasks.workunit.client.0.smithi077.stdout:5/730: chown d0/df/d10/d5c/d74/d89 44 1 2024-09-18T21:12:56.799 INFO:tasks.workunit.client.1.smithi103.stdout:8/753: stat d4/d2d/d3d/da0/dab/de7/f8a 0 2024-09-18T21:12:56.800 INFO:tasks.workunit.client.0.smithi077.stdout:8/525: truncate d2/d5f/da8/d26/f84 1029724 0 2024-09-18T21:12:56.800 INFO:tasks.workunit.client.1.smithi103.stdout:9/707: dwrite d18/d29/d68/d78/fba [0,4194304] 0 2024-09-18T21:12:56.802 INFO:tasks.workunit.client.1.smithi103.stdout:8/754: chown d4/d81/dd7/dde/d59/d5e/c99 1970 1 2024-09-18T21:12:56.803 INFO:tasks.workunit.client.1.smithi103.stdout:9/708: chown d18/d52/d6f/d8e/d8f/dbd/dc3 4886 1 2024-09-18T21:12:56.804 INFO:tasks.workunit.client.1.smithi103.stdout:8/755: readlink d4/d81/dd7/dde/d59/d5e/l6d 0 2024-09-18T21:12:56.805 INFO:tasks.workunit.client.0.smithi077.stdout:7/648: chown d12/d22/d59/d72 59703246 1 2024-09-18T21:12:56.806 INFO:tasks.workunit.client.1.smithi103.stdout:6/675: creat d2/d3/d8/d4c/d79/fd3 x:0 0 0 2024-09-18T21:12:56.806 INFO:tasks.workunit.client.1.smithi103.stdout:6/676: chown d2/d24/d5a/d67 870 1 2024-09-18T21:12:56.807 INFO:tasks.workunit.client.0.smithi077.stdout:7/649: write d12/f45 [2545042,21271] 0 2024-09-18T21:12:56.810 INFO:tasks.workunit.client.1.smithi103.stdout:4/694: rename d9/d38/d72/df0/d83/db6/c28 to d9/d38/d72/d85/cf2 0 2024-09-18T21:12:56.811 INFO:tasks.workunit.client.1.smithi103.stdout:7/637: write d1/df/d42/d1f/d2e/d3f/f56 [181708,47201] 0 2024-09-18T21:12:56.812 INFO:tasks.workunit.client.0.smithi077.stdout:0/668: dwrite d8/f2f [0,4194304] 0 2024-09-18T21:12:56.813 INFO:tasks.workunit.client.1.smithi103.stdout:4/695: fsync d9/d38/d72/d85/dd8/f5c 0 2024-09-18T21:12:56.814 INFO:tasks.workunit.client.0.smithi077.stdout:4/538: mkdir d3/dc/d24/da8 0 2024-09-18T21:12:56.815 INFO:tasks.workunit.client.1.smithi103.stdout:2/579: dread d3/d5/d2c/d54/d68/f84 [0,4194304] 0 2024-09-18T21:12:56.815 INFO:tasks.workunit.client.0.smithi077.stdout:0/669: write d8/d1d/f68 [2539522,48210] 0 2024-09-18T21:12:56.816 INFO:tasks.workunit.client.0.smithi077.stdout:5/731: symlink d0/df/d10/d5c/d74/led 0 2024-09-18T21:12:56.823 INFO:tasks.workunit.client.1.smithi103.stdout:4/696: mknod d9/d38/d58/cf3 0 2024-09-18T21:12:56.823 INFO:tasks.workunit.client.0.smithi077.stdout:2/633: dwrite d1/d4/d5/f3a [0,4194304] 0 2024-09-18T21:12:56.824 INFO:tasks.workunit.client.1.smithi103.stdout:2/580: fdatasync d3/d5/d25/d98/fbb 0 2024-09-18T21:12:56.827 INFO:tasks.workunit.client.1.smithi103.stdout:8/756: creat d4/d2d/dc1/dee/ff4 x:0 0 0 2024-09-18T21:12:56.829 INFO:tasks.workunit.client.1.smithi103.stdout:6/677: mkdir d2/d24/d5a/d67/d76/d43/dd4 0 2024-09-18T21:12:56.829 INFO:tasks.workunit.client.1.smithi103.stdout:8/757: write d4/d26/d56/d77/d9f/fa6 [4768478,84904] 0 2024-09-18T21:12:56.831 INFO:tasks.workunit.client.0.smithi077.stdout:4/539: rename d3/d35/f56 to d3/dc/d32/d5b/fa9 0 2024-09-18T21:12:56.832 INFO:tasks.workunit.client.0.smithi077.stdout:4/540: fsync d3/d7/d73/f96 0 2024-09-18T21:12:56.833 INFO:tasks.workunit.client.1.smithi103.stdout:9/709: rename d18/d52/d5e/f5f to d18/d29/d68/d78/fee 0 2024-09-18T21:12:56.835 INFO:tasks.workunit.client.1.smithi103.stdout:4/697: symlink d9/d38/d72/d85/dd8/lf4 0 2024-09-18T21:12:56.837 INFO:tasks.workunit.client.1.smithi103.stdout:9/710: dread - d18/d52/d6f/d8e/db4/fdc zero size 2024-09-18T21:12:56.838 INFO:tasks.workunit.client.0.smithi077.stdout:4/541: dwrite d3/d7/f4f [0,4194304] 0 2024-09-18T21:12:56.840 INFO:tasks.workunit.client.0.smithi077.stdout:8/526: link d2/d5f/d6f/f95 d2/d5f/da8/d20/d3e/db4/fbf 0 2024-09-18T21:12:56.840 INFO:tasks.workunit.client.1.smithi103.stdout:5/689: dwrite de/d1f/d3b/d51/d57/d79/fa3 [0,4194304] 0 2024-09-18T21:12:56.841 INFO:tasks.workunit.client.0.smithi077.stdout:8/527: write d2/d5/f16 [94677,34132] 0 2024-09-18T21:12:56.843 INFO:tasks.workunit.client.1.smithi103.stdout:2/581: symlink d3/d5/d2c/d77/d9c/db8/ld2 0 2024-09-18T21:12:56.843 INFO:tasks.workunit.client.0.smithi077.stdout:5/732: read - d0/df/d10/d47/f93 zero size 2024-09-18T21:12:56.848 INFO:tasks.workunit.client.0.smithi077.stdout:2/634: unlink d1/d4/d5/d1a/d49/d6a/d81/dc4/fae 0 2024-09-18T21:12:56.850 INFO:tasks.workunit.client.0.smithi077.stdout:6/542: dwrite d7/d7e/d11/f19 [0,4194304] 0 2024-09-18T21:12:56.851 INFO:tasks.workunit.client.0.smithi077.stdout:3/551: sync 2024-09-18T21:12:56.851 INFO:tasks.workunit.client.0.smithi077.stdout:1/612: sync 2024-09-18T21:12:56.852 INFO:tasks.workunit.client.0.smithi077.stdout:2/635: write d1/d4/d5/d1a/d2e/d41/f9b [791046,92065] 0 2024-09-18T21:12:56.854 INFO:tasks.workunit.client.0.smithi077.stdout:3/552: write db/d14/d22/f9d [809171,118777] 0 2024-09-18T21:12:56.854 INFO:tasks.workunit.client.0.smithi077.stdout:1/613: read d3/d38/d97/f98 [1782911,6790] 0 2024-09-18T21:12:56.854 INFO:tasks.workunit.client.1.smithi103.stdout:7/638: rename d1/df/d43/d52/f99 to d1/df/d42/d29/d48/dbb/d33/d9d/fc8 0 2024-09-18T21:12:56.855 INFO:tasks.workunit.client.0.smithi077.stdout:6/543: write d7/d7e/d11/fa2 [27867,3691] 0 2024-09-18T21:12:56.857 INFO:tasks.workunit.client.0.smithi077.stdout:0/670: symlink d8/d1d/d57/dce/dcf/ld3 0 2024-09-18T21:12:56.858 INFO:tasks.workunit.client.0.smithi077.stdout:0/671: truncate d8/f3a 1276690 0 2024-09-18T21:12:56.859 INFO:tasks.workunit.client.0.smithi077.stdout:4/542: creat d3/dc/d32/d45/faa x:0 0 0 2024-09-18T21:12:56.860 INFO:tasks.workunit.client.1.smithi103.stdout:8/758: dread d4/d26/f4d [0,4194304] 0 2024-09-18T21:12:56.861 INFO:tasks.workunit.client.0.smithi077.stdout:1/614: read d3/d8/d93/dd3/f1a [1455871,64753] 0 2024-09-18T21:12:56.864 INFO:tasks.workunit.client.1.smithi103.stdout:2/582: creat d3/d5/d2f/d48/dab/fd3 x:0 0 0 2024-09-18T21:12:56.864 INFO:tasks.workunit.client.1.smithi103.stdout:7/639: dwrite d1/df/d43/d61/fa5 [0,4194304] 0 2024-09-18T21:12:56.865 INFO:tasks.workunit.client.0.smithi077.stdout:8/528: write d2/d5f/da8/d20/d3e/db4/fbf [376665,109400] 0 2024-09-18T21:12:56.865 INFO:tasks.workunit.client.1.smithi103.stdout:6/678: mknod d2/d3/d8/d4c/d79/d9e/cd5 0 2024-09-18T21:12:56.868 INFO:tasks.workunit.client.0.smithi077.stdout:5/733: creat d0/df/d3d/fee x:0 0 0 2024-09-18T21:12:56.868 INFO:tasks.workunit.client.1.smithi103.stdout:6/679: truncate d2/d3/d8/d4c/d79/f82 198552 0 2024-09-18T21:12:56.869 INFO:tasks.workunit.client.1.smithi103.stdout:4/698: mkdir d9/d38/d72/df0/d83/db6/df5 0 2024-09-18T21:12:56.871 INFO:tasks.workunit.client.0.smithi077.stdout:2/636: mknod d1/d4/d5/d1a/d2e/d41/d2c/cd3 0 2024-09-18T21:12:56.872 INFO:tasks.workunit.client.1.smithi103.stdout:5/690: creat de/d1f/d3b/d58/dd1/fe2 x:0 0 0 2024-09-18T21:12:56.874 INFO:tasks.workunit.client.1.smithi103.stdout:5/691: write de/d1f/d3b/d51/db0/fca [497943,42909] 0 2024-09-18T21:12:56.874 INFO:tasks.workunit.client.0.smithi077.stdout:2/637: truncate d1/d4/d5/d1a/d2e/d40/d69/fbe 855271 0 2024-09-18T21:12:56.875 INFO:tasks.workunit.client.0.smithi077.stdout:3/553: rename db/d14/d32/d49/da4/d71/d3b/c98 to db/d14/d22/d36/d39/d50/cb1 0 2024-09-18T21:12:56.876 INFO:tasks.workunit.client.1.smithi103.stdout:8/759: mknod d4/d2d/dc1/dee/cf5 0 2024-09-18T21:12:56.877 INFO:tasks.workunit.client.1.smithi103.stdout:8/760: chown d4/d2d/d4e/d73/fd4 1 1 2024-09-18T21:12:56.878 INFO:tasks.workunit.client.0.smithi077.stdout:0/672: creat d8/d1d/d57/fd4 x:0 0 0 2024-09-18T21:12:56.879 INFO:tasks.workunit.client.0.smithi077.stdout:4/543: symlink d3/dc/lab 0 2024-09-18T21:12:56.880 INFO:tasks.workunit.client.1.smithi103.stdout:7/640: creat d1/df/d43/db1/fc9 x:0 0 0 2024-09-18T21:12:56.881 INFO:tasks.workunit.client.0.smithi077.stdout:7/650: link d12/d31/d77/da0/fb1 d12/d22/d59/fdb 0 2024-09-18T21:12:56.882 INFO:tasks.workunit.client.1.smithi103.stdout:4/699: unlink d9/d38/d72/df0/d83/db6/d21/f88 0 2024-09-18T21:12:56.882 INFO:tasks.workunit.client.1.smithi103.stdout:7/641: dread - d1/df/d42/d29/d48/dbb/d33/fae zero size 2024-09-18T21:12:56.884 INFO:tasks.workunit.client.1.smithi103.stdout:4/700: dread - d9/d38/fe0 zero size 2024-09-18T21:12:56.884 INFO:tasks.workunit.client.1.smithi103.stdout:8/761: dwrite d4/d2d/d4e/d73/fd4 [0,4194304] 0 2024-09-18T21:12:56.885 INFO:tasks.workunit.client.0.smithi077.stdout:2/638: fdatasync d1/f1d 0 2024-09-18T21:12:56.886 INFO:tasks.workunit.client.1.smithi103.stdout:2/583: symlink d3/db3/ld4 0 2024-09-18T21:12:56.887 INFO:tasks.workunit.client.0.smithi077.stdout:5/734: rename d0/df/d10/d4b/d80/de9/ca6 to d0/d6/d3b/d64/d95/cef 0 2024-09-18T21:12:56.889 INFO:tasks.workunit.client.0.smithi077.stdout:0/673: dread - d8/d1a/d39/f6e zero size 2024-09-18T21:12:56.894 INFO:tasks.workunit.client.1.smithi103.stdout:7/642: dwrite d1/df/d42/d1f/d2e/f41 [0,4194304] 0 2024-09-18T21:12:56.894 INFO:tasks.workunit.client.0.smithi077.stdout:8/529: dread d2/d27/d29/f61 [0,4194304] 0 2024-09-18T21:12:56.894 INFO:tasks.workunit.client.0.smithi077.stdout:4/544: creat d3/d77/fac x:0 0 0 2024-09-18T21:12:56.903 INFO:tasks.workunit.client.1.smithi103.stdout:2/584: mkdir d3/d5/d25/dd5 0 2024-09-18T21:12:56.904 INFO:tasks.workunit.client.1.smithi103.stdout:7/643: dwrite d1/df/d42/d29/d48/dbb/f4f [0,4194304] 0 2024-09-18T21:12:56.905 INFO:tasks.workunit.client.0.smithi077.stdout:0/674: creat d8/d37/d66/d87/fd5 x:0 0 0 2024-09-18T21:12:56.907 INFO:tasks.workunit.client.1.smithi103.stdout:3/615: sync 2024-09-18T21:12:56.908 INFO:tasks.workunit.client.1.smithi103.stdout:4/701: truncate d9/d38/d72/df0/d61/d91/d9e/f35 1020619 0 2024-09-18T21:12:56.908 INFO:tasks.workunit.client.1.smithi103.stdout:6/680: link d2/d3/d8/f59 d2/d24/d5a/d67/fd6 0 2024-09-18T21:12:56.909 INFO:tasks.workunit.client.0.smithi077.stdout:8/530: rmdir d2/d5f/da8/d4f/d5a/d2a/d67 39 2024-09-18T21:12:56.909 INFO:tasks.workunit.client.1.smithi103.stdout:4/702: write d9/f6e [1879308,117988] 0 2024-09-18T21:12:56.912 INFO:tasks.workunit.client.0.smithi077.stdout:8/531: read d2/d5f/da8/d20/f56 [4315695,88587] 0 2024-09-18T21:12:56.912 INFO:tasks.workunit.client.0.smithi077.stdout:7/651: unlink d12/l18 0 2024-09-18T21:12:56.914 INFO:tasks.workunit.client.0.smithi077.stdout:4/545: dread d3/dc/d20/f3b [0,4194304] 0 2024-09-18T21:12:56.915 INFO:tasks.workunit.client.0.smithi077.stdout:2/639: truncate d1/d4/d5/d1a/d2e/f37 314372 0 2024-09-18T21:12:56.917 INFO:tasks.workunit.client.0.smithi077.stdout:0/675: fsync d8/d26/f15 0 2024-09-18T21:12:56.919 INFO:tasks.workunit.client.0.smithi077.stdout:1/615: getdents d3/d8/d49 0 2024-09-18T21:12:56.920 INFO:tasks.workunit.client.1.smithi103.stdout:4/703: fdatasync d9/d38/d72/df0/d83/fed 0 2024-09-18T21:12:56.921 INFO:tasks.workunit.client.1.smithi103.stdout:4/704: chown d9/d38/d72/df0/d83/db6/d21/f63 1795 1 2024-09-18T21:12:56.924 INFO:tasks.workunit.client.1.smithi103.stdout:3/616: unlink d1/l27 0 2024-09-18T21:12:56.925 INFO:tasks.workunit.client.0.smithi077.stdout:4/546: read - d3/dc/d51/d53/f58 zero size 2024-09-18T21:12:56.926 INFO:tasks.workunit.client.1.smithi103.stdout:3/617: chown d1/d23/d25/d4f/d58/d86 2015299 1 2024-09-18T21:12:56.928 INFO:tasks.workunit.client.0.smithi077.stdout:6/544: write d7/d7e/f1e [1083273,48163] 0 2024-09-18T21:12:56.929 INFO:tasks.workunit.client.1.smithi103.stdout:4/705: dwrite d9/d1c/d69/f71 [0,4194304] 0 2024-09-18T21:12:56.930 INFO:tasks.workunit.client.0.smithi077.stdout:0/676: creat d8/d1a/d39/d3b/d9a/fd6 x:0 0 0 2024-09-18T21:12:56.931 INFO:tasks.workunit.client.1.smithi103.stdout:2/585: dread d3/f9 [0,4194304] 0 2024-09-18T21:12:56.932 INFO:tasks.workunit.client.1.smithi103.stdout:3/618: symlink d1/da/df/lbf 0 2024-09-18T21:12:56.932 INFO:tasks.workunit.client.0.smithi077.stdout:0/677: write d8/d1a/d35/d6d/fc2 [1160371,102181] 0 2024-09-18T21:12:56.933 INFO:tasks.workunit.client.1.smithi103.stdout:3/619: chown d1/da/df/f14 6340004 1 2024-09-18T21:12:56.936 INFO:tasks.workunit.client.1.smithi103.stdout:7/644: dread d1/f5f [0,4194304] 0 2024-09-18T21:12:56.936 INFO:tasks.workunit.client.1.smithi103.stdout:2/586: fsync d3/fa5 0 2024-09-18T21:12:56.937 INFO:tasks.workunit.client.0.smithi077.stdout:5/735: link d0/df/fa7 d0/df/d10/d5c/d74/ff0 0 2024-09-18T21:12:56.938 INFO:tasks.workunit.client.0.smithi077.stdout:5/736: write d0/f78 [2807683,13669] 0 2024-09-18T21:12:56.939 INFO:tasks.workunit.client.1.smithi103.stdout:2/587: dread - d3/d5/d2f/fc5 zero size 2024-09-18T21:12:56.939 INFO:tasks.workunit.client.0.smithi077.stdout:8/532: link d2/d27/d29/d72/d81/fbb d2/d5f/da8/d4f/fc0 0 2024-09-18T21:12:56.941 INFO:tasks.workunit.client.1.smithi103.stdout:3/620: read d1/d23/d25/d4f/d58/d68/d50/d54/f9d [492286,54415] 0 2024-09-18T21:12:56.941 INFO:tasks.workunit.client.0.smithi077.stdout:2/640: dread d1/d4/d5/d1a/d2e/f7f [0,4194304] 0 2024-09-18T21:12:56.945 INFO:tasks.workunit.client.1.smithi103.stdout:5/692: dwrite de/d1f/d3b/d51/f64 [0,4194304] 0 2024-09-18T21:12:56.945 INFO:tasks.workunit.client.1.smithi103.stdout:7/645: symlink d1/df/d42/d1f/d5d/d85/db0/lca 0 2024-09-18T21:12:56.945 INFO:tasks.workunit.client.0.smithi077.stdout:6/545: dread d7/d7e/d11/d1d/f44 [0,4194304] 0 2024-09-18T21:12:56.948 INFO:tasks.workunit.client.0.smithi077.stdout:0/678: creat d8/d1d/d57/fd7 x:0 0 0 2024-09-18T21:12:56.950 INFO:tasks.workunit.client.0.smithi077.stdout:4/547: creat d3/dc/d51/d53/d89/fad x:0 0 0 2024-09-18T21:12:56.950 INFO:tasks.workunit.client.1.smithi103.stdout:7/646: fdatasync d1/df/d42/d29/faa 0 2024-09-18T21:12:56.952 INFO:tasks.workunit.client.0.smithi077.stdout:8/533: creat d2/d27/d29/d41/dbc/fc1 x:0 0 0 2024-09-18T21:12:56.955 INFO:tasks.workunit.client.1.smithi103.stdout:4/706: dread d9/d38/f45 [0,4194304] 0 2024-09-18T21:12:56.955 INFO:tasks.workunit.client.1.smithi103.stdout:2/588: dwrite d3/fbc [0,4194304] 0 2024-09-18T21:12:56.957 INFO:tasks.workunit.client.0.smithi077.stdout:6/546: rename d7/d7e/d11/d1d/f44 to d7/d7e/d11/d1d/d50/fb7 0 2024-09-18T21:12:56.959 INFO:tasks.workunit.client.1.smithi103.stdout:3/621: dwrite d1/d23/d25/d4f/d58/f6d [0,4194304] 0 2024-09-18T21:12:56.960 INFO:tasks.workunit.client.0.smithi077.stdout:4/548: symlink d3/dc/d51/lae 0 2024-09-18T21:12:56.963 INFO:tasks.workunit.client.1.smithi103.stdout:8/762: dwrite d4/d81/f92 [0,4194304] 0 2024-09-18T21:12:56.964 INFO:tasks.workunit.client.0.smithi077.stdout:2/641: creat d1/d4/d5/d1a/d2e/d41/d2c/dab/fd4 x:0 0 0 2024-09-18T21:12:56.968 INFO:tasks.workunit.client.1.smithi103.stdout:2/589: creat d3/d5/d2c/fd6 x:0 0 0 2024-09-18T21:12:56.969 INFO:tasks.workunit.client.0.smithi077.stdout:0/679: mknod d8/d37/cd8 0 2024-09-18T21:12:56.970 INFO:tasks.workunit.client.0.smithi077.stdout:4/549: dwrite d3/dc/d51/d53/d89/fad [0,4194304] 0 2024-09-18T21:12:56.971 INFO:tasks.workunit.client.0.smithi077.stdout:7/652: dwrite d12/d31/f54 [0,4194304] 0 2024-09-18T21:12:56.974 INFO:tasks.workunit.client.1.smithi103.stdout:6/681: dwrite d2/d3/d8/f10 [4194304,4194304] 0 2024-09-18T21:12:56.977 INFO:tasks.workunit.client.0.smithi077.stdout:1/616: write d3/d6a/d9b/f31 [934833,22230] 0 2024-09-18T21:12:56.978 INFO:tasks.workunit.client.1.smithi103.stdout:5/693: rename de/d3e/f2f to de/d1f/d3b/d51/d57/fe3 0 2024-09-18T21:12:56.979 INFO:tasks.workunit.client.0.smithi077.stdout:2/642: symlink d1/d4/d9/d80/d95/ld5 0 2024-09-18T21:12:56.981 INFO:tasks.workunit.client.1.smithi103.stdout:8/763: creat d4/d2d/d4e/ff6 x:0 0 0 2024-09-18T21:12:56.982 INFO:tasks.workunit.client.1.smithi103.stdout:6/682: chown d2/d24/d5a/d67/d76/l33 28999 1 2024-09-18T21:12:56.983 INFO:tasks.workunit.client.0.smithi077.stdout:7/653: dwrite d12/d56/da1/db6/dbd/fd9 [0,4194304] 0 2024-09-18T21:12:56.983 INFO:tasks.workunit.client.1.smithi103.stdout:3/622: dwrite d1/d2/f4b [0,4194304] 0 2024-09-18T21:12:56.983 INFO:tasks.workunit.client.1.smithi103.stdout:3/623: chown d1 8606794 1 2024-09-18T21:12:56.987 INFO:tasks.workunit.client.1.smithi103.stdout:7/647: rename d1/df/d42/d1f/d2e/fc0 to d1/df/d44/dba/fcb 0 2024-09-18T21:12:56.992 INFO:tasks.workunit.client.1.smithi103.stdout:8/764: rmdir d4/d26/d56 39 2024-09-18T21:12:56.994 INFO:tasks.workunit.client.0.smithi077.stdout:7/654: dwrite d12/d22/d59/d5a/f69 [0,4194304] 0 2024-09-18T21:12:56.998 INFO:tasks.workunit.client.1.smithi103.stdout:6/683: chown d2/d3/f74 2186916 1 2024-09-18T21:12:57.002 INFO:tasks.workunit.client.1.smithi103.stdout:7/648: rename d1/df/d42/d29/d48/f77 to d1/df/d43/d52/d95/fcc 0 2024-09-18T21:12:57.002 INFO:tasks.workunit.client.1.smithi103.stdout:6/684: write d2/d3/d8/d4c/d79/fd3 [898896,93932] 0 2024-09-18T21:12:57.003 INFO:tasks.workunit.client.1.smithi103.stdout:5/694: symlink de/d1f/d3b/dcd/le4 0 2024-09-18T21:12:57.004 INFO:tasks.workunit.client.0.smithi077.stdout:6/547: getdents d7/d7e/d11/d3e/d42/d88/da4 0 2024-09-18T21:12:57.004 INFO:tasks.workunit.client.0.smithi077.stdout:2/643: truncate d1/f92 364391 0 2024-09-18T21:12:57.007 INFO:tasks.workunit.client.0.smithi077.stdout:0/680: dwrite d8/d1a/d39/d3b/d79/fae [0,4194304] 0 2024-09-18T21:12:57.007 INFO:tasks.workunit.client.0.smithi077.stdout:7/655: dwrite d12/d22/d59/f79 [0,4194304] 0 2024-09-18T21:12:57.008 INFO:tasks.workunit.client.1.smithi103.stdout:5/695: readlink de/d1f/d3b/d51/d57/d79/ld5 0 2024-09-18T21:12:57.009 INFO:tasks.workunit.client.1.smithi103.stdout:3/624: link d1/d23/d25/d4f/d72/d7e/l88 d1/d23/d25/d4f/d58/d68/d50/d54/d8c/lc0 0 2024-09-18T21:12:57.010 INFO:tasks.workunit.client.0.smithi077.stdout:6/548: fdatasync d7/d7e/d11/f45 0 2024-09-18T21:12:57.010 INFO:tasks.workunit.client.0.smithi077.stdout:2/644: creat d1/d4/d9/d80/d8e/fd6 x:0 0 0 2024-09-18T21:12:57.012 INFO:tasks.workunit.client.0.smithi077.stdout:7/656: truncate d12/d31/f48 4934821 0 2024-09-18T21:12:57.014 INFO:tasks.workunit.client.1.smithi103.stdout:3/625: dread - d1/d2/d18/fbc zero size 2024-09-18T21:12:57.016 INFO:tasks.workunit.client.0.smithi077.stdout:7/657: fsync d12/d22/d59/d5a/f8a 0 2024-09-18T21:12:57.017 INFO:tasks.workunit.client.1.smithi103.stdout:6/685: getdents d2/d24/d5a/d67/d76 0 2024-09-18T21:12:57.017 INFO:tasks.workunit.client.1.smithi103.stdout:8/765: dwrite d4/d26/d56/fc2 [0,4194304] 0 2024-09-18T21:12:57.018 INFO:tasks.workunit.client.1.smithi103.stdout:3/626: mkdir d1/da/df/d70/dc1 0 2024-09-18T21:12:57.018 INFO:tasks.workunit.client.0.smithi077.stdout:1/617: dread d3/d8/f59 [0,4194304] 0 2024-09-18T21:12:57.020 INFO:tasks.workunit.client.0.smithi077.stdout:1/618: chown d3/d6a/d9b/d68/f9d 2425163 1 2024-09-18T21:12:57.021 INFO:tasks.workunit.client.1.smithi103.stdout:4/707: dread d9/d38/d72/df0/d83/db6/d41/d64/fc5 [0,4194304] 0 2024-09-18T21:12:57.022 INFO:tasks.workunit.client.0.smithi077.stdout:6/549: rename d7/d7e/d11/d1d/f53 to d7/d7e/d11/d1d/d49/d96/fb8 0 2024-09-18T21:12:57.028 INFO:tasks.workunit.client.0.smithi077.stdout:6/550: fdatasync d7/d7e/f15 0 2024-09-18T21:12:57.028 INFO:tasks.workunit.client.1.smithi103.stdout:6/686: rename d2/d24/d38/f8f to d2/d3/d7f/d91/fd7 0 2024-09-18T21:12:57.029 INFO:tasks.workunit.client.1.smithi103.stdout:7/649: dread d1/df/d43/d52/f75 [0,4194304] 0 2024-09-18T21:12:57.031 INFO:tasks.workunit.client.1.smithi103.stdout:4/708: creat d9/d38/d72/d85/ff6 x:0 0 0 2024-09-18T21:12:57.032 INFO:tasks.workunit.client.1.smithi103.stdout:8/766: rename d4/d81/dd7/dde/d59/d5e/f85 to d4/d2d/d4e/d73/ff7 0 2024-09-18T21:12:57.033 INFO:tasks.workunit.client.1.smithi103.stdout:7/650: fdatasync d1/df/f22 0 2024-09-18T21:12:57.034 INFO:tasks.workunit.client.0.smithi077.stdout:0/681: dread d8/d26/f11 [0,4194304] 0 2024-09-18T21:12:57.034 INFO:tasks.workunit.client.1.smithi103.stdout:6/687: readlink d2/d24/d38/d68/d7c/lb5 0 2024-09-18T21:12:57.034 INFO:tasks.workunit.client.1.smithi103.stdout:0/628: sync 2024-09-18T21:12:57.035 INFO:tasks.workunit.client.1.smithi103.stdout:8/767: write d4/d2d/d4e/ff6 [346282,76490] 0 2024-09-18T21:12:57.036 INFO:tasks.workunit.client.1.smithi103.stdout:4/709: symlink d9/d38/d72/d85/lf7 0 2024-09-18T21:12:57.036 INFO:tasks.workunit.client.0.smithi077.stdout:6/551: link d7/d7e/d11/d3e/d42/la3 d7/d7e/d11/d9a/lb9 0 2024-09-18T21:12:57.037 INFO:tasks.workunit.client.1.smithi103.stdout:3/627: dread d1/d2/d18/d30/d4e/f84 [0,4194304] 0 2024-09-18T21:12:57.037 INFO:tasks.workunit.client.1.smithi103.stdout:7/651: symlink d1/df/d43/d52/lcd 0 2024-09-18T21:12:57.040 INFO:tasks.workunit.client.1.smithi103.stdout:5/696: rename de/d1f/d3b/d58/dc4/d33/f9a to de/d1f/d3b/d58/dc4/d33/fe5 0 2024-09-18T21:12:57.040 INFO:tasks.workunit.client.0.smithi077.stdout:6/552: stat d7/d7e/d11/d9a/ca1 0 2024-09-18T21:12:57.042 INFO:tasks.workunit.client.0.smithi077.stdout:6/553: chown d7/d7e/d11/d1d/d4c/l61 41235412 1 2024-09-18T21:12:57.043 INFO:tasks.workunit.client.1.smithi103.stdout:0/629: creat d1/daf/fdf x:0 0 0 2024-09-18T21:12:57.045 INFO:tasks.workunit.client.1.smithi103.stdout:4/710: mkdir d9/d1c/d69/df8 0 2024-09-18T21:12:57.045 INFO:tasks.workunit.client.0.smithi077.stdout:8/534: write d2/d5f/da8/d26/f39 [2953639,12738] 0 2024-09-18T21:12:57.045 INFO:tasks.workunit.client.0.smithi077.stdout:6/554: readlink d7/d7e/d11/d3e/l4a 0 2024-09-18T21:12:57.048 INFO:tasks.workunit.client.0.smithi077.stdout:8/535: unlink d2/lb 0 2024-09-18T21:12:57.049 INFO:tasks.workunit.client.0.smithi077.stdout:6/555: creat d7/d7e/d11/d1d/d49/d96/fba x:0 0 0 2024-09-18T21:12:57.051 INFO:tasks.workunit.client.0.smithi077.stdout:8/536: mkdir d2/d27/d29/d41/dc2 0 2024-09-18T21:12:57.052 INFO:tasks.workunit.client.1.smithi103.stdout:8/768: symlink d4/ddf/lf8 0 2024-09-18T21:12:57.052 INFO:tasks.workunit.client.1.smithi103.stdout:0/630: chown d1/d9/f52 13298828 1 2024-09-18T21:12:57.053 INFO:tasks.workunit.client.1.smithi103.stdout:4/711: rmdir d9/d38/d72/df0/d83/db6 39 2024-09-18T21:12:57.054 INFO:tasks.workunit.client.1.smithi103.stdout:0/631: chown d1/d9/f52 68739020 1 2024-09-18T21:12:57.054 INFO:tasks.workunit.client.1.smithi103.stdout:7/652: creat d1/df/dc7/fce x:0 0 0 2024-09-18T21:12:57.055 INFO:tasks.workunit.client.1.smithi103.stdout:5/697: creat de/d1f/d3b/d58/dc4/d33/d4f/fe6 x:0 0 0 2024-09-18T21:12:57.055 INFO:tasks.workunit.client.1.smithi103.stdout:4/712: write d9/d38/fe0 [654184,108732] 0 2024-09-18T21:12:57.055 INFO:tasks.workunit.client.1.smithi103.stdout:8/769: fdatasync d4/d2d/d3d/da0/dab/de7/f8a 0 2024-09-18T21:12:57.056 INFO:tasks.workunit.client.0.smithi077.stdout:8/537: dwrite d2/d5/f16 [0,4194304] 0 2024-09-18T21:12:57.056 INFO:tasks.workunit.client.0.smithi077.stdout:8/538: readlink d2/l74 0 2024-09-18T21:12:57.056 INFO:tasks.workunit.client.1.smithi103.stdout:5/698: chown de/d1f 16167237 1 2024-09-18T21:12:57.057 INFO:tasks.workunit.client.0.smithi077.stdout:8/539: write d2/d5f/da8/d26/fba [976008,5449] 0 2024-09-18T21:12:57.059 INFO:tasks.workunit.client.1.smithi103.stdout:8/770: rmdir d4/d98 39 2024-09-18T21:12:57.061 INFO:tasks.workunit.client.1.smithi103.stdout:8/771: dread - d4/d2d/d4e/fd8 zero size 2024-09-18T21:12:57.061 INFO:tasks.workunit.client.1.smithi103.stdout:5/699: mkdir de/d1f/d3b/d51/de7 0 2024-09-18T21:12:57.061 INFO:tasks.workunit.client.0.smithi077.stdout:9/565: sync 2024-09-18T21:12:57.064 INFO:tasks.workunit.client.0.smithi077.stdout:8/540: dwrite d2/d5f/da8/d20/d3e/db4/fbf [0,4194304] 0 2024-09-18T21:12:57.064 INFO:tasks.workunit.client.1.smithi103.stdout:8/772: dread - d4/de/fef zero size 2024-09-18T21:12:57.065 INFO:tasks.workunit.client.1.smithi103.stdout:4/713: creat d9/d38/d72/df0/d83/db6/ff9 x:0 0 0 2024-09-18T21:12:57.066 INFO:tasks.workunit.client.0.smithi077.stdout:9/566: creat d1/dd/d1a/d42/d4b/fbb x:0 0 0 2024-09-18T21:12:57.067 INFO:tasks.workunit.client.0.smithi077.stdout:9/567: fdatasync d1/d54/f12 0 2024-09-18T21:12:57.068 INFO:tasks.workunit.client.1.smithi103.stdout:0/632: dwrite d1/d5/de/d19/d1e/d34/f69 [0,4194304] 0 2024-09-18T21:12:57.068 INFO:tasks.workunit.client.0.smithi077.stdout:8/541: symlink d2/d27/d29/d41/dbc/lc3 0 2024-09-18T21:12:57.070 INFO:tasks.workunit.client.0.smithi077.stdout:8/542: write d2/d5f/da8/d4f/f69 [165297,110028] 0 2024-09-18T21:12:57.071 INFO:tasks.workunit.client.0.smithi077.stdout:8/543: chown d2/d5f/da8/d4f/f5d 487790200 1 2024-09-18T21:12:57.073 INFO:tasks.workunit.client.0.smithi077.stdout:9/568: symlink d1/d54/d51/da3/lbc 0 2024-09-18T21:12:57.074 INFO:tasks.workunit.client.1.smithi103.stdout:8/773: dread d4/d2d/d3d/da0/dab/de7/fb5 [0,4194304] 0 2024-09-18T21:12:57.074 INFO:tasks.workunit.client.1.smithi103.stdout:5/700: mkdir de/d1f/d3b/d51/d57/dc8/de8 0 2024-09-18T21:12:57.074 INFO:tasks.workunit.client.0.smithi077.stdout:9/569: readlink d1/l78 0 2024-09-18T21:12:57.074 INFO:tasks.workunit.client.1.smithi103.stdout:4/714: mkdir d9/d38/d72/df0/d61/dfa 0 2024-09-18T21:12:57.076 INFO:tasks.workunit.client.1.smithi103.stdout:0/633: rename d1/d5/de/d19/fa6 to d1/d93/fe0 0 2024-09-18T21:12:57.077 INFO:tasks.workunit.client.1.smithi103.stdout:4/715: stat d9/d38/d72/df0/d83/db6/d21/c75 0 2024-09-18T21:12:57.077 INFO:tasks.workunit.client.0.smithi077.stdout:8/544: symlink d2/d27/d29/d72/d81/lc4 0 2024-09-18T21:12:57.077 INFO:tasks.workunit.client.1.smithi103.stdout:4/716: stat d9/d38/d72/d85 0 2024-09-18T21:12:57.078 INFO:tasks.workunit.client.1.smithi103.stdout:8/774: mknod d4/de/cf9 0 2024-09-18T21:12:57.081 INFO:tasks.workunit.client.0.smithi077.stdout:8/545: dread d2/d5/f16 [0,4194304] 0 2024-09-18T21:12:57.083 INFO:tasks.workunit.client.1.smithi103.stdout:5/701: creat de/d1f/d3b/d51/de7/fe9 x:0 0 0 2024-09-18T21:12:57.084 INFO:tasks.workunit.client.1.smithi103.stdout:4/717: symlink d9/de3/lfb 0 2024-09-18T21:12:57.085 INFO:tasks.workunit.client.1.smithi103.stdout:0/634: creat d1/d5/de/dc0/dbf/fe1 x:0 0 0 2024-09-18T21:12:57.087 INFO:tasks.workunit.client.1.smithi103.stdout:4/718: chown d9/d38/d72/df0/d83/db6/d21/f63 21 1 2024-09-18T21:12:57.088 INFO:tasks.workunit.client.1.smithi103.stdout:0/635: chown d1/d5/de/dc0/d8c/dce/d9f/d4f/d68/cd6 30 1 2024-09-18T21:12:57.089 INFO:tasks.workunit.client.1.smithi103.stdout:4/719: chown d9/d38/fe0 23719 1 2024-09-18T21:12:57.089 INFO:tasks.workunit.client.1.smithi103.stdout:2/590: write d3/d5/d2f/d32/f60 [522690,20698] 0 2024-09-18T21:12:57.091 INFO:tasks.workunit.client.1.smithi103.stdout:0/636: symlink d1/d5/de/d19/le2 0 2024-09-18T21:12:57.091 INFO:tasks.workunit.client.0.smithi077.stdout:4/550: truncate d3/f63 5587 0 2024-09-18T21:12:57.091 INFO:tasks.workunit.client.1.smithi103.stdout:7/653: dread d1/df/d42/d29/d48/dbb/d33/fb3 [0,4194304] 0 2024-09-18T21:12:57.092 INFO:tasks.workunit.client.0.smithi077.stdout:4/551: chown d3/dc/la5 7448214 1 2024-09-18T21:12:57.092 INFO:tasks.workunit.client.1.smithi103.stdout:4/720: mkdir d9/d38/d72/df0/d83/db6/d41/dfc 0 2024-09-18T21:12:57.093 INFO:tasks.workunit.client.0.smithi077.stdout:4/552: mknod d3/dc/d51/caf 0 2024-09-18T21:12:57.095 INFO:tasks.workunit.client.1.smithi103.stdout:2/591: rename d3/d5/d2c/d77/d9c/db7 to d3/d5/d2f/d32/d90/dd7 0 2024-09-18T21:12:57.097 INFO:tasks.workunit.client.1.smithi103.stdout:1/609: sync 2024-09-18T21:12:57.099 INFO:tasks.workunit.client.1.smithi103.stdout:1/610: dread - d0/d2/d2b/d3a/d42/d72/db0/da7/fb9 zero size 2024-09-18T21:12:57.099 INFO:tasks.workunit.client.1.smithi103.stdout:4/721: creat d9/d1c/dcd/dd1/ffd x:0 0 0 2024-09-18T21:12:57.102 INFO:tasks.workunit.client.1.smithi103.stdout:4/722: unlink f3 0 2024-09-18T21:12:57.102 INFO:tasks.workunit.client.1.smithi103.stdout:0/637: dwrite d1/d5/de/dc0/dbf/fa4 [4194304,4194304] 0 2024-09-18T21:12:57.106 INFO:tasks.workunit.client.1.smithi103.stdout:4/723: dread d9/d38/d58/fbb [0,4194304] 0 2024-09-18T21:12:57.108 INFO:tasks.workunit.client.1.smithi103.stdout:1/611: creat d0/d11/fda x:0 0 0 2024-09-18T21:12:57.112 INFO:tasks.workunit.client.1.smithi103.stdout:4/724: mknod d9/d38/d72/df0/d61/d91/d9e/d48/cfe 0 2024-09-18T21:12:57.113 INFO:tasks.workunit.client.1.smithi103.stdout:1/612: stat d0/d2/d9/d10/ccb 0 2024-09-18T21:12:57.114 INFO:tasks.workunit.client.0.smithi077.stdout:7/658: write d12/d31/f7e [4245996,118571] 0 2024-09-18T21:12:57.115 INFO:tasks.workunit.client.1.smithi103.stdout:0/638: link d1/d5/de/d24/d43/d81/l92 d1/d5/de/d24/d43/d76/dc5/le3 0 2024-09-18T21:12:57.115 INFO:tasks.workunit.client.1.smithi103.stdout:1/613: write d0/d2/d9/dc/d36/fb3 [919122,37774] 0 2024-09-18T21:12:57.116 INFO:tasks.workunit.client.1.smithi103.stdout:5/702: dread de/d2d/f75 [0,4194304] 0 2024-09-18T21:12:57.117 INFO:tasks.workunit.client.1.smithi103.stdout:4/725: read d9/d38/d72/d85/dd8/f44 [2166957,2017] 0 2024-09-18T21:12:57.117 INFO:tasks.workunit.client.1.smithi103.stdout:1/614: chown d0/d3/d68/d81 231 1 2024-09-18T21:12:57.118 INFO:tasks.workunit.client.0.smithi077.stdout:1/619: write d3/d6a/d9b/d4c/fae [1550665,84444] 0 2024-09-18T21:12:57.118 INFO:tasks.workunit.client.0.smithi077.stdout:7/659: truncate d12/d22/d59/d72/f9b 33641 0 2024-09-18T21:12:57.119 INFO:tasks.workunit.client.0.smithi077.stdout:2/645: dwrite d1/d4/d5/d1a/d2e/f34 [0,4194304] 0 2024-09-18T21:12:57.121 INFO:tasks.workunit.client.1.smithi103.stdout:1/615: truncate d0/d3/d68/d81/da2/da4/dc2/dd8/fb6 509176 0 2024-09-18T21:12:57.124 INFO:tasks.workunit.client.1.smithi103.stdout:5/703: unlink de/d1f/d3b/d58/dc4/d33/d4f/fe6 0 2024-09-18T21:12:57.125 INFO:tasks.workunit.client.1.smithi103.stdout:5/704: fdatasync de/d1f/d3b/d51/d57/d79/fa3 0 2024-09-18T21:12:57.126 INFO:tasks.workunit.client.0.smithi077.stdout:2/646: symlink d1/d4/d5/d1a/d2e/d41/d2c/dab/ld7 0 2024-09-18T21:12:57.127 INFO:tasks.workunit.client.0.smithi077.stdout:2/647: dread - d1/d4/d5/d1a/d2e/d41/d2c/dab/fd4 zero size 2024-09-18T21:12:57.128 INFO:tasks.workunit.client.1.smithi103.stdout:4/726: truncate d9/d38/d72/df0/d83/db6/d21/f33 1361890 0 2024-09-18T21:12:57.129 INFO:tasks.workunit.client.0.smithi077.stdout:0/682: write d8/fa7 [1083057,36612] 0 2024-09-18T21:12:57.129 INFO:tasks.workunit.client.1.smithi103.stdout:4/727: write d9/d38/d72/df0/d61/d91/daa/fc0 [397134,65806] 0 2024-09-18T21:12:57.131 INFO:tasks.workunit.client.1.smithi103.stdout:4/728: chown d9/f6e 1170868 1 2024-09-18T21:12:57.132 INFO:tasks.workunit.client.1.smithi103.stdout:4/729: write d9/d38/d72/df0/d83/db6/d41/fa5 [2369972,71446] 0 2024-09-18T21:12:57.137 INFO:tasks.workunit.client.1.smithi103.stdout:5/705: rename de/d1f/d3b/d58/dc4/f18 to de/d1f/d3b/d58/dc4/d33/d4f/fea 0 2024-09-18T21:12:57.138 INFO:tasks.workunit.client.1.smithi103.stdout:6/688: write d2/d3/d8/f59 [598115,30172] 0 2024-09-18T21:12:57.138 INFO:tasks.workunit.client.0.smithi077.stdout:1/620: getdents d3/d6a/d9b/d68 0 2024-09-18T21:12:57.139 INFO:tasks.workunit.client.1.smithi103.stdout:3/628: dwrite d1/f2e [0,4194304] 0 2024-09-18T21:12:57.139 INFO:tasks.workunit.client.0.smithi077.stdout:7/660: dread d12/d31/d77/d93/f88 [0,4194304] 0 2024-09-18T21:12:57.140 INFO:tasks.workunit.client.0.smithi077.stdout:1/621: chown d3/d8/d93/dd3/f91 74118166 1 2024-09-18T21:12:57.144 INFO:tasks.workunit.client.1.smithi103.stdout:4/730: symlink d9/d38/d72/df0/lff 0 2024-09-18T21:12:57.146 INFO:tasks.workunit.client.1.smithi103.stdout:0/639: getdents d1/d5/de/dc0/d8c 0 2024-09-18T21:12:57.146 INFO:tasks.workunit.client.1.smithi103.stdout:0/640: stat d1/d5/de/d19/d1e/d34/f45 0 2024-09-18T21:12:57.149 INFO:tasks.workunit.client.1.smithi103.stdout:5/706: unlink de/d1f/d3b/d58/dc4/l42 0 2024-09-18T21:12:57.152 INFO:tasks.workunit.client.1.smithi103.stdout:6/689: truncate d2/f22 215974 0 2024-09-18T21:12:57.157 INFO:tasks.workunit.client.1.smithi103.stdout:4/731: creat d9/d38/d72/df0/f100 x:0 0 0 2024-09-18T21:12:57.157 INFO:tasks.workunit.client.0.smithi077.stdout:2/648: link d1/d4/d5/d1a/d2e/c46 d1/d4/d5/d1a/d2e/cd8 0 2024-09-18T21:12:57.158 INFO:tasks.workunit.client.1.smithi103.stdout:4/732: write d9/d1c/d77/f59 [430341,108796] 0 2024-09-18T21:12:57.159 INFO:tasks.workunit.client.1.smithi103.stdout:0/641: write d1/d9/f54 [884288,72996] 0 2024-09-18T21:12:57.159 INFO:tasks.workunit.client.0.smithi077.stdout:8/546: truncate d2/d5/f16 3673981 0 2024-09-18T21:12:57.160 INFO:tasks.workunit.client.0.smithi077.stdout:1/622: link d3/d8/d13/f2b d3/d8/d93/fda 0 2024-09-18T21:12:57.160 INFO:tasks.workunit.client.0.smithi077.stdout:8/547: fsync d2/d27/d29/f90 0 2024-09-18T21:12:57.161 INFO:tasks.workunit.client.0.smithi077.stdout:9/570: truncate d1/d54/d27/f39 1914294 0 2024-09-18T21:12:57.161 INFO:tasks.workunit.client.1.smithi103.stdout:4/733: truncate d9/d38/d72/df0/d83/fed 900174 0 2024-09-18T21:12:57.162 INFO:tasks.workunit.client.0.smithi077.stdout:1/623: truncate d3/d6a/d9b/f31 970415 0 2024-09-18T21:12:57.164 INFO:tasks.workunit.client.1.smithi103.stdout:8/775: truncate d4/de/fbc 369203 0 2024-09-18T21:12:57.165 INFO:tasks.workunit.client.0.smithi077.stdout:7/661: rename d12/d31/d77/d93/d89/d99/da9/fc5 to d12/d22/d59/fdc 0 2024-09-18T21:12:57.167 INFO:tasks.workunit.client.1.smithi103.stdout:1/616: getdents d0/d3/d68/d81 0 2024-09-18T21:12:57.169 INFO:tasks.workunit.client.1.smithi103.stdout:6/690: dread d2/d24/fb6 [0,4194304] 0 2024-09-18T21:12:57.170 INFO:tasks.workunit.client.1.smithi103.stdout:5/707: dwrite de/d1f/d3b/d58/dc4/f22 [0,4194304] 0 2024-09-18T21:12:57.170 INFO:tasks.workunit.client.0.smithi077.stdout:2/649: dread d1/d4/d9/fb [0,4194304] 0 2024-09-18T21:12:57.170 INFO:tasks.workunit.client.0.smithi077.stdout:9/571: rmdir d1/dd/d11/d1c/d38/d46 39 2024-09-18T21:12:57.171 INFO:tasks.workunit.client.0.smithi077.stdout:2/650: truncate d1/d62/f94 724920 0 2024-09-18T21:12:57.172 INFO:tasks.workunit.client.0.smithi077.stdout:9/572: truncate d1/dd/d11/d72/f98 461277 0 2024-09-18T21:12:57.174 INFO:tasks.workunit.client.1.smithi103.stdout:6/691: stat d2/d24/d5a/d67/d76/c6c 0 2024-09-18T21:12:57.174 INFO:tasks.workunit.client.1.smithi103.stdout:5/708: fdatasync de/d3e/d15/f2e 0 2024-09-18T21:12:57.174 INFO:tasks.workunit.client.0.smithi077.stdout:1/624: rename d3/d6a/d9b/d7f/l85 to d3/d8/d49/d4e/ldb 0 2024-09-18T21:12:57.175 INFO:tasks.workunit.client.1.smithi103.stdout:8/776: dread d4/d81/f92 [0,4194304] 0 2024-09-18T21:12:57.177 INFO:tasks.workunit.client.0.smithi077.stdout:7/662: creat d12/d56/da1/db6/dbd/fdd x:0 0 0 2024-09-18T21:12:57.178 INFO:tasks.workunit.client.1.smithi103.stdout:0/642: dread d1/f9a [0,4194304] 0 2024-09-18T21:12:57.179 INFO:tasks.workunit.client.0.smithi077.stdout:8/548: creat d2/d5f/da8/d20/d3e/db4/fc5 x:0 0 0 2024-09-18T21:12:57.179 INFO:tasks.workunit.client.0.smithi077.stdout:7/663: chown d12/d31/d77/d93/d2a/d7f/ca4 930 1 2024-09-18T21:12:57.182 INFO:tasks.workunit.client.0.smithi077.stdout:7/664: read d12/d22/d59/d5a/f8c [4163487,20306] 0 2024-09-18T21:12:57.182 INFO:tasks.workunit.client.0.smithi077.stdout:4/553: dwrite d3/dc/d32/d5b/fa9 [0,4194304] 0 2024-09-18T21:12:57.186 INFO:tasks.workunit.client.1.smithi103.stdout:7/654: dwrite d1/df/d42/d29/d48/dbb/d33/f6f [0,4194304] 0 2024-09-18T21:12:57.187 INFO:tasks.workunit.client.1.smithi103.stdout:7/655: chown d1/df/d42/d29 469914 1 2024-09-18T21:12:57.191 INFO:tasks.workunit.client.0.smithi077.stdout:2/651: mknod d1/d4/d5/d1a/d2e/cd9 0 2024-09-18T21:12:57.191 INFO:tasks.workunit.client.1.smithi103.stdout:8/777: dwrite d4/d81/d71/f84 [0,4194304] 0 2024-09-18T21:12:57.197 INFO:tasks.workunit.client.1.smithi103.stdout:6/692: dread d2/d3/d8/d4c/d4e/f9a [0,4194304] 0 2024-09-18T21:12:57.198 INFO:tasks.workunit.client.0.smithi077.stdout:7/665: write d12/d31/d77/d93/d2a/d6c/fcf [967285,4727] 0 2024-09-18T21:12:57.201 INFO:tasks.workunit.client.0.smithi077.stdout:9/573: mkdir d1/dd/d11/d1c/d38/d46/d55/d9c/dbd 0 2024-09-18T21:12:57.204 INFO:tasks.workunit.client.0.smithi077.stdout:0/683: dwrite d8/d1a/d39/f3c [0,4194304] 0 2024-09-18T21:12:57.205 INFO:tasks.workunit.client.0.smithi077.stdout:0/684: write d8/d1a/f20 [3822871,37783] 0 2024-09-18T21:12:57.207 INFO:tasks.workunit.client.1.smithi103.stdout:1/617: dread d0/d2/d9/dc/f15 [0,4194304] 0 2024-09-18T21:12:57.207 INFO:tasks.workunit.client.1.smithi103.stdout:1/618: stat d0/c4 0 2024-09-18T21:12:57.208 INFO:tasks.workunit.client.1.smithi103.stdout:7/656: creat d1/df/d43/d61/fcf x:0 0 0 2024-09-18T21:12:57.210 INFO:tasks.workunit.client.1.smithi103.stdout:3/629: write d1/f75 [1283970,29349] 0 2024-09-18T21:12:57.211 INFO:tasks.workunit.client.1.smithi103.stdout:3/630: readlink d1/d23/d25/da1/da5/lb5 0 2024-09-18T21:12:57.212 INFO:tasks.workunit.client.0.smithi077.stdout:4/554: rename d3/dc/d20/f29 to d3/dc/fb0 0 2024-09-18T21:12:57.216 INFO:tasks.workunit.client.1.smithi103.stdout:0/643: mknod d1/dcf/ce4 0 2024-09-18T21:12:57.217 INFO:tasks.workunit.client.0.smithi077.stdout:2/652: read - d1/d4/d5/d1a/d49/d6a/d81/dc4/dc0/f6f zero size 2024-09-18T21:12:57.219 INFO:tasks.workunit.client.1.smithi103.stdout:6/693: creat d2/d24/d5a/d67/d76/da4/fd8 x:0 0 0 2024-09-18T21:12:57.219 INFO:tasks.workunit.client.1.smithi103.stdout:5/709: dread de/d1f/d3b/d58/fad [0,4194304] 0 2024-09-18T21:12:57.220 INFO:tasks.workunit.client.1.smithi103.stdout:1/619: rmdir d0/d2/d2b 39 2024-09-18T21:12:57.225 INFO:tasks.workunit.client.1.smithi103.stdout:3/631: creat d1/d9a/fc2 x:0 0 0 2024-09-18T21:12:57.226 INFO:tasks.workunit.client.1.smithi103.stdout:4/734: write d9/d38/d72/f98 [297435,113386] 0 2024-09-18T21:12:57.231 INFO:tasks.workunit.client.1.smithi103.stdout:1/620: mknod d0/d2/d9/d10/d5d/cdb 0 2024-09-18T21:12:57.232 INFO:tasks.workunit.client.0.smithi077.stdout:2/653: rename d1/d4/d5/d1a/d49/c79 to d1/d4/cda 0 2024-09-18T21:12:57.233 INFO:tasks.workunit.client.1.smithi103.stdout:7/657: creat d1/df/d42/d1f/d5d/dbe/fd0 x:0 0 0 2024-09-18T21:12:57.235 INFO:tasks.workunit.client.1.smithi103.stdout:5/710: dwrite de/d2d/f75 [4194304,4194304] 0 2024-09-18T21:12:57.238 INFO:tasks.workunit.client.1.smithi103.stdout:5/711: truncate de/d1f/d3b/d58/dc4/d33/fe5 512306 0 2024-09-18T21:12:57.239 INFO:tasks.workunit.client.1.smithi103.stdout:6/694: chown d2/d3/d8/d4c/d7a/c86 6 1 2024-09-18T21:12:57.239 INFO:tasks.workunit.client.1.smithi103.stdout:5/712: stat de/d1f/d3b/d51/db0 0 2024-09-18T21:12:57.242 INFO:tasks.workunit.client.0.smithi077.stdout:0/685: creat d8/d37/dd2/fd9 x:0 0 0 2024-09-18T21:12:57.243 INFO:tasks.workunit.client.0.smithi077.stdout:0/686: fsync d8/d26/f6b 0 2024-09-18T21:12:57.247 INFO:tasks.workunit.client.0.smithi077.stdout:1/625: getdents d3/d8/d93/dd3/d99 0 2024-09-18T21:12:57.248 INFO:tasks.workunit.client.1.smithi103.stdout:0/644: dread d1/d5/de/d19/d1e/f21 [0,4194304] 0 2024-09-18T21:12:57.250 INFO:tasks.workunit.client.0.smithi077.stdout:2/654: mkdir d1/d4/d5/d1a/d2e/d41/d2c/ddb 0 2024-09-18T21:12:57.251 INFO:tasks.workunit.client.1.smithi103.stdout:5/713: creat de/d1f/d3b/d58/feb x:0 0 0 2024-09-18T21:12:57.251 INFO:tasks.workunit.client.0.smithi077.stdout:8/549: link d2/d27/d29/d41/dbc/c4b d2/d27/d29/d72/d81/cc6 0 2024-09-18T21:12:57.254 INFO:tasks.workunit.client.0.smithi077.stdout:9/574: creat d1/d54/fbe x:0 0 0 2024-09-18T21:12:57.255 INFO:tasks.workunit.client.1.smithi103.stdout:6/695: mknod d2/d3/d8/d4c/d7d/cd9 0 2024-09-18T21:12:57.255 INFO:tasks.workunit.client.1.smithi103.stdout:6/696: stat d2/d24/d5a/d67/fa0 0 2024-09-18T21:12:57.261 INFO:tasks.workunit.client.1.smithi103.stdout:9/711: sync 2024-09-18T21:12:57.262 INFO:tasks.workunit.client.1.smithi103.stdout:3/632: rename d1/d23/d25/da1/da5/db4 to d1/d2/dc3 0 2024-09-18T21:12:57.262 INFO:tasks.workunit.client.1.smithi103.stdout:4/735: dread d9/d38/d72/df0/d61/f76 [0,4194304] 0 2024-09-18T21:12:57.263 INFO:tasks.workunit.client.0.smithi077.stdout:1/626: creat d3/d6a/fdc x:0 0 0 2024-09-18T21:12:57.263 INFO:tasks.workunit.client.0.smithi077.stdout:0/687: dread d8/d1a/f51 [0,4194304] 0 2024-09-18T21:12:57.264 INFO:tasks.workunit.client.1.smithi103.stdout:8/778: write d4/d98/fbd [551584,111993] 0 2024-09-18T21:12:57.264 INFO:tasks.workunit.client.1.smithi103.stdout:3/633: dread d1/da/df/f77 [0,4194304] 0 2024-09-18T21:12:57.266 INFO:tasks.workunit.client.0.smithi077.stdout:7/666: truncate d12/d22/f5e 485528 0 2024-09-18T21:12:57.266 INFO:tasks.workunit.client.0.smithi077.stdout:8/550: dread d2/d5f/da8/d4f/d5a/d5e/f83 [0,4194304] 0 2024-09-18T21:12:57.267 INFO:tasks.workunit.client.1.smithi103.stdout:0/645: creat d1/d5/de/dc0/d8c/dce/d9f/fe5 x:0 0 0 2024-09-18T21:12:57.270 INFO:tasks.workunit.client.0.smithi077.stdout:3/554: sync 2024-09-18T21:12:57.272 INFO:tasks.workunit.client.1.smithi103.stdout:7/658: write d1/df/d42/f4e [2446481,92046] 0 2024-09-18T21:12:57.278 INFO:tasks.workunit.client.1.smithi103.stdout:4/736: fdatasync d9/d38/d72/df0/f100 0 2024-09-18T21:12:57.279 INFO:tasks.workunit.client.1.smithi103.stdout:1/621: rename d0/d2/d9/d9e/fc5 to d0/d3/d68/d81/da2/da4/fdc 0 2024-09-18T21:12:57.280 INFO:tasks.workunit.client.1.smithi103.stdout:8/779: creat d4/d81/d71/ffa x:0 0 0 2024-09-18T21:12:57.281 INFO:tasks.workunit.client.1.smithi103.stdout:3/634: mknod d1/d2/d18/d30/cc4 0 2024-09-18T21:12:57.282 INFO:tasks.workunit.client.1.smithi103.stdout:8/780: write d4/d26/d56/fc2 [5129035,54177] 0 2024-09-18T21:12:57.282 INFO:tasks.workunit.client.1.smithi103.stdout:5/714: write de/d2d/f69 [1670790,83116] 0 2024-09-18T21:12:57.283 INFO:tasks.workunit.client.1.smithi103.stdout:6/697: creat d2/d3/d8/d4c/d7d/d9b/dd0/fda x:0 0 0 2024-09-18T21:12:57.284 INFO:tasks.workunit.client.0.smithi077.stdout:4/555: write d3/d77/f8b [664257,47105] 0 2024-09-18T21:12:57.284 INFO:tasks.workunit.client.1.smithi103.stdout:7/659: creat d1/df/d43/d63/fd1 x:0 0 0 2024-09-18T21:12:57.286 INFO:tasks.workunit.client.0.smithi077.stdout:1/627: write d3/d6a/d9b/fc5 [94146,81518] 0 2024-09-18T21:12:57.286 INFO:tasks.workunit.client.1.smithi103.stdout:7/660: write d1/df/d42/d29/d48/dbb/d33/d51/f9e [2071917,22448] 0 2024-09-18T21:12:57.289 INFO:tasks.workunit.client.0.smithi077.stdout:0/688: symlink d8/d1a/d39/dd0/lda 0 2024-09-18T21:12:57.290 INFO:tasks.workunit.client.0.smithi077.stdout:7/667: dwrite d12/d31/f7e [0,4194304] 0 2024-09-18T21:12:57.290 INFO:tasks.workunit.client.1.smithi103.stdout:1/622: fdatasync d0/d2/d2b/d3a/d42/f97 0 2024-09-18T21:12:57.290 INFO:tasks.workunit.client.0.smithi077.stdout:3/555: unlink db/d14/d32/d49/c5e 0 2024-09-18T21:12:57.291 INFO:tasks.workunit.client.0.smithi077.stdout:1/628: stat d3/d8/d13/d77/db1/da6 0 2024-09-18T21:12:57.292 INFO:tasks.workunit.client.1.smithi103.stdout:0/646: symlink d1/d5/de/d19/d1e/le6 0 2024-09-18T21:12:57.293 INFO:tasks.workunit.client.0.smithi077.stdout:3/556: chown db/d14/d32/f55 24003605 1 2024-09-18T21:12:57.293 INFO:tasks.workunit.client.1.smithi103.stdout:8/781: rmdir d4/d2d/d3d 39 2024-09-18T21:12:57.294 INFO:tasks.workunit.client.1.smithi103.stdout:8/782: stat d4/d26/f1a 0 2024-09-18T21:12:57.294 INFO:tasks.workunit.client.1.smithi103.stdout:7/661: dwrite d1/df/d42/d1f/d2e/d3f/f56 [0,4194304] 0 2024-09-18T21:12:57.295 INFO:tasks.workunit.client.0.smithi077.stdout:2/655: dwrite d1/d4/d5/f53 [8388608,4194304] 0 2024-09-18T21:12:57.299 INFO:tasks.workunit.client.0.smithi077.stdout:1/629: mknod d3/d38/d97/cdd 0 2024-09-18T21:12:57.301 INFO:tasks.workunit.client.1.smithi103.stdout:4/737: mknod d9/d38/d72/df0/d83/db6/c101 0 2024-09-18T21:12:57.301 INFO:tasks.workunit.client.1.smithi103.stdout:7/662: dread - d1/df/d43/d52/fb7 zero size 2024-09-18T21:12:57.302 INFO:tasks.workunit.client.0.smithi077.stdout:7/668: rename f10 to d12/d31/d77/d93/d2a/fde 0 2024-09-18T21:12:57.305 INFO:tasks.workunit.client.1.smithi103.stdout:7/663: write d1/df/d43/d61/fcf [800228,10015] 0 2024-09-18T21:12:57.306 INFO:tasks.workunit.client.1.smithi103.stdout:1/623: rmdir d0/d2/d9/dc/d36 39 2024-09-18T21:12:57.307 INFO:tasks.workunit.client.0.smithi077.stdout:4/556: write d3/d77/f39 [1476779,129599] 0 2024-09-18T21:12:57.308 INFO:tasks.workunit.client.0.smithi077.stdout:3/557: mkdir db/d14/d90/db2 0 2024-09-18T21:12:57.309 INFO:tasks.workunit.client.1.smithi103.stdout:3/635: symlink d1/d2/d18/d30/d4e/db1/lc5 0 2024-09-18T21:12:57.310 INFO:tasks.workunit.client.1.smithi103.stdout:3/636: chown d1/d23/l4a 3 1 2024-09-18T21:12:57.311 INFO:tasks.workunit.client.0.smithi077.stdout:2/656: mkdir d1/d4/d9/d80/d83/dba/ddc 0 2024-09-18T21:12:57.311 INFO:tasks.workunit.client.0.smithi077.stdout:7/669: dwrite d12/d31/d77/d93/d2a/d7f/fb3 [0,4194304] 0 2024-09-18T21:12:57.311 INFO:tasks.workunit.client.1.smithi103.stdout:3/637: chown d1/da/df/f14 27 1 2024-09-18T21:12:57.312 INFO:tasks.workunit.client.0.smithi077.stdout:8/551: link d2/d5f/da8/d4f/d5a/d2a/d67/f73 d2/d5f/da8/d4f/d5a/fc7 0 2024-09-18T21:12:57.313 INFO:tasks.workunit.client.0.smithi077.stdout:7/670: chown d12/d56/da1/db6/fcd 5504 1 2024-09-18T21:12:57.314 INFO:tasks.workunit.client.1.smithi103.stdout:5/715: unlink de/d1f/d3b/d58/f67 0 2024-09-18T21:12:57.315 INFO:tasks.workunit.client.0.smithi077.stdout:1/630: write d3/d8/d49/d4e/f57 [770998,66168] 0 2024-09-18T21:12:57.316 INFO:tasks.workunit.client.1.smithi103.stdout:9/712: getdents d18 0 2024-09-18T21:12:57.317 INFO:tasks.workunit.client.0.smithi077.stdout:0/689: creat d8/d1a/d39/d3b/fdb x:0 0 0 2024-09-18T21:12:57.319 INFO:tasks.workunit.client.0.smithi077.stdout:0/690: fsync d8/d1d/d57/fcc 0 2024-09-18T21:12:57.320 INFO:tasks.workunit.client.1.smithi103.stdout:4/738: dread d9/d38/d58/fa7 [0,4194304] 0 2024-09-18T21:12:57.321 INFO:tasks.workunit.client.1.smithi103.stdout:8/783: readlink d4/d2d/d87/dbb/lec 0 2024-09-18T21:12:57.323 INFO:tasks.workunit.client.0.smithi077.stdout:3/558: dread db/d14/d22/d36/d39/f45 [0,4194304] 0 2024-09-18T21:12:57.325 INFO:tasks.workunit.client.0.smithi077.stdout:7/671: rmdir d12/d22/d59/d72/d68 39 2024-09-18T21:12:57.326 INFO:tasks.workunit.client.1.smithi103.stdout:7/664: symlink d1/df/d42/d1f/d5d/d85/db0/dc5/ld2 0 2024-09-18T21:12:57.327 INFO:tasks.workunit.client.0.smithi077.stdout:0/691: dwrite d8/d1d/d57/fcc [0,4194304] 0 2024-09-18T21:12:57.328 INFO:tasks.workunit.client.0.smithi077.stdout:0/692: dread - d8/d1d/d57/fd4 zero size 2024-09-18T21:12:57.333 INFO:tasks.workunit.client.1.smithi103.stdout:7/665: mknod d1/df/d42/d1f/d5d/dbe/cd3 0 2024-09-18T21:12:57.335 INFO:tasks.workunit.client.1.smithi103.stdout:4/739: mknod d9/d38/db4/c102 0 2024-09-18T21:12:57.336 INFO:tasks.workunit.client.0.smithi077.stdout:0/693: truncate d8/d1d/f2b 3560503 0 2024-09-18T21:12:57.338 INFO:tasks.workunit.client.0.smithi077.stdout:0/694: write d8/d1a/d35/d6d/fac [224282,126685] 0 2024-09-18T21:12:57.339 INFO:tasks.workunit.client.1.smithi103.stdout:7/666: creat d1/df/dc7/fd4 x:0 0 0 2024-09-18T21:12:57.340 INFO:tasks.workunit.client.0.smithi077.stdout:1/631: link d3/d8/d49/lc8 d3/d8/d75/lde 0 2024-09-18T21:12:57.342 INFO:tasks.workunit.client.1.smithi103.stdout:4/740: dwrite d9/d1c/d77/f54 [0,4194304] 0 2024-09-18T21:12:57.343 INFO:tasks.workunit.client.0.smithi077.stdout:4/557: getdents d3/dc/d20 0 2024-09-18T21:12:57.343 INFO:tasks.workunit.client.0.smithi077.stdout:4/558: read - d3/d77/f98 zero size 2024-09-18T21:12:57.345 INFO:tasks.workunit.client.1.smithi103.stdout:8/784: rename d4/de/c27 to d4/cfb 0 2024-09-18T21:12:57.349 INFO:tasks.workunit.client.1.smithi103.stdout:4/741: symlink d9/d1c/db1/l103 0 2024-09-18T21:12:57.351 INFO:tasks.workunit.client.1.smithi103.stdout:4/742: fdatasync d9/d1c/d77/f6f 0 2024-09-18T21:12:57.352 INFO:tasks.workunit.client.0.smithi077.stdout:7/672: dread f1 [0,4194304] 0 2024-09-18T21:12:57.353 INFO:tasks.workunit.client.1.smithi103.stdout:9/713: dread d18/d8d/d2f/f41 [0,4194304] 0 2024-09-18T21:12:57.353 INFO:tasks.workunit.client.0.smithi077.stdout:7/673: chown d12/d22/d59/d72/fbb 33264 1 2024-09-18T21:12:57.354 INFO:tasks.workunit.client.0.smithi077.stdout:1/632: rename d3/d8/d93/dd3/f1a to d3/d6a/d9b/dbe/fdf 0 2024-09-18T21:12:57.354 INFO:tasks.workunit.client.0.smithi077.stdout:2/657: write d1/f1d [3962841,89041] 0 2024-09-18T21:12:57.354 INFO:tasks.workunit.client.1.smithi103.stdout:3/638: write d1/d23/d25/d4f/d58/d68/d50/d54/f9d [6049568,81554] 0 2024-09-18T21:12:57.355 INFO:tasks.workunit.client.1.smithi103.stdout:4/743: chown d9/d38/d72/df0/d83/db6/c8c 3052893 1 2024-09-18T21:12:57.355 INFO:tasks.workunit.client.1.smithi103.stdout:1/624: dwrite d0/d2/d9/d10/f25 [0,4194304] 0 2024-09-18T21:12:57.356 INFO:tasks.workunit.client.0.smithi077.stdout:8/552: dread d2/d5/d6/f14 [0,4194304] 0 2024-09-18T21:12:57.357 INFO:tasks.workunit.client.0.smithi077.stdout:4/559: dread d3/dc/d20/f97 [0,4194304] 0 2024-09-18T21:12:57.357 INFO:tasks.workunit.client.1.smithi103.stdout:9/714: dread - d18/d52/d6f/d8e/d8f/dbd/dc3/fb7 zero size 2024-09-18T21:12:57.358 INFO:tasks.workunit.client.0.smithi077.stdout:3/559: getdents db/d14/d22/d36/d39 0 2024-09-18T21:12:57.358 INFO:tasks.workunit.client.1.smithi103.stdout:7/667: symlink d1/df/d43/d63/d67/dc3/ld5 0 2024-09-18T21:12:57.364 INFO:tasks.workunit.client.0.smithi077.stdout:7/674: mkdir d12/d56/da1/ddf 0 2024-09-18T21:12:57.368 INFO:tasks.workunit.client.1.smithi103.stdout:4/744: mknod d9/d38/d72/d85/dd8/c104 0 2024-09-18T21:12:57.369 INFO:tasks.workunit.client.0.smithi077.stdout:8/553: chown d2/d27/d29/d41/dbc/c4b 583 1 2024-09-18T21:12:57.370 INFO:tasks.workunit.client.0.smithi077.stdout:8/554: write d2/d5f/d6f/f95 [276646,25066] 0 2024-09-18T21:12:57.371 INFO:tasks.workunit.client.0.smithi077.stdout:0/695: creat d8/d1a/fdc x:0 0 0 2024-09-18T21:12:57.373 INFO:tasks.workunit.client.1.smithi103.stdout:9/715: creat d18/d29/d68/fef x:0 0 0 2024-09-18T21:12:57.376 INFO:tasks.workunit.client.1.smithi103.stdout:8/785: truncate d4/d98/fbd 627527 0 2024-09-18T21:12:57.377 INFO:tasks.workunit.client.1.smithi103.stdout:3/639: mkdir d1/d23/d25/d4f/dc6 0 2024-09-18T21:12:57.378 INFO:tasks.workunit.client.1.smithi103.stdout:3/640: write d1/d2/f3e [4679800,21428] 0 2024-09-18T21:12:57.380 INFO:tasks.workunit.client.1.smithi103.stdout:4/745: symlink d9/d38/d72/df0/d83/db6/d41/l105 0 2024-09-18T21:12:57.381 INFO:tasks.workunit.client.0.smithi077.stdout:2/658: mknod d1/d4/d5/d1a/d2e/cdd 0 2024-09-18T21:12:57.382 INFO:tasks.workunit.client.0.smithi077.stdout:8/555: dread d2/d5f/da8/d4f/f79 [0,4194304] 0 2024-09-18T21:12:57.382 INFO:tasks.workunit.client.1.smithi103.stdout:9/716: creat d18/d29/d68/d92/d9c/ff0 x:0 0 0 2024-09-18T21:12:57.383 INFO:tasks.workunit.client.1.smithi103.stdout:9/717: write d18/d52/f82 [1550,63793] 0 2024-09-18T21:12:57.385 INFO:tasks.workunit.client.1.smithi103.stdout:9/718: write d18/d29/d68/d78/fba [4453740,15383] 0 2024-09-18T21:12:57.387 INFO:tasks.workunit.client.0.smithi077.stdout:0/696: rename d8/d1a/f7c to d8/d1d/d80/fdd 0 2024-09-18T21:12:57.388 INFO:tasks.workunit.client.0.smithi077.stdout:0/697: readlink d8/d37/d66/lc5 0 2024-09-18T21:12:57.388 INFO:tasks.workunit.client.0.smithi077.stdout:0/698: read - d8/d1a/d39/d56/fb6 zero size 2024-09-18T21:12:57.392 INFO:tasks.workunit.client.1.smithi103.stdout:3/641: dread d1/d2/d18/d30/f38 [0,4194304] 0 2024-09-18T21:12:57.395 INFO:tasks.workunit.client.1.smithi103.stdout:1/625: link d0/d3/d68/la1 d0/d2/d9/dc/d6e/ldd 0 2024-09-18T21:12:57.396 INFO:tasks.workunit.client.1.smithi103.stdout:4/746: dwrite d9/d38/d72/df0/d83/db6/f1e [0,4194304] 0 2024-09-18T21:12:57.397 INFO:tasks.workunit.client.1.smithi103.stdout:8/786: mknod d4/d26/d56/cfc 0 2024-09-18T21:12:57.397 INFO:tasks.workunit.client.1.smithi103.stdout:8/787: chown d4/ce1 112139 1 2024-09-18T21:12:57.406 INFO:tasks.workunit.client.1.smithi103.stdout:3/642: dread d1/d23/d25/f60 [0,4194304] 0 2024-09-18T21:12:57.407 INFO:tasks.workunit.client.1.smithi103.stdout:8/788: fdatasync d4/d2d/d4e/d73/fc6 0 2024-09-18T21:12:57.410 INFO:tasks.workunit.client.1.smithi103.stdout:8/789: write d4/d81/dd7/dde/d59/d9c/de6/ff2 [53616,69942] 0 2024-09-18T21:12:57.410 INFO:tasks.workunit.client.1.smithi103.stdout:3/643: rmdir d1/d2 39 2024-09-18T21:12:57.414 INFO:tasks.workunit.client.1.smithi103.stdout:8/790: symlink d4/d81/lfd 0 2024-09-18T21:12:57.419 INFO:tasks.workunit.client.1.smithi103.stdout:2/592: sync 2024-09-18T21:12:57.422 INFO:tasks.workunit.client.1.smithi103.stdout:1/626: write d0/d2/f3d [736516,32876] 0 2024-09-18T21:12:57.423 INFO:tasks.workunit.client.1.smithi103.stdout:4/747: write d9/d38/d72/df0/d83/db6/d21/f33 [1633248,53992] 0 2024-09-18T21:12:57.426 INFO:tasks.workunit.client.1.smithi103.stdout:9/719: dwrite d18/d52/f60 [0,4194304] 0 2024-09-18T21:12:57.428 INFO:tasks.workunit.client.1.smithi103.stdout:4/748: dread - d9/d38/d72/df0/d61/fbd zero size 2024-09-18T21:12:57.429 INFO:tasks.workunit.client.1.smithi103.stdout:4/749: fdatasync d9/d1c/d77/f6f 0 2024-09-18T21:12:57.432 INFO:tasks.workunit.client.1.smithi103.stdout:9/720: unlink d18/d8d/d2f/f50 0 2024-09-18T21:12:57.432 INFO:tasks.workunit.client.1.smithi103.stdout:4/750: fsync d9/d38/d72/df0/d61/d91/d9e/f53 0 2024-09-18T21:12:57.433 INFO:tasks.workunit.client.0.smithi077.stdout:2/659: dread d1/d4/d5/d1a/d2e/f5a [0,4194304] 0 2024-09-18T21:12:57.434 INFO:tasks.workunit.client.1.smithi103.stdout:1/627: link d0/d3/d68/d81/da2/da4/dc2/dd8/fb6 d0/d3/d68/d81/da2/da4/dc2/dd8/fde 0 2024-09-18T21:12:57.434 INFO:tasks.workunit.client.0.smithi077.stdout:2/660: chown d1/d4/d5/d1a/d2e/d41/d2c/dab/fd4 26 1 2024-09-18T21:12:57.436 INFO:tasks.workunit.client.1.smithi103.stdout:3/644: dwrite d1/f31 [0,4194304] 0 2024-09-18T21:12:57.437 INFO:tasks.workunit.client.1.smithi103.stdout:3/645: write d1/d9a/fc2 [638918,46508] 0 2024-09-18T21:12:57.439 INFO:tasks.workunit.client.0.smithi077.stdout:3/560: link db/d14/d32/d49/da4/f53 db/d14/d32/d49/da4/d89/fb3 0 2024-09-18T21:12:57.440 INFO:tasks.workunit.client.1.smithi103.stdout:9/721: mkdir d18/d52/d6f/d8e/d8f/dbd/df1 0 2024-09-18T21:12:57.440 INFO:tasks.workunit.client.0.smithi077.stdout:3/561: write db/d14/d32/d49/fab [292433,114819] 0 2024-09-18T21:12:57.441 INFO:tasks.workunit.client.1.smithi103.stdout:4/751: rmdir d9/d38/d72/df0/d61/d91/daa 39 2024-09-18T21:12:57.441 INFO:tasks.workunit.client.1.smithi103.stdout:3/646: chown d1/d23/d25/d4f/d58/f6d 8691657 1 2024-09-18T21:12:57.442 INFO:tasks.workunit.client.0.smithi077.stdout:1/633: link d3/d8/l11 d3/d38/dd5/le0 0 2024-09-18T21:12:57.442 INFO:tasks.workunit.client.0.smithi077.stdout:3/562: write db/d14/d32/d49/da4/f82 [1469310,108480] 0 2024-09-18T21:12:57.442 INFO:tasks.workunit.client.1.smithi103.stdout:8/791: write d4/d26/d56/d77/d9f/fca [894905,30591] 0 2024-09-18T21:12:57.442 INFO:tasks.workunit.client.1.smithi103.stdout:1/628: symlink d0/d2/da8/ldf 0 2024-09-18T21:12:57.443 INFO:tasks.workunit.client.0.smithi077.stdout:7/675: chown d12/d22/daa/dc0/dac/ld7 0 1 2024-09-18T21:12:57.444 INFO:tasks.workunit.client.0.smithi077.stdout:8/556: mkdir d2/d5f/da8/d4f/d5a/d2a/dc8 0 2024-09-18T21:12:57.444 INFO:tasks.workunit.client.1.smithi103.stdout:9/722: chown d18/d52/d6f/l7e 16600 1 2024-09-18T21:12:57.445 INFO:tasks.workunit.client.1.smithi103.stdout:4/752: fsync d9/d1c/d69/f71 0 2024-09-18T21:12:57.448 INFO:tasks.workunit.client.0.smithi077.stdout:0/699: link d8/d1a/d39/d3b/d9a/fd6 d8/d1a/d39/d56/fde 0 2024-09-18T21:12:57.449 INFO:tasks.workunit.client.1.smithi103.stdout:2/593: dwrite d3/d5/f27 [0,4194304] 0 2024-09-18T21:12:57.452 INFO:tasks.workunit.client.0.smithi077.stdout:0/700: dread d8/f2f [0,4194304] 0 2024-09-18T21:12:57.452 INFO:tasks.workunit.client.1.smithi103.stdout:8/792: mknod d4/d81/d71/d7f/cfe 0 2024-09-18T21:12:57.454 INFO:tasks.workunit.client.0.smithi077.stdout:3/563: rename f3 to db/d14/d22/d36/fb4 0 2024-09-18T21:12:57.455 INFO:tasks.workunit.client.1.smithi103.stdout:1/629: creat d0/d2/d9/d9e/d7a/fe0 x:0 0 0 2024-09-18T21:12:57.457 INFO:tasks.workunit.client.1.smithi103.stdout:4/753: dwrite d9/d38/d72/d85/ff6 [0,4194304] 0 2024-09-18T21:12:57.460 INFO:tasks.workunit.client.1.smithi103.stdout:4/754: write d9/d38/d72/df0/d61/f99 [900865,96692] 0 2024-09-18T21:12:57.460 INFO:tasks.workunit.client.1.smithi103.stdout:9/723: rename d18/d8d/d2f/ddd/fe1 to d18/d52/d6f/db9/ff2 0 2024-09-18T21:12:57.463 INFO:tasks.workunit.client.1.smithi103.stdout:2/594: creat d3/d5/d4a/d56/fd8 x:0 0 0 2024-09-18T21:12:57.464 INFO:tasks.workunit.client.0.smithi077.stdout:3/564: dread db/d14/d32/d49/da4/d89/fb3 [0,4194304] 0 2024-09-18T21:12:57.464 INFO:tasks.workunit.client.1.smithi103.stdout:4/755: dread - d9/d38/d72/df0/d61/fa2 zero size 2024-09-18T21:12:57.464 INFO:tasks.workunit.client.0.smithi077.stdout:2/661: write d1/d4/d5/d1a/d2e/d40/f44 [7524483,106744] 0 2024-09-18T21:12:57.466 INFO:tasks.workunit.client.1.smithi103.stdout:4/756: fsync d9/d38/d58/f92 0 2024-09-18T21:12:57.466 INFO:tasks.workunit.client.0.smithi077.stdout:3/565: truncate db/d14/d32/d49/fab 875628 0 2024-09-18T21:12:57.467 INFO:tasks.workunit.client.1.smithi103.stdout:3/647: dread d1/d2/f8 [0,4194304] 0 2024-09-18T21:12:57.470 INFO:tasks.workunit.client.0.smithi077.stdout:0/701: rename d8/d37/d66/d87/fd5 to d8/d1a/d39/fdf 0 2024-09-18T21:12:57.471 INFO:tasks.workunit.client.1.smithi103.stdout:3/648: dread d1/d2/d18/d30/f38 [0,4194304] 0 2024-09-18T21:12:57.472 INFO:tasks.workunit.client.0.smithi077.stdout:8/557: creat d2/d5f/da8/d4f/d5a/d2a/dc8/fc9 x:0 0 0 2024-09-18T21:12:57.473 INFO:tasks.workunit.client.0.smithi077.stdout:3/566: dwrite db/d14/d32/d49/d4e/d6a/f61 [0,4194304] 0 2024-09-18T21:12:57.474 INFO:tasks.workunit.client.1.smithi103.stdout:8/793: symlink d4/d2d/dc1/dee/lff 0 2024-09-18T21:12:57.475 INFO:tasks.workunit.client.1.smithi103.stdout:2/595: symlink d3/d5/d2f/d93/ld9 0 2024-09-18T21:12:57.476 INFO:tasks.workunit.client.1.smithi103.stdout:8/794: read d4/de/f1c [1630475,67504] 0 2024-09-18T21:12:57.477 INFO:tasks.workunit.client.0.smithi077.stdout:7/676: creat d12/d22/daa/dc0/fe0 x:0 0 0 2024-09-18T21:12:57.478 INFO:tasks.workunit.client.1.smithi103.stdout:8/795: write d4/d81/dd7/dde/d59/fdb [737283,1274] 0 2024-09-18T21:12:57.478 INFO:tasks.workunit.client.0.smithi077.stdout:0/702: write d8/d37/d95/dab/f8c [1293455,46661] 0 2024-09-18T21:12:57.483 INFO:tasks.workunit.client.1.smithi103.stdout:2/596: creat d3/d5/d2f/d32/fda x:0 0 0 2024-09-18T21:12:57.484 INFO:tasks.workunit.client.0.smithi077.stdout:7/677: unlink d12/c1d 0 2024-09-18T21:12:57.485 INFO:tasks.workunit.client.1.smithi103.stdout:3/649: creat d1/d23/d25/d4f/d72/d85/d93/fc7 x:0 0 0 2024-09-18T21:12:57.487 INFO:tasks.workunit.client.0.smithi077.stdout:1/634: write d3/d8/f1c [163462,36489] 0 2024-09-18T21:12:57.488 INFO:tasks.workunit.client.0.smithi077.stdout:1/635: fdatasync d3/d8/f67 0 2024-09-18T21:12:57.489 INFO:tasks.workunit.client.1.smithi103.stdout:4/757: rename d9/d38/d72/df0/d61/dfa to d9/d1c/d106 0 2024-09-18T21:12:57.492 INFO:tasks.workunit.client.1.smithi103.stdout:3/650: dread d1/da/df/f77 [0,4194304] 0 2024-09-18T21:12:57.494 INFO:tasks.workunit.client.0.smithi077.stdout:8/558: creat d2/d5/d6/d9f/da6/fca x:0 0 0 2024-09-18T21:12:57.494 INFO:tasks.workunit.client.1.smithi103.stdout:1/630: dwrite d0/d2/d9/dc/f22 [0,4194304] 0 2024-09-18T21:12:57.497 INFO:tasks.workunit.client.1.smithi103.stdout:2/597: rename d3/d5/d2f/d5b/f75 to d3/d5/d2c/d77/fdb 0 2024-09-18T21:12:57.499 INFO:tasks.workunit.client.1.smithi103.stdout:2/598: chown d3/fcf 306885 1 2024-09-18T21:12:57.500 INFO:tasks.workunit.client.0.smithi077.stdout:2/662: rename d1/d4/d5/d1a/d2e/d41/d2c/f47 to d1/d4/d5/d1a/d2e/fde 0 2024-09-18T21:12:57.502 INFO:tasks.workunit.client.0.smithi077.stdout:8/559: fsync d2/d5/f93 0 2024-09-18T21:12:57.503 INFO:tasks.workunit.client.1.smithi103.stdout:9/724: dwrite d18/d52/d6f/d8e/d8f/dbd/dc3/fc4 [0,4194304] 0 2024-09-18T21:12:57.507 INFO:tasks.workunit.client.0.smithi077.stdout:7/678: dread d12/d31/d77/d93/d2a/f3d [0,4194304] 0 2024-09-18T21:12:57.507 INFO:tasks.workunit.client.0.smithi077.stdout:2/663: symlink d1/d4/d5/d1a/d49/ldf 0 2024-09-18T21:12:57.510 INFO:tasks.workunit.client.0.smithi077.stdout:7/679: fsync d12/f45 0 2024-09-18T21:12:57.512 INFO:tasks.workunit.client.0.smithi077.stdout:3/567: dread db/d14/d32/f55 [4194304,4194304] 0 2024-09-18T21:12:57.512 INFO:tasks.workunit.client.0.smithi077.stdout:1/636: write d3/d8/d13/f14 [3895931,16673] 0 2024-09-18T21:12:57.512 INFO:tasks.workunit.client.1.smithi103.stdout:8/796: getdents d4/d2d 0 2024-09-18T21:12:57.513 INFO:tasks.workunit.client.0.smithi077.stdout:7/680: dread - d12/d56/da1/db6/fb8 zero size 2024-09-18T21:12:57.513 INFO:tasks.workunit.client.1.smithi103.stdout:3/651: dwrite d1/d2/f3e [0,4194304] 0 2024-09-18T21:12:57.515 INFO:tasks.workunit.client.1.smithi103.stdout:8/797: write d4/d81/d71/fc4 [635189,108624] 0 2024-09-18T21:12:57.516 INFO:tasks.workunit.client.0.smithi077.stdout:0/703: dwrite d8/d1d/d57/f8f [0,4194304] 0 2024-09-18T21:12:57.516 INFO:tasks.workunit.client.0.smithi077.stdout:3/568: chown db/d14/d22/d36/fa2 821 1 2024-09-18T21:12:57.516 INFO:tasks.workunit.client.1.smithi103.stdout:1/631: dwrite d0/fbd [0,4194304] 0 2024-09-18T21:12:57.516 INFO:tasks.workunit.client.1.smithi103.stdout:8/798: chown d4/d81/d65 288564719 1 2024-09-18T21:12:57.517 INFO:tasks.workunit.client.0.smithi077.stdout:7/681: write d12/d22/daa/dc0/fe0 [637919,98993] 0 2024-09-18T21:12:57.521 INFO:tasks.workunit.client.0.smithi077.stdout:2/664: symlink d1/d4/d5/d1a/d2e/d40/d69/le0 0 2024-09-18T21:12:57.527 INFO:tasks.workunit.client.0.smithi077.stdout:0/704: rmdir d8 39 2024-09-18T21:12:57.529 INFO:tasks.workunit.client.0.smithi077.stdout:6/556: sync 2024-09-18T21:12:57.529 INFO:tasks.workunit.client.0.smithi077.stdout:5/737: sync 2024-09-18T21:12:57.529 INFO:tasks.workunit.client.0.smithi077.stdout:8/560: dwrite d2/d27/f57 [0,4194304] 0 2024-09-18T21:12:57.530 INFO:tasks.workunit.client.0.smithi077.stdout:3/569: mkdir db/d14/d32/d49/d4e/d6a/db5 0 2024-09-18T21:12:57.531 INFO:tasks.workunit.client.0.smithi077.stdout:3/570: dread - db/d14/d32/d49/fa0 zero size 2024-09-18T21:12:57.532 INFO:tasks.workunit.client.0.smithi077.stdout:2/665: rmdir d1 39 2024-09-18T21:12:57.533 INFO:tasks.workunit.client.0.smithi077.stdout:7/682: chown d12/d31/d77/d93/d89/lc8 389674 1 2024-09-18T21:12:57.533 INFO:tasks.workunit.client.0.smithi077.stdout:5/738: truncate d0/d6/d3b/d64/fd1 306977 0 2024-09-18T21:12:57.534 INFO:tasks.workunit.client.0.smithi077.stdout:5/739: chown d0/d43 849951 1 2024-09-18T21:12:57.535 INFO:tasks.workunit.client.0.smithi077.stdout:3/571: truncate db/d14/d32/d49/fab 919530 0 2024-09-18T21:12:57.541 INFO:tasks.workunit.client.0.smithi077.stdout:5/740: chown d0/df/d10/l34 10 1 2024-09-18T21:12:57.543 INFO:tasks.workunit.client.0.smithi077.stdout:0/705: rename d8/d1d/d57 to d8/d37/d66/d87/de0 0 2024-09-18T21:12:57.546 INFO:tasks.workunit.client.0.smithi077.stdout:2/666: mknod d1/d4/d5/d1a/d49/d6a/d81/ce1 0 2024-09-18T21:12:57.547 INFO:tasks.workunit.client.0.smithi077.stdout:2/667: readlink d1/d4/d5/d1a/d2e/d40/d69/le0 0 2024-09-18T21:12:57.552 INFO:tasks.workunit.client.0.smithi077.stdout:1/637: write d3/d38/dd5/f6f [3193822,5222] 0 2024-09-18T21:12:57.553 INFO:tasks.workunit.client.0.smithi077.stdout:1/638: chown d3/f10 1035457 1 2024-09-18T21:12:57.557 INFO:tasks.workunit.client.0.smithi077.stdout:0/706: symlink d8/d37/le1 0 2024-09-18T21:12:57.559 INFO:tasks.workunit.client.0.smithi077.stdout:0/707: chown d8/d1a/d39/d3b/d79/fae 95 1 2024-09-18T21:12:57.560 INFO:tasks.workunit.client.0.smithi077.stdout:6/557: getdents d7/d7e/d11/d3e 0 2024-09-18T21:12:57.561 INFO:tasks.workunit.client.0.smithi077.stdout:9/575: sync 2024-09-18T21:12:57.564 INFO:tasks.workunit.client.1.smithi103.stdout:2/599: dread - d3/d5/d2c/d54/d68/f6b zero size 2024-09-18T21:12:57.567 INFO:tasks.workunit.client.0.smithi077.stdout:5/741: dread d0/df/d3d/f9a [0,4194304] 0 2024-09-18T21:12:57.569 INFO:tasks.workunit.client.0.smithi077.stdout:8/561: dwrite d2/d27/d29/d72/d81/fbb [0,4194304] 0 2024-09-18T21:12:57.569 INFO:tasks.workunit.client.0.smithi077.stdout:6/558: rename d7/d7e/d11/d1d to d7/d7e/d11/d3e/d42/dbb 0 2024-09-18T21:12:57.570 INFO:tasks.workunit.client.0.smithi077.stdout:1/639: dread d3/d8/d49/f79 [0,4194304] 0 2024-09-18T21:12:57.573 INFO:tasks.workunit.client.0.smithi077.stdout:9/576: truncate d1/dd/d11/d1c/f7d 135354 0 2024-09-18T21:12:57.573 INFO:tasks.workunit.client.0.smithi077.stdout:7/683: write d12/d31/fda [1291707,55211] 0 2024-09-18T21:12:57.575 INFO:tasks.workunit.client.1.smithi103.stdout:3/652: mknod d1/d23/d25/d4f/d58/d68/d50/d54/cc8 0 2024-09-18T21:12:57.576 INFO:tasks.workunit.client.1.smithi103.stdout:8/799: creat d4/d2d/d3d/da0/f100 x:0 0 0 2024-09-18T21:12:57.578 INFO:tasks.workunit.client.0.smithi077.stdout:3/572: truncate db/d14/d22/d36/fb4 660945 0 2024-09-18T21:12:57.578 INFO:tasks.workunit.client.0.smithi077.stdout:3/573: readlink db/l4a 0 2024-09-18T21:12:57.580 INFO:tasks.workunit.client.1.smithi103.stdout:4/758: getdents d9/d1c/db1 0 2024-09-18T21:12:57.581 INFO:tasks.workunit.client.1.smithi103.stdout:9/725: unlink d18/d8d/d2f/l5c 0 2024-09-18T21:12:57.583 INFO:tasks.workunit.client.0.smithi077.stdout:8/562: dread d2/d5f/da8/d4f/f79 [0,4194304] 0 2024-09-18T21:12:57.583 INFO:tasks.workunit.client.0.smithi077.stdout:6/559: readlink d7/d7e/d11/d3e/d42/dbb/d31/l66 0 2024-09-18T21:12:57.584 INFO:tasks.workunit.client.0.smithi077.stdout:7/684: creat d12/d31/d77/da0/fe1 x:0 0 0 2024-09-18T21:12:57.585 INFO:tasks.workunit.client.1.smithi103.stdout:2/600: dread d3/d5/d2f/d5b/f6c [0,4194304] 0 2024-09-18T21:12:57.588 INFO:tasks.workunit.client.0.smithi077.stdout:2/668: dwrite d1/d4/f8 [0,4194304] 0 2024-09-18T21:12:57.588 INFO:tasks.workunit.client.0.smithi077.stdout:8/563: dread d2/d27/d29/d72/f9d [0,4194304] 0 2024-09-18T21:12:57.589 INFO:tasks.workunit.client.0.smithi077.stdout:5/742: dwrite d0/df/d10/fb0 [4194304,4194304] 0 2024-09-18T21:12:57.590 INFO:tasks.workunit.client.0.smithi077.stdout:8/564: fsync d2/d27/d29/d72/f9d 0 2024-09-18T21:12:57.590 INFO:tasks.workunit.client.1.smithi103.stdout:3/653: symlink d1/d23/d25/d4f/lc9 0 2024-09-18T21:12:57.594 INFO:tasks.workunit.client.0.smithi077.stdout:0/708: write d8/f23 [1189762,41734] 0 2024-09-18T21:12:57.597 INFO:tasks.workunit.client.1.smithi103.stdout:2/601: creat d3/d5/d2c/d77/d9c/db8/fdc x:0 0 0 2024-09-18T21:12:57.600 INFO:tasks.workunit.client.0.smithi077.stdout:7/685: creat d12/d22/daa/fe2 x:0 0 0 2024-09-18T21:12:57.601 INFO:tasks.workunit.client.0.smithi077.stdout:3/574: write db/d14/d32/d49/da4/d71/f78 [203740,43460] 0 2024-09-18T21:12:57.602 INFO:tasks.workunit.client.0.smithi077.stdout:7/686: read d12/d31/d77/d93/d2a/f3d [1432550,105121] 0 2024-09-18T21:12:57.603 INFO:tasks.workunit.client.0.smithi077.stdout:6/560: creat d7/d7e/d11/d3e/d42/dbb/d49/fbc x:0 0 0 2024-09-18T21:12:57.604 INFO:tasks.workunit.client.1.smithi103.stdout:9/726: truncate d18/d8d/d2f/f97 656870 0 2024-09-18T21:12:57.604 INFO:tasks.workunit.client.0.smithi077.stdout:7/687: fsync d12/d31/d77/d93/f88 0 2024-09-18T21:12:57.605 INFO:tasks.workunit.client.0.smithi077.stdout:3/575: truncate db/d14/d32/d49/d4e/d6a/f6c 5238338 0 2024-09-18T21:12:57.607 INFO:tasks.workunit.client.0.smithi077.stdout:7/688: dread - d12/d56/da1/db6/dbd/fdd zero size 2024-09-18T21:12:57.607 INFO:tasks.workunit.client.0.smithi077.stdout:3/576: chown db/d14/f20 16941702 1 2024-09-18T21:12:57.607 INFO:tasks.workunit.client.1.smithi103.stdout:8/800: link d4/d2d/dc1/dee/lff d4/d81/l101 0 2024-09-18T21:12:57.608 INFO:tasks.workunit.client.1.smithi103.stdout:8/801: chown d4/d26/f1a 285174360 1 2024-09-18T21:12:57.609 INFO:tasks.workunit.client.0.smithi077.stdout:9/577: truncate d1/dd/d1a/d42/f5e 2019078 0 2024-09-18T21:12:57.611 INFO:tasks.workunit.client.1.smithi103.stdout:4/759: rename d9/d38/d72/df0/d83/db6/d86/fd9 to d9/f107 0 2024-09-18T21:12:57.612 INFO:tasks.workunit.client.0.smithi077.stdout:2/669: unlink d1/d4/d5/d1a/d49/d6a/d81/dc4/lca 0 2024-09-18T21:12:57.613 INFO:tasks.workunit.client.1.smithi103.stdout:6/698: sync 2024-09-18T21:12:57.614 INFO:tasks.workunit.client.1.smithi103.stdout:4/760: dread d9/d38/d72/d85/f90 [0,4194304] 0 2024-09-18T21:12:57.614 INFO:tasks.workunit.client.1.smithi103.stdout:3/654: truncate d1/da/f16 2251806 0 2024-09-18T21:12:57.616 INFO:tasks.workunit.client.1.smithi103.stdout:6/699: write d2/d3/d8/d4c/d79/fd1 [435316,83180] 0 2024-09-18T21:12:57.616 INFO:tasks.workunit.client.0.smithi077.stdout:6/561: creat d7/d7e/d11/d3e/d42/d88/fbd x:0 0 0 2024-09-18T21:12:57.618 INFO:tasks.workunit.client.0.smithi077.stdout:9/578: dwrite d1/dd/d11/d1c/d38/d46/f67 [0,4194304] 0 2024-09-18T21:12:57.618 INFO:tasks.workunit.client.1.smithi103.stdout:6/700: dread - d2/d24/d38/d68/dac/fc6 zero size 2024-09-18T21:12:57.620 INFO:tasks.workunit.client.1.smithi103.stdout:6/701: truncate d2/f28 5185748 0 2024-09-18T21:12:57.621 INFO:tasks.workunit.client.0.smithi077.stdout:5/743: symlink d0/d6/lf1 0 2024-09-18T21:12:57.621 INFO:tasks.workunit.client.1.smithi103.stdout:9/727: dwrite d18/d52/d5e/f7b [0,4194304] 0 2024-09-18T21:12:57.622 INFO:tasks.workunit.client.0.smithi077.stdout:3/577: mkdir db/d14/d93/db6 0 2024-09-18T21:12:57.623 INFO:tasks.workunit.client.0.smithi077.stdout:0/709: dwrite d8/d37/f63 [0,4194304] 0 2024-09-18T21:12:57.623 INFO:tasks.workunit.client.0.smithi077.stdout:7/689: mknod d12/d22/d59/d5a/ce3 0 2024-09-18T21:12:57.628 INFO:tasks.workunit.client.0.smithi077.stdout:8/565: symlink d2/d5/d6/d7e/lcb 0 2024-09-18T21:12:57.628 INFO:tasks.workunit.client.1.smithi103.stdout:2/602: creat d3/d5/fdd x:0 0 0 2024-09-18T21:12:57.628 INFO:tasks.workunit.client.1.smithi103.stdout:1/632: sync 2024-09-18T21:12:57.628 INFO:tasks.workunit.client.1.smithi103.stdout:0/647: sync 2024-09-18T21:12:57.628 INFO:tasks.workunit.client.1.smithi103.stdout:5/716: sync 2024-09-18T21:12:57.629 INFO:tasks.workunit.client.1.smithi103.stdout:7/668: sync 2024-09-18T21:12:57.629 INFO:tasks.workunit.client.0.smithi077.stdout:8/566: write d2/d5f/da8/d20/f24 [780280,33427] 0 2024-09-18T21:12:57.631 INFO:tasks.workunit.client.1.smithi103.stdout:8/802: symlink d4/d2d/d4e/de9/l102 0 2024-09-18T21:12:57.632 INFO:tasks.workunit.client.0.smithi077.stdout:2/670: unlink d1/d4/d5/d1a/d49/d6a/d81/dc4/fad 0 2024-09-18T21:12:57.637 INFO:tasks.workunit.client.1.smithi103.stdout:9/728: dwrite d18/d52/d6f/d8e/d8f/dbd/dc3/fc4 [4194304,4194304] 0 2024-09-18T21:12:57.637 INFO:tasks.workunit.client.1.smithi103.stdout:3/655: getdents d1/d23/d25/d4f/d72/d7e/db2 0 2024-09-18T21:12:57.637 INFO:tasks.workunit.client.0.smithi077.stdout:3/578: unlink db/d14/d90/la3 0 2024-09-18T21:12:57.638 INFO:tasks.workunit.client.1.smithi103.stdout:1/633: chown d0/d3/d68/d81/da2/da4/dc2/dd8 4958 1 2024-09-18T21:12:57.639 INFO:tasks.workunit.client.0.smithi077.stdout:3/579: fsync db/d14/d32/d49/da4/f82 0 2024-09-18T21:12:57.639 INFO:tasks.workunit.client.0.smithi077.stdout:0/710: unlink d8/d1a/d39/d3b/d79/l7e 0 2024-09-18T21:12:57.640 INFO:tasks.workunit.client.0.smithi077.stdout:7/690: creat d12/d31/d77/d93/d2a/d7f/fe4 x:0 0 0 2024-09-18T21:12:57.641 INFO:tasks.workunit.client.1.smithi103.stdout:2/603: dread d3/d5/d2c/f88 [0,4194304] 0 2024-09-18T21:12:57.641 INFO:tasks.workunit.client.1.smithi103.stdout:1/634: chown d0/d2/d2b/c31 590320 1 2024-09-18T21:12:57.641 INFO:tasks.workunit.client.1.smithi103.stdout:7/669: rmdir d1/df/d43/d63/db9 39 2024-09-18T21:12:57.645 INFO:tasks.workunit.client.1.smithi103.stdout:0/648: rename d1/d9/d48/f75 to d1/d5/de/d22/d98/fe7 0 2024-09-18T21:12:57.645 INFO:tasks.workunit.client.1.smithi103.stdout:9/729: dwrite d18/d29/d68/f99 [0,4194304] 0 2024-09-18T21:12:57.645 INFO:tasks.workunit.client.0.smithi077.stdout:2/671: truncate d1/d4/f22 228862 0 2024-09-18T21:12:57.647 INFO:tasks.workunit.client.1.smithi103.stdout:4/761: rmdir d9/d1c/d69/df8 0 2024-09-18T21:12:57.649 INFO:tasks.workunit.client.1.smithi103.stdout:5/717: mkdir de/d1f/d3b/dec 0 2024-09-18T21:12:57.649 INFO:tasks.workunit.client.0.smithi077.stdout:0/711: chown d8/d1d/f2b 64 1 2024-09-18T21:12:57.650 INFO:tasks.workunit.client.0.smithi077.stdout:3/580: symlink db/d14/d32/d49/da4/d8a/d99/lb7 0 2024-09-18T21:12:57.651 INFO:tasks.workunit.client.0.smithi077.stdout:7/691: creat d12/d31/d77/d93/d2a/fe5 x:0 0 0 2024-09-18T21:12:57.653 INFO:tasks.workunit.client.1.smithi103.stdout:2/604: write d3/d5/d2f/d32/d46/fb0 [514663,13736] 0 2024-09-18T21:12:57.654 INFO:tasks.workunit.client.0.smithi077.stdout:2/672: mkdir d1/d4/d5/d1a/d2e/d41/d2c/dab/de2 0 2024-09-18T21:12:57.657 INFO:tasks.workunit.client.0.smithi077.stdout:0/712: unlink d8/d37/d66/d87/de0/lc3 0 2024-09-18T21:12:57.658 INFO:tasks.workunit.client.0.smithi077.stdout:6/562: dread d7/d7e/d11/d3e/d42/f8b [0,4194304] 0 2024-09-18T21:12:57.661 INFO:tasks.workunit.client.0.smithi077.stdout:7/692: symlink d12/d56/le6 0 2024-09-18T21:12:57.663 INFO:tasks.workunit.client.0.smithi077.stdout:5/744: link d0/df/d10/d47/l7d d0/d6/d3b/d64/d67/lf2 0 2024-09-18T21:12:57.665 INFO:tasks.workunit.client.0.smithi077.stdout:0/713: dwrite d8/d37/d95/dab/f7f [0,4194304] 0 2024-09-18T21:12:57.665 INFO:tasks.workunit.client.0.smithi077.stdout:2/673: creat d1/d4/d9/d80/d83/dba/ddc/fe3 x:0 0 0 2024-09-18T21:12:57.666 INFO:tasks.workunit.client.0.smithi077.stdout:5/745: creat d0/d6/dd/d5d/ff3 x:0 0 0 2024-09-18T21:12:57.667 INFO:tasks.workunit.client.0.smithi077.stdout:7/693: symlink d12/d31/d77/d93/le7 0 2024-09-18T21:12:57.669 INFO:tasks.workunit.client.0.smithi077.stdout:2/674: write d1/d4/d5/d1a/d49/fc9 [928666,79332] 0 2024-09-18T21:12:57.669 INFO:tasks.workunit.client.0.smithi077.stdout:6/563: link d7/d7e/d11/d3e/d42/dbb/d49/d55/l73 d7/d7e/lbe 0 2024-09-18T21:12:57.672 INFO:tasks.workunit.client.0.smithi077.stdout:0/714: rename d8/d1a/d35/d6d/c72 to d8/d1a/d39/d3b/d79/ce2 0 2024-09-18T21:12:57.672 INFO:tasks.workunit.client.0.smithi077.stdout:2/675: fsync d1/d4/d9/d80/d83/fbf 0 2024-09-18T21:12:57.674 INFO:tasks.workunit.client.0.smithi077.stdout:6/564: write d7/d7e/d11/d3e/f51 [1825630,112302] 0 2024-09-18T21:12:57.676 INFO:tasks.workunit.client.0.smithi077.stdout:7/694: mknod d12/d22/daa/dc0/d62/ce8 0 2024-09-18T21:12:57.677 INFO:tasks.workunit.client.0.smithi077.stdout:5/746: rename d0/df/d10/d47/da0/fc0 to d0/d6/dd/da5/ff4 0 2024-09-18T21:12:57.678 INFO:tasks.workunit.client.0.smithi077.stdout:5/747: write d0/d43/d6d/fa1 [2006889,71628] 0 2024-09-18T21:12:57.680 INFO:tasks.workunit.client.0.smithi077.stdout:6/565: write d7/d7e/d11/d3e/d42/dbb/d5c/f95 [106919,17776] 0 2024-09-18T21:12:57.685 INFO:tasks.workunit.client.0.smithi077.stdout:6/566: fdatasync d7/d7e/d11/f56 0 2024-09-18T21:12:57.689 INFO:tasks.workunit.client.0.smithi077.stdout:2/676: getdents d1/d4/d9/d80/d95 0 2024-09-18T21:12:57.692 INFO:tasks.workunit.client.0.smithi077.stdout:7/695: rename d12/d22/daa/dc0/d62/c6f to d12/d31/ce9 0 2024-09-18T21:12:57.694 INFO:tasks.workunit.client.0.smithi077.stdout:2/677: creat d1/d4/d9/d4f/fe4 x:0 0 0 2024-09-18T21:12:57.695 INFO:tasks.workunit.client.0.smithi077.stdout:5/748: getdents d0/d43/d6d 0 2024-09-18T21:12:57.698 INFO:tasks.workunit.client.0.smithi077.stdout:9/579: dwrite d1/dd/d11/d1c/f25 [0,4194304] 0 2024-09-18T21:12:57.699 INFO:tasks.workunit.client.0.smithi077.stdout:0/715: dread d8/d26/f15 [0,4194304] 0 2024-09-18T21:12:57.701 INFO:tasks.workunit.client.0.smithi077.stdout:6/567: link d7/d7e/d11/d3e/d42/f8b d7/d7e/d11/fbf 0 2024-09-18T21:12:57.702 INFO:tasks.workunit.client.0.smithi077.stdout:9/580: write d1/dd/d11/d2d/f32 [2748500,18777] 0 2024-09-18T21:12:57.702 INFO:tasks.workunit.client.1.smithi103.stdout:4/762: unlink d9/d38/d72/df0/d61/d91/fd0 0 2024-09-18T21:12:57.703 INFO:tasks.workunit.client.1.smithi103.stdout:1/635: symlink d0/d2/le1 0 2024-09-18T21:12:57.703 INFO:tasks.workunit.client.1.smithi103.stdout:3/656: mknod d1/d23/d25/d4f/dc6/cca 0 2024-09-18T21:12:57.705 INFO:tasks.workunit.client.0.smithi077.stdout:8/567: dwrite d2/d5f/da8/d4f/f5d [0,4194304] 0 2024-09-18T21:12:57.707 INFO:tasks.workunit.client.1.smithi103.stdout:2/605: dread - d3/d5/d2c/f43 zero size 2024-09-18T21:12:57.707 INFO:tasks.workunit.client.0.smithi077.stdout:2/678: mknod d1/d4/d5/d1a/d2e/d41/d2c/ddb/ce5 0 2024-09-18T21:12:57.709 INFO:tasks.workunit.client.1.smithi103.stdout:8/803: truncate d4/d81/d65/f83 1636260 0 2024-09-18T21:12:57.709 INFO:tasks.workunit.client.1.smithi103.stdout:9/730: dread d18/d8d/d2f/f97 [0,4194304] 0 2024-09-18T21:12:57.711 INFO:tasks.workunit.client.0.smithi077.stdout:0/716: fsync d8/d1a/d39/d3b/d9a/fc4 0 2024-09-18T21:12:57.714 INFO:tasks.workunit.client.0.smithi077.stdout:5/749: mkdir d0/df/dd2/df5 0 2024-09-18T21:12:57.718 INFO:tasks.workunit.client.1.smithi103.stdout:2/606: dread d3/d5/d2f/f91 [0,4194304] 0 2024-09-18T21:12:57.719 INFO:tasks.workunit.client.0.smithi077.stdout:8/568: creat d2/d5f/da8/d4f/fcc x:0 0 0 2024-09-18T21:12:57.719 INFO:tasks.workunit.client.1.smithi103.stdout:2/607: fsync d3/d5/d4a/f53 0 2024-09-18T21:12:57.720 INFO:tasks.workunit.client.0.smithi077.stdout:3/581: dwrite db/d14/d32/d49/da4/d71/f3e [0,4194304] 0 2024-09-18T21:12:57.720 INFO:tasks.workunit.client.1.smithi103.stdout:2/608: truncate d3/d5/d4a/fb9 283671 0 2024-09-18T21:12:57.722 INFO:tasks.workunit.client.0.smithi077.stdout:6/568: rename d7/d7e/d11/d3e/d42/d88/c92 to d7/d7e/d11/d3e/d42/dbb/d5c/cc0 0 2024-09-18T21:12:57.723 INFO:tasks.workunit.client.0.smithi077.stdout:2/679: mknod d1/d4/d9/d80/d95/ce6 0 2024-09-18T21:12:57.724 INFO:tasks.workunit.client.1.smithi103.stdout:5/718: dread de/d3e/d15/f8a [0,4194304] 0 2024-09-18T21:12:57.727 INFO:tasks.workunit.client.0.smithi077.stdout:9/581: symlink d1/dd/d11/d1c/d38/dae/lbf 0 2024-09-18T21:12:57.728 INFO:tasks.workunit.client.0.smithi077.stdout:9/582: fsync d1/dd/d11/d15/f86 0 2024-09-18T21:12:57.729 INFO:tasks.workunit.client.0.smithi077.stdout:3/582: dread db/d14/d32/d49/da4/f82 [0,4194304] 0 2024-09-18T21:12:57.729 INFO:tasks.workunit.client.0.smithi077.stdout:9/583: read - d1/d54/fbe zero size 2024-09-18T21:12:57.730 INFO:tasks.workunit.client.0.smithi077.stdout:9/584: write d1/dd/d11/d2d/fb6 [449332,30858] 0 2024-09-18T21:12:57.731 INFO:tasks.workunit.client.1.smithi103.stdout:2/609: rmdir d3/d5/d2c/d54/d68 39 2024-09-18T21:12:57.732 INFO:tasks.workunit.client.0.smithi077.stdout:8/569: rmdir d2/d5f 39 2024-09-18T21:12:57.733 INFO:tasks.workunit.client.1.smithi103.stdout:5/719: symlink de/d1f/d3b/d58/dc4/d33/d4f/led 0 2024-09-18T21:12:57.734 INFO:tasks.workunit.client.1.smithi103.stdout:5/720: readlink de/d1f/l5f 0 2024-09-18T21:12:57.734 INFO:tasks.workunit.client.0.smithi077.stdout:6/569: rename d7/f2d to d7/d7e/da6/fc1 0 2024-09-18T21:12:57.738 INFO:tasks.workunit.client.1.smithi103.stdout:1/636: dread d0/d2/d9/f59 [0,4194304] 0 2024-09-18T21:12:57.739 INFO:tasks.workunit.client.0.smithi077.stdout:7/696: truncate d12/d31/fda 517206 0 2024-09-18T21:12:57.740 INFO:tasks.workunit.client.1.smithi103.stdout:4/763: dread d9/d38/d72/d85/dd8/f5c [0,4194304] 0 2024-09-18T21:12:57.741 INFO:tasks.workunit.client.1.smithi103.stdout:5/721: mknod de/d1f/d3b/d58/dc4/d33/cee 0 2024-09-18T21:12:57.742 INFO:tasks.workunit.client.0.smithi077.stdout:3/583: rmdir db/d14/d32/d49/da4/d8a 39 2024-09-18T21:12:57.745 INFO:tasks.workunit.client.1.smithi103.stdout:1/637: mknod d0/d3/d68/d81/da2/da4/dc2/ce2 0 2024-09-18T21:12:57.747 INFO:tasks.workunit.client.1.smithi103.stdout:6/702: sync 2024-09-18T21:12:57.747 INFO:tasks.workunit.client.1.smithi103.stdout:4/764: truncate d9/d38/d58/fbb 1039778 0 2024-09-18T21:12:57.748 INFO:tasks.workunit.client.1.smithi103.stdout:5/722: symlink de/d1f/d3b/d51/d57/d79/d8d/lef 0 2024-09-18T21:12:57.749 INFO:tasks.workunit.client.0.smithi077.stdout:6/570: mkdir d7/d7e/d11/d3e/d42/dbb/d49/d55/dc2 0 2024-09-18T21:12:57.750 INFO:tasks.workunit.client.1.smithi103.stdout:3/657: truncate d1/da/f15 2588266 0 2024-09-18T21:12:57.751 INFO:tasks.workunit.client.0.smithi077.stdout:2/680: fsync d1/d4/d5/d1a/d2e/f37 0 2024-09-18T21:12:57.752 INFO:tasks.workunit.client.1.smithi103.stdout:1/638: mknod d0/d11/d5f/d19/ce3 0 2024-09-18T21:12:57.753 INFO:tasks.workunit.client.1.smithi103.stdout:8/804: dwrite d4/d26/f4d [0,4194304] 0 2024-09-18T21:12:57.755 INFO:tasks.workunit.client.1.smithi103.stdout:6/703: dwrite d2/d24/d38/d68/dac/fc6 [0,4194304] 0 2024-09-18T21:12:57.756 INFO:tasks.workunit.client.1.smithi103.stdout:5/723: truncate de/d2d/d7f/f87 120907 0 2024-09-18T21:12:57.756 INFO:tasks.workunit.client.0.smithi077.stdout:7/697: creat d12/d31/d77/da0/fea x:0 0 0 2024-09-18T21:12:57.757 INFO:tasks.workunit.client.1.smithi103.stdout:2/610: link d3/d5/fd0 d3/d5/fde 0 2024-09-18T21:12:57.761 INFO:tasks.workunit.client.1.smithi103.stdout:3/658: unlink d1/d23/f63 0 2024-09-18T21:12:57.764 INFO:tasks.workunit.client.1.smithi103.stdout:4/765: dread d9/d38/f51 [0,4194304] 0 2024-09-18T21:12:57.764 INFO:tasks.workunit.client.1.smithi103.stdout:4/766: stat d9/d38/d72/d85/dd8 0 2024-09-18T21:12:57.765 INFO:tasks.workunit.client.0.smithi077.stdout:8/570: creat d2/d5f/da8/d26/fcd x:0 0 0 2024-09-18T21:12:57.765 INFO:tasks.workunit.client.0.smithi077.stdout:4/560: sync 2024-09-18T21:12:57.768 INFO:tasks.workunit.client.1.smithi103.stdout:8/805: symlink d4/d2d/dc1/dee/l103 0 2024-09-18T21:12:57.769 INFO:tasks.workunit.client.1.smithi103.stdout:6/704: creat d2/d3/d7f/d91/fdb x:0 0 0 2024-09-18T21:12:57.771 INFO:tasks.workunit.client.0.smithi077.stdout:2/681: mkdir d1/d4/d9/d80/d8e/de7 0 2024-09-18T21:12:57.773 INFO:tasks.workunit.client.1.smithi103.stdout:5/724: chown de/d1f/d3b/d51/d57/c96 185417 1 2024-09-18T21:12:57.773 INFO:tasks.workunit.client.0.smithi077.stdout:0/717: getdents d8/d37/d66 0 2024-09-18T21:12:57.775 INFO:tasks.workunit.client.0.smithi077.stdout:7/698: mknod d12/d22/daa/dc0/d62/ceb 0 2024-09-18T21:12:57.776 INFO:tasks.workunit.client.0.smithi077.stdout:3/584: getdents db/d14/d32/d49/d4e/d6a/db5 0 2024-09-18T21:12:57.777 INFO:tasks.workunit.client.0.smithi077.stdout:3/585: chown db/d14/d90/db2 1534895499 1 2024-09-18T21:12:57.777 INFO:tasks.workunit.client.1.smithi103.stdout:3/659: mkdir d1/da/df/d70/dcb 0 2024-09-18T21:12:57.778 INFO:tasks.workunit.client.0.smithi077.stdout:9/585: creat d1/d54/fc0 x:0 0 0 2024-09-18T21:12:57.781 INFO:tasks.workunit.client.0.smithi077.stdout:6/571: write d7/d7e/d11/d3e/d42/dbb/d4c/f8a [1006966,38279] 0 2024-09-18T21:12:57.781 INFO:tasks.workunit.client.0.smithi077.stdout:8/571: mkdir d2/d27/d29/d41/dbc/dce 0 2024-09-18T21:12:57.783 INFO:tasks.workunit.client.1.smithi103.stdout:1/639: truncate d0/d2/d9/dc/d36/f6d 120962 0 2024-09-18T21:12:57.784 INFO:tasks.workunit.client.1.smithi103.stdout:1/640: write d0/d2/d2b/d3a/d42/d87/fbf [734501,38919] 0 2024-09-18T21:12:57.785 INFO:tasks.workunit.client.0.smithi077.stdout:2/682: unlink d1/d4/d5/f3a 0 2024-09-18T21:12:57.785 INFO:tasks.workunit.client.1.smithi103.stdout:1/641: readlink d0/d2/d9/dc/l3b 0 2024-09-18T21:12:57.786 INFO:tasks.workunit.client.0.smithi077.stdout:0/718: fdatasync d8/d1a/d35/f7a 0 2024-09-18T21:12:57.787 INFO:tasks.workunit.client.1.smithi103.stdout:2/611: mkdir d3/d5/d2f/d32/dae/ddf 0 2024-09-18T21:12:57.791 INFO:tasks.workunit.client.1.smithi103.stdout:3/660: rmdir d1/d23/d25/d4f/d58/d68 39 2024-09-18T21:12:57.791 INFO:tasks.workunit.client.1.smithi103.stdout:3/661: chown d1/d23/d47/l78 5148 1 2024-09-18T21:12:57.792 INFO:tasks.workunit.client.0.smithi077.stdout:9/586: creat d1/d54/d27/fc1 x:0 0 0 2024-09-18T21:12:57.794 INFO:tasks.workunit.client.0.smithi077.stdout:4/561: dwrite d3/dc/f1b [0,4194304] 0 2024-09-18T21:12:57.795 INFO:tasks.workunit.client.0.smithi077.stdout:9/587: write d1/dd/d11/d1c/d38/d46/f8a [1232444,46945] 0 2024-09-18T21:12:57.797 INFO:tasks.workunit.client.0.smithi077.stdout:6/572: rmdir d7/d7c 39 2024-09-18T21:12:57.798 INFO:tasks.workunit.client.0.smithi077.stdout:2/683: dread d1/fd [4194304,4194304] 0 2024-09-18T21:12:57.799 INFO:tasks.workunit.client.1.smithi103.stdout:6/705: creat d2/d24/d5a/d67/d76/da4/dc7/fdc x:0 0 0 2024-09-18T21:12:57.800 INFO:tasks.workunit.client.0.smithi077.stdout:2/684: chown d1/d4/d5/d1a/d2e/d40/l7c 765939 1 2024-09-18T21:12:57.802 INFO:tasks.workunit.client.0.smithi077.stdout:8/572: dread d2/d27/d29/d72/f9d [0,4194304] 0 2024-09-18T21:12:57.802 INFO:tasks.workunit.client.0.smithi077.stdout:2/685: write d1/d4/d5/f53 [11725093,82602] 0 2024-09-18T21:12:57.807 INFO:tasks.workunit.client.1.smithi103.stdout:5/725: creat de/d1f/d3b/d58/dc4/d9c/ff0 x:0 0 0 2024-09-18T21:12:57.807 INFO:tasks.workunit.client.0.smithi077.stdout:6/573: dwrite d7/d7e/d11/d3e/d42/dbb/d49/fbc [0,4194304] 0 2024-09-18T21:12:57.808 INFO:tasks.workunit.client.1.smithi103.stdout:4/767: dwrite d9/d38/d58/fbb [0,4194304] 0 2024-09-18T21:12:57.809 INFO:tasks.workunit.client.1.smithi103.stdout:4/768: chown d9/de3/lfb 111927 1 2024-09-18T21:12:57.809 INFO:tasks.workunit.client.0.smithi077.stdout:0/719: truncate d8/f19 508094 0 2024-09-18T21:12:57.810 INFO:tasks.workunit.client.1.smithi103.stdout:1/642: write d0/d3/f4b [1542975,31119] 0 2024-09-18T21:12:57.811 INFO:tasks.workunit.client.0.smithi077.stdout:8/573: dread d2/d5f/da8/d4f/f5d [0,4194304] 0 2024-09-18T21:12:57.812 INFO:tasks.workunit.client.1.smithi103.stdout:6/706: symlink d2/d24/d5a/d67/d76/da4/ldd 0 2024-09-18T21:12:57.814 INFO:tasks.workunit.client.0.smithi077.stdout:4/562: mkdir d3/d35/db1 0 2024-09-18T21:12:57.815 INFO:tasks.workunit.client.0.smithi077.stdout:9/588: rename d1/dd/d11/d1c/d38/d46/d55/d9c/dbd to d1/dd/d11/d1c/d38/d46/daf/dc2 0 2024-09-18T21:12:57.817 INFO:tasks.workunit.client.1.smithi103.stdout:5/726: rename de/d1f/l71 to de/d1f/d3b/d51/db0/lf1 0 2024-09-18T21:12:57.819 INFO:tasks.workunit.client.1.smithi103.stdout:2/612: dwrite d3/d5/d4a/f5e [0,4194304] 0 2024-09-18T21:12:57.821 INFO:tasks.workunit.client.1.smithi103.stdout:3/662: write d1/da/df/f19 [1349968,4291] 0 2024-09-18T21:12:57.821 INFO:tasks.workunit.client.1.smithi103.stdout:6/707: mkdir d2/d24/d38/d68/dac/dde 0 2024-09-18T21:12:57.822 INFO:tasks.workunit.client.1.smithi103.stdout:2/613: dread d3/d5/d2c/f88 [0,4194304] 0 2024-09-18T21:12:57.824 INFO:tasks.workunit.client.1.smithi103.stdout:6/708: fsync d2/d24/d5a/d67/d76/d43/d44/f6e 0 2024-09-18T21:12:57.824 INFO:tasks.workunit.client.1.smithi103.stdout:5/727: mkdir de/d1f/d3b/db4/df2 0 2024-09-18T21:12:57.825 INFO:tasks.workunit.client.1.smithi103.stdout:1/643: mknod d0/d11/ce4 0 2024-09-18T21:12:57.827 INFO:tasks.workunit.client.1.smithi103.stdout:3/663: mknod d1/d9a/ccc 0 2024-09-18T21:12:57.828 INFO:tasks.workunit.client.0.smithi077.stdout:3/586: link db/d14/d22/c25 db/d14/cb8 0 2024-09-18T21:12:57.830 INFO:tasks.workunit.client.0.smithi077.stdout:3/587: readlink db/d14/d32/d49/da4/d71/l5f 0 2024-09-18T21:12:57.831 INFO:tasks.workunit.client.1.smithi103.stdout:5/728: creat de/d1f/d3b/db4/ff3 x:0 0 0 2024-09-18T21:12:57.832 INFO:tasks.workunit.client.0.smithi077.stdout:3/588: chown db/d14/d32/d49/d4e/d6a 2 1 2024-09-18T21:12:57.833 INFO:tasks.workunit.client.0.smithi077.stdout:7/699: truncate d12/d31/d77/d93/f7c 512299 0 2024-09-18T21:12:57.834 INFO:tasks.workunit.client.1.smithi103.stdout:1/644: mknod d0/d2/d2b/d3a/d42/d72/db0/ce5 0 2024-09-18T21:12:57.835 INFO:tasks.workunit.client.0.smithi077.stdout:8/574: dwrite d2/d27/d29/d72/f8c [0,4194304] 0 2024-09-18T21:12:57.836 INFO:tasks.workunit.client.0.smithi077.stdout:3/589: truncate db/d14/d93/f96 841486 0 2024-09-18T21:12:57.839 INFO:tasks.workunit.client.1.smithi103.stdout:3/664: readlink d1/d23/d25/d4f/d58/d68/d50/d54/d8c/l9e 0 2024-09-18T21:12:57.839 INFO:tasks.workunit.client.0.smithi077.stdout:9/589: creat d1/dd/d11/d1c/d38/d46/d55/d7f/fc3 x:0 0 0 2024-09-18T21:12:57.841 INFO:tasks.workunit.client.1.smithi103.stdout:5/729: chown de/d1f/l21 0 1 2024-09-18T21:12:57.844 INFO:tasks.workunit.client.1.smithi103.stdout:6/709: dread d2/d24/d5a/d67/f95 [0,4194304] 0 2024-09-18T21:12:57.844 INFO:tasks.workunit.client.1.smithi103.stdout:1/645: rename d0/d3/l8 to d0/d2/d2b/d3a/d42/d87/le6 0 2024-09-18T21:12:57.845 INFO:tasks.workunit.client.1.smithi103.stdout:6/710: chown d2/d3/d8/f29 0 1 2024-09-18T21:12:57.848 INFO:tasks.workunit.client.0.smithi077.stdout:0/720: mkdir d8/d1d/de3 0 2024-09-18T21:12:57.849 INFO:tasks.workunit.client.1.smithi103.stdout:1/646: creat d0/d3/d68/d81/da2/fe7 x:0 0 0 2024-09-18T21:12:57.852 INFO:tasks.workunit.client.0.smithi077.stdout:4/563: link d3/dc/d20/f97 d3/dc/d24/d72/fb2 0 2024-09-18T21:12:57.853 INFO:tasks.workunit.client.0.smithi077.stdout:4/564: fdatasync d3/dc/d20/f7d 0 2024-09-18T21:12:57.855 INFO:tasks.workunit.client.1.smithi103.stdout:1/647: write d0/d2/fc8 [2689187,87504] 0 2024-09-18T21:12:57.856 INFO:tasks.workunit.client.1.smithi103.stdout:4/769: dread d9/d1c/d77/f3d [0,4194304] 0 2024-09-18T21:12:57.859 INFO:tasks.workunit.client.0.smithi077.stdout:9/590: rename d1/dd/d1a/d42/d4b/c63 to d1/dd/d11/d1c/d38/d46/daf/dc2/cc4 0 2024-09-18T21:12:57.863 INFO:tasks.workunit.client.0.smithi077.stdout:6/574: dread d7/d7e/d11/d3e/d42/dbb/f2e [0,4194304] 0 2024-09-18T21:12:57.864 INFO:tasks.workunit.client.0.smithi077.stdout:6/575: readlink d7/d7e/l54 0 2024-09-18T21:12:57.865 INFO:tasks.workunit.client.1.smithi103.stdout:3/665: dread d1/d2/d18/f44 [0,4194304] 0 2024-09-18T21:12:57.866 INFO:tasks.workunit.client.0.smithi077.stdout:8/575: mknod d2/d5/d6/ccf 0 2024-09-18T21:12:57.868 INFO:tasks.workunit.client.0.smithi077.stdout:4/565: creat d3/d7/d42/fb3 x:0 0 0 2024-09-18T21:12:57.870 INFO:tasks.workunit.client.0.smithi077.stdout:4/566: read - d3/dc/d20/f6a zero size 2024-09-18T21:12:57.871 INFO:tasks.workunit.client.1.smithi103.stdout:4/770: link d9/d38/fba d9/de3/f108 0 2024-09-18T21:12:57.871 INFO:tasks.workunit.client.0.smithi077.stdout:4/567: chown d3/d7/d73 1203 1 2024-09-18T21:12:57.871 INFO:tasks.workunit.client.0.smithi077.stdout:4/568: chown d3/d7/d73/fa2 21 1 2024-09-18T21:12:57.874 INFO:tasks.workunit.client.1.smithi103.stdout:3/666: mkdir d1/d23/d25/d4f/d72/d7e/db2/dcd 0 2024-09-18T21:12:57.875 INFO:tasks.workunit.client.1.smithi103.stdout:3/667: chown d1/f31 84087 1 2024-09-18T21:12:57.877 INFO:tasks.workunit.client.0.smithi077.stdout:9/591: creat d1/dd/d11/d2d/fc5 x:0 0 0 2024-09-18T21:12:57.877 INFO:tasks.workunit.client.0.smithi077.stdout:2/686: link d1/d4/d5/lb6 d1/d4/d9/d80/d8e/de7/le8 0 2024-09-18T21:12:57.878 INFO:tasks.workunit.client.1.smithi103.stdout:6/711: dwrite d2/d3/d8/d4c/d4e/f9a [0,4194304] 0 2024-09-18T21:12:57.879 INFO:tasks.workunit.client.0.smithi077.stdout:3/590: write db/d14/d22/d36/f73 [4831557,83758] 0 2024-09-18T21:12:57.879 INFO:tasks.workunit.client.0.smithi077.stdout:6/576: chown d7/d7c/f97 13 1 2024-09-18T21:12:57.880 INFO:tasks.workunit.client.0.smithi077.stdout:0/721: mkdir d8/d37/d95/de4 0 2024-09-18T21:12:57.880 INFO:tasks.workunit.client.1.smithi103.stdout:3/668: mkdir d1/d23/d25/d4f/dce 0 2024-09-18T21:12:57.881 INFO:tasks.workunit.client.0.smithi077.stdout:0/722: read - d8/d1a/d35/fb9 zero size 2024-09-18T21:12:57.882 INFO:tasks.workunit.client.0.smithi077.stdout:8/576: creat d2/d5f/da8/d20/d3e/db4/fd0 x:0 0 0 2024-09-18T21:12:57.883 INFO:tasks.workunit.client.1.smithi103.stdout:7/670: sync 2024-09-18T21:12:57.884 INFO:tasks.workunit.client.0.smithi077.stdout:4/569: write d3/d7/d7b/d88/f8d [513186,112698] 0 2024-09-18T21:12:57.884 INFO:tasks.workunit.client.1.smithi103.stdout:3/669: dread d1/d23/d47/fb6 [0,4194304] 0 2024-09-18T21:12:57.886 INFO:tasks.workunit.client.0.smithi077.stdout:2/687: rename d1 to d1/d4/d5/d1a/d2e/de9 22 2024-09-18T21:12:57.887 INFO:tasks.workunit.client.1.smithi103.stdout:1/648: write d0/d3/d68/d81/da2/da4/dc2/dd8/fde [1110595,89032] 0 2024-09-18T21:12:57.889 INFO:tasks.workunit.client.0.smithi077.stdout:9/592: dread d1/dd/d11/d1c/f7d [0,4194304] 0 2024-09-18T21:12:57.890 INFO:tasks.workunit.client.1.smithi103.stdout:6/712: creat d2/d3/fdf x:0 0 0 2024-09-18T21:12:57.890 INFO:tasks.workunit.client.0.smithi077.stdout:2/688: fdatasync d1/d4/d5/d1a/d2e/d41/f3f 0 2024-09-18T21:12:57.890 INFO:tasks.workunit.client.1.smithi103.stdout:1/649: truncate d0/d2/d2b/d3a/d42/d72/f8f 100741 0 2024-09-18T21:12:57.891 INFO:tasks.workunit.client.0.smithi077.stdout:3/591: unlink db/d14/d32/d49/d6b/c9f 0 2024-09-18T21:12:57.892 INFO:tasks.workunit.client.0.smithi077.stdout:8/577: dwrite d2/d27/d29/d41/dbc/f78 [0,4194304] 0 2024-09-18T21:12:57.893 INFO:tasks.workunit.client.1.smithi103.stdout:7/671: dwrite d1/df/d42/d29/d48/dbb/d33/d9d/fc8 [4194304,4194304] 0 2024-09-18T21:12:57.895 INFO:tasks.workunit.client.1.smithi103.stdout:7/672: fsync d1/df/d43/db1/fc4 0 2024-09-18T21:12:57.898 INFO:tasks.workunit.client.1.smithi103.stdout:1/650: rmdir d0/d3/d68/d81/da2/da4/dc2 39 2024-09-18T21:12:57.898 INFO:tasks.workunit.client.0.smithi077.stdout:7/700: truncate d12/d22/d59/d5a/f69 2126592 0 2024-09-18T21:12:57.899 INFO:tasks.workunit.client.0.smithi077.stdout:3/592: read db/d14/d32/d49/d4e/d6a/f88 [344769,19345] 0 2024-09-18T21:12:57.900 INFO:tasks.workunit.client.1.smithi103.stdout:1/651: write d0/d2/d9/f65 [834993,1424] 0 2024-09-18T21:12:57.900 INFO:tasks.workunit.client.0.smithi077.stdout:3/593: write db/d14/d32/d49/da4/f82 [2484036,67906] 0 2024-09-18T21:12:57.904 INFO:tasks.workunit.client.1.smithi103.stdout:7/673: rename d1/df/d42/d1f/d2e/d3f/f56 to d1/df/d43/d61/fd6 0 2024-09-18T21:12:57.904 INFO:tasks.workunit.client.0.smithi077.stdout:8/578: creat d2/d5f/d6f/fd1 x:0 0 0 2024-09-18T21:12:57.906 INFO:tasks.workunit.client.0.smithi077.stdout:4/570: fsync d3/dc/d24/f8e 0 2024-09-18T21:12:57.907 INFO:tasks.workunit.client.1.smithi103.stdout:7/674: read d1/df/d42/d29/d48/dbb/d33/d9d/fc8 [4548792,50827] 0 2024-09-18T21:12:57.908 INFO:tasks.workunit.client.1.smithi103.stdout:4/771: dwrite d9/fa [0,4194304] 0 2024-09-18T21:12:57.910 INFO:tasks.workunit.client.1.smithi103.stdout:7/675: chown d1/df/d43/d63/d67/d5b/c84 1912701 1 2024-09-18T21:12:57.911 INFO:tasks.workunit.client.1.smithi103.stdout:6/713: link d2/d24/d5a/d67/d76/l8a d2/d24/d5a/d67/d76/da4/le0 0 2024-09-18T21:12:57.915 INFO:tasks.workunit.client.0.smithi077.stdout:0/723: rename d8/d37/d66/d87/fa4 to d8/d1a/fe5 0 2024-09-18T21:12:57.916 INFO:tasks.workunit.client.1.smithi103.stdout:7/676: truncate d1/df/d42/f1e 4916052 0 2024-09-18T21:12:57.916 INFO:tasks.workunit.client.0.smithi077.stdout:6/577: link d7/f1c d7/d7e/d11/d3e/d42/dbb/d31/fc3 0 2024-09-18T21:12:57.916 INFO:tasks.workunit.client.0.smithi077.stdout:1/640: sync 2024-09-18T21:12:57.917 INFO:tasks.workunit.client.1.smithi103.stdout:6/714: mkdir d2/d3/d8/de1 0 2024-09-18T21:12:57.921 INFO:tasks.workunit.client.1.smithi103.stdout:7/677: creat d1/df/d43/db1/fd7 x:0 0 0 2024-09-18T21:12:57.925 INFO:tasks.workunit.client.1.smithi103.stdout:4/772: getdents d9/d38/d72/df0/d61 0 2024-09-18T21:12:57.926 INFO:tasks.workunit.client.0.smithi077.stdout:2/689: rename d1/d4/d5/d1a/d2e/d40/l7c to d1/d4/d5/d1a/d49/d6a/d81/dc4/dc0/lea 0 2024-09-18T21:12:57.929 INFO:tasks.workunit.client.1.smithi103.stdout:7/678: creat d1/df/d42/d1f/d5d/d85/db0/fd8 x:0 0 0 2024-09-18T21:12:57.930 INFO:tasks.workunit.client.0.smithi077.stdout:9/593: getdents d1/dd/d11/d15/d80 0 2024-09-18T21:12:57.931 INFO:tasks.workunit.client.1.smithi103.stdout:4/773: rmdir d9/d38/d72/df0/d83/db6 39 2024-09-18T21:12:57.933 INFO:tasks.workunit.client.1.smithi103.stdout:7/679: dread d1/df/d43/d52/f75 [0,4194304] 0 2024-09-18T21:12:57.934 INFO:tasks.workunit.client.0.smithi077.stdout:7/701: truncate d12/d31/d77/d93/f7c 730441 0 2024-09-18T21:12:57.934 INFO:tasks.workunit.client.1.smithi103.stdout:1/652: dwrite d0/d2/d9/f2f [0,4194304] 0 2024-09-18T21:12:57.935 INFO:tasks.workunit.client.1.smithi103.stdout:7/680: read d1/df/d44/fa0 [140973,81192] 0 2024-09-18T21:12:57.936 INFO:tasks.workunit.client.0.smithi077.stdout:3/594: write db/f95 [271217,106020] 0 2024-09-18T21:12:57.937 INFO:tasks.workunit.client.0.smithi077.stdout:2/690: creat d1/d4/d9/d80/d95/feb x:0 0 0 2024-09-18T21:12:57.938 INFO:tasks.workunit.client.1.smithi103.stdout:7/681: write d1/df/d42/d29/fbd [460215,101585] 0 2024-09-18T21:12:57.938 INFO:tasks.workunit.client.0.smithi077.stdout:1/641: mknod d3/d6a/d9b/ce1 0 2024-09-18T21:12:57.940 INFO:tasks.workunit.client.0.smithi077.stdout:1/642: read - d3/d6a/d9b/d4c/f5c zero size 2024-09-18T21:12:57.940 INFO:tasks.workunit.client.1.smithi103.stdout:7/682: read d1/df/d54/f5a [734798,28448] 0 2024-09-18T21:12:57.941 INFO:tasks.workunit.client.1.smithi103.stdout:4/774: dwrite d9/d38/d72/d85/dd8/f44 [0,4194304] 0 2024-09-18T21:12:57.941 INFO:tasks.workunit.client.1.smithi103.stdout:7/683: chown d1/df/d42/d1f/d2e/d3f 340 1 2024-09-18T21:12:57.942 INFO:tasks.workunit.client.1.smithi103.stdout:4/775: fsync d9/d1c/f42 0 2024-09-18T21:12:57.942 INFO:tasks.workunit.client.1.smithi103.stdout:1/653: rmdir d0/d2/d9/dc/d6e 39 2024-09-18T21:12:57.943 INFO:tasks.workunit.client.0.smithi077.stdout:9/594: mkdir d1/dd/d11/d2d/dc6 0 2024-09-18T21:12:57.943 INFO:tasks.workunit.client.1.smithi103.stdout:7/684: dread - d1/df/d44/db4/fc1 zero size 2024-09-18T21:12:57.947 INFO:tasks.workunit.client.0.smithi077.stdout:6/578: truncate d7/d7e/d11/d3e/d42/dbb/d31/f71 2262555 0 2024-09-18T21:12:57.951 INFO:tasks.workunit.client.0.smithi077.stdout:8/579: link d2/d5f/da8/d20/c92 d2/d5f/da8/d4f/d5a/d2a/d67/cd2 0 2024-09-18T21:12:57.952 INFO:tasks.workunit.client.1.smithi103.stdout:6/715: write d2/f22 [879041,27439] 0 2024-09-18T21:12:57.952 INFO:tasks.workunit.client.0.smithi077.stdout:4/571: dwrite d3/dc/fb0 [0,4194304] 0 2024-09-18T21:12:57.953 INFO:tasks.workunit.client.0.smithi077.stdout:8/580: write d2/d27/d29/f90 [1194559,106940] 0 2024-09-18T21:12:57.954 INFO:tasks.workunit.client.1.smithi103.stdout:6/716: write d2/d3/d8/d4c/d4e/f70 [3314691,21925] 0 2024-09-18T21:12:57.955 INFO:tasks.workunit.client.1.smithi103.stdout:4/776: mknod d9/d1c/db1/c109 0 2024-09-18T21:12:57.957 INFO:tasks.workunit.client.0.smithi077.stdout:3/595: fsync db/d14/d22/f2f 0 2024-09-18T21:12:57.959 INFO:tasks.workunit.client.0.smithi077.stdout:5/750: sync 2024-09-18T21:12:57.961 INFO:tasks.workunit.client.1.smithi103.stdout:1/654: unlink d0/l32 0 2024-09-18T21:12:57.962 INFO:tasks.workunit.client.0.smithi077.stdout:1/643: mknod d3/d6a/d9b/dbe/ce2 0 2024-09-18T21:12:57.965 INFO:tasks.workunit.client.1.smithi103.stdout:4/777: symlink d9/d38/l10a 0 2024-09-18T21:12:57.968 INFO:tasks.workunit.client.1.smithi103.stdout:7/685: creat d1/df/d42/d1f/d2e/fd9 x:0 0 0 2024-09-18T21:12:57.968 INFO:tasks.workunit.client.0.smithi077.stdout:7/702: creat d12/d22/d59/d72/d91/fec x:0 0 0 2024-09-18T21:12:57.969 INFO:tasks.workunit.client.1.smithi103.stdout:1/655: symlink d0/d2/d9/dc/d6e/le8 0 2024-09-18T21:12:57.969 INFO:tasks.workunit.client.1.smithi103.stdout:4/778: mkdir d9/d38/d72/d85/dd8/d10b 0 2024-09-18T21:12:57.969 INFO:tasks.workunit.client.1.smithi103.stdout:7/686: fdatasync d1/df/d42/f83 0 2024-09-18T21:12:57.971 INFO:tasks.workunit.client.0.smithi077.stdout:0/724: rename d8/f3a to d8/d26/fe6 0 2024-09-18T21:12:57.971 INFO:tasks.workunit.client.1.smithi103.stdout:1/656: truncate d0/d2/d2b/d3a/d42/d72/f8f 1051899 0 2024-09-18T21:12:57.973 INFO:tasks.workunit.client.1.smithi103.stdout:4/779: chown d9/d38/d72/df0/d83/db6/d41/fc7 1046877326 1 2024-09-18T21:12:57.974 INFO:tasks.workunit.client.0.smithi077.stdout:9/595: mknod d1/dd/d11/cc7 0 2024-09-18T21:12:57.974 INFO:tasks.workunit.client.0.smithi077.stdout:1/644: symlink d3/d38/dd5/le3 0 2024-09-18T21:12:57.975 INFO:tasks.workunit.client.0.smithi077.stdout:8/581: dwrite d2/d5f/da8/d26/f60 [0,4194304] 0 2024-09-18T21:12:57.976 INFO:tasks.workunit.client.1.smithi103.stdout:1/657: rename d0/d2/d9/dc/f69 to d0/d2/d9/d9e/fe9 0 2024-09-18T21:12:57.977 INFO:tasks.workunit.client.1.smithi103.stdout:7/687: dwrite d1/df/d42/d29/d48/dbb/f9a [0,4194304] 0 2024-09-18T21:12:57.978 INFO:tasks.workunit.client.0.smithi077.stdout:1/645: truncate d3/d6a/d9b/dbe/fce 929814 0 2024-09-18T21:12:57.979 INFO:tasks.workunit.client.0.smithi077.stdout:6/579: dread d7/d7e/d11/d3e/d42/d88/da4/f2b [0,4194304] 0 2024-09-18T21:12:57.979 INFO:tasks.workunit.client.1.smithi103.stdout:4/780: creat d9/d1c/dcd/dd1/f10c x:0 0 0 2024-09-18T21:12:57.981 INFO:tasks.workunit.client.1.smithi103.stdout:4/781: dread - d9/d38/d72/df0/d83/db6/d41/fc7 zero size 2024-09-18T21:12:57.984 INFO:tasks.workunit.client.0.smithi077.stdout:8/582: dread d2/d5/f16 [0,4194304] 0 2024-09-18T21:12:57.984 INFO:tasks.workunit.client.0.smithi077.stdout:7/703: mkdir d12/d56/ded 0 2024-09-18T21:12:57.986 INFO:tasks.workunit.client.1.smithi103.stdout:1/658: chown d0/d2/d2b/d3a/f91 1403125 1 2024-09-18T21:12:57.989 INFO:tasks.workunit.client.1.smithi103.stdout:6/717: dread d2/d3/d7f/f85 [0,4194304] 0 2024-09-18T21:12:57.989 INFO:tasks.workunit.client.0.smithi077.stdout:3/596: creat db/d14/d90/db2/fb9 x:0 0 0 2024-09-18T21:12:57.990 INFO:tasks.workunit.client.0.smithi077.stdout:3/597: dread - db/f68 zero size 2024-09-18T21:12:57.992 INFO:tasks.workunit.client.0.smithi077.stdout:4/572: rmdir d3/dc/d24/da8 0 2024-09-18T21:12:57.994 INFO:tasks.workunit.client.1.smithi103.stdout:7/688: dwrite d1/df/d43/d61/fd6 [0,4194304] 0 2024-09-18T21:12:57.995 INFO:tasks.workunit.client.1.smithi103.stdout:1/659: dwrite d0/d2/d9/dc/f28 [0,4194304] 0 2024-09-18T21:12:57.996 INFO:tasks.workunit.client.0.smithi077.stdout:2/691: write d1/d4/d5/d1a/d2e/fde [3772281,15942] 0 2024-09-18T21:12:57.999 INFO:tasks.workunit.client.0.smithi077.stdout:4/573: dread d3/dc/d24/f8e [0,4194304] 0 2024-09-18T21:12:58.000 INFO:tasks.workunit.client.1.smithi103.stdout:7/689: write d1/df/d42/d29/d48/dbb/d33/fae [929195,95103] 0 2024-09-18T21:12:58.000 INFO:tasks.workunit.client.1.smithi103.stdout:0/649: sync 2024-09-18T21:12:58.000 INFO:tasks.workunit.client.0.smithi077.stdout:4/574: chown d3/d7/d7b/f92 0 1 2024-09-18T21:12:58.001 INFO:tasks.workunit.client.0.smithi077.stdout:4/575: write d3/dc/fb0 [471397,39154] 0 2024-09-18T21:12:58.002 INFO:tasks.workunit.client.1.smithi103.stdout:6/718: truncate d2/d3/f19 3675744 0 2024-09-18T21:12:58.003 INFO:tasks.workunit.client.1.smithi103.stdout:6/719: chown d2/d3/d8/d4c/d4e/l73 7138312 1 2024-09-18T21:12:58.004 INFO:tasks.workunit.client.0.smithi077.stdout:0/725: symlink d8/le7 0 2024-09-18T21:12:58.006 INFO:tasks.workunit.client.0.smithi077.stdout:9/596: dread d1/dd/f14 [0,4194304] 0 2024-09-18T21:12:58.007 INFO:tasks.workunit.client.0.smithi077.stdout:3/598: creat db/d14/d32/d49/d4e/fba x:0 0 0 2024-09-18T21:12:58.007 INFO:tasks.workunit.client.1.smithi103.stdout:4/782: write d9/f6d [316144,29210] 0 2024-09-18T21:12:58.008 INFO:tasks.workunit.client.1.smithi103.stdout:7/690: creat d1/df/d42/d29/fda x:0 0 0 2024-09-18T21:12:58.009 INFO:tasks.workunit.client.0.smithi077.stdout:3/599: dread - db/d14/d32/d49/fa0 zero size 2024-09-18T21:12:58.009 INFO:tasks.workunit.client.0.smithi077.stdout:3/600: readlink db/d4d/lac 0 2024-09-18T21:12:58.010 INFO:tasks.workunit.client.0.smithi077.stdout:1/646: dread d3/d6a/d9b/d68/f9d [0,4194304] 0 2024-09-18T21:12:58.013 INFO:tasks.workunit.client.0.smithi077.stdout:2/692: stat d1/f92 0 2024-09-18T21:12:58.014 INFO:tasks.workunit.client.1.smithi103.stdout:4/783: creat d9/d38/d72/df0/d61/d91/d9e/f10d x:0 0 0 2024-09-18T21:12:58.014 INFO:tasks.workunit.client.0.smithi077.stdout:6/580: symlink d7/d7e/d11/d3e/d42/dbb/d49/d55/dc2/lc4 0 2024-09-18T21:12:58.015 INFO:tasks.workunit.client.1.smithi103.stdout:7/691: mkdir d1/df/d42/d29/d48/ddb 0 2024-09-18T21:12:58.017 INFO:tasks.workunit.client.1.smithi103.stdout:7/692: truncate d1/df/d42/d29/fda 371043 0 2024-09-18T21:12:58.018 INFO:tasks.workunit.client.1.smithi103.stdout:4/784: dread d9/d38/d58/fa7 [0,4194304] 0 2024-09-18T21:12:58.019 INFO:tasks.workunit.client.1.smithi103.stdout:1/660: getdents d0/d2/d9/d10/d8d 0 2024-09-18T21:12:58.020 INFO:tasks.workunit.client.1.smithi103.stdout:1/661: dread - d0/d3/d68/d81/faa zero size 2024-09-18T21:12:58.020 INFO:tasks.workunit.client.0.smithi077.stdout:3/601: unlink db/d14/d90/db2/fb9 0 2024-09-18T21:12:58.021 INFO:tasks.workunit.client.0.smithi077.stdout:2/693: chown d1/d4/d9/lcf 1 1 2024-09-18T21:12:58.022 INFO:tasks.workunit.client.0.smithi077.stdout:6/581: creat d7/d7e/da6/fc5 x:0 0 0 2024-09-18T21:12:58.023 INFO:tasks.workunit.client.0.smithi077.stdout:6/582: readlink d7/d7e/d11/d3e/d42/dbb/d4c/lad 0 2024-09-18T21:12:58.023 INFO:tasks.workunit.client.0.smithi077.stdout:7/704: creat d12/d22/daa/dc0/fee x:0 0 0 2024-09-18T21:12:58.026 INFO:tasks.workunit.client.0.smithi077.stdout:8/583: link d2/d5f/da8/d4f/d5a/d2a/d88/fa3 d2/d5f/da8/fd3 0 2024-09-18T21:12:58.028 INFO:tasks.workunit.client.0.smithi077.stdout:8/584: write d2/d5f/da8/d26/f32 [1115433,28222] 0 2024-09-18T21:12:58.030 INFO:tasks.workunit.client.0.smithi077.stdout:8/585: dread - d2/d5/d6/d9f/da6/fca zero size 2024-09-18T21:12:58.033 INFO:tasks.workunit.client.0.smithi077.stdout:6/583: mknod d7/d7e/d11/d3e/cc6 0 2024-09-18T21:12:58.034 INFO:tasks.workunit.client.1.smithi103.stdout:0/650: dwrite d1/f29 [0,4194304] 0 2024-09-18T21:12:58.034 INFO:tasks.workunit.client.0.smithi077.stdout:7/705: dread d12/f78 [0,4194304] 0 2024-09-18T21:12:58.035 INFO:tasks.workunit.client.0.smithi077.stdout:4/576: rename d3/dc/d20/f7d to d3/dc/d51/d53/fb4 0 2024-09-18T21:12:58.035 INFO:tasks.workunit.client.0.smithi077.stdout:1/647: link d3/d38/d97/f98 d3/d8/d13/d77/fe4 0 2024-09-18T21:12:58.038 INFO:tasks.workunit.client.0.smithi077.stdout:8/586: creat d2/d27/d29/d41/fd4 x:0 0 0 2024-09-18T21:12:58.039 INFO:tasks.workunit.client.1.smithi103.stdout:0/651: rmdir d1/d5/de/d22/d6a 39 2024-09-18T21:12:58.040 INFO:tasks.workunit.client.1.smithi103.stdout:1/662: write d0/d3/f20 [2219589,46581] 0 2024-09-18T21:12:58.041 INFO:tasks.workunit.client.1.smithi103.stdout:7/693: truncate d1/df/d42/d29/d48/dbb/f4f 4077202 0 2024-09-18T21:12:58.042 INFO:tasks.workunit.client.1.smithi103.stdout:4/785: dread d9/d1c/d77/f6f [0,4194304] 0 2024-09-18T21:12:58.043 INFO:tasks.workunit.client.0.smithi077.stdout:0/726: dread d8/d1d/d80/fdd [0,4194304] 0 2024-09-18T21:12:58.046 INFO:tasks.workunit.client.0.smithi077.stdout:2/694: dread d1/f1d [0,4194304] 0 2024-09-18T21:12:58.047 INFO:tasks.workunit.client.1.smithi103.stdout:1/663: creat d0/d2/d9/d9e/d7a/fea x:0 0 0 2024-09-18T21:12:58.050 INFO:tasks.workunit.client.0.smithi077.stdout:0/727: dwrite d8/d1a/f42 [0,4194304] 0 2024-09-18T21:12:58.050 INFO:tasks.workunit.client.0.smithi077.stdout:7/706: symlink d12/d22/d59/d72/d68/lef 0 2024-09-18T21:12:58.052 INFO:tasks.workunit.client.1.smithi103.stdout:4/786: rmdir d9 39 2024-09-18T21:12:58.052 INFO:tasks.workunit.client.0.smithi077.stdout:0/728: write d8/f23 [1631962,17470] 0 2024-09-18T21:12:58.056 INFO:tasks.workunit.client.0.smithi077.stdout:9/597: rename d1/dd/d11/d1c/d38/d46/lb5 to d1/d54/d81/lc8 0 2024-09-18T21:12:58.058 INFO:tasks.workunit.client.1.smithi103.stdout:1/664: mkdir d0/d2/d9/dc/d6e/deb 0 2024-09-18T21:12:58.058 INFO:tasks.workunit.client.0.smithi077.stdout:4/577: mknod d3/d35/db1/cb5 0 2024-09-18T21:12:58.059 INFO:tasks.workunit.client.1.smithi103.stdout:1/665: chown d0/d2/cb8 50783225 1 2024-09-18T21:12:58.059 INFO:tasks.workunit.client.0.smithi077.stdout:8/587: mknod d2/d5f/da8/d4f/d5a/d5e/d8f/d6e/cd5 0 2024-09-18T21:12:58.059 INFO:tasks.workunit.client.1.smithi103.stdout:1/666: read - d0/d2/d2b/d3a/d42/f97 zero size 2024-09-18T21:12:58.060 INFO:tasks.workunit.client.0.smithi077.stdout:0/729: dwrite d8/d1d/d80/f5e [0,4194304] 0 2024-09-18T21:12:58.061 INFO:tasks.workunit.client.0.smithi077.stdout:4/578: chown d3/dc/d32/d45/l7e 0 1 2024-09-18T21:12:58.062 INFO:tasks.workunit.client.1.smithi103.stdout:0/652: getdents d1/dcf 0 2024-09-18T21:12:58.064 INFO:tasks.workunit.client.0.smithi077.stdout:8/588: fdatasync d2/d5f/da8/d26/f60 0 2024-09-18T21:12:58.065 INFO:tasks.workunit.client.1.smithi103.stdout:4/787: mknod d9/d38/d72/df0/d83/db6/d41/c10e 0 2024-09-18T21:12:58.066 INFO:tasks.workunit.client.1.smithi103.stdout:1/667: dwrite d0/d2/d9/f65 [0,4194304] 0 2024-09-18T21:12:58.068 INFO:tasks.workunit.client.1.smithi103.stdout:7/694: rename d1/df/d43/d63/d67/d5b/cc6 to d1/df/d43/d63/db9/cdc 0 2024-09-18T21:12:58.068 INFO:tasks.workunit.client.1.smithi103.stdout:1/668: fdatasync d0/d3/f20 0 2024-09-18T21:12:58.068 INFO:tasks.workunit.client.0.smithi077.stdout:1/648: rename d3/d38/dd5/l6e to d3/d8/d13/d77/db1/da6/le5 0 2024-09-18T21:12:58.068 INFO:tasks.workunit.client.0.smithi077.stdout:2/695: dread d1/d4/d5/d1a/d2e/d41/f5d [0,4194304] 0 2024-09-18T21:12:58.069 INFO:tasks.workunit.client.0.smithi077.stdout:9/598: fsync d1/d54/f1e 0 2024-09-18T21:12:58.071 INFO:tasks.workunit.client.0.smithi077.stdout:0/730: mkdir d8/d1a/d39/d3b/d9a/de8 0 2024-09-18T21:12:58.074 INFO:tasks.workunit.client.1.smithi103.stdout:1/669: symlink d0/d2/d9/d10/lec 0 2024-09-18T21:12:58.074 INFO:tasks.workunit.client.0.smithi077.stdout:6/584: fsync d7/d7e/d11/d3e/d42/d88/da4/f47 0 2024-09-18T21:12:58.075 INFO:tasks.workunit.client.1.smithi103.stdout:1/670: chown d0/d2/d9/d10/f44 2822 1 2024-09-18T21:12:58.076 INFO:tasks.workunit.client.0.smithi077.stdout:8/589: chown d2/d5/d6/d9f/laa 77 1 2024-09-18T21:12:58.077 INFO:tasks.workunit.client.0.smithi077.stdout:1/649: mknod d3/d6a/d9b/d68/d3e/ce6 0 2024-09-18T21:12:58.078 INFO:tasks.workunit.client.0.smithi077.stdout:2/696: truncate d1/f19 513835 0 2024-09-18T21:12:58.078 INFO:tasks.workunit.client.1.smithi103.stdout:4/788: read d9/d38/d72/df0/d83/db6/d21/d80/f9d [278192,80417] 0 2024-09-18T21:12:58.079 INFO:tasks.workunit.client.0.smithi077.stdout:1/650: chown d3/d6a/d9b/c94 1 1 2024-09-18T21:12:58.079 INFO:tasks.workunit.client.0.smithi077.stdout:4/579: mkdir d3/d77/d9c/db6 0 2024-09-18T21:12:58.080 INFO:tasks.workunit.client.0.smithi077.stdout:2/697: fdatasync d1/d4/d5/d1a/d49/d6a/d81/dc4/fb8 0 2024-09-18T21:12:58.080 INFO:tasks.workunit.client.0.smithi077.stdout:1/651: chown d3/d8/d93/dd3/ca8 13 1 2024-09-18T21:12:58.081 INFO:tasks.workunit.client.0.smithi077.stdout:1/652: chown d3/d8/f1c 87231 1 2024-09-18T21:12:58.081 INFO:tasks.workunit.client.1.smithi103.stdout:1/671: dwrite d0/d2/f3d [0,4194304] 0 2024-09-18T21:12:58.082 INFO:tasks.workunit.client.0.smithi077.stdout:1/653: read d3/f23 [3598872,31155] 0 2024-09-18T21:12:58.082 INFO:tasks.workunit.client.0.smithi077.stdout:9/599: rename d1/f48 to d1/d54/d51/da3/fc9 0 2024-09-18T21:12:58.083 INFO:tasks.workunit.client.0.smithi077.stdout:0/731: mknod d8/d1a/d35/d6d/ce9 0 2024-09-18T21:12:58.084 INFO:tasks.workunit.client.1.smithi103.stdout:4/789: dread d9/fa [0,4194304] 0 2024-09-18T21:12:58.086 INFO:tasks.workunit.client.0.smithi077.stdout:6/585: symlink d7/d7e/d11/d3e/d42/dbb/d49/d96/lc7 0 2024-09-18T21:12:58.088 INFO:tasks.workunit.client.0.smithi077.stdout:6/586: chown d7/d7e/d11/d3e/d42/dbb/d49/d55 17572 1 2024-09-18T21:12:58.088 INFO:tasks.workunit.client.0.smithi077.stdout:4/580: creat d3/dc/fb7 x:0 0 0 2024-09-18T21:12:58.089 INFO:tasks.workunit.client.0.smithi077.stdout:2/698: mknod d1/d4/d5/d1a/d49/d6a/d81/dc4/cec 0 2024-09-18T21:12:58.089 INFO:tasks.workunit.client.1.smithi103.stdout:4/790: dread d9/d38/d72/d85/dd8/f50 [0,4194304] 0 2024-09-18T21:12:58.090 INFO:tasks.workunit.client.0.smithi077.stdout:1/654: fsync d3/d6a/d9b/d68/f9d 0 2024-09-18T21:12:58.091 INFO:tasks.workunit.client.0.smithi077.stdout:6/587: creat d7/d7e/d11/d3e/d42/fc8 x:0 0 0 2024-09-18T21:12:58.094 INFO:tasks.workunit.client.1.smithi103.stdout:4/791: rename d9/d38/d72/df0/d83/db6/d21/f9b to d9/d38/d72/d85/dd8/f10f 0 2024-09-18T21:12:58.095 INFO:tasks.workunit.client.1.smithi103.stdout:4/792: write d9/d1c/d77/f59 [2172694,66133] 0 2024-09-18T21:12:58.096 INFO:tasks.workunit.client.0.smithi077.stdout:7/707: dread d12/d22/d59/d5a/f70 [0,4194304] 0 2024-09-18T21:12:58.097 INFO:tasks.workunit.client.0.smithi077.stdout:0/732: link d8/d1a/d39/d3b/fcb d8/d37/d66/db4/fea 0 2024-09-18T21:12:58.098 INFO:tasks.workunit.client.1.smithi103.stdout:0/653: dread d1/f9b [0,4194304] 0 2024-09-18T21:12:58.100 INFO:tasks.workunit.client.1.smithi103.stdout:4/793: rename d9/d38/d72/df0/d61 to d9/d38/d72/df0/d61/d91/daa/d110 22 2024-09-18T21:12:58.100 INFO:tasks.workunit.client.0.smithi077.stdout:2/699: mknod d1/ced 0 2024-09-18T21:12:58.101 INFO:tasks.workunit.client.1.smithi103.stdout:4/794: truncate d9/d38/d72/df0/d61/d91/fd3 42462 0 2024-09-18T21:12:58.101 INFO:tasks.workunit.client.1.smithi103.stdout:4/795: fdatasync d9/d1c/db1/dd5/feb 0 2024-09-18T21:12:58.102 INFO:tasks.workunit.client.1.smithi103.stdout:0/654: mkdir d1/d5/de/dc0/d8c/dce/d9f/d4f/de8 0 2024-09-18T21:12:58.104 INFO:tasks.workunit.client.0.smithi077.stdout:6/588: rename d7/d7e/d11/d3e/d42/d88/f9c to d7/d7e/d11/d3e/d42/fc9 0 2024-09-18T21:12:58.105 INFO:tasks.workunit.client.0.smithi077.stdout:7/708: creat d12/d22/daa/dc0/dac/dad/ff0 x:0 0 0 2024-09-18T21:12:58.106 INFO:tasks.workunit.client.0.smithi077.stdout:7/709: write d12/d31/f83 [1860171,53066] 0 2024-09-18T21:12:58.106 INFO:tasks.workunit.client.1.smithi103.stdout:0/655: chown d1/d5/de/d22/d6a/fa9 19 1 2024-09-18T21:12:58.109 INFO:tasks.workunit.client.0.smithi077.stdout:2/700: rmdir d1/d4/d9/d80/d83/dba/ddc 39 2024-09-18T21:12:58.111 INFO:tasks.workunit.client.1.smithi103.stdout:0/656: dwrite d1/d5/de/d24/d43/d81/fb2 [0,4194304] 0 2024-09-18T21:12:58.112 INFO:tasks.workunit.client.0.smithi077.stdout:2/701: dread d1/fd [8388608,4194304] 0 2024-09-18T21:12:58.114 INFO:tasks.workunit.client.1.smithi103.stdout:9/731: sync 2024-09-18T21:12:58.115 INFO:tasks.workunit.client.0.smithi077.stdout:0/733: mkdir d8/d1a/d39/d3b/d9a/de8/deb 0 2024-09-18T21:12:58.115 INFO:tasks.workunit.client.0.smithi077.stdout:0/734: readlink d8/d1a/l27 0 2024-09-18T21:12:58.115 INFO:tasks.workunit.client.1.smithi103.stdout:0/657: symlink d1/d93/le9 0 2024-09-18T21:12:58.117 INFO:tasks.workunit.client.1.smithi103.stdout:0/658: fdatasync d1/f9a 0 2024-09-18T21:12:58.118 INFO:tasks.workunit.client.0.smithi077.stdout:4/581: getdents d3/dc/d32/d5b 0 2024-09-18T21:12:58.120 INFO:tasks.workunit.client.1.smithi103.stdout:0/659: fsync d1/d5/de/dc0/d8c/dce/d9f/d4f/d68/fc8 0 2024-09-18T21:12:58.120 INFO:tasks.workunit.client.1.smithi103.stdout:9/732: mkdir d18/d52/d6f/db9/de0/de7/df3 0 2024-09-18T21:12:58.121 INFO:tasks.workunit.client.1.smithi103.stdout:7/695: dwrite d1/df/d42/f2b [0,4194304] 0 2024-09-18T21:12:58.123 INFO:tasks.workunit.client.0.smithi077.stdout:0/735: unlink d8/d1a/c33 0 2024-09-18T21:12:58.127 INFO:tasks.workunit.client.1.smithi103.stdout:9/733: write d18/d52/d6f/db9/ff2 [955335,2788] 0 2024-09-18T21:12:58.128 INFO:tasks.workunit.client.0.smithi077.stdout:7/710: truncate d12/d22/d59/d5a/f8a 3985668 0 2024-09-18T21:12:58.130 INFO:tasks.workunit.client.1.smithi103.stdout:0/660: creat d1/d5/de/d19/d1e/d34/fea x:0 0 0 2024-09-18T21:12:58.132 INFO:tasks.workunit.client.0.smithi077.stdout:4/582: creat d3/d7/d42/fb8 x:0 0 0 2024-09-18T21:12:58.132 INFO:tasks.workunit.client.0.smithi077.stdout:4/583: stat d3/dc/d24/f8e 0 2024-09-18T21:12:58.133 INFO:tasks.workunit.client.1.smithi103.stdout:7/696: rename d1/df/d42/d29/fa6 to d1/df/dbf/fdd 0 2024-09-18T21:12:58.139 INFO:tasks.workunit.client.1.smithi103.stdout:1/672: dwrite d0/d3/f29 [4194304,4194304] 0 2024-09-18T21:12:58.140 INFO:tasks.workunit.client.0.smithi077.stdout:8/590: dwrite d2/d5f/da8/d20/f56 [4194304,4194304] 0 2024-09-18T21:12:58.142 INFO:tasks.workunit.client.0.smithi077.stdout:4/584: read d3/dc/d32/f3e [3923898,33449] 0 2024-09-18T21:12:58.143 INFO:tasks.workunit.client.0.smithi077.stdout:4/585: dread - d3/d7/d42/fb8 zero size 2024-09-18T21:12:58.144 INFO:tasks.workunit.client.0.smithi077.stdout:0/736: symlink d8/d37/d95/de4/lec 0 2024-09-18T21:12:58.146 INFO:tasks.workunit.client.0.smithi077.stdout:0/737: chown d8/d1a/d39/d3b/d79 31479638 1 2024-09-18T21:12:58.148 INFO:tasks.workunit.client.0.smithi077.stdout:8/591: rmdir d2/d5/d6/d9f 39 2024-09-18T21:12:58.151 INFO:tasks.workunit.client.0.smithi077.stdout:8/592: dread - d2/d5f/da8/d20/d3e/db4/fd0 zero size 2024-09-18T21:12:58.152 INFO:tasks.workunit.client.1.smithi103.stdout:1/673: unlink d0/d2/d2b/l78 0 2024-09-18T21:12:58.154 INFO:tasks.workunit.client.0.smithi077.stdout:0/738: mkdir d8/d1a/d39/ded 0 2024-09-18T21:12:58.154 INFO:tasks.workunit.client.0.smithi077.stdout:1/655: dwrite d3/d8/d93/dd3/f4d [0,4194304] 0 2024-09-18T21:12:58.154 INFO:tasks.workunit.client.1.smithi103.stdout:7/697: dread d1/df/f79 [0,4194304] 0 2024-09-18T21:12:58.155 INFO:tasks.workunit.client.1.smithi103.stdout:7/698: fsync d1/df/d44/db4/fc1 0 2024-09-18T21:12:58.156 INFO:tasks.workunit.client.0.smithi077.stdout:7/711: creat d12/d31/d77/d93/d2a/d6c/ff1 x:0 0 0 2024-09-18T21:12:58.157 INFO:tasks.workunit.client.1.smithi103.stdout:0/661: link d1/d9/d3e/d6e/f97 d1/d5/feb 0 2024-09-18T21:12:58.158 INFO:tasks.workunit.client.0.smithi077.stdout:6/589: dwrite d7/d7e/d11/f8e [0,4194304] 0 2024-09-18T21:12:58.159 INFO:tasks.workunit.client.1.smithi103.stdout:0/662: write d1/d5/de/dc0/d8c/dce/d9f/f46 [1735391,84399] 0 2024-09-18T21:12:58.162 INFO:tasks.workunit.client.1.smithi103.stdout:1/674: creat d0/d2/d2b/d3a/d42/d72/fed x:0 0 0 2024-09-18T21:12:58.163 INFO:tasks.workunit.client.1.smithi103.stdout:1/675: write d0/fbd [4264984,32187] 0 2024-09-18T21:12:58.165 INFO:tasks.workunit.client.1.smithi103.stdout:9/734: getdents d18/d29/d68/d92 0 2024-09-18T21:12:58.167 INFO:tasks.workunit.client.1.smithi103.stdout:7/699: mkdir d1/df/d42/d1f/d5d/d85/dde 0 2024-09-18T21:12:58.173 INFO:tasks.workunit.client.0.smithi077.stdout:0/739: symlink d8/d1a/d39/d56/lee 0 2024-09-18T21:12:58.173 INFO:tasks.workunit.client.0.smithi077.stdout:7/712: fsync d12/d22/f8b 0 2024-09-18T21:12:58.174 INFO:tasks.workunit.client.0.smithi077.stdout:0/740: read d8/d37/f6f [76899,1029] 0 2024-09-18T21:12:58.174 INFO:tasks.workunit.client.1.smithi103.stdout:7/700: write d1/df/d42/d29/d48/dbb/d33/d51/f9e [2493146,102669] 0 2024-09-18T21:12:58.174 INFO:tasks.workunit.client.1.smithi103.stdout:9/735: dwrite d18/da4/fce [0,4194304] 0 2024-09-18T21:12:58.174 INFO:tasks.workunit.client.0.smithi077.stdout:7/713: fsync d12/d22/f7b 0 2024-09-18T21:12:58.177 INFO:tasks.workunit.client.0.smithi077.stdout:2/702: dwrite d1/d4/d5/d1a/d49/d6a/d81/fa8 [0,4194304] 0 2024-09-18T21:12:58.177 INFO:tasks.workunit.client.0.smithi077.stdout:4/586: write d3/d7/d73/f79 [330184,118361] 0 2024-09-18T21:12:58.179 INFO:tasks.workunit.client.0.smithi077.stdout:7/714: dread - d12/d22/daa/dc0/dac/dad/ff0 zero size 2024-09-18T21:12:58.183 INFO:tasks.workunit.client.1.smithi103.stdout:7/701: dwrite d1/df/d44/db4/fc1 [0,4194304] 0 2024-09-18T21:12:58.184 INFO:tasks.workunit.client.1.smithi103.stdout:9/736: dwrite f1 [0,4194304] 0 2024-09-18T21:12:58.189 INFO:tasks.workunit.client.0.smithi077.stdout:0/741: creat d8/d1d/d80/fef x:0 0 0 2024-09-18T21:12:58.189 INFO:tasks.workunit.client.1.smithi103.stdout:7/702: chown d1/df/d42/d1f/d2e/f50 31155259 1 2024-09-18T21:12:58.190 INFO:tasks.workunit.client.1.smithi103.stdout:1/676: creat d0/d2/d9/fee x:0 0 0 2024-09-18T21:12:58.191 INFO:tasks.workunit.client.1.smithi103.stdout:7/703: read - d1/df/d42/d1f/d2e/fd9 zero size 2024-09-18T21:12:58.191 INFO:tasks.workunit.client.0.smithi077.stdout:6/590: rename d7/d7e/d11/d3e/d42/dbb/d49/d96/fb8 to d7/d7e/d11/d3e/d42/dbb/d50/fca 0 2024-09-18T21:12:58.193 INFO:tasks.workunit.client.1.smithi103.stdout:9/737: rename d18/d52/d6f/d8e/fc5 to d18/d52/d6f/db9/de0/de7/df3/ff4 0 2024-09-18T21:12:58.194 INFO:tasks.workunit.client.0.smithi077.stdout:4/587: mkdir d3/d77/d9c/db9 0 2024-09-18T21:12:58.194 INFO:tasks.workunit.client.1.smithi103.stdout:3/670: sync 2024-09-18T21:12:58.194 INFO:tasks.workunit.client.1.smithi103.stdout:6/720: sync 2024-09-18T21:12:58.194 INFO:tasks.workunit.client.1.smithi103.stdout:8/806: sync 2024-09-18T21:12:58.195 INFO:tasks.workunit.client.1.smithi103.stdout:2/614: sync 2024-09-18T21:12:58.195 INFO:tasks.workunit.client.1.smithi103.stdout:5/730: sync 2024-09-18T21:12:58.195 INFO:tasks.workunit.client.1.smithi103.stdout:0/663: dwrite d1/d9/f52 [0,4194304] 0 2024-09-18T21:12:58.196 INFO:tasks.workunit.client.0.smithi077.stdout:2/703: creat d1/d4/d9/d80/d95/fee x:0 0 0 2024-09-18T21:12:58.196 INFO:tasks.workunit.client.0.smithi077.stdout:4/588: chown d3/dc/d32/f3e 1 1 2024-09-18T21:12:58.197 INFO:tasks.workunit.client.1.smithi103.stdout:7/704: mknod d1/df/dbf/cdf 0 2024-09-18T21:12:58.197 INFO:tasks.workunit.client.1.smithi103.stdout:6/721: chown d2/d3/d7f 1388 1 2024-09-18T21:12:58.198 INFO:tasks.workunit.client.1.smithi103.stdout:5/731: stat de/d3e/cc9 0 2024-09-18T21:12:58.200 INFO:tasks.workunit.client.1.smithi103.stdout:9/738: symlink d18/d29/lf5 0 2024-09-18T21:12:58.200 INFO:tasks.workunit.client.1.smithi103.stdout:3/671: chown d1/d23/d25/d4f/d72/f87 24460 1 2024-09-18T21:12:58.201 INFO:tasks.workunit.client.1.smithi103.stdout:0/664: chown d1/d5/de/d24/f32 6485898 1 2024-09-18T21:12:58.204 INFO:tasks.workunit.client.1.smithi103.stdout:1/677: creat d0/d2/fef x:0 0 0 2024-09-18T21:12:58.206 INFO:tasks.workunit.client.1.smithi103.stdout:8/807: chown d4/d81/dd7/dde/d59/cb8 12 1 2024-09-18T21:12:58.206 INFO:tasks.workunit.client.0.smithi077.stdout:8/593: dwrite d2/d5/d6/f21 [0,4194304] 0 2024-09-18T21:12:58.209 INFO:tasks.workunit.client.0.smithi077.stdout:0/742: dread d8/d1a/d39/f3c [0,4194304] 0 2024-09-18T21:12:58.209 INFO:tasks.workunit.client.0.smithi077.stdout:1/656: dread d3/d8/d13/f26 [0,4194304] 0 2024-09-18T21:12:58.209 INFO:tasks.workunit.client.1.smithi103.stdout:9/739: creat d18/da4/ff6 x:0 0 0 2024-09-18T21:12:58.210 INFO:tasks.workunit.client.1.smithi103.stdout:3/672: mkdir d1/d23/d25/dcf 0 2024-09-18T21:12:58.211 INFO:tasks.workunit.client.0.smithi077.stdout:7/715: creat d12/d22/d59/d72/ff2 x:0 0 0 2024-09-18T21:12:58.213 INFO:tasks.workunit.client.1.smithi103.stdout:0/665: mknod d1/d5/de/dc0/cec 0 2024-09-18T21:12:58.213 INFO:tasks.workunit.client.0.smithi077.stdout:7/716: write d12/d22/daa/dc0/fe0 [1341795,47992] 0 2024-09-18T21:12:58.214 INFO:tasks.workunit.client.0.smithi077.stdout:0/743: dread d8/d1d/f8b [0,4194304] 0 2024-09-18T21:12:58.215 INFO:tasks.workunit.client.1.smithi103.stdout:1/678: symlink d0/d2/d2b/lf0 0 2024-09-18T21:12:58.215 INFO:tasks.workunit.client.0.smithi077.stdout:0/744: read - d8/d1a/d39/fdf zero size 2024-09-18T21:12:58.216 INFO:tasks.workunit.client.0.smithi077.stdout:8/594: symlink d2/d27/d29/ld6 0 2024-09-18T21:12:58.219 INFO:tasks.workunit.client.1.smithi103.stdout:3/673: rename d1/d2/d18/d30/d4e/d62/f6a to d1/d2/d18/d30/d4e/db1/fd0 0 2024-09-18T21:12:58.222 INFO:tasks.workunit.client.1.smithi103.stdout:8/808: getdents d4/d2d/d87/dbb/dea 0 2024-09-18T21:12:58.222 INFO:tasks.workunit.client.0.smithi077.stdout:0/745: dwrite d8/d1a/d39/d3b/fdb [0,4194304] 0 2024-09-18T21:12:58.223 INFO:tasks.workunit.client.0.smithi077.stdout:6/591: getdents d7/d7e/d11/d3e/d42/d88 0 2024-09-18T21:12:58.224 INFO:tasks.workunit.client.1.smithi103.stdout:7/705: creat d1/df/d42/d29/d48/dbb/fe0 x:0 0 0 2024-09-18T21:12:58.225 INFO:tasks.workunit.client.1.smithi103.stdout:3/674: write d1/d64/f95 [713963,13138] 0 2024-09-18T21:12:58.228 INFO:tasks.workunit.client.0.smithi077.stdout:7/717: symlink d12/d22/daa/dc0/lf3 0 2024-09-18T21:12:58.229 INFO:tasks.workunit.client.1.smithi103.stdout:8/809: mknod d4/de/c104 0 2024-09-18T21:12:58.229 INFO:tasks.workunit.client.0.smithi077.stdout:7/718: dread - d12/d31/d77/d93/d89/faf zero size 2024-09-18T21:12:58.230 INFO:tasks.workunit.client.0.smithi077.stdout:1/657: dread d3/f10 [0,4194304] 0 2024-09-18T21:12:58.231 INFO:tasks.workunit.client.1.smithi103.stdout:1/679: creat d0/d2/d9/d10/da0/ff1 x:0 0 0 2024-09-18T21:12:58.231 INFO:tasks.workunit.client.0.smithi077.stdout:8/595: symlink d2/d5f/da8/d20/ld7 0 2024-09-18T21:12:58.233 INFO:tasks.workunit.client.0.smithi077.stdout:6/592: mknod d7/d7e/d11/d3e/d42/dbb/d49/d96/ccb 0 2024-09-18T21:12:58.234 INFO:tasks.workunit.client.1.smithi103.stdout:1/680: fsync d0/d2/d2b/d3a/d42/d72/db0/f7f 0 2024-09-18T21:12:58.234 INFO:tasks.workunit.client.0.smithi077.stdout:6/593: read - d7/fa9 zero size 2024-09-18T21:12:58.235 INFO:tasks.workunit.client.1.smithi103.stdout:0/666: creat d1/d9/fed x:0 0 0 2024-09-18T21:12:58.236 INFO:tasks.workunit.client.1.smithi103.stdout:3/675: creat d1/d23/d25/d4f/d58/d86/fd1 x:0 0 0 2024-09-18T21:12:58.237 INFO:tasks.workunit.client.1.smithi103.stdout:8/810: dwrite d4/d2d/d87/fbe [0,4194304] 0 2024-09-18T21:12:58.239 INFO:tasks.workunit.client.0.smithi077.stdout:8/596: rmdir d2/d27/d29/d41 39 2024-09-18T21:12:58.241 INFO:tasks.workunit.client.1.smithi103.stdout:7/706: truncate d1/df/d42/d29/d48/dbb/f4f 3590253 0 2024-09-18T21:12:58.243 INFO:tasks.workunit.client.0.smithi077.stdout:7/719: mknod d12/cf4 0 2024-09-18T21:12:58.243 INFO:tasks.workunit.client.1.smithi103.stdout:7/707: chown d1/df/d43/d52/fb7 2 1 2024-09-18T21:12:58.245 INFO:tasks.workunit.client.1.smithi103.stdout:8/811: mkdir d4/d2d/dc1/dee/d105 0 2024-09-18T21:12:58.247 INFO:tasks.workunit.client.1.smithi103.stdout:0/667: rename d1/d9/f33 to d1/d5/de/dc0/d8c/dce/d9f/fee 0 2024-09-18T21:12:58.248 INFO:tasks.workunit.client.1.smithi103.stdout:0/668: chown d1/f9a 318 1 2024-09-18T21:12:58.248 INFO:tasks.workunit.client.0.smithi077.stdout:6/594: truncate d7/d7e/da6/fc1 4545858 0 2024-09-18T21:12:58.249 INFO:tasks.workunit.client.0.smithi077.stdout:6/595: chown d7/d7e/d11/d3e/d42/dbb/d31/f5a 3178523 1 2024-09-18T21:12:58.251 INFO:tasks.workunit.client.1.smithi103.stdout:7/708: creat d1/df/d42/d29/d48/fe1 x:0 0 0 2024-09-18T21:12:58.252 INFO:tasks.workunit.client.1.smithi103.stdout:7/709: stat d1/f21 0 2024-09-18T21:12:58.254 INFO:tasks.workunit.client.0.smithi077.stdout:7/720: mknod d12/d56/da1/ddf/cf5 0 2024-09-18T21:12:58.255 INFO:tasks.workunit.client.0.smithi077.stdout:7/721: fsync d12/d31/d77/d93/d2a/d6c/ff1 0 2024-09-18T21:12:58.258 INFO:tasks.workunit.client.0.smithi077.stdout:8/597: symlink d2/d27/d29/d41/dbc/dce/ld8 0 2024-09-18T21:12:58.259 INFO:tasks.workunit.client.1.smithi103.stdout:1/681: symlink d0/d2/d2b/d3a/d42/d72/db0/da7/lf2 0 2024-09-18T21:12:58.261 INFO:tasks.workunit.client.0.smithi077.stdout:4/589: write d3/d35/f37 [2299808,80016] 0 2024-09-18T21:12:58.261 INFO:tasks.workunit.client.1.smithi103.stdout:7/710: truncate d1/f8e 483431 0 2024-09-18T21:12:58.262 INFO:tasks.workunit.client.0.smithi077.stdout:7/722: read d12/d22/d59/d72/d68/f75 [1296270,52727] 0 2024-09-18T21:12:58.263 INFO:tasks.workunit.client.0.smithi077.stdout:8/598: unlink d2/l74 0 2024-09-18T21:12:58.265 INFO:tasks.workunit.client.0.smithi077.stdout:4/590: creat d3/dc/d32/d45/fba x:0 0 0 2024-09-18T21:12:58.265 INFO:tasks.workunit.client.1.smithi103.stdout:3/676: creat d1/d23/d25/d4f/fd2 x:0 0 0 2024-09-18T21:12:58.266 INFO:tasks.workunit.client.0.smithi077.stdout:7/723: truncate fa 1695079 0 2024-09-18T21:12:58.267 INFO:tasks.workunit.client.1.smithi103.stdout:1/682: dread d0/d2/d2b/d3a/d42/d72/f8f [0,4194304] 0 2024-09-18T21:12:58.267 INFO:tasks.workunit.client.0.smithi077.stdout:2/704: truncate d1/d4/d5/d1a/d2e/d41/f68 1255196 0 2024-09-18T21:12:58.267 INFO:tasks.workunit.client.1.smithi103.stdout:2/615: dwrite d3/f6e [0,4194304] 0 2024-09-18T21:12:58.268 INFO:tasks.workunit.client.1.smithi103.stdout:9/740: mkdir d18/d52/d6f/d8e/df7 0 2024-09-18T21:12:58.269 INFO:tasks.workunit.client.1.smithi103.stdout:2/616: stat d3/c1c 0 2024-09-18T21:12:58.269 INFO:tasks.workunit.client.1.smithi103.stdout:5/732: dwrite de/d1f/d3b/d3c/f90 [0,4194304] 0 2024-09-18T21:12:58.272 INFO:tasks.workunit.client.1.smithi103.stdout:1/683: chown d0/d2/d9/d10/d8d/c90 1636819383 1 2024-09-18T21:12:58.275 INFO:tasks.workunit.client.0.smithi077.stdout:7/724: creat d12/d31/d77/d93/d2a/ff6 x:0 0 0 2024-09-18T21:12:58.276 INFO:tasks.workunit.client.0.smithi077.stdout:2/705: dwrite d1/d4/d5/d1a/d2e/d41/d2c/f88 [0,4194304] 0 2024-09-18T21:12:58.277 INFO:tasks.workunit.client.0.smithi077.stdout:7/725: fdatasync d12/f9a 0 2024-09-18T21:12:58.278 INFO:tasks.workunit.client.0.smithi077.stdout:7/726: fdatasync d12/d22/daa/fe2 0 2024-09-18T21:12:58.279 INFO:tasks.workunit.client.0.smithi077.stdout:0/746: write d8/d1d/f2b [3782711,85462] 0 2024-09-18T21:12:58.280 INFO:tasks.workunit.client.0.smithi077.stdout:0/747: write d8/d26/f54 [3104395,37618] 0 2024-09-18T21:12:58.281 INFO:tasks.workunit.client.0.smithi077.stdout:0/748: write d8/fbc [549281,95874] 0 2024-09-18T21:12:58.285 INFO:tasks.workunit.client.1.smithi103.stdout:1/684: creat d0/d3/d68/ff3 x:0 0 0 2024-09-18T21:12:58.287 INFO:tasks.workunit.client.1.smithi103.stdout:1/685: write d0/d2/d9/d10/d5d/f8a [1341061,109263] 0 2024-09-18T21:12:58.288 INFO:tasks.workunit.client.1.smithi103.stdout:5/733: creat de/d1f/d3b/d51/d57/d79/d8d/ff4 x:0 0 0 2024-09-18T21:12:58.289 INFO:tasks.workunit.client.1.smithi103.stdout:5/734: chown de/d1f/d3b/d51/de7 246129793 1 2024-09-18T21:12:58.291 INFO:tasks.workunit.client.0.smithi077.stdout:1/658: dwrite d3/d38/fb3 [0,4194304] 0 2024-09-18T21:12:58.293 INFO:tasks.workunit.client.0.smithi077.stdout:2/706: mknod d1/d4/d9/d80/d83/dba/dcd/cef 0 2024-09-18T21:12:58.295 INFO:tasks.workunit.client.1.smithi103.stdout:9/741: fsync d18/d52/d6f/d8e/d8f/dbd/dc3/f9e 0 2024-09-18T21:12:58.296 INFO:tasks.workunit.client.0.smithi077.stdout:0/749: dwrite d8/d1d/f8b [0,4194304] 0 2024-09-18T21:12:58.299 INFO:tasks.workunit.client.0.smithi077.stdout:1/659: symlink d3/d8/d49/d4e/dbd/le7 0 2024-09-18T21:12:58.299 INFO:tasks.workunit.client.0.smithi077.stdout:6/596: write d7/d7e/d11/d3e/d42/dbb/d49/d55/f59 [3063188,17392] 0 2024-09-18T21:12:58.300 INFO:tasks.workunit.client.1.smithi103.stdout:1/686: rmdir d0/d2/d2b/d3a/d42/d72/db0 39 2024-09-18T21:12:58.302 INFO:tasks.workunit.client.0.smithi077.stdout:1/660: chown d3/d6a/d9b/d68/d3e/l4b 990675 1 2024-09-18T21:12:58.304 INFO:tasks.workunit.client.1.smithi103.stdout:5/735: unlink de/d1f/d3b/fda 0 2024-09-18T21:12:58.306 INFO:tasks.workunit.client.0.smithi077.stdout:7/727: creat d12/ff7 x:0 0 0 2024-09-18T21:12:58.308 INFO:tasks.workunit.client.1.smithi103.stdout:8/812: dwrite d4/d26/f97 [0,4194304] 0 2024-09-18T21:12:58.309 INFO:tasks.workunit.client.0.smithi077.stdout:0/750: symlink d8/d37/d95/dab/lf0 0 2024-09-18T21:12:58.309 INFO:tasks.workunit.client.0.smithi077.stdout:5/751: sync 2024-09-18T21:12:58.311 INFO:tasks.workunit.client.0.smithi077.stdout:6/597: symlink d7/d7e/d11/d3e/d42/dbb/d5c/lcc 0 2024-09-18T21:12:58.311 INFO:tasks.workunit.client.0.smithi077.stdout:1/661: dwrite d3/d8/d75/d89/dbb/fc3 [0,4194304] 0 2024-09-18T21:12:58.314 INFO:tasks.workunit.client.0.smithi077.stdout:1/662: write d3/d6a/d9b/d68/f9d [229588,89348] 0 2024-09-18T21:12:58.315 INFO:tasks.workunit.client.1.smithi103.stdout:1/687: dread d0/d2/d9/dc/f15 [0,4194304] 0 2024-09-18T21:12:58.316 INFO:tasks.workunit.client.1.smithi103.stdout:1/688: fsync d0/d2/d2b/d3a/d42/d87/fbf 0 2024-09-18T21:12:58.317 INFO:tasks.workunit.client.0.smithi077.stdout:2/707: link d1/d4/f8 d1/d4/d9/d4f/ff0 0 2024-09-18T21:12:58.319 INFO:tasks.workunit.client.1.smithi103.stdout:2/617: link d3/d5/d2f/fc5 d3/d5/d25/fe0 0 2024-09-18T21:12:58.319 INFO:tasks.workunit.client.0.smithi077.stdout:2/708: dread d1/d62/fbc [0,4194304] 0 2024-09-18T21:12:58.323 INFO:tasks.workunit.client.0.smithi077.stdout:7/728: creat d12/d56/ff8 x:0 0 0 2024-09-18T21:12:58.325 INFO:tasks.workunit.client.1.smithi103.stdout:5/736: unlink de/d1f/d3b/d3c/f89 0 2024-09-18T21:12:58.327 INFO:tasks.workunit.client.1.smithi103.stdout:9/742: dread f17 [0,4194304] 0 2024-09-18T21:12:58.327 INFO:tasks.workunit.client.0.smithi077.stdout:8/599: dwrite d2/d5f/da8/fd3 [0,4194304] 0 2024-09-18T21:12:58.328 INFO:tasks.workunit.client.0.smithi077.stdout:5/752: creat d0/df/d10/d5c/ff6 x:0 0 0 2024-09-18T21:12:58.329 INFO:tasks.workunit.client.1.smithi103.stdout:8/813: unlink d4/de/f46 0 2024-09-18T21:12:58.329 INFO:tasks.workunit.client.1.smithi103.stdout:8/814: stat d4/d81/d65 0 2024-09-18T21:12:58.331 INFO:tasks.workunit.client.0.smithi077.stdout:4/591: dwrite d3/dc/d20/f6a [0,4194304] 0 2024-09-18T21:12:58.332 INFO:tasks.workunit.client.0.smithi077.stdout:5/753: write d0/fbf [951724,17149] 0 2024-09-18T21:12:58.334 INFO:tasks.workunit.client.1.smithi103.stdout:4/796: sync 2024-09-18T21:12:58.336 INFO:tasks.workunit.client.1.smithi103.stdout:8/815: dwrite d4/d81/dd7/dde/d59/d9c/de6/ff2 [0,4194304] 0 2024-09-18T21:12:58.337 INFO:tasks.workunit.client.0.smithi077.stdout:2/709: dread - d1/d4/d5/d1a/d2e/d40/f78 zero size 2024-09-18T21:12:58.337 INFO:tasks.workunit.client.0.smithi077.stdout:0/751: dwrite d8/d26/f18 [0,4194304] 0 2024-09-18T21:12:58.340 INFO:tasks.workunit.client.1.smithi103.stdout:5/737: dread - de/d1f/d3b/d51/d57/d59/f7d zero size 2024-09-18T21:12:58.343 INFO:tasks.workunit.client.1.smithi103.stdout:4/797: dread d9/d38/d72/d85/ff6 [0,4194304] 0 2024-09-18T21:12:58.344 INFO:tasks.workunit.client.0.smithi077.stdout:9/600: sync 2024-09-18T21:12:58.344 INFO:tasks.workunit.client.0.smithi077.stdout:3/602: sync 2024-09-18T21:12:58.345 INFO:tasks.workunit.client.1.smithi103.stdout:9/743: rename d18/d52/d6f/db9/de0/de7/df3 to d18/d52/d6f/df8 0 2024-09-18T21:12:58.346 INFO:tasks.workunit.client.0.smithi077.stdout:3/603: write db/d14/f1d [2309988,69973] 0 2024-09-18T21:12:58.346 INFO:tasks.workunit.client.1.smithi103.stdout:9/744: stat d18/d52/d6f/db9/de0/de7 0 2024-09-18T21:12:58.347 INFO:tasks.workunit.client.0.smithi077.stdout:7/729: rmdir d12/d31/d77/d93/d2a 39 2024-09-18T21:12:58.348 INFO:tasks.workunit.client.1.smithi103.stdout:9/745: truncate d18/d52/d5e/fac 50575 0 2024-09-18T21:12:58.350 INFO:tasks.workunit.client.1.smithi103.stdout:2/618: mknod d3/d5/d25/ce1 0 2024-09-18T21:12:58.350 INFO:tasks.workunit.client.0.smithi077.stdout:0/752: dread d8/fbc [0,4194304] 0 2024-09-18T21:12:58.351 INFO:tasks.workunit.client.0.smithi077.stdout:6/598: mkdir d7/d7e/d11/d3e/dcd 0 2024-09-18T21:12:58.351 INFO:tasks.workunit.client.1.smithi103.stdout:2/619: chown d3/d5/d2c/d77/d9c/db8/fdc 1721 1 2024-09-18T21:12:58.354 INFO:tasks.workunit.client.1.smithi103.stdout:8/816: creat d4/d2d/d87/dbb/f106 x:0 0 0 2024-09-18T21:12:58.358 INFO:tasks.workunit.client.1.smithi103.stdout:4/798: rename d9/d38/d58/fbb to d9/d38/d72/df0/d83/db6/d86/f111 0 2024-09-18T21:12:58.362 INFO:tasks.workunit.client.1.smithi103.stdout:7/711: dread d1/df/d42/d29/d48/dbb/f4f [0,4194304] 0 2024-09-18T21:12:58.363 INFO:tasks.workunit.client.1.smithi103.stdout:2/620: unlink d3/d5/d2c/c78 0 2024-09-18T21:12:58.364 INFO:tasks.workunit.client.1.smithi103.stdout:2/621: chown d3/d5/d2f/d32/f74 258054 1 2024-09-18T21:12:58.366 INFO:tasks.workunit.client.1.smithi103.stdout:8/817: fdatasync d4/d26/f1d 0 2024-09-18T21:12:58.370 INFO:tasks.workunit.client.1.smithi103.stdout:9/746: symlink d18/d52/lf9 0 2024-09-18T21:12:58.377 INFO:tasks.workunit.client.0.smithi077.stdout:7/730: dread - d12/d31/d77/d93/d2a/fe5 zero size 2024-09-18T21:12:58.377 INFO:tasks.workunit.client.0.smithi077.stdout:1/663: dwrite d3/d6a/d9b/d68/f44 [0,4194304] 0 2024-09-18T21:12:58.386 INFO:tasks.workunit.client.0.smithi077.stdout:4/592: unlink d3/fa 0 2024-09-18T21:12:58.386 INFO:tasks.workunit.client.0.smithi077.stdout:3/604: dwrite db/d14/d22/d36/f7f [0,4194304] 0 2024-09-18T21:12:58.392 INFO:tasks.workunit.client.0.smithi077.stdout:1/664: dread d3/d6a/d9b/d68/f9d [0,4194304] 0 2024-09-18T21:12:58.392 INFO:tasks.workunit.client.0.smithi077.stdout:2/710: write d1/d4/d5/d1a/d2e/d40/f7b [1730549,8959] 0 2024-09-18T21:12:58.393 INFO:tasks.workunit.client.0.smithi077.stdout:4/593: truncate d3/dc/d32/d45/d5e/f84 136683 0 2024-09-18T21:12:58.394 INFO:tasks.workunit.client.0.smithi077.stdout:7/731: creat d12/d22/d59/d5a/ff9 x:0 0 0 2024-09-18T21:12:58.394 INFO:tasks.workunit.client.0.smithi077.stdout:8/600: dwrite d2/d27/d29/f68 [0,4194304] 0 2024-09-18T21:12:58.395 INFO:tasks.workunit.client.0.smithi077.stdout:1/665: stat d3/d8/d13 0 2024-09-18T21:12:58.396 INFO:tasks.workunit.client.0.smithi077.stdout:2/711: dread - d1/d4/d9/d80/d83/fbf zero size 2024-09-18T21:12:58.400 INFO:tasks.workunit.client.0.smithi077.stdout:0/753: dread d8/f2f [0,4194304] 0 2024-09-18T21:12:58.404 INFO:tasks.workunit.client.0.smithi077.stdout:1/666: dwrite d3/d8/f67 [4194304,4194304] 0 2024-09-18T21:12:58.405 INFO:tasks.workunit.client.0.smithi077.stdout:1/667: readlink d3/d8/d75/l8e 0 2024-09-18T21:12:58.409 INFO:tasks.workunit.client.0.smithi077.stdout:1/668: dread d3/d8/d13/f1f [0,4194304] 0 2024-09-18T21:12:58.412 INFO:tasks.workunit.client.1.smithi103.stdout:5/738: creat de/d3e/ff5 x:0 0 0 2024-09-18T21:12:58.412 INFO:tasks.workunit.client.1.smithi103.stdout:9/747: creat d18/d52/d6f/db9/dcb/ffa x:0 0 0 2024-09-18T21:12:58.413 INFO:tasks.workunit.client.1.smithi103.stdout:2/622: truncate d3/d5/fd0 664171 0 2024-09-18T21:12:58.413 INFO:tasks.workunit.client.0.smithi077.stdout:9/601: dwrite d1/dd/d1a/f1b [0,4194304] 0 2024-09-18T21:12:58.414 INFO:tasks.workunit.client.1.smithi103.stdout:8/818: mkdir d4/de/de3/d107 0 2024-09-18T21:12:58.414 INFO:tasks.workunit.client.0.smithi077.stdout:9/602: chown d1/d54/f84 26 1 2024-09-18T21:12:58.416 INFO:tasks.workunit.client.1.smithi103.stdout:5/739: symlink de/d1f/d3b/d3c/d62/lf6 0 2024-09-18T21:12:58.417 INFO:tasks.workunit.client.1.smithi103.stdout:2/623: creat d3/d5/d2f/d32/dae/fe2 x:0 0 0 2024-09-18T21:12:58.418 INFO:tasks.workunit.client.1.smithi103.stdout:8/819: creat d4/de/f108 x:0 0 0 2024-09-18T21:12:58.424 INFO:tasks.workunit.client.0.smithi077.stdout:5/754: creat d0/d6/dd/ff7 x:0 0 0 2024-09-18T21:12:58.425 INFO:tasks.workunit.client.1.smithi103.stdout:7/712: dread d1/df/d42/f45 [0,4194304] 0 2024-09-18T21:12:58.425 INFO:tasks.workunit.client.1.smithi103.stdout:5/740: dread de/d1f/d3b/d3c/f90 [0,4194304] 0 2024-09-18T21:12:58.425 INFO:tasks.workunit.client.0.smithi077.stdout:3/605: mknod db/d14/d72/cbb 0 2024-09-18T21:12:58.426 INFO:tasks.workunit.client.0.smithi077.stdout:3/606: chown db/d14/d32/f7b 1799 1 2024-09-18T21:12:58.427 INFO:tasks.workunit.client.1.smithi103.stdout:2/624: dwrite d3/d5/d2c/f5c [0,4194304] 0 2024-09-18T21:12:58.429 INFO:tasks.workunit.client.0.smithi077.stdout:4/594: creat d3/dc/d24/fbb x:0 0 0 2024-09-18T21:12:58.430 INFO:tasks.workunit.client.0.smithi077.stdout:2/712: creat d1/d4/d5/d1a/d2e/d41/d2c/dab/ff1 x:0 0 0 2024-09-18T21:12:58.431 INFO:tasks.workunit.client.1.smithi103.stdout:7/713: symlink d1/df/d43/d63/d67/le2 0 2024-09-18T21:12:58.432 INFO:tasks.workunit.client.1.smithi103.stdout:8/820: getdents d4/d2d/dc1 0 2024-09-18T21:12:58.434 INFO:tasks.workunit.client.1.smithi103.stdout:5/741: symlink de/d1f/d3b/d58/dc4/d9c/lf7 0 2024-09-18T21:12:58.435 INFO:tasks.workunit.client.0.smithi077.stdout:1/669: readlink d3/d8/d49/d4e/ldb 0 2024-09-18T21:12:58.436 INFO:tasks.workunit.client.1.smithi103.stdout:7/714: unlink d1/df/d43/d61/fcf 0 2024-09-18T21:12:58.437 INFO:tasks.workunit.client.0.smithi077.stdout:1/670: write d3/d8/f88 [1595968,108111] 0 2024-09-18T21:12:58.439 INFO:tasks.workunit.client.0.smithi077.stdout:3/607: creat db/d14/d22/d36/fbc x:0 0 0 2024-09-18T21:12:58.441 INFO:tasks.workunit.client.1.smithi103.stdout:7/715: mknod d1/df/d44/db4/ce3 0 2024-09-18T21:12:58.442 INFO:tasks.workunit.client.1.smithi103.stdout:8/821: truncate f2 261011 0 2024-09-18T21:12:58.443 INFO:tasks.workunit.client.0.smithi077.stdout:1/671: dwrite d3/d38/dd5/f6f [0,4194304] 0 2024-09-18T21:12:58.446 INFO:tasks.workunit.client.0.smithi077.stdout:2/713: mknod d1/d4/d9/d80/d95/cf2 0 2024-09-18T21:12:58.449 INFO:tasks.workunit.client.1.smithi103.stdout:7/716: creat d1/df/d44/db4/fe4 x:0 0 0 2024-09-18T21:12:58.451 INFO:tasks.workunit.client.1.smithi103.stdout:8/822: write d4/d81/d71/f7e [1897786,120262] 0 2024-09-18T21:12:58.452 INFO:tasks.workunit.client.1.smithi103.stdout:2/625: getdents d3/d5/d2f 0 2024-09-18T21:12:58.452 INFO:tasks.workunit.client.0.smithi077.stdout:5/755: symlink d0/d6/lf8 0 2024-09-18T21:12:58.453 INFO:tasks.workunit.client.1.smithi103.stdout:7/717: mkdir d1/df/d42/d29/de5 0 2024-09-18T21:12:58.454 INFO:tasks.workunit.client.0.smithi077.stdout:8/601: symlink d2/d5/d6/d9f/da4/ld9 0 2024-09-18T21:12:58.455 INFO:tasks.workunit.client.0.smithi077.stdout:3/608: fsync db/d14/d32/f7b 0 2024-09-18T21:12:58.457 INFO:tasks.workunit.client.0.smithi077.stdout:3/609: write db/d14/d32/d49/fab [1825341,8981] 0 2024-09-18T21:12:58.458 INFO:tasks.workunit.client.1.smithi103.stdout:2/626: read d3/f21 [2458242,310] 0 2024-09-18T21:12:58.458 INFO:tasks.workunit.client.1.smithi103.stdout:8/823: dwrite d4/d2d/d4e/ff6 [0,4194304] 0 2024-09-18T21:12:58.459 INFO:tasks.workunit.client.0.smithi077.stdout:4/595: dread d3/dc/d51/d53/d89/fad [0,4194304] 0 2024-09-18T21:12:58.460 INFO:tasks.workunit.client.1.smithi103.stdout:7/718: rename d1/cd to d1/df/d42/d1f/d5d/dbe/ce6 0 2024-09-18T21:12:58.460 INFO:tasks.workunit.client.0.smithi077.stdout:6/599: link d7/d7e/d11/l2f d7/d7e/d11/d3e/d42/dbb/d31/lce 0 2024-09-18T21:12:58.463 INFO:tasks.workunit.client.1.smithi103.stdout:7/719: mkdir d1/df/d44/dba/de7 0 2024-09-18T21:12:58.464 INFO:tasks.workunit.client.0.smithi077.stdout:1/672: rename d3/d8/d13/d77/db1 to d3/d8/d93/dd3/d99/de8 0 2024-09-18T21:12:58.467 INFO:tasks.workunit.client.1.smithi103.stdout:9/748: dwrite d18/d52/fbf [0,4194304] 0 2024-09-18T21:12:58.469 INFO:tasks.workunit.client.0.smithi077.stdout:5/756: unlink d0/df/d10/d5c/f72 0 2024-09-18T21:12:58.470 INFO:tasks.workunit.client.0.smithi077.stdout:8/602: symlink d2/d5f/da8/d4f/d5a/d5e/d8f/lda 0 2024-09-18T21:12:58.472 INFO:tasks.workunit.client.0.smithi077.stdout:8/603: stat d2/d5f/da8/d20/l40 0 2024-09-18T21:12:58.472 INFO:tasks.workunit.client.1.smithi103.stdout:9/749: creat d18/d52/d6f/db9/de0/ffb x:0 0 0 2024-09-18T21:12:58.473 INFO:tasks.workunit.client.1.smithi103.stdout:2/627: dwrite d3/d5/d2f/d32/d90/dd7/fc6 [0,4194304] 0 2024-09-18T21:12:58.475 INFO:tasks.workunit.client.0.smithi077.stdout:7/732: link d12/d31/d77/d93/le7 d12/d22/d59/lfa 0 2024-09-18T21:12:58.476 INFO:tasks.workunit.client.1.smithi103.stdout:9/750: fdatasync d18/d52/d6f/d8e/db4/fdc 0 2024-09-18T21:12:58.478 INFO:tasks.workunit.client.0.smithi077.stdout:3/610: dread - db/d14/d32/d49/da4/d8a/d99/fa1 zero size 2024-09-18T21:12:58.481 INFO:tasks.workunit.client.1.smithi103.stdout:7/720: dread d1/df/d42/d1f/d2e/f37 [0,4194304] 0 2024-09-18T21:12:58.482 INFO:tasks.workunit.client.0.smithi077.stdout:6/600: fsync d7/d7e/d11/d3e/d42/d88/da4/f26 0 2024-09-18T21:12:58.483 INFO:tasks.workunit.client.1.smithi103.stdout:2/628: mknod d3/d5/d4a/ce3 0 2024-09-18T21:12:58.485 INFO:tasks.workunit.client.0.smithi077.stdout:0/754: link f5 d8/d37/ff1 0 2024-09-18T21:12:58.487 INFO:tasks.workunit.client.1.smithi103.stdout:7/721: creat d1/df/d43/d63/db9/d72/fe8 x:0 0 0 2024-09-18T21:12:58.488 INFO:tasks.workunit.client.1.smithi103.stdout:2/629: creat d3/d5/d2f/fe4 x:0 0 0 2024-09-18T21:12:58.489 INFO:tasks.workunit.client.1.smithi103.stdout:2/630: chown d3/fbc 704526 1 2024-09-18T21:12:58.492 INFO:tasks.workunit.client.1.smithi103.stdout:5/742: write de/d1f/d3b/d51/d57/d59/f5c [716082,90615] 0 2024-09-18T21:12:58.493 INFO:tasks.workunit.client.1.smithi103.stdout:2/631: rename d3/d5/d2f/lcd to d3/d5/d2f/d5b/le5 0 2024-09-18T21:12:58.493 INFO:tasks.workunit.client.1.smithi103.stdout:2/632: stat d3/d5/d25/f5f 0 2024-09-18T21:12:58.496 INFO:tasks.workunit.client.1.smithi103.stdout:5/743: fdatasync de/d3e/d15/f9e 0 2024-09-18T21:12:58.498 INFO:tasks.workunit.client.1.smithi103.stdout:2/633: mknod d3/d5/d2f/d32/ce6 0 2024-09-18T21:12:58.500 INFO:tasks.workunit.client.1.smithi103.stdout:2/634: truncate d3/d5/fdd 985791 0 2024-09-18T21:12:58.501 INFO:tasks.workunit.client.0.smithi077.stdout:0/755: creat d8/d1a/d39/d3b/d9a/dbd/ff2 x:0 0 0 2024-09-18T21:12:58.502 INFO:tasks.workunit.client.1.smithi103.stdout:2/635: chown d3/l71 233 1 2024-09-18T21:12:58.503 INFO:tasks.workunit.client.0.smithi077.stdout:4/596: dread d3/dc/f47 [0,4194304] 0 2024-09-18T21:12:58.503 INFO:tasks.workunit.client.0.smithi077.stdout:8/604: creat d2/d5/fdb x:0 0 0 2024-09-18T21:12:58.505 INFO:tasks.workunit.client.0.smithi077.stdout:3/611: dread db/d14/d32/d49/da4/d71/d3b/f7e [0,4194304] 0 2024-09-18T21:12:58.508 INFO:tasks.workunit.client.1.smithi103.stdout:5/744: rename de/d1f/d3b/d58/dc4/d33/d4f/f6a to de/d1f/d3b/ff8 0 2024-09-18T21:12:58.509 INFO:tasks.workunit.client.0.smithi077.stdout:4/597: unlink d3/dc/fb7 0 2024-09-18T21:12:58.510 INFO:tasks.workunit.client.0.smithi077.stdout:4/598: chown d3/d77/l64 106161861 1 2024-09-18T21:12:58.511 INFO:tasks.workunit.client.0.smithi077.stdout:4/599: stat d3/dc/d51/d53/fb4 0 2024-09-18T21:12:58.512 INFO:tasks.workunit.client.1.smithi103.stdout:2/636: symlink d3/d5/d2f/d32/dae/ddf/le7 0 2024-09-18T21:12:58.517 INFO:tasks.workunit.client.0.smithi077.stdout:3/612: dread db/f54 [0,4194304] 0 2024-09-18T21:12:58.517 INFO:tasks.workunit.client.0.smithi077.stdout:4/600: dwrite d3/d35/f37 [0,4194304] 0 2024-09-18T21:12:58.519 INFO:tasks.workunit.client.0.smithi077.stdout:2/714: write d1/d4/d5/d1a/f4a [7818296,98160] 0 2024-09-18T21:12:58.523 INFO:tasks.workunit.client.0.smithi077.stdout:4/601: mknod d3/dc/d24/d72/cbc 0 2024-09-18T21:12:58.525 INFO:tasks.workunit.client.0.smithi077.stdout:2/715: symlink d1/d4/d9/d80/d8e/lf3 0 2024-09-18T21:12:58.525 INFO:tasks.workunit.client.1.smithi103.stdout:9/751: dwrite d18/d52/d5e/f7d [0,4194304] 0 2024-09-18T21:12:58.526 INFO:tasks.workunit.client.1.smithi103.stdout:9/752: chown d18/d29/d68/d78/ca5 405 1 2024-09-18T21:12:58.526 INFO:tasks.workunit.client.0.smithi077.stdout:2/716: chown d1/d4/d9/d80/d8e/l4b 1063066327 1 2024-09-18T21:12:58.527 INFO:tasks.workunit.client.1.smithi103.stdout:9/753: chown d18/d29/d68/d92/d9c/fae 59 1 2024-09-18T21:12:58.530 INFO:tasks.workunit.client.0.smithi077.stdout:6/601: dwrite d7/d7e/d11/f56 [0,4194304] 0 2024-09-18T21:12:58.534 INFO:tasks.workunit.client.0.smithi077.stdout:2/717: rename d1/f11 to d1/d4/d5/d1a/d2e/d7e/ff4 0 2024-09-18T21:12:58.537 INFO:tasks.workunit.client.0.smithi077.stdout:4/602: symlink d3/lbd 0 2024-09-18T21:12:58.538 INFO:tasks.workunit.client.1.smithi103.stdout:6/722: sync 2024-09-18T21:12:58.538 INFO:tasks.workunit.client.0.smithi077.stdout:6/602: rename d7/c3d to d7/d7e/d11/d3e/d42/d88/ccf 0 2024-09-18T21:12:58.539 INFO:tasks.workunit.client.0.smithi077.stdout:2/718: rmdir d1/d4/d5/d1a/d2e/d41/d2c/ddb 39 2024-09-18T21:12:58.540 INFO:tasks.workunit.client.0.smithi077.stdout:2/719: stat d1/d4/d9/d80/d83/fbf 0 2024-09-18T21:12:58.541 INFO:tasks.workunit.client.0.smithi077.stdout:0/756: dwrite d8/d37/d95/dab/f7f [4194304,4194304] 0 2024-09-18T21:12:58.543 INFO:tasks.workunit.client.1.smithi103.stdout:6/723: dwrite d2/d3/d8/d4c/d4e/fc3 [0,4194304] 0 2024-09-18T21:12:58.545 INFO:tasks.workunit.client.0.smithi077.stdout:6/603: dread - d7/d7c/f97 zero size 2024-09-18T21:12:58.545 INFO:tasks.workunit.client.0.smithi077.stdout:8/605: write d2/d27/d29/d41/dbc/f6a [232791,97687] 0 2024-09-18T21:12:58.549 INFO:tasks.workunit.client.0.smithi077.stdout:2/720: dwrite d1/d4/d5/d1a/d2e/d41/d2c/f88 [0,4194304] 0 2024-09-18T21:12:58.552 INFO:tasks.workunit.client.0.smithi077.stdout:2/721: chown d1/d4/d5/d1a/d49/d6a/d81/dc4/dc0/ca9 7 1 2024-09-18T21:12:58.553 INFO:tasks.workunit.client.0.smithi077.stdout:2/722: readlink d1/d4/d9/lcf 0 2024-09-18T21:12:58.556 INFO:tasks.workunit.client.0.smithi077.stdout:6/604: mkdir d7/d7e/dd0 0 2024-09-18T21:12:58.557 INFO:tasks.workunit.client.0.smithi077.stdout:8/606: stat d2/d5f/da8/d4f/d5a/d2a/d67/f73 0 2024-09-18T21:12:58.558 INFO:tasks.workunit.client.0.smithi077.stdout:3/613: truncate f4 906516 0 2024-09-18T21:12:58.558 INFO:tasks.workunit.client.0.smithi077.stdout:8/607: chown d2/d5f/da8/d4f 25637 1 2024-09-18T21:12:58.569 INFO:tasks.workunit.client.0.smithi077.stdout:3/614: rename db/d14/f1d to db/d14/d32/d49/d4e/d8b/fbd 0 2024-09-18T21:12:58.570 INFO:tasks.workunit.client.0.smithi077.stdout:3/615: chown db/d14/d22/c51 92 1 2024-09-18T21:12:58.571 INFO:tasks.workunit.client.0.smithi077.stdout:4/603: dwrite d3/dc/d24/f43 [0,4194304] 0 2024-09-18T21:12:58.573 INFO:tasks.workunit.client.1.smithi103.stdout:5/745: mknod de/d1f/d3b/dcd/cf9 0 2024-09-18T21:12:58.574 INFO:tasks.workunit.client.0.smithi077.stdout:8/608: fsync d2/d5f/da8/f3c 0 2024-09-18T21:12:58.575 INFO:tasks.workunit.client.1.smithi103.stdout:2/637: symlink d3/d5/d2c/d77/le8 0 2024-09-18T21:12:58.576 INFO:tasks.workunit.client.0.smithi077.stdout:0/757: getdents d8/d1a/d39/d3b/d9a/de8 0 2024-09-18T21:12:58.580 INFO:tasks.workunit.client.1.smithi103.stdout:9/754: rename d18/d8d/d2f/f63 to d18/d29/d68/d92/d9c/dc8/deb/ffc 0 2024-09-18T21:12:58.580 INFO:tasks.workunit.client.0.smithi077.stdout:0/758: chown d8/d1a/d35/f7a 14329041 1 2024-09-18T21:12:58.581 INFO:tasks.workunit.client.0.smithi077.stdout:4/604: dwrite d3/dc/d32/d45/faa [0,4194304] 0 2024-09-18T21:12:58.581 INFO:tasks.workunit.client.0.smithi077.stdout:4/605: fsync d3/d7/d7b/f92 0 2024-09-18T21:12:58.583 INFO:tasks.workunit.client.0.smithi077.stdout:3/616: unlink db/f13 0 2024-09-18T21:12:58.585 INFO:tasks.workunit.client.1.smithi103.stdout:5/746: rmdir de/d1f/d3b/dcd 39 2024-09-18T21:12:58.586 INFO:tasks.workunit.client.0.smithi077.stdout:8/609: mknod d2/d5f/d6f/cdc 0 2024-09-18T21:12:58.586 INFO:tasks.workunit.client.1.smithi103.stdout:5/747: fdatasync de/d1f/d3b/d58/dc4/f22 0 2024-09-18T21:12:58.589 INFO:tasks.workunit.client.1.smithi103.stdout:9/755: rename d18/l4a to d18/d52/d6f/d8e/d8f/dbd/df1/lfd 0 2024-09-18T21:12:58.590 INFO:tasks.workunit.client.0.smithi077.stdout:0/759: mknod d8/d1a/d39/d64/cf3 0 2024-09-18T21:12:58.591 INFO:tasks.workunit.client.1.smithi103.stdout:6/724: mkdir d2/d3/d8/de2 0 2024-09-18T21:12:58.594 INFO:tasks.workunit.client.0.smithi077.stdout:8/610: dwrite d2/d5f/da8/d4f/d5a/d2a/dc8/fc9 [0,4194304] 0 2024-09-18T21:12:58.596 INFO:tasks.workunit.client.1.smithi103.stdout:5/748: mknod de/d1f/d3b/d51/db0/cfa 0 2024-09-18T21:12:58.596 INFO:tasks.workunit.client.0.smithi077.stdout:2/723: truncate d1/d4/d5/d1a/d49/d6a/d81/fce 159180 0 2024-09-18T21:12:58.598 INFO:tasks.workunit.client.0.smithi077.stdout:8/611: read d2/d27/f57 [2968238,63980] 0 2024-09-18T21:12:58.599 INFO:tasks.workunit.client.0.smithi077.stdout:6/605: write d7/d7e/d11/d3e/d42/dbb/d50/fb7 [449526,114470] 0 2024-09-18T21:12:58.600 INFO:tasks.workunit.client.0.smithi077.stdout:8/612: stat d2/d27/d29/d41/f45 0 2024-09-18T21:12:58.602 INFO:tasks.workunit.client.1.smithi103.stdout:6/725: creat d2/d24/d38/d68/d7c/fe3 x:0 0 0 2024-09-18T21:12:58.604 INFO:tasks.workunit.client.0.smithi077.stdout:2/724: creat d1/d4/d9/d80/d95/ff5 x:0 0 0 2024-09-18T21:12:58.606 INFO:tasks.workunit.client.0.smithi077.stdout:0/760: symlink d8/d1a/d39/d3b/lf4 0 2024-09-18T21:12:58.607 INFO:tasks.workunit.client.0.smithi077.stdout:6/606: dwrite d7/d7e/d11/d3e/d42/dbb/d49/fbc [0,4194304] 0 2024-09-18T21:12:58.608 INFO:tasks.workunit.client.0.smithi077.stdout:0/761: chown d8/d1d/d80/f5e 7 1 2024-09-18T21:12:58.609 INFO:tasks.workunit.client.1.smithi103.stdout:5/749: mkdir de/d1f/d3b/dfb 0 2024-09-18T21:12:58.610 INFO:tasks.workunit.client.1.smithi103.stdout:6/726: mkdir d2/d3/d7f/d91/da2/de4 0 2024-09-18T21:12:58.611 INFO:tasks.workunit.client.0.smithi077.stdout:8/613: creat d2/d5f/da8/d4f/d5a/d2a/d88/fdd x:0 0 0 2024-09-18T21:12:58.613 INFO:tasks.workunit.client.1.smithi103.stdout:5/750: creat de/d1f/d3b/d3c/d62/ffc x:0 0 0 2024-09-18T21:12:58.615 INFO:tasks.workunit.client.1.smithi103.stdout:6/727: dread d2/d3/d8/f59 [0,4194304] 0 2024-09-18T21:12:58.616 INFO:tasks.workunit.client.0.smithi077.stdout:2/725: readlink d1/d4/d5/d1a/d49/d6a/d81/dc4/dc0/lea 0 2024-09-18T21:12:58.619 INFO:tasks.workunit.client.1.smithi103.stdout:5/751: mknod de/d1f/d3b/d58/dd1/cfd 0 2024-09-18T21:12:58.621 INFO:tasks.workunit.client.0.smithi077.stdout:6/607: creat d7/d7e/d11/d3e/d42/d88/da4/fd1 x:0 0 0 2024-09-18T21:12:58.621 INFO:tasks.workunit.client.0.smithi077.stdout:4/606: dwrite d3/dc/d20/f27 [0,4194304] 0 2024-09-18T21:12:58.624 INFO:tasks.workunit.client.0.smithi077.stdout:0/762: creat d8/d1a/d39/d3b/d79/ff5 x:0 0 0 2024-09-18T21:12:58.625 INFO:tasks.workunit.client.1.smithi103.stdout:3/677: sync 2024-09-18T21:12:58.625 INFO:tasks.workunit.client.1.smithi103.stdout:0/669: sync 2024-09-18T21:12:58.625 INFO:tasks.workunit.client.1.smithi103.stdout:1/689: sync 2024-09-18T21:12:58.625 INFO:tasks.workunit.client.1.smithi103.stdout:4/799: sync 2024-09-18T21:12:58.627 INFO:tasks.workunit.client.1.smithi103.stdout:3/678: write d1/d23/d25/d4f/d58/f6d [2114356,39284] 0 2024-09-18T21:12:58.628 INFO:tasks.workunit.client.0.smithi077.stdout:4/607: dread d3/dc/d24/f43 [0,4194304] 0 2024-09-18T21:12:58.629 INFO:tasks.workunit.client.1.smithi103.stdout:5/752: creat de/d3e/d85/ffe x:0 0 0 2024-09-18T21:12:58.629 INFO:tasks.workunit.client.0.smithi077.stdout:4/608: write d3/d7/d42/f5d [5150594,92591] 0 2024-09-18T21:12:58.630 INFO:tasks.workunit.client.1.smithi103.stdout:5/753: write de/d1f/d3b/d3c/fc6 [129156,77048] 0 2024-09-18T21:12:58.631 INFO:tasks.workunit.client.1.smithi103.stdout:1/690: truncate d0/f9d 624876 0 2024-09-18T21:12:58.632 INFO:tasks.workunit.client.0.smithi077.stdout:3/617: creat db/d14/d32/d49/da4/d8a/d99/daf/fbe x:0 0 0 2024-09-18T21:12:58.632 INFO:tasks.workunit.client.1.smithi103.stdout:5/754: write de/d1f/d3b/d58/f9b [289486,40856] 0 2024-09-18T21:12:58.638 INFO:tasks.workunit.client.0.smithi077.stdout:8/614: symlink d2/d5f/da8/lde 0 2024-09-18T21:12:58.639 INFO:tasks.workunit.client.0.smithi077.stdout:8/615: fdatasync d2/d5f/da8/d20/f56 0 2024-09-18T21:12:58.639 INFO:tasks.workunit.client.1.smithi103.stdout:3/679: creat d1/d23/d25/fd3 x:0 0 0 2024-09-18T21:12:58.640 INFO:tasks.workunit.client.1.smithi103.stdout:3/680: write d1/d23/d25/d4f/d72/d85/fab [3941695,58002] 0 2024-09-18T21:12:58.641 INFO:tasks.workunit.client.0.smithi077.stdout:4/609: mknod d3/d7/cbe 0 2024-09-18T21:12:58.644 INFO:tasks.workunit.client.0.smithi077.stdout:2/726: rename d1/c70 to d1/d4/d9/d80/d83/dba/ddc/cf6 0 2024-09-18T21:12:58.646 INFO:tasks.workunit.client.1.smithi103.stdout:6/728: dwrite d2/d24/d5a/d67/f95 [0,4194304] 0 2024-09-18T21:12:58.646 INFO:tasks.workunit.client.1.smithi103.stdout:6/729: chown d2/d24/d5a/d67/c9c 83197 1 2024-09-18T21:12:58.648 INFO:tasks.workunit.client.0.smithi077.stdout:4/610: dwrite d3/dc/f6b [4194304,4194304] 0 2024-09-18T21:12:58.648 INFO:tasks.workunit.client.1.smithi103.stdout:5/755: creat de/d1f/d3b/d58/fff x:0 0 0 2024-09-18T21:12:58.653 INFO:tasks.workunit.client.0.smithi077.stdout:8/616: symlink d2/d5f/da8/d4f/ldf 0 2024-09-18T21:12:58.653 INFO:tasks.workunit.client.1.smithi103.stdout:1/691: mknod d0/d2/d2b/d3a/cf4 0 2024-09-18T21:12:58.656 INFO:tasks.workunit.client.0.smithi077.stdout:2/727: rename d1/d4/d9/l5b to d1/d4/d5/d7d/lf7 0 2024-09-18T21:12:58.657 INFO:tasks.workunit.client.1.smithi103.stdout:1/692: readlink d0/d2/d9/d10/l83 0 2024-09-18T21:12:58.658 INFO:tasks.workunit.client.1.smithi103.stdout:5/756: symlink de/d1f/d3b/d51/d57/dc8/l100 0 2024-09-18T21:12:58.658 INFO:tasks.workunit.client.1.smithi103.stdout:6/730: dwrite d2/d24/f80 [0,4194304] 0 2024-09-18T21:12:58.659 INFO:tasks.workunit.client.0.smithi077.stdout:4/611: rmdir d3/d7/d42 39 2024-09-18T21:12:58.660 INFO:tasks.workunit.client.1.smithi103.stdout:4/800: getdents d9/d38/d72/df0/d83 0 2024-09-18T21:12:58.661 INFO:tasks.workunit.client.1.smithi103.stdout:9/756: dwrite d18/d29/d68/f9a [0,4194304] 0 2024-09-18T21:12:58.663 INFO:tasks.workunit.client.0.smithi077.stdout:8/617: mknod d2/d5f/d6f/ce0 0 2024-09-18T21:12:58.663 INFO:tasks.workunit.client.1.smithi103.stdout:0/670: dwrite d1/d5/de/dc0/d8c/dce/d9f/d4f/d68/fa3 [0,4194304] 0 2024-09-18T21:12:58.665 INFO:tasks.workunit.client.1.smithi103.stdout:4/801: chown d9/d38/d72/df0/d83/db6/d21/c75 285874594 1 2024-09-18T21:12:58.669 INFO:tasks.workunit.client.1.smithi103.stdout:5/757: dwrite de/d2d/f69 [0,4194304] 0 2024-09-18T21:12:58.670 INFO:tasks.workunit.client.0.smithi077.stdout:0/763: dwrite d8/d26/f28 [0,4194304] 0 2024-09-18T21:12:58.671 INFO:tasks.workunit.client.1.smithi103.stdout:5/758: dread - de/d3e/d85/fac zero size 2024-09-18T21:12:58.671 INFO:tasks.workunit.client.1.smithi103.stdout:9/757: chown d18/d29/d68/d92/d9c/fad 7 1 2024-09-18T21:12:58.678 INFO:tasks.workunit.client.1.smithi103.stdout:6/731: chown d2/d24/d5a/d67/d76/d43/d44/lb2 0 1 2024-09-18T21:12:58.678 INFO:tasks.workunit.client.0.smithi077.stdout:3/618: getdents db/d14/d32/d49/da4/d71/d3b 0 2024-09-18T21:12:58.680 INFO:tasks.workunit.client.1.smithi103.stdout:0/671: unlink d1/d5/de/dc0/d8c/dce/d9f/d4f/d68/fa3 0 2024-09-18T21:12:58.681 INFO:tasks.workunit.client.0.smithi077.stdout:8/618: readlink d2/d5/d6/l77 0 2024-09-18T21:12:58.682 INFO:tasks.workunit.client.0.smithi077.stdout:8/619: chown d2/d5f/da8/f3c 245861701 1 2024-09-18T21:12:58.685 INFO:tasks.workunit.client.0.smithi077.stdout:6/608: link d7/d7e/d11/d3e/f65 d7/d7e/d11/fd2 0 2024-09-18T21:12:58.687 INFO:tasks.workunit.client.0.smithi077.stdout:6/609: chown d7/d7e/d11/d3e/d42/dbb/d5c/f6f 14 1 2024-09-18T21:12:58.687 INFO:tasks.workunit.client.0.smithi077.stdout:4/612: rename d3/la3 to d3/d77/d9c/db9/lbf 0 2024-09-18T21:12:58.688 INFO:tasks.workunit.client.1.smithi103.stdout:9/758: readlink d18/d52/d6f/d8e/db4/lc2 0 2024-09-18T21:12:58.689 INFO:tasks.workunit.client.0.smithi077.stdout:6/610: dread - d7/d7e/f58 zero size 2024-09-18T21:12:58.689 INFO:tasks.workunit.client.0.smithi077.stdout:8/620: mknod d2/d5/d6/d7e/ce1 0 2024-09-18T21:12:58.691 INFO:tasks.workunit.client.1.smithi103.stdout:6/732: mkdir d2/d3/d7f/d91/de5 0 2024-09-18T21:12:58.691 INFO:tasks.workunit.client.0.smithi077.stdout:2/728: dwrite d1/d4/d5/d1a/d2e/d7e/f91 [0,4194304] 0 2024-09-18T21:12:58.692 INFO:tasks.workunit.client.0.smithi077.stdout:8/621: write d2/d5f/da8/d4f/fcc [738007,126280] 0 2024-09-18T21:12:58.695 INFO:tasks.workunit.client.1.smithi103.stdout:0/672: unlink d1/d5/de/d19/d1e/d34/fea 0 2024-09-18T21:12:58.696 INFO:tasks.workunit.client.1.smithi103.stdout:5/759: dread de/f81 [0,4194304] 0 2024-09-18T21:12:58.696 INFO:tasks.workunit.client.0.smithi077.stdout:3/619: mknod db/d14/d32/d49/da4/cbf 0 2024-09-18T21:12:58.698 INFO:tasks.workunit.client.1.smithi103.stdout:9/759: mkdir d18/d52/d6f/d8e/d8f/dbd/df1/dfe 0 2024-09-18T21:12:58.698 INFO:tasks.workunit.client.0.smithi077.stdout:0/764: rename d8/d26/c24 to d8/d1a/d39/ded/cf6 0 2024-09-18T21:12:58.703 INFO:tasks.workunit.client.0.smithi077.stdout:6/611: creat d7/d7e/d11/d3e/dcd/fd3 x:0 0 0 2024-09-18T21:12:58.705 INFO:tasks.workunit.client.1.smithi103.stdout:9/760: dread - d18/d52/d6f/d8e/fa0 zero size 2024-09-18T21:12:58.706 INFO:tasks.workunit.client.0.smithi077.stdout:0/765: unlink d8/d1a/d39/f8e 0 2024-09-18T21:12:58.707 INFO:tasks.workunit.client.1.smithi103.stdout:4/802: getdents d9/d38/d72/df0 0 2024-09-18T21:12:58.708 INFO:tasks.workunit.client.1.smithi103.stdout:4/803: fsync d9/d38/d72/df0/f49 0 2024-09-18T21:12:58.709 INFO:tasks.workunit.client.0.smithi077.stdout:6/612: mkdir d7/d7e/d11/d3e/d42/d88/da4/dd4 0 2024-09-18T21:12:58.710 INFO:tasks.workunit.client.1.smithi103.stdout:9/761: mkdir d18/d29/d68/dff 0 2024-09-18T21:12:58.710 INFO:tasks.workunit.client.1.smithi103.stdout:0/673: link d1/d5/de/d24/f32 d1/d5/de/d19/fef 0 2024-09-18T21:12:58.711 INFO:tasks.workunit.client.1.smithi103.stdout:0/674: chown d1/f9b 15255 1 2024-09-18T21:12:58.711 INFO:tasks.workunit.client.0.smithi077.stdout:0/766: creat d8/d37/d66/d87/de0/dce/ff7 x:0 0 0 2024-09-18T21:12:58.712 INFO:tasks.workunit.client.0.smithi077.stdout:8/622: creat d2/d5f/da8/d20/fe2 x:0 0 0 2024-09-18T21:12:58.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:12:58 smithi077 ceph-mon[27689]: pgmap v20: 65 pgs: 65 active+clean; 2.5 GiB data, 9.0 GiB used, 527 GiB / 536 GiB avail; 86 MiB/s rd, 262 MiB/s wr, 476 op/s 2024-09-18T21:12:58.713 INFO:tasks.workunit.client.0.smithi077.stdout:6/613: mkdir d7/d7e/d11/d3e/d42/dbb/d50/dd5 0 2024-09-18T21:12:58.713 INFO:tasks.workunit.client.0.smithi077.stdout:8/623: chown d2/d5f/da8/d4f/d5a/d5e/d8f/d6e/cd5 13 1 2024-09-18T21:12:58.713 INFO:tasks.workunit.client.1.smithi103.stdout:6/733: link d2/d3/d8/d4c/f61 d2/d3/d7f/d91/da2/de4/fe6 0 2024-09-18T21:12:58.715 INFO:tasks.workunit.client.0.smithi077.stdout:6/614: write d7/f1f [1639374,62590] 0 2024-09-18T21:12:58.715 INFO:tasks.workunit.client.1.smithi103.stdout:7/722: sync 2024-09-18T21:12:58.715 INFO:tasks.workunit.client.1.smithi103.stdout:8/824: sync 2024-09-18T21:12:58.715 INFO:tasks.workunit.client.1.smithi103.stdout:2/638: sync 2024-09-18T21:12:58.717 INFO:tasks.workunit.client.0.smithi077.stdout:9/603: sync 2024-09-18T21:12:58.717 INFO:tasks.workunit.client.0.smithi077.stdout:9/604: readlink d1/l78 0 2024-09-18T21:12:58.720 INFO:tasks.workunit.client.1.smithi103.stdout:5/760: getdents de/d2d 0 2024-09-18T21:12:58.720 INFO:tasks.workunit.client.1.smithi103.stdout:8/825: dread d4/d81/dd7/dde/d59/fdb [0,4194304] 0 2024-09-18T21:12:58.720 INFO:tasks.workunit.client.0.smithi077.stdout:9/605: dread d1/dd/d11/d2d/fb6 [0,4194304] 0 2024-09-18T21:12:58.721 INFO:tasks.workunit.client.1.smithi103.stdout:1/693: truncate d0/d11/f35 7107652 0 2024-09-18T21:12:58.723 INFO:tasks.workunit.client.0.smithi077.stdout:6/615: unlink d7/d7e/d11/d3e/d42/d88/da4/f85 0 2024-09-18T21:12:58.726 INFO:tasks.workunit.client.1.smithi103.stdout:4/804: symlink d9/d38/d72/df0/d83/db6/l112 0 2024-09-18T21:12:58.727 INFO:tasks.workunit.client.1.smithi103.stdout:3/681: sync 2024-09-18T21:12:58.728 INFO:tasks.workunit.client.1.smithi103.stdout:3/682: write d1/d2/d18/d30/fb8 [950645,35134] 0 2024-09-18T21:12:58.728 INFO:tasks.workunit.client.0.smithi077.stdout:9/606: rename d1/dd/d11/f3e to d1/d54/d81/fca 0 2024-09-18T21:12:58.729 INFO:tasks.workunit.client.1.smithi103.stdout:3/683: fdatasync d1/d23/d25/d4f/d72/f87 0 2024-09-18T21:12:58.730 INFO:tasks.workunit.client.1.smithi103.stdout:3/684: read - d1/d23/d25/d4f/d58/d68/fac zero size 2024-09-18T21:12:58.730 INFO:tasks.workunit.client.0.smithi077.stdout:2/729: write d1/d4/d9/d80/f90 [383148,20731] 0 2024-09-18T21:12:58.731 INFO:tasks.workunit.client.1.smithi103.stdout:7/723: creat d1/df/d43/d63/db9/fe9 x:0 0 0 2024-09-18T21:12:58.732 INFO:tasks.workunit.client.1.smithi103.stdout:7/724: fsync d1/df/d42/d1f/d5d/dbe/fd0 0 2024-09-18T21:12:58.732 INFO:tasks.workunit.client.1.smithi103.stdout:7/725: stat d1/df/d43/d63/l9b 0 2024-09-18T21:12:58.733 INFO:tasks.workunit.client.0.smithi077.stdout:6/616: rename d7/d7e/f15 to d7/d7e/d11/d3e/d42/fd6 0 2024-09-18T21:12:58.734 INFO:tasks.workunit.client.0.smithi077.stdout:4/613: write d3/f26 [1651250,81748] 0 2024-09-18T21:12:58.736 INFO:tasks.workunit.client.0.smithi077.stdout:3/620: write db/d14/f20 [1962801,20143] 0 2024-09-18T21:12:58.740 INFO:tasks.workunit.client.0.smithi077.stdout:6/617: dread d7/d7e/d11/d3e/d42/dbb/d49/f84 [0,4194304] 0 2024-09-18T21:12:58.742 INFO:tasks.workunit.client.0.smithi077.stdout:6/618: stat d7/d7e/d11/d3e/d42/d88/da4 0 2024-09-18T21:12:58.742 INFO:tasks.workunit.client.0.smithi077.stdout:9/607: dwrite d1/dd/d11/d1c/d38/d46/fac [0,4194304] 0 2024-09-18T21:12:58.743 INFO:tasks.workunit.client.0.smithi077.stdout:6/619: write d7/d7e/d11/f56 [5066243,64969] 0 2024-09-18T21:12:58.744 INFO:tasks.workunit.client.0.smithi077.stdout:4/614: fdatasync d3/dc/d51/d53/f58 0 2024-09-18T21:12:58.745 INFO:tasks.workunit.client.0.smithi077.stdout:4/615: fdatasync d3/d7/f4f 0 2024-09-18T21:12:58.748 INFO:tasks.workunit.client.1.smithi103.stdout:6/734: symlink d2/d3/d8/le7 0 2024-09-18T21:12:58.748 INFO:tasks.workunit.client.0.smithi077.stdout:8/624: rmdir d2 39 2024-09-18T21:12:58.749 INFO:tasks.workunit.client.0.smithi077.stdout:3/621: readlink db/d14/d32/d49/da4/d71/l74 0 2024-09-18T21:12:58.749 INFO:tasks.workunit.client.0.smithi077.stdout:0/767: write d8/d37/d66/d87/de0/f8a [175080,125201] 0 2024-09-18T21:12:58.751 INFO:tasks.workunit.client.0.smithi077.stdout:9/608: dwrite d1/dd/d1a/d42/f9f [0,4194304] 0 2024-09-18T21:12:58.752 INFO:tasks.workunit.client.0.smithi077.stdout:2/730: mknod d1/d4/d9/d80/d8e/de7/cf8 0 2024-09-18T21:12:58.759 INFO:tasks.workunit.client.0.smithi077.stdout:2/731: dwrite d1/d4/d5/d1a/d2e/d41/d2c/dab/fd4 [0,4194304] 0 2024-09-18T21:12:58.760 INFO:tasks.workunit.client.1.smithi103.stdout:2/639: mknod d3/d5/d25/dd5/ce9 0 2024-09-18T21:12:58.761 INFO:tasks.workunit.client.1.smithi103.stdout:2/640: chown d3/d5/d2f/f91 48533 1 2024-09-18T21:12:58.761 INFO:tasks.workunit.client.1.smithi103.stdout:2/641: chown d3/d5/d2c/l3a 131692666 1 2024-09-18T21:12:58.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:12:58 smithi103 ceph-mon[34827]: pgmap v20: 65 pgs: 65 active+clean; 2.5 GiB data, 9.0 GiB used, 527 GiB / 536 GiB avail; 86 MiB/s rd, 262 MiB/s wr, 476 op/s 2024-09-18T21:12:58.767 INFO:tasks.workunit.client.1.smithi103.stdout:5/761: dwrite de/f16 [0,4194304] 0 2024-09-18T21:12:58.768 INFO:tasks.workunit.client.1.smithi103.stdout:5/762: stat de/d2d/d7f/f6b 0 2024-09-18T21:12:58.771 INFO:tasks.workunit.client.0.smithi077.stdout:8/625: fsync d2/d5f/da8/d20/d3e/db4/fd0 0 2024-09-18T21:12:58.772 INFO:tasks.workunit.client.0.smithi077.stdout:3/622: mknod db/d14/d32/d49/d4e/d6a/cc0 0 2024-09-18T21:12:58.773 INFO:tasks.workunit.client.0.smithi077.stdout:0/768: symlink d8/d1a/d39/dd0/lf8 0 2024-09-18T21:12:58.773 INFO:tasks.workunit.client.1.smithi103.stdout:1/694: dwrite d0/d2/d9/dc/f15 [0,4194304] 0 2024-09-18T21:12:58.774 INFO:tasks.workunit.client.1.smithi103.stdout:5/763: truncate de/d1f/d3b/d58/faa 2009108 0 2024-09-18T21:12:58.775 INFO:tasks.workunit.client.1.smithi103.stdout:9/762: creat d18/d8d/f100 x:0 0 0 2024-09-18T21:12:58.775 INFO:tasks.workunit.client.1.smithi103.stdout:2/642: mknod d3/d5/d2f/d32/cea 0 2024-09-18T21:12:58.777 INFO:tasks.workunit.client.0.smithi077.stdout:2/732: mkdir d1/d4/d9/d80/d8e/df9 0 2024-09-18T21:12:58.778 INFO:tasks.workunit.client.1.smithi103.stdout:8/826: link d4/ff d4/d81/dd7/f109 0 2024-09-18T21:12:58.780 INFO:tasks.workunit.client.1.smithi103.stdout:0/675: rename d1/d5/de/f87 to d1/d5/de/d19/d1e/ff0 0 2024-09-18T21:12:58.780 INFO:tasks.workunit.client.1.smithi103.stdout:4/805: dwrite d9/d38/fba [0,4194304] 0 2024-09-18T21:12:58.781 INFO:tasks.workunit.client.1.smithi103.stdout:2/643: write d3/d5/f35 [5083171,58537] 0 2024-09-18T21:12:58.781 INFO:tasks.workunit.client.0.smithi077.stdout:3/623: dwrite db/d14/d22/d36/f73 [0,4194304] 0 2024-09-18T21:12:58.783 INFO:tasks.workunit.client.0.smithi077.stdout:0/769: dwrite d8/d37/d66/f6c [0,4194304] 0 2024-09-18T21:12:58.785 INFO:tasks.workunit.client.1.smithi103.stdout:1/695: unlink d0/d11/ce4 0 2024-09-18T21:12:58.785 INFO:tasks.workunit.client.1.smithi103.stdout:2/644: truncate d3/d5/d2c/d77/d9c/fc8 562133 0 2024-09-18T21:12:58.790 INFO:tasks.workunit.client.0.smithi077.stdout:8/626: rename d2/d27/d29/l85 to d2/d5f/da8/d4f/d5a/d2a/dc8/le3 0 2024-09-18T21:12:58.790 INFO:tasks.workunit.client.1.smithi103.stdout:7/726: link d1/df/l47 d1/df/d43/d63/db9/lea 0 2024-09-18T21:12:58.791 INFO:tasks.workunit.client.1.smithi103.stdout:5/764: mkdir de/d1f/d3b/d58/dc4/d33/d4f/d101 0 2024-09-18T21:12:58.793 INFO:tasks.workunit.client.1.smithi103.stdout:5/765: read de/d3e/d15/fa8 [288672,67610] 0 2024-09-18T21:12:58.794 INFO:tasks.workunit.client.0.smithi077.stdout:4/616: creat d3/dc/d32/fc0 x:0 0 0 2024-09-18T21:12:58.796 INFO:tasks.workunit.client.1.smithi103.stdout:6/735: rename d2/l25 to d2/d3/dcb/le8 0 2024-09-18T21:12:58.796 INFO:tasks.workunit.client.0.smithi077.stdout:2/733: read d1/d4/d5/d1a/d49/d6a/f8b [1707889,26238] 0 2024-09-18T21:12:58.797 INFO:tasks.workunit.client.0.smithi077.stdout:3/624: creat db/d14/d22/d36/d39/d50/fc1 x:0 0 0 2024-09-18T21:12:58.799 INFO:tasks.workunit.client.1.smithi103.stdout:8/827: creat d4/d81/dd7/dde/d59/d9c/f10a x:0 0 0 2024-09-18T21:12:58.803 INFO:tasks.workunit.client.0.smithi077.stdout:6/620: getdents d7/d7e/d11/d3e/d42 0 2024-09-18T21:12:58.805 INFO:tasks.workunit.client.0.smithi077.stdout:4/617: creat d3/d77/d9c/fc1 x:0 0 0 2024-09-18T21:12:58.812 INFO:tasks.workunit.client.1.smithi103.stdout:9/763: rename d18/d52/d6f/db9/dcb/fd6 to d18/d8d/d2f/f101 0 2024-09-18T21:12:58.812 INFO:tasks.workunit.client.0.smithi077.stdout:9/609: link d1/d54/d81/f8b d1/dd/d1a/d42/fcb 0 2024-09-18T21:12:58.814 INFO:tasks.workunit.client.0.smithi077.stdout:3/625: dwrite db/d4d/f69 [0,4194304] 0 2024-09-18T21:12:58.814 INFO:tasks.workunit.client.1.smithi103.stdout:8/828: unlink d4/d2d/d3d/c48 0 2024-09-18T21:12:58.815 INFO:tasks.workunit.client.0.smithi077.stdout:9/610: write d1/dd/d11/d1c/d38/d46/f8a [1641126,116639] 0 2024-09-18T21:12:58.817 INFO:tasks.workunit.client.1.smithi103.stdout:2/645: truncate d3/d5/d2c/d54/d68/f9d 926861 0 2024-09-18T21:12:58.818 INFO:tasks.workunit.client.0.smithi077.stdout:6/621: creat d7/d7e/d11/d3e/d42/dbb/d49/fd7 x:0 0 0 2024-09-18T21:12:58.818 INFO:tasks.workunit.client.1.smithi103.stdout:0/676: dread d1/f36 [0,4194304] 0 2024-09-18T21:12:58.823 INFO:tasks.workunit.client.1.smithi103.stdout:6/736: truncate d2/d3/f19 2019136 0 2024-09-18T21:12:58.824 INFO:tasks.workunit.client.1.smithi103.stdout:6/737: chown d2/d24/d5a/d67/f95 21 1 2024-09-18T21:12:58.826 INFO:tasks.workunit.client.1.smithi103.stdout:1/696: dread d0/f7 [0,4194304] 0 2024-09-18T21:12:58.829 INFO:tasks.workunit.client.1.smithi103.stdout:4/806: rename d9/d38/d72/df0/d83/db6/d86 to d9/d38/d58/d113 0 2024-09-18T21:12:58.832 INFO:tasks.workunit.client.0.smithi077.stdout:9/611: stat d1/d54/c1d 0 2024-09-18T21:12:58.833 INFO:tasks.workunit.client.0.smithi077.stdout:6/622: dread - d7/d7e/f32 zero size 2024-09-18T21:12:58.834 INFO:tasks.workunit.client.1.smithi103.stdout:2/646: truncate d3/d5/f4c 3882643 0 2024-09-18T21:12:58.835 INFO:tasks.workunit.client.0.smithi077.stdout:2/734: link d1/d4/d9/d80/d95/cf2 d1/d4/d9/d80/d83/cfa 0 2024-09-18T21:12:58.838 INFO:tasks.workunit.client.0.smithi077.stdout:8/627: getdents d2/d5f/da8/d4f/d5a/d5e 0 2024-09-18T21:12:58.839 INFO:tasks.workunit.client.0.smithi077.stdout:8/628: write d2/d27/d29/f43 [516009,56137] 0 2024-09-18T21:12:58.840 INFO:tasks.workunit.client.1.smithi103.stdout:6/738: mknod d2/d3/d7f/d91/ce9 0 2024-09-18T21:12:58.840 INFO:tasks.workunit.client.1.smithi103.stdout:7/727: dwrite d1/df/d42/d29/d48/dbb/f4f [0,4194304] 0 2024-09-18T21:12:58.840 INFO:tasks.workunit.client.0.smithi077.stdout:4/618: write d3/dc/d51/d53/f58 [71387,51516] 0 2024-09-18T21:12:58.841 INFO:tasks.workunit.client.1.smithi103.stdout:6/739: chown d2/d24/d5a/f17 1904248 1 2024-09-18T21:12:58.841 INFO:tasks.workunit.client.1.smithi103.stdout:5/766: dwrite de/d1f/d3b/d58/dc4/f5b [0,4194304] 0 2024-09-18T21:12:58.843 INFO:tasks.workunit.client.1.smithi103.stdout:5/767: dread - de/d1f/d3b/d58/feb zero size 2024-09-18T21:12:58.844 INFO:tasks.workunit.client.1.smithi103.stdout:4/807: truncate d9/d38/d58/fa7 352179 0 2024-09-18T21:12:58.845 INFO:tasks.workunit.client.1.smithi103.stdout:3/685: sync 2024-09-18T21:12:58.848 INFO:tasks.workunit.client.0.smithi077.stdout:6/623: fdatasync d7/d7e/d11/d3e/d42/dbb/d31/f3f 0 2024-09-18T21:12:58.850 INFO:tasks.workunit.client.1.smithi103.stdout:9/764: mkdir d18/d52/d6f/d8e/d102 0 2024-09-18T21:12:58.851 INFO:tasks.workunit.client.0.smithi077.stdout:2/735: rmdir d1/d4/d9/d80/d8e/de7 39 2024-09-18T21:12:58.854 INFO:tasks.workunit.client.1.smithi103.stdout:4/808: dread d9/d38/d72/df0/d83/db6/d41/f5f [0,4194304] 0 2024-09-18T21:12:58.854 INFO:tasks.workunit.client.0.smithi077.stdout:3/626: write db/d14/d32/d49/da4/f53 [966778,12006] 0 2024-09-18T21:12:58.855 INFO:tasks.workunit.client.0.smithi077.stdout:3/627: chown db/d14/d32/d49/da4/c7c 967001158 1 2024-09-18T21:12:58.857 INFO:tasks.workunit.client.0.smithi077.stdout:4/619: creat d3/dc/d32/d45/d5e/fc2 x:0 0 0 2024-09-18T21:12:58.858 INFO:tasks.workunit.client.0.smithi077.stdout:8/629: dread d2/d5f/da8/d20/d3e/f8a [0,4194304] 0 2024-09-18T21:12:58.858 INFO:tasks.workunit.client.1.smithi103.stdout:0/677: write d1/d5/de/d22/f5b [1405370,22482] 0 2024-09-18T21:12:58.859 INFO:tasks.workunit.client.0.smithi077.stdout:4/620: truncate d3/d7/d7b/f92 582036 0 2024-09-18T21:12:58.861 INFO:tasks.workunit.client.1.smithi103.stdout:7/728: fdatasync d1/df/f22 0 2024-09-18T21:12:58.863 INFO:tasks.workunit.client.1.smithi103.stdout:1/697: write d0/d2/d9/d10/d5d/f95 [1255130,62415] 0 2024-09-18T21:12:58.863 INFO:tasks.workunit.client.0.smithi077.stdout:9/612: creat d1/fcc x:0 0 0 2024-09-18T21:12:58.865 INFO:tasks.workunit.client.1.smithi103.stdout:6/740: creat d2/d3/d8/d4c/d7d/fea x:0 0 0 2024-09-18T21:12:58.868 INFO:tasks.workunit.client.0.smithi077.stdout:8/630: mknod d2/d27/d29/d72/d81/ce4 0 2024-09-18T21:12:58.869 INFO:tasks.workunit.client.1.smithi103.stdout:6/741: truncate d2/d24/d38/d68/dac/fcc 392072 0 2024-09-18T21:12:58.870 INFO:tasks.workunit.client.1.smithi103.stdout:1/698: dwrite d0/d2/fb [0,4194304] 0 2024-09-18T21:12:58.870 INFO:tasks.workunit.client.0.smithi077.stdout:8/631: write d2/d5f/da8/d4f/d5a/d2a/dc8/fc9 [4207742,4070] 0 2024-09-18T21:12:58.870 INFO:tasks.workunit.client.1.smithi103.stdout:6/742: chown d2/f28 99694934 1 2024-09-18T21:12:58.871 INFO:tasks.workunit.client.0.smithi077.stdout:2/736: truncate d1/d4/d5/d1a/f4c 3154836 0 2024-09-18T21:12:58.873 INFO:tasks.workunit.client.0.smithi077.stdout:3/628: mknod db/d14/d32/d49/da4/d89/cc2 0 2024-09-18T21:12:58.873 INFO:tasks.workunit.client.0.smithi077.stdout:2/737: readlink d1/d4/d5/d1a/d2e/d41/la4 0 2024-09-18T21:12:58.875 INFO:tasks.workunit.client.1.smithi103.stdout:9/765: rmdir d18/d8d 39 2024-09-18T21:12:58.879 INFO:tasks.workunit.client.0.smithi077.stdout:9/613: symlink d1/dd/d1a/lcd 0 2024-09-18T21:12:58.881 INFO:tasks.workunit.client.1.smithi103.stdout:2/647: dwrite d3/d5/d2f/d48/f9b [0,4194304] 0 2024-09-18T21:12:58.882 INFO:tasks.workunit.client.0.smithi077.stdout:8/632: dwrite d2/d5f/da8/fd3 [0,4194304] 0 2024-09-18T21:12:58.883 INFO:tasks.workunit.client.1.smithi103.stdout:4/809: write d9/fc [2645393,27911] 0 2024-09-18T21:12:58.886 INFO:tasks.workunit.client.0.smithi077.stdout:2/738: fsync d1/d4/d5/d1a/d2e/f5a 0 2024-09-18T21:12:58.887 INFO:tasks.workunit.client.1.smithi103.stdout:0/678: dread d1/d93/fe0 [0,4194304] 0 2024-09-18T21:12:58.890 INFO:tasks.workunit.client.0.smithi077.stdout:9/614: rename d1/d54/d51/da3 to d1/dd/d11/d1c/d38/d46/d55/dce 0 2024-09-18T21:12:58.892 INFO:tasks.workunit.client.1.smithi103.stdout:7/729: creat d1/df/dbf/feb x:0 0 0 2024-09-18T21:12:58.892 INFO:tasks.workunit.client.0.smithi077.stdout:3/629: mkdir db/d14/d32/d49/d4e/d6a/db5/dc3 0 2024-09-18T21:12:58.895 INFO:tasks.workunit.client.0.smithi077.stdout:8/633: creat d2/d5f/da8/d4f/d5a/d5e/fe5 x:0 0 0 2024-09-18T21:12:58.898 INFO:tasks.workunit.client.1.smithi103.stdout:1/699: creat d0/d2/d9/dc/d36/d52/ff5 x:0 0 0 2024-09-18T21:12:58.898 INFO:tasks.workunit.client.0.smithi077.stdout:9/615: dwrite d1/dd/d11/d15/f86 [4194304,4194304] 0 2024-09-18T21:12:58.900 INFO:tasks.workunit.client.1.smithi103.stdout:6/743: mknod d2/d3/d7f/d91/da2/ceb 0 2024-09-18T21:12:58.902 INFO:tasks.workunit.client.0.smithi077.stdout:2/739: chown d1/d4/d5/d1a/c56 0 1 2024-09-18T21:12:58.902 INFO:tasks.workunit.client.1.smithi103.stdout:5/768: truncate de/d1f/d3b/d58/dc4/f22 31028 0 2024-09-18T21:12:58.905 INFO:tasks.workunit.client.0.smithi077.stdout:8/634: dwrite d2/d5f/da8/d4f/fc0 [0,4194304] 0 2024-09-18T21:12:58.907 INFO:tasks.workunit.client.0.smithi077.stdout:4/621: dread d3/d77/f7a [0,4194304] 0 2024-09-18T21:12:58.907 INFO:tasks.workunit.client.1.smithi103.stdout:3/686: creat d1/d23/d25/d4f/dce/fd4 x:0 0 0 2024-09-18T21:12:58.909 INFO:tasks.workunit.client.1.smithi103.stdout:6/744: dwrite d2/d24/d38/d68/dac/fc8 [0,4194304] 0 2024-09-18T21:12:58.909 INFO:tasks.workunit.client.1.smithi103.stdout:6/745: stat d2 0 2024-09-18T21:12:58.910 INFO:tasks.workunit.client.0.smithi077.stdout:9/616: stat d1/dd/d11/d1c/d38/d46/d55/dce/lb1 0 2024-09-18T21:12:58.911 INFO:tasks.workunit.client.1.smithi103.stdout:3/687: write d1/d23/d47/dbb/fba [731863,58611] 0 2024-09-18T21:12:58.914 INFO:tasks.workunit.client.0.smithi077.stdout:8/635: mknod d2/d5f/d6f/ce6 0 2024-09-18T21:12:58.916 INFO:tasks.workunit.client.0.smithi077.stdout:8/636: write d2/d27/d29/d41/fb7 [116623,74449] 0 2024-09-18T21:12:58.917 INFO:tasks.workunit.client.0.smithi077.stdout:8/637: chown d2/d27/c86 93 1 2024-09-18T21:12:58.918 INFO:tasks.workunit.client.1.smithi103.stdout:6/746: dread d2/d3/d8/f75 [0,4194304] 0 2024-09-18T21:12:58.919 INFO:tasks.workunit.client.1.smithi103.stdout:8/829: getdents d4/de 0 2024-09-18T21:12:58.923 INFO:tasks.workunit.client.1.smithi103.stdout:4/810: unlink d9/d38/d72/df0/d83/fe5 0 2024-09-18T21:12:58.923 INFO:tasks.workunit.client.1.smithi103.stdout:4/811: readlink d9/d38/l10a 0 2024-09-18T21:12:58.926 INFO:tasks.workunit.client.1.smithi103.stdout:0/679: fdatasync d1/d9/d3e/fac 0 2024-09-18T21:12:58.929 INFO:tasks.workunit.client.0.smithi077.stdout:2/740: creat d1/d4/d5/d1a/d2e/d41/ffb x:0 0 0 2024-09-18T21:12:58.930 INFO:tasks.workunit.client.0.smithi077.stdout:4/622: link d3/lbd d3/dc/d51/d53/d89/lc3 0 2024-09-18T21:12:58.933 INFO:tasks.workunit.client.0.smithi077.stdout:9/617: creat d1/d54/fcf x:0 0 0 2024-09-18T21:12:58.935 INFO:tasks.workunit.client.0.smithi077.stdout:3/630: dwrite db/d14/d32/d49/da4/d71/f43 [0,4194304] 0 2024-09-18T21:12:58.936 INFO:tasks.workunit.client.0.smithi077.stdout:4/623: fsync d3/dc/d24/f4a 0 2024-09-18T21:12:58.937 INFO:tasks.workunit.client.0.smithi077.stdout:8/638: dread d2/d5f/da8/d26/f84 [0,4194304] 0 2024-09-18T21:12:58.938 INFO:tasks.workunit.client.0.smithi077.stdout:4/624: chown d3/dc/d20/l3d 112 1 2024-09-18T21:12:58.941 INFO:tasks.workunit.client.1.smithi103.stdout:5/769: dread de/d1f/d3b/ff8 [0,4194304] 0 2024-09-18T21:12:58.943 INFO:tasks.workunit.client.0.smithi077.stdout:2/741: rename d1/d4/d9/d80 to d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc 0 2024-09-18T21:12:58.945 INFO:tasks.workunit.client.1.smithi103.stdout:9/766: chown d18/d8d/f100 528671783 1 2024-09-18T21:12:58.946 INFO:tasks.workunit.client.1.smithi103.stdout:7/730: write d1/df/d42/d1f/d2e/f50 [2100489,33460] 0 2024-09-18T21:12:58.950 INFO:tasks.workunit.client.1.smithi103.stdout:6/747: symlink d2/d3/d8/d4c/d7d/lec 0 2024-09-18T21:12:58.951 INFO:tasks.workunit.client.1.smithi103.stdout:7/731: dwrite d1/df/d44/db4/fc1 [0,4194304] 0 2024-09-18T21:12:58.953 INFO:tasks.workunit.client.0.smithi077.stdout:8/639: rename d2/d27/d29/d72/d81/fbb to d2/d5f/da8/d4f/d5a/d2a/d67/fe7 0 2024-09-18T21:12:58.954 INFO:tasks.workunit.client.0.smithi077.stdout:8/640: write d2/d5f/da8/d20/f24 [1481640,120056] 0 2024-09-18T21:12:58.955 INFO:tasks.workunit.client.0.smithi077.stdout:2/742: fdatasync d1/d4/d5/d1a/d49/d6a/f8b 0 2024-09-18T21:12:58.958 INFO:tasks.workunit.client.0.smithi077.stdout:3/631: mkdir db/d14/d93/db6/dc4 0 2024-09-18T21:12:58.959 INFO:tasks.workunit.client.1.smithi103.stdout:0/680: dread d1/d5/de/d19/d1e/f21 [0,4194304] 0 2024-09-18T21:12:58.959 INFO:tasks.workunit.client.0.smithi077.stdout:9/618: dread d1/dd/d11/d1c/d38/d46/d55/f87 [0,4194304] 0 2024-09-18T21:12:58.960 INFO:tasks.workunit.client.0.smithi077.stdout:4/625: mknod d3/d7/d42/cc4 0 2024-09-18T21:12:58.960 INFO:tasks.workunit.client.0.smithi077.stdout:3/632: readlink db/d14/d72/l8e 0 2024-09-18T21:12:58.961 INFO:tasks.workunit.client.0.smithi077.stdout:4/626: chown d3/c30 4085 1 2024-09-18T21:12:58.962 INFO:tasks.workunit.client.0.smithi077.stdout:3/633: write db/d14/f20 [39067,50999] 0 2024-09-18T21:12:58.964 INFO:tasks.workunit.client.0.smithi077.stdout:8/641: dwrite d2/d5f/da8/d26/fcd [0,4194304] 0 2024-09-18T21:12:58.965 INFO:tasks.workunit.client.0.smithi077.stdout:8/642: stat d2/d5f/l89 0 2024-09-18T21:12:58.966 INFO:tasks.workunit.client.1.smithi103.stdout:3/688: symlink d1/d23/d25/d4f/d72/d7e/db2/dcd/ld5 0 2024-09-18T21:12:58.971 INFO:tasks.workunit.client.1.smithi103.stdout:6/748: symlink d2/d3/d8/d4c/d79/led 0 2024-09-18T21:12:58.972 INFO:tasks.workunit.client.0.smithi077.stdout:4/627: fdatasync d3/dc/d24/f78 0 2024-09-18T21:12:58.973 INFO:tasks.workunit.client.1.smithi103.stdout:3/689: dwrite d1/d23/d25/d4f/d72/d85/fb3 [0,4194304] 0 2024-09-18T21:12:58.974 INFO:tasks.workunit.client.0.smithi077.stdout:2/743: mkdir d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d83/dba/dfd 0 2024-09-18T21:12:58.976 INFO:tasks.workunit.client.0.smithi077.stdout:2/744: truncate d1/d4/d5/d1a/d2e/d41/f3f 4797580 0 2024-09-18T21:12:58.977 INFO:tasks.workunit.client.0.smithi077.stdout:8/643: mknod d2/d5/d6/d9f/da4/ce8 0 2024-09-18T21:12:58.978 INFO:tasks.workunit.client.1.smithi103.stdout:6/749: dwrite d2/f28 [0,4194304] 0 2024-09-18T21:12:58.980 INFO:tasks.workunit.client.1.smithi103.stdout:0/681: fdatasync d1/d9/d3e/d6e/f97 0 2024-09-18T21:12:58.981 INFO:tasks.workunit.client.0.smithi077.stdout:4/628: mknod d3/dc/d51/d53/d89/cc5 0 2024-09-18T21:12:58.983 INFO:tasks.workunit.client.0.smithi077.stdout:2/745: mkdir d1/d4/d5/d1a/d2e/d40/d69/dfe 0 2024-09-18T21:12:58.986 INFO:tasks.workunit.client.0.smithi077.stdout:8/644: creat d2/d27/d29/d72/d81/fe9 x:0 0 0 2024-09-18T21:12:58.986 INFO:tasks.workunit.client.1.smithi103.stdout:8/830: getdents d4/de 0 2024-09-18T21:12:58.987 INFO:tasks.workunit.client.0.smithi077.stdout:9/619: write d1/dd/f94 [842273,91882] 0 2024-09-18T21:12:58.987 INFO:tasks.workunit.client.0.smithi077.stdout:8/645: chown d2/d5f/da8/d18/c37 12 1 2024-09-18T21:12:58.988 INFO:tasks.workunit.client.0.smithi077.stdout:8/646: write d2/d5f/d6f/fd1 [479228,12437] 0 2024-09-18T21:12:58.992 INFO:tasks.workunit.client.0.smithi077.stdout:3/634: link db/d14/d32/d49/d6b/f9a db/d14/d22/dae/fc5 0 2024-09-18T21:12:58.993 INFO:tasks.workunit.client.1.smithi103.stdout:3/690: chown d1/d23/d25/d4f/d72/d7e/l96 499682864 1 2024-09-18T21:12:58.994 INFO:tasks.workunit.client.1.smithi103.stdout:5/770: dwrite de/d1f/f86 [0,4194304] 0 2024-09-18T21:12:58.994 INFO:tasks.workunit.client.1.smithi103.stdout:3/691: chown d1/d2/d18/d30/c49 3137 1 2024-09-18T21:12:58.995 INFO:tasks.workunit.client.0.smithi077.stdout:2/746: mkdir d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d83/dba/ddc/dff 0 2024-09-18T21:12:58.995 INFO:tasks.workunit.client.0.smithi077.stdout:3/635: chown db/d14/d22/d36/d39/d50/d5c/l84 418 1 2024-09-18T21:12:58.995 INFO:tasks.workunit.client.0.smithi077.stdout:9/620: dwrite d1/dd/d11/d2d/d79/fa6 [0,4194304] 0 2024-09-18T21:12:58.996 INFO:tasks.workunit.client.0.smithi077.stdout:8/647: mknod d2/d5f/da8/d4f/d5a/d2a/d88/cea 0 2024-09-18T21:12:58.997 INFO:tasks.workunit.client.1.smithi103.stdout:5/771: dread de/d1f/d3b/d3c/fc6 [0,4194304] 0 2024-09-18T21:12:58.998 INFO:tasks.workunit.client.1.smithi103.stdout:6/750: rmdir d2/d24/d5a/d67/d76/da4 39 2024-09-18T21:12:58.999 INFO:tasks.workunit.client.1.smithi103.stdout:6/751: chown d2/d3/f48 71019 1 2024-09-18T21:12:59.003 INFO:tasks.workunit.client.1.smithi103.stdout:0/682: symlink d1/d5/de/dc0/dbf/d4e/lf1 0 2024-09-18T21:12:59.007 INFO:tasks.workunit.client.1.smithi103.stdout:9/767: rename d18/f64 to d18/d52/d6f/d8e/d8f/dbd/df1/f103 0 2024-09-18T21:12:59.008 INFO:tasks.workunit.client.0.smithi077.stdout:3/636: truncate db/d14/d72/f8d 2695395 0 2024-09-18T21:12:59.009 INFO:tasks.workunit.client.1.smithi103.stdout:8/831: chown d4/d81/d65/l45 303783395 1 2024-09-18T21:12:59.009 INFO:tasks.workunit.client.0.smithi077.stdout:3/637: write db/d14/d32/d49/da4/d8a/d99/fa1 [1023266,124659] 0 2024-09-18T21:12:59.010 INFO:tasks.workunit.client.1.smithi103.stdout:7/732: link d1/df/d42/d29/d48/dbb/ca7 d1/df/d43/d52/cec 0 2024-09-18T21:12:59.011 INFO:tasks.workunit.client.0.smithi077.stdout:3/638: truncate db/d14/f20 4745366 0 2024-09-18T21:12:59.011 INFO:tasks.workunit.client.1.smithi103.stdout:2/648: link d3/f1d d3/d5/d2f/d32/d90/feb 0 2024-09-18T21:12:59.012 INFO:tasks.workunit.client.1.smithi103.stdout:8/832: truncate d4/d81/d71/d7f/fdd 263374 0 2024-09-18T21:12:59.012 INFO:tasks.workunit.client.0.smithi077.stdout:9/621: mknod d1/cd0 0 2024-09-18T21:12:59.013 INFO:tasks.workunit.client.1.smithi103.stdout:3/692: creat d1/d23/d25/d4f/dce/fd6 x:0 0 0 2024-09-18T21:12:59.014 INFO:tasks.workunit.client.0.smithi077.stdout:4/629: getdents d3/d7 0 2024-09-18T21:12:59.016 INFO:tasks.workunit.client.0.smithi077.stdout:8/648: creat d2/d27/d29/feb x:0 0 0 2024-09-18T21:12:59.016 INFO:tasks.workunit.client.1.smithi103.stdout:1/700: link d0/d2/d9/dc/d36/f6d d0/d2/d2b/d3a/d42/d72/ff6 0 2024-09-18T21:12:59.017 INFO:tasks.workunit.client.1.smithi103.stdout:7/733: dwrite d1/df/d42/d29/d48/dbb/f9a [0,4194304] 0 2024-09-18T21:12:59.017 INFO:tasks.workunit.client.0.smithi077.stdout:8/649: dread - d2/d27/d29/d41/dbc/fc1 zero size 2024-09-18T21:12:59.017 INFO:tasks.workunit.client.0.smithi077.stdout:3/639: mknod db/d14/d93/cc6 0 2024-09-18T21:12:59.019 INFO:tasks.workunit.client.0.smithi077.stdout:9/622: unlink d1/dd/d11/d2d/fc5 0 2024-09-18T21:12:59.019 INFO:tasks.workunit.client.0.smithi077.stdout:1/673: sync 2024-09-18T21:12:59.019 INFO:tasks.workunit.client.0.smithi077.stdout:7/733: sync 2024-09-18T21:12:59.019 INFO:tasks.workunit.client.0.smithi077.stdout:5/757: sync 2024-09-18T21:12:59.020 INFO:tasks.workunit.client.0.smithi077.stdout:2/747: getdents d1/d62 0 2024-09-18T21:12:59.020 INFO:tasks.workunit.client.0.smithi077.stdout:9/623: chown d1/dd/d11/d15/d80/l93 3 1 2024-09-18T21:12:59.021 INFO:tasks.workunit.client.1.smithi103.stdout:9/768: creat d18/d52/d6f/db9/f104 x:0 0 0 2024-09-18T21:12:59.021 INFO:tasks.workunit.client.0.smithi077.stdout:4/630: mknod d3/d77/d9c/db9/cc6 0 2024-09-18T21:12:59.023 INFO:tasks.workunit.client.0.smithi077.stdout:8/650: truncate d2/d5/f93 290205 0 2024-09-18T21:12:59.024 INFO:tasks.workunit.client.1.smithi103.stdout:2/649: dread - d3/d5/d2c/f66 zero size 2024-09-18T21:12:59.026 INFO:tasks.workunit.client.0.smithi077.stdout:3/640: rename db/d14/d32/d49/d4e/d6a/l4b to db/d14/d32/d49/d4e/d8b/lc7 0 2024-09-18T21:12:59.027 INFO:tasks.workunit.client.1.smithi103.stdout:5/772: dread de/ff [0,4194304] 0 2024-09-18T21:12:59.028 INFO:tasks.workunit.client.1.smithi103.stdout:5/773: read de/d2d/f69 [2545053,22109] 0 2024-09-18T21:12:59.029 INFO:tasks.workunit.client.1.smithi103.stdout:3/693: creat d1/d23/d25/d4f/dce/fd7 x:0 0 0 2024-09-18T21:12:59.030 INFO:tasks.workunit.client.0.smithi077.stdout:9/624: symlink d1/dd/d11/d1c/ld1 0 2024-09-18T21:12:59.031 INFO:tasks.workunit.client.0.smithi077.stdout:4/631: creat d3/d7/d6c/fc7 x:0 0 0 2024-09-18T21:12:59.031 INFO:tasks.workunit.client.1.smithi103.stdout:3/694: write d1/d2/fb [9138480,12050] 0 2024-09-18T21:12:59.031 INFO:tasks.workunit.client.1.smithi103.stdout:2/650: dwrite d3/d5/d4a/fb9 [0,4194304] 0 2024-09-18T21:12:59.032 INFO:tasks.workunit.client.1.smithi103.stdout:0/683: symlink d1/lf2 0 2024-09-18T21:12:59.034 INFO:tasks.workunit.client.1.smithi103.stdout:1/701: chown d0/d3/c80 3806765 1 2024-09-18T21:12:59.034 INFO:tasks.workunit.client.0.smithi077.stdout:8/651: creat d2/d5f/d7a/fec x:0 0 0 2024-09-18T21:12:59.035 INFO:tasks.workunit.client.1.smithi103.stdout:6/752: write d2/d24/f3b [151173,50509] 0 2024-09-18T21:12:59.036 INFO:tasks.workunit.client.0.smithi077.stdout:4/632: dread d3/d77/f7a [0,4194304] 0 2024-09-18T21:12:59.037 INFO:tasks.workunit.client.1.smithi103.stdout:6/753: chown d2/d3/d8/f2a 346174 1 2024-09-18T21:12:59.037 INFO:tasks.workunit.client.0.smithi077.stdout:8/652: truncate d2/d27/d29/d41/dbc/f6a 5155320 0 2024-09-18T21:12:59.038 INFO:tasks.workunit.client.1.smithi103.stdout:1/702: fsync d0/d2/d9/dc/d36/d52/ff5 0 2024-09-18T21:12:59.038 INFO:tasks.workunit.client.1.smithi103.stdout:7/734: rmdir d1/df/d42 39 2024-09-18T21:12:59.038 INFO:tasks.workunit.client.1.smithi103.stdout:3/695: dread d1/d23/d47/dbb/fba [0,4194304] 0 2024-09-18T21:12:59.039 INFO:tasks.workunit.client.0.smithi077.stdout:4/633: truncate d3/d7/d73/f79 940647 0 2024-09-18T21:12:59.039 INFO:tasks.workunit.client.0.smithi077.stdout:8/653: fdatasync d2/d5f/da8/d26/fcd 0 2024-09-18T21:12:59.039 INFO:tasks.workunit.client.0.smithi077.stdout:4/634: dread - d3/d7/d6c/fc7 zero size 2024-09-18T21:12:59.041 INFO:tasks.workunit.client.0.smithi077.stdout:4/635: fsync d3/d7/d6c/f90 0 2024-09-18T21:12:59.041 INFO:tasks.workunit.client.1.smithi103.stdout:9/769: rmdir d18/d8d 39 2024-09-18T21:12:59.041 INFO:tasks.workunit.client.0.smithi077.stdout:4/636: read - d3/d7/d42/f5c zero size 2024-09-18T21:12:59.043 INFO:tasks.workunit.client.0.smithi077.stdout:9/625: creat d1/dd/d11/d1c/d38/d46/d55/d7f/fd2 x:0 0 0 2024-09-18T21:12:59.044 INFO:tasks.workunit.client.0.smithi077.stdout:9/626: truncate d1/dd/f94 1528192 0 2024-09-18T21:12:59.046 INFO:tasks.workunit.client.0.smithi077.stdout:2/748: rename d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d95/ce6 to d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d8e/de7/c100 0 2024-09-18T21:12:59.046 INFO:tasks.workunit.client.0.smithi077.stdout:4/637: dread d3/dc/d20/f27 [0,4194304] 0 2024-09-18T21:12:59.049 INFO:tasks.workunit.client.0.smithi077.stdout:8/654: creat d2/d5/d6/d7e/fed x:0 0 0 2024-09-18T21:12:59.052 INFO:tasks.workunit.client.0.smithi077.stdout:9/627: dwrite d1/dd/d11/d15/d80/f91 [0,4194304] 0 2024-09-18T21:12:59.053 INFO:tasks.workunit.client.1.smithi103.stdout:4/812: sync 2024-09-18T21:12:59.053 INFO:tasks.workunit.client.1.smithi103.stdout:2/651: dread d3/f1b [0,4194304] 0 2024-09-18T21:12:59.053 INFO:tasks.workunit.client.1.smithi103.stdout:5/774: read de/fd9 [3892672,8326] 0 2024-09-18T21:12:59.055 INFO:tasks.workunit.client.1.smithi103.stdout:2/652: read - d3/d5/d2c/d54/d68/f6b zero size 2024-09-18T21:12:59.057 INFO:tasks.workunit.client.1.smithi103.stdout:0/684: chown d1/d5/de/l7f 1455749 1 2024-09-18T21:12:59.057 INFO:tasks.workunit.client.0.smithi077.stdout:7/734: write d12/f24 [3360338,51358] 0 2024-09-18T21:12:59.060 INFO:tasks.workunit.client.0.smithi077.stdout:2/749: creat d1/d4/d5/d1a/d49/d6a/f101 x:0 0 0 2024-09-18T21:12:59.060 INFO:tasks.workunit.client.0.smithi077.stdout:9/628: dwrite d1/dd/d11/d1c/f25 [0,4194304] 0 2024-09-18T21:12:59.060 INFO:tasks.workunit.client.0.smithi077.stdout:3/641: dread db/d14/d22/d36/d39/f47 [0,4194304] 0 2024-09-18T21:12:59.063 INFO:tasks.workunit.client.1.smithi103.stdout:1/703: rmdir d0/d2/d9/dc 39 2024-09-18T21:12:59.065 INFO:tasks.workunit.client.1.smithi103.stdout:6/754: mknod d2/d24/d38/d68/dac/cee 0 2024-09-18T21:12:59.066 INFO:tasks.workunit.client.0.smithi077.stdout:8/655: mknod d2/d27/d29/d72/d81/cee 0 2024-09-18T21:12:59.067 INFO:tasks.workunit.client.0.smithi077.stdout:8/656: stat d2/d5f/d6f/c8b 0 2024-09-18T21:12:59.069 INFO:tasks.workunit.client.1.smithi103.stdout:9/770: readlink d18/d52/d6f/d8e/lc1 0 2024-09-18T21:12:59.070 INFO:tasks.workunit.client.1.smithi103.stdout:7/735: dwrite d1/df/d42/d1f/d5d/dbe/fd0 [0,4194304] 0 2024-09-18T21:12:59.072 INFO:tasks.workunit.client.1.smithi103.stdout:4/813: fsync d9/d38/d72/df0/d83/db6/d21/f63 0 2024-09-18T21:12:59.074 INFO:tasks.workunit.client.0.smithi077.stdout:3/642: fsync fa 0 2024-09-18T21:12:59.074 INFO:tasks.workunit.client.1.smithi103.stdout:4/814: dread - d9/d1c/d77/fbc zero size 2024-09-18T21:12:59.075 INFO:tasks.workunit.client.1.smithi103.stdout:5/775: chown de/d1f/d3b/d58/dc4/d33/d4f/fea 117535211 1 2024-09-18T21:12:59.076 INFO:tasks.workunit.client.1.smithi103.stdout:6/755: dwrite d2/d24/d5a/d67/d76/d43/d44/f54 [0,4194304] 0 2024-09-18T21:12:59.077 INFO:tasks.workunit.client.1.smithi103.stdout:0/685: mknod d1/d9/d3e/d6e/cf3 0 2024-09-18T21:12:59.081 INFO:tasks.workunit.client.0.smithi077.stdout:9/629: fsync d1/dd/f62 0 2024-09-18T21:12:59.082 INFO:tasks.workunit.client.0.smithi077.stdout:3/643: dwrite db/d14/d22/d36/f73 [0,4194304] 0 2024-09-18T21:12:59.083 INFO:tasks.workunit.client.1.smithi103.stdout:1/704: rmdir d0/d2 39 2024-09-18T21:12:59.091 INFO:tasks.workunit.client.1.smithi103.stdout:3/696: truncate d1/da/f16 2675322 0 2024-09-18T21:12:59.092 INFO:tasks.workunit.client.1.smithi103.stdout:3/697: write d1/d23/d25/d4f/d58/d86/fd1 [607603,57610] 0 2024-09-18T21:12:59.093 INFO:tasks.workunit.client.1.smithi103.stdout:3/698: readlink d1/d23/l4a 0 2024-09-18T21:12:59.094 INFO:tasks.workunit.client.0.smithi077.stdout:9/630: dwrite d1/d54/d51/f9d [4194304,4194304] 0 2024-09-18T21:12:59.094 INFO:tasks.workunit.client.1.smithi103.stdout:8/833: getdents d4/d81/dd7/dde/d59 0 2024-09-18T21:12:59.096 INFO:tasks.workunit.client.1.smithi103.stdout:7/736: fdatasync d1/df/f18 0 2024-09-18T21:12:59.098 INFO:tasks.workunit.client.1.smithi103.stdout:2/653: write d3/d5/d25/d98/f9a [303293,111521] 0 2024-09-18T21:12:59.098 INFO:tasks.workunit.client.1.smithi103.stdout:9/771: write d18/d52/d6f/d8e/d8f/dbd/df1/f103 [3297567,65140] 0 2024-09-18T21:12:59.099 INFO:tasks.workunit.client.0.smithi077.stdout:3/644: rmdir db/d14/d22 39 2024-09-18T21:12:59.100 INFO:tasks.workunit.client.1.smithi103.stdout:2/654: dread - d3/d5/d25/f5f zero size 2024-09-18T21:12:59.102 INFO:tasks.workunit.client.0.smithi077.stdout:4/638: dwrite d3/f2b [0,4194304] 0 2024-09-18T21:12:59.104 INFO:tasks.workunit.client.0.smithi077.stdout:7/735: link d12/d31/d77/d93/d2a/d6c/f96 d12/d31/d77/d93/d89/d94/ffb 0 2024-09-18T21:12:59.105 INFO:tasks.workunit.client.0.smithi077.stdout:3/645: readlink db/d14/d22/d36/d39/l7a 0 2024-09-18T21:12:59.107 INFO:tasks.workunit.client.1.smithi103.stdout:6/756: symlink d2/d3/dcb/lef 0 2024-09-18T21:12:59.109 INFO:tasks.workunit.client.0.smithi077.stdout:4/639: stat d3/dc/d32/d45/d5e/la1 0 2024-09-18T21:12:59.110 INFO:tasks.workunit.client.1.smithi103.stdout:0/686: symlink d1/d5/de/dc0/d62/lf4 0 2024-09-18T21:12:59.111 INFO:tasks.workunit.client.1.smithi103.stdout:5/776: dread de/d1f/d3b/d51/db0/fbe [0,4194304] 0 2024-09-18T21:12:59.111 INFO:tasks.workunit.client.1.smithi103.stdout:0/687: read - d1/daf/fda zero size 2024-09-18T21:12:59.112 INFO:tasks.workunit.client.0.smithi077.stdout:2/750: dwrite d1/d4/d5/d1a/d2e/fcc [0,4194304] 0 2024-09-18T21:12:59.113 INFO:tasks.workunit.client.1.smithi103.stdout:3/699: readlink d1/d2/d18/l8f 0 2024-09-18T21:12:59.115 INFO:tasks.workunit.client.0.smithi077.stdout:4/640: read d3/dc/d32/f48 [1532864,80951] 0 2024-09-18T21:12:59.116 INFO:tasks.workunit.client.1.smithi103.stdout:8/834: creat d4/d2d/dc1/f10b x:0 0 0 2024-09-18T21:12:59.116 INFO:tasks.workunit.client.0.smithi077.stdout:7/736: truncate d12/f45 1777200 0 2024-09-18T21:12:59.119 INFO:tasks.workunit.client.0.smithi077.stdout:2/751: creat d1/d4/d5/d1a/d49/d6a/d81/dc4/f102 x:0 0 0 2024-09-18T21:12:59.120 INFO:tasks.workunit.client.1.smithi103.stdout:1/705: dwrite d0/d2/d2b/fcf [0,4194304] 0 2024-09-18T21:12:59.121 INFO:tasks.workunit.client.0.smithi077.stdout:2/752: readlink d1/d4/d5/d1a/d2e/d7e/l85 0 2024-09-18T21:12:59.122 INFO:tasks.workunit.client.1.smithi103.stdout:1/706: write d0/d2/d9/f65 [873351,80232] 0 2024-09-18T21:12:59.124 INFO:tasks.workunit.client.1.smithi103.stdout:1/707: write d0/d2/d9/d9e/d7a/fb2 [5054532,42891] 0 2024-09-18T21:12:59.125 INFO:tasks.workunit.client.1.smithi103.stdout:6/757: mkdir d2/d3/d8/d94/df0 0 2024-09-18T21:12:59.127 INFO:tasks.workunit.client.0.smithi077.stdout:7/737: dwrite d12/d22/d59/d72/f86 [0,4194304] 0 2024-09-18T21:12:59.137 INFO:tasks.workunit.client.1.smithi103.stdout:8/835: creat d4/de/de3/f10c x:0 0 0 2024-09-18T21:12:59.138 INFO:tasks.workunit.client.1.smithi103.stdout:7/737: mkdir d1/df/d42/d29/d48/dbb/ded 0 2024-09-18T21:12:59.138 INFO:tasks.workunit.client.0.smithi077.stdout:3/646: dwrite db/d14/d32/d49/da4/d8a/d99/fa9 [0,4194304] 0 2024-09-18T21:12:59.139 INFO:tasks.workunit.client.1.smithi103.stdout:9/772: truncate d18/d8d/d2f/f97 1417324 0 2024-09-18T21:12:59.142 INFO:tasks.workunit.client.1.smithi103.stdout:2/655: mkdir d3/d5/d2c/d54/dec 0 2024-09-18T21:12:59.144 INFO:tasks.workunit.client.1.smithi103.stdout:2/656: write d3/d5/d2c/fd6 [984146,10282] 0 2024-09-18T21:12:59.145 INFO:tasks.workunit.client.1.smithi103.stdout:2/657: truncate d3/d5/d2f/fe4 897519 0 2024-09-18T21:12:59.146 INFO:tasks.workunit.client.1.smithi103.stdout:4/815: creat d9/d38/d72/df0/d83/db6/d21/f114 x:0 0 0 2024-09-18T21:12:59.147 INFO:tasks.workunit.client.0.smithi077.stdout:3/647: link db/d14/d32/d49/fa0 db/d14/d22/d36/fc8 0 2024-09-18T21:12:59.148 INFO:tasks.workunit.client.0.smithi077.stdout:4/641: dwrite d3/dc/d20/f97 [0,4194304] 0 2024-09-18T21:12:59.149 INFO:tasks.workunit.client.1.smithi103.stdout:1/708: fsync d0/d2/d9/d10/d5d/d6f/f8b 0 2024-09-18T21:12:59.149 INFO:tasks.workunit.client.1.smithi103.stdout:5/777: symlink de/d3e/l102 0 2024-09-18T21:12:59.149 INFO:tasks.workunit.client.1.smithi103.stdout:0/688: rename d1/l78 to d1/d5/de/d19/lf5 0 2024-09-18T21:12:59.150 INFO:tasks.workunit.client.0.smithi077.stdout:2/753: dwrite d1/d4/d5/d1a/d2e/d40/d69/fa6 [0,4194304] 0 2024-09-18T21:12:59.152 INFO:tasks.workunit.client.1.smithi103.stdout:8/836: fsync d4/d81/d65/f31 0 2024-09-18T21:12:59.153 INFO:tasks.workunit.client.1.smithi103.stdout:4/816: read d9/d38/d72/df0/d61/f76 [1713520,73404] 0 2024-09-18T21:12:59.155 INFO:tasks.workunit.client.1.smithi103.stdout:9/773: chown d18/d52/d6f/d8e/d8f/dbd/df1/lfd 9382897 1 2024-09-18T21:12:59.155 INFO:tasks.workunit.client.0.smithi077.stdout:3/648: mkdir db/d14/d32/d49/d4e/d8b/dc9 0 2024-09-18T21:12:59.155 INFO:tasks.workunit.client.1.smithi103.stdout:6/758: dread d2/d24/d5a/d67/d76/d43/f45 [0,4194304] 0 2024-09-18T21:12:59.156 INFO:tasks.workunit.client.1.smithi103.stdout:6/759: fdatasync d2/d3/fdf 0 2024-09-18T21:12:59.164 INFO:tasks.workunit.client.1.smithi103.stdout:0/689: mknod d1/d5/de/d24/d43/d76/dc5/cf6 0 2024-09-18T21:12:59.166 INFO:tasks.workunit.client.1.smithi103.stdout:2/658: dwrite d3/d5/d4a/d56/fc7 [0,4194304] 0 2024-09-18T21:12:59.167 INFO:tasks.workunit.client.0.smithi077.stdout:6/624: sync 2024-09-18T21:12:59.168 INFO:tasks.workunit.client.0.smithi077.stdout:0/770: sync 2024-09-18T21:12:59.168 INFO:tasks.workunit.client.1.smithi103.stdout:8/837: rename d4/d2d/d3d/da0/f100 to d4/d2d/d3d/da0/f10d 0 2024-09-18T21:12:59.170 INFO:tasks.workunit.client.0.smithi077.stdout:4/642: dwrite d3/d7/f11 [0,4194304] 0 2024-09-18T21:12:59.170 INFO:tasks.workunit.client.1.smithi103.stdout:9/774: mkdir d18/d52/d6f/df8/d105 0 2024-09-18T21:12:59.172 INFO:tasks.workunit.client.0.smithi077.stdout:0/771: mkdir d8/d1a/d39/d56/df9 0 2024-09-18T21:12:59.173 INFO:tasks.workunit.client.1.smithi103.stdout:3/700: getdents d1/d23/d25/da1 0 2024-09-18T21:12:59.174 INFO:tasks.workunit.client.0.smithi077.stdout:6/625: write d7/d7e/d11/d3e/d42/dbb/d50/fca [3715198,6395] 0 2024-09-18T21:12:59.175 INFO:tasks.workunit.client.0.smithi077.stdout:6/626: read - d7/d7e/d11/d3e/d42/dbb/d31/fb4 zero size 2024-09-18T21:12:59.176 INFO:tasks.workunit.client.1.smithi103.stdout:1/709: mknod d0/d3/d68/d81/da2/da4/dc2/cf7 0 2024-09-18T21:12:59.176 INFO:tasks.workunit.client.0.smithi077.stdout:4/643: mknod d3/dc/d51/d53/d89/cc8 0 2024-09-18T21:12:59.179 INFO:tasks.workunit.client.0.smithi077.stdout:4/644: write d3/dc/d32/d5b/f83 [3189873,88708] 0 2024-09-18T21:12:59.179 INFO:tasks.workunit.client.1.smithi103.stdout:2/659: mknod d3/db3/ced 0 2024-09-18T21:12:59.180 INFO:tasks.workunit.client.0.smithi077.stdout:0/772: creat d8/d37/ffa x:0 0 0 2024-09-18T21:12:59.181 INFO:tasks.workunit.client.0.smithi077.stdout:6/627: truncate d7/d7e/d11/d3e/d42/dbb/d31/f5a 3960108 0 2024-09-18T21:12:59.183 INFO:tasks.workunit.client.0.smithi077.stdout:4/645: fdatasync d3/d7/f70 0 2024-09-18T21:12:59.186 INFO:tasks.workunit.client.1.smithi103.stdout:9/775: stat d18/d29/d68/d92/d9c/fae 0 2024-09-18T21:12:59.188 INFO:tasks.workunit.client.0.smithi077.stdout:4/646: creat d3/dc/d20/fc9 x:0 0 0 2024-09-18T21:12:59.188 INFO:tasks.workunit.client.0.smithi077.stdout:3/649: write db/f2e [7608135,2469] 0 2024-09-18T21:12:59.192 INFO:tasks.workunit.client.1.smithi103.stdout:0/690: link d1/d9/f52 d1/d5/de/d19/ff7 0 2024-09-18T21:12:59.193 INFO:tasks.workunit.client.0.smithi077.stdout:2/754: dread d1/d4/d5/d1a/f4c [0,4194304] 0 2024-09-18T21:12:59.193 INFO:tasks.workunit.client.0.smithi077.stdout:2/755: read d1/d62/f94 [88131,31168] 0 2024-09-18T21:12:59.193 INFO:tasks.workunit.client.0.smithi077.stdout:6/628: mkdir d7/d7e/d11/dd8 0 2024-09-18T21:12:59.193 INFO:tasks.workunit.client.1.smithi103.stdout:4/817: write d9/f11 [1344068,33408] 0 2024-09-18T21:12:59.195 INFO:tasks.workunit.client.1.smithi103.stdout:5/778: getdents de/d1f/d3b 0 2024-09-18T21:12:59.197 INFO:tasks.workunit.client.0.smithi077.stdout:0/773: rename d8/d26/f6b to d8/d1d/ffb 0 2024-09-18T21:12:59.197 INFO:tasks.workunit.client.1.smithi103.stdout:7/738: dwrite d1/df/d42/d1f/d5d/f71 [0,4194304] 0 2024-09-18T21:12:59.198 INFO:tasks.workunit.client.1.smithi103.stdout:4/818: write d9/d38/d72/df0/d83/db6/d41/d64/fcf [1379962,4466] 0 2024-09-18T21:12:59.201 INFO:tasks.workunit.client.1.smithi103.stdout:1/710: symlink d0/lf8 0 2024-09-18T21:12:59.205 INFO:tasks.workunit.client.1.smithi103.stdout:0/691: symlink d1/d5/de/dc0/d8c/dce/d9f/d8d/da7/lf8 0 2024-09-18T21:12:59.207 INFO:tasks.workunit.client.1.smithi103.stdout:4/819: dwrite d9/d38/d72/df0/d83/db6/d21/f33 [0,4194304] 0 2024-09-18T21:12:59.210 INFO:tasks.workunit.client.1.smithi103.stdout:5/779: write de/d1f/d3b/d58/dc4/d33/d4f/f9d [2775723,17265] 0 2024-09-18T21:12:59.210 INFO:tasks.workunit.client.1.smithi103.stdout:6/760: getdents d2/d3/d8/d4c/d7d/d9b 0 2024-09-18T21:12:59.215 INFO:tasks.workunit.client.0.smithi077.stdout:2/756: rename d1/d4/d5/f7 to d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d95/f103 0 2024-09-18T21:12:59.217 INFO:tasks.workunit.client.1.smithi103.stdout:6/761: truncate d2/d3/d8/d4c/d79/f82 1096246 0 2024-09-18T21:12:59.218 INFO:tasks.workunit.client.1.smithi103.stdout:8/838: dwrite d4/d81/dd7/dde/d59/fb3 [0,4194304] 0 2024-09-18T21:12:59.218 INFO:tasks.workunit.client.1.smithi103.stdout:4/820: fsync d9/d38/d58/d113/f111 0 2024-09-18T21:12:59.219 INFO:tasks.workunit.client.0.smithi077.stdout:2/757: truncate d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d95/ff5 458373 0 2024-09-18T21:12:59.219 INFO:tasks.workunit.client.0.smithi077.stdout:3/650: link db/d14/d32/d49/da4/d71/c94 db/d14/d32/d49/d4e/d6a/cca 0 2024-09-18T21:12:59.219 INFO:tasks.workunit.client.1.smithi103.stdout:4/821: readlink d9/d38/d72/df0/d83/db6/d41/l105 0 2024-09-18T21:12:59.220 INFO:tasks.workunit.client.0.smithi077.stdout:3/651: fdatasync db/d14/d32/d49/d4e/d6a/f61 0 2024-09-18T21:12:59.221 INFO:tasks.workunit.client.0.smithi077.stdout:3/652: stat db/d14/d32/d49/da4/d71/d3b/f66 0 2024-09-18T21:12:59.222 INFO:tasks.workunit.client.1.smithi103.stdout:2/660: truncate d3/d5/d2f/d32/d90/dd7/fc6 3373693 0 2024-09-18T21:12:59.222 INFO:tasks.workunit.client.0.smithi077.stdout:3/653: stat db/d14/d32/d87/d9e 0 2024-09-18T21:12:59.223 INFO:tasks.workunit.client.0.smithi077.stdout:6/629: creat d7/fd9 x:0 0 0 2024-09-18T21:12:59.224 INFO:tasks.workunit.client.1.smithi103.stdout:7/739: symlink d1/df/d42/d29/d48/dbb/ded/lee 0 2024-09-18T21:12:59.224 INFO:tasks.workunit.client.0.smithi077.stdout:4/647: getdents d3/d7/d73 0 2024-09-18T21:12:59.229 INFO:tasks.workunit.client.1.smithi103.stdout:1/711: truncate d0/d3/f20 3665738 0 2024-09-18T21:12:59.229 INFO:tasks.workunit.client.0.smithi077.stdout:3/654: dwrite db/d14/d32/d49/da4/f53 [0,4194304] 0 2024-09-18T21:12:59.234 INFO:tasks.workunit.client.0.smithi077.stdout:4/648: creat d3/d7/d7b/d88/fca x:0 0 0 2024-09-18T21:12:59.237 INFO:tasks.workunit.client.1.smithi103.stdout:9/776: link d18/d8d/ce3 d18/d52/d6f/c106 0 2024-09-18T21:12:59.238 INFO:tasks.workunit.client.1.smithi103.stdout:9/777: chown d18/d29/d68/d92/d9c/fa6 122 1 2024-09-18T21:12:59.239 INFO:tasks.workunit.client.0.smithi077.stdout:2/758: creat d1/d4/d5/f104 x:0 0 0 2024-09-18T21:12:59.239 INFO:tasks.workunit.client.0.smithi077.stdout:0/774: dwrite d8/d37/d95/dab/f52 [0,4194304] 0 2024-09-18T21:12:59.239 INFO:tasks.workunit.client.1.smithi103.stdout:0/692: dread d1/d5/de/dc0/dbf/f86 [0,4194304] 0 2024-09-18T21:12:59.240 INFO:tasks.workunit.client.0.smithi077.stdout:3/655: symlink db/lcb 0 2024-09-18T21:12:59.243 INFO:tasks.workunit.client.0.smithi077.stdout:2/759: rename d1/d62/f94 to d1/d62/f105 0 2024-09-18T21:12:59.245 INFO:tasks.workunit.client.1.smithi103.stdout:4/822: truncate d9/d38/d58/d113/f111 1264678 0 2024-09-18T21:12:59.245 INFO:tasks.workunit.client.0.smithi077.stdout:3/656: chown db/d14/d32/d49/d4e/d8b 358040176 1 2024-09-18T21:12:59.247 INFO:tasks.workunit.client.1.smithi103.stdout:1/712: dwrite d0/d2/d9/dc/d36/fc3 [0,4194304] 0 2024-09-18T21:12:59.247 INFO:tasks.workunit.client.1.smithi103.stdout:9/778: dwrite d18/d52/d6f/d8e/d8f/dbd/dc3/fc4 [0,4194304] 0 2024-09-18T21:12:59.249 INFO:tasks.workunit.client.0.smithi077.stdout:3/657: mknod db/d14/d22/d36/ccc 0 2024-09-18T21:12:59.249 INFO:tasks.workunit.client.0.smithi077.stdout:6/630: link d7/d7e/d11/d3e/d42/dbb/d49/d55/l73 d7/d7e/d11/lda 0 2024-09-18T21:12:59.251 INFO:tasks.workunit.client.0.smithi077.stdout:2/760: mkdir d1/d4/d5/d1a/d2e/d41/d2c/ddb/d106 0 2024-09-18T21:12:59.259 INFO:tasks.workunit.client.0.smithi077.stdout:2/761: fdatasync d1/d4/d5/d1a/d49/d6a/d81/dc4/dc0/f6f 0 2024-09-18T21:12:59.264 INFO:tasks.workunit.client.1.smithi103.stdout:4/823: write d9/d38/d72/df0/d83/db6/d21/d80/f9d [4629701,22559] 0 2024-09-18T21:12:59.266 INFO:tasks.workunit.client.1.smithi103.stdout:9/779: mknod d18/d52/d6f/db9/de0/de7/c107 0 2024-09-18T21:12:59.266 INFO:tasks.workunit.client.0.smithi077.stdout:2/762: creat d1/d4/d5/d7d/f107 x:0 0 0 2024-09-18T21:12:59.268 INFO:tasks.workunit.client.1.smithi103.stdout:9/780: write d18/d29/d68/fb1 [4811377,23107] 0 2024-09-18T21:12:59.270 INFO:tasks.workunit.client.1.smithi103.stdout:5/780: dwrite de/d3e/d15/fa8 [0,4194304] 0 2024-09-18T21:12:59.270 INFO:tasks.workunit.client.1.smithi103.stdout:1/713: rename d0/d3 to d0/d2/d9/d9e/d7a/dd0/df9 0 2024-09-18T21:12:59.271 INFO:tasks.workunit.client.1.smithi103.stdout:2/661: link d3/db3/ced d3/d5/cee 0 2024-09-18T21:12:59.271 INFO:tasks.workunit.client.1.smithi103.stdout:4/824: truncate d9/d38/d72/df0/d83/db6/d41/fc7 524701 0 2024-09-18T21:12:59.272 INFO:tasks.workunit.client.1.smithi103.stdout:5/781: fsync de/d2d/f56 0 2024-09-18T21:12:59.272 INFO:tasks.workunit.client.1.smithi103.stdout:0/693: getdents d1/d5/de/dc0/d8c 0 2024-09-18T21:12:59.273 INFO:tasks.workunit.client.0.smithi077.stdout:2/763: dwrite d1/d4/d5/d7d/f107 [0,4194304] 0 2024-09-18T21:12:59.275 INFO:tasks.workunit.client.1.smithi103.stdout:2/662: write d3/d5/d2c/d77/d9c/fc8 [502763,7013] 0 2024-09-18T21:12:59.276 INFO:tasks.workunit.client.1.smithi103.stdout:8/839: write d4/d81/d71/d7f/d9d/fae [1079603,1792] 0 2024-09-18T21:12:59.277 INFO:tasks.workunit.client.1.smithi103.stdout:4/825: chown d9/d38/d72/df0/d83/db6/d41/fc7 87673779 1 2024-09-18T21:12:59.280 INFO:tasks.workunit.client.0.smithi077.stdout:2/764: symlink d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d83/dba/ddc/dff/l108 0 2024-09-18T21:12:59.285 INFO:tasks.workunit.client.0.smithi077.stdout:2/765: fdatasync d1/d4/d5/d1a/d2e/d41/f5d 0 2024-09-18T21:12:59.287 INFO:tasks.workunit.client.1.smithi103.stdout:2/663: dwrite d3/d5/d2c/d54/f7b [0,4194304] 0 2024-09-18T21:12:59.287 INFO:tasks.workunit.client.1.smithi103.stdout:5/782: mknod de/d1f/d3b/d51/c103 0 2024-09-18T21:12:59.289 INFO:tasks.workunit.client.1.smithi103.stdout:6/762: dwrite d2/d3/d7f/d91/fd7 [0,4194304] 0 2024-09-18T21:12:59.289 INFO:tasks.workunit.client.0.smithi077.stdout:6/631: write d7/d7e/d11/d3e/d42/dbb/d5c/f91 [1055592,96332] 0 2024-09-18T21:12:59.296 INFO:tasks.workunit.client.0.smithi077.stdout:6/632: rmdir d7/d7e/da6 39 2024-09-18T21:12:59.296 INFO:tasks.workunit.client.1.smithi103.stdout:4/826: unlink d9/d38/d72/d85/ff6 0 2024-09-18T21:12:59.297 INFO:tasks.workunit.client.0.smithi077.stdout:2/766: dwrite d1/d4/d5/d1a/d2e/f7f [4194304,4194304] 0 2024-09-18T21:12:59.299 INFO:tasks.workunit.client.1.smithi103.stdout:1/714: mkdir d0/d2/d9/dc/d6e/dac/dfa 0 2024-09-18T21:12:59.299 INFO:tasks.workunit.client.1.smithi103.stdout:2/664: dwrite d3/d5/d4a/d56/f97 [4194304,4194304] 0 2024-09-18T21:12:59.305 INFO:tasks.workunit.client.0.smithi077.stdout:6/633: creat d7/d7e/d11/d3e/d42/dbb/d50/fdb x:0 0 0 2024-09-18T21:12:59.313 INFO:tasks.workunit.client.1.smithi103.stdout:9/781: dread d18/d29/d68/d92/d9c/dc8/fe9 [0,4194304] 0 2024-09-18T21:12:59.324 INFO:tasks.workunit.client.1.smithi103.stdout:5/783: dread de/d1f/d3b/d58/fad [0,4194304] 0 2024-09-18T21:12:59.324 INFO:tasks.workunit.client.1.smithi103.stdout:5/784: dread - de/d1f/d3b/d51/d57/d59/f7d zero size 2024-09-18T21:12:59.369 INFO:tasks.workunit.client.1.smithi103.stdout:3/701: sync 2024-09-18T21:12:59.381 INFO:tasks.workunit.client.0.smithi077.stdout:2/767: creat d1/d4/d5/d7d/f109 x:0 0 0 2024-09-18T21:12:59.382 INFO:tasks.workunit.client.0.smithi077.stdout:6/634: chown d7/d7e/d11/d3e/d42/dbb/d31/lce 1 1 2024-09-18T21:12:59.385 INFO:tasks.workunit.client.0.smithi077.stdout:2/768: dread d1/d4/d5/d1a/d2e/f5a [0,4194304] 0 2024-09-18T21:12:59.387 INFO:tasks.workunit.client.1.smithi103.stdout:8/840: write d4/d81/f95 [4152429,117555] 0 2024-09-18T21:12:59.391 INFO:tasks.workunit.client.1.smithi103.stdout:1/715: creat d0/d2/d2b/d3a/d42/d9c/ffb x:0 0 0 2024-09-18T21:12:59.392 INFO:tasks.workunit.client.0.smithi077.stdout:6/635: dread d7/d7e/d11/d3e/d42/d88/da4/f47 [0,4194304] 0 2024-09-18T21:12:59.393 INFO:tasks.workunit.client.1.smithi103.stdout:9/782: unlink d18/d8d/d2f/l9b 0 2024-09-18T21:12:59.393 INFO:tasks.workunit.client.0.smithi077.stdout:6/636: truncate d7/d7e/d11/d3e/d42/fd6 4362751 0 2024-09-18T21:12:59.396 INFO:tasks.workunit.client.1.smithi103.stdout:3/702: mkdir d1/d23/d25/da1/dd8 0 2024-09-18T21:12:59.397 INFO:tasks.workunit.client.1.smithi103.stdout:0/694: write d1/d9/f2b [1118802,57835] 0 2024-09-18T21:12:59.403 INFO:tasks.workunit.client.1.smithi103.stdout:7/740: sync 2024-09-18T21:12:59.404 INFO:tasks.workunit.client.1.smithi103.stdout:8/841: fsync d4/d81/f92 0 2024-09-18T21:12:59.405 INFO:tasks.workunit.client.1.smithi103.stdout:5/785: write de/d1f/d3b/d51/d57/d59/fb3 [605404,31688] 0 2024-09-18T21:12:59.405 INFO:tasks.workunit.client.1.smithi103.stdout:2/665: symlink d3/d5/d4a/lef 0 2024-09-18T21:12:59.407 INFO:tasks.workunit.client.1.smithi103.stdout:7/741: write d1/df/d42/d29/d48/dbb/f9a [974527,98340] 0 2024-09-18T21:12:59.407 INFO:tasks.workunit.client.1.smithi103.stdout:9/783: truncate d18/d52/d6f/db9/dcb/fb0 646849 0 2024-09-18T21:12:59.408 INFO:tasks.workunit.client.1.smithi103.stdout:1/716: dread d0/d2/d2b/f41 [0,4194304] 0 2024-09-18T21:12:59.409 INFO:tasks.workunit.client.1.smithi103.stdout:1/717: chown d0/d2/d9/dc/d6e/cce 1450 1 2024-09-18T21:12:59.410 INFO:tasks.workunit.client.1.smithi103.stdout:3/703: chown d1/da/df/l94 7 1 2024-09-18T21:12:59.411 INFO:tasks.workunit.client.1.smithi103.stdout:7/742: truncate d1/df/d42/d1f/d5d/d85/db0/fd8 940425 0 2024-09-18T21:12:59.412 INFO:tasks.workunit.client.1.smithi103.stdout:3/704: dread - d1/d23/d25/d4f/d58/d68/fac zero size 2024-09-18T21:12:59.414 INFO:tasks.workunit.client.1.smithi103.stdout:9/784: dwrite d18/d29/d68/fb1 [0,4194304] 0 2024-09-18T21:12:59.415 INFO:tasks.workunit.client.1.smithi103.stdout:9/785: stat d18/d52/d6f/d8e/d8f/dbd/dc3/fc4 0 2024-09-18T21:12:59.417 INFO:tasks.workunit.client.1.smithi103.stdout:8/842: chown d4/d2d/d3d/da0/dab/de7/c3c 888901 1 2024-09-18T21:12:59.417 INFO:tasks.workunit.client.0.smithi077.stdout:2/769: mknod d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d95/c10a 0 2024-09-18T21:12:59.418 INFO:tasks.workunit.client.1.smithi103.stdout:8/843: stat d4/d26/cc8 0 2024-09-18T21:12:59.420 INFO:tasks.workunit.client.1.smithi103.stdout:5/786: creat de/d1f/d3b/d51/f104 x:0 0 0 2024-09-18T21:12:59.421 INFO:tasks.workunit.client.0.smithi077.stdout:2/770: dread d1/d4/d5/d1a/f4c [0,4194304] 0 2024-09-18T21:12:59.422 INFO:tasks.workunit.client.0.smithi077.stdout:2/771: stat d1/d4/d5/d1a/d2e/cd9 0 2024-09-18T21:12:59.422 INFO:tasks.workunit.client.1.smithi103.stdout:9/786: dwrite d18/d8d/f87 [0,4194304] 0 2024-09-18T21:12:59.423 INFO:tasks.workunit.client.0.smithi077.stdout:2/772: chown d1/d4/d5/d1a/d2e/d40/l6e 18 1 2024-09-18T21:12:59.423 INFO:tasks.workunit.client.1.smithi103.stdout:9/787: chown d18/d52/d6f/d8e/db4/fdc 526806 1 2024-09-18T21:12:59.426 INFO:tasks.workunit.client.1.smithi103.stdout:4/827: truncate d9/d38/f45 2351295 0 2024-09-18T21:12:59.427 INFO:tasks.workunit.client.0.smithi077.stdout:6/637: link d7/d7e/d11/f9e d7/d7e/d11/d3e/d42/dbb/d49/d55/fdc 0 2024-09-18T21:12:59.427 INFO:tasks.workunit.client.1.smithi103.stdout:6/763: getdents d2/d24/d5a/d67/d76 0 2024-09-18T21:12:59.428 INFO:tasks.workunit.client.0.smithi077.stdout:6/638: chown d7/d7e/d11/d3e/d42/dbb/d50/c83 11275 1 2024-09-18T21:12:59.430 INFO:tasks.workunit.client.1.smithi103.stdout:3/705: rename d1/d23/d25/d4f/d72/d7e/db2 to d1/d23/d25/d4f/d72/d85/dd9 0 2024-09-18T21:12:59.430 INFO:tasks.workunit.client.0.smithi077.stdout:6/639: chown d7/d7e/d11/d3e/d42/d88/da4/dd4 13 1 2024-09-18T21:12:59.431 INFO:tasks.workunit.client.1.smithi103.stdout:3/706: chown d1/d23/d25/d4f/d72/f87 28 1 2024-09-18T21:12:59.432 INFO:tasks.workunit.client.1.smithi103.stdout:2/666: mkdir d3/d5/d2f/d32/d90/df0 0 2024-09-18T21:12:59.433 INFO:tasks.workunit.client.1.smithi103.stdout:5/787: symlink de/d1f/d3b/d58/dc4/d7e/l105 0 2024-09-18T21:12:59.435 INFO:tasks.workunit.client.1.smithi103.stdout:9/788: chown d18/l67 154853 1 2024-09-18T21:12:59.435 INFO:tasks.workunit.client.0.smithi077.stdout:2/773: dwrite d1/d4/d5/d1a/d49/d6a/d81/dc4/dc0/f8a [4194304,4194304] 0 2024-09-18T21:12:59.436 INFO:tasks.workunit.client.0.smithi077.stdout:6/640: symlink d7/ldd 0 2024-09-18T21:12:59.439 INFO:tasks.workunit.client.1.smithi103.stdout:4/828: creat d9/d1c/d106/f115 x:0 0 0 2024-09-18T21:12:59.442 INFO:tasks.workunit.client.1.smithi103.stdout:4/829: chown d9/d38/d72/df0/d83/db6/d41/l62 19386 1 2024-09-18T21:12:59.443 INFO:tasks.workunit.client.0.smithi077.stdout:2/774: mkdir d1/d4/d5/d10b 0 2024-09-18T21:12:59.449 INFO:tasks.workunit.client.1.smithi103.stdout:0/695: dwrite d1/f3f [0,4194304] 0 2024-09-18T21:12:59.450 INFO:tasks.workunit.client.0.smithi077.stdout:2/775: symlink d1/d4/d5/d1a/l10c 0 2024-09-18T21:12:59.451 INFO:tasks.workunit.client.0.smithi077.stdout:6/641: getdents d7/d7e/d11/d3e/dcd 0 2024-09-18T21:12:59.452 INFO:tasks.workunit.client.1.smithi103.stdout:6/764: write d2/d24/f5f [484282,89864] 0 2024-09-18T21:12:59.453 INFO:tasks.workunit.client.0.smithi077.stdout:2/776: write d1/d4/d5/d1a/d2e/d40/d69/fa6 [3900364,72173] 0 2024-09-18T21:12:59.453 INFO:tasks.workunit.client.1.smithi103.stdout:6/765: chown d2/d3/d8/c3a 5 1 2024-09-18T21:12:59.455 INFO:tasks.workunit.client.1.smithi103.stdout:4/830: fdatasync d9/d38/d72/df0/d83/db6/d21/d80/f97 0 2024-09-18T21:12:59.456 INFO:tasks.workunit.client.0.smithi077.stdout:6/642: truncate d7/d7e/d11/d3e/d42/d88/da4/f2b 3287615 0 2024-09-18T21:12:59.457 INFO:tasks.workunit.client.1.smithi103.stdout:3/707: dread d1/f31 [0,4194304] 0 2024-09-18T21:12:59.458 INFO:tasks.workunit.client.1.smithi103.stdout:1/718: getdents d0/d2/d9/d10/d5d/d6f 0 2024-09-18T21:12:59.458 INFO:tasks.workunit.client.1.smithi103.stdout:3/708: write d1/f75 [2130692,6349] 0 2024-09-18T21:12:59.459 INFO:tasks.workunit.client.1.smithi103.stdout:5/788: fdatasync de/d1f/d3b/d58/dc4/d33/f7c 0 2024-09-18T21:12:59.461 INFO:tasks.workunit.client.1.smithi103.stdout:0/696: creat d1/d5/de/d24/d43/d76/ff9 x:0 0 0 2024-09-18T21:12:59.461 INFO:tasks.workunit.client.1.smithi103.stdout:9/789: truncate d18/d29/d68/d78/fee 1539709 0 2024-09-18T21:12:59.463 INFO:tasks.workunit.client.1.smithi103.stdout:8/844: mknod d4/d2d/d87/dbb/dea/c10e 0 2024-09-18T21:12:59.463 INFO:tasks.workunit.client.0.smithi077.stdout:2/777: getdents d1/d4/d5/d1a/d2e/d41 0 2024-09-18T21:12:59.464 INFO:tasks.workunit.client.0.smithi077.stdout:6/643: link d7/d7e/d11/l80 d7/d7e/d11/d3e/d42/d88/da4/lde 0 2024-09-18T21:12:59.465 INFO:tasks.workunit.client.1.smithi103.stdout:4/831: fdatasync d9/d1c/dcd/fdf 0 2024-09-18T21:12:59.465 INFO:tasks.workunit.client.1.smithi103.stdout:2/667: rmdir d3/d5/d2c/d54/daf 0 2024-09-18T21:12:59.468 INFO:tasks.workunit.client.0.smithi077.stdout:6/644: rename d7/d7e/d11/d3e/d42/dbb/d4c/lad to d7/d7e/d11/d3e/d42/dbb/d49/d96/ldf 0 2024-09-18T21:12:59.469 INFO:tasks.workunit.client.0.smithi077.stdout:6/645: write d7/d7e/d11/d3e/d42/dbb/d49/fd7 [940912,86699] 0 2024-09-18T21:12:59.470 INFO:tasks.workunit.client.0.smithi077.stdout:2/778: creat d1/d4/d5/d1a/d49/d6a/d81/dc4/f10d x:0 0 0 2024-09-18T21:12:59.471 INFO:tasks.workunit.client.1.smithi103.stdout:5/789: creat de/d1f/d3b/d51/de7/f106 x:0 0 0 2024-09-18T21:12:59.472 INFO:tasks.workunit.client.1.smithi103.stdout:5/790: fdatasync de/d1f/d3b/d3c/fb6 0 2024-09-18T21:12:59.473 INFO:tasks.workunit.client.1.smithi103.stdout:5/791: chown de/c13 7836205 1 2024-09-18T21:12:59.473 INFO:tasks.workunit.client.1.smithi103.stdout:0/697: symlink d1/d5/de/d24/d43/d76/lfa 0 2024-09-18T21:12:59.475 INFO:tasks.workunit.client.1.smithi103.stdout:9/790: rmdir d18/d52 39 2024-09-18T21:12:59.477 INFO:tasks.workunit.client.1.smithi103.stdout:8/845: rmdir d4/d2d/dc1/dee 39 2024-09-18T21:12:59.483 INFO:tasks.workunit.client.0.smithi077.stdout:6/646: link d7/d7e/d11/d3e/d42/dbb/c93 d7/d7e/d11/d3e/d42/dbb/d31/ce0 0 2024-09-18T21:12:59.483 INFO:tasks.workunit.client.1.smithi103.stdout:2/668: mknod d3/d5/d2c/d77/cf1 0 2024-09-18T21:12:59.483 INFO:tasks.workunit.client.1.smithi103.stdout:2/669: dread - d3/d5/d25/f5f zero size 2024-09-18T21:12:59.484 INFO:tasks.workunit.client.1.smithi103.stdout:1/719: symlink d0/d11/lfc 0 2024-09-18T21:12:59.487 INFO:tasks.workunit.client.0.smithi077.stdout:6/647: mkdir d7/d7e/da6/de1 0 2024-09-18T21:12:59.488 INFO:tasks.workunit.client.0.smithi077.stdout:6/648: chown d7/d7e/f32 32 1 2024-09-18T21:12:59.491 INFO:tasks.workunit.client.1.smithi103.stdout:3/709: creat d1/d23/d25/d4f/d58/d68/fda x:0 0 0 2024-09-18T21:12:59.492 INFO:tasks.workunit.client.0.smithi077.stdout:2/779: dwrite d1/d4/d5/d1a/d49/f72 [0,4194304] 0 2024-09-18T21:12:59.493 INFO:tasks.workunit.client.1.smithi103.stdout:3/710: chown d1/d2/d18/d30/l39 14 1 2024-09-18T21:12:59.493 INFO:tasks.workunit.client.1.smithi103.stdout:0/698: mknod d1/d9/cfb 0 2024-09-18T21:12:59.497 INFO:tasks.workunit.client.1.smithi103.stdout:9/791: readlink d18/d52/d5e/l79 0 2024-09-18T21:12:59.498 INFO:tasks.workunit.client.1.smithi103.stdout:9/792: chown d18/d8d/f87 107282 1 2024-09-18T21:12:59.500 INFO:tasks.workunit.client.0.smithi077.stdout:2/780: creat d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d83/dba/dcd/f10e x:0 0 0 2024-09-18T21:12:59.501 INFO:tasks.workunit.client.1.smithi103.stdout:2/670: truncate d3/d5/d2c/f50 1971541 0 2024-09-18T21:12:59.503 INFO:tasks.workunit.client.0.smithi077.stdout:2/781: mkdir d1/d4/d5/d1a/d2e/d7e/d10f 0 2024-09-18T21:12:59.504 INFO:tasks.workunit.client.0.smithi077.stdout:2/782: read - d1/d4/d5/d1a/d2e/fd1 zero size 2024-09-18T21:12:59.505 INFO:tasks.workunit.client.0.smithi077.stdout:6/649: truncate d7/d7e/f1e 3104495 0 2024-09-18T21:12:59.506 INFO:tasks.workunit.client.1.smithi103.stdout:9/793: mknod d18/d29/d68/d92/d9c/c108 0 2024-09-18T21:12:59.506 INFO:tasks.workunit.client.1.smithi103.stdout:4/832: getdents d9/d38/d72/d94 0 2024-09-18T21:12:59.507 INFO:tasks.workunit.client.1.smithi103.stdout:2/671: symlink d3/d5/d2c/d77/d9c/db8/lf2 0 2024-09-18T21:12:59.507 INFO:tasks.workunit.client.1.smithi103.stdout:5/792: link de/d1f/d3b/d58/dc4/d9c/lf7 de/l107 0 2024-09-18T21:12:59.509 INFO:tasks.workunit.client.1.smithi103.stdout:1/720: truncate d0/d2/d2b/d3a/d42/d72/db0/f7f 3325379 0 2024-09-18T21:12:59.510 INFO:tasks.workunit.client.1.smithi103.stdout:1/721: chown d0/f37 192594 1 2024-09-18T21:12:59.511 INFO:tasks.workunit.client.1.smithi103.stdout:0/699: truncate d1/d5/de/d24/f38 7862582 0 2024-09-18T21:12:59.511 INFO:tasks.workunit.client.0.smithi077.stdout:2/783: dwrite d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d8e/f74 [4194304,4194304] 0 2024-09-18T21:12:59.512 INFO:tasks.workunit.client.0.smithi077.stdout:6/650: creat d7/d7e/d11/fe2 x:0 0 0 2024-09-18T21:12:59.513 INFO:tasks.workunit.client.0.smithi077.stdout:2/784: readlink d1/d4/d5/d1a/d2e/d41/d2c/l50 0 2024-09-18T21:12:59.514 INFO:tasks.workunit.client.0.smithi077.stdout:2/785: write d1/d4/d5/d1a/d2e/fcc [1614586,41708] 0 2024-09-18T21:12:59.518 INFO:tasks.workunit.client.1.smithi103.stdout:3/711: link d1/d23/d25/d4f/d58/d68/d50/d54/f9d d1/d23/d25/d4f/dce/fdb 0 2024-09-18T21:12:59.519 INFO:tasks.workunit.client.0.smithi077.stdout:5/758: sync 2024-09-18T21:12:59.519 INFO:tasks.workunit.client.0.smithi077.stdout:1/674: sync 2024-09-18T21:12:59.519 INFO:tasks.workunit.client.0.smithi077.stdout:9/631: sync 2024-09-18T21:12:59.520 INFO:tasks.workunit.client.0.smithi077.stdout:8/657: sync 2024-09-18T21:12:59.520 INFO:tasks.workunit.client.1.smithi103.stdout:9/794: fsync d18/da4/fce 0 2024-09-18T21:12:59.520 INFO:tasks.workunit.client.0.smithi077.stdout:6/651: truncate d7/d7e/d11/d3e/d42/dbb/d49/f84 3104154 0 2024-09-18T21:12:59.522 INFO:tasks.workunit.client.1.smithi103.stdout:5/793: mkdir de/d1f/d3b/d3c/d62/d108 0 2024-09-18T21:12:59.522 INFO:tasks.workunit.client.1.smithi103.stdout:5/794: chown de/d1f/d3b/l84 3 1 2024-09-18T21:12:59.524 INFO:tasks.workunit.client.0.smithi077.stdout:2/786: rename d1/d4/d5/d1a/d49/ldf to d1/d4/d5/d1a/d49/d6a/d81/dc4/dc0/l110 0 2024-09-18T21:12:59.525 INFO:tasks.workunit.client.1.smithi103.stdout:5/795: dread fb [0,4194304] 0 2024-09-18T21:12:59.527 INFO:tasks.workunit.client.1.smithi103.stdout:5/796: truncate de/d3e/d15/fa8 5030790 0 2024-09-18T21:12:59.527 INFO:tasks.workunit.client.1.smithi103.stdout:1/722: rmdir d0/d2/d9 39 2024-09-18T21:12:59.528 INFO:tasks.workunit.client.0.smithi077.stdout:5/759: creat d0/df/d10/d4b/d98/ff9 x:0 0 0 2024-09-18T21:12:59.529 INFO:tasks.workunit.client.0.smithi077.stdout:5/760: write d0/d6/d3b/d64/fb2 [617456,15365] 0 2024-09-18T21:12:59.529 INFO:tasks.workunit.client.0.smithi077.stdout:5/761: stat d0/df 0 2024-09-18T21:12:59.529 INFO:tasks.workunit.client.0.smithi077.stdout:1/675: rename d3/d8/f1c to d3/d8/d49/d4e/fe9 0 2024-09-18T21:12:59.537 INFO:tasks.workunit.client.0.smithi077.stdout:1/676: mkdir d3/d38/d97/dea 0 2024-09-18T21:12:59.538 INFO:tasks.workunit.client.0.smithi077.stdout:2/787: dwrite d1/d4/d5/d1a/d2e/d40/f44 [4194304,4194304] 0 2024-09-18T21:12:59.540 INFO:tasks.workunit.client.0.smithi077.stdout:9/632: rename d1/d54/fc0 to d1/d54/fd3 0 2024-09-18T21:12:59.540 INFO:tasks.workunit.client.0.smithi077.stdout:2/788: chown d1/d4/d5/d1a/d2e/d41/d2c/cd3 482232761 1 2024-09-18T21:12:59.541 INFO:tasks.workunit.client.0.smithi077.stdout:2/789: rename d1/d4 to d1/d4/d111 22 2024-09-18T21:12:59.545 INFO:tasks.workunit.client.0.smithi077.stdout:9/633: creat d1/d54/d51/fd4 x:0 0 0 2024-09-18T21:12:59.546 INFO:tasks.workunit.client.0.smithi077.stdout:8/658: getdents d2/d5f/da8/d4f/d5a/d2a/dc8 0 2024-09-18T21:12:59.547 INFO:tasks.workunit.client.0.smithi077.stdout:5/762: link d0/d6/d3b/f7e d0/d43/ffa 0 2024-09-18T21:12:59.547 INFO:tasks.workunit.client.0.smithi077.stdout:1/677: dwrite d3/d6a/d9b/d68/fd0 [0,4194304] 0 2024-09-18T21:12:59.548 INFO:tasks.workunit.client.0.smithi077.stdout:9/634: chown d1/dd/d1a/d42/d4b/l52 726 1 2024-09-18T21:12:59.551 INFO:tasks.workunit.client.0.smithi077.stdout:8/659: rmdir d2/d5/d6 39 2024-09-18T21:12:59.553 INFO:tasks.workunit.client.0.smithi077.stdout:1/678: chown d3/d6a/d9b/f5b 64897116 1 2024-09-18T21:12:59.555 INFO:tasks.workunit.client.0.smithi077.stdout:1/679: chown d3/d8/d49/d4e/lbf 1030222149 1 2024-09-18T21:12:59.556 INFO:tasks.workunit.client.0.smithi077.stdout:2/790: creat d1/d4/d9/f112 x:0 0 0 2024-09-18T21:12:59.560 INFO:tasks.workunit.client.0.smithi077.stdout:5/763: creat d0/d36/ffb x:0 0 0 2024-09-18T21:12:59.561 INFO:tasks.workunit.client.0.smithi077.stdout:8/660: dwrite d2/d27/d29/f3f [0,4194304] 0 2024-09-18T21:12:59.567 INFO:tasks.workunit.client.0.smithi077.stdout:8/661: mkdir d2/d5f/def 0 2024-09-18T21:12:59.569 INFO:tasks.workunit.client.0.smithi077.stdout:5/764: fdatasync d0/df/d10/d5c/d74/fc4 0 2024-09-18T21:12:59.575 INFO:tasks.workunit.client.0.smithi077.stdout:1/680: dread d3/d38/f60 [0,4194304] 0 2024-09-18T21:12:59.577 INFO:tasks.workunit.client.0.smithi077.stdout:5/765: creat d0/df/d10/d4b/d80/ffc x:0 0 0 2024-09-18T21:12:59.584 INFO:tasks.workunit.client.0.smithi077.stdout:1/681: creat d3/d38/d97/dea/feb x:0 0 0 2024-09-18T21:12:59.585 INFO:tasks.workunit.client.0.smithi077.stdout:5/766: mknod d0/d6/dde/cfd 0 2024-09-18T21:12:59.586 INFO:tasks.workunit.client.0.smithi077.stdout:8/662: mkdir d2/d5f/da8/d4f/d5a/d5e/d8f/dad/df0 0 2024-09-18T21:12:59.590 INFO:tasks.workunit.client.0.smithi077.stdout:5/767: mknod d0/d6/d3b/d64/d95/cfe 0 2024-09-18T21:12:59.592 INFO:tasks.workunit.client.0.smithi077.stdout:8/663: dread - d2/d5f/da8/d20/fa1 zero size 2024-09-18T21:12:59.592 INFO:tasks.workunit.client.1.smithi103.stdout:4/833: symlink d9/d38/d72/df0/d83/db6/l116 0 2024-09-18T21:12:59.593 INFO:tasks.workunit.client.0.smithi077.stdout:9/635: dwrite d1/d54/f6b [0,4194304] 0 2024-09-18T21:12:59.596 INFO:tasks.workunit.client.0.smithi077.stdout:9/636: chown d1/dd/d1a/d42/d4b/fbb 568 1 2024-09-18T21:12:59.596 INFO:tasks.workunit.client.1.smithi103.stdout:2/672: mknod d3/d5/d2f/d32/d90/cf3 0 2024-09-18T21:12:59.597 INFO:tasks.workunit.client.1.smithi103.stdout:3/712: creat d1/d23/d25/d4f/d58/d86/fdc x:0 0 0 2024-09-18T21:12:59.597 INFO:tasks.workunit.client.0.smithi077.stdout:2/791: write d1/d4/d5/d1a/d2e/d41/f68 [588916,7524] 0 2024-09-18T21:12:59.600 INFO:tasks.workunit.client.0.smithi077.stdout:5/768: rename d0/d6/dd/f1e to d0/d43/fff 0 2024-09-18T21:12:59.600 INFO:tasks.workunit.client.0.smithi077.stdout:1/682: dread d3/d8/f67 [0,4194304] 0 2024-09-18T21:12:59.600 INFO:tasks.workunit.client.0.smithi077.stdout:5/769: dread - d0/de6/feb zero size 2024-09-18T21:12:59.601 INFO:tasks.workunit.client.1.smithi103.stdout:9/795: creat d18/d8d/d2f/ddd/f109 x:0 0 0 2024-09-18T21:12:59.602 INFO:tasks.workunit.client.0.smithi077.stdout:8/664: mkdir d2/d5f/da8/d4f/d5a/d2a/dc8/df1 0 2024-09-18T21:12:59.604 INFO:tasks.workunit.client.0.smithi077.stdout:9/637: creat d1/dd/d11/d1c/d38/d46/daf/fd5 x:0 0 0 2024-09-18T21:12:59.608 INFO:tasks.workunit.client.0.smithi077.stdout:1/683: mknod d3/d8/d75/cec 0 2024-09-18T21:12:59.609 INFO:tasks.workunit.client.0.smithi077.stdout:1/684: chown d3/d6a/d9b/dbe/ce2 3 1 2024-09-18T21:12:59.610 INFO:tasks.workunit.client.0.smithi077.stdout:5/770: creat d0/df/d10/d47/db6/f100 x:0 0 0 2024-09-18T21:12:59.611 INFO:tasks.workunit.client.1.smithi103.stdout:0/700: mkdir d1/d9/d3e/dfc 0 2024-09-18T21:12:59.614 INFO:tasks.workunit.client.1.smithi103.stdout:4/834: chown d9/d38/f4c 11689 1 2024-09-18T21:12:59.615 INFO:tasks.workunit.client.1.smithi103.stdout:4/835: truncate d9/d1c/dcd/dd1/ffd 737657 0 2024-09-18T21:12:59.616 INFO:tasks.workunit.client.0.smithi077.stdout:9/638: rename d1/dd/d11/d1c/d38/d46/f67 to d1/dd/d11/d1c/d38/d46/d55/d9c/fd6 0 2024-09-18T21:12:59.616 INFO:tasks.workunit.client.0.smithi077.stdout:2/792: dread d1/d4/d5/d1a/d2e/f34 [0,4194304] 0 2024-09-18T21:12:59.619 INFO:tasks.workunit.client.0.smithi077.stdout:1/685: unlink d3/c82 0 2024-09-18T21:12:59.620 INFO:tasks.workunit.client.1.smithi103.stdout:2/673: dread d3/fbc [0,4194304] 0 2024-09-18T21:12:59.620 INFO:tasks.workunit.client.0.smithi077.stdout:5/771: mkdir d0/d6/d3b/d64/d101 0 2024-09-18T21:12:59.620 INFO:tasks.workunit.client.0.smithi077.stdout:2/793: truncate d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d83/dba/ddc/fe3 656773 0 2024-09-18T21:12:59.621 INFO:tasks.workunit.client.1.smithi103.stdout:9/796: truncate d18/d52/f8b 466576 0 2024-09-18T21:12:59.621 INFO:tasks.workunit.client.1.smithi103.stdout:9/797: readlink d18/d8d/laf 0 2024-09-18T21:12:59.622 INFO:tasks.workunit.client.1.smithi103.stdout:9/798: read - d18/da4/ff6 zero size 2024-09-18T21:12:59.622 INFO:tasks.workunit.client.1.smithi103.stdout:9/799: stat d18/d29/l37 0 2024-09-18T21:12:59.626 INFO:tasks.workunit.client.0.smithi077.stdout:5/772: rename d0/df/d3d/d85/f86 to d0/d6/dde/f102 0 2024-09-18T21:12:59.627 INFO:tasks.workunit.client.1.smithi103.stdout:1/723: mkdir d0/d2/d2b/d3a/d42/dfd 0 2024-09-18T21:12:59.627 INFO:tasks.workunit.client.0.smithi077.stdout:5/773: chown d0/d6/fb 34492721 1 2024-09-18T21:12:59.628 INFO:tasks.workunit.client.0.smithi077.stdout:8/665: symlink d2/d5/d6/lf2 0 2024-09-18T21:12:59.628 INFO:tasks.workunit.client.0.smithi077.stdout:5/774: dread - d0/df/d10/d4b/d80/fec zero size 2024-09-18T21:12:59.629 INFO:tasks.workunit.client.0.smithi077.stdout:8/666: readlink d2/d27/d29/d72/d81/lc4 0 2024-09-18T21:12:59.631 INFO:tasks.workunit.client.0.smithi077.stdout:1/686: dread d3/d6a/d9b/f5b [0,4194304] 0 2024-09-18T21:12:59.635 INFO:tasks.workunit.client.1.smithi103.stdout:3/713: truncate d1/da/f16 3298705 0 2024-09-18T21:12:59.637 INFO:tasks.workunit.client.0.smithi077.stdout:1/687: fdatasync d3/d8/d49/f62 0 2024-09-18T21:12:59.638 INFO:tasks.workunit.client.1.smithi103.stdout:4/836: dread d9/d38/d58/d113/f111 [0,4194304] 0 2024-09-18T21:12:59.638 INFO:tasks.workunit.client.0.smithi077.stdout:9/639: getdents d1/dd/d11/d1c/d38/d46/d55/d9c 0 2024-09-18T21:12:59.640 INFO:tasks.workunit.client.1.smithi103.stdout:4/837: fdatasync d9/d38/d72/df0/d83/db6/d41/d64/fcf 0 2024-09-18T21:12:59.640 INFO:tasks.workunit.client.1.smithi103.stdout:5/797: dwrite de/d3e/f19 [0,4194304] 0 2024-09-18T21:12:59.641 INFO:tasks.workunit.client.1.smithi103.stdout:0/701: mkdir d1/d5/de/d24/d43/dfd 0 2024-09-18T21:12:59.643 INFO:tasks.workunit.client.0.smithi077.stdout:2/794: rename d1/d4/d5/d1a/d49/d6a to d1/d4/d5/d1a/d113 0 2024-09-18T21:12:59.644 INFO:tasks.workunit.client.0.smithi077.stdout:2/795: chown d1/d4/d5/d1a/d2e/d41/d2c/dab/ld7 166 1 2024-09-18T21:12:59.646 INFO:tasks.workunit.client.1.smithi103.stdout:1/724: dwrite d0/d2/d9/dc/d36/fb3 [0,4194304] 0 2024-09-18T21:12:59.647 INFO:tasks.workunit.client.0.smithi077.stdout:1/688: mknod d3/d8/d13/d77/ced 0 2024-09-18T21:12:59.647 INFO:tasks.workunit.client.0.smithi077.stdout:1/689: stat d3/d38 0 2024-09-18T21:12:59.648 INFO:tasks.workunit.client.0.smithi077.stdout:5/775: write d0/d6/d3b/d64/fe5 [556932,5147] 0 2024-09-18T21:12:59.649 INFO:tasks.workunit.client.0.smithi077.stdout:5/776: dread - d0/d6/dd/d5d/ff3 zero size 2024-09-18T21:12:59.649 INFO:tasks.workunit.client.1.smithi103.stdout:1/725: fdatasync d0/d2/d9/d9e/d7a/dd0/df9/d68/d81/da2/da4/dc2/dd8/fb6 0 2024-09-18T21:12:59.650 INFO:tasks.workunit.client.0.smithi077.stdout:9/640: mkdir d1/dd/d11/d1c/dd7 0 2024-09-18T21:12:59.652 INFO:tasks.workunit.client.0.smithi077.stdout:9/641: read d1/dd/d11/d1c/d38/d46/d55/d9c/fb8 [1128346,19466] 0 2024-09-18T21:12:59.652 INFO:tasks.workunit.client.0.smithi077.stdout:7/738: sync 2024-09-18T21:12:59.652 INFO:tasks.workunit.client.0.smithi077.stdout:4/649: sync 2024-09-18T21:12:59.652 INFO:tasks.workunit.client.0.smithi077.stdout:8/667: rename d2/d5f/da8/d4f/d5a/d2a/lb5 to d2/d5f/da8/d20/d3e/lf3 0 2024-09-18T21:12:59.658 INFO:tasks.workunit.client.1.smithi103.stdout:4/838: mknod d9/d38/d58/c117 0 2024-09-18T21:12:59.659 INFO:tasks.workunit.client.1.smithi103.stdout:5/798: write de/d3e/d15/f8a [5116469,14738] 0 2024-09-18T21:12:59.659 INFO:tasks.workunit.client.1.smithi103.stdout:3/714: dwrite d1/f3c [0,4194304] 0 2024-09-18T21:12:59.660 INFO:tasks.workunit.client.0.smithi077.stdout:9/642: symlink d1/dd/d1a/d42/d4b/ld8 0 2024-09-18T21:12:59.660 INFO:tasks.workunit.client.1.smithi103.stdout:4/839: truncate d9/d1c/d69/fdc 652641 0 2024-09-18T21:12:59.662 INFO:tasks.workunit.client.1.smithi103.stdout:2/674: creat d3/ff4 x:0 0 0 2024-09-18T21:12:59.662 INFO:tasks.workunit.client.1.smithi103.stdout:3/715: truncate d1/d2/d18/fbc 469480 0 2024-09-18T21:12:59.663 INFO:tasks.workunit.client.1.smithi103.stdout:2/675: chown d3/d5/d25 262808 1 2024-09-18T21:12:59.663 INFO:tasks.workunit.client.0.smithi077.stdout:4/650: mknod d3/ccb 0 2024-09-18T21:12:59.663 INFO:tasks.workunit.client.1.smithi103.stdout:3/716: chown d1/d2/d18/d30/l39 78488 1 2024-09-18T21:12:59.664 INFO:tasks.workunit.client.0.smithi077.stdout:4/651: chown d3/dc/d32/d45/l7e 945796 1 2024-09-18T21:12:59.665 INFO:tasks.workunit.client.1.smithi103.stdout:3/717: write d1/d23/d25/d4f/d72/d85/fab [5209216,52712] 0 2024-09-18T21:12:59.665 INFO:tasks.workunit.client.0.smithi077.stdout:4/652: fsync d3/d7/d6c/f90 0 2024-09-18T21:12:59.666 INFO:tasks.workunit.client.1.smithi103.stdout:3/718: chown d1/d23/d47/dbb/fba 5 1 2024-09-18T21:12:59.666 INFO:tasks.workunit.client.0.smithi077.stdout:2/796: rename d1/d4/d9/fa0 to d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d83/f114 0 2024-09-18T21:12:59.668 INFO:tasks.workunit.client.1.smithi103.stdout:9/800: rmdir d18/d52/d6f/d8e/d102 0 2024-09-18T21:12:59.668 INFO:tasks.workunit.client.0.smithi077.stdout:2/797: readlink d1/d4/d5/d7d/lb9 0 2024-09-18T21:12:59.672 INFO:tasks.workunit.client.0.smithi077.stdout:3/658: sync 2024-09-18T21:12:59.672 INFO:tasks.workunit.client.0.smithi077.stdout:6/652: sync 2024-09-18T21:12:59.672 INFO:tasks.workunit.client.0.smithi077.stdout:0/775: sync 2024-09-18T21:12:59.672 INFO:tasks.workunit.client.0.smithi077.stdout:2/798: truncate d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d95/ff5 1499560 0 2024-09-18T21:12:59.673 INFO:tasks.workunit.client.1.smithi103.stdout:5/799: creat de/d1f/d3b/d3c/d62/f109 x:0 0 0 2024-09-18T21:12:59.674 INFO:tasks.workunit.client.0.smithi077.stdout:4/653: symlink d3/dc/d51/d53/d66/lcc 0 2024-09-18T21:12:59.676 INFO:tasks.workunit.client.0.smithi077.stdout:3/659: write db/d14/d32/d49/da4/d8a/d99/daf/fbe [909642,24580] 0 2024-09-18T21:12:59.676 INFO:tasks.workunit.client.1.smithi103.stdout:2/676: read d3/d5/d2c/f50 [1446925,55014] 0 2024-09-18T21:12:59.679 INFO:tasks.workunit.client.0.smithi077.stdout:0/776: creat d8/d37/d95/dab/ffc x:0 0 0 2024-09-18T21:12:59.679 INFO:tasks.workunit.client.0.smithi077.stdout:5/777: dread d0/d6/fb [0,4194304] 0 2024-09-18T21:12:59.680 INFO:tasks.workunit.client.0.smithi077.stdout:1/690: rename d3/d8/f88 to d3/fee 0 2024-09-18T21:12:59.683 INFO:tasks.workunit.client.0.smithi077.stdout:0/777: write d8/d1d/d80/f84 [3905845,79845] 0 2024-09-18T21:12:59.683 INFO:tasks.workunit.client.0.smithi077.stdout:3/660: stat db/d14/cb8 0 2024-09-18T21:12:59.684 INFO:tasks.workunit.client.1.smithi103.stdout:1/726: write d0/d2/d2b/d3a/f91 [477599,96360] 0 2024-09-18T21:12:59.684 INFO:tasks.workunit.client.0.smithi077.stdout:1/691: write d3/d6a/d9b/d4c/fae [1207729,95537] 0 2024-09-18T21:12:59.686 INFO:tasks.workunit.client.1.smithi103.stdout:9/801: creat d18/d52/d6f/d8e/d8f/dbd/f10a x:0 0 0 2024-09-18T21:12:59.691 INFO:tasks.workunit.client.1.smithi103.stdout:5/800: chown de/d1f/d3b/d58/dc4/f22 1035800 1 2024-09-18T21:12:59.691 INFO:tasks.workunit.client.0.smithi077.stdout:8/668: dread d2/d5f/d6f/f95 [0,4194304] 0 2024-09-18T21:12:59.692 INFO:tasks.workunit.client.0.smithi077.stdout:7/739: dread d12/d31/f41 [4194304,4194304] 0 2024-09-18T21:12:59.693 INFO:tasks.workunit.client.0.smithi077.stdout:0/778: dwrite d8/d37/d66/d87/de0/fd7 [0,4194304] 0 2024-09-18T21:12:59.693 INFO:tasks.workunit.client.0.smithi077.stdout:9/643: rename d1/d54/d81/lb0 to d1/dd/d11/d1c/d38/dae/ld9 0 2024-09-18T21:12:59.694 INFO:tasks.workunit.client.0.smithi077.stdout:0/779: chown d8/d1a 396379970 1 2024-09-18T21:12:59.694 INFO:tasks.workunit.client.0.smithi077.stdout:8/669: dread - d2/d5/d6/d9f/da6/fca zero size 2024-09-18T21:12:59.696 INFO:tasks.workunit.client.0.smithi077.stdout:4/654: write d3/d7/d42/f5c [822059,74996] 0 2024-09-18T21:12:59.697 INFO:tasks.workunit.client.0.smithi077.stdout:5/778: fsync d0/d6/dd/f35 0 2024-09-18T21:12:59.698 INFO:tasks.workunit.client.0.smithi077.stdout:2/799: dread d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d95/f103 [0,4194304] 0 2024-09-18T21:12:59.698 INFO:tasks.workunit.client.1.smithi103.stdout:2/677: rmdir d3/d5/d4a/d56 39 2024-09-18T21:12:59.699 INFO:tasks.workunit.client.1.smithi103.stdout:2/678: read - d3/d5/d2c/d77/d9c/db8/fdc zero size 2024-09-18T21:12:59.701 INFO:tasks.workunit.client.1.smithi103.stdout:4/840: truncate d9/d1c/d77/f59 59337 0 2024-09-18T21:12:59.701 INFO:tasks.workunit.client.0.smithi077.stdout:2/800: read d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d8e/f74 [6667949,104027] 0 2024-09-18T21:12:59.703 INFO:tasks.workunit.client.1.smithi103.stdout:1/727: creat d0/d2/d9/dc/d6e/dac/ffe x:0 0 0 2024-09-18T21:12:59.703 INFO:tasks.workunit.client.1.smithi103.stdout:1/728: dread - d0/d2/d9/fee zero size 2024-09-18T21:12:59.704 INFO:tasks.workunit.client.0.smithi077.stdout:1/692: creat d3/d8/d49/d4e/d50/fef x:0 0 0 2024-09-18T21:12:59.705 INFO:tasks.workunit.client.1.smithi103.stdout:9/802: chown d18/d8d/l75 70985 1 2024-09-18T21:12:59.705 INFO:tasks.workunit.client.1.smithi103.stdout:0/702: getdents d1/d5/de/d22/d6a 0 2024-09-18T21:12:59.706 INFO:tasks.workunit.client.1.smithi103.stdout:5/801: truncate de/fcc 1741879 0 2024-09-18T21:12:59.708 INFO:tasks.workunit.client.1.smithi103.stdout:2/679: rename d3/l10 to d3/d5/d2f/d32/dae/lf5 0 2024-09-18T21:12:59.709 INFO:tasks.workunit.client.0.smithi077.stdout:7/740: creat d12/d22/d59/d72/d91/ffc x:0 0 0 2024-09-18T21:12:59.711 INFO:tasks.workunit.client.0.smithi077.stdout:0/780: creat d8/d1d/d80/ffd x:0 0 0 2024-09-18T21:12:59.714 INFO:tasks.workunit.client.0.smithi077.stdout:0/781: write d8/d37/d66/d87/de0/dce/ff7 [519720,69920] 0 2024-09-18T21:12:59.715 INFO:tasks.workunit.client.0.smithi077.stdout:6/653: truncate d7/d7e/d11/d3e/d42/dbb/d4c/f86 2784838 0 2024-09-18T21:12:59.717 INFO:tasks.workunit.client.0.smithi077.stdout:7/741: dwrite d12/d56/da1/db6/dbd/fdd [0,4194304] 0 2024-09-18T21:12:59.719 INFO:tasks.workunit.client.0.smithi077.stdout:9/644: symlink d1/dd/d11/d1c/d38/d46/d55/d9c/lda 0 2024-09-18T21:12:59.719 INFO:tasks.workunit.client.1.smithi103.stdout:3/719: getdents d1/d23/d25/d4f/d58/d68/d50 0 2024-09-18T21:12:59.721 INFO:tasks.workunit.client.0.smithi077.stdout:4/655: creat d3/d7/d7b/d88/fcd x:0 0 0 2024-09-18T21:12:59.721 INFO:tasks.workunit.client.1.smithi103.stdout:9/803: dwrite d18/d8d/d2f/f101 [0,4194304] 0 2024-09-18T21:12:59.722 INFO:tasks.workunit.client.1.smithi103.stdout:9/804: chown d18/d29/d68/d78/fa8 9718895 1 2024-09-18T21:12:59.723 INFO:tasks.workunit.client.1.smithi103.stdout:9/805: readlink d18/d29/l37 0 2024-09-18T21:12:59.723 INFO:tasks.workunit.client.1.smithi103.stdout:2/680: chown d3/d5/fde 12 1 2024-09-18T21:12:59.724 INFO:tasks.workunit.client.0.smithi077.stdout:5/779: write d0/d6/d3b/d64/d67/fcc [485771,64725] 0 2024-09-18T21:12:59.726 INFO:tasks.workunit.client.1.smithi103.stdout:2/681: write d3/d5/d2c/d77/d9c/fc8 [1466261,130727] 0 2024-09-18T21:12:59.727 INFO:tasks.workunit.client.0.smithi077.stdout:1/693: mkdir d3/d8/d49/df0 0 2024-09-18T21:12:59.728 INFO:tasks.workunit.client.0.smithi077.stdout:1/694: chown d3/d8/d13/f14 13016 1 2024-09-18T21:12:59.730 INFO:tasks.workunit.client.1.smithi103.stdout:4/841: dread d9/d38/d72/d85/dd8/f44 [0,4194304] 0 2024-09-18T21:12:59.731 INFO:tasks.workunit.client.0.smithi077.stdout:8/670: unlink d2/d27/d29/d41/dbc/lb6 0 2024-09-18T21:12:59.733 INFO:tasks.workunit.client.1.smithi103.stdout:4/842: chown d9/d38/d58/d113/cc8 8 1 2024-09-18T21:12:59.734 INFO:tasks.workunit.client.1.smithi103.stdout:3/720: truncate d1/d2/d18/f29 4950552 0 2024-09-18T21:12:59.735 INFO:tasks.workunit.client.0.smithi077.stdout:8/671: dread d2/d27/d29/f61 [0,4194304] 0 2024-09-18T21:12:59.735 INFO:tasks.workunit.client.0.smithi077.stdout:6/654: fdatasync d7/d7e/d11/d3e/d42/dbb/d50/f5f 0 2024-09-18T21:12:59.735 INFO:tasks.workunit.client.0.smithi077.stdout:8/672: chown f1 0 1 2024-09-18T21:12:59.736 INFO:tasks.workunit.client.1.smithi103.stdout:1/729: dwrite d0/d2/d2b/d3a/d42/d72/db0/da7/fc4 [0,4194304] 0 2024-09-18T21:12:59.737 INFO:tasks.workunit.client.0.smithi077.stdout:6/655: dread - d7/d7e/d11/d3e/d42/d88/fbd zero size 2024-09-18T21:12:59.738 INFO:tasks.workunit.client.1.smithi103.stdout:2/682: fdatasync d3/d5/d2f/d5b/f6c 0 2024-09-18T21:12:59.741 INFO:tasks.workunit.client.0.smithi077.stdout:2/801: mknod d1/d4/d5/d1a/d2e/d7e/d10f/c115 0 2024-09-18T21:12:59.741 INFO:tasks.workunit.client.1.smithi103.stdout:1/730: write d0/d2/d9/d9e/d7a/dd0/df9/d68/d81/da2/da4/dc2/fcc [3263,22491] 0 2024-09-18T21:12:59.741 INFO:tasks.workunit.client.1.smithi103.stdout:5/802: link de/d1f/d3b/d58/dc4/d7e/l105 de/d1f/d3b/d58/l10a 0 2024-09-18T21:12:59.743 INFO:tasks.workunit.client.0.smithi077.stdout:1/695: mknod d3/d6a/d9b/dbe/cf1 0 2024-09-18T21:12:59.745 INFO:tasks.workunit.client.1.smithi103.stdout:3/721: dwrite d1/d23/d25/d4f/dce/fd4 [0,4194304] 0 2024-09-18T21:12:59.745 INFO:tasks.workunit.client.0.smithi077.stdout:0/782: symlink d8/d1a/lfe 0 2024-09-18T21:12:59.745 INFO:tasks.workunit.client.1.smithi103.stdout:3/722: readlink d1/da/df/l48 0 2024-09-18T21:12:59.748 INFO:tasks.workunit.client.1.smithi103.stdout:5/803: creat de/d1f/d3b/dcd/f10b x:0 0 0 2024-09-18T21:12:59.748 INFO:tasks.workunit.client.1.smithi103.stdout:3/723: read d1/f13 [1399821,106344] 0 2024-09-18T21:12:59.749 INFO:tasks.workunit.client.0.smithi077.stdout:6/656: dwrite d7/fab [0,4194304] 0 2024-09-18T21:12:59.750 INFO:tasks.workunit.client.0.smithi077.stdout:6/657: chown d7/d7e/d11/d3e/d42/d88/da4/f5b 0 1 2024-09-18T21:12:59.750 INFO:tasks.workunit.client.1.smithi103.stdout:3/724: fdatasync d1/d2/d18/f46 0 2024-09-18T21:12:59.750 INFO:tasks.workunit.client.1.smithi103.stdout:1/731: rmdir d0/d2/d2b/d3a/d42 39 2024-09-18T21:12:59.752 INFO:tasks.workunit.client.0.smithi077.stdout:4/656: mkdir d3/dc/d51/d53/dce 0 2024-09-18T21:12:59.754 INFO:tasks.workunit.client.0.smithi077.stdout:8/673: creat d2/d5f/da8/d4f/d5a/d5e/d8f/dad/ff4 x:0 0 0 2024-09-18T21:12:59.755 INFO:tasks.workunit.client.0.smithi077.stdout:5/780: mknod d0/df/dd2/df5/c103 0 2024-09-18T21:12:59.755 INFO:tasks.workunit.client.0.smithi077.stdout:8/674: stat d2/d27/d29/f43 0 2024-09-18T21:12:59.759 INFO:tasks.workunit.client.1.smithi103.stdout:3/725: truncate d1/d2/f4b 2535170 0 2024-09-18T21:12:59.760 INFO:tasks.workunit.client.0.smithi077.stdout:0/783: rmdir d8/d37/d66/d87/de0/dce/dcf 39 2024-09-18T21:12:59.761 INFO:tasks.workunit.client.1.smithi103.stdout:3/726: write d1/f2e [462808,15440] 0 2024-09-18T21:12:59.762 INFO:tasks.workunit.client.0.smithi077.stdout:3/661: truncate db/d14/d32/d49/d4e/d6a/f6c 1331776 0 2024-09-18T21:12:59.765 INFO:tasks.workunit.client.1.smithi103.stdout:1/732: dwrite d0/d2/d2b/f41 [0,4194304] 0 2024-09-18T21:12:59.766 INFO:tasks.workunit.client.0.smithi077.stdout:4/657: mknod d3/dc/d24/ccf 0 2024-09-18T21:12:59.767 INFO:tasks.workunit.client.1.smithi103.stdout:3/727: rename d1/d9a/fc2 to d1/d64/fdd 0 2024-09-18T21:12:59.768 INFO:tasks.workunit.client.0.smithi077.stdout:0/784: dwrite d8/d1a/d39/d3b/d70/fcd [0,4194304] 0 2024-09-18T21:12:59.768 INFO:tasks.workunit.client.0.smithi077.stdout:4/658: truncate d3/d7/f70 1161725 0 2024-09-18T21:12:59.770 INFO:tasks.workunit.client.1.smithi103.stdout:0/703: dwrite d1/d5/de/d24/f38 [0,4194304] 0 2024-09-18T21:12:59.771 INFO:tasks.workunit.client.0.smithi077.stdout:0/785: dread - d8/d37/d95/dab/ffc zero size 2024-09-18T21:12:59.771 INFO:tasks.workunit.client.0.smithi077.stdout:8/675: symlink d2/d5f/lf5 0 2024-09-18T21:12:59.773 INFO:tasks.workunit.client.0.smithi077.stdout:5/781: rename d0/d6/dd/c61 to d0/df/d10/de1/c104 0 2024-09-18T21:12:59.775 INFO:tasks.workunit.client.1.smithi103.stdout:7/743: sync 2024-09-18T21:12:59.778 INFO:tasks.workunit.client.1.smithi103.stdout:1/733: creat d0/d2/d9/d9e/d7a/dd0/df9/d68/d81/da2/da4/dc2/dd8/dae/fff x:0 0 0 2024-09-18T21:12:59.778 INFO:tasks.workunit.client.0.smithi077.stdout:9/645: link d1/dd/d1a/l73 d1/dd/d11/ldb 0 2024-09-18T21:12:59.780 INFO:tasks.workunit.client.1.smithi103.stdout:3/728: write d1/d23/d25/f4c [1205992,57661] 0 2024-09-18T21:12:59.781 INFO:tasks.workunit.client.1.smithi103.stdout:9/806: write d18/d52/f54 [1028436,30896] 0 2024-09-18T21:12:59.782 INFO:tasks.workunit.client.1.smithi103.stdout:4/843: dread d9/d38/d72/df0/d83/db6/d21/d80/f97 [0,4194304] 0 2024-09-18T21:12:59.782 INFO:tasks.workunit.client.1.smithi103.stdout:0/704: mknod d1/d5/de/dc0/d8c/dce/d9f/d8d/da7/cfe 0 2024-09-18T21:12:59.782 INFO:tasks.workunit.client.0.smithi077.stdout:3/662: symlink db/d14/d32/lcd 0 2024-09-18T21:12:59.783 INFO:tasks.workunit.client.1.smithi103.stdout:2/683: dread d3/f20 [0,4194304] 0 2024-09-18T21:12:59.784 INFO:tasks.workunit.client.1.smithi103.stdout:2/684: dread - d3/d5/d2f/f7c zero size 2024-09-18T21:12:59.785 INFO:tasks.workunit.client.0.smithi077.stdout:4/659: creat d3/d7/fd0 x:0 0 0 2024-09-18T21:12:59.786 INFO:tasks.workunit.client.1.smithi103.stdout:4/844: dread d9/d38/d72/df0/d61/d91/fd3 [0,4194304] 0 2024-09-18T21:12:59.788 INFO:tasks.workunit.client.0.smithi077.stdout:8/676: rmdir d2/d27/d29/d41 39 2024-09-18T21:12:59.790 INFO:tasks.workunit.client.0.smithi077.stdout:7/742: truncate d12/d56/da1/db6/dbd/fd9 3359254 0 2024-09-18T21:12:59.793 INFO:tasks.workunit.client.1.smithi103.stdout:9/807: rename d18/d52/d6f/l86 to d18/d29/d68/d92/dd1/l10b 0 2024-09-18T21:12:59.794 INFO:tasks.workunit.client.1.smithi103.stdout:9/808: write d18/d8d/f100 [70359,59533] 0 2024-09-18T21:12:59.795 INFO:tasks.workunit.client.0.smithi077.stdout:9/646: fsync d1/dd/d11/d1c/f31 0 2024-09-18T21:12:59.798 INFO:tasks.workunit.client.1.smithi103.stdout:5/804: dwrite de/d2d/d7f/f4c [0,4194304] 0 2024-09-18T21:12:59.799 INFO:tasks.workunit.client.0.smithi077.stdout:1/696: write d3/d8/d13/f26 [4868903,122616] 0 2024-09-18T21:12:59.800 INFO:tasks.workunit.client.0.smithi077.stdout:1/697: chown d3/d38/d97 232 1 2024-09-18T21:12:59.801 INFO:tasks.workunit.client.1.smithi103.stdout:4/845: rename d9/d38/d58/d113 to d9/d38/d72/df0/d83/db6/d41/d64/d118 0 2024-09-18T21:12:59.801 INFO:tasks.workunit.client.0.smithi077.stdout:4/660: creat d3/dc/d32/d45/fd1 x:0 0 0 2024-09-18T21:12:59.802 INFO:tasks.workunit.client.1.smithi103.stdout:4/846: write d9/d38/d72/df0/d61/f99 [466036,42165] 0 2024-09-18T21:12:59.804 INFO:tasks.workunit.client.1.smithi103.stdout:9/809: fdatasync d18/d52/d6f/d8e/fa0 0 2024-09-18T21:12:59.805 INFO:tasks.workunit.client.0.smithi077.stdout:0/786: symlink d8/d37/d66/d87/de0/dce/lff 0 2024-09-18T21:12:59.805 INFO:tasks.workunit.client.1.smithi103.stdout:9/810: fsync d18/d29/d68/fb1 0 2024-09-18T21:12:59.805 INFO:tasks.workunit.client.1.smithi103.stdout:4/847: chown d9/d38/d72/df0/d61/d91/d9e/d48/cfe 247 1 2024-09-18T21:12:59.809 INFO:tasks.workunit.client.0.smithi077.stdout:9/647: creat d1/d54/d27/fdc x:0 0 0 2024-09-18T21:12:59.810 INFO:tasks.workunit.client.0.smithi077.stdout:6/658: link d7/d7e/d11/d3e/d42/d88/da4/l5e d7/d7e/da6/de1/le3 0 2024-09-18T21:12:59.810 INFO:tasks.workunit.client.0.smithi077.stdout:6/659: readlink l1 0 2024-09-18T21:12:59.812 INFO:tasks.workunit.client.0.smithi077.stdout:7/743: dread d12/d31/d77/d93/d2a/d6c/f96 [0,4194304] 0 2024-09-18T21:12:59.813 INFO:tasks.workunit.client.0.smithi077.stdout:8/677: mkdir d2/d27/d29/d41/dbc/dce/df6 0 2024-09-18T21:12:59.814 INFO:tasks.workunit.client.1.smithi103.stdout:4/848: dwrite d9/d38/d72/df0/d61/d91/d9e/d48/f7e [0,4194304] 0 2024-09-18T21:12:59.814 INFO:tasks.workunit.client.0.smithi077.stdout:1/698: readlink d3/d8/d49/lc8 0 2024-09-18T21:12:59.817 INFO:tasks.workunit.client.1.smithi103.stdout:0/705: dread d1/d5/de/dc0/d8c/dce/d9f/f46 [0,4194304] 0 2024-09-18T21:12:59.819 INFO:tasks.workunit.client.0.smithi077.stdout:7/744: unlink d12/d22/daa/dc0/fee 0 2024-09-18T21:12:59.821 INFO:tasks.workunit.client.0.smithi077.stdout:7/745: dread - d12/d22/d59/d72/f80 zero size 2024-09-18T21:12:59.821 INFO:tasks.workunit.client.0.smithi077.stdout:8/678: dwrite d2/d27/d29/f58 [0,4194304] 0 2024-09-18T21:12:59.824 INFO:tasks.workunit.client.0.smithi077.stdout:5/782: getdents d0/d6/d3b/d64/d95 0 2024-09-18T21:12:59.824 INFO:tasks.workunit.client.1.smithi103.stdout:4/849: dread d9/f6d [0,4194304] 0 2024-09-18T21:12:59.825 INFO:tasks.workunit.client.0.smithi077.stdout:5/783: chown d0/df/d10/d5c/d74/d89/l8e 503580 1 2024-09-18T21:12:59.825 INFO:tasks.workunit.client.1.smithi103.stdout:0/706: truncate d1/d9/d3e/fac 667031 0 2024-09-18T21:12:59.827 INFO:tasks.workunit.client.0.smithi077.stdout:9/648: symlink d1/dd/d11/d2d/dc6/ldd 0 2024-09-18T21:12:59.830 INFO:tasks.workunit.client.0.smithi077.stdout:1/699: rename d3/d38/dd5/le3 to d3/d8/d75/lf2 0 2024-09-18T21:12:59.831 INFO:tasks.workunit.client.0.smithi077.stdout:1/700: chown d3/d8/d75/d89/dbb 64 1 2024-09-18T21:12:59.832 INFO:tasks.workunit.client.1.smithi103.stdout:4/850: fdatasync d9/d38/d72/d85/dd8/f5c 0 2024-09-18T21:12:59.833 INFO:tasks.workunit.client.1.smithi103.stdout:0/707: symlink d1/d5/de/d22/d98/lff 0 2024-09-18T21:12:59.833 INFO:tasks.workunit.client.1.smithi103.stdout:4/851: fdatasync d9/d38/d72/df0/d83/db6/d41/fe6 0 2024-09-18T21:12:59.836 INFO:tasks.workunit.client.0.smithi077.stdout:1/701: dwrite d3/d8/d93/dd3/f4d [0,4194304] 0 2024-09-18T21:12:59.843 INFO:tasks.workunit.client.1.smithi103.stdout:6/766: sync 2024-09-18T21:12:59.843 INFO:tasks.workunit.client.1.smithi103.stdout:8/846: sync 2024-09-18T21:12:59.848 INFO:tasks.workunit.client.0.smithi077.stdout:7/746: mknod d12/cfd 0 2024-09-18T21:12:59.852 INFO:tasks.workunit.client.0.smithi077.stdout:3/663: dwrite db/d14/d22/f2f [0,4194304] 0 2024-09-18T21:12:59.854 INFO:tasks.workunit.client.1.smithi103.stdout:5/805: write de/d1f/f86 [2927584,101581] 0 2024-09-18T21:12:59.855 INFO:tasks.workunit.client.0.smithi077.stdout:9/649: fsync d1/d54/d81/f8b 0 2024-09-18T21:12:59.857 INFO:tasks.workunit.client.1.smithi103.stdout:8/847: dread d4/d98/fbd [0,4194304] 0 2024-09-18T21:12:59.857 INFO:tasks.workunit.client.0.smithi077.stdout:7/747: mkdir d12/d31/d77/d93/d89/dfe 0 2024-09-18T21:12:59.865 INFO:tasks.workunit.client.0.smithi077.stdout:4/661: dwrite d3/dc/f47 [0,4194304] 0 2024-09-18T21:12:59.865 INFO:tasks.workunit.client.1.smithi103.stdout:8/848: dwrite d4/de/de3/f10c [0,4194304] 0 2024-09-18T21:12:59.867 INFO:tasks.workunit.client.0.smithi077.stdout:6/660: dwrite d7/d7e/d11/d3e/d42/d88/f90 [0,4194304] 0 2024-09-18T21:12:59.870 INFO:tasks.workunit.client.0.smithi077.stdout:9/650: creat d1/dd/d11/d1c/d38/d46/d55/d7f/fde x:0 0 0 2024-09-18T21:12:59.871 INFO:tasks.workunit.client.0.smithi077.stdout:6/661: dread - d7/d7e/d11/d3e/d42/d88/fbd zero size 2024-09-18T21:12:59.874 INFO:tasks.workunit.client.1.smithi103.stdout:6/767: getdents d2/d3/d8 0 2024-09-18T21:12:59.874 INFO:tasks.workunit.client.0.smithi077.stdout:1/702: creat d3/d8/d93/dd3/ff3 x:0 0 0 2024-09-18T21:12:59.875 INFO:tasks.workunit.client.1.smithi103.stdout:6/768: chown d2/d3/f48 9 1 2024-09-18T21:12:59.879 INFO:tasks.workunit.client.1.smithi103.stdout:8/849: mknod d4/d81/c10f 0 2024-09-18T21:12:59.880 INFO:tasks.workunit.client.0.smithi077.stdout:5/784: write d0/df/d10/f7 [4892018,51944] 0 2024-09-18T21:12:59.882 INFO:tasks.workunit.client.0.smithi077.stdout:8/679: getdents d2/d5f/da8/d20 0 2024-09-18T21:12:59.882 INFO:tasks.workunit.client.1.smithi103.stdout:8/850: read d4/d81/d71/d7f/ff0 [259881,32329] 0 2024-09-18T21:12:59.884 INFO:tasks.workunit.client.1.smithi103.stdout:5/806: getdents de/d1f/d3b/d58/dc4/d33/d4f 0 2024-09-18T21:12:59.886 INFO:tasks.workunit.client.1.smithi103.stdout:6/769: rename d2/d3/d8/d4c/d79/f82 to d2/d3/d7f/d91/de5/ff1 0 2024-09-18T21:12:59.887 INFO:tasks.workunit.client.1.smithi103.stdout:5/807: dread - de/d3e/d15/f9e zero size 2024-09-18T21:12:59.888 INFO:tasks.workunit.client.0.smithi077.stdout:6/662: readlink d7/d7e/d11/d3e/l4a 0 2024-09-18T21:12:59.889 INFO:tasks.workunit.client.1.smithi103.stdout:0/708: dwrite d1/f36 [0,4194304] 0 2024-09-18T21:12:59.889 INFO:tasks.workunit.client.1.smithi103.stdout:8/851: fdatasync d4/d26/d56/d77/d9f/fa6 0 2024-09-18T21:12:59.890 INFO:tasks.workunit.client.1.smithi103.stdout:6/770: dread - d2/d3/d8/d4c/d7d/fea zero size 2024-09-18T21:12:59.891 INFO:tasks.workunit.client.1.smithi103.stdout:0/709: stat d1/d5/de/dc0/db0/ccb 0 2024-09-18T21:12:59.891 INFO:tasks.workunit.client.0.smithi077.stdout:3/664: unlink db/d14/d32/d49/da4/d8a/d99/fa1 0 2024-09-18T21:12:59.892 INFO:tasks.workunit.client.1.smithi103.stdout:5/808: dread - de/d1f/d3b/db4/ff3 zero size 2024-09-18T21:12:59.895 INFO:tasks.workunit.client.0.smithi077.stdout:9/651: link d1/dd/f94 d1/dd/d1a/fdf 0 2024-09-18T21:12:59.895 INFO:tasks.workunit.client.0.smithi077.stdout:1/703: symlink d3/d38/dd5/da5/lf4 0 2024-09-18T21:12:59.896 INFO:tasks.workunit.client.0.smithi077.stdout:6/663: creat d7/d7e/d11/d3e/d42/d88/fe4 x:0 0 0 2024-09-18T21:12:59.898 INFO:tasks.workunit.client.0.smithi077.stdout:3/665: truncate db/f28 427603 0 2024-09-18T21:12:59.898 INFO:tasks.workunit.client.0.smithi077.stdout:5/785: truncate d0/df/d3d/f9a 647120 0 2024-09-18T21:12:59.900 INFO:tasks.workunit.client.0.smithi077.stdout:4/662: rename d3/dc/d51/d53/d66 to d3/dd2 0 2024-09-18T21:12:59.900 INFO:tasks.workunit.client.0.smithi077.stdout:9/652: symlink d1/dd/d11/d2d/d79/le0 0 2024-09-18T21:12:59.901 INFO:tasks.workunit.client.0.smithi077.stdout:1/704: creat d3/d8/d93/dd3/dc1/ff5 x:0 0 0 2024-09-18T21:12:59.901 INFO:tasks.workunit.client.0.smithi077.stdout:6/664: rmdir d7/d7e/d11/d3e/d42/dbb/d49/d96 39 2024-09-18T21:12:59.902 INFO:tasks.workunit.client.0.smithi077.stdout:9/653: chown d1/d54/d51/fa4 105388772 1 2024-09-18T21:12:59.903 INFO:tasks.workunit.client.0.smithi077.stdout:4/663: read d3/d7/d7b/d88/f8d [574932,92202] 0 2024-09-18T21:12:59.905 INFO:tasks.workunit.client.0.smithi077.stdout:1/705: mkdir d3/d38/d97/dea/df6 0 2024-09-18T21:12:59.906 INFO:tasks.workunit.client.0.smithi077.stdout:9/654: mkdir d1/dd/d11/d2d/d59/de1 0 2024-09-18T21:12:59.908 INFO:tasks.workunit.client.0.smithi077.stdout:9/655: chown d1/d54/fbe 52 1 2024-09-18T21:12:59.908 INFO:tasks.workunit.client.0.smithi077.stdout:3/666: rename db/d14/c1b to db/d14/cce 0 2024-09-18T21:12:59.909 INFO:tasks.workunit.client.0.smithi077.stdout:6/665: rename d7/d7e/d11/d3e/d42/d88/da4/f5b to d7/d7e/d11/d3e/d42/dbb/d49/d55/dc2/fe5 0 2024-09-18T21:12:59.910 INFO:tasks.workunit.client.0.smithi077.stdout:4/664: dwrite d3/d7/d73/f96 [0,4194304] 0 2024-09-18T21:12:59.913 INFO:tasks.workunit.client.0.smithi077.stdout:6/666: symlink d7/le6 0 2024-09-18T21:12:59.914 INFO:tasks.workunit.client.0.smithi077.stdout:3/667: symlink db/d14/d32/d87/lcf 0 2024-09-18T21:12:59.915 INFO:tasks.workunit.client.0.smithi077.stdout:4/665: creat d3/dc/d32/fd3 x:0 0 0 2024-09-18T21:12:59.916 INFO:tasks.workunit.client.0.smithi077.stdout:3/668: symlink db/d14/d93/db6/ld0 0 2024-09-18T21:12:59.920 INFO:tasks.workunit.client.0.smithi077.stdout:7/748: write d12/d31/f61 [4999805,120155] 0 2024-09-18T21:12:59.923 INFO:tasks.workunit.client.0.smithi077.stdout:7/749: truncate d12/d22/d59/d72/fbb 1808121 0 2024-09-18T21:12:59.925 INFO:tasks.workunit.client.0.smithi077.stdout:6/667: dwrite d7/d7e/d11/d3e/d42/dbb/d31/fb4 [0,4194304] 0 2024-09-18T21:12:59.926 INFO:tasks.workunit.client.0.smithi077.stdout:9/656: dread d1/dd/f5a [0,4194304] 0 2024-09-18T21:12:59.928 INFO:tasks.workunit.client.0.smithi077.stdout:4/666: link d3/fb d3/dc/d51/d53/fd4 0 2024-09-18T21:12:59.929 INFO:tasks.workunit.client.0.smithi077.stdout:7/750: chown d12/d31/d77/d93/l92 57973 1 2024-09-18T21:12:59.939 INFO:tasks.workunit.client.0.smithi077.stdout:4/667: dwrite d3/dc/d51/fa4 [0,4194304] 0 2024-09-18T21:12:59.939 INFO:tasks.workunit.client.1.smithi103.stdout:8/852: creat d4/de/de3/f110 x:0 0 0 2024-09-18T21:12:59.939 INFO:tasks.workunit.client.1.smithi103.stdout:4/852: dwrite d9/d38/d72/df0/d61/fa1 [0,4194304] 0 2024-09-18T21:12:59.941 INFO:tasks.workunit.client.0.smithi077.stdout:7/751: dwrite d12/d22/f65 [0,4194304] 0 2024-09-18T21:12:59.942 INFO:tasks.workunit.client.1.smithi103.stdout:8/853: fsync d4/d2d/d87/dbb/f106 0 2024-09-18T21:12:59.942 INFO:tasks.workunit.client.1.smithi103.stdout:3/729: dread d1/d2/d18/f29 [0,4194304] 0 2024-09-18T21:12:59.943 INFO:tasks.workunit.client.1.smithi103.stdout:6/771: creat d2/d24/d5a/d67/d76/ff2 x:0 0 0 2024-09-18T21:12:59.947 INFO:tasks.workunit.client.0.smithi077.stdout:3/669: write db/ff [2341698,18075] 0 2024-09-18T21:12:59.948 INFO:tasks.workunit.client.1.smithi103.stdout:4/853: truncate d9/d1c/f52 655129 0 2024-09-18T21:12:59.950 INFO:tasks.workunit.client.0.smithi077.stdout:3/670: chown db/d14/d72/cbb 29705697 1 2024-09-18T21:12:59.950 INFO:tasks.workunit.client.0.smithi077.stdout:7/752: symlink d12/d31/d77/d93/d89/d99/da9/lff 0 2024-09-18T21:12:59.952 INFO:tasks.workunit.client.1.smithi103.stdout:5/809: dread de/d1f/d3b/d51/d57/d59/fb3 [0,4194304] 0 2024-09-18T21:12:59.952 INFO:tasks.workunit.client.1.smithi103.stdout:3/730: dwrite d1/f13 [4194304,4194304] 0 2024-09-18T21:12:59.952 INFO:tasks.workunit.client.1.smithi103.stdout:0/710: mknod d1/d5/de/d19/d1e/c100 0 2024-09-18T21:12:59.953 INFO:tasks.workunit.client.0.smithi077.stdout:4/668: dwrite d3/d7/d6c/f90 [0,4194304] 0 2024-09-18T21:12:59.953 INFO:tasks.workunit.client.0.smithi077.stdout:3/671: dread db/f28 [0,4194304] 0 2024-09-18T21:12:59.955 INFO:tasks.workunit.client.0.smithi077.stdout:7/753: mkdir d12/d56/da1/ddf/d100 0 2024-09-18T21:12:59.955 INFO:tasks.workunit.client.0.smithi077.stdout:3/672: chown db/d14/d32/d49/da4/d8a 12953 1 2024-09-18T21:12:59.956 INFO:tasks.workunit.client.1.smithi103.stdout:3/731: truncate d1/d23/d25/d4f/d72/d85/d93/fc7 738616 0 2024-09-18T21:12:59.957 INFO:tasks.workunit.client.1.smithi103.stdout:3/732: fdatasync d1/f3c 0 2024-09-18T21:12:59.959 INFO:tasks.workunit.client.1.smithi103.stdout:0/711: rmdir d1/d5/de/dc0/d8c/dce/d9f 39 2024-09-18T21:12:59.960 INFO:tasks.workunit.client.1.smithi103.stdout:4/854: symlink d9/d1c/l119 0 2024-09-18T21:12:59.961 INFO:tasks.workunit.client.0.smithi077.stdout:6/668: dread d7/d7e/d11/d3e/d42/dbb/d50/fca [0,4194304] 0 2024-09-18T21:12:59.963 INFO:tasks.workunit.client.1.smithi103.stdout:3/733: rename d1/da/df/c1c to d1/d23/d25/d4f/d58/d86/cde 0 2024-09-18T21:12:59.964 INFO:tasks.workunit.client.1.smithi103.stdout:3/734: stat d1/d23/d25/d4f/dce/fd4 0 2024-09-18T21:12:59.966 INFO:tasks.workunit.client.1.smithi103.stdout:4/855: creat d9/d1c/f11a x:0 0 0 2024-09-18T21:12:59.967 INFO:tasks.workunit.client.1.smithi103.stdout:4/856: chown d9/f11 831 1 2024-09-18T21:12:59.967 INFO:tasks.workunit.client.1.smithi103.stdout:0/712: creat d1/d5/de/dc0/d8c/dce/f101 x:0 0 0 2024-09-18T21:12:59.970 INFO:tasks.workunit.client.0.smithi077.stdout:4/669: dwrite d3/dc/d51/d53/d89/fad [4194304,4194304] 0 2024-09-18T21:12:59.971 INFO:tasks.workunit.client.0.smithi077.stdout:6/669: rename d7/d7c to d7/d7e/d11/d3e/d42/d88/da4/de7 0 2024-09-18T21:12:59.972 INFO:tasks.workunit.client.0.smithi077.stdout:3/673: dread db/f54 [0,4194304] 0 2024-09-18T21:12:59.973 INFO:tasks.workunit.client.0.smithi077.stdout:4/670: fsync d3/dc/d32/d5b/f83 0 2024-09-18T21:12:59.974 INFO:tasks.workunit.client.1.smithi103.stdout:4/857: rename d9/d38/d72/df0/d83/db6/d41/f5f to d9/d38/d72/df0/d61/d91/daa/f11b 0 2024-09-18T21:12:59.974 INFO:tasks.workunit.client.0.smithi077.stdout:9/657: dread d1/dd/d11/d1c/d38/d46/f60 [0,4194304] 0 2024-09-18T21:12:59.979 INFO:tasks.workunit.client.1.smithi103.stdout:4/858: mknod d9/d38/d72/d94/c11c 0 2024-09-18T21:12:59.980 INFO:tasks.workunit.client.0.smithi077.stdout:6/670: fdatasync d7/d7e/d11/d3e/d42/d88/da4/f2b 0 2024-09-18T21:12:59.981 INFO:tasks.workunit.client.1.smithi103.stdout:0/713: getdents d1/d5/de/d19/d1e/d58 0 2024-09-18T21:12:59.981 INFO:tasks.workunit.client.0.smithi077.stdout:4/671: dwrite d3/dc/d20/fc9 [0,4194304] 0 2024-09-18T21:12:59.983 INFO:tasks.workunit.client.0.smithi077.stdout:4/672: chown d3/dc/d32/fc0 5 1 2024-09-18T21:12:59.984 INFO:tasks.workunit.client.1.smithi103.stdout:8/854: dwrite d4/d26/d56/d77/d9f/fbf [0,4194304] 0 2024-09-18T21:12:59.984 INFO:tasks.workunit.client.0.smithi077.stdout:9/658: creat d1/dd/d11/d1c/d38/d46/d55/d7f/fe2 x:0 0 0 2024-09-18T21:12:59.985 INFO:tasks.workunit.client.1.smithi103.stdout:4/859: rmdir d9/d38/d72/df0/d83/db6/d41/d64/d118 39 2024-09-18T21:12:59.987 INFO:tasks.workunit.client.1.smithi103.stdout:4/860: readlink d9/d1c/dcd/dd1/lee 0 2024-09-18T21:12:59.990 INFO:tasks.workunit.client.1.smithi103.stdout:8/855: rename d4/d2d/dc1/f10b to d4/d2d/d4e/f111 0 2024-09-18T21:12:59.992 INFO:tasks.workunit.client.1.smithi103.stdout:5/810: dwrite de/d1f/d3b/f61 [0,4194304] 0 2024-09-18T21:12:59.992 INFO:tasks.workunit.client.1.smithi103.stdout:0/714: mknod d1/d9/c102 0 2024-09-18T21:12:59.995 INFO:tasks.workunit.client.0.smithi077.stdout:9/659: rename d1/dd/d11/c5f to d1/dd/d11/d1c/d38/dae/ce3 0 2024-09-18T21:12:59.996 INFO:tasks.workunit.client.0.smithi077.stdout:6/671: unlink d7/d7e/d11/d3e/d42/dbb/l20 0 2024-09-18T21:12:59.997 INFO:tasks.workunit.client.0.smithi077.stdout:9/660: truncate d1/dd/d11/d15/d80/f8c 879531 0 2024-09-18T21:12:59.999 INFO:tasks.workunit.client.1.smithi103.stdout:3/735: dwrite d1/d2/d18/d30/f3f [0,4194304] 0 2024-09-18T21:12:59.999 INFO:tasks.workunit.client.1.smithi103.stdout:5/811: unlink de/d3e/d15/f8a 0 2024-09-18T21:13:00.000 INFO:tasks.workunit.client.1.smithi103.stdout:0/715: stat d1/d5/de/dc0/d8c/dce/d9f/fee 0 2024-09-18T21:13:00.001 INFO:tasks.workunit.client.0.smithi077.stdout:6/672: symlink d7/d7e/d11/d3e/d42/dbb/d49/d55/le8 0 2024-09-18T21:13:00.002 INFO:tasks.workunit.client.1.smithi103.stdout:3/736: creat d1/da/df/fdf x:0 0 0 2024-09-18T21:13:00.004 INFO:tasks.workunit.client.0.smithi077.stdout:6/673: dread - d7/d7e/d11/d3e/d42/dbb/f77 zero size 2024-09-18T21:13:00.005 INFO:tasks.workunit.client.1.smithi103.stdout:3/737: read d1/d2/f8 [2139097,42492] 0 2024-09-18T21:13:00.006 INFO:tasks.workunit.client.1.smithi103.stdout:3/738: fdatasync d1/d23/d25/d4f/dce/fd6 0 2024-09-18T21:13:00.006 INFO:tasks.workunit.client.1.smithi103.stdout:0/716: creat d1/d5/de/dc0/d8c/dce/d9f/d4f/f103 x:0 0 0 2024-09-18T21:13:00.007 INFO:tasks.workunit.client.1.smithi103.stdout:0/717: stat d1/f9b 0 2024-09-18T21:13:00.007 INFO:tasks.workunit.client.1.smithi103.stdout:0/718: dread - d1/daf/fdf zero size 2024-09-18T21:13:00.008 INFO:tasks.workunit.client.1.smithi103.stdout:5/812: creat de/d1f/d3b/db4/df2/f10c x:0 0 0 2024-09-18T21:13:00.008 INFO:tasks.workunit.client.1.smithi103.stdout:3/739: mknod d1/d9a/ce0 0 2024-09-18T21:13:00.010 INFO:tasks.workunit.client.1.smithi103.stdout:0/719: symlink d1/d93/l104 0 2024-09-18T21:13:00.012 INFO:tasks.workunit.client.0.smithi077.stdout:6/674: creat d7/d7e/d11/fe9 x:0 0 0 2024-09-18T21:13:00.012 INFO:tasks.workunit.client.1.smithi103.stdout:3/740: mknod d1/d23/d25/d4f/dc6/ce1 0 2024-09-18T21:13:00.012 INFO:tasks.workunit.client.1.smithi103.stdout:0/720: mkdir d1/d5/de/d24/d43/d76/dc5/d105 0 2024-09-18T21:13:00.015 INFO:tasks.workunit.client.1.smithi103.stdout:3/741: unlink d1/d23/d25/d4f/d72/d85/lad 0 2024-09-18T21:13:00.016 INFO:tasks.workunit.client.1.smithi103.stdout:3/742: fsync d1/d23/d25/d4f/d72/d85/fb3 0 2024-09-18T21:13:00.017 INFO:tasks.workunit.client.0.smithi077.stdout:6/675: dwrite d7/d7e/da6/fc5 [0,4194304] 0 2024-09-18T21:13:00.017 INFO:tasks.workunit.client.1.smithi103.stdout:3/743: stat d1/f31 0 2024-09-18T21:13:00.021 INFO:tasks.workunit.client.0.smithi077.stdout:6/676: symlink d7/d7e/d11/d3e/d42/dbb/d31/lea 0 2024-09-18T21:13:00.022 INFO:tasks.workunit.client.1.smithi103.stdout:3/744: mknod d1/d23/d25/d4f/d58/d68/ce2 0 2024-09-18T21:13:00.027 INFO:tasks.workunit.client.0.smithi077.stdout:3/674: truncate db/d14/d32/d49/fab 1611126 0 2024-09-18T21:13:00.028 INFO:tasks.workunit.client.0.smithi077.stdout:4/673: write d3/dc/d24/f8e [954236,27979] 0 2024-09-18T21:13:00.030 INFO:tasks.workunit.client.0.smithi077.stdout:3/675: symlink db/d14/ld1 0 2024-09-18T21:13:00.031 INFO:tasks.workunit.client.0.smithi077.stdout:3/676: chown db/d14/d72 106 1 2024-09-18T21:13:00.032 INFO:tasks.workunit.client.0.smithi077.stdout:4/674: chown d3/d77/d9c/db9/lbf 641394719 1 2024-09-18T21:13:00.033 INFO:tasks.workunit.client.0.smithi077.stdout:9/661: dread d1/dd/d1a/f1b [0,4194304] 0 2024-09-18T21:13:00.034 INFO:tasks.workunit.client.1.smithi103.stdout:0/721: dread d1/d5/de/d24/f32 [0,4194304] 0 2024-09-18T21:13:00.035 INFO:tasks.workunit.client.0.smithi077.stdout:4/675: dread d3/dc/d51/d53/f58 [0,4194304] 0 2024-09-18T21:13:00.036 INFO:tasks.workunit.client.1.smithi103.stdout:4/861: dwrite d9/d38/d72/df0/d61/d91/d9e/d48/f56 [0,4194304] 0 2024-09-18T21:13:00.038 INFO:tasks.workunit.client.1.smithi103.stdout:8/856: truncate d4/d81/dd7/dde/d59/d9c/de6/ff2 3687425 0 2024-09-18T21:13:00.040 INFO:tasks.workunit.client.0.smithi077.stdout:4/676: creat d3/dc/fd5 x:0 0 0 2024-09-18T21:13:00.042 INFO:tasks.workunit.client.0.smithi077.stdout:3/677: link db/c11 db/d14/d22/dae/cd2 0 2024-09-18T21:13:00.043 INFO:tasks.workunit.client.1.smithi103.stdout:8/857: unlink d4/d2d/d3d/da0/dab/de7/f4f 0 2024-09-18T21:13:00.043 INFO:tasks.workunit.client.1.smithi103.stdout:0/722: symlink d1/d5/de/d24/d43/l106 0 2024-09-18T21:13:00.044 INFO:tasks.workunit.client.0.smithi077.stdout:4/677: creat d3/d7/d6c/fd6 x:0 0 0 2024-09-18T21:13:00.045 INFO:tasks.workunit.client.0.smithi077.stdout:4/678: read - d3/dc/d24/fbb zero size 2024-09-18T21:13:00.046 INFO:tasks.workunit.client.1.smithi103.stdout:4/862: fdatasync d9/d38/f81 0 2024-09-18T21:13:00.047 INFO:tasks.workunit.client.1.smithi103.stdout:8/858: truncate d4/d81/dd7/dde/d59/d9c/f10a 990403 0 2024-09-18T21:13:00.047 INFO:tasks.workunit.client.0.smithi077.stdout:3/678: rename db/d14/cb8 to db/d14/d90/db2/cd3 0 2024-09-18T21:13:00.048 INFO:tasks.workunit.client.1.smithi103.stdout:5/813: dwrite de/d2d/fa5 [0,4194304] 0 2024-09-18T21:13:00.050 INFO:tasks.workunit.client.0.smithi077.stdout:3/679: read db/d14/d22/f58 [4430399,9529] 0 2024-09-18T21:13:00.051 INFO:tasks.workunit.client.0.smithi077.stdout:3/680: stat db/d14/d32/d49/da4/d8a/d99/fad 0 2024-09-18T21:13:00.053 INFO:tasks.workunit.client.0.smithi077.stdout:3/681: dread - db/d14/d32/d49/da4/d8a/d99/daf/fb0 zero size 2024-09-18T21:13:00.054 INFO:tasks.workunit.client.1.smithi103.stdout:8/859: mknod d4/d81/dd7/dde/d59/c112 0 2024-09-18T21:13:00.055 INFO:tasks.workunit.client.0.smithi077.stdout:9/662: write d1/dd/d11/d1c/f53 [524278,69400] 0 2024-09-18T21:13:00.055 INFO:tasks.workunit.client.1.smithi103.stdout:4/863: fsync d9/d38/d72/df0/d83/db6/d41/d64/fc5 0 2024-09-18T21:13:00.058 INFO:tasks.workunit.client.1.smithi103.stdout:5/814: unlink de/d1f/d3b/d58/dc4/d33/d4f/fcb 0 2024-09-18T21:13:00.060 INFO:tasks.workunit.client.0.smithi077.stdout:9/663: mknod d1/d54/d51/ce4 0 2024-09-18T21:13:00.060 INFO:tasks.workunit.client.1.smithi103.stdout:3/745: dwrite d1/d2/d18/f2f [0,4194304] 0 2024-09-18T21:13:00.062 INFO:tasks.workunit.client.1.smithi103.stdout:8/860: creat d4/d2d/d87/dbb/f113 x:0 0 0 2024-09-18T21:13:00.062 INFO:tasks.workunit.client.0.smithi077.stdout:3/682: link db/d14/d32/d49/da4/d8a/d99/fa9 db/d14/d93/fd4 0 2024-09-18T21:13:00.062 INFO:tasks.workunit.client.1.smithi103.stdout:8/861: readlink d4/de/la5 0 2024-09-18T21:13:00.063 INFO:tasks.workunit.client.1.smithi103.stdout:3/746: truncate d1/d23/d25/da1/fbe 347881 0 2024-09-18T21:13:00.064 INFO:tasks.workunit.client.0.smithi077.stdout:9/664: rmdir d1/d54/d81/d92 39 2024-09-18T21:13:00.064 INFO:tasks.workunit.client.1.smithi103.stdout:3/747: stat d1/d23/d47/fb6 0 2024-09-18T21:13:00.066 INFO:tasks.workunit.client.1.smithi103.stdout:5/815: mknod de/d1f/d3b/db4/df2/c10d 0 2024-09-18T21:13:00.066 INFO:tasks.workunit.client.1.smithi103.stdout:3/748: dread - d1/d23/d25/d4f/dce/fd6 zero size 2024-09-18T21:13:00.067 INFO:tasks.workunit.client.0.smithi077.stdout:3/683: rename l6 to db/d14/d32/d49/d4e/ld5 0 2024-09-18T21:13:00.068 INFO:tasks.workunit.client.0.smithi077.stdout:4/679: write d3/dc/d51/d53/fd4 [2206190,73818] 0 2024-09-18T21:13:00.070 INFO:tasks.workunit.client.0.smithi077.stdout:4/680: stat d3/d77/d9c/db9/lbf 0 2024-09-18T21:13:00.073 INFO:tasks.workunit.client.1.smithi103.stdout:3/749: mknod d1/d23/d25/d4f/d58/d68/d50/d54/d8c/ce3 0 2024-09-18T21:13:00.075 INFO:tasks.workunit.client.0.smithi077.stdout:9/665: rename d1/d54/d81/d92/cb7 to d1/dd/d11/d1c/d38/d46/ce5 0 2024-09-18T21:13:00.075 INFO:tasks.workunit.client.0.smithi077.stdout:3/684: dwrite db/d14/d22/d36/f73 [4194304,4194304] 0 2024-09-18T21:13:00.076 INFO:tasks.workunit.client.1.smithi103.stdout:8/862: dwrite d4/d98/fbd [0,4194304] 0 2024-09-18T21:13:00.079 INFO:tasks.workunit.client.1.smithi103.stdout:0/723: dwrite d1/d5/de/d22/d6a/f91 [0,4194304] 0 2024-09-18T21:13:00.082 INFO:tasks.workunit.client.1.smithi103.stdout:3/750: unlink d1/d23/d47/dbb/f5d 0 2024-09-18T21:13:00.083 INFO:tasks.workunit.client.1.smithi103.stdout:4/864: dread d9/fc [0,4194304] 0 2024-09-18T21:13:00.084 INFO:tasks.workunit.client.0.smithi077.stdout:3/685: creat db/d14/d32/d49/d4e/d6a/fd6 x:0 0 0 2024-09-18T21:13:00.088 INFO:tasks.workunit.client.1.smithi103.stdout:5/816: write de/d1f/f23 [3317772,97724] 0 2024-09-18T21:13:00.091 INFO:tasks.workunit.client.1.smithi103.stdout:7/744: sync 2024-09-18T21:13:00.091 INFO:tasks.workunit.client.1.smithi103.stdout:1/734: sync 2024-09-18T21:13:00.091 INFO:tasks.workunit.client.1.smithi103.stdout:3/751: symlink d1/le4 0 2024-09-18T21:13:00.092 INFO:tasks.workunit.client.1.smithi103.stdout:0/724: creat d1/d5/de/d24/d43/dfd/f107 x:0 0 0 2024-09-18T21:13:00.092 INFO:tasks.workunit.client.0.smithi077.stdout:3/686: creat db/fd7 x:0 0 0 2024-09-18T21:13:00.093 INFO:tasks.workunit.client.1.smithi103.stdout:5/817: chown de/d1f/d3b/d51/d57/cb9 2 1 2024-09-18T21:13:00.093 INFO:tasks.workunit.client.1.smithi103.stdout:4/865: dwrite d9/d38/d58/f93 [0,4194304] 0 2024-09-18T21:13:00.093 INFO:tasks.workunit.client.1.smithi103.stdout:7/745: chown d1/df/d42/d29/d48/dbb 2 1 2024-09-18T21:13:00.094 INFO:tasks.workunit.client.0.smithi077.stdout:4/681: write d3/dc/d24/f43 [3686307,66661] 0 2024-09-18T21:13:00.095 INFO:tasks.workunit.client.0.smithi077.stdout:3/687: mknod db/d14/d93/db6/cd8 0 2024-09-18T21:13:00.099 INFO:tasks.workunit.client.1.smithi103.stdout:0/725: chown d1/d5/de/f6f 2476 1 2024-09-18T21:13:00.099 INFO:tasks.workunit.client.0.smithi077.stdout:2/802: sync 2024-09-18T21:13:00.099 INFO:tasks.workunit.client.0.smithi077.stdout:4/682: fsync d3/dc/d51/f80 0 2024-09-18T21:13:00.100 INFO:tasks.workunit.client.1.smithi103.stdout:4/866: fsync d9/d1c/d77/f3d 0 2024-09-18T21:13:00.102 INFO:tasks.workunit.client.1.smithi103.stdout:1/735: creat d0/d2/d9/d9e/d7a/dd0/df9/d68/f100 x:0 0 0 2024-09-18T21:13:00.105 INFO:tasks.workunit.client.1.smithi103.stdout:1/736: truncate d0/d2/d9/d9e/d7a/dd0/df9/d68/d81/faa 674788 0 2024-09-18T21:13:00.105 INFO:tasks.workunit.client.1.smithi103.stdout:5/818: rename de/d3e/d15/f9e to de/d1f/d3b/d58/dc4/d7e/f10e 0 2024-09-18T21:13:00.107 INFO:tasks.workunit.client.0.smithi077.stdout:4/683: rename d3/d7/d42/fb3 to d3/dc/d51/fd7 0 2024-09-18T21:13:00.108 INFO:tasks.workunit.client.0.smithi077.stdout:4/684: write d3/dc/d20/f97 [1861269,113926] 0 2024-09-18T21:13:00.108 INFO:tasks.workunit.client.0.smithi077.stdout:2/803: mkdir d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d83/dba/ddc/d116 0 2024-09-18T21:13:00.112 INFO:tasks.workunit.client.0.smithi077.stdout:3/688: getdents db/d14/d32/d49/da4/d8a 0 2024-09-18T21:13:00.113 INFO:tasks.workunit.client.0.smithi077.stdout:2/804: mknod d1/d4/d5/d1a/d113/c117 0 2024-09-18T21:13:00.113 INFO:tasks.workunit.client.1.smithi103.stdout:4/867: dread d9/d1c/f52 [0,4194304] 0 2024-09-18T21:13:00.114 INFO:tasks.workunit.client.0.smithi077.stdout:9/666: write d1/dd/d1a/d42/f89 [1450927,80424] 0 2024-09-18T21:13:00.115 INFO:tasks.workunit.client.1.smithi103.stdout:8/863: dread d4/de/f1c [0,4194304] 0 2024-09-18T21:13:00.117 INFO:tasks.workunit.client.1.smithi103.stdout:7/746: getdents d1/df/d43/d61 0 2024-09-18T21:13:00.120 INFO:tasks.workunit.client.0.smithi077.stdout:9/667: mknod d1/dd/d11/d1c/d38/d46/ce6 0 2024-09-18T21:13:00.121 INFO:tasks.workunit.client.0.smithi077.stdout:9/668: chown d1/dd/d11/d2d/f32 919 1 2024-09-18T21:13:00.123 INFO:tasks.workunit.client.0.smithi077.stdout:2/805: creat d1/d4/d5/f118 x:0 0 0 2024-09-18T21:13:00.124 INFO:tasks.workunit.client.0.smithi077.stdout:9/669: rmdir d1/d54 39 2024-09-18T21:13:00.126 INFO:tasks.workunit.client.0.smithi077.stdout:2/806: fdatasync d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d8e/f55 0 2024-09-18T21:13:00.126 INFO:tasks.workunit.client.0.smithi077.stdout:9/670: dread - d1/dd/d11/d1c/d38/d46/d55/d7f/fde zero size 2024-09-18T21:13:00.126 INFO:tasks.workunit.client.1.smithi103.stdout:7/747: dwrite d1/df/d42/d29/d48/dbb/d33/fae [0,4194304] 0 2024-09-18T21:13:00.128 INFO:tasks.workunit.client.1.smithi103.stdout:7/748: chown d1/df/d42/d29/faa 1 1 2024-09-18T21:13:00.128 INFO:tasks.workunit.client.1.smithi103.stdout:6/772: sync 2024-09-18T21:13:00.129 INFO:tasks.workunit.client.1.smithi103.stdout:2/685: sync 2024-09-18T21:13:00.129 INFO:tasks.workunit.client.1.smithi103.stdout:9/811: sync 2024-09-18T21:13:00.130 INFO:tasks.workunit.client.0.smithi077.stdout:9/671: mknod d1/d54/ce7 0 2024-09-18T21:13:00.131 INFO:tasks.workunit.client.0.smithi077.stdout:9/672: dread - d1/d54/fcf zero size 2024-09-18T21:13:00.131 INFO:tasks.workunit.client.0.smithi077.stdout:3/689: write db/d14/d93/f96 [4494506,565] 0 2024-09-18T21:13:00.131 INFO:tasks.workunit.client.1.smithi103.stdout:1/737: write d0/f9d [961398,45913] 0 2024-09-18T21:13:00.132 INFO:tasks.workunit.client.1.smithi103.stdout:6/773: symlink d2/d24/d38/lf3 0 2024-09-18T21:13:00.133 INFO:tasks.workunit.client.1.smithi103.stdout:5/819: truncate de/d3e/d15/fa8 2077298 0 2024-09-18T21:13:00.135 INFO:tasks.workunit.client.0.smithi077.stdout:3/690: mkdir db/d14/d22/d36/dd9 0 2024-09-18T21:13:00.135 INFO:tasks.workunit.client.1.smithi103.stdout:4/868: dread d9/d38/d72/df0/d83/db6/d21/f63 [0,4194304] 0 2024-09-18T21:13:00.136 INFO:tasks.workunit.client.1.smithi103.stdout:3/752: dread d1/d2/f8 [0,4194304] 0 2024-09-18T21:13:00.139 INFO:tasks.workunit.client.0.smithi077.stdout:9/673: dwrite d1/f49 [0,4194304] 0 2024-09-18T21:13:00.139 INFO:tasks.workunit.client.0.smithi077.stdout:3/691: symlink db/d14/d22/d36/dd9/lda 0 2024-09-18T21:13:00.140 INFO:tasks.workunit.client.1.smithi103.stdout:7/749: mknod d1/df/d42/d29/d48/dbb/d33/d51/cef 0 2024-09-18T21:13:00.141 INFO:tasks.workunit.client.0.smithi077.stdout:3/692: chown db/d14/f34 52 1 2024-09-18T21:13:00.142 INFO:tasks.workunit.client.0.smithi077.stdout:3/693: chown db/d14/d93/la5 4499 1 2024-09-18T21:13:00.142 INFO:tasks.workunit.client.1.smithi103.stdout:6/774: write d2/f22 [28694,73196] 0 2024-09-18T21:13:00.142 INFO:tasks.workunit.client.0.smithi077.stdout:3/694: dread - db/d14/d22/d36/d39/d50/fc1 zero size 2024-09-18T21:13:00.144 INFO:tasks.workunit.client.1.smithi103.stdout:0/726: dwrite d1/d5/de/dc0/dbf/d4e/f66 [0,4194304] 0 2024-09-18T21:13:00.145 INFO:tasks.workunit.client.1.smithi103.stdout:8/864: dread d4/de/f43 [0,4194304] 0 2024-09-18T21:13:00.146 INFO:tasks.workunit.client.0.smithi077.stdout:9/674: mkdir d1/dd/d57/de8 0 2024-09-18T21:13:00.148 INFO:tasks.workunit.client.0.smithi077.stdout:3/695: symlink db/d14/d93/db6/ldb 0 2024-09-18T21:13:00.149 INFO:tasks.workunit.client.1.smithi103.stdout:0/727: chown d1/d5/de/d19/f7c 385076 1 2024-09-18T21:13:00.149 INFO:tasks.workunit.client.0.smithi077.stdout:3/696: readlink db/d14/d93/db6/ldb 0 2024-09-18T21:13:00.150 INFO:tasks.workunit.client.1.smithi103.stdout:2/686: write d3/d5/d2c/d54/d68/fbe [775749,50008] 0 2024-09-18T21:13:00.153 INFO:tasks.workunit.client.1.smithi103.stdout:3/753: creat d1/d64/fe5 x:0 0 0 2024-09-18T21:13:00.156 INFO:tasks.workunit.client.1.smithi103.stdout:4/869: mknod d9/d1c/c11d 0 2024-09-18T21:13:00.157 INFO:tasks.workunit.client.1.smithi103.stdout:7/750: mknod d1/df/d42/d29/d48/ddb/cf0 0 2024-09-18T21:13:00.158 INFO:tasks.workunit.client.1.smithi103.stdout:6/775: mknod d2/d3/d8/de1/cf4 0 2024-09-18T21:13:00.160 INFO:tasks.workunit.client.1.smithi103.stdout:1/738: dwrite d0/d2/d9/d9e/d7a/fea [0,4194304] 0 2024-09-18T21:13:00.161 INFO:tasks.workunit.client.0.smithi077.stdout:3/697: dread db/d14/d22/f9d [0,4194304] 0 2024-09-18T21:13:00.163 INFO:tasks.workunit.client.1.smithi103.stdout:8/865: link d4/d2d/d3d/da0/dab/de7/c3c d4/de/de3/d107/c114 0 2024-09-18T21:13:00.165 INFO:tasks.workunit.client.1.smithi103.stdout:0/728: dread d1/d5/de/dc0/d8c/dce/d9f/f46 [0,4194304] 0 2024-09-18T21:13:00.166 INFO:tasks.workunit.client.1.smithi103.stdout:8/866: write d4/d98/fcf [1193442,94639] 0 2024-09-18T21:13:00.167 INFO:tasks.workunit.client.0.smithi077.stdout:3/698: unlink db/d14/d32/d49/da4/d8a/d99/fad 0 2024-09-18T21:13:00.167 INFO:tasks.workunit.client.0.smithi077.stdout:3/699: stat db/fd7 0 2024-09-18T21:13:00.168 INFO:tasks.workunit.client.1.smithi103.stdout:0/729: fsync d1/daf/fdf 0 2024-09-18T21:13:00.169 INFO:tasks.workunit.client.1.smithi103.stdout:1/739: write d0/d2/d9/d9e/d7a/dd0/df9/d68/d81/da2/da4/dc2/fcc [993556,68108] 0 2024-09-18T21:13:00.172 INFO:tasks.workunit.client.0.smithi077.stdout:9/675: truncate d1/dd/f14 1652686 0 2024-09-18T21:13:00.173 INFO:tasks.workunit.client.1.smithi103.stdout:5/820: dwrite de/d3e/f29 [4194304,4194304] 0 2024-09-18T21:13:00.176 INFO:tasks.workunit.client.1.smithi103.stdout:4/870: symlink d9/d38/d72/df0/d61/d91/l11e 0 2024-09-18T21:13:00.176 INFO:tasks.workunit.client.0.smithi077.stdout:9/676: mkdir d1/dd/d11/d15/d80/d85/de9 0 2024-09-18T21:13:00.180 INFO:tasks.workunit.client.1.smithi103.stdout:7/751: dwrite d1/df/d42/f45 [0,4194304] 0 2024-09-18T21:13:00.183 INFO:tasks.workunit.client.1.smithi103.stdout:2/687: truncate d3/d5/d2f/d32/d46/fb4 953954 0 2024-09-18T21:13:00.185 INFO:tasks.workunit.client.0.smithi077.stdout:9/677: truncate d1/dd/d1a/fdf 2476239 0 2024-09-18T21:13:00.185 INFO:tasks.workunit.client.0.smithi077.stdout:3/700: write db/f28 [1468687,31526] 0 2024-09-18T21:13:00.188 INFO:tasks.workunit.client.1.smithi103.stdout:3/754: dread d1/d23/d25/d4f/d72/d85/fb3 [0,4194304] 0 2024-09-18T21:13:00.188 INFO:tasks.workunit.client.0.smithi077.stdout:9/678: mkdir d1/dd/d11/d15/d80/dea 0 2024-09-18T21:13:00.190 INFO:tasks.workunit.client.1.smithi103.stdout:7/752: mkdir d1/df/d42/d1f/d5d/dbe/df1 0 2024-09-18T21:13:00.190 INFO:tasks.workunit.client.0.smithi077.stdout:3/701: truncate db/d14/d32/d49/d4e/d6a/f5d 1181899 0 2024-09-18T21:13:00.191 INFO:tasks.workunit.client.1.smithi103.stdout:1/740: mknod d0/d2/d9/dc/c101 0 2024-09-18T21:13:00.192 INFO:tasks.workunit.client.1.smithi103.stdout:7/753: chown d1/df/d43/d52/lcd 238 1 2024-09-18T21:13:00.193 INFO:tasks.workunit.client.1.smithi103.stdout:2/688: mknod d3/db3/cf6 0 2024-09-18T21:13:00.193 INFO:tasks.workunit.client.1.smithi103.stdout:6/776: link d2/d24/l35 d2/d3/d7f/lf5 0 2024-09-18T21:13:00.195 INFO:tasks.workunit.client.1.smithi103.stdout:1/741: rmdir d0/d2/d9/dc/d36 39 2024-09-18T21:13:00.197 INFO:tasks.workunit.client.1.smithi103.stdout:7/754: creat d1/df/d42/d1f/ff2 x:0 0 0 2024-09-18T21:13:00.197 INFO:tasks.workunit.client.1.smithi103.stdout:2/689: dread - d3/d5/d2f/d48/dab/fad zero size 2024-09-18T21:13:00.198 INFO:tasks.workunit.client.1.smithi103.stdout:8/867: link d4/d81/c10f d4/d2d/dc1/dee/d105/c115 0 2024-09-18T21:13:00.199 INFO:tasks.workunit.client.1.smithi103.stdout:3/755: getdents d1/d23/d25/dcf 0 2024-09-18T21:13:00.200 INFO:tasks.workunit.client.1.smithi103.stdout:7/755: read d1/df/d42/f45 [6177155,28143] 0 2024-09-18T21:13:00.203 INFO:tasks.workunit.client.1.smithi103.stdout:8/868: creat d4/f116 x:0 0 0 2024-09-18T21:13:00.203 INFO:tasks.workunit.client.1.smithi103.stdout:6/777: chown d2/d24/d5a/d67/d76/d43/d44/f98 28 1 2024-09-18T21:13:00.205 INFO:tasks.workunit.client.1.smithi103.stdout:1/742: link d0/d2/d2b/d3a/f91 d0/d2/d9/dc/d36/d52/f102 0 2024-09-18T21:13:00.206 INFO:tasks.workunit.client.1.smithi103.stdout:2/690: truncate d3/d5/d2c/d77/fdb 3981708 0 2024-09-18T21:13:00.207 INFO:tasks.workunit.client.1.smithi103.stdout:3/756: rename d1/d23/d47/l67 to d1/d23/d47/dbb/le6 0 2024-09-18T21:13:00.209 INFO:tasks.workunit.client.1.smithi103.stdout:8/869: creat d4/d2d/d3d/da0/dab/f117 x:0 0 0 2024-09-18T21:13:00.213 INFO:tasks.workunit.client.1.smithi103.stdout:2/691: mknod d3/db3/cf7 0 2024-09-18T21:13:00.215 INFO:tasks.workunit.client.1.smithi103.stdout:5/821: write de/d1f/d3b/d58/dc4/d7e/f82 [2113303,70831] 0 2024-09-18T21:13:00.215 INFO:tasks.workunit.client.1.smithi103.stdout:3/757: write d1/d64/fdd [697124,43804] 0 2024-09-18T21:13:00.216 INFO:tasks.workunit.client.1.smithi103.stdout:2/692: chown d3/d5/d2f/d48/f9b 53081775 1 2024-09-18T21:13:00.218 INFO:tasks.workunit.client.1.smithi103.stdout:1/743: chown d0/d2/d2b/d3a/d42/d72/ff6 1963 1 2024-09-18T21:13:00.218 INFO:tasks.workunit.client.1.smithi103.stdout:8/870: read d4/d81/dd7/f109 [1594569,127452] 0 2024-09-18T21:13:00.219 INFO:tasks.workunit.client.1.smithi103.stdout:4/871: dread d9/d38/db4/fbf [0,4194304] 0 2024-09-18T21:13:00.220 INFO:tasks.workunit.client.1.smithi103.stdout:3/758: dread d1/d23/d25/da1/fbe [0,4194304] 0 2024-09-18T21:13:00.220 INFO:tasks.workunit.client.1.smithi103.stdout:7/756: rename d1/df/d42/d29/d48/la9 to d1/df/d44/db4/lf3 0 2024-09-18T21:13:00.221 INFO:tasks.workunit.client.0.smithi077.stdout:3/702: write db/d14/d72/f8d [2717456,32702] 0 2024-09-18T21:13:00.222 INFO:tasks.workunit.client.1.smithi103.stdout:7/757: write d1/df/d42/f83 [1981353,67776] 0 2024-09-18T21:13:00.223 INFO:tasks.workunit.client.1.smithi103.stdout:5/822: creat de/d1f/d3b/d51/d57/d79/f10f x:0 0 0 2024-09-18T21:13:00.226 INFO:tasks.workunit.client.1.smithi103.stdout:5/823: dread - de/d1f/d3b/dcd/f10b zero size 2024-09-18T21:13:00.226 INFO:tasks.workunit.client.0.smithi077.stdout:9/679: dwrite d1/dd/d11/d1c/d38/d46/f60 [0,4194304] 0 2024-09-18T21:13:00.228 INFO:tasks.workunit.client.0.smithi077.stdout:9/680: dread - d1/dd/d11/d2d/d59/fb4 zero size 2024-09-18T21:13:00.228 INFO:tasks.workunit.client.1.smithi103.stdout:6/778: getdents d2 0 2024-09-18T21:13:00.231 INFO:tasks.workunit.client.1.smithi103.stdout:3/759: creat d1/d2/d18/d30/d4e/d62/fe7 x:0 0 0 2024-09-18T21:13:00.234 INFO:tasks.workunit.client.0.smithi077.stdout:9/681: dread d1/dd/d11/d1c/d38/d46/d55/d9c/fb8 [0,4194304] 0 2024-09-18T21:13:00.237 INFO:tasks.workunit.client.0.smithi077.stdout:3/703: link db/d14/d32/d49/da4/f60 db/d14/d32/d49/fdc 0 2024-09-18T21:13:00.238 INFO:tasks.workunit.client.1.smithi103.stdout:7/758: dwrite d1/f21 [0,4194304] 0 2024-09-18T21:13:00.241 INFO:tasks.workunit.client.1.smithi103.stdout:4/872: dread d9/fa [0,4194304] 0 2024-09-18T21:13:00.241 INFO:tasks.workunit.client.1.smithi103.stdout:6/779: truncate d2/f56 2836171 0 2024-09-18T21:13:00.242 INFO:tasks.workunit.client.1.smithi103.stdout:1/744: dread d0/d2/d9/f65 [0,4194304] 0 2024-09-18T21:13:00.243 INFO:tasks.workunit.client.1.smithi103.stdout:7/759: fdatasync d1/df/d43/d61/fa5 0 2024-09-18T21:13:00.244 INFO:tasks.workunit.client.1.smithi103.stdout:1/745: readlink d0/d2/d9/d10/lec 0 2024-09-18T21:13:00.245 INFO:tasks.workunit.client.1.smithi103.stdout:8/871: creat d4/f118 x:0 0 0 2024-09-18T21:13:00.246 INFO:tasks.workunit.client.0.smithi077.stdout:9/682: rmdir d1/d54/d81/d92 0 2024-09-18T21:13:00.247 INFO:tasks.workunit.client.1.smithi103.stdout:8/872: dread - d4/d2d/d87/dbb/f113 zero size 2024-09-18T21:13:00.247 INFO:tasks.workunit.client.1.smithi103.stdout:2/693: rename d3/d5/d2c/d54/d68/f9d to d3/d5/d4a/d56/ff8 0 2024-09-18T21:13:00.249 INFO:tasks.workunit.client.1.smithi103.stdout:4/873: rmdir d9/d1c/d106 39 2024-09-18T21:13:00.252 INFO:tasks.workunit.client.0.smithi077.stdout:9/683: truncate d1/d54/d81/fca 1343204 0 2024-09-18T21:13:00.254 INFO:tasks.workunit.client.1.smithi103.stdout:6/780: dwrite d2/d3/f48 [4194304,4194304] 0 2024-09-18T21:13:00.255 INFO:tasks.workunit.client.1.smithi103.stdout:7/760: creat d1/df/d43/d63/d67/d5b/ff4 x:0 0 0 2024-09-18T21:13:00.256 INFO:tasks.workunit.client.1.smithi103.stdout:1/746: rename d0/d2/d9/d10/ccb to d0/d2/d9/d9e/d7a/dd0/df9/d68/d81/c103 0 2024-09-18T21:13:00.258 INFO:tasks.workunit.client.1.smithi103.stdout:1/747: chown d0/d2/d9/dc/d36/fb3 235490 1 2024-09-18T21:13:00.259 INFO:tasks.workunit.client.1.smithi103.stdout:4/874: read d9/d38/d72/df0/d83/db6/d21/f33 [361852,103259] 0 2024-09-18T21:13:00.260 INFO:tasks.workunit.client.0.smithi077.stdout:9/684: creat d1/feb x:0 0 0 2024-09-18T21:13:00.261 INFO:tasks.workunit.client.0.smithi077.stdout:9/685: readlink d1/dd/d11/d2d/d79/le0 0 2024-09-18T21:13:00.262 INFO:tasks.workunit.client.1.smithi103.stdout:2/694: creat d3/d5/d2c/d54/dec/ff9 x:0 0 0 2024-09-18T21:13:00.265 INFO:tasks.workunit.client.0.smithi077.stdout:3/704: write db/d14/d32/d49/da4/d71/d3b/f66 [2668988,114953] 0 2024-09-18T21:13:00.266 INFO:tasks.workunit.client.1.smithi103.stdout:1/748: dwrite d0/d2/d2b/d3a/d42/d9c/ffb [0,4194304] 0 2024-09-18T21:13:00.268 INFO:tasks.workunit.client.1.smithi103.stdout:5/824: dwrite de/d1f/d3b/d3c/d62/f76 [0,4194304] 0 2024-09-18T21:13:00.271 INFO:tasks.workunit.client.0.smithi077.stdout:9/686: dwrite d1/dd/d1a/f1b [4194304,4194304] 0 2024-09-18T21:13:00.271 INFO:tasks.workunit.client.1.smithi103.stdout:5/825: chown de/d1f/d3b/dfb 2704 1 2024-09-18T21:13:00.274 INFO:tasks.workunit.client.1.smithi103.stdout:2/695: dwrite d3/d5/d2f/d48/f9b [0,4194304] 0 2024-09-18T21:13:00.274 INFO:tasks.workunit.client.1.smithi103.stdout:6/781: fdatasync d2/d3/d7f/d91/da2/de4/fe6 0 2024-09-18T21:13:00.278 INFO:tasks.workunit.client.1.smithi103.stdout:1/749: truncate d0/d2/d9/d9e/d7a/fe0 862417 0 2024-09-18T21:13:00.278 INFO:tasks.workunit.client.0.smithi077.stdout:9/687: link d1/d54/f12 d1/dd/d1a/fec 0 2024-09-18T21:13:00.279 INFO:tasks.workunit.client.1.smithi103.stdout:4/875: write d9/f107 [1018444,111492] 0 2024-09-18T21:13:00.282 INFO:tasks.workunit.client.0.smithi077.stdout:9/688: rmdir d1/dd 39 2024-09-18T21:13:00.283 INFO:tasks.workunit.client.1.smithi103.stdout:7/761: creat d1/df/d42/d1f/d2e/ff5 x:0 0 0 2024-09-18T21:13:00.283 INFO:tasks.workunit.client.1.smithi103.stdout:3/760: dwrite d1/d2/d18/d30/d4e/db1/fd0 [0,4194304] 0 2024-09-18T21:13:00.284 INFO:tasks.workunit.client.1.smithi103.stdout:7/762: write d1/df/d44/db4/fc1 [2437388,22524] 0 2024-09-18T21:13:00.287 INFO:tasks.workunit.client.0.smithi077.stdout:9/689: creat d1/dd/d57/fed x:0 0 0 2024-09-18T21:13:00.288 INFO:tasks.workunit.client.1.smithi103.stdout:2/696: read - d3/d5/d2f/d48/f70 zero size 2024-09-18T21:13:00.291 INFO:tasks.workunit.client.1.smithi103.stdout:3/761: rmdir d1/d23 39 2024-09-18T21:13:00.294 INFO:tasks.workunit.client.0.smithi077.stdout:9/690: dwrite d1/dd/d11/d15/d80/f91 [0,4194304] 0 2024-09-18T21:13:00.295 INFO:tasks.workunit.client.1.smithi103.stdout:3/762: stat d1/d2/d18/d30/la9 0 2024-09-18T21:13:00.295 INFO:tasks.workunit.client.1.smithi103.stdout:8/873: truncate d4/d26/d56/d77/d9f/fca 3711010 0 2024-09-18T21:13:00.297 INFO:tasks.workunit.client.0.smithi077.stdout:3/705: truncate db/d14/f34 3277365 0 2024-09-18T21:13:00.298 INFO:tasks.workunit.client.1.smithi103.stdout:5/826: creat de/d3e/f110 x:0 0 0 2024-09-18T21:13:00.298 INFO:tasks.workunit.client.1.smithi103.stdout:3/763: fdatasync d1/d64/fdd 0 2024-09-18T21:13:00.303 INFO:tasks.workunit.client.0.smithi077.stdout:9/691: dread d1/dd/d1a/f1b [4194304,4194304] 0 2024-09-18T21:13:00.303 INFO:tasks.workunit.client.0.smithi077.stdout:3/706: unlink db/d14/d32/d49/da4/d71/l74 0 2024-09-18T21:13:00.308 INFO:tasks.workunit.client.1.smithi103.stdout:1/750: creat d0/f104 x:0 0 0 2024-09-18T21:13:00.309 INFO:tasks.workunit.client.0.smithi077.stdout:3/707: mkdir db/d14/d32/d49/da4/d8a/ddd 0 2024-09-18T21:13:00.311 INFO:tasks.workunit.client.1.smithi103.stdout:4/876: creat d9/d38/d72/df0/d83/db6/f11f x:0 0 0 2024-09-18T21:13:00.313 INFO:tasks.workunit.client.0.smithi077.stdout:3/708: creat db/d14/d22/d36/d39/d50/fde x:0 0 0 2024-09-18T21:13:00.314 INFO:tasks.workunit.client.0.smithi077.stdout:9/692: rmdir d1/dd/d11/d15/d80/dea 0 2024-09-18T21:13:00.315 INFO:tasks.workunit.client.1.smithi103.stdout:4/877: write d9/d38/fba [2206066,105450] 0 2024-09-18T21:13:00.315 INFO:tasks.workunit.client.1.smithi103.stdout:6/782: dread d2/d24/d5a/f11 [0,4194304] 0 2024-09-18T21:13:00.318 INFO:tasks.workunit.client.0.smithi077.stdout:3/709: creat db/d14/d32/d49/d4e/d6a/db5/dc3/fdf x:0 0 0 2024-09-18T21:13:00.319 INFO:tasks.workunit.client.1.smithi103.stdout:7/763: link d1/df/d42/d1f/d2e/d3f/f4a d1/df/d42/ff6 0 2024-09-18T21:13:00.321 INFO:tasks.workunit.client.0.smithi077.stdout:9/693: rename d1/dd/d11/d1c/d38/d46/ce5 to d1/dd/d11/d2d/dc6/cee 0 2024-09-18T21:13:00.322 INFO:tasks.workunit.client.1.smithi103.stdout:3/764: truncate d1/d23/d25/d4f/d72/f87 315655 0 2024-09-18T21:13:00.325 INFO:tasks.workunit.client.0.smithi077.stdout:3/710: dwrite db/d14/d32/d49/d4e/d6a/db5/dc3/fdf [0,4194304] 0 2024-09-18T21:13:00.327 INFO:tasks.workunit.client.1.smithi103.stdout:7/764: truncate d1/df/d43/d63/d67/d5b/f7e 806291 0 2024-09-18T21:13:00.327 INFO:tasks.workunit.client.1.smithi103.stdout:6/783: dread d2/d3/d7f/fb3 [0,4194304] 0 2024-09-18T21:13:00.328 INFO:tasks.workunit.client.1.smithi103.stdout:4/878: mknod d9/d38/d72/df0/d83/db6/d41/d64/d118/c120 0 2024-09-18T21:13:00.329 INFO:tasks.workunit.client.1.smithi103.stdout:3/765: mkdir d1/d23/d25/da1/da5/de8 0 2024-09-18T21:13:00.331 INFO:tasks.workunit.client.1.smithi103.stdout:7/765: chown d1/df/d43/d52/d95 23 1 2024-09-18T21:13:00.331 INFO:tasks.workunit.client.1.smithi103.stdout:5/827: dread de/fd9 [0,4194304] 0 2024-09-18T21:13:00.331 INFO:tasks.workunit.client.1.smithi103.stdout:7/766: stat d1/df/d42/d29/d48 0 2024-09-18T21:13:00.333 INFO:tasks.workunit.client.1.smithi103.stdout:7/767: stat d1/df/d43/d63/d67/d5b/ff4 0 2024-09-18T21:13:00.336 INFO:tasks.workunit.client.1.smithi103.stdout:4/879: mknod d9/d38/c121 0 2024-09-18T21:13:00.338 INFO:tasks.workunit.client.1.smithi103.stdout:4/880: stat d9/d1c 0 2024-09-18T21:13:00.339 INFO:tasks.workunit.client.1.smithi103.stdout:4/881: rmdir d9/d38/d72 39 2024-09-18T21:13:00.342 INFO:tasks.workunit.client.1.smithi103.stdout:2/697: write d3/d5/d2f/d32/d90/feb [4065694,36960] 0 2024-09-18T21:13:00.350 INFO:tasks.workunit.client.1.smithi103.stdout:9/812: sync 2024-09-18T21:13:00.350 INFO:tasks.workunit.client.1.smithi103.stdout:4/882: creat d9/d38/d72/df0/d61/d91/daa/f122 x:0 0 0 2024-09-18T21:13:00.351 INFO:tasks.workunit.client.1.smithi103.stdout:3/766: dread d1/da/f6b [4194304,4194304] 0 2024-09-18T21:13:00.351 INFO:tasks.workunit.client.1.smithi103.stdout:8/874: dwrite d4/d81/f92 [0,4194304] 0 2024-09-18T21:13:00.353 INFO:tasks.workunit.client.1.smithi103.stdout:1/751: truncate d0/d2/d9/d9e/d7a/dd0/df9/d68/d81/da2/da4/dc2/dd8/dae/fb4 65873 0 2024-09-18T21:13:00.355 INFO:tasks.workunit.client.1.smithi103.stdout:3/767: write d1/d2/d18/f46 [1763388,103384] 0 2024-09-18T21:13:00.357 INFO:tasks.workunit.client.1.smithi103.stdout:2/698: rename d3/c1c to d3/db3/cfa 0 2024-09-18T21:13:00.357 INFO:tasks.workunit.client.1.smithi103.stdout:9/813: creat d18/d29/d68/d92/d9c/dc8/f10c x:0 0 0 2024-09-18T21:13:00.359 INFO:tasks.workunit.client.1.smithi103.stdout:9/814: write d18/d29/d68/fb1 [5224483,26403] 0 2024-09-18T21:13:00.359 INFO:tasks.workunit.client.1.smithi103.stdout:4/883: mkdir d9/d38/d72/df0/d83/db6/d41/d64/d118/d123 0 2024-09-18T21:13:00.360 INFO:tasks.workunit.client.1.smithi103.stdout:2/699: creat d3/d5/d2f/d32/ffb x:0 0 0 2024-09-18T21:13:00.361 INFO:tasks.workunit.client.1.smithi103.stdout:9/815: fdatasync d18/d29/f2a 0 2024-09-18T21:13:00.365 INFO:tasks.workunit.client.1.smithi103.stdout:4/884: fsync d9/d38/d72/df0/d61/f76 0 2024-09-18T21:13:00.366 INFO:tasks.workunit.client.1.smithi103.stdout:3/768: creat d1/da/fe9 x:0 0 0 2024-09-18T21:13:00.366 INFO:tasks.workunit.client.1.smithi103.stdout:5/828: dwrite de/fcc [0,4194304] 0 2024-09-18T21:13:00.367 INFO:tasks.workunit.client.1.smithi103.stdout:2/700: fsync d3/d5/d2c/d54/d68/f84 0 2024-09-18T21:13:00.369 INFO:tasks.workunit.client.1.smithi103.stdout:5/829: stat de/d2d/d7f/f45 0 2024-09-18T21:13:00.369 INFO:tasks.workunit.client.1.smithi103.stdout:8/875: creat d4/d81/dd7/dde/d59/f119 x:0 0 0 2024-09-18T21:13:00.369 INFO:tasks.workunit.client.1.smithi103.stdout:4/885: write d9/d38/d72/df0/d61/d91/d9e/d48/f56 [4489396,72452] 0 2024-09-18T21:13:00.372 INFO:tasks.workunit.client.1.smithi103.stdout:3/769: dread d1/da/df/f77 [0,4194304] 0 2024-09-18T21:13:00.377 INFO:tasks.workunit.client.1.smithi103.stdout:3/770: read d1/f2e [792429,11083] 0 2024-09-18T21:13:00.377 INFO:tasks.workunit.client.1.smithi103.stdout:5/830: dwrite de/d1f/d3b/d51/d57/d79/fa3 [0,4194304] 0 2024-09-18T21:13:00.382 INFO:tasks.workunit.client.1.smithi103.stdout:5/831: rename de/d1f/d3b/d58/dd1/cfd to de/d1f/d3b/d51/d57/db5/c111 0 2024-09-18T21:13:00.383 INFO:tasks.workunit.client.1.smithi103.stdout:5/832: chown de/d2d/d7f 634749361 1 2024-09-18T21:13:00.385 INFO:tasks.workunit.client.1.smithi103.stdout:5/833: truncate de/d1f/d3b/d3c/f90 4375025 0 2024-09-18T21:13:00.394 INFO:tasks.workunit.client.1.smithi103.stdout:4/886: dread d9/de3/f108 [0,4194304] 0 2024-09-18T21:13:00.468 INFO:tasks.workunit.client.1.smithi103.stdout:8/876: write d4/d2d/d87/fa7 [659478,112284] 0 2024-09-18T21:13:00.469 INFO:tasks.workunit.client.1.smithi103.stdout:2/701: write d3/d5/d2f/d32/d46/fb4 [545225,118442] 0 2024-09-18T21:13:00.470 INFO:tasks.workunit.client.1.smithi103.stdout:2/702: chown d3/d5/d2f/d93/fa1 0 1 2024-09-18T21:13:00.476 INFO:tasks.workunit.client.1.smithi103.stdout:8/877: dwrite d4/de/fef [0,4194304] 0 2024-09-18T21:13:00.476 INFO:tasks.workunit.client.1.smithi103.stdout:7/768: dread d1/df/f22 [0,4194304] 0 2024-09-18T21:13:00.503 INFO:tasks.workunit.client.1.smithi103.stdout:0/730: sync 2024-09-18T21:13:00.504 INFO:tasks.workunit.client.1.smithi103.stdout:0/731: dread - d1/d5/de/dc0/dbf/d4e/f85 zero size 2024-09-18T21:13:00.505 INFO:tasks.workunit.client.1.smithi103.stdout:0/732: write d1/d5/de/dc0/d8c/dce/d9f/d4f/f103 [83244,55424] 0 2024-09-18T21:13:00.510 INFO:tasks.workunit.client.1.smithi103.stdout:0/733: dwrite d1/fd [0,4194304] 0 2024-09-18T21:13:00.523 INFO:tasks.workunit.client.1.smithi103.stdout:0/734: dread d1/d93/fe0 [0,4194304] 0 2024-09-18T21:13:00.523 INFO:tasks.workunit.client.1.smithi103.stdout:0/735: chown d1/d9/f54 707654 1 2024-09-18T21:13:00.530 INFO:tasks.workunit.client.1.smithi103.stdout:2/703: mkdir d3/d5/d2f/d32/dfc 0 2024-09-18T21:13:00.530 INFO:tasks.workunit.client.1.smithi103.stdout:3/771: write d1/d23/d25/d4f/d58/d68/f36 [4204540,56456] 0 2024-09-18T21:13:00.530 INFO:tasks.workunit.client.1.smithi103.stdout:3/772: read - d1/da/fe9 zero size 2024-09-18T21:13:00.531 INFO:tasks.workunit.client.1.smithi103.stdout:2/704: chown d3/d5/d2c/d54/dec/ff9 11915 1 2024-09-18T21:13:00.531 INFO:tasks.workunit.client.1.smithi103.stdout:5/834: rmdir de/d1f/d3b/d58 39 2024-09-18T21:13:00.532 INFO:tasks.workunit.client.1.smithi103.stdout:5/835: dread - de/d3e/f110 zero size 2024-09-18T21:13:00.537 INFO:tasks.workunit.client.0.smithi077.stdout:0/787: sync 2024-09-18T21:13:00.543 INFO:tasks.workunit.client.1.smithi103.stdout:4/887: dwrite d9/d38/db4/fbf [4194304,4194304] 0 2024-09-18T21:13:00.544 INFO:tasks.workunit.client.1.smithi103.stdout:0/736: dread d1/d5/de/dc0/dbf/f86 [0,4194304] 0 2024-09-18T21:13:00.559 INFO:tasks.workunit.client.0.smithi077.stdout:0/788: write d8/d1a/d39/f6e [977302,66492] 0 2024-09-18T21:13:00.560 INFO:tasks.workunit.client.1.smithi103.stdout:2/705: stat d3/d5/d2f/d32/d90/ccc 0 2024-09-18T21:13:00.564 INFO:tasks.workunit.client.1.smithi103.stdout:4/888: mknod d9/d38/d72/d85/dd8/c124 0 2024-09-18T21:13:00.567 INFO:tasks.workunit.client.1.smithi103.stdout:7/769: rmdir d1/df/d44/dba/de7 0 2024-09-18T21:13:00.570 INFO:tasks.workunit.client.1.smithi103.stdout:5/836: readlink de/d1f/d3b/d51/db0/lf1 0 2024-09-18T21:13:00.572 INFO:tasks.workunit.client.1.smithi103.stdout:2/706: mknod d3/d5/d2f/d32/d90/cfd 0 2024-09-18T21:13:00.572 INFO:tasks.workunit.client.1.smithi103.stdout:7/770: mknod d1/df/d42/d1f/d5d/d85/dde/cf7 0 2024-09-18T21:13:00.576 INFO:tasks.workunit.client.1.smithi103.stdout:7/771: mknod d1/df/d43/d52/d95/cf8 0 2024-09-18T21:13:00.578 INFO:tasks.workunit.client.1.smithi103.stdout:7/772: truncate d1/df/d44/fa0 924849 0 2024-09-18T21:13:00.579 INFO:tasks.workunit.client.1.smithi103.stdout:7/773: chown d1/df/d42/d29/d48/dbb/f9a 814 1 2024-09-18T21:13:00.579 INFO:tasks.workunit.client.0.smithi077.stdout:0/789: truncate d8/d1a/d39/d3b/fdb 439522 0 2024-09-18T21:13:00.581 INFO:tasks.workunit.client.1.smithi103.stdout:3/773: write d1/da/f15 [561151,13038] 0 2024-09-18T21:13:00.582 INFO:tasks.workunit.client.1.smithi103.stdout:3/774: fsync d1/d64/fdd 0 2024-09-18T21:13:00.583 INFO:tasks.workunit.client.1.smithi103.stdout:7/774: dread d1/df/d42/d29/d48/dbb/d33/fae [0,4194304] 0 2024-09-18T21:13:00.584 INFO:tasks.workunit.client.1.smithi103.stdout:0/737: truncate d1/f36 745355 0 2024-09-18T21:13:00.587 INFO:tasks.workunit.client.1.smithi103.stdout:5/837: truncate de/f16 474011 0 2024-09-18T21:13:00.589 INFO:tasks.workunit.client.1.smithi103.stdout:0/738: write d1/d9/d3e/fd0 [2646575,57831] 0 2024-09-18T21:13:00.593 INFO:tasks.workunit.client.1.smithi103.stdout:7/775: getdents d1/df/d44/db4 0 2024-09-18T21:13:00.596 INFO:tasks.workunit.client.0.smithi077.stdout:0/790: dwrite f3 [0,4194304] 0 2024-09-18T21:13:00.596 INFO:tasks.workunit.client.1.smithi103.stdout:5/838: mknod de/d1f/d3b/d51/d57/c112 0 2024-09-18T21:13:00.596 INFO:tasks.workunit.client.1.smithi103.stdout:3/775: dwrite d1/d2/d18/d30/f38 [0,4194304] 0 2024-09-18T21:13:00.596 INFO:tasks.workunit.client.1.smithi103.stdout:2/707: dwrite d3/f1b [0,4194304] 0 2024-09-18T21:13:00.596 INFO:tasks.workunit.client.1.smithi103.stdout:0/739: fsync d1/d5/de/dc0/d8c/dce/d9f/f3d 0 2024-09-18T21:13:00.597 INFO:tasks.workunit.client.0.smithi077.stdout:0/791: fsync d8/d1a/d39/d56/fb6 0 2024-09-18T21:13:00.600 INFO:tasks.workunit.client.0.smithi077.stdout:0/792: mknod d8/d37/d66/d87/c100 0 2024-09-18T21:13:00.601 INFO:tasks.workunit.client.1.smithi103.stdout:0/740: write d1/d5/de/d19/fdc [66935,131016] 0 2024-09-18T21:13:00.603 INFO:tasks.workunit.client.1.smithi103.stdout:7/776: symlink d1/df/d42/d1f/d5d/dbe/lf9 0 2024-09-18T21:13:00.604 INFO:tasks.workunit.client.0.smithi077.stdout:0/793: fdatasync d8/d1d/f55 0 2024-09-18T21:13:00.606 INFO:tasks.workunit.client.0.smithi077.stdout:0/794: chown d8/d26/f75 6 1 2024-09-18T21:13:00.608 INFO:tasks.workunit.client.1.smithi103.stdout:2/708: creat d3/d5/d2f/d5b/ffe x:0 0 0 2024-09-18T21:13:00.608 INFO:tasks.workunit.client.1.smithi103.stdout:5/839: dwrite de/d1f/d3b/d51/d57/d59/f6e [0,4194304] 0 2024-09-18T21:13:00.609 INFO:tasks.workunit.client.1.smithi103.stdout:3/776: dwrite d1/d23/fa6 [0,4194304] 0 2024-09-18T21:13:00.611 INFO:tasks.workunit.client.1.smithi103.stdout:3/777: dread - d1/d2/d18/d30/d4e/d62/fe7 zero size 2024-09-18T21:13:00.615 INFO:tasks.workunit.client.0.smithi077.stdout:0/795: rename d8/d37/d95/dab/f8c to d8/d26/dc9/f101 0 2024-09-18T21:13:00.618 INFO:tasks.workunit.client.1.smithi103.stdout:7/777: mkdir d1/df/d43/d52/dfa 0 2024-09-18T21:13:00.621 INFO:tasks.workunit.client.1.smithi103.stdout:2/709: chown d3/db3/cfa 309603 1 2024-09-18T21:13:00.624 INFO:tasks.workunit.client.1.smithi103.stdout:7/778: mknod d1/df/d43/d52/cfb 0 2024-09-18T21:13:00.626 INFO:tasks.workunit.client.1.smithi103.stdout:0/741: creat d1/d5/de/f108 x:0 0 0 2024-09-18T21:13:00.626 INFO:tasks.workunit.client.1.smithi103.stdout:2/710: truncate d3/d5/d2c/f65 446196 0 2024-09-18T21:13:00.628 INFO:tasks.workunit.client.1.smithi103.stdout:6/784: sync 2024-09-18T21:13:00.628 INFO:tasks.workunit.client.1.smithi103.stdout:0/742: truncate d1/d5/de/d19/fdc 818266 0 2024-09-18T21:13:00.628 INFO:tasks.workunit.client.1.smithi103.stdout:7/779: rename d1/df/d42/d29/d48/dbb/ca7 to d1/df/d42/cfc 0 2024-09-18T21:13:00.630 INFO:tasks.workunit.client.1.smithi103.stdout:6/785: fsync d2/d24/d5a/d67/d76/da4/fd8 0 2024-09-18T21:13:00.632 INFO:tasks.workunit.client.1.smithi103.stdout:6/786: mknod d2/d3/d8/d4c/d4e/cf6 0 2024-09-18T21:13:00.635 INFO:tasks.workunit.client.1.smithi103.stdout:6/787: link d2/d24/d5a/d67/d76/da4/dc7/fdc d2/d3/d7f/d91/da2/ff7 0 2024-09-18T21:13:00.637 INFO:tasks.workunit.client.1.smithi103.stdout:6/788: mknod d2/d3/d8/d4c/d7a/cf8 0 2024-09-18T21:13:00.642 INFO:tasks.workunit.client.0.smithi077.stdout:0/796: getdents d8/d37/d95/dab 0 2024-09-18T21:13:00.644 INFO:tasks.workunit.client.0.smithi077.stdout:0/797: mkdir d8/d37/d66/d102 0 2024-09-18T21:13:00.646 INFO:tasks.workunit.client.0.smithi077.stdout:0/798: write d8/d37/d66/d87/de0/fcc [2942935,73462] 0 2024-09-18T21:13:00.647 INFO:tasks.workunit.client.1.smithi103.stdout:2/711: write d3/d5/d25/fe0 [727208,123837] 0 2024-09-18T21:13:00.647 INFO:tasks.workunit.client.0.smithi077.stdout:0/799: dread - d8/d37/d66/d87/de0/fd4 zero size 2024-09-18T21:13:00.648 INFO:tasks.workunit.client.0.smithi077.stdout:0/800: truncate d8/d1d/f8b 5159271 0 2024-09-18T21:13:00.650 INFO:tasks.workunit.client.1.smithi103.stdout:1/752: sync 2024-09-18T21:13:00.650 INFO:tasks.workunit.client.1.smithi103.stdout:5/840: dread de/d1f/f86 [0,4194304] 0 2024-09-18T21:13:00.654 INFO:tasks.workunit.client.1.smithi103.stdout:3/778: dwrite d1/da/f6b [0,4194304] 0 2024-09-18T21:13:00.655 INFO:tasks.workunit.client.0.smithi077.stdout:0/801: dwrite d8/d37/d66/d87/de0/fcc [0,4194304] 0 2024-09-18T21:13:00.658 INFO:tasks.workunit.client.1.smithi103.stdout:7/780: dwrite d1/f82 [0,4194304] 0 2024-09-18T21:13:00.659 INFO:tasks.workunit.client.1.smithi103.stdout:2/712: write d3/d5/d2f/d48/fa7 [4765836,117914] 0 2024-09-18T21:13:00.659 INFO:tasks.workunit.client.1.smithi103.stdout:1/753: write d0/d2/d9/d9e/d7a/dd0/df9/d68/d81/da2/da4/fdc [1032795,45263] 0 2024-09-18T21:13:00.660 INFO:tasks.workunit.client.1.smithi103.stdout:0/743: dread d1/d5/de/dc0/f79 [0,4194304] 0 2024-09-18T21:13:00.664 INFO:tasks.workunit.client.1.smithi103.stdout:3/779: read - d1/d23/d47/dbb/f9b zero size 2024-09-18T21:13:00.666 INFO:tasks.workunit.client.0.smithi077.stdout:0/802: read d8/d1a/d39/f59 [1376831,38388] 0 2024-09-18T21:13:00.666 INFO:tasks.workunit.client.1.smithi103.stdout:7/781: dread - d1/df/d43/d63/d67/d5b/f81 zero size 2024-09-18T21:13:00.668 INFO:tasks.workunit.client.1.smithi103.stdout:2/713: unlink d3/d5/f35 0 2024-09-18T21:13:00.668 INFO:tasks.workunit.client.1.smithi103.stdout:1/754: symlink d0/d2/l105 0 2024-09-18T21:13:00.671 INFO:tasks.workunit.client.0.smithi077.stdout:0/803: rmdir d8/d1a/d39/d3b/d9a/de8/deb 0 2024-09-18T21:13:00.672 INFO:tasks.workunit.client.1.smithi103.stdout:1/755: mknod d0/d2/d9/dc/c106 0 2024-09-18T21:13:00.673 INFO:tasks.workunit.client.1.smithi103.stdout:0/744: dread d1/d5/de/d24/f32 [0,4194304] 0 2024-09-18T21:13:00.674 INFO:tasks.workunit.client.1.smithi103.stdout:5/841: dwrite de/fd9 [0,4194304] 0 2024-09-18T21:13:00.674 INFO:tasks.workunit.client.1.smithi103.stdout:8/878: sync 2024-09-18T21:13:00.674 INFO:tasks.workunit.client.1.smithi103.stdout:9/816: sync 2024-09-18T21:13:00.674 INFO:tasks.workunit.client.1.smithi103.stdout:1/756: chown d0/d2/d9/f92 7280 1 2024-09-18T21:13:00.676 INFO:tasks.workunit.client.1.smithi103.stdout:2/714: getdents d3/d5/d2f/d32/d90/dd7 0 2024-09-18T21:13:00.678 INFO:tasks.workunit.client.1.smithi103.stdout:1/757: fdatasync d0/d2/f3d 0 2024-09-18T21:13:00.678 INFO:tasks.workunit.client.1.smithi103.stdout:0/745: unlink d1/d5/de/dc0/db0/fd5 0 2024-09-18T21:13:00.679 INFO:tasks.workunit.client.1.smithi103.stdout:6/789: dread d2/d24/d38/d68/dac/fc8 [0,4194304] 0 2024-09-18T21:13:00.679 INFO:tasks.workunit.client.1.smithi103.stdout:1/758: chown d0/d11/d5f/c5e 1 1 2024-09-18T21:13:00.682 INFO:tasks.workunit.client.1.smithi103.stdout:8/879: creat d4/d2d/d4e/f11a x:0 0 0 2024-09-18T21:13:00.683 INFO:tasks.workunit.client.1.smithi103.stdout:0/746: mkdir d1/dcf/d109 0 2024-09-18T21:13:00.685 INFO:tasks.workunit.client.1.smithi103.stdout:2/715: dwrite d3/d5/d2f/d32/dae/fe2 [0,4194304] 0 2024-09-18T21:13:00.685 INFO:tasks.workunit.client.1.smithi103.stdout:6/790: mknod d2/d3/d8/d4c/d79/d9e/cf9 0 2024-09-18T21:13:00.686 INFO:tasks.workunit.client.1.smithi103.stdout:6/791: readlink d2/d24/d38/d68/lba 0 2024-09-18T21:13:00.687 INFO:tasks.workunit.client.1.smithi103.stdout:1/759: unlink d0/d2/d9/d9e/d7a/fea 0 2024-09-18T21:13:00.688 INFO:tasks.workunit.client.1.smithi103.stdout:9/817: mknod d18/d52/d6f/d8e/d8f/dbd/df1/dfe/c10d 0 2024-09-18T21:13:00.688 INFO:tasks.workunit.client.1.smithi103.stdout:9/818: readlink d18/d29/lf5 0 2024-09-18T21:13:00.690 INFO:tasks.workunit.client.1.smithi103.stdout:8/880: creat d4/ddf/f11b x:0 0 0 2024-09-18T21:13:00.690 INFO:tasks.workunit.client.1.smithi103.stdout:4/889: sync 2024-09-18T21:13:00.694 INFO:tasks.workunit.client.1.smithi103.stdout:5/842: write de/fae [4140621,9789] 0 2024-09-18T21:13:00.696 INFO:tasks.workunit.client.0.smithi077.stdout:8/680: sync 2024-09-18T21:13:00.698 INFO:tasks.workunit.client.1.smithi103.stdout:4/890: dread d9/f6d [0,4194304] 0 2024-09-18T21:13:00.698 INFO:tasks.workunit.client.1.smithi103.stdout:0/747: dwrite d1/d9/f54 [0,4194304] 0 2024-09-18T21:13:00.699 INFO:tasks.workunit.client.0.smithi077.stdout:0/804: dwrite d8/d1a/d39/d56/fde [0,4194304] 0 2024-09-18T21:13:00.700 INFO:tasks.workunit.client.1.smithi103.stdout:2/716: rename d3/d5/c8c to d3/cff 0 2024-09-18T21:13:00.702 INFO:tasks.workunit.client.0.smithi077.stdout:0/805: fdatasync d8/d37/d95/dab/fa9 0 2024-09-18T21:13:00.703 INFO:tasks.workunit.client.1.smithi103.stdout:2/717: stat d3/d5/d2f/fe4 0 2024-09-18T21:13:00.710 INFO:tasks.workunit.client.1.smithi103.stdout:8/881: creat d4/d2d/dc1/f11c x:0 0 0 2024-09-18T21:13:00.710 INFO:tasks.workunit.client.1.smithi103.stdout:0/748: dwrite d1/d5/fd8 [0,4194304] 0 2024-09-18T21:13:00.713 INFO:tasks.workunit.client.1.smithi103.stdout:9/819: getdents d18/d52/d6f/d8e/d8f/dbd/dc3 0 2024-09-18T21:13:00.715 INFO:tasks.workunit.client.1.smithi103.stdout:0/749: write d1/d5/de/d24/f38 [325774,43560] 0 2024-09-18T21:13:00.716 INFO:tasks.workunit.client.1.smithi103.stdout:1/760: truncate d0/d2/d9/d9e/d7a/dd0/df9/f29 6516225 0 2024-09-18T21:13:00.720 INFO:tasks.workunit.client.1.smithi103.stdout:6/792: rename d2/d24/d5a/d67/d76/l77 to d2/d24/d38/d68/lfa 0 2024-09-18T21:13:00.721 INFO:tasks.workunit.client.1.smithi103.stdout:8/882: dwrite d4/d26/d56/fc2 [0,4194304] 0 2024-09-18T21:13:00.724 INFO:tasks.workunit.client.1.smithi103.stdout:0/750: mkdir d1/d5/de/d24/d43/dfd/d10a 0 2024-09-18T21:13:00.724 INFO:tasks.workunit.client.0.smithi077.stdout:0/806: write d8/f2d [286233,65845] 0 2024-09-18T21:13:00.725 INFO:tasks.workunit.client.0.smithi077.stdout:0/807: fdatasync d8/d1a/f20 0 2024-09-18T21:13:00.731 INFO:tasks.workunit.client.0.smithi077.stdout:0/808: write d8/d1a/d39/fdf [587874,87799] 0 2024-09-18T21:13:00.732 INFO:tasks.workunit.client.1.smithi103.stdout:4/891: dwrite d9/f18 [0,4194304] 0 2024-09-18T21:13:00.733 INFO:tasks.workunit.client.1.smithi103.stdout:0/751: creat d1/d5/de/d24/d43/d76/dc5/f10b x:0 0 0 2024-09-18T21:13:00.737 INFO:tasks.workunit.client.1.smithi103.stdout:6/793: dread d2/d24/d38/f89 [0,4194304] 0 2024-09-18T21:13:00.739 INFO:tasks.workunit.client.1.smithi103.stdout:4/892: symlink d9/d38/d58/l125 0 2024-09-18T21:13:00.741 INFO:tasks.workunit.client.1.smithi103.stdout:0/752: dread d1/f9a [0,4194304] 0 2024-09-18T21:13:00.742 INFO:tasks.workunit.client.1.smithi103.stdout:2/718: dwrite d3/d5/d2f/d32/d46/fc9 [0,4194304] 0 2024-09-18T21:13:00.743 INFO:tasks.workunit.client.1.smithi103.stdout:8/883: write d4/d81/dd7/dde/d59/d5e/faa [1814490,78340] 0 2024-09-18T21:13:00.743 INFO:tasks.workunit.client.1.smithi103.stdout:5/843: dwrite de/d1f/d3b/d58/dc4/d33/f5d [4194304,4194304] 0 2024-09-18T21:13:00.743 INFO:tasks.workunit.client.1.smithi103.stdout:6/794: chown d2/d3/d7f/cce 0 1 2024-09-18T21:13:00.749 INFO:tasks.workunit.client.1.smithi103.stdout:2/719: fsync d3/d5/d2c/d77/d9c/fc8 0 2024-09-18T21:13:00.749 INFO:tasks.workunit.client.1.smithi103.stdout:4/893: symlink d9/d38/d72/df0/d61/d91/d9e/d48/l126 0 2024-09-18T21:13:00.749 INFO:tasks.workunit.client.1.smithi103.stdout:0/753: creat d1/d5/de/d22/d6a/f10c x:0 0 0 2024-09-18T21:13:00.754 INFO:tasks.workunit.client.1.smithi103.stdout:5/844: mknod de/d1f/d3b/d51/d57/db5/c113 0 2024-09-18T21:13:00.754 INFO:tasks.workunit.client.1.smithi103.stdout:2/720: mkdir d3/d5/d2f/d5b/d100 0 2024-09-18T21:13:00.754 INFO:tasks.workunit.client.0.smithi077.stdout:0/809: dread f5 [0,4194304] 0 2024-09-18T21:13:00.756 INFO:tasks.workunit.client.1.smithi103.stdout:0/754: unlink d1/d5/de/d19/d1e/f1f 0 2024-09-18T21:13:00.760 INFO:tasks.workunit.client.1.smithi103.stdout:4/894: dwrite d9/d38/d72/df0/d83/db6/d21/f114 [0,4194304] 0 2024-09-18T21:13:00.761 INFO:tasks.workunit.client.1.smithi103.stdout:4/895: chown d9/d1c/dcd/dd1/lee 368 1 2024-09-18T21:13:00.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:00 smithi103 ceph-mon[34827]: pgmap v21: 65 pgs: 65 active+clean; 2.8 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 112 MiB/s rd, 322 MiB/s wr, 565 op/s 2024-09-18T21:13:00.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:00 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:00.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:00 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:00.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:00 smithi103 ceph-mon[34827]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:13:00.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:00 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:13:00.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:00 smithi103 ceph-mon[34827]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:13:00.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:00 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:13:00.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:00 smithi103 ceph-mon[34827]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:13:00.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:00 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:13:00.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:00 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:00.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:00 smithi103 ceph-mon[34827]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:13:00.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:00 smithi103 ceph-mon[34827]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:13:00.765 INFO:tasks.workunit.client.1.smithi103.stdout:6/795: rename d2/f12 to d2/d24/d5a/d67/d76/ffb 0 2024-09-18T21:13:00.765 INFO:tasks.workunit.client.0.smithi077.stdout:5/786: sync 2024-09-18T21:13:00.765 INFO:tasks.workunit.client.0.smithi077.stdout:7/754: sync 2024-09-18T21:13:00.765 INFO:tasks.workunit.client.0.smithi077.stdout:3/711: sync 2024-09-18T21:13:00.766 INFO:tasks.workunit.client.0.smithi077.stdout:6/677: sync 2024-09-18T21:13:00.766 INFO:tasks.workunit.client.0.smithi077.stdout:1/706: sync 2024-09-18T21:13:00.766 INFO:tasks.workunit.client.0.smithi077.stdout:4/685: sync 2024-09-18T21:13:00.766 INFO:tasks.workunit.client.0.smithi077.stdout:2/807: sync 2024-09-18T21:13:00.766 INFO:tasks.workunit.client.0.smithi077.stdout:9/694: sync 2024-09-18T21:13:00.767 INFO:tasks.workunit.client.1.smithi103.stdout:2/721: link d3/d5/d4a/d56/fce d3/d5/d2c/d77/f101 0 2024-09-18T21:13:00.768 INFO:tasks.workunit.client.0.smithi077.stdout:1/707: readlink d3/d8/d49/lc8 0 2024-09-18T21:13:00.769 INFO:tasks.workunit.client.0.smithi077.stdout:9/695: write d1/feb [1009256,50415] 0 2024-09-18T21:13:00.770 INFO:tasks.workunit.client.1.smithi103.stdout:4/896: creat d9/d38/d72/df0/d83/db6/d21/d80/f127 x:0 0 0 2024-09-18T21:13:00.771 INFO:tasks.workunit.client.1.smithi103.stdout:5/845: link de/d1f/d3b/d58/dc4/cb2 de/d1f/d3b/dfb/c114 0 2024-09-18T21:13:00.773 INFO:tasks.workunit.client.1.smithi103.stdout:5/846: write de/d3e/d85/fe0 [745223,58144] 0 2024-09-18T21:13:00.775 INFO:tasks.workunit.client.1.smithi103.stdout:2/722: fsync d3/d5/d2c/f66 0 2024-09-18T21:13:00.776 INFO:tasks.workunit.client.0.smithi077.stdout:2/808: dwrite d1/d4/d5/d1a/d2e/f97 [0,4194304] 0 2024-09-18T21:13:00.780 INFO:tasks.workunit.client.1.smithi103.stdout:4/897: rename d9/d38/d72/df0/d61/d91/fd3 to d9/d38/db4/dec/f128 0 2024-09-18T21:13:00.783 INFO:tasks.workunit.client.0.smithi077.stdout:1/708: fdatasync d3/d6a/fcc 0 2024-09-18T21:13:00.785 INFO:tasks.workunit.client.0.smithi077.stdout:1/709: dread - d3/d8/d93/dd3/dc1/fd6 zero size 2024-09-18T21:13:00.786 INFO:tasks.workunit.client.0.smithi077.stdout:9/696: symlink d1/d54/d27/lef 0 2024-09-18T21:13:00.789 INFO:tasks.workunit.client.1.smithi103.stdout:4/898: dwrite d9/d38/d72/df0/d83/db6/d41/d64/fc5 [4194304,4194304] 0 2024-09-18T21:13:00.790 INFO:tasks.workunit.client.0.smithi077.stdout:8/681: dread d2/d27/d29/d41/dbc/f78 [0,4194304] 0 2024-09-18T21:13:00.793 INFO:tasks.workunit.client.1.smithi103.stdout:2/723: mkdir d3/d5/d2c/d54/d68/d102 0 2024-09-18T21:13:00.793 INFO:tasks.workunit.client.0.smithi077.stdout:6/678: symlink d7/d7e/d11/d3e/d42/dbb/d49/leb 0 2024-09-18T21:13:00.797 INFO:tasks.workunit.client.0.smithi077.stdout:7/755: write d12/d56/da1/db6/dbd/fd9 [968245,110263] 0 2024-09-18T21:13:00.800 INFO:tasks.workunit.client.0.smithi077.stdout:8/682: dwrite d2/d5f/da8/d4f/d5a/d2a/d88/fb9 [0,4194304] 0 2024-09-18T21:13:00.800 INFO:tasks.workunit.client.0.smithi077.stdout:7/756: chown d12/d22/d59/l6a 1026681934 1 2024-09-18T21:13:00.801 INFO:tasks.workunit.client.1.smithi103.stdout:5/847: dwrite de/d2d/d7f/f65 [4194304,4194304] 0 2024-09-18T21:13:00.801 INFO:tasks.workunit.client.1.smithi103.stdout:4/899: mknod d9/d1c/dcd/dd1/c129 0 2024-09-18T21:13:00.801 INFO:tasks.workunit.client.0.smithi077.stdout:1/710: chown d3/d8/d49/d4e/d50 48 1 2024-09-18T21:13:00.801 INFO:tasks.workunit.client.0.smithi077.stdout:8/683: stat d2/d5/d6/d7e/ce1 0 2024-09-18T21:13:00.802 INFO:tasks.workunit.client.1.smithi103.stdout:2/724: creat d3/db3/f103 x:0 0 0 2024-09-18T21:13:00.802 INFO:tasks.workunit.client.1.smithi103.stdout:5/848: stat de/fcc 0 2024-09-18T21:13:00.803 INFO:tasks.workunit.client.0.smithi077.stdout:9/697: unlink d1/dd/d11/d2d/d59/f95 0 2024-09-18T21:13:00.805 INFO:tasks.workunit.client.0.smithi077.stdout:4/686: truncate d3/f2b 3098460 0 2024-09-18T21:13:00.812 INFO:tasks.workunit.client.0.smithi077.stdout:2/809: fdatasync d1/d4/d5/d1a/f4c 0 2024-09-18T21:13:00.813 INFO:tasks.workunit.client.1.smithi103.stdout:1/761: dread d0/d2/d9/f59 [0,4194304] 0 2024-09-18T21:13:00.815 INFO:tasks.workunit.client.1.smithi103.stdout:4/900: creat d9/d38/d72/df0/d83/db6/d41/dfc/f12a x:0 0 0 2024-09-18T21:13:00.816 INFO:tasks.workunit.client.0.smithi077.stdout:8/684: symlink d2/d5f/da8/d20/d3e/db4/lf7 0 2024-09-18T21:13:00.817 INFO:tasks.workunit.client.0.smithi077.stdout:9/698: rename d1/dd/d11/c68 to d1/dd/d11/d2d/cf0 0 2024-09-18T21:13:00.817 INFO:tasks.workunit.client.1.smithi103.stdout:6/796: dread - d2/d24/d5a/d67/d76/d43/d44/f98 zero size 2024-09-18T21:13:00.818 INFO:tasks.workunit.client.0.smithi077.stdout:4/687: mkdir d3/d7/d42/dd8 0 2024-09-18T21:13:00.820 INFO:tasks.workunit.client.0.smithi077.stdout:4/688: write d3/dc/d51/d53/d89/fad [4434232,105608] 0 2024-09-18T21:13:00.820 INFO:tasks.workunit.client.1.smithi103.stdout:9/820: dread d18/d52/d6f/d8e/d8f/dbd/df1/f103 [0,4194304] 0 2024-09-18T21:13:00.821 INFO:tasks.workunit.client.1.smithi103.stdout:9/821: fsync d18/da4/ff6 0 2024-09-18T21:13:00.821 INFO:tasks.workunit.client.1.smithi103.stdout:6/797: mknod d2/d24/d38/d68/cfc 0 2024-09-18T21:13:00.823 INFO:tasks.workunit.client.0.smithi077.stdout:8/685: mkdir d2/d5/d6/d9f/da4/df8 0 2024-09-18T21:13:00.824 INFO:tasks.workunit.client.1.smithi103.stdout:1/762: rename d0/d11/f35 to d0/d11/d5f/f107 0 2024-09-18T21:13:00.825 INFO:tasks.workunit.client.1.smithi103.stdout:4/901: mkdir d9/d1c/d12b 0 2024-09-18T21:13:00.827 INFO:tasks.workunit.client.1.smithi103.stdout:4/902: fsync d9/d1c/d77/f54 0 2024-09-18T21:13:00.829 INFO:tasks.workunit.client.1.smithi103.stdout:9/822: dwrite d18/d29/d68/d92/d9c/dc8/f10c [0,4194304] 0 2024-09-18T21:13:00.832 INFO:tasks.workunit.client.1.smithi103.stdout:5/849: write de/d1f/d3b/d51/d57/d79/d8d/fd6 [616173,3601] 0 2024-09-18T21:13:00.834 INFO:tasks.workunit.client.1.smithi103.stdout:6/798: fdatasync d2/d3/d7f/d91/da2/de4/fe6 0 2024-09-18T21:13:00.834 INFO:tasks.workunit.client.1.smithi103.stdout:2/725: write d3/d5/d4a/d56/f8d [1236739,98625] 0 2024-09-18T21:13:00.837 INFO:tasks.workunit.client.0.smithi077.stdout:2/810: link d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d95/fee d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d83/dba/ddc/dff/f119 0 2024-09-18T21:13:00.837 INFO:tasks.workunit.client.0.smithi077.stdout:7/757: write d12/d56/f3a [4267272,62255] 0 2024-09-18T21:13:00.838 INFO:tasks.workunit.client.0.smithi077.stdout:9/699: creat d1/dd/d11/d2d/d59/de1/ff1 x:0 0 0 2024-09-18T21:13:00.841 INFO:tasks.workunit.client.0.smithi077.stdout:4/689: symlink d3/dc/d51/d53/dce/ld9 0 2024-09-18T21:13:00.843 INFO:tasks.workunit.client.1.smithi103.stdout:5/850: unlink de/d1f/d3b/d51/d57/d59/cd3 0 2024-09-18T21:13:00.843 INFO:tasks.workunit.client.0.smithi077.stdout:6/679: write d7/d7e/d11/d3e/f65 [2246316,28111] 0 2024-09-18T21:13:00.843 INFO:tasks.workunit.client.0.smithi077.stdout:8/686: symlink d2/d5f/da8/d4f/d5a/d2a/dc8/df1/lf9 0 2024-09-18T21:13:00.845 INFO:tasks.workunit.client.1.smithi103.stdout:5/851: chown de/d2d/f56 126756332 1 2024-09-18T21:13:00.845 INFO:tasks.workunit.client.0.smithi077.stdout:8/687: chown d2/d27/d29/d72/f9d 205235081 1 2024-09-18T21:13:00.849 INFO:tasks.workunit.client.1.smithi103.stdout:6/799: creat d2/d24/d38/ffd x:0 0 0 2024-09-18T21:13:00.855 INFO:tasks.workunit.client.0.smithi077.stdout:6/680: creat d7/d7e/d11/d3e/dcd/fec x:0 0 0 2024-09-18T21:13:00.856 INFO:tasks.workunit.client.1.smithi103.stdout:1/763: dwrite d0/d2/d9/f59 [0,4194304] 0 2024-09-18T21:13:00.856 INFO:tasks.workunit.client.1.smithi103.stdout:6/800: mkdir d2/d3/d8/de1/dfe 0 2024-09-18T21:13:00.857 INFO:tasks.workunit.client.0.smithi077.stdout:7/758: mkdir d12/d56/ded/d101 0 2024-09-18T21:13:00.860 INFO:tasks.workunit.client.1.smithi103.stdout:9/823: link d18/d52/d6f/db9/fbc d18/d29/d68/d92/d9c/dc8/f10e 0 2024-09-18T21:13:00.863 INFO:tasks.workunit.client.0.smithi077.stdout:7/759: read d12/d22/d59/d5a/f70 [2583598,73241] 0 2024-09-18T21:13:00.866 INFO:tasks.workunit.client.0.smithi077.stdout:0/810: dread d8/d1a/f42 [0,4194304] 0 2024-09-18T21:13:00.866 INFO:tasks.workunit.client.0.smithi077.stdout:0/811: dread - d8/d1a/d39/d3b/d9a/dbd/ff2 zero size 2024-09-18T21:13:00.867 INFO:tasks.workunit.client.0.smithi077.stdout:0/812: stat d8/d1a/d35 0 2024-09-18T21:13:00.868 INFO:tasks.workunit.client.1.smithi103.stdout:0/755: dread d1/f29 [0,4194304] 0 2024-09-18T21:13:00.869 INFO:tasks.workunit.client.0.smithi077.stdout:0/813: fdatasync d8/d1d/d80/f5e 0 2024-09-18T21:13:00.870 INFO:tasks.workunit.client.1.smithi103.stdout:5/852: rename de/d1f/l21 to de/d1f/d3b/d51/d57/l115 0 2024-09-18T21:13:00.874 INFO:tasks.workunit.client.1.smithi103.stdout:2/726: dwrite d3/d5/d2f/d93/fa1 [0,4194304] 0 2024-09-18T21:13:00.874 INFO:tasks.workunit.client.1.smithi103.stdout:9/824: rename d18/d52/d6f/d8e/db4/lc2 to d18/d29/d68/d92/l10f 0 2024-09-18T21:13:00.875 INFO:tasks.workunit.client.1.smithi103.stdout:2/727: fdatasync d3/f6e 0 2024-09-18T21:13:00.876 INFO:tasks.workunit.client.0.smithi077.stdout:0/814: mknod d8/d37/d66/c103 0 2024-09-18T21:13:00.876 INFO:tasks.workunit.client.1.smithi103.stdout:2/728: chown d3/d5/d2f/d5b/l99 3347 1 2024-09-18T21:13:00.877 INFO:tasks.workunit.client.0.smithi077.stdout:0/815: stat d8/d1a/d39/f3c 0 2024-09-18T21:13:00.880 INFO:tasks.workunit.client.0.smithi077.stdout:7/760: unlink d12/d31/f48 0 2024-09-18T21:13:00.882 INFO:tasks.workunit.client.0.smithi077.stdout:4/690: getdents d3/dc/d51/d53 0 2024-09-18T21:13:00.882 INFO:tasks.workunit.client.0.smithi077.stdout:5/787: dread d0/d6/f48 [0,4194304] 0 2024-09-18T21:13:00.884 INFO:tasks.workunit.client.0.smithi077.stdout:5/788: chown d0/df/d10 0 1 2024-09-18T21:13:00.884 INFO:tasks.workunit.client.0.smithi077.stdout:4/691: fsync d3/dc/d32/d45/fd1 0 2024-09-18T21:13:00.885 INFO:tasks.workunit.client.1.smithi103.stdout:1/764: getdents d0/d2/d9/d10/d5d 0 2024-09-18T21:13:00.887 INFO:tasks.workunit.client.1.smithi103.stdout:1/765: truncate d0/d2/fca 253663 0 2024-09-18T21:13:00.887 INFO:tasks.workunit.client.0.smithi077.stdout:8/688: write d2/d5f/da8/d20/f96 [423216,108832] 0 2024-09-18T21:13:00.887 INFO:tasks.workunit.client.0.smithi077.stdout:0/816: creat d8/d37/d66/db4/f104 x:0 0 0 2024-09-18T21:13:00.888 INFO:tasks.workunit.client.1.smithi103.stdout:9/825: unlink d18/d8d/d2f/c49 0 2024-09-18T21:13:00.890 INFO:tasks.workunit.client.1.smithi103.stdout:6/801: write d2/d3/d8/f20 [213238,41290] 0 2024-09-18T21:13:00.891 INFO:tasks.workunit.client.0.smithi077.stdout:8/689: write d2/d5f/da8/d26/fcd [3226705,69004] 0 2024-09-18T21:13:00.891 INFO:tasks.workunit.client.0.smithi077.stdout:6/681: getdents d7/d7e/d11/d3e/dcd 0 2024-09-18T21:13:00.894 INFO:tasks.workunit.client.0.smithi077.stdout:8/690: readlink d2/d5f/l89 0 2024-09-18T21:13:00.896 INFO:tasks.workunit.client.1.smithi103.stdout:5/853: dread de/d3e/f19 [0,4194304] 0 2024-09-18T21:13:00.897 INFO:tasks.workunit.client.0.smithi077.stdout:5/789: dwrite d0/fbf [0,4194304] 0 2024-09-18T21:13:00.900 INFO:tasks.workunit.client.1.smithi103.stdout:1/766: unlink d0/d2/d9/d10/d5d/f95 0 2024-09-18T21:13:00.901 INFO:tasks.workunit.client.1.smithi103.stdout:5/854: read - de/d3e/ff5 zero size 2024-09-18T21:13:00.901 INFO:tasks.workunit.client.1.smithi103.stdout:9/826: chown c7 235246 1 2024-09-18T21:13:00.901 INFO:tasks.workunit.client.1.smithi103.stdout:9/827: chown d18/d52/d6f 13223 1 2024-09-18T21:13:00.901 INFO:tasks.workunit.client.1.smithi103.stdout:9/828: readlink d18/d8d/laf 0 2024-09-18T21:13:00.901 INFO:tasks.workunit.client.0.smithi077.stdout:9/700: dwrite d1/d54/d81/fca [0,4194304] 0 2024-09-18T21:13:00.903 INFO:tasks.workunit.client.0.smithi077.stdout:7/761: mkdir d12/dd5/d102 0 2024-09-18T21:13:00.904 INFO:tasks.workunit.client.0.smithi077.stdout:7/762: chown d12/d22/daa/dc0/d62/ce8 41728 1 2024-09-18T21:13:00.904 INFO:tasks.workunit.client.1.smithi103.stdout:2/729: fdatasync d3/d5/d2c/f65 0 2024-09-18T21:13:00.905 INFO:tasks.workunit.client.1.smithi103.stdout:2/730: chown d3/d5/d2f 1598719 1 2024-09-18T21:13:00.905 INFO:tasks.workunit.client.0.smithi077.stdout:4/692: creat d3/d7/d42/dd8/fda x:0 0 0 2024-09-18T21:13:00.906 INFO:tasks.workunit.client.0.smithi077.stdout:6/682: rmdir d7/d7e/d11/d3e/d42/dbb/d31 39 2024-09-18T21:13:00.907 INFO:tasks.workunit.client.0.smithi077.stdout:5/790: creat d0/df/d10/d47/da0/f105 x:0 0 0 2024-09-18T21:13:00.908 INFO:tasks.workunit.client.0.smithi077.stdout:0/817: mknod d8/d1a/d35/c105 0 2024-09-18T21:13:00.909 INFO:tasks.workunit.client.0.smithi077.stdout:0/818: chown d8/d37/d95/de4 533 1 2024-09-18T21:13:00.910 INFO:tasks.workunit.client.1.smithi103.stdout:1/767: mknod d0/d2/d9/d9e/d7a/dd0/df9/d68/d81/da2/da4/dc2/c108 0 2024-09-18T21:13:00.910 INFO:tasks.workunit.client.0.smithi077.stdout:2/811: fdatasync d1/d4/d5/d1a/d2e/f97 0 2024-09-18T21:13:00.913 INFO:tasks.workunit.client.0.smithi077.stdout:4/693: creat d3/d77/d9c/fdb x:0 0 0 2024-09-18T21:13:00.914 INFO:tasks.workunit.client.1.smithi103.stdout:0/756: creat d1/d5/de/dc0/d8c/dce/f10d x:0 0 0 2024-09-18T21:13:00.915 INFO:tasks.workunit.client.0.smithi077.stdout:5/791: creat d0/d6/daa/f106 x:0 0 0 2024-09-18T21:13:00.916 INFO:tasks.workunit.client.1.smithi103.stdout:2/731: dwrite d3/d5/d25/d98/fbb [0,4194304] 0 2024-09-18T21:13:00.916 INFO:tasks.workunit.client.1.smithi103.stdout:1/768: fdatasync d0/ff 0 2024-09-18T21:13:00.917 INFO:tasks.workunit.client.1.smithi103.stdout:6/802: dread d2/d24/d5a/f64 [0,4194304] 0 2024-09-18T21:13:00.918 INFO:tasks.workunit.client.0.smithi077.stdout:0/819: rmdir d8/d1d 39 2024-09-18T21:13:00.921 INFO:tasks.workunit.client.0.smithi077.stdout:2/812: dwrite d1/d4/d5/d1a/d113/d81/dc4/f102 [0,4194304] 0 2024-09-18T21:13:00.922 INFO:tasks.workunit.client.0.smithi077.stdout:7/763: mkdir d12/d31/d77/d93/d89/dfe/d103 0 2024-09-18T21:13:00.923 INFO:tasks.workunit.client.1.smithi103.stdout:6/803: dwrite d2/d3/fdf [0,4194304] 0 2024-09-18T21:13:00.923 INFO:tasks.workunit.client.1.smithi103.stdout:7/782: sync 2024-09-18T21:13:00.923 INFO:tasks.workunit.client.1.smithi103.stdout:8/884: sync 2024-09-18T21:13:00.923 INFO:tasks.workunit.client.1.smithi103.stdout:3/780: sync 2024-09-18T21:13:00.926 INFO:tasks.workunit.client.1.smithi103.stdout:3/781: chown d1/da/df/f77 3 1 2024-09-18T21:13:00.930 INFO:tasks.workunit.client.0.smithi077.stdout:6/683: link d7/d7e/d11/d3e/d42/f72 d7/d7e/d11/dd8/fed 0 2024-09-18T21:13:00.934 INFO:tasks.workunit.client.0.smithi077.stdout:6/684: stat d7/d7e/d11/d3e/d42/dbb/d5c/f6f 0 2024-09-18T21:13:00.934 INFO:tasks.workunit.client.0.smithi077.stdout:4/694: rename d3/d7/f82 to d3/d7/d6c/fdc 0 2024-09-18T21:13:00.937 INFO:tasks.workunit.client.0.smithi077.stdout:0/820: mknod d8/d1a/d39/d3b/d9a/dbd/c106 0 2024-09-18T21:13:00.940 INFO:tasks.workunit.client.0.smithi077.stdout:9/701: dwrite d1/d54/f5c [0,4194304] 0 2024-09-18T21:13:00.941 INFO:tasks.workunit.client.1.smithi103.stdout:5/855: rename de/l107 to de/d1f/d3b/l116 0 2024-09-18T21:13:00.941 INFO:tasks.workunit.client.0.smithi077.stdout:0/821: write d8/d1a/d35/d6d/fc2 [196538,86055] 0 2024-09-18T21:13:00.944 INFO:tasks.workunit.client.1.smithi103.stdout:8/885: write d4/d81/dd7/dde/d59/d9c/f10a [1226293,128576] 0 2024-09-18T21:13:00.946 INFO:tasks.workunit.client.1.smithi103.stdout:6/804: truncate d2/d24/f65 3276545 0 2024-09-18T21:13:00.951 INFO:tasks.workunit.client.1.smithi103.stdout:8/886: dwrite d4/f116 [0,4194304] 0 2024-09-18T21:13:00.953 INFO:tasks.workunit.client.1.smithi103.stdout:8/887: truncate d4/d2d/d87/fa7 790846 0 2024-09-18T21:13:00.954 INFO:tasks.workunit.client.0.smithi077.stdout:7/764: rename fb to d12/d31/d77/d93/d89/dfe/f104 0 2024-09-18T21:13:00.956 INFO:tasks.workunit.client.0.smithi077.stdout:5/792: dwrite d0/df/d10/d5c/d74/fc4 [0,4194304] 0 2024-09-18T21:13:00.957 INFO:tasks.workunit.client.1.smithi103.stdout:3/782: mkdir d1/d23/d25/d4f/d58/d68/d50/dea 0 2024-09-18T21:13:00.958 INFO:tasks.workunit.client.1.smithi103.stdout:3/783: truncate d1/d2/d18/d30/fb8 1797640 0 2024-09-18T21:13:00.959 INFO:tasks.workunit.client.1.smithi103.stdout:1/769: symlink d0/d2/d2b/d3a/d42/d72/l109 0 2024-09-18T21:13:00.960 INFO:tasks.workunit.client.0.smithi077.stdout:4/695: dread d3/f26 [0,4194304] 0 2024-09-18T21:13:00.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:00 smithi077 ceph-mon[27689]: pgmap v21: 65 pgs: 65 active+clean; 2.8 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 112 MiB/s rd, 322 MiB/s wr, 565 op/s 2024-09-18T21:13:00.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:00 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:00.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:00 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:00.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:00 smithi077 ceph-mon[27689]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:13:00.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:00 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:13:00.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:00 smithi077 ceph-mon[27689]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:13:00.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:00 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:13:00.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:00 smithi077 ceph-mon[27689]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:13:00.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:00 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-18T21:13:00.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:00 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:00.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:00 smithi077 ceph-mon[27689]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:13:00.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:00 smithi077 ceph-mon[27689]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:13:00.964 INFO:tasks.workunit.client.1.smithi103.stdout:2/732: truncate d3/d5/f27 25099 0 2024-09-18T21:13:00.965 INFO:tasks.workunit.client.1.smithi103.stdout:5/856: rmdir de/d1f/d3b/d58/dc4/d9c 39 2024-09-18T21:13:00.971 INFO:tasks.workunit.client.0.smithi077.stdout:4/696: dwrite d3/dc/f47 [0,4194304] 0 2024-09-18T21:13:00.973 INFO:tasks.workunit.client.1.smithi103.stdout:6/805: fsync d2/d3/d7f/d91/de5/ff1 0 2024-09-18T21:13:00.974 INFO:tasks.workunit.client.0.smithi077.stdout:6/685: dwrite d7/d7e/d11/dd8/fed [4194304,4194304] 0 2024-09-18T21:13:00.982 INFO:tasks.workunit.client.0.smithi077.stdout:0/822: dwrite d8/d1a/d39/d64/f93 [0,4194304] 0 2024-09-18T21:13:00.983 INFO:tasks.workunit.client.1.smithi103.stdout:1/770: mkdir d0/d2/d9/d10/d8d/d10a 0 2024-09-18T21:13:00.990 INFO:tasks.workunit.client.1.smithi103.stdout:3/784: dread d1/d23/d25/d4f/d72/d85/fab [0,4194304] 0 2024-09-18T21:13:00.998 INFO:tasks.workunit.client.1.smithi103.stdout:3/785: dwrite d1/d2/d18/d30/f3f [4194304,4194304] 0 2024-09-18T21:13:01.000 INFO:tasks.workunit.client.0.smithi077.stdout:4/697: dread d3/d35/f37 [0,4194304] 0 2024-09-18T21:13:01.004 INFO:tasks.workunit.client.1.smithi103.stdout:8/888: dread d4/d81/d65/f83 [0,4194304] 0 2024-09-18T21:13:01.008 INFO:tasks.workunit.client.1.smithi103.stdout:4/903: sync 2024-09-18T21:13:01.018 INFO:tasks.workunit.client.0.smithi077.stdout:5/793: mkdir d0/d6/d40/d107 0 2024-09-18T21:13:01.019 INFO:tasks.workunit.client.0.smithi077.stdout:5/794: chown d0/d6/d3b/d64/d67/cc3 726 1 2024-09-18T21:13:01.022 INFO:tasks.workunit.client.0.smithi077.stdout:9/702: symlink d1/dd/lf2 0 2024-09-18T21:13:01.023 INFO:tasks.workunit.client.0.smithi077.stdout:2/813: link d1/d4/d5/d1a/d113/l8c d1/d4/d5/d1a/d2e/d7e/d10f/l11a 0 2024-09-18T21:13:01.025 INFO:tasks.workunit.client.0.smithi077.stdout:9/703: truncate d1/dd/d11/d1c/d38/d46/d55/d7f/fd2 484876 0 2024-09-18T21:13:01.026 INFO:tasks.workunit.client.1.smithi103.stdout:2/733: write d3/d5/d2f/d48/fa6 [1403285,51166] 0 2024-09-18T21:13:01.029 INFO:tasks.workunit.client.1.smithi103.stdout:1/771: creat d0/d2/d2b/d3a/d42/d72/db0/f10b x:0 0 0 2024-09-18T21:13:01.031 INFO:tasks.workunit.client.0.smithi077.stdout:4/698: creat d3/dc/d32/d45/fdd x:0 0 0 2024-09-18T21:13:01.032 INFO:tasks.workunit.client.1.smithi103.stdout:3/786: creat d1/d23/d25/d4f/d72/d7e/feb x:0 0 0 2024-09-18T21:13:01.036 INFO:tasks.workunit.client.0.smithi077.stdout:7/765: write fa [224191,18524] 0 2024-09-18T21:13:01.036 INFO:tasks.workunit.client.1.smithi103.stdout:8/889: fsync d4/d2d/d3d/f5a 0 2024-09-18T21:13:01.038 INFO:tasks.workunit.client.1.smithi103.stdout:4/904: symlink d9/d1c/dcd/l12c 0 2024-09-18T21:13:01.038 INFO:tasks.workunit.client.0.smithi077.stdout:9/704: rmdir d1/dd/d11/d1c/d38 39 2024-09-18T21:13:01.039 INFO:tasks.workunit.client.0.smithi077.stdout:5/795: write d0/df/d10/f45 [2131597,55830] 0 2024-09-18T21:13:01.040 INFO:tasks.workunit.client.0.smithi077.stdout:0/823: fdatasync d8/d1d/d80/fdd 0 2024-09-18T21:13:01.041 INFO:tasks.workunit.client.0.smithi077.stdout:4/699: creat d3/d77/d9c/db9/fde x:0 0 0 2024-09-18T21:13:01.043 INFO:tasks.workunit.client.1.smithi103.stdout:6/806: fdatasync d2/d3/d8/f29 0 2024-09-18T21:13:01.044 INFO:tasks.workunit.client.0.smithi077.stdout:2/814: mknod d1/d4/d5/d10b/c11b 0 2024-09-18T21:13:01.045 INFO:tasks.workunit.client.0.smithi077.stdout:2/815: stat d1/d4/d5/d1a/d2e/f97 0 2024-09-18T21:13:01.047 INFO:tasks.workunit.client.1.smithi103.stdout:3/787: creat d1/d23/d25/da1/da5/fec x:0 0 0 2024-09-18T21:13:01.048 INFO:tasks.workunit.client.0.smithi077.stdout:0/824: readlink d8/d26/l29 0 2024-09-18T21:13:01.049 INFO:tasks.workunit.client.1.smithi103.stdout:4/905: mknod d9/d38/d72/d94/c12d 0 2024-09-18T21:13:01.050 INFO:tasks.workunit.client.0.smithi077.stdout:0/825: write d8/d1a/d39/d3b/d9a/fd6 [1113871,60876] 0 2024-09-18T21:13:01.051 INFO:tasks.workunit.client.1.smithi103.stdout:9/829: rename d18/c3b to d18/d8d/c110 0 2024-09-18T21:13:01.052 INFO:tasks.workunit.client.0.smithi077.stdout:9/705: dwrite d1/dd/d11/d1c/d38/d46/f8a [0,4194304] 0 2024-09-18T21:13:01.052 INFO:tasks.workunit.client.1.smithi103.stdout:5/857: creat de/d1f/d3b/d58/dc4/f117 x:0 0 0 2024-09-18T21:13:01.054 INFO:tasks.workunit.client.0.smithi077.stdout:9/706: chown d1/dd/d11/d15/d80/fa5 350 1 2024-09-18T21:13:01.055 INFO:tasks.workunit.client.1.smithi103.stdout:6/807: creat d2/d3/d7f/d91/de5/fff x:0 0 0 2024-09-18T21:13:01.055 INFO:tasks.workunit.client.0.smithi077.stdout:5/796: mknod d0/d6/c108 0 2024-09-18T21:13:01.056 INFO:tasks.workunit.client.1.smithi103.stdout:1/772: mknod d0/d2/d9/c10c 0 2024-09-18T21:13:01.058 INFO:tasks.workunit.client.1.smithi103.stdout:3/788: write d1/d2/d18/d30/f45 [3215636,102417] 0 2024-09-18T21:13:01.061 INFO:tasks.workunit.client.1.smithi103.stdout:3/789: readlink d1/d23/d25/d4f/l9f 0 2024-09-18T21:13:01.061 INFO:tasks.workunit.client.1.smithi103.stdout:0/757: rename d1/d5/de/d22/c2f to d1/d5/de/dc0/db0/c10e 0 2024-09-18T21:13:01.062 INFO:tasks.workunit.client.0.smithi077.stdout:2/816: creat d1/d4/d5/d1a/d2e/d41/d2c/ddb/d106/f11c x:0 0 0 2024-09-18T21:13:01.063 INFO:tasks.workunit.client.1.smithi103.stdout:3/790: dread - d1/d23/d25/d4f/fd2 zero size 2024-09-18T21:13:01.064 INFO:tasks.workunit.client.0.smithi077.stdout:9/707: symlink d1/dd/d11/d2d/dc6/lf3 0 2024-09-18T21:13:01.065 INFO:tasks.workunit.client.1.smithi103.stdout:5/858: truncate de/d2d/d7f/f45 794049 0 2024-09-18T21:13:01.065 INFO:tasks.workunit.client.1.smithi103.stdout:1/773: dread d0/d2/d9/d10/d5d/d6f/f8b [0,4194304] 0 2024-09-18T21:13:01.065 INFO:tasks.workunit.client.1.smithi103.stdout:5/859: readlink de/d3e/l5e 0 2024-09-18T21:13:01.066 INFO:tasks.workunit.client.0.smithi077.stdout:9/708: chown d1/dd/d11/d1c/d38/d46/d55/dce/fc9 159609795 1 2024-09-18T21:13:01.067 INFO:tasks.workunit.client.1.smithi103.stdout:6/808: rmdir d2/d3/d8/d4c/d79 39 2024-09-18T21:13:01.069 INFO:tasks.workunit.client.1.smithi103.stdout:0/758: dread - d1/d5/de/d19/d1e/ff0 zero size 2024-09-18T21:13:01.071 INFO:tasks.workunit.client.1.smithi103.stdout:2/734: fsync d3/d5/d2f/d48/fa6 0 2024-09-18T21:13:01.071 INFO:tasks.workunit.client.1.smithi103.stdout:8/890: rename d4/d2d/d4e/f111 to d4/d2d/dc1/dee/f11d 0 2024-09-18T21:13:01.073 INFO:tasks.workunit.client.1.smithi103.stdout:8/891: read d4/de/fef [2460255,20397] 0 2024-09-18T21:13:01.073 INFO:tasks.workunit.client.0.smithi077.stdout:4/700: getdents d3/dc/d51/d53/d89 0 2024-09-18T21:13:01.077 INFO:tasks.workunit.client.0.smithi077.stdout:9/709: creat d1/ff4 x:0 0 0 2024-09-18T21:13:01.078 INFO:tasks.workunit.client.1.smithi103.stdout:0/759: creat d1/d5/de/dc0/d8c/dce/d9f/d4f/d68/f10f x:0 0 0 2024-09-18T21:13:01.080 INFO:tasks.workunit.client.1.smithi103.stdout:2/735: creat d3/d5/d25/dd5/f104 x:0 0 0 2024-09-18T21:13:01.081 INFO:tasks.workunit.client.0.smithi077.stdout:4/701: dwrite d3/d7/d6c/f90 [0,4194304] 0 2024-09-18T21:13:01.081 INFO:tasks.workunit.client.0.smithi077.stdout:9/710: creat d1/dd/d57/ff5 x:0 0 0 2024-09-18T21:13:01.083 INFO:tasks.workunit.client.0.smithi077.stdout:4/702: write d3/dc/d32/d45/d5e/fc2 [789768,1974] 0 2024-09-18T21:13:01.084 INFO:tasks.workunit.client.1.smithi103.stdout:5/860: mkdir de/d1f/d3b/d3c/d62/d118 0 2024-09-18T21:13:01.085 INFO:tasks.workunit.client.0.smithi077.stdout:4/703: write d3/dc/d20/f97 [2460837,110919] 0 2024-09-18T21:13:01.085 INFO:tasks.workunit.client.1.smithi103.stdout:4/906: getdents d9/d38/d72/df0/d83/db6/d41/d64 0 2024-09-18T21:13:01.086 INFO:tasks.workunit.client.1.smithi103.stdout:4/907: chown d9/d38/d72/d85/dd8/d10b 26477 1 2024-09-18T21:13:01.089 INFO:tasks.workunit.client.1.smithi103.stdout:7/783: sync 2024-09-18T21:13:01.090 INFO:tasks.workunit.client.0.smithi077.stdout:0/826: dread d8/d26/f54 [4194304,4194304] 0 2024-09-18T21:13:01.094 INFO:tasks.workunit.client.1.smithi103.stdout:8/892: mknod d4/d26/d56/c11e 0 2024-09-18T21:13:01.094 INFO:tasks.workunit.client.0.smithi077.stdout:4/704: dwrite d3/d7/d7b/f92 [0,4194304] 0 2024-09-18T21:13:01.095 INFO:tasks.workunit.client.1.smithi103.stdout:8/893: write d4/d2d/dc1/f11c [212986,96932] 0 2024-09-18T21:13:01.097 INFO:tasks.workunit.client.0.smithi077.stdout:0/827: unlink d8/d1a/d39/f3c 0 2024-09-18T21:13:01.099 INFO:tasks.workunit.client.0.smithi077.stdout:9/711: link d1/dd/l77 d1/dd/d11/d1c/d38/d46/d55/dce/lf6 0 2024-09-18T21:13:01.100 INFO:tasks.workunit.client.0.smithi077.stdout:4/705: mknod d3/d35/cdf 0 2024-09-18T21:13:01.100 INFO:tasks.workunit.client.0.smithi077.stdout:2/817: dread d1/d4/d5/d1a/d2e/d40/f7b [0,4194304] 0 2024-09-18T21:13:01.101 INFO:tasks.workunit.client.1.smithi103.stdout:8/894: dwrite d4/d81/dd7/dde/fb1 [0,4194304] 0 2024-09-18T21:13:01.101 INFO:tasks.workunit.client.1.smithi103.stdout:1/774: rename d0/d2/d2b/d3a/d42/d72/db0/da7/fc4 to d0/d2/d2b/d3a/f10d 0 2024-09-18T21:13:01.102 INFO:tasks.workunit.client.0.smithi077.stdout:0/828: mknod d8/d37/d66/d87/c107 0 2024-09-18T21:13:01.102 INFO:tasks.workunit.client.1.smithi103.stdout:8/895: dread - d4/d2d/dc1/dee/f11d zero size 2024-09-18T21:13:01.105 INFO:tasks.workunit.client.1.smithi103.stdout:4/908: symlink d9/d38/d72/d85/dd8/l12e 0 2024-09-18T21:13:01.105 INFO:tasks.workunit.client.1.smithi103.stdout:8/896: dread d4/de/fbc [0,4194304] 0 2024-09-18T21:13:01.106 INFO:tasks.workunit.client.0.smithi077.stdout:4/706: creat d3/d7/fe0 x:0 0 0 2024-09-18T21:13:01.107 INFO:tasks.workunit.client.1.smithi103.stdout:7/784: mkdir d1/df/d43/d63/d67/dfd 0 2024-09-18T21:13:01.111 INFO:tasks.workunit.client.1.smithi103.stdout:3/791: getdents d1/d23/d25/d4f/d72/d85 0 2024-09-18T21:13:01.112 INFO:tasks.workunit.client.0.smithi077.stdout:9/712: creat d1/dd/d57/d97/ff7 x:0 0 0 2024-09-18T21:13:01.112 INFO:tasks.workunit.client.0.smithi077.stdout:4/707: creat d3/d7/d42/dd8/fe1 x:0 0 0 2024-09-18T21:13:01.116 INFO:tasks.workunit.client.0.smithi077.stdout:9/713: read d1/dd/d11/d15/d80/f91 [4057574,83387] 0 2024-09-18T21:13:01.117 INFO:tasks.workunit.client.0.smithi077.stdout:0/829: symlink d8/d37/d95/l108 0 2024-09-18T21:13:01.117 INFO:tasks.workunit.client.0.smithi077.stdout:4/708: symlink d3/dc/d20/le2 0 2024-09-18T21:13:01.118 INFO:tasks.workunit.client.0.smithi077.stdout:9/714: dread - d1/dd/d1a/d42/d4b/fbb zero size 2024-09-18T21:13:01.118 INFO:tasks.workunit.client.1.smithi103.stdout:4/909: mkdir d9/d38/db4/dec/d12f 0 2024-09-18T21:13:01.120 INFO:tasks.workunit.client.1.smithi103.stdout:7/785: mkdir d1/df/d42/d29/d48/dbb/ded/dfe 0 2024-09-18T21:13:01.122 INFO:tasks.workunit.client.1.smithi103.stdout:3/792: mkdir d1/d23/d25/d4f/d58/d68/d50/d54/ded 0 2024-09-18T21:13:01.123 INFO:tasks.workunit.client.1.smithi103.stdout:3/793: stat d1/d2/d18/d30/l41 0 2024-09-18T21:13:01.123 INFO:tasks.workunit.client.0.smithi077.stdout:0/830: fsync d8/d1a/d35/f82 0 2024-09-18T21:13:01.124 INFO:tasks.workunit.client.1.smithi103.stdout:3/794: write d1/d23/d25/d4f/d58/f6d [196186,112321] 0 2024-09-18T21:13:01.125 INFO:tasks.workunit.client.1.smithi103.stdout:8/897: mknod d4/c11f 0 2024-09-18T21:13:01.126 INFO:tasks.workunit.client.1.smithi103.stdout:4/910: symlink d9/d38/d58/l130 0 2024-09-18T21:13:01.129 INFO:tasks.workunit.client.1.smithi103.stdout:4/911: fsync d9/d38/d72/df0/d83/db6/d41/d64/ff1 0 2024-09-18T21:13:01.129 INFO:tasks.workunit.client.0.smithi077.stdout:4/709: dread d3/d77/f7a [0,4194304] 0 2024-09-18T21:13:01.129 INFO:tasks.workunit.client.1.smithi103.stdout:7/786: creat d1/df/d43/d52/d95/fff x:0 0 0 2024-09-18T21:13:01.130 INFO:tasks.workunit.client.0.smithi077.stdout:4/710: readlink d3/d77/l64 0 2024-09-18T21:13:01.132 INFO:tasks.workunit.client.1.smithi103.stdout:7/787: write d1/df/d42/d29/fbd [12818,38008] 0 2024-09-18T21:13:01.132 INFO:tasks.workunit.client.1.smithi103.stdout:3/795: dwrite d1/d64/fdd [0,4194304] 0 2024-09-18T21:13:01.132 INFO:tasks.workunit.client.0.smithi077.stdout:7/766: write d12/d22/daa/dc0/dac/dad/fb0 [34865,28867] 0 2024-09-18T21:13:01.134 INFO:tasks.workunit.client.1.smithi103.stdout:1/775: link d0/d2/d9/d9e/d7a/dd0/df9/d68/d81/da2/da4/dc2/cf7 d0/d2/d9/d9e/d7a/dd0/df9/d68/d81/da2/da4/dc2/c10e 0 2024-09-18T21:13:01.135 INFO:tasks.workunit.client.1.smithi103.stdout:7/788: write d1/df/d42/d1f/d5d/f71 [536198,127278] 0 2024-09-18T21:13:01.140 INFO:tasks.workunit.client.0.smithi077.stdout:9/715: creat d1/ff8 x:0 0 0 2024-09-18T21:13:01.143 INFO:tasks.workunit.client.0.smithi077.stdout:9/716: truncate d1/dd/d11/d72/f98 1241167 0 2024-09-18T21:13:01.144 INFO:tasks.workunit.client.1.smithi103.stdout:4/912: truncate d9/d1c/d106/f115 522053 0 2024-09-18T21:13:01.145 INFO:tasks.workunit.client.0.smithi077.stdout:7/767: creat d12/d56/ded/f105 x:0 0 0 2024-09-18T21:13:01.147 INFO:tasks.workunit.client.0.smithi077.stdout:5/797: write d0/d6/d3b/d64/f79 [3507217,15629] 0 2024-09-18T21:13:01.147 INFO:tasks.workunit.client.0.smithi077.stdout:7/768: write d12/d22/daa/dc0/d62/fba [941713,98122] 0 2024-09-18T21:13:01.148 INFO:tasks.workunit.client.1.smithi103.stdout:3/796: mkdir d1/d23/d25/d4f/d58/d68/d50/d54/dee 0 2024-09-18T21:13:01.150 INFO:tasks.workunit.client.0.smithi077.stdout:5/798: read - d0/df/d10/d4b/d80/fec zero size 2024-09-18T21:13:01.151 INFO:tasks.workunit.client.1.smithi103.stdout:9/830: write d18/d8d/d2f/f97 [267052,61742] 0 2024-09-18T21:13:01.151 INFO:tasks.workunit.client.1.smithi103.stdout:4/913: dwrite d9/d1c/dcd/fdf [0,4194304] 0 2024-09-18T21:13:01.152 INFO:tasks.workunit.client.1.smithi103.stdout:7/789: fsync d1/df/d42/d29/d48/dbb/d33/fae 0 2024-09-18T21:13:01.152 INFO:tasks.workunit.client.0.smithi077.stdout:9/717: truncate d1/dd/d11/d1c/d38/d46/d55/d9c/fb8 1620059 0 2024-09-18T21:13:01.154 INFO:tasks.workunit.client.1.smithi103.stdout:1/776: rename d0/d2/d9/d10/d8d to d0/d2/d9/d9e/d7a/dd0/d10f 0 2024-09-18T21:13:01.156 INFO:tasks.workunit.client.1.smithi103.stdout:1/777: read - d0/d2/d9/dc/d6e/dac/ffe zero size 2024-09-18T21:13:01.158 INFO:tasks.workunit.client.1.smithi103.stdout:6/809: write d2/d24/d5a/d67/d76/da4/fa3 [6954,115612] 0 2024-09-18T21:13:01.159 INFO:tasks.workunit.client.1.smithi103.stdout:6/810: stat d2/d24/d5a/d67/d76/da4/fd8 0 2024-09-18T21:13:01.160 INFO:tasks.workunit.client.1.smithi103.stdout:3/797: chown d1/da/ld 3968 1 2024-09-18T21:13:01.160 INFO:tasks.workunit.client.1.smithi103.stdout:6/811: readlink d2/d24/d38/l46 0 2024-09-18T21:13:01.161 INFO:tasks.workunit.client.1.smithi103.stdout:3/798: fdatasync d1/d23/d25/d4f/dce/fd6 0 2024-09-18T21:13:01.161 INFO:tasks.workunit.client.1.smithi103.stdout:8/898: truncate d4/de/fef 4902486 0 2024-09-18T21:13:01.162 INFO:tasks.workunit.client.1.smithi103.stdout:8/899: chown d4/d26/f1a 388096 1 2024-09-18T21:13:01.163 INFO:tasks.workunit.client.1.smithi103.stdout:2/736: write d3/d5/f86 [857559,96788] 0 2024-09-18T21:13:01.164 INFO:tasks.workunit.client.1.smithi103.stdout:8/900: write d4/d2d/d87/dbb/f113 [777122,70673] 0 2024-09-18T21:13:01.165 INFO:tasks.workunit.client.0.smithi077.stdout:5/799: creat d0/d6/dbd/f109 x:0 0 0 2024-09-18T21:13:01.167 INFO:tasks.workunit.client.1.smithi103.stdout:9/831: rename d18/d52/d6f/df8/ff4 to d18/d29/d68/d92/dd1/f111 0 2024-09-18T21:13:01.169 INFO:tasks.workunit.client.1.smithi103.stdout:1/778: mknod d0/d2/d9/d10/d5d/d6f/c110 0 2024-09-18T21:13:01.170 INFO:tasks.workunit.client.0.smithi077.stdout:5/800: mknod d0/df/d3d/d85/c10a 0 2024-09-18T21:13:01.171 INFO:tasks.workunit.client.1.smithi103.stdout:6/812: chown d2/c1e 8360858 1 2024-09-18T21:13:01.172 INFO:tasks.workunit.client.1.smithi103.stdout:3/799: mknod d1/d2/d18/d30/d4e/db1/cef 0 2024-09-18T21:13:01.173 INFO:tasks.workunit.client.0.smithi077.stdout:5/801: dread - d0/d6/d3b/f8f zero size 2024-09-18T21:13:01.173 INFO:tasks.workunit.client.1.smithi103.stdout:9/832: dread f17 [0,4194304] 0 2024-09-18T21:13:01.174 INFO:tasks.workunit.client.0.smithi077.stdout:5/802: chown d0/d6/dd/f30 89439 1 2024-09-18T21:13:01.174 INFO:tasks.workunit.client.1.smithi103.stdout:4/914: mknod d9/d1c/c131 0 2024-09-18T21:13:01.174 INFO:tasks.workunit.client.1.smithi103.stdout:3/800: readlink d1/da/df/d70/laa 0 2024-09-18T21:13:01.176 INFO:tasks.workunit.client.0.smithi077.stdout:2/818: write d1/d4/fbd [210717,122978] 0 2024-09-18T21:13:01.177 INFO:tasks.workunit.client.1.smithi103.stdout:8/901: creat d4/d81/dd7/dde/d59/d5e/f120 x:0 0 0 2024-09-18T21:13:01.178 INFO:tasks.workunit.client.1.smithi103.stdout:0/760: dwrite d1/d9/f5c [0,4194304] 0 2024-09-18T21:13:01.179 INFO:tasks.workunit.client.1.smithi103.stdout:1/779: readlink d0/d2/d9/dc/d6e/ldd 0 2024-09-18T21:13:01.180 INFO:tasks.workunit.client.0.smithi077.stdout:2/819: creat d1/d62/f11d x:0 0 0 2024-09-18T21:13:01.181 INFO:tasks.workunit.client.1.smithi103.stdout:6/813: dread - d2/d24/d5a/d67/fa0 zero size 2024-09-18T21:13:01.183 INFO:tasks.workunit.client.1.smithi103.stdout:0/761: fdatasync d1/d5/de/dc0/d8c/dce/d9f/d4f/f103 0 2024-09-18T21:13:01.187 INFO:tasks.workunit.client.1.smithi103.stdout:6/814: truncate d2/d3/d8/f59 893707 0 2024-09-18T21:13:01.189 INFO:tasks.workunit.client.1.smithi103.stdout:3/801: creat d1/d23/d25/d4f/dce/ff0 x:0 0 0 2024-09-18T21:13:01.189 INFO:tasks.workunit.client.1.smithi103.stdout:5/861: dwrite de/d1f/d3b/f4a [4194304,4194304] 0 2024-09-18T21:13:01.189 INFO:tasks.workunit.client.1.smithi103.stdout:8/902: dwrite d4/d2d/d3d/da0/dab/f117 [0,4194304] 0 2024-09-18T21:13:01.191 INFO:tasks.workunit.client.1.smithi103.stdout:8/903: readlink d4/d26/l2a 0 2024-09-18T21:13:01.192 INFO:tasks.workunit.client.1.smithi103.stdout:1/780: mkdir d0/d2/d2b/d111 0 2024-09-18T21:13:01.197 INFO:tasks.workunit.client.1.smithi103.stdout:7/790: getdents d1/df/d43/d63/d67/d5b 0 2024-09-18T21:13:01.197 INFO:tasks.workunit.client.1.smithi103.stdout:3/802: write d1/d23/d25/d4f/dce/fd4 [1470036,94270] 0 2024-09-18T21:13:01.197 INFO:tasks.workunit.client.0.smithi077.stdout:0/831: write d8/d1a/d39/d3b/d9a/fa2 [756402,108140] 0 2024-09-18T21:13:01.198 INFO:tasks.workunit.client.1.smithi103.stdout:9/833: truncate d18/d52/f8b 1336863 0 2024-09-18T21:13:01.199 INFO:tasks.workunit.client.1.smithi103.stdout:3/803: fsync d1/d2/d18/d30/d4e/f84 0 2024-09-18T21:13:01.199 INFO:tasks.workunit.client.1.smithi103.stdout:9/834: chown d18/d52/d6f/db9/f104 1610461 1 2024-09-18T21:13:01.202 INFO:tasks.workunit.client.1.smithi103.stdout:6/815: mknod d2/d24/d5a/d67/d76/da4/c100 0 2024-09-18T21:13:01.206 INFO:tasks.workunit.client.0.smithi077.stdout:4/711: dwrite d3/d35/f37 [0,4194304] 0 2024-09-18T21:13:01.208 INFO:tasks.workunit.client.0.smithi077.stdout:4/712: read d3/f26 [1125320,83136] 0 2024-09-18T21:13:01.209 INFO:tasks.workunit.client.1.smithi103.stdout:1/781: rename d0/d2/d9/dc/l94 to d0/d11/d5f/l112 0 2024-09-18T21:13:01.212 INFO:tasks.workunit.client.1.smithi103.stdout:7/791: creat d1/df/d42/d1f/d5d/dbe/f100 x:0 0 0 2024-09-18T21:13:01.213 INFO:tasks.workunit.client.0.smithi077.stdout:9/718: write d1/dd/d11/fad [863301,43541] 0 2024-09-18T21:13:01.214 INFO:tasks.workunit.client.0.smithi077.stdout:4/713: write d3/d7/d6c/fdc [275390,78043] 0 2024-09-18T21:13:01.215 INFO:tasks.workunit.client.0.smithi077.stdout:7/769: truncate d12/d22/f28 3465849 0 2024-09-18T21:13:01.217 INFO:tasks.workunit.client.0.smithi077.stdout:9/719: rename d1/dd/d11/d2d to d1/dd/d11/d2d/d59/de1/df9 22 2024-09-18T21:13:01.217 INFO:tasks.workunit.client.0.smithi077.stdout:9/720: readlink d1/dd/d11/d2d/dc6/lf3 0 2024-09-18T21:13:01.218 INFO:tasks.workunit.client.0.smithi077.stdout:7/770: dread d12/d22/d59/fdc [0,4194304] 0 2024-09-18T21:13:01.220 INFO:tasks.workunit.client.0.smithi077.stdout:0/832: getdents d8/d37/d95 0 2024-09-18T21:13:01.220 INFO:tasks.workunit.client.0.smithi077.stdout:9/721: dread - d1/dd/d11/d1c/d38/d46/d55/d7f/fb3 zero size 2024-09-18T21:13:01.221 INFO:tasks.workunit.client.1.smithi103.stdout:9/835: mknod d18/d29/d68/d78/c112 0 2024-09-18T21:13:01.221 INFO:tasks.workunit.client.1.smithi103.stdout:9/836: fdatasync d18/d52/d5e/fac 0 2024-09-18T21:13:01.222 INFO:tasks.workunit.client.0.smithi077.stdout:9/722: write d1/d54/d51/f9d [5166804,47695] 0 2024-09-18T21:13:01.225 INFO:tasks.workunit.client.1.smithi103.stdout:5/862: link de/d1f/d3b/d51/d57/db5/fde de/d1f/d3b/dfb/f119 0 2024-09-18T21:13:01.225 INFO:tasks.workunit.client.1.smithi103.stdout:2/737: write d3/d5/f61 [4080865,4175] 0 2024-09-18T21:13:01.226 INFO:tasks.workunit.client.0.smithi077.stdout:0/833: mkdir d8/d1a/d39/d109 0 2024-09-18T21:13:01.228 INFO:tasks.workunit.client.0.smithi077.stdout:5/803: write d0/df/d10/d4b/f65 [852265,69322] 0 2024-09-18T21:13:01.230 INFO:tasks.workunit.client.0.smithi077.stdout:2/820: write d1/d4/d5/d1a/d113/d81/fa5 [731517,38345] 0 2024-09-18T21:13:01.232 INFO:tasks.workunit.client.0.smithi077.stdout:9/723: mknod d1/dd/d1a/d42/d4b/cfa 0 2024-09-18T21:13:01.234 INFO:tasks.workunit.client.1.smithi103.stdout:4/915: write d9/d38/d72/df0/d83/db6/d41/d64/d118/f111 [532000,97842] 0 2024-09-18T21:13:01.234 INFO:tasks.workunit.client.1.smithi103.stdout:7/792: stat d1/df/c11 0 2024-09-18T21:13:01.236 INFO:tasks.workunit.client.1.smithi103.stdout:4/916: write d9/d38/d72/df0/d83/db6/d41/d64/ff1 [510529,104302] 0 2024-09-18T21:13:01.239 INFO:tasks.workunit.client.1.smithi103.stdout:4/917: fdatasync d9/d38/d72/df0/d83/db6/d21/d80/f9d 0 2024-09-18T21:13:01.239 INFO:tasks.workunit.client.1.smithi103.stdout:0/762: write d1/d5/de/d22/f83 [4382997,98874] 0 2024-09-18T21:13:01.241 INFO:tasks.workunit.client.1.smithi103.stdout:4/918: chown d9/d38/db4/ce1 7234775 1 2024-09-18T21:13:01.242 INFO:tasks.workunit.client.1.smithi103.stdout:7/793: dwrite d1/df/d43/d63/db9/d72/fe8 [0,4194304] 0 2024-09-18T21:13:01.242 INFO:tasks.workunit.client.0.smithi077.stdout:2/821: truncate d1/d4/d5/d1a/d2e/f5a 310790 0 2024-09-18T21:13:01.242 INFO:tasks.workunit.client.0.smithi077.stdout:4/714: dread d3/dc/d24/f43 [0,4194304] 0 2024-09-18T21:13:01.245 INFO:tasks.workunit.client.1.smithi103.stdout:3/804: write d1/d2/f8 [500079,120358] 0 2024-09-18T21:13:01.247 INFO:tasks.workunit.client.0.smithi077.stdout:0/834: dread d8/d1a/d35/f85 [0,4194304] 0 2024-09-18T21:13:01.247 INFO:tasks.workunit.client.1.smithi103.stdout:2/738: rename d3/d5/d25/ce1 to d3/d5/d2c/c105 0 2024-09-18T21:13:01.247 INFO:tasks.workunit.client.1.smithi103.stdout:3/805: stat d1/d23/d47/dbb/c8e 0 2024-09-18T21:13:01.248 INFO:tasks.workunit.client.0.smithi077.stdout:7/771: write d12/d31/d77/d93/d89/d94/ffb [2153540,89216] 0 2024-09-18T21:13:01.249 INFO:tasks.workunit.client.0.smithi077.stdout:4/715: mknod d3/d7/ce3 0 2024-09-18T21:13:01.249 INFO:tasks.workunit.client.1.smithi103.stdout:2/739: stat d3/d5/d25/fe0 0 2024-09-18T21:13:01.250 INFO:tasks.workunit.client.1.smithi103.stdout:3/806: write d1/d23/d25/d4f/d58/d86/fdc [920766,66484] 0 2024-09-18T21:13:01.251 INFO:tasks.workunit.client.0.smithi077.stdout:7/772: truncate d12/d22/d59/d5a/ff9 964229 0 2024-09-18T21:13:01.252 INFO:tasks.workunit.client.0.smithi077.stdout:0/835: fdatasync d8/d1a/d35/f85 0 2024-09-18T21:13:01.255 INFO:tasks.workunit.client.0.smithi077.stdout:4/716: creat d3/d7/fe4 x:0 0 0 2024-09-18T21:13:01.257 INFO:tasks.workunit.client.0.smithi077.stdout:9/724: write d1/d54/d27/f9b [607789,935] 0 2024-09-18T21:13:01.258 INFO:tasks.workunit.client.1.smithi103.stdout:9/837: mknod d18/d52/d6f/d8e/c113 0 2024-09-18T21:13:01.259 INFO:tasks.workunit.client.0.smithi077.stdout:0/836: read - d8/d37/faa zero size 2024-09-18T21:13:01.259 INFO:tasks.workunit.client.1.smithi103.stdout:9/838: write d18/d29/d68/fb1 [2446923,111579] 0 2024-09-18T21:13:01.260 INFO:tasks.workunit.client.1.smithi103.stdout:4/919: creat d9/d1c/dcd/dd1/f132 x:0 0 0 2024-09-18T21:13:01.261 INFO:tasks.workunit.client.1.smithi103.stdout:4/920: write f6 [671216,53154] 0 2024-09-18T21:13:01.262 INFO:tasks.workunit.client.0.smithi077.stdout:4/717: mkdir d3/d77/de5 0 2024-09-18T21:13:01.263 INFO:tasks.workunit.client.1.smithi103.stdout:4/921: readlink d9/d38/d72/df0/d83/db6/d41/l62 0 2024-09-18T21:13:01.264 INFO:tasks.workunit.client.0.smithi077.stdout:5/804: dread d0/d6/dd/f3a [0,4194304] 0 2024-09-18T21:13:01.264 INFO:tasks.workunit.client.1.smithi103.stdout:4/922: readlink d9/d38/d72/df0/d61/d91/d9e/d48/l126 0 2024-09-18T21:13:01.265 INFO:tasks.workunit.client.1.smithi103.stdout:4/923: chown d9/d38/db4/c102 0 1 2024-09-18T21:13:01.266 INFO:tasks.workunit.client.0.smithi077.stdout:7/773: mknod d12/c106 0 2024-09-18T21:13:01.267 INFO:tasks.workunit.client.1.smithi103.stdout:6/816: creat d2/d24/d5a/d67/d76/d43/f101 x:0 0 0 2024-09-18T21:13:01.267 INFO:tasks.workunit.client.0.smithi077.stdout:9/725: dwrite d1/dd/d11/d1c/f25 [0,4194304] 0 2024-09-18T21:13:01.270 INFO:tasks.workunit.client.1.smithi103.stdout:8/904: getdents d4/d81/dd7/dde 0 2024-09-18T21:13:01.273 INFO:tasks.workunit.client.1.smithi103.stdout:5/863: rename de/d1f/d3b/d51/c103 to de/d1f/d3b/d58/dd1/c11a 0 2024-09-18T21:13:01.274 INFO:tasks.workunit.client.0.smithi077.stdout:0/837: dwrite d8/d1a/d39/d3b/d79/fae [0,4194304] 0 2024-09-18T21:13:01.276 INFO:tasks.workunit.client.1.smithi103.stdout:0/763: dread d1/d5/de/dc0/dbf/d4e/f66 [0,4194304] 0 2024-09-18T21:13:01.276 INFO:tasks.workunit.client.1.smithi103.stdout:7/794: write d1/df/d43/d63/d67/d5b/f70 [2242285,84082] 0 2024-09-18T21:13:01.277 INFO:tasks.workunit.client.0.smithi077.stdout:7/774: dwrite d12/d56/fa2 [0,4194304] 0 2024-09-18T21:13:01.278 INFO:tasks.workunit.client.1.smithi103.stdout:1/782: creat d0/d2/d2b/d3a/d42/d72/db0/da7/f113 x:0 0 0 2024-09-18T21:13:01.278 INFO:tasks.workunit.client.0.smithi077.stdout:7/775: chown d12/d56/ded/d101 8 1 2024-09-18T21:13:01.281 INFO:tasks.workunit.client.0.smithi077.stdout:4/718: creat d3/d77/fe6 x:0 0 0 2024-09-18T21:13:01.284 INFO:tasks.workunit.client.0.smithi077.stdout:5/805: creat d0/d6/d3b/d64/d67/f10b x:0 0 0 2024-09-18T21:13:01.285 INFO:tasks.workunit.client.0.smithi077.stdout:9/726: write d1/dd/d11/d15/d80/d85/fa1 [9026914,103291] 0 2024-09-18T21:13:01.285 INFO:tasks.workunit.client.0.smithi077.stdout:4/719: readlink d3/dc/d20/le2 0 2024-09-18T21:13:01.290 INFO:tasks.workunit.client.1.smithi103.stdout:2/740: symlink d3/d5/d2f/d32/d90/dd7/dc4/l106 0 2024-09-18T21:13:01.290 INFO:tasks.workunit.client.1.smithi103.stdout:5/864: dwrite de/d1f/d3b/d58/fff [0,4194304] 0 2024-09-18T21:13:01.290 INFO:tasks.workunit.client.0.smithi077.stdout:0/838: dwrite d8/d1a/d35/d6d/fac [0,4194304] 0 2024-09-18T21:13:01.291 INFO:tasks.workunit.client.0.smithi077.stdout:9/727: write d1/dd/d11/d1c/f53 [2034707,100791] 0 2024-09-18T21:13:01.291 INFO:tasks.workunit.client.1.smithi103.stdout:7/795: creat d1/df/d42/d1f/f101 x:0 0 0 2024-09-18T21:13:01.295 INFO:tasks.workunit.client.0.smithi077.stdout:4/720: unlink d3/dc/d51/fa4 0 2024-09-18T21:13:01.300 INFO:tasks.workunit.client.0.smithi077.stdout:5/806: rename d0/df/d10/d5c/d74/d89/l8e to d0/df/d10/d5c/d74/d89/l10c 0 2024-09-18T21:13:01.301 INFO:tasks.workunit.client.1.smithi103.stdout:2/741: dwrite d3/d5/fe [4194304,4194304] 0 2024-09-18T21:13:01.303 INFO:tasks.workunit.client.1.smithi103.stdout:1/783: creat d0/d2/d9/d9e/d7a/dd0/df9/d68/d81/da2/da4/dc2/f114 x:0 0 0 2024-09-18T21:13:01.304 INFO:tasks.workunit.client.0.smithi077.stdout:7/776: dwrite d12/d22/d59/d72/f57 [0,4194304] 0 2024-09-18T21:13:01.307 INFO:tasks.workunit.client.1.smithi103.stdout:0/764: dread d1/d5/de/dc0/f72 [0,4194304] 0 2024-09-18T21:13:01.310 INFO:tasks.workunit.client.1.smithi103.stdout:0/765: truncate d1/d5/de/dc0/d8c/dce/f10d 152317 0 2024-09-18T21:13:01.313 INFO:tasks.workunit.client.1.smithi103.stdout:0/766: truncate d1/d5/de/d22/d6a/fa9 753514 0 2024-09-18T21:13:01.383 INFO:tasks.workunit.client.0.smithi077.stdout:3/712: sync 2024-09-18T21:13:01.390 INFO:tasks.workunit.client.1.smithi103.stdout:4/924: sync 2024-09-18T21:13:01.391 INFO:tasks.workunit.client.1.smithi103.stdout:4/925: dread - d9/d1c/db1/dd5/feb zero size 2024-09-18T21:13:01.391 INFO:tasks.workunit.client.1.smithi103.stdout:6/817: symlink d2/d3/d8/d4c/d79/d9e/l102 0 2024-09-18T21:13:01.393 INFO:tasks.workunit.client.1.smithi103.stdout:4/926: chown d9/d38/d72/df0/d83/db6/d41/dfc/f12a 415 1 2024-09-18T21:13:01.402 INFO:tasks.workunit.client.0.smithi077.stdout:5/807: symlink d0/d6/d3b/d64/d95/l10d 0 2024-09-18T21:13:01.411 INFO:tasks.workunit.client.1.smithi103.stdout:7/796: mkdir d1/df/d42/d29/d48/d102 0 2024-09-18T21:13:01.412 INFO:tasks.workunit.client.1.smithi103.stdout:7/797: truncate d1/df/d42/d1f/d2e/f41 4485508 0 2024-09-18T21:13:01.413 INFO:tasks.workunit.client.1.smithi103.stdout:7/798: dread - d1/df/d42/d1f/ff2 zero size 2024-09-18T21:13:01.419 INFO:tasks.workunit.client.0.smithi077.stdout:5/808: dread d0/d43/d6d/f71 [0,4194304] 0 2024-09-18T21:13:01.423 INFO:tasks.workunit.client.1.smithi103.stdout:1/784: rename d0/d2/d9/dc/d6e/l99 to d0/d2/d2b/d3a/d42/d87/l115 0 2024-09-18T21:13:01.424 INFO:tasks.workunit.client.1.smithi103.stdout:1/785: dread - d0/d2/d9/dc/d36/d52/ff5 zero size 2024-09-18T21:13:01.431 INFO:tasks.workunit.client.1.smithi103.stdout:7/799: dread d1/df/d43/f4d [0,4194304] 0 2024-09-18T21:13:01.433 INFO:tasks.workunit.client.1.smithi103.stdout:8/905: link d4/de/la5 d4/d81/d71/d7f/d9d/l121 0 2024-09-18T21:13:01.434 INFO:tasks.workunit.client.1.smithi103.stdout:8/906: readlink d4/d81/lfd 0 2024-09-18T21:13:01.434 INFO:tasks.workunit.client.1.smithi103.stdout:8/907: write d4/d2d/d4e/fd8 [250970,105952] 0 2024-09-18T21:13:01.438 INFO:tasks.workunit.client.1.smithi103.stdout:3/807: link d1/d23/d25/d4f/d72/d7e/l88 d1/d23/d25/d4f/d72/d85/dd9/dcd/lf1 0 2024-09-18T21:13:01.443 INFO:tasks.workunit.client.1.smithi103.stdout:2/742: mknod d3/d5/d2c/d54/d68/d102/c107 0 2024-09-18T21:13:01.445 INFO:tasks.workunit.client.1.smithi103.stdout:1/786: creat d0/d2/da8/f116 x:0 0 0 2024-09-18T21:13:01.449 INFO:tasks.workunit.client.1.smithi103.stdout:3/808: dread d1/f13 [0,4194304] 0 2024-09-18T21:13:01.455 INFO:tasks.workunit.client.1.smithi103.stdout:3/809: dwrite d1/d23/d25/d4f/d72/d7e/feb [0,4194304] 0 2024-09-18T21:13:01.455 INFO:tasks.workunit.client.1.smithi103.stdout:7/800: rename d1/df/d42/d1f/d5d/d85/dde/cf7 to d1/df/d42/d1f/d5d/d85/db0/c103 0 2024-09-18T21:13:01.458 INFO:tasks.workunit.client.1.smithi103.stdout:8/908: mknod d4/d81/dd7/dde/d59/d9c/de6/c122 0 2024-09-18T21:13:01.458 INFO:tasks.workunit.client.1.smithi103.stdout:3/810: truncate d1/d23/d25/d4f/d58/d86/fdc 1580437 0 2024-09-18T21:13:01.465 INFO:tasks.workunit.client.0.smithi077.stdout:1/711: sync 2024-09-18T21:13:01.467 INFO:tasks.workunit.client.0.smithi077.stdout:1/712: write d3/d6a/d9b/d68/f44 [4696180,89296] 0 2024-09-18T21:13:01.477 INFO:tasks.workunit.client.1.smithi103.stdout:3/811: chown d1/d2/d18/d30/d4e/la7 182 1 2024-09-18T21:13:01.490 INFO:tasks.workunit.client.0.smithi077.stdout:4/721: creat d3/d7/d73/d9f/fe7 x:0 0 0 2024-09-18T21:13:01.492 INFO:tasks.workunit.client.0.smithi077.stdout:4/722: write d3/dc/f47 [4610482,47587] 0 2024-09-18T21:13:01.492 INFO:tasks.workunit.client.1.smithi103.stdout:7/801: dread d1/df/d43/d63/d67/d5b/f70 [0,4194304] 0 2024-09-18T21:13:01.493 INFO:tasks.workunit.client.0.smithi077.stdout:3/713: truncate db/d14/d32/d49/d4e/d6a/f6c 90295 0 2024-09-18T21:13:01.494 INFO:tasks.workunit.client.0.smithi077.stdout:9/728: write d1/dd/d57/f74 [4876060,8349] 0 2024-09-18T21:13:01.496 INFO:tasks.workunit.client.1.smithi103.stdout:8/909: link d4/d81/dd7/dde/lb4 d4/d2d/d3d/l123 0 2024-09-18T21:13:01.497 INFO:tasks.workunit.client.0.smithi077.stdout:3/714: truncate db/d14/d22/d36/fc8 999650 0 2024-09-18T21:13:01.502 INFO:tasks.workunit.client.1.smithi103.stdout:8/910: creat d4/d2d/d4e/de9/f124 x:0 0 0 2024-09-18T21:13:01.505 INFO:tasks.workunit.client.1.smithi103.stdout:7/802: mknod d1/df/d43/d63/d67/dfd/c104 0 2024-09-18T21:13:01.507 INFO:tasks.workunit.client.1.smithi103.stdout:8/911: mknod d4/de/de3/c125 0 2024-09-18T21:13:01.509 INFO:tasks.workunit.client.1.smithi103.stdout:7/803: dread - d1/df/d42/d29/f94 zero size 2024-09-18T21:13:01.510 INFO:tasks.workunit.client.1.smithi103.stdout:7/804: write d1/df/d43/d61/fa5 [348350,36376] 0 2024-09-18T21:13:01.511 INFO:tasks.workunit.client.0.smithi077.stdout:9/729: fsync d1/dd/d1a/f76 0 2024-09-18T21:13:01.512 INFO:tasks.workunit.client.1.smithi103.stdout:7/805: dread d1/df/d42/d29/fda [0,4194304] 0 2024-09-18T21:13:01.513 INFO:tasks.workunit.client.0.smithi077.stdout:3/715: fdatasync db/d14/d22/d36/d39/f45 0 2024-09-18T21:13:01.515 INFO:tasks.workunit.client.0.smithi077.stdout:1/713: creat d3/d8/d49/df0/ff7 x:0 0 0 2024-09-18T21:13:01.516 INFO:tasks.workunit.client.0.smithi077.stdout:1/714: stat d3/d8/d49/d4e/d50/fa3 0 2024-09-18T21:13:01.526 INFO:tasks.workunit.client.0.smithi077.stdout:9/730: symlink d1/dd/d11/d1c/d38/lfb 0 2024-09-18T21:13:01.533 INFO:tasks.workunit.client.0.smithi077.stdout:9/731: rename d1/dd/d1a/d42/d4b to d1/dd/d11/d2d/d59/dfc 0 2024-09-18T21:13:01.534 INFO:tasks.workunit.client.0.smithi077.stdout:3/716: dread db/d14/d32/d49/da4/d71/f3e [0,4194304] 0 2024-09-18T21:13:01.541 INFO:tasks.workunit.client.0.smithi077.stdout:9/732: rename d1/dd/d11/d2d/dc6/ldd to d1/dd/d11/d15/d80/d85/de9/lfd 0 2024-09-18T21:13:01.542 INFO:tasks.workunit.client.0.smithi077.stdout:9/733: chown d1/dd/d11/d1c/d38/d46/d55/d7f/fc3 658 1 2024-09-18T21:13:01.576 INFO:tasks.workunit.client.0.smithi077.stdout:8/691: sync 2024-09-18T21:13:01.578 INFO:tasks.workunit.client.0.smithi077.stdout:8/692: mkdir d2/d5f/d6f/dfa 0 2024-09-18T21:13:01.579 INFO:tasks.workunit.client.0.smithi077.stdout:8/693: dread - d2/d5f/da8/d20/fe2 zero size 2024-09-18T21:13:01.579 INFO:tasks.workunit.client.1.smithi103.stdout:6/818: dwrite d2/d24/d5a/d67/d76/da4/dc7/fdc [0,4194304] 0 2024-09-18T21:13:01.581 INFO:tasks.workunit.client.0.smithi077.stdout:8/694: chown d2/d5f/da8/d4f/d5a/d2a/d67 0 1 2024-09-18T21:13:01.582 INFO:tasks.workunit.client.1.smithi103.stdout:0/767: write d1/d9/d3e/fac [1316402,68764] 0 2024-09-18T21:13:01.586 INFO:tasks.workunit.client.0.smithi077.stdout:8/695: dread d2/d5f/da8/d4f/d5a/d2a/d88/fb9 [0,4194304] 0 2024-09-18T21:13:01.589 INFO:tasks.workunit.client.1.smithi103.stdout:0/768: dwrite d1/d5/de/d24/d43/d81/fb2 [0,4194304] 0 2024-09-18T21:13:01.590 INFO:tasks.workunit.client.1.smithi103.stdout:6/819: link d2/d3/d7f/d91/da2/de4/fe6 d2/d3/d7f/d91/da2/f103 0 2024-09-18T21:13:01.590 INFO:tasks.workunit.client.1.smithi103.stdout:0/769: write d1/d5/fc [8654191,47325] 0 2024-09-18T21:13:01.593 INFO:tasks.workunit.client.0.smithi077.stdout:8/696: creat d2/d27/d29/d41/dc2/ffb x:0 0 0 2024-09-18T21:13:01.595 INFO:tasks.workunit.client.1.smithi103.stdout:8/912: sync 2024-09-18T21:13:01.595 INFO:tasks.workunit.client.1.smithi103.stdout:0/770: creat d1/d5/de/d22/d98/f110 x:0 0 0 2024-09-18T21:13:01.596 INFO:tasks.workunit.client.1.smithi103.stdout:3/812: mknod d1/d2/cf2 0 2024-09-18T21:13:01.597 INFO:tasks.workunit.client.1.smithi103.stdout:0/771: write d1/d5/de/dc0/d8c/dce/f101 [983658,70179] 0 2024-09-18T21:13:01.598 INFO:tasks.workunit.client.1.smithi103.stdout:6/820: rename d2/d3/d8/d4c/f78 to d2/d3/dcb/f104 0 2024-09-18T21:13:01.599 INFO:tasks.workunit.client.1.smithi103.stdout:0/772: dread - d1/d5/de/dc0/d8c/dce/d9f/d4f/d68/fc8 zero size 2024-09-18T21:13:01.601 INFO:tasks.workunit.client.1.smithi103.stdout:8/913: creat d4/d81/d71/d7f/d9d/f126 x:0 0 0 2024-09-18T21:13:01.605 INFO:tasks.workunit.client.1.smithi103.stdout:3/813: mkdir d1/d23/d25/d4f/d58/d68/d50/dea/df3 0 2024-09-18T21:13:01.607 INFO:tasks.workunit.client.0.smithi077.stdout:7/777: creat d12/d56/da1/f107 x:0 0 0 2024-09-18T21:13:01.610 INFO:tasks.workunit.client.1.smithi103.stdout:0/773: creat d1/d5/de/dc0/dbf/f111 x:0 0 0 2024-09-18T21:13:01.611 INFO:tasks.workunit.client.0.smithi077.stdout:7/778: fdatasync d12/d31/d77/d93/d2a/f82 0 2024-09-18T21:13:01.612 INFO:tasks.workunit.client.1.smithi103.stdout:3/814: unlink d1/d2/d18/c2d 0 2024-09-18T21:13:01.614 INFO:tasks.workunit.client.1.smithi103.stdout:1/787: symlink d0/d2/d2b/d3a/l117 0 2024-09-18T21:13:01.616 INFO:tasks.workunit.client.0.smithi077.stdout:7/779: chown d12/l17 693579 1 2024-09-18T21:13:01.616 INFO:tasks.workunit.client.1.smithi103.stdout:0/774: read d1/d9/d3e/d6e/f97 [4062624,33975] 0 2024-09-18T21:13:01.616 INFO:tasks.workunit.client.1.smithi103.stdout:8/914: getdents d4/d2d/dc1/dee/d105 0 2024-09-18T21:13:01.617 INFO:tasks.workunit.client.0.smithi077.stdout:7/780: chown d12/d22/f63 116 1 2024-09-18T21:13:01.617 INFO:tasks.workunit.client.1.smithi103.stdout:6/821: dread d2/d3/d8/d4c/d4e/f70 [0,4194304] 0 2024-09-18T21:13:01.618 INFO:tasks.workunit.client.1.smithi103.stdout:3/815: creat d1/d23/d25/da1/da5/de8/ff4 x:0 0 0 2024-09-18T21:13:01.619 INFO:tasks.workunit.client.1.smithi103.stdout:3/816: readlink d1/d2/l1a 0 2024-09-18T21:13:01.620 INFO:tasks.workunit.client.1.smithi103.stdout:8/915: unlink d4/d26/f97 0 2024-09-18T21:13:01.621 INFO:tasks.workunit.client.1.smithi103.stdout:3/817: truncate d1/d23/d25/d4f/d58/d68/fac 642658 0 2024-09-18T21:13:01.621 INFO:tasks.workunit.client.0.smithi077.stdout:7/781: rename d12/d22/d59/d72/d68/f75 to d12/d31/d77/d93/d89/dfe/d103/f108 0 2024-09-18T21:13:01.622 INFO:tasks.workunit.client.1.smithi103.stdout:0/775: write d1/d5/de/d19/fd2 [490970,32177] 0 2024-09-18T21:13:01.622 INFO:tasks.workunit.client.0.smithi077.stdout:7/782: write d12/d22/d59/d72/ff2 [421806,116237] 0 2024-09-18T21:13:01.628 INFO:tasks.workunit.client.1.smithi103.stdout:0/776: mknod d1/d5/de/dc0/d8c/dce/d9f/d4f/d68/c112 0 2024-09-18T21:13:01.630 INFO:tasks.workunit.client.1.smithi103.stdout:6/822: dwrite d2/d3/d8/fc9 [0,4194304] 0 2024-09-18T21:13:01.630 INFO:tasks.workunit.client.1.smithi103.stdout:8/916: rename d4/cfb to d4/d81/dd7/dde/c127 0 2024-09-18T21:13:01.633 INFO:tasks.workunit.client.1.smithi103.stdout:0/777: creat d1/d5/de/d24/d43/d81/f113 x:0 0 0 2024-09-18T21:13:01.634 INFO:tasks.workunit.client.1.smithi103.stdout:1/788: dread d0/d2/f4e [0,4194304] 0 2024-09-18T21:13:01.635 INFO:tasks.workunit.client.1.smithi103.stdout:8/917: truncate d4/d81/d65/f31 53287 0 2024-09-18T21:13:01.636 INFO:tasks.workunit.client.1.smithi103.stdout:8/918: readlink d4/d81/d71/d7f/d9d/le4 0 2024-09-18T21:13:01.637 INFO:tasks.workunit.client.1.smithi103.stdout:2/743: unlink d3/d5/l42 0 2024-09-18T21:13:01.638 INFO:tasks.workunit.client.1.smithi103.stdout:2/744: stat d3/d5/d4a/d56/f8d 0 2024-09-18T21:13:01.638 INFO:tasks.workunit.client.0.smithi077.stdout:5/809: dwrite d0/df/d10/f26 [0,4194304] 0 2024-09-18T21:13:01.642 INFO:tasks.workunit.client.0.smithi077.stdout:7/783: dread d12/d31/d77/d93/d89/dfe/f104 [0,4194304] 0 2024-09-18T21:13:01.642 INFO:tasks.workunit.client.1.smithi103.stdout:8/919: creat d4/d81/d71/d7f/f128 x:0 0 0 2024-09-18T21:13:01.645 INFO:tasks.workunit.client.1.smithi103.stdout:6/823: rmdir d2/d3/d8/d94/df0 0 2024-09-18T21:13:01.646 INFO:tasks.workunit.client.0.smithi077.stdout:7/784: symlink d12/d56/da1/ddf/l109 0 2024-09-18T21:13:01.647 INFO:tasks.workunit.client.0.smithi077.stdout:7/785: read - d12/d22/d59/d5a/f67 zero size 2024-09-18T21:13:01.648 INFO:tasks.workunit.client.1.smithi103.stdout:2/745: dread d3/d5/d2f/d32/f8f [0,4194304] 0 2024-09-18T21:13:01.651 INFO:tasks.workunit.client.1.smithi103.stdout:1/789: unlink d0/d2/d9/d10/l60 0 2024-09-18T21:13:01.654 INFO:tasks.workunit.client.1.smithi103.stdout:6/824: rename d2/d24/d38/l8e to d2/d24/d5a/d67/d76/d43/d44/l105 0 2024-09-18T21:13:01.655 INFO:tasks.workunit.client.0.smithi077.stdout:4/723: dwrite d3/dc/d20/f3b [0,4194304] 0 2024-09-18T21:13:01.658 INFO:tasks.workunit.client.1.smithi103.stdout:2/746: unlink d3/f4d 0 2024-09-18T21:13:01.658 INFO:tasks.workunit.client.0.smithi077.stdout:0/839: sync 2024-09-18T21:13:01.658 INFO:tasks.workunit.client.0.smithi077.stdout:2/822: sync 2024-09-18T21:13:01.658 INFO:tasks.workunit.client.0.smithi077.stdout:6/686: sync 2024-09-18T21:13:01.661 INFO:tasks.workunit.client.1.smithi103.stdout:4/927: symlink d9/d38/d72/df0/d83/db6/l133 0 2024-09-18T21:13:01.664 INFO:tasks.workunit.client.1.smithi103.stdout:8/920: mknod d4/d26/d56/d77/c129 0 2024-09-18T21:13:01.664 INFO:tasks.workunit.client.1.smithi103.stdout:8/921: stat d4/d81/d71/d7f/fdd 0 2024-09-18T21:13:01.665 INFO:tasks.workunit.client.0.smithi077.stdout:0/840: symlink d8/d1a/d39/l10a 0 2024-09-18T21:13:01.665 INFO:tasks.workunit.client.1.smithi103.stdout:8/922: write d4/d81/d71/ffa [48206,121769] 0 2024-09-18T21:13:01.666 INFO:tasks.workunit.client.1.smithi103.stdout:8/923: readlink d4/de/l32 0 2024-09-18T21:13:01.669 INFO:tasks.workunit.client.0.smithi077.stdout:2/823: dwrite d1/d4/d5/d1a/d2e/d41/d2c/dab/ff1 [0,4194304] 0 2024-09-18T21:13:01.671 INFO:tasks.workunit.client.0.smithi077.stdout:7/786: link d12/d22/d59/lbe d12/d22/d59/l10a 0 2024-09-18T21:13:01.672 INFO:tasks.workunit.client.1.smithi103.stdout:4/928: mkdir d9/d38/d72/df0/d134 0 2024-09-18T21:13:01.677 INFO:tasks.workunit.client.1.smithi103.stdout:6/825: symlink d2/d24/d5a/d67/d76/l106 0 2024-09-18T21:13:01.679 INFO:tasks.workunit.client.1.smithi103.stdout:8/924: creat d4/d81/f12a x:0 0 0 2024-09-18T21:13:01.680 INFO:tasks.workunit.client.0.smithi077.stdout:1/715: dwrite d3/d6a/d9b/d4c/f5c [0,4194304] 0 2024-09-18T21:13:01.680 INFO:tasks.workunit.client.0.smithi077.stdout:7/787: truncate d12/d22/d59/d72/f3b 461056 0 2024-09-18T21:13:01.681 INFO:tasks.workunit.client.0.smithi077.stdout:4/724: dread d3/d7/d73/f96 [0,4194304] 0 2024-09-18T21:13:01.689 INFO:tasks.workunit.client.1.smithi103.stdout:8/925: creat d4/d2d/dc1/dee/f12b x:0 0 0 2024-09-18T21:13:01.690 INFO:tasks.workunit.client.0.smithi077.stdout:4/725: chown d3/dc/d32/d5b/l9d 605 1 2024-09-18T21:13:01.693 INFO:tasks.workunit.client.0.smithi077.stdout:2/824: rename d1/d62 to d1/d4/d5/d1a/d11e 0 2024-09-18T21:13:01.694 INFO:tasks.workunit.client.0.smithi077.stdout:9/734: write d1/dd/d11/d1c/d38/d46/d55/dce/fc9 [3276135,9771] 0 2024-09-18T21:13:01.696 INFO:tasks.workunit.client.0.smithi077.stdout:3/717: dwrite db/d14/d32/d49/fdc [0,4194304] 0 2024-09-18T21:13:01.698 INFO:tasks.workunit.client.0.smithi077.stdout:9/735: read d1/dd/d11/d1c/f7d [129316,65615] 0 2024-09-18T21:13:01.699 INFO:tasks.workunit.client.0.smithi077.stdout:9/736: dread - d1/d54/d27/fdc zero size 2024-09-18T21:13:01.700 INFO:tasks.workunit.client.0.smithi077.stdout:3/718: write db/d14/d32/d49/da4/d8a/d99/fa9 [210077,74485] 0 2024-09-18T21:13:01.701 INFO:tasks.workunit.client.0.smithi077.stdout:4/726: mkdir d3/d7/de8 0 2024-09-18T21:13:01.703 INFO:tasks.workunit.client.1.smithi103.stdout:6/826: link d2/d24/d38/d68/d7c/c83 d2/d24/d5a/d67/d76/d43/c107 0 2024-09-18T21:13:01.705 INFO:tasks.workunit.client.0.smithi077.stdout:2/825: rename d1/lb4 to d1/d4/d9/d4f/l11f 0 2024-09-18T21:13:01.706 INFO:tasks.workunit.client.0.smithi077.stdout:2/826: stat d1/f1d 0 2024-09-18T21:13:01.707 INFO:tasks.workunit.client.1.smithi103.stdout:9/839: creat d18/d52/d6f/d8e/d8f/f114 x:0 0 0 2024-09-18T21:13:01.707 INFO:tasks.workunit.client.0.smithi077.stdout:7/788: dread d12/d56/da1/db6/dbd/fd9 [0,4194304] 0 2024-09-18T21:13:01.708 INFO:tasks.workunit.client.1.smithi103.stdout:6/827: chown d2/d3/dcb/le8 15 1 2024-09-18T21:13:01.710 INFO:tasks.workunit.client.1.smithi103.stdout:6/828: truncate d2/d3/d8/d4c/d7d/d9b/dd0/fda 823634 0 2024-09-18T21:13:01.710 INFO:tasks.workunit.client.1.smithi103.stdout:9/840: creat d18/d52/d6f/df8/f115 x:0 0 0 2024-09-18T21:13:01.712 INFO:tasks.workunit.client.1.smithi103.stdout:6/829: truncate d2/d3/d8/d4c/d4e/f70 4654005 0 2024-09-18T21:13:01.714 INFO:tasks.workunit.client.0.smithi077.stdout:2/827: truncate d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d8e/f55 223004 0 2024-09-18T21:13:01.715 INFO:tasks.workunit.client.0.smithi077.stdout:4/727: creat d3/d7/de8/fe9 x:0 0 0 2024-09-18T21:13:01.716 INFO:tasks.workunit.client.0.smithi077.stdout:4/728: readlink d3/dc/lab 0 2024-09-18T21:13:01.716 INFO:tasks.workunit.client.1.smithi103.stdout:6/830: truncate d2/d24/d5a/d67/fb8 251870 0 2024-09-18T21:13:01.716 INFO:tasks.workunit.client.1.smithi103.stdout:9/841: read d18/d8d/d2f/f65 [3672190,60434] 0 2024-09-18T21:13:01.719 INFO:tasks.workunit.client.1.smithi103.stdout:9/842: chown d18/d8d/l4c 505444 1 2024-09-18T21:13:01.719 INFO:tasks.workunit.client.1.smithi103.stdout:9/843: chown d18/d8d/d2f/f101 427666 1 2024-09-18T21:13:01.720 INFO:tasks.workunit.client.1.smithi103.stdout:9/844: chown d18/d52/f82 65291 1 2024-09-18T21:13:01.720 INFO:tasks.workunit.client.1.smithi103.stdout:7/806: mkdir d1/df/d42/d105 0 2024-09-18T21:13:01.721 INFO:tasks.workunit.client.1.smithi103.stdout:7/807: write d1/df/dbf/feb [63886,57669] 0 2024-09-18T21:13:01.723 INFO:tasks.workunit.client.1.smithi103.stdout:5/865: creat de/d1f/d3b/f11b x:0 0 0 2024-09-18T21:13:01.728 INFO:tasks.workunit.client.0.smithi077.stdout:3/719: getdents db/d4d 0 2024-09-18T21:13:01.729 INFO:tasks.workunit.client.0.smithi077.stdout:3/720: readlink db/d14/d32/lcd 0 2024-09-18T21:13:01.731 INFO:tasks.workunit.client.1.smithi103.stdout:9/845: creat d18/d52/d6f/db9/dcb/ded/f116 x:0 0 0 2024-09-18T21:13:01.733 INFO:tasks.workunit.client.0.smithi077.stdout:4/729: getdents d3/dd2 0 2024-09-18T21:13:01.734 INFO:tasks.workunit.client.0.smithi077.stdout:4/730: chown d3/dc/d20/f27 7787607 1 2024-09-18T21:13:01.737 INFO:tasks.workunit.client.1.smithi103.stdout:9/846: mkdir d18/d52/d6f/d8e/d8f/dbd/df1/dfe/d117 0 2024-09-18T21:13:01.738 INFO:tasks.workunit.client.0.smithi077.stdout:8/697: write d2/d5f/da8/d26/fa2 [4911886,32936] 0 2024-09-18T21:13:01.740 INFO:tasks.workunit.client.0.smithi077.stdout:4/731: symlink d3/d77/de5/lea 0 2024-09-18T21:13:01.741 INFO:tasks.workunit.client.1.smithi103.stdout:9/847: truncate d18/d29/faa 1236700 0 2024-09-18T21:13:01.742 INFO:tasks.workunit.client.0.smithi077.stdout:8/698: mknod d2/d27/d29/d41/dbc/cfc 0 2024-09-18T21:13:01.744 INFO:tasks.workunit.client.1.smithi103.stdout:9/848: symlink d18/d52/d6f/db9/dcb/l118 0 2024-09-18T21:13:01.745 INFO:tasks.workunit.client.0.smithi077.stdout:8/699: truncate d2/d27/f57 4896045 0 2024-09-18T21:13:01.751 INFO:tasks.workunit.client.0.smithi077.stdout:8/700: link d2/d27/d29/d41/fd4 d2/d5f/da8/d4f/d5a/d2a/d88/ffd 0 2024-09-18T21:13:01.756 INFO:tasks.workunit.client.0.smithi077.stdout:4/732: dread d3/dc/d51/d53/d89/fad [4194304,4194304] 0 2024-09-18T21:13:01.759 INFO:tasks.workunit.client.0.smithi077.stdout:4/733: rename d3/dc/d24/d72/f94 to d3/d77/de5/feb 0 2024-09-18T21:13:01.759 INFO:tasks.workunit.client.1.smithi103.stdout:3/818: dwrite d1/d2/d18/f29 [4194304,4194304] 0 2024-09-18T21:13:01.761 INFO:tasks.workunit.client.0.smithi077.stdout:4/734: truncate d3/dc/d32/d45/d5e/fc2 791867 0 2024-09-18T21:13:01.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:01 smithi103 ceph-mon[34827]: Adjusting osd_memory_target on smithi103 to 2581M 2024-09-18T21:13:01.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:01 smithi103 ceph-mon[34827]: Updating smithi077:/etc/ceph/ceph.conf 2024-09-18T21:13:01.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:01 smithi103 ceph-mon[34827]: Updating smithi103:/etc/ceph/ceph.conf 2024-09-18T21:13:01.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:01 smithi103 ceph-mon[34827]: Updating smithi103:/var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T21:13:01.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:01 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:01.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:01 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:01.764 INFO:tasks.workunit.client.1.smithi103.stdout:3/819: creat d1/d23/d47/ff5 x:0 0 0 2024-09-18T21:13:01.765 INFO:tasks.workunit.client.1.smithi103.stdout:3/820: chown d1/da/f15 986601160 1 2024-09-18T21:13:01.765 INFO:tasks.workunit.client.0.smithi077.stdout:4/735: symlink d3/dc/d51/d53/dce/lec 0 2024-09-18T21:13:01.766 INFO:tasks.workunit.client.1.smithi103.stdout:8/926: dwrite d4/d81/dd7/dde/d59/fce [0,4194304] 0 2024-09-18T21:13:01.766 INFO:tasks.workunit.client.0.smithi077.stdout:4/736: fdatasync d3/d35/f37 0 2024-09-18T21:13:01.767 INFO:tasks.workunit.client.0.smithi077.stdout:5/810: write d0/df/d3d/d85/f96 [6398439,129724] 0 2024-09-18T21:13:01.767 INFO:tasks.workunit.client.1.smithi103.stdout:3/821: rmdir d1/d23 39 2024-09-18T21:13:01.768 INFO:tasks.workunit.client.0.smithi077.stdout:4/737: chown d3/d7/f4f 68841965 1 2024-09-18T21:13:01.768 INFO:tasks.workunit.client.1.smithi103.stdout:8/927: write d4/d81/d71/fc4 [1273330,88550] 0 2024-09-18T21:13:01.769 INFO:tasks.workunit.client.0.smithi077.stdout:4/738: fsync d3/d77/d9c/fdb 0 2024-09-18T21:13:01.769 INFO:tasks.workunit.client.0.smithi077.stdout:4/739: fsync d3/d77/f98 0 2024-09-18T21:13:01.772 INFO:tasks.workunit.client.0.smithi077.stdout:4/740: truncate d3/d7/d7b/d88/f8d 1573236 0 2024-09-18T21:13:01.773 INFO:tasks.workunit.client.1.smithi103.stdout:0/778: write d1/d5/f44 [1803575,59941] 0 2024-09-18T21:13:01.775 INFO:tasks.workunit.client.1.smithi103.stdout:8/928: creat d4/d2d/dc1/dee/d105/f12c x:0 0 0 2024-09-18T21:13:01.777 INFO:tasks.workunit.client.0.smithi077.stdout:4/741: symlink d3/dd2/led 0 2024-09-18T21:13:01.777 INFO:tasks.workunit.client.1.smithi103.stdout:3/822: dwrite d1/d2/d18/d30/d4e/f61 [0,4194304] 0 2024-09-18T21:13:01.780 INFO:tasks.workunit.client.1.smithi103.stdout:0/779: fdatasync d1/d5/de/dc0/d8c/dce/d9f/fee 0 2024-09-18T21:13:01.781 INFO:tasks.workunit.client.1.smithi103.stdout:0/780: write d1/daf/fdf [113259,114341] 0 2024-09-18T21:13:01.783 INFO:tasks.workunit.client.1.smithi103.stdout:8/929: dwrite d4/d81/d71/ffa [0,4194304] 0 2024-09-18T21:13:01.784 INFO:tasks.workunit.client.1.smithi103.stdout:1/790: truncate d0/d2/d9/dc/f22 2405566 0 2024-09-18T21:13:01.789 INFO:tasks.workunit.client.1.smithi103.stdout:3/823: rename d1/d23/d25/d4f/d58/d68/d50/d54/dee to d1/d23/d25/d4f/d72/d85/df6 0 2024-09-18T21:13:01.790 INFO:tasks.workunit.client.0.smithi077.stdout:6/687: dwrite d7/f1f [0,4194304] 0 2024-09-18T21:13:01.793 INFO:tasks.workunit.client.1.smithi103.stdout:8/930: fsync d4/d2d/d4e/d73/ff7 0 2024-09-18T21:13:01.794 INFO:tasks.workunit.client.1.smithi103.stdout:4/929: write d9/d38/d72/df0/d61/f76 [904316,109628] 0 2024-09-18T21:13:01.795 INFO:tasks.workunit.client.1.smithi103.stdout:8/931: write d4/ddf/f11b [463711,43133] 0 2024-09-18T21:13:01.797 INFO:tasks.workunit.client.1.smithi103.stdout:8/932: readlink d4/d81/dd7/dde/d59/d9c/laf 0 2024-09-18T21:13:01.797 INFO:tasks.workunit.client.1.smithi103.stdout:2/747: dwrite d3/d5/f4c [0,4194304] 0 2024-09-18T21:13:01.797 INFO:tasks.workunit.client.1.smithi103.stdout:3/824: mkdir d1/d23/d47/dbb/df7 0 2024-09-18T21:13:01.799 INFO:tasks.workunit.client.1.smithi103.stdout:0/781: creat d1/d9/f114 x:0 0 0 2024-09-18T21:13:01.801 INFO:tasks.workunit.client.0.smithi077.stdout:1/716: truncate d3/d8/d75/d89/dbb/fc3 2420094 0 2024-09-18T21:13:01.807 INFO:tasks.workunit.client.1.smithi103.stdout:8/933: mknod d4/de/c12d 0 2024-09-18T21:13:01.813 INFO:tasks.workunit.client.1.smithi103.stdout:2/748: read d3/d5/d25/f37 [1668235,97961] 0 2024-09-18T21:13:01.814 INFO:tasks.workunit.client.0.smithi077.stdout:9/737: truncate d1/dd/d11/d1c/d38/d46/d55/d9c/fd6 2958015 0 2024-09-18T21:13:01.815 INFO:tasks.workunit.client.0.smithi077.stdout:7/789: dwrite d12/d22/d59/d72/f81 [0,4194304] 0 2024-09-18T21:13:01.816 INFO:tasks.workunit.client.1.smithi103.stdout:4/930: getdents d9/d38/d72/d94 0 2024-09-18T21:13:01.816 INFO:tasks.workunit.client.1.smithi103.stdout:6/831: write d2/f4a [568280,51195] 0 2024-09-18T21:13:01.818 INFO:tasks.workunit.client.1.smithi103.stdout:2/749: creat d3/d5/d2f/f108 x:0 0 0 2024-09-18T21:13:01.820 INFO:tasks.workunit.client.0.smithi077.stdout:2/828: truncate d1/d4/d5/d1a/d113/d81/fa8 44680 0 2024-09-18T21:13:01.822 INFO:tasks.workunit.client.0.smithi077.stdout:9/738: symlink d1/dd/d11/d1c/d38/lfe 0 2024-09-18T21:13:01.823 INFO:tasks.workunit.client.1.smithi103.stdout:7/808: write d1/fe [1312497,25383] 0 2024-09-18T21:13:01.824 INFO:tasks.workunit.client.1.smithi103.stdout:5/866: truncate de/d1f/d3b/d58/dc4/f5b 3154684 0 2024-09-18T21:13:01.824 INFO:tasks.workunit.client.0.smithi077.stdout:3/721: write db/d14/d32/d49/fa0 [727508,53048] 0 2024-09-18T21:13:01.825 INFO:tasks.workunit.client.0.smithi077.stdout:3/722: stat db/d14/d22/d36/fa2 0 2024-09-18T21:13:01.826 INFO:tasks.workunit.client.0.smithi077.stdout:9/739: mknod d1/d54/d51/cff 0 2024-09-18T21:13:01.828 INFO:tasks.workunit.client.1.smithi103.stdout:8/934: dread d4/d26/f1d [0,4194304] 0 2024-09-18T21:13:01.828 INFO:tasks.workunit.client.1.smithi103.stdout:4/931: symlink d9/d38/d72/l135 0 2024-09-18T21:13:01.829 INFO:tasks.workunit.client.1.smithi103.stdout:4/932: fsync d9/d38/d58/f93 0 2024-09-18T21:13:01.830 INFO:tasks.workunit.client.1.smithi103.stdout:7/809: mknod d1/df/d42/d29/d48/c106 0 2024-09-18T21:13:01.832 INFO:tasks.workunit.client.1.smithi103.stdout:9/849: write d18/d52/d6f/d8e/d8f/fb3 [721368,52528] 0 2024-09-18T21:13:01.833 INFO:tasks.workunit.client.1.smithi103.stdout:0/782: dread d1/d9/f52 [0,4194304] 0 2024-09-18T21:13:01.834 INFO:tasks.workunit.client.0.smithi077.stdout:9/740: getdents d1/dd/d57/de8 0 2024-09-18T21:13:01.835 INFO:tasks.workunit.client.0.smithi077.stdout:9/741: readlink d1/dd/d11/d1c/ld1 0 2024-09-18T21:13:01.837 INFO:tasks.workunit.client.0.smithi077.stdout:8/701: write d2/d5/d6/fac [1982762,125866] 0 2024-09-18T21:13:01.838 INFO:tasks.workunit.client.1.smithi103.stdout:6/832: link d2/d24/d5a/d67/d76/d43/d44/f98 d2/d24/f108 0 2024-09-18T21:13:01.840 INFO:tasks.workunit.client.0.smithi077.stdout:1/717: dread d3/d6a/d9b/d68/f37 [0,4194304] 0 2024-09-18T21:13:01.842 INFO:tasks.workunit.client.0.smithi077.stdout:3/723: rename db/d14/d22/f58 to db/d14/d32/fe0 0 2024-09-18T21:13:01.842 INFO:tasks.workunit.client.0.smithi077.stdout:1/718: chown d3/d8/d93/dd3/dc1/ff5 57 1 2024-09-18T21:13:01.842 INFO:tasks.workunit.client.0.smithi077.stdout:8/702: truncate d2/d5f/da8/d4f/d5a/d2a/d88/ffd 689148 0 2024-09-18T21:13:01.843 INFO:tasks.workunit.client.1.smithi103.stdout:8/935: symlink d4/d26/d56/d77/d9f/l12e 0 2024-09-18T21:13:01.844 INFO:tasks.workunit.client.1.smithi103.stdout:4/933: creat d9/d1c/d77/f136 x:0 0 0 2024-09-18T21:13:01.848 INFO:tasks.workunit.client.1.smithi103.stdout:7/810: creat d1/df/d43/d63/d67/f107 x:0 0 0 2024-09-18T21:13:01.849 INFO:tasks.workunit.client.0.smithi077.stdout:9/742: rename d1/dd/d11/c99 to d1/d54/d51/c100 0 2024-09-18T21:13:01.849 INFO:tasks.workunit.client.0.smithi077.stdout:5/811: write d0/d6/dd/f24 [415761,66446] 0 2024-09-18T21:13:01.849 INFO:tasks.workunit.client.1.smithi103.stdout:7/811: fsync d1/df/d42/d1f/d5d/dbe/fd0 0 2024-09-18T21:13:01.849 INFO:tasks.workunit.client.1.smithi103.stdout:2/750: creat d3/d5/d25/f109 x:0 0 0 2024-09-18T21:13:01.852 INFO:tasks.workunit.client.1.smithi103.stdout:5/867: mkdir de/d1f/d3b/d3c/d62/d118/d11c 0 2024-09-18T21:13:01.852 INFO:tasks.workunit.client.0.smithi077.stdout:2/829: dread d1/f1c [0,4194304] 0 2024-09-18T21:13:01.854 INFO:tasks.workunit.client.0.smithi077.stdout:1/719: rmdir d3/d8/d13 39 2024-09-18T21:13:01.857 INFO:tasks.workunit.client.1.smithi103.stdout:0/783: readlink d1/d9/l2d 0 2024-09-18T21:13:01.857 INFO:tasks.workunit.client.0.smithi077.stdout:1/720: write d3/d8/f59 [4651188,44163] 0 2024-09-18T21:13:01.857 INFO:tasks.workunit.client.0.smithi077.stdout:9/743: dwrite d1/dd/d11/fad [0,4194304] 0 2024-09-18T21:13:01.863 INFO:tasks.workunit.client.0.smithi077.stdout:3/724: symlink db/d14/d32/le1 0 2024-09-18T21:13:01.864 INFO:tasks.workunit.client.1.smithi103.stdout:6/833: symlink d2/d3/d8/d4c/d7d/d9b/l109 0 2024-09-18T21:13:01.865 INFO:tasks.workunit.client.0.smithi077.stdout:4/742: dwrite d3/dc/d24/f78 [0,4194304] 0 2024-09-18T21:13:01.867 INFO:tasks.workunit.client.0.smithi077.stdout:4/743: truncate d3/d77/f98 286556 0 2024-09-18T21:13:01.867 INFO:tasks.workunit.client.0.smithi077.stdout:5/812: creat d0/df/d10/d5c/d74/d89/f10e x:0 0 0 2024-09-18T21:13:01.868 INFO:tasks.workunit.client.1.smithi103.stdout:1/791: dwrite d0/d2/d9/d10/d5d/f88 [0,4194304] 0 2024-09-18T21:13:01.870 INFO:tasks.workunit.client.1.smithi103.stdout:8/936: rmdir d4/d81/dd7/dde/d59/d9c 39 2024-09-18T21:13:01.872 INFO:tasks.workunit.client.0.smithi077.stdout:6/688: write d7/d7e/d11/d3e/d42/fc9 [264660,117937] 0 2024-09-18T21:13:01.874 INFO:tasks.workunit.client.0.smithi077.stdout:8/703: mknod d2/d5f/def/cfe 0 2024-09-18T21:13:01.875 INFO:tasks.workunit.client.0.smithi077.stdout:6/689: stat d7/d7e/d11/d3e/d42/d88/da4/dd4 0 2024-09-18T21:13:01.877 INFO:tasks.workunit.client.1.smithi103.stdout:8/937: truncate d4/d2d/dc1/dee/f12b 446861 0 2024-09-18T21:13:01.877 INFO:tasks.workunit.client.0.smithi077.stdout:6/690: chown d7/d7e/d11/l2f 36513 1 2024-09-18T21:13:01.880 INFO:tasks.workunit.client.0.smithi077.stdout:2/830: truncate d1/d4/d5/d1a/d2e/d40/f78 850683 0 2024-09-18T21:13:01.881 INFO:tasks.workunit.client.0.smithi077.stdout:9/744: creat d1/dd/d11/d2d/d59/de1/f101 x:0 0 0 2024-09-18T21:13:01.881 INFO:tasks.workunit.client.1.smithi103.stdout:3/825: write d1/f13 [2969382,103302] 0 2024-09-18T21:13:01.883 INFO:tasks.workunit.client.1.smithi103.stdout:7/812: creat d1/df/dc7/f108 x:0 0 0 2024-09-18T21:13:01.884 INFO:tasks.workunit.client.1.smithi103.stdout:8/938: dwrite d4/d2d/d87/fa7 [0,4194304] 0 2024-09-18T21:13:01.886 INFO:tasks.workunit.client.1.smithi103.stdout:2/751: mknod d3/d5/d2f/d32/d90/dd7/dc4/c10a 0 2024-09-18T21:13:01.887 INFO:tasks.workunit.client.1.smithi103.stdout:8/939: truncate d4/d26/d56/d77/d9f/fa6 5159608 0 2024-09-18T21:13:01.890 INFO:tasks.workunit.client.1.smithi103.stdout:0/784: symlink d1/d5/de/dc0/d8c/dce/d9f/d8d/l115 0 2024-09-18T21:13:01.892 INFO:tasks.workunit.client.0.smithi077.stdout:3/725: symlink db/d14/d22/d36/le2 0 2024-09-18T21:13:01.892 INFO:tasks.workunit.client.1.smithi103.stdout:0/785: write d1/d5/de/d22/d6a/f10c [556062,35098] 0 2024-09-18T21:13:01.894 INFO:tasks.workunit.client.1.smithi103.stdout:9/850: rename d18/d52/d6f/db9/de0/de7/cea to d18/d52/d6f/db9/de0/de7/c119 0 2024-09-18T21:13:01.895 INFO:tasks.workunit.client.1.smithi103.stdout:9/851: fdatasync f1 0 2024-09-18T21:13:01.898 INFO:tasks.workunit.client.1.smithi103.stdout:6/834: mkdir d2/d24/d5a/d67/d76/da4/d10a 0 2024-09-18T21:13:01.900 INFO:tasks.workunit.client.1.smithi103.stdout:1/792: rename d0/d2/d2b/d3a/d42/d87/caf to d0/d2/d9/d9e/d7a/dd0/df9/d68/d81/c118 0 2024-09-18T21:13:01.902 INFO:tasks.workunit.client.0.smithi077.stdout:8/704: rename d2/d5f/da8/d4f/d5a/l8e to d2/d5f/da8/d4f/d5a/d2a/d67/lff 0 2024-09-18T21:13:01.903 INFO:tasks.workunit.client.0.smithi077.stdout:8/705: readlink d2/d5f/da8/d4f/d5a/d2a/dc8/le3 0 2024-09-18T21:13:01.906 INFO:tasks.workunit.client.0.smithi077.stdout:2/831: creat d1/d4/d5/d1a/d2e/d41/f120 x:0 0 0 2024-09-18T21:13:01.908 INFO:tasks.workunit.client.0.smithi077.stdout:9/745: creat d1/dd/d11/d1c/d38/d46/d55/f102 x:0 0 0 2024-09-18T21:13:01.916 INFO:tasks.workunit.client.1.smithi103.stdout:0/786: chown d1/d9/fb5 1948 1 2024-09-18T21:13:01.917 INFO:tasks.workunit.client.0.smithi077.stdout:5/813: mknod d0/df/d10/d47/db6/dc8/c10f 0 2024-09-18T21:13:01.918 INFO:tasks.workunit.client.0.smithi077.stdout:5/814: write d0/d6/dd/ff7 [455007,105841] 0 2024-09-18T21:13:01.919 INFO:tasks.workunit.client.0.smithi077.stdout:5/815: chown d0/d6/d40/fb9 10739554 1 2024-09-18T21:13:01.919 INFO:tasks.workunit.client.1.smithi103.stdout:9/852: mknod d18/d52/d6f/d8e/d8f/dbd/dc3/c11a 0 2024-09-18T21:13:01.920 INFO:tasks.workunit.client.1.smithi103.stdout:9/853: chown d18/d52/d6f/db9/de0/de7/c107 400802657 1 2024-09-18T21:13:01.921 INFO:tasks.workunit.client.0.smithi077.stdout:2/832: dread d1/d4/d5/d1a/d2e/d7e/f91 [0,4194304] 0 2024-09-18T21:13:01.921 INFO:tasks.workunit.client.1.smithi103.stdout:6/835: creat d2/d3/d8/d94/f10b x:0 0 0 2024-09-18T21:13:01.921 INFO:tasks.workunit.client.1.smithi103.stdout:9/854: chown d18/d29/d68/d92/d9c/dc8/deb/ffc 43 1 2024-09-18T21:13:01.922 INFO:tasks.workunit.client.0.smithi077.stdout:2/833: write d1/fd [10373794,2913] 0 2024-09-18T21:13:01.923 INFO:tasks.workunit.client.1.smithi103.stdout:7/813: rename d1/df/d42/d1f/d5d/dbe/lf9 to d1/df/d42/d105/l109 0 2024-09-18T21:13:01.924 INFO:tasks.workunit.client.0.smithi077.stdout:6/691: mknod d7/d7e/d11/d3e/d42/dbb/d50/dd5/cee 0 2024-09-18T21:13:01.924 INFO:tasks.workunit.client.1.smithi103.stdout:7/814: write d1/df/d43/db1/fc4 [999654,121681] 0 2024-09-18T21:13:01.925 INFO:tasks.workunit.client.1.smithi103.stdout:1/793: mkdir d0/d2/d9/d9e/d7a/dd0/df9/d68/d119 0 2024-09-18T21:13:01.927 INFO:tasks.workunit.client.1.smithi103.stdout:3/826: symlink d1/d2/d18/lf8 0 2024-09-18T21:13:01.927 INFO:tasks.workunit.client.1.smithi103.stdout:1/794: fsync d0/d2/d9/d9e/d7a/dd0/df9/d68/d81/da2/fe7 0 2024-09-18T21:13:01.928 INFO:tasks.workunit.client.1.smithi103.stdout:1/795: fsync d0/d2/d2b/d3a/d42/d72/db0/f10b 0 2024-09-18T21:13:01.928 INFO:tasks.workunit.client.0.smithi077.stdout:9/746: creat d1/dd/d11/d15/d80/d85/de9/f103 x:0 0 0 2024-09-18T21:13:01.931 INFO:tasks.workunit.client.0.smithi077.stdout:5/816: mkdir d0/df/d10/de1/d110 0 2024-09-18T21:13:01.933 INFO:tasks.workunit.client.1.smithi103.stdout:0/787: rmdir d1/d5/de/dc0/dbf/d4e 39 2024-09-18T21:13:01.937 INFO:tasks.workunit.client.1.smithi103.stdout:4/934: write d9/d38/d72/df0/d83/db6/d21/f63 [1736256,55155] 0 2024-09-18T21:13:01.938 INFO:tasks.workunit.client.0.smithi077.stdout:6/692: truncate d7/d7e/d11/d3e/d42/dbb/f77 522323 0 2024-09-18T21:13:01.941 INFO:tasks.workunit.client.1.smithi103.stdout:7/815: symlink d1/df/d42/d29/d48/dbb/d33/d51/l10a 0 2024-09-18T21:13:01.941 INFO:tasks.workunit.client.0.smithi077.stdout:1/721: write d3/d8/d49/d4e/d5a/f69 [452659,117424] 0 2024-09-18T21:13:01.944 INFO:tasks.workunit.client.0.smithi077.stdout:5/817: creat d0/d6/d8a/f111 x:0 0 0 2024-09-18T21:13:01.945 INFO:tasks.workunit.client.1.smithi103.stdout:1/796: rmdir d0/d2/d9/dc/d36/d52 39 2024-09-18T21:13:01.949 INFO:tasks.workunit.client.1.smithi103.stdout:2/752: link d3/d5/d2c/d77/d9c/db8/fc3 d3/d5/d2f/d32/dfc/f10b 0 2024-09-18T21:13:01.952 INFO:tasks.workunit.client.1.smithi103.stdout:6/836: fsync d2/d24/d5a/d67/d76/d43/d44/f98 0 2024-09-18T21:13:01.954 INFO:tasks.workunit.client.0.smithi077.stdout:6/693: mkdir d7/d7e/d11/d3e/d42/dbb/d49/d55/dc2/def 0 2024-09-18T21:13:01.955 INFO:tasks.workunit.client.0.smithi077.stdout:1/722: chown d3/d8/cc 7006 1 2024-09-18T21:13:01.956 INFO:tasks.workunit.client.1.smithi103.stdout:3/827: creat d1/d23/d25/d4f/d58/d68/d50/dea/df3/ff9 x:0 0 0 2024-09-18T21:13:01.958 INFO:tasks.workunit.client.0.smithi077.stdout:5/818: unlink d0/d6/dd/f19 0 2024-09-18T21:13:01.959 INFO:tasks.workunit.client.0.smithi077.stdout:5/819: chown d0/df/d10/d5c/fdc 2721 1 2024-09-18T21:13:01.959 INFO:tasks.workunit.client.1.smithi103.stdout:7/816: chown d1/df/d43/d63/d67/d5b/c97 83551 1 2024-09-18T21:13:01.959 INFO:tasks.workunit.client.1.smithi103.stdout:4/935: dread d9/d1c/f39 [0,4194304] 0 2024-09-18T21:13:01.962 INFO:tasks.workunit.client.0.smithi077.stdout:8/706: getdents d2 0 2024-09-18T21:13:01.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:01 smithi077 ceph-mon[27689]: Adjusting osd_memory_target on smithi103 to 2581M 2024-09-18T21:13:01.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:01 smithi077 ceph-mon[27689]: Updating smithi077:/etc/ceph/ceph.conf 2024-09-18T21:13:01.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:01 smithi077 ceph-mon[27689]: Updating smithi103:/etc/ceph/ceph.conf 2024-09-18T21:13:01.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:01 smithi077 ceph-mon[27689]: Updating smithi103:/var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T21:13:01.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:01 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:01.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:01 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:01.963 INFO:tasks.workunit.client.1.smithi103.stdout:5/868: link de/d1f/d3b/la9 de/d1f/d3b/dcd/l11d 0 2024-09-18T21:13:01.964 INFO:tasks.workunit.client.1.smithi103.stdout:7/817: dwrite d1/df/d43/d61/fd6 [0,4194304] 0 2024-09-18T21:13:01.966 INFO:tasks.workunit.client.0.smithi077.stdout:9/747: creat d1/dd/d1a/d42/f104 x:0 0 0 2024-09-18T21:13:01.967 INFO:tasks.workunit.client.0.smithi077.stdout:4/744: truncate d3/dc/d20/f3b 33515 0 2024-09-18T21:13:01.968 INFO:tasks.workunit.client.0.smithi077.stdout:4/745: write d3/dc/d20/f97 [956886,83875] 0 2024-09-18T21:13:01.969 INFO:tasks.workunit.client.1.smithi103.stdout:8/940: dwrite d4/d81/d65/f83 [0,4194304] 0 2024-09-18T21:13:01.969 INFO:tasks.workunit.client.0.smithi077.stdout:4/746: stat d3/d7/d42/f5c 0 2024-09-18T21:13:01.976 INFO:tasks.workunit.client.0.smithi077.stdout:5/820: mknod d0/d43/d6d/c112 0 2024-09-18T21:13:01.978 INFO:tasks.workunit.client.0.smithi077.stdout:8/707: mknod d2/d5f/da8/d4f/d5a/c100 0 2024-09-18T21:13:01.979 INFO:tasks.workunit.client.1.smithi103.stdout:4/936: symlink d9/d38/d72/df0/d83/db6/d41/dfc/l137 0 2024-09-18T21:13:01.981 INFO:tasks.workunit.client.0.smithi077.stdout:9/748: mknod d1/dd/d1a/c105 0 2024-09-18T21:13:01.984 INFO:tasks.workunit.client.1.smithi103.stdout:9/855: write d18/d8d/d2f/f65 [8825752,4285] 0 2024-09-18T21:13:01.985 INFO:tasks.workunit.client.1.smithi103.stdout:2/753: symlink d3/d5/d4a/l10c 0 2024-09-18T21:13:01.987 INFO:tasks.workunit.client.0.smithi077.stdout:8/708: dread d2/d5f/da8/d20/f24 [0,4194304] 0 2024-09-18T21:13:01.987 INFO:tasks.workunit.client.0.smithi077.stdout:3/726: dwrite db/d14/d32/d49/fab [0,4194304] 0 2024-09-18T21:13:01.988 INFO:tasks.workunit.client.0.smithi077.stdout:4/747: creat d3/d77/d9c/fee x:0 0 0 2024-09-18T21:13:01.994 INFO:tasks.workunit.client.0.smithi077.stdout:2/834: fsync d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/fac 0 2024-09-18T21:13:01.995 INFO:tasks.workunit.client.0.smithi077.stdout:5/821: dread - d0/d6/d40/f77 zero size 2024-09-18T21:13:01.997 INFO:tasks.workunit.client.0.smithi077.stdout:5/822: dread - d0/df/d10/d47/db6/f100 zero size 2024-09-18T21:13:02.003 INFO:tasks.workunit.client.1.smithi103.stdout:4/937: chown d9/d38/d58/f92 3079 1 2024-09-18T21:13:02.007 INFO:tasks.workunit.client.0.smithi077.stdout:6/694: dwrite d7/d7e/f2a [0,4194304] 0 2024-09-18T21:13:02.009 INFO:tasks.workunit.client.1.smithi103.stdout:2/754: dread d3/d5/d4a/d56/ff8 [0,4194304] 0 2024-09-18T21:13:02.012 INFO:tasks.workunit.client.1.smithi103.stdout:9/856: mkdir d18/d52/d6f/d8e/d8f/dbd/df1/d11b 0 2024-09-18T21:13:02.014 INFO:tasks.workunit.client.0.smithi077.stdout:1/723: dwrite d3/d8/d93/dd3/d99/de8/da6/fcd [0,4194304] 0 2024-09-18T21:13:02.014 INFO:tasks.workunit.client.0.smithi077.stdout:3/727: symlink db/d14/d32/d49/da4/d8a/d99/daf/le3 0 2024-09-18T21:13:02.015 INFO:tasks.workunit.client.1.smithi103.stdout:4/938: dread d9/d1c/d77/f6f [0,4194304] 0 2024-09-18T21:13:02.018 INFO:tasks.workunit.client.1.smithi103.stdout:5/869: creat de/d1f/d3b/d3c/d62/d118/d11c/f11e x:0 0 0 2024-09-18T21:13:02.019 INFO:tasks.workunit.client.1.smithi103.stdout:7/818: link d1/df/d42/d29/d48/dbb/d33/f6f d1/df/d42/d29/d48/dbb/ded/dfe/f10b 0 2024-09-18T21:13:02.019 INFO:tasks.workunit.client.1.smithi103.stdout:4/939: dwrite d9/d38/f51 [0,4194304] 0 2024-09-18T21:13:02.021 INFO:tasks.workunit.client.0.smithi077.stdout:6/695: dread d7/d7e/d11/d3e/d42/dbb/d49/fd7 [0,4194304] 0 2024-09-18T21:13:02.021 INFO:tasks.workunit.client.1.smithi103.stdout:8/941: rmdir d4/d81/dd7/dde/d59 39 2024-09-18T21:13:02.022 INFO:tasks.workunit.client.1.smithi103.stdout:8/942: fsync d4/d2d/d87/dbb/f106 0 2024-09-18T21:13:02.027 INFO:tasks.workunit.client.1.smithi103.stdout:3/828: truncate d1/da/df/f19 702440 0 2024-09-18T21:13:02.028 INFO:tasks.workunit.client.0.smithi077.stdout:9/749: write d1/dd/d11/d2d/d59/fab [570832,31698] 0 2024-09-18T21:13:02.029 INFO:tasks.workunit.client.1.smithi103.stdout:1/797: link d0/d2/d9/d9e/d7a/dd0/df9/l8c d0/d2/d2b/d3a/d42/d72/db0/l11a 0 2024-09-18T21:13:02.029 INFO:tasks.workunit.client.0.smithi077.stdout:9/750: chown d1/ff4 17378 1 2024-09-18T21:13:02.032 INFO:tasks.workunit.client.1.smithi103.stdout:2/755: rename d3/d5/fdd to d3/d5/d2c/f10d 0 2024-09-18T21:13:02.033 INFO:tasks.workunit.client.0.smithi077.stdout:9/751: dread d1/dd/d11/d1c/d38/d46/f5b [0,4194304] 0 2024-09-18T21:13:02.034 INFO:tasks.workunit.client.0.smithi077.stdout:9/752: chown d1/d54/f21 3945 1 2024-09-18T21:13:02.034 INFO:tasks.workunit.client.0.smithi077.stdout:9/753: chown d1/d54/d51 157833 1 2024-09-18T21:13:02.035 INFO:tasks.workunit.client.1.smithi103.stdout:9/857: creat d18/d8d/d2f/f11c x:0 0 0 2024-09-18T21:13:02.035 INFO:tasks.workunit.client.0.smithi077.stdout:9/754: chown d1/dd/d11/d15/d80 465 1 2024-09-18T21:13:02.035 INFO:tasks.workunit.client.1.smithi103.stdout:7/819: stat d1/df/d43/d63/d67/d5b/lad 0 2024-09-18T21:13:02.038 INFO:tasks.workunit.client.0.smithi077.stdout:3/728: creat db/d14/d32/d49/da4/d89/fe4 x:0 0 0 2024-09-18T21:13:02.038 INFO:tasks.workunit.client.0.smithi077.stdout:2/835: mknod d1/c121 0 2024-09-18T21:13:02.039 INFO:tasks.workunit.client.1.smithi103.stdout:6/837: getdents d2/d24/d5a/d67/d76/d43 0 2024-09-18T21:13:02.040 INFO:tasks.workunit.client.1.smithi103.stdout:6/838: write d2/d3/d7f/d91/de5/fff [930564,114170] 0 2024-09-18T21:13:02.043 INFO:tasks.workunit.client.1.smithi103.stdout:3/829: dread d1/d2/d18/d30/d4e/db1/fd0 [0,4194304] 0 2024-09-18T21:13:02.043 INFO:tasks.workunit.client.0.smithi077.stdout:9/755: dwrite d1/dd/d11/d1c/d38/d46/d55/d7f/fe2 [0,4194304] 0 2024-09-18T21:13:02.044 INFO:tasks.workunit.client.0.smithi077.stdout:3/729: write db/d14/d22/d36/d39/f45 [1079120,48397] 0 2024-09-18T21:13:02.044 INFO:tasks.workunit.client.0.smithi077.stdout:4/748: link d3/dc/d20/f40 d3/dc/d24/fef 0 2024-09-18T21:13:02.045 INFO:tasks.workunit.client.0.smithi077.stdout:3/730: fsync db/d4d/f69 0 2024-09-18T21:13:02.052 INFO:tasks.workunit.client.1.smithi103.stdout:2/756: symlink d3/d5/d2f/d32/d90/dd7/dc4/l10e 0 2024-09-18T21:13:02.053 INFO:tasks.workunit.client.0.smithi077.stdout:8/709: dwrite d2/d27/d29/d41/fd4 [0,4194304] 0 2024-09-18T21:13:02.053 INFO:tasks.workunit.client.1.smithi103.stdout:0/788: sync 2024-09-18T21:13:02.054 INFO:tasks.workunit.client.1.smithi103.stdout:5/870: mkdir de/d1f/d3b/d51/d57/d11f 0 2024-09-18T21:13:02.058 INFO:tasks.workunit.client.0.smithi077.stdout:6/696: symlink d7/d7e/da6/de1/lf0 0 2024-09-18T21:13:02.060 INFO:tasks.workunit.client.1.smithi103.stdout:7/820: creat d1/df/d43/d63/d67/dc3/f10c x:0 0 0 2024-09-18T21:13:02.062 INFO:tasks.workunit.client.0.smithi077.stdout:2/836: unlink d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d8e/l4b 0 2024-09-18T21:13:02.063 INFO:tasks.workunit.client.0.smithi077.stdout:5/823: dwrite d0/d36/f75 [4194304,4194304] 0 2024-09-18T21:13:02.065 INFO:tasks.workunit.client.0.smithi077.stdout:2/837: read d1/d4/d5/f53 [12365117,78610] 0 2024-09-18T21:13:02.067 INFO:tasks.workunit.client.0.smithi077.stdout:9/756: symlink d1/d54/d8f/l106 0 2024-09-18T21:13:02.068 INFO:tasks.workunit.client.1.smithi103.stdout:8/943: mknod d4/d2d/d87/c12f 0 2024-09-18T21:13:02.069 INFO:tasks.workunit.client.0.smithi077.stdout:9/757: stat d1/dd/d1a/d42/fcb 0 2024-09-18T21:13:02.071 INFO:tasks.workunit.client.0.smithi077.stdout:4/749: mkdir d3/dc/d32/d45/d5e/df0 0 2024-09-18T21:13:02.072 INFO:tasks.workunit.client.1.smithi103.stdout:6/839: mknod d2/d3/d8/d94/c10c 0 2024-09-18T21:13:02.073 INFO:tasks.workunit.client.1.smithi103.stdout:6/840: chown d2/d3/d8/le7 52335 1 2024-09-18T21:13:02.073 INFO:tasks.workunit.client.0.smithi077.stdout:1/724: write d3/d6a/d9b/d7f/fd2 [131039,7086] 0 2024-09-18T21:13:02.075 INFO:tasks.workunit.client.0.smithi077.stdout:2/838: dwrite d1/d4/d5/d1a/d2e/d41/d2c/dab/fd4 [0,4194304] 0 2024-09-18T21:13:02.075 INFO:tasks.workunit.client.0.smithi077.stdout:1/725: chown d3/d8/d75/d89/f8c 72523588 1 2024-09-18T21:13:02.076 INFO:tasks.workunit.client.0.smithi077.stdout:3/731: truncate db/d14/f17 4010775 0 2024-09-18T21:13:02.077 INFO:tasks.workunit.client.1.smithi103.stdout:6/841: dread d2/d3/d8/d4c/d4e/f70 [0,4194304] 0 2024-09-18T21:13:02.077 INFO:tasks.workunit.client.0.smithi077.stdout:2/839: write d1/d4/d5/d1a/d2e/fcc [151603,88370] 0 2024-09-18T21:13:02.078 INFO:tasks.workunit.client.0.smithi077.stdout:8/710: mkdir d2/d27/d101 0 2024-09-18T21:13:02.080 INFO:tasks.workunit.client.0.smithi077.stdout:2/840: fsync d1/d4/d5/d1a/d11e/f11d 0 2024-09-18T21:13:02.081 INFO:tasks.workunit.client.1.smithi103.stdout:2/757: rename d3/d5/d2f/d32/d90/lca to d3/d5/d2c/d77/l10f 0 2024-09-18T21:13:02.083 INFO:tasks.workunit.client.0.smithi077.stdout:6/697: chown d7/d7e/d11/d3e/d42/dbb/d31/l8c 2124163 1 2024-09-18T21:13:02.083 INFO:tasks.workunit.client.1.smithi103.stdout:5/871: dread - de/f98 zero size 2024-09-18T21:13:02.086 INFO:tasks.workunit.client.0.smithi077.stdout:5/824: creat d0/d36/f113 x:0 0 0 2024-09-18T21:13:02.091 INFO:tasks.workunit.client.1.smithi103.stdout:4/940: link d9/d38/d72/d85/dd8/c124 d9/d1c/d77/c138 0 2024-09-18T21:13:02.092 INFO:tasks.workunit.client.0.smithi077.stdout:4/750: mknod d3/d7/d73/d9f/cf1 0 2024-09-18T21:13:02.093 INFO:tasks.workunit.client.0.smithi077.stdout:4/751: write d3/d7/f4f [900440,43768] 0 2024-09-18T21:13:02.095 INFO:tasks.workunit.client.0.smithi077.stdout:1/726: chown d3/d8/d75/lf2 3 1 2024-09-18T21:13:02.096 INFO:tasks.workunit.client.1.smithi103.stdout:1/798: creat d0/d11/f11b x:0 0 0 2024-09-18T21:13:02.098 INFO:tasks.workunit.client.0.smithi077.stdout:9/758: dwrite d1/dd/d1a/f23 [4194304,4194304] 0 2024-09-18T21:13:02.099 INFO:tasks.workunit.client.0.smithi077.stdout:3/732: creat db/d14/d32/d49/d4e/d6a/fe5 x:0 0 0 2024-09-18T21:13:02.102 INFO:tasks.workunit.client.0.smithi077.stdout:8/711: mknod d2/d5/d6/d9f/da4/c102 0 2024-09-18T21:13:02.102 INFO:tasks.workunit.client.1.smithi103.stdout:1/799: dwrite d0/d2/d9/d10/f25 [4194304,4194304] 0 2024-09-18T21:13:02.103 INFO:tasks.workunit.client.1.smithi103.stdout:1/800: chown d0/d2/fca 1561 1 2024-09-18T21:13:02.104 INFO:tasks.workunit.client.1.smithi103.stdout:6/842: chown d2/d24/d5a/d67/fb8 404 1 2024-09-18T21:13:02.111 INFO:tasks.workunit.client.0.smithi077.stdout:6/698: rename d7/d7e/d11/d3e/d42/fc8 to d7/d7e/d11/d3e/d42/d88/ff1 0 2024-09-18T21:13:02.112 INFO:tasks.workunit.client.1.smithi103.stdout:0/789: getdents d1/d5/de/dc0/d8c/dce/d9f/d4f/de8 0 2024-09-18T21:13:02.116 INFO:tasks.workunit.client.0.smithi077.stdout:5/825: unlink d0/df/d10/d5c/d74/faf 0 2024-09-18T21:13:02.118 INFO:tasks.workunit.client.0.smithi077.stdout:4/752: write d3/dc/d51/fd7 [873829,31970] 0 2024-09-18T21:13:02.118 INFO:tasks.workunit.client.1.smithi103.stdout:7/821: dwrite d1/df/f22 [0,4194304] 0 2024-09-18T21:13:02.119 INFO:tasks.workunit.client.0.smithi077.stdout:4/753: stat d3/dc/d32/d45/d5e/f84 0 2024-09-18T21:13:02.121 INFO:tasks.workunit.client.0.smithi077.stdout:4/754: write d3/dc/f6b [3485493,9979] 0 2024-09-18T21:13:02.124 INFO:tasks.workunit.client.1.smithi103.stdout:7/822: dwrite d1/df/d43/d63/d67/f107 [0,4194304] 0 2024-09-18T21:13:02.124 INFO:tasks.workunit.client.0.smithi077.stdout:3/733: dread db/d14/d32/d49/d4e/d6a/f6c [0,4194304] 0 2024-09-18T21:13:02.126 INFO:tasks.workunit.client.0.smithi077.stdout:1/727: dread d3/d8/d49/d4e/d5a/f78 [0,4194304] 0 2024-09-18T21:13:02.126 INFO:tasks.workunit.client.1.smithi103.stdout:8/944: truncate d4/de/fef 4525466 0 2024-09-18T21:13:02.129 INFO:tasks.workunit.client.1.smithi103.stdout:6/843: stat d2/d3/d7f/d91/cca 0 2024-09-18T21:13:02.129 INFO:tasks.workunit.client.1.smithi103.stdout:1/801: read d0/d2/d9/dc/f22 [637572,23730] 0 2024-09-18T21:13:02.133 INFO:tasks.workunit.client.0.smithi077.stdout:5/826: fsync d0/d6/d40/f77 0 2024-09-18T21:13:02.133 INFO:tasks.workunit.client.1.smithi103.stdout:5/872: link de/d3e/f110 de/d1f/d3b/d3c/d62/f120 0 2024-09-18T21:13:02.135 INFO:tasks.workunit.client.1.smithi103.stdout:5/873: write de/d3e/d85/fe0 [1447557,101687] 0 2024-09-18T21:13:02.135 INFO:tasks.workunit.client.1.smithi103.stdout:9/858: getdents d18/d52/d6f/df8 0 2024-09-18T21:13:02.135 INFO:tasks.workunit.client.0.smithi077.stdout:4/755: rmdir d3/d7/d73 39 2024-09-18T21:13:02.138 INFO:tasks.workunit.client.0.smithi077.stdout:3/734: fdatasync db/d14/d22/f9d 0 2024-09-18T21:13:02.139 INFO:tasks.workunit.client.0.smithi077.stdout:1/728: creat d3/d6a/ff8 x:0 0 0 2024-09-18T21:13:02.145 INFO:tasks.workunit.client.0.smithi077.stdout:4/756: fsync d3/dc/d20/f27 0 2024-09-18T21:13:02.145 INFO:tasks.workunit.client.1.smithi103.stdout:6/844: dread d2/d24/d5a/d67/fd6 [0,4194304] 0 2024-09-18T21:13:02.146 INFO:tasks.workunit.client.1.smithi103.stdout:4/941: truncate d9/d38/d72/df0/f49 3072866 0 2024-09-18T21:13:02.147 INFO:tasks.workunit.client.0.smithi077.stdout:2/841: truncate d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d8e/f82 2948459 0 2024-09-18T21:13:02.148 INFO:tasks.workunit.client.1.smithi103.stdout:1/802: dwrite d0/d2/d9/dc/d6e/dac/ffe [0,4194304] 0 2024-09-18T21:13:02.149 INFO:tasks.workunit.client.0.smithi077.stdout:8/712: rmdir d2/d5f/d6f/dfa 0 2024-09-18T21:13:02.149 INFO:tasks.workunit.client.0.smithi077.stdout:2/842: chown d1/d4/d5/d1a/d113/l8c 9127949 1 2024-09-18T21:13:02.149 INFO:tasks.workunit.client.1.smithi103.stdout:3/830: getdents d1/d23/d25/d4f/dce 0 2024-09-18T21:13:02.149 INFO:tasks.workunit.client.1.smithi103.stdout:0/790: creat d1/d9/d3e/dfc/f116 x:0 0 0 2024-09-18T21:13:02.149 INFO:tasks.workunit.client.1.smithi103.stdout:6/845: stat d2/d3/d8/d4c 0 2024-09-18T21:13:02.150 INFO:tasks.workunit.client.0.smithi077.stdout:2/843: read - d1/d4/d5/d1a/d113/f101 zero size 2024-09-18T21:13:02.150 INFO:tasks.workunit.client.1.smithi103.stdout:9/859: write d18/d8d/d2f/f101 [1382507,91679] 0 2024-09-18T21:13:02.153 INFO:tasks.workunit.client.1.smithi103.stdout:5/874: unlink de/l4b 0 2024-09-18T21:13:02.155 INFO:tasks.workunit.client.0.smithi077.stdout:9/759: rename d1/dd/d11/d15/d80/d85/fa1 to d1/dd/d11/d1c/d38/f107 0 2024-09-18T21:13:02.155 INFO:tasks.workunit.client.1.smithi103.stdout:9/860: stat d18/d52/d6f/d8e/df7 0 2024-09-18T21:13:02.157 INFO:tasks.workunit.client.1.smithi103.stdout:2/758: dwrite d3/d5/d4a/d56/ff8 [0,4194304] 0 2024-09-18T21:13:02.160 INFO:tasks.workunit.client.0.smithi077.stdout:6/699: dread d7/d7e/f1b [0,4194304] 0 2024-09-18T21:13:02.160 INFO:tasks.workunit.client.1.smithi103.stdout:1/803: dread d0/d2/d9/dc/d6e/dac/ffe [0,4194304] 0 2024-09-18T21:13:02.163 INFO:tasks.workunit.client.0.smithi077.stdout:4/757: symlink d3/dc/d51/d53/lf2 0 2024-09-18T21:13:02.163 INFO:tasks.workunit.client.0.smithi077.stdout:6/700: stat d7/d7e/d11/d3e/d42/dbb/d49/f84 0 2024-09-18T21:13:02.165 INFO:tasks.workunit.client.0.smithi077.stdout:4/758: write d3/dc/d32/d45/faa [3394909,1785] 0 2024-09-18T21:13:02.168 INFO:tasks.workunit.client.0.smithi077.stdout:2/844: read d1/d4/d5/d1a/d2e/d40/f99 [294480,76284] 0 2024-09-18T21:13:02.169 INFO:tasks.workunit.client.1.smithi103.stdout:1/804: dread d0/d2/d9/d9e/d7a/dd0/df9/d68/d81/da2/da4/dc2/dd8/fb6 [0,4194304] 0 2024-09-18T21:13:02.169 INFO:tasks.workunit.client.1.smithi103.stdout:6/846: dread - d2/d3/dcb/f104 zero size 2024-09-18T21:13:02.169 INFO:tasks.workunit.client.1.smithi103.stdout:6/847: fsync d2/d3/f48 0 2024-09-18T21:13:02.173 INFO:tasks.workunit.client.1.smithi103.stdout:0/791: creat d1/d5/de/dc0/db0/f117 x:0 0 0 2024-09-18T21:13:02.173 INFO:tasks.workunit.client.0.smithi077.stdout:2/845: write d1/d4/d5/d1a/d2e/d41/d2c/ddb/d106/f11c [339731,8769] 0 2024-09-18T21:13:02.173 INFO:tasks.workunit.client.0.smithi077.stdout:1/729: getdents d3/d38/d97/dea/df6 0 2024-09-18T21:13:02.175 INFO:tasks.workunit.client.0.smithi077.stdout:2/846: chown d1/d4/f5f 0 1 2024-09-18T21:13:02.176 INFO:tasks.workunit.client.1.smithi103.stdout:7/823: rename d1/df/d42/d1f/f7b to d1/df/d42/f10d 0 2024-09-18T21:13:02.178 INFO:tasks.workunit.client.1.smithi103.stdout:5/875: mknod de/d1f/d3b/d58/c121 0 2024-09-18T21:13:02.180 INFO:tasks.workunit.client.0.smithi077.stdout:8/713: dread d2/d27/d29/f58 [0,4194304] 0 2024-09-18T21:13:02.182 INFO:tasks.workunit.client.0.smithi077.stdout:3/735: dread db/d14/d32/f55 [0,4194304] 0 2024-09-18T21:13:02.182 INFO:tasks.workunit.client.0.smithi077.stdout:8/714: write d2/d27/d29/f3f [5026709,73626] 0 2024-09-18T21:13:02.182 INFO:tasks.workunit.client.1.smithi103.stdout:7/824: dwrite d1/df/d42/d1f/d2e/d3f/f91 [0,4194304] 0 2024-09-18T21:13:02.183 INFO:tasks.workunit.client.1.smithi103.stdout:3/831: write d1/d23/d25/da1/fbe [848310,45898] 0 2024-09-18T21:13:02.185 INFO:tasks.workunit.client.0.smithi077.stdout:9/760: dread d1/dd/d11/d2d/d59/f6a [0,4194304] 0 2024-09-18T21:13:02.186 INFO:tasks.workunit.client.0.smithi077.stdout:4/759: dread - d3/d7/d73/fa7 zero size 2024-09-18T21:13:02.187 INFO:tasks.workunit.client.1.smithi103.stdout:4/942: write d9/d38/d72/d85/dd8/f8d [853261,64600] 0 2024-09-18T21:13:02.190 INFO:tasks.workunit.client.0.smithi077.stdout:9/761: dread - d1/dd/d11/d2d/d59/fb4 zero size 2024-09-18T21:13:02.190 INFO:tasks.workunit.client.0.smithi077.stdout:4/760: dread - d3/d7/d73/d9f/fe7 zero size 2024-09-18T21:13:02.190 INFO:tasks.workunit.client.0.smithi077.stdout:5/827: getdents d0/de6 0 2024-09-18T21:13:02.195 INFO:tasks.workunit.client.0.smithi077.stdout:3/736: dwrite db/ff [0,4194304] 0 2024-09-18T21:13:02.196 INFO:tasks.workunit.client.0.smithi077.stdout:1/730: rename d3/d8/d49/d4e/d50/l2f to d3/d6a/d9b/d68/lf9 0 2024-09-18T21:13:02.197 INFO:tasks.workunit.client.0.smithi077.stdout:1/731: fdatasync d3/d8/d49/df0/ff7 0 2024-09-18T21:13:02.202 INFO:tasks.workunit.client.1.smithi103.stdout:0/792: rmdir d1/daf 39 2024-09-18T21:13:02.202 INFO:tasks.workunit.client.1.smithi103.stdout:6/848: dread d2/d3/d8/d4c/f61 [0,4194304] 0 2024-09-18T21:13:02.203 INFO:tasks.workunit.client.1.smithi103.stdout:0/793: write d1/d9/f5c [4379644,117319] 0 2024-09-18T21:13:02.205 INFO:tasks.workunit.client.1.smithi103.stdout:6/849: truncate d2/d3/d8/d4c/d7d/fea 547347 0 2024-09-18T21:13:02.209 INFO:tasks.workunit.client.1.smithi103.stdout:2/759: mkdir d3/d110 0 2024-09-18T21:13:02.210 INFO:tasks.workunit.client.0.smithi077.stdout:2/847: truncate d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/fac 116020 0 2024-09-18T21:13:02.210 INFO:tasks.workunit.client.1.smithi103.stdout:5/876: write de/d1f/d3b/d51/d57/db5/fde [806866,85308] 0 2024-09-18T21:13:02.210 INFO:tasks.workunit.client.1.smithi103.stdout:3/832: mkdir d1/d23/d25/da1/dfa 0 2024-09-18T21:13:02.212 INFO:tasks.workunit.client.0.smithi077.stdout:8/715: dwrite d2/d5f/da8/d4f/f5d [0,4194304] 0 2024-09-18T21:13:02.213 INFO:tasks.workunit.client.1.smithi103.stdout:7/825: write d1/df/d42/d29/d48/dbb/d33/d9d/fc8 [3412826,76070] 0 2024-09-18T21:13:02.213 INFO:tasks.workunit.client.0.smithi077.stdout:4/761: creat d3/d7/de8/ff3 x:0 0 0 2024-09-18T21:13:02.215 INFO:tasks.workunit.client.1.smithi103.stdout:7/826: write d1/df/d42/f83 [4943427,112534] 0 2024-09-18T21:13:02.215 INFO:tasks.workunit.client.0.smithi077.stdout:9/762: symlink d1/dd/d11/d15/d80/d85/l108 0 2024-09-18T21:13:02.216 INFO:tasks.workunit.client.0.smithi077.stdout:6/701: truncate d7/d7e/d11/d3e/d42/dbb/d49/fbc 3859259 0 2024-09-18T21:13:02.217 INFO:tasks.workunit.client.1.smithi103.stdout:7/827: dread - d1/df/dc7/fd4 zero size 2024-09-18T21:13:02.218 INFO:tasks.workunit.client.1.smithi103.stdout:1/805: mknod d0/c11c 0 2024-09-18T21:13:02.218 INFO:tasks.workunit.client.1.smithi103.stdout:3/833: dwrite d1/d2/d18/f2f [4194304,4194304] 0 2024-09-18T21:13:02.219 INFO:tasks.workunit.client.1.smithi103.stdout:7/828: fsync d1/f82 0 2024-09-18T21:13:02.219 INFO:tasks.workunit.client.0.smithi077.stdout:3/737: write db/d14/d32/f7b [3852949,123290] 0 2024-09-18T21:13:02.219 INFO:tasks.workunit.client.0.smithi077.stdout:1/732: chown d3/d6a/d9b/f3b 30 1 2024-09-18T21:13:02.223 INFO:tasks.workunit.client.0.smithi077.stdout:1/733: write d3/d6a/d9b/d7f/fd2 [378894,13104] 0 2024-09-18T21:13:02.224 INFO:tasks.workunit.client.1.smithi103.stdout:0/794: creat d1/d5/de/d19/d1e/d34/f118 x:0 0 0 2024-09-18T21:13:02.228 INFO:tasks.workunit.client.1.smithi103.stdout:3/834: dread d1/d23/d25/d4f/d58/d86/fd1 [0,4194304] 0 2024-09-18T21:13:02.229 INFO:tasks.workunit.client.0.smithi077.stdout:4/762: mknod d3/dc/d32/d45/cf4 0 2024-09-18T21:13:02.232 INFO:tasks.workunit.client.1.smithi103.stdout:8/945: sync 2024-09-18T21:13:02.235 INFO:tasks.workunit.client.0.smithi077.stdout:5/828: truncate d0/d6/d3b/d64/fb2 7180 0 2024-09-18T21:13:02.235 INFO:tasks.workunit.client.0.smithi077.stdout:5/829: dread - d0/de6/feb zero size 2024-09-18T21:13:02.235 INFO:tasks.workunit.client.0.smithi077.stdout:6/702: mknod d7/d7e/d11/d3e/d42/d88/da4/cf2 0 2024-09-18T21:13:02.236 INFO:tasks.workunit.client.1.smithi103.stdout:4/943: dread d9/d1c/f68 [0,4194304] 0 2024-09-18T21:13:02.239 INFO:tasks.workunit.client.1.smithi103.stdout:7/829: mkdir d1/df/d43/d63/d67/d5b/d10e 0 2024-09-18T21:13:02.239 INFO:tasks.workunit.client.1.smithi103.stdout:7/830: chown d1/df/d43/d61/l90 42224 1 2024-09-18T21:13:02.240 INFO:tasks.workunit.client.0.smithi077.stdout:3/738: mkdir db/d14/d32/d49/da4/d8a/d99/daf/de6 0 2024-09-18T21:13:02.243 INFO:tasks.workunit.client.0.smithi077.stdout:3/739: read db/d4d/f69 [3925242,108815] 0 2024-09-18T21:13:02.244 INFO:tasks.workunit.client.0.smithi077.stdout:6/703: dwrite d7/d7e/da6/fc5 [0,4194304] 0 2024-09-18T21:13:02.247 INFO:tasks.workunit.client.0.smithi077.stdout:0/841: sync 2024-09-18T21:13:02.247 INFO:tasks.workunit.client.0.smithi077.stdout:7/790: sync 2024-09-18T21:13:02.251 INFO:tasks.workunit.client.0.smithi077.stdout:7/791: write d12/d31/d77/d93/d2a/d6c/fcf [1010337,129106] 0 2024-09-18T21:13:02.251 INFO:tasks.workunit.client.1.smithi103.stdout:2/760: fsync d3/d5/f36 0 2024-09-18T21:13:02.252 INFO:tasks.workunit.client.1.smithi103.stdout:9/861: sync 2024-09-18T21:13:02.252 INFO:tasks.workunit.client.0.smithi077.stdout:8/716: creat d2/d27/d29/d41/dbc/dce/df6/f103 x:0 0 0 2024-09-18T21:13:02.253 INFO:tasks.workunit.client.1.smithi103.stdout:3/835: unlink d1/da/df/l55 0 2024-09-18T21:13:02.254 INFO:tasks.workunit.client.0.smithi077.stdout:6/704: dread d7/d7e/d11/d3e/d42/fc9 [0,4194304] 0 2024-09-18T21:13:02.255 INFO:tasks.workunit.client.0.smithi077.stdout:4/763: creat d3/d35/db1/ff5 x:0 0 0 2024-09-18T21:13:02.256 INFO:tasks.workunit.client.1.smithi103.stdout:5/877: creat de/d1f/d3b/d51/d57/dc8/de8/f122 x:0 0 0 2024-09-18T21:13:02.260 INFO:tasks.workunit.client.1.smithi103.stdout:8/946: mknod d4/d2d/d87/dbb/dea/c130 0 2024-09-18T21:13:02.260 INFO:tasks.workunit.client.1.smithi103.stdout:8/947: write d4/d26/d56/d77/d9f/fbf [3284458,111033] 0 2024-09-18T21:13:02.260 INFO:tasks.workunit.client.0.smithi077.stdout:4/764: read d3/dc/d20/f2a [4339817,231] 0 2024-09-18T21:13:02.262 INFO:tasks.workunit.client.1.smithi103.stdout:7/831: creat d1/df/d42/d29/d48/dbb/ded/f10f x:0 0 0 2024-09-18T21:13:02.263 INFO:tasks.workunit.client.0.smithi077.stdout:2/848: truncate d1/d4/d5/d1a/d49/f72 1140467 0 2024-09-18T21:13:02.263 INFO:tasks.workunit.client.1.smithi103.stdout:7/832: chown d1/df/d42/d29/d48/dbb/d33 0 1 2024-09-18T21:13:02.264 INFO:tasks.workunit.client.0.smithi077.stdout:2/849: chown d1/d4/d5/d1a/d2e/d41/d2c 0 1 2024-09-18T21:13:02.267 INFO:tasks.workunit.client.1.smithi103.stdout:1/806: mkdir d0/d2/d9/d9e/d7a/dd0/d10f/d10a/d11d 0 2024-09-18T21:13:02.268 INFO:tasks.workunit.client.0.smithi077.stdout:2/850: dread d1/d4/d5/d1a/d49/fc9 [0,4194304] 0 2024-09-18T21:13:02.272 INFO:tasks.workunit.client.1.smithi103.stdout:3/836: mknod d1/d23/d25/d4f/d72/d85/d93/cfb 0 2024-09-18T21:13:02.272 INFO:tasks.workunit.client.0.smithi077.stdout:8/717: dread d2/d5/d6/f14 [0,4194304] 0 2024-09-18T21:13:02.275 INFO:tasks.workunit.client.0.smithi077.stdout:1/734: rename d3/d6a/cc4 to d3/d8/d13/d77/cfa 0 2024-09-18T21:13:02.276 INFO:tasks.workunit.client.1.smithi103.stdout:4/944: symlink d9/d38/d72/df0/d83/db6/d21/l139 0 2024-09-18T21:13:02.278 INFO:tasks.workunit.client.0.smithi077.stdout:7/792: symlink d12/d22/daa/dbc/l10b 0 2024-09-18T21:13:02.278 INFO:tasks.workunit.client.1.smithi103.stdout:4/945: truncate d9/d38/d72/df0/d61/d91/daa/f122 543878 0 2024-09-18T21:13:02.278 INFO:tasks.workunit.client.1.smithi103.stdout:9/862: dread fc [0,4194304] 0 2024-09-18T21:13:02.278 INFO:tasks.workunit.client.1.smithi103.stdout:7/833: symlink d1/df/d42/d29/d48/dbb/ded/l110 0 2024-09-18T21:13:02.279 INFO:tasks.workunit.client.0.smithi077.stdout:9/763: getdents d1/dd/d11/d1c/d38 0 2024-09-18T21:13:02.283 INFO:tasks.workunit.client.1.smithi103.stdout:9/863: dwrite d18/d52/d6f/db9/f104 [0,4194304] 0 2024-09-18T21:13:02.285 INFO:tasks.workunit.client.1.smithi103.stdout:6/850: getdents d2/d3/d7f/d91/da2/de4 0 2024-09-18T21:13:02.286 INFO:tasks.workunit.client.1.smithi103.stdout:0/795: creat d1/d9/d3e/f119 x:0 0 0 2024-09-18T21:13:02.288 INFO:tasks.workunit.client.1.smithi103.stdout:2/761: truncate d3/d5/f27 420254 0 2024-09-18T21:13:02.295 INFO:tasks.workunit.client.1.smithi103.stdout:6/851: mkdir d2/d3/d8/d4c/d4e/d10d 0 2024-09-18T21:13:02.296 INFO:tasks.workunit.client.1.smithi103.stdout:6/852: truncate d2/d24/f80 5083394 0 2024-09-18T21:13:02.296 INFO:tasks.workunit.client.1.smithi103.stdout:0/796: fsync d1/d5/de/d19/ff7 0 2024-09-18T21:13:02.298 INFO:tasks.workunit.client.1.smithi103.stdout:3/837: symlink d1/da/df/d70/dc1/lfc 0 2024-09-18T21:13:02.298 INFO:tasks.workunit.client.1.smithi103.stdout:6/853: dread d2/d3/d7f/d91/da2/f103 [0,4194304] 0 2024-09-18T21:13:02.300 INFO:tasks.workunit.client.1.smithi103.stdout:2/762: rename d3/d5/d25/d40 to d3/d5/d2c/d54/d68/d102/d111 0 2024-09-18T21:13:02.304 INFO:tasks.workunit.client.1.smithi103.stdout:8/948: truncate d4/d26/d56/d77/d9f/fa6 2140952 0 2024-09-18T21:13:02.304 INFO:tasks.workunit.client.1.smithi103.stdout:4/946: write d9/d38/f4c [12138040,101036] 0 2024-09-18T21:13:02.305 INFO:tasks.workunit.client.1.smithi103.stdout:8/949: fdatasync d4/d2d/d87/dbb/f106 0 2024-09-18T21:13:02.306 INFO:tasks.workunit.client.1.smithi103.stdout:6/854: write d2/d3/d8/f59 [1799133,33132] 0 2024-09-18T21:13:02.307 INFO:tasks.workunit.client.1.smithi103.stdout:4/947: chown d9/d38/d72/df0/d83/db6/d41/l105 5399 1 2024-09-18T21:13:02.307 INFO:tasks.workunit.client.1.smithi103.stdout:5/878: getdents de/d1f/d3b/db4 0 2024-09-18T21:13:02.308 INFO:tasks.workunit.client.0.smithi077.stdout:6/705: mknod d7/d7e/d11/d3e/d42/dbb/cf3 0 2024-09-18T21:13:02.308 INFO:tasks.workunit.client.1.smithi103.stdout:4/948: dread - d9/d38/d72/df0/d61/fa2 zero size 2024-09-18T21:13:02.309 INFO:tasks.workunit.client.1.smithi103.stdout:5/879: dread de/d1f/d3b/d58/dc4/f22 [0,4194304] 0 2024-09-18T21:13:02.309 INFO:tasks.workunit.client.1.smithi103.stdout:3/838: rename d1/da/ld to d1/da/df/d70/lfd 0 2024-09-18T21:13:02.311 INFO:tasks.workunit.client.1.smithi103.stdout:3/839: write d1/d23/d25/da1/da5/fec [974001,127342] 0 2024-09-18T21:13:02.311 INFO:tasks.workunit.client.1.smithi103.stdout:2/763: rmdir d3/d5/d2f/d32/d90/dd7 39 2024-09-18T21:13:02.312 INFO:tasks.workunit.client.1.smithi103.stdout:3/840: chown d1/d64/fe5 0 1 2024-09-18T21:13:02.312 INFO:tasks.workunit.client.0.smithi077.stdout:3/740: creat db/d14/d32/d49/da4/d71/fe7 x:0 0 0 2024-09-18T21:13:02.313 INFO:tasks.workunit.client.0.smithi077.stdout:7/793: dwrite d12/d31/d77/d93/d89/faf [0,4194304] 0 2024-09-18T21:13:02.313 INFO:tasks.workunit.client.0.smithi077.stdout:1/735: dread d3/f10 [4194304,4194304] 0 2024-09-18T21:13:02.315 INFO:tasks.workunit.client.1.smithi103.stdout:9/864: write fa [1666282,89823] 0 2024-09-18T21:13:02.316 INFO:tasks.workunit.client.1.smithi103.stdout:1/807: getdents d0/d2/d2b/d3a/d42 0 2024-09-18T21:13:02.317 INFO:tasks.workunit.client.0.smithi077.stdout:8/718: mkdir d2/d27/d29/d104 0 2024-09-18T21:13:02.319 INFO:tasks.workunit.client.1.smithi103.stdout:0/797: mknod d1/d5/de/d24/d43/c11a 0 2024-09-18T21:13:02.322 INFO:tasks.workunit.client.0.smithi077.stdout:8/719: truncate d2/d5/d6/d9f/da6/fca 282440 0 2024-09-18T21:13:02.323 INFO:tasks.workunit.client.0.smithi077.stdout:5/830: dwrite d0/d6/d3b/d64/fb2 [0,4194304] 0 2024-09-18T21:13:02.324 INFO:tasks.workunit.client.0.smithi077.stdout:8/720: fsync d2/d5/d6/fac 0 2024-09-18T21:13:02.326 INFO:tasks.workunit.client.0.smithi077.stdout:6/706: rmdir d7/d7e/d11 39 2024-09-18T21:13:02.328 INFO:tasks.workunit.client.0.smithi077.stdout:5/831: truncate d0/d6/dd/d5d/fea 234565 0 2024-09-18T21:13:02.328 INFO:tasks.workunit.client.0.smithi077.stdout:7/794: rmdir d12/d31 39 2024-09-18T21:13:02.328 INFO:tasks.workunit.client.0.smithi077.stdout:5/832: stat d0/df/d10/c2a 0 2024-09-18T21:13:02.330 INFO:tasks.workunit.client.0.smithi077.stdout:1/736: symlink d3/d6a/lfb 0 2024-09-18T21:13:02.331 INFO:tasks.workunit.client.1.smithi103.stdout:2/764: stat d3/db3/ced 0 2024-09-18T21:13:02.332 INFO:tasks.workunit.client.1.smithi103.stdout:3/841: creat d1/d23/d25/d4f/d72/d7e/ffe x:0 0 0 2024-09-18T21:13:02.333 INFO:tasks.workunit.client.1.smithi103.stdout:2/765: dread d3/d5/d2f/f91 [0,4194304] 0 2024-09-18T21:13:02.333 INFO:tasks.workunit.client.1.smithi103.stdout:2/766: chown d3/d5/d2f/d32/dae/ddf 74 1 2024-09-18T21:13:02.335 INFO:tasks.workunit.client.0.smithi077.stdout:0/842: rename d8/d1a/d39/d3b/d9a to d8/d10b 0 2024-09-18T21:13:02.336 INFO:tasks.workunit.client.1.smithi103.stdout:8/950: write d4/d2d/d3d/d9b/fe0 [771963,41945] 0 2024-09-18T21:13:02.337 INFO:tasks.workunit.client.0.smithi077.stdout:0/843: write d8/d1a/d35/f85 [4287657,44084] 0 2024-09-18T21:13:02.339 INFO:tasks.workunit.client.1.smithi103.stdout:0/798: creat d1/d5/de/d24/f11b x:0 0 0 2024-09-18T21:13:02.341 INFO:tasks.workunit.client.0.smithi077.stdout:7/795: dread - d12/d22/fc2 zero size 2024-09-18T21:13:02.341 INFO:tasks.workunit.client.0.smithi077.stdout:5/833: symlink d0/df/d84/l114 0 2024-09-18T21:13:02.342 INFO:tasks.workunit.client.0.smithi077.stdout:5/834: read - d0/df/d84/f90 zero size 2024-09-18T21:13:02.344 INFO:tasks.workunit.client.0.smithi077.stdout:5/835: write d0/d6/dd/f24 [909308,108979] 0 2024-09-18T21:13:02.344 INFO:tasks.workunit.client.0.smithi077.stdout:4/765: rename d3/d7/fe4 to d3/dc/d20/ff6 0 2024-09-18T21:13:02.347 INFO:tasks.workunit.client.0.smithi077.stdout:0/844: creat d8/d37/d95/dab/f10c x:0 0 0 2024-09-18T21:13:02.349 INFO:tasks.workunit.client.0.smithi077.stdout:3/741: dread db/f10 [0,4194304] 0 2024-09-18T21:13:02.351 INFO:tasks.workunit.client.1.smithi103.stdout:9/865: mkdir d18/d8d/d11d 0 2024-09-18T21:13:02.352 INFO:tasks.workunit.client.1.smithi103.stdout:3/842: dread d1/f24 [4194304,4194304] 0 2024-09-18T21:13:02.355 INFO:tasks.workunit.client.1.smithi103.stdout:5/880: write de/d1f/d3b/d58/dc4/f5b [3748054,124690] 0 2024-09-18T21:13:02.356 INFO:tasks.workunit.client.0.smithi077.stdout:4/766: creat d3/d77/ff7 x:0 0 0 2024-09-18T21:13:02.357 INFO:tasks.workunit.client.0.smithi077.stdout:8/721: truncate d2/d5f/da8/d20/d3e/db4/fbf 2901501 0 2024-09-18T21:13:02.358 INFO:tasks.workunit.client.1.smithi103.stdout:0/799: chown d1/d9/c63 3472541 1 2024-09-18T21:13:02.358 INFO:tasks.workunit.client.1.smithi103.stdout:3/843: dwrite d1/d64/fdd [4194304,4194304] 0 2024-09-18T21:13:02.358 INFO:tasks.workunit.client.0.smithi077.stdout:4/767: write d3/d7/d73/fa2 [2606696,47854] 0 2024-09-18T21:13:02.358 INFO:tasks.workunit.client.0.smithi077.stdout:5/836: symlink d0/de6/l115 0 2024-09-18T21:13:02.359 INFO:tasks.workunit.client.0.smithi077.stdout:8/722: write d2/d27/d29/d41/fd4 [4629696,80221] 0 2024-09-18T21:13:02.359 INFO:tasks.workunit.client.1.smithi103.stdout:0/800: chown d1/d5/de/dc0/d8c/dce/d9f/d8d/da7/ld3 1273354888 1 2024-09-18T21:13:02.360 INFO:tasks.workunit.client.1.smithi103.stdout:6/855: creat d2/d24/d5a/d67/d76/f10e x:0 0 0 2024-09-18T21:13:02.361 INFO:tasks.workunit.client.0.smithi077.stdout:4/768: chown d3/dc/d32/d45/faa 1 1 2024-09-18T21:13:02.361 INFO:tasks.workunit.client.0.smithi077.stdout:1/737: rename d3/db6 to d3/d8/d93/dd3/d99/dfc 0 2024-09-18T21:13:02.363 INFO:tasks.workunit.client.1.smithi103.stdout:4/949: rename d9/d1c/c131 to d9/d38/d72/c13a 0 2024-09-18T21:13:02.364 INFO:tasks.workunit.client.1.smithi103.stdout:3/844: dwrite d1/d2/fb [8388608,4194304] 0 2024-09-18T21:13:02.366 INFO:tasks.workunit.client.0.smithi077.stdout:6/707: link d7/d7e/d11/fd2 d7/d7e/d11/d3e/d42/dbb/d50/dd5/ff4 0 2024-09-18T21:13:02.367 INFO:tasks.workunit.client.1.smithi103.stdout:2/767: mkdir d3/d5/d2f/d32/d90/df0/d112 0 2024-09-18T21:13:02.376 INFO:tasks.workunit.client.1.smithi103.stdout:0/801: fdatasync d1/d5/de/d22/d6a/fa9 0 2024-09-18T21:13:02.377 INFO:tasks.workunit.client.1.smithi103.stdout:7/834: sync 2024-09-18T21:13:02.378 INFO:tasks.workunit.client.0.smithi077.stdout:4/769: symlink d3/d7/d7b/lf8 0 2024-09-18T21:13:02.378 INFO:tasks.workunit.client.0.smithi077.stdout:4/770: dread - d3/d77/fac zero size 2024-09-18T21:13:02.381 INFO:tasks.workunit.client.1.smithi103.stdout:6/856: rename d2/d3/d7f/d91/da2/f103 to d2/d3/d8/de1/dfe/f10f 0 2024-09-18T21:13:02.382 INFO:tasks.workunit.client.1.smithi103.stdout:6/857: write d2/d24/d5a/d67/d76/da4/fd8 [232069,77117] 0 2024-09-18T21:13:02.382 INFO:tasks.workunit.client.0.smithi077.stdout:0/845: dread d8/d1a/d35/f7a [0,4194304] 0 2024-09-18T21:13:02.383 INFO:tasks.workunit.client.1.smithi103.stdout:6/858: write d2/d24/d38/d68/dac/fcc [1223719,104343] 0 2024-09-18T21:13:02.386 INFO:tasks.workunit.client.0.smithi077.stdout:8/723: read d2/d5f/da8/d4f/d5a/d5e/f83 [897788,35907] 0 2024-09-18T21:13:02.388 INFO:tasks.workunit.client.0.smithi077.stdout:6/708: creat d7/d7e/d11/d3e/d42/d88/da4/ff5 x:0 0 0 2024-09-18T21:13:02.388 INFO:tasks.workunit.client.0.smithi077.stdout:8/724: chown d2/d5f/da8/d4f/d5a/d2a/lbd 10 1 2024-09-18T21:13:02.390 INFO:tasks.workunit.client.1.smithi103.stdout:3/845: mkdir d1/d23/d25/d4f/d72/d7e/dff 0 2024-09-18T21:13:02.390 INFO:tasks.workunit.client.0.smithi077.stdout:1/738: dwrite d3/f23 [4194304,4194304] 0 2024-09-18T21:13:02.391 INFO:tasks.workunit.client.1.smithi103.stdout:3/846: write d1/d23/d25/d4f/d58/f6d [3187856,30350] 0 2024-09-18T21:13:02.391 INFO:tasks.workunit.client.0.smithi077.stdout:6/709: write d7/d7e/f2a [6120096,62469] 0 2024-09-18T21:13:02.393 INFO:tasks.workunit.client.1.smithi103.stdout:2/768: rmdir d3/d5/d2f/d5b 39 2024-09-18T21:13:02.394 INFO:tasks.workunit.client.1.smithi103.stdout:2/769: write d3/f1b [1743201,66965] 0 2024-09-18T21:13:02.397 INFO:tasks.workunit.client.1.smithi103.stdout:8/951: chown d4/d81/dd7/dde/d59/d9c/de6/cf1 5 1 2024-09-18T21:13:02.397 INFO:tasks.workunit.client.1.smithi103.stdout:9/866: write d18/d29/d68/d92/d9c/fa6 [806652,20048] 0 2024-09-18T21:13:02.398 INFO:tasks.workunit.client.0.smithi077.stdout:3/742: write db/d14/d22/d36/d39/f47 [732809,75392] 0 2024-09-18T21:13:02.399 INFO:tasks.workunit.client.1.smithi103.stdout:1/808: getdents d0/d2/d9/d9e/d7a/dd0/d10f/d10a 0 2024-09-18T21:13:02.401 INFO:tasks.workunit.client.1.smithi103.stdout:1/809: stat d0/d2/d9/d10/d5d/d6f/c110 0 2024-09-18T21:13:02.404 INFO:tasks.workunit.client.1.smithi103.stdout:5/881: truncate de/d3e/d15/f2e 4055781 0 2024-09-18T21:13:02.405 INFO:tasks.workunit.client.0.smithi077.stdout:5/837: write d0/d43/d6d/f71 [903492,42129] 0 2024-09-18T21:13:02.405 INFO:tasks.workunit.client.1.smithi103.stdout:8/952: dwrite d4/ddf/f11b [0,4194304] 0 2024-09-18T21:13:02.406 INFO:tasks.workunit.client.0.smithi077.stdout:5/838: stat d0/d6/c4f 0 2024-09-18T21:13:02.407 INFO:tasks.workunit.client.0.smithi077.stdout:5/839: readlink d0/l76 0 2024-09-18T21:13:02.408 INFO:tasks.workunit.client.0.smithi077.stdout:7/796: dwrite d12/d22/f28 [0,4194304] 0 2024-09-18T21:13:02.410 INFO:tasks.workunit.client.1.smithi103.stdout:8/953: write d4/d81/dd7/dde/d59/d9c/f10a [2371821,94452] 0 2024-09-18T21:13:02.410 INFO:tasks.workunit.client.1.smithi103.stdout:1/810: dwrite d0/f104 [0,4194304] 0 2024-09-18T21:13:02.411 INFO:tasks.workunit.client.0.smithi077.stdout:6/710: fdatasync d7/d7e/f32 0 2024-09-18T21:13:02.412 INFO:tasks.workunit.client.1.smithi103.stdout:0/802: rename d1/d5/de/d24/f11b to d1/d9/d3e/d6e/f11c 0 2024-09-18T21:13:02.414 INFO:tasks.workunit.client.0.smithi077.stdout:6/711: write d7/d7e/da6/fc5 [265769,12284] 0 2024-09-18T21:13:02.416 INFO:tasks.workunit.client.1.smithi103.stdout:6/859: unlink d2/d3/d7f/fb3 0 2024-09-18T21:13:02.426 INFO:tasks.workunit.client.0.smithi077.stdout:4/771: truncate d3/d77/f8b 331529 0 2024-09-18T21:13:02.427 INFO:tasks.workunit.client.0.smithi077.stdout:4/772: stat d3/d7/d42/dd8/fe1 0 2024-09-18T21:13:02.427 INFO:tasks.workunit.client.1.smithi103.stdout:2/770: truncate d3/f16 1512493 0 2024-09-18T21:13:02.428 INFO:tasks.workunit.client.0.smithi077.stdout:4/773: readlink d3/dc/d51/d53/lf2 0 2024-09-18T21:13:02.431 INFO:tasks.workunit.client.1.smithi103.stdout:5/882: creat de/d2d/f123 x:0 0 0 2024-09-18T21:13:02.440 INFO:tasks.workunit.client.1.smithi103.stdout:2/771: creat d3/d5/d2f/d93/f113 x:0 0 0 2024-09-18T21:13:02.441 INFO:tasks.workunit.client.1.smithi103.stdout:9/867: mknod d18/d29/d68/dff/c11e 0 2024-09-18T21:13:02.441 INFO:tasks.workunit.client.1.smithi103.stdout:9/868: write d18/d29/f5b [872689,4842] 0 2024-09-18T21:13:02.442 INFO:tasks.workunit.client.1.smithi103.stdout:1/811: mknod d0/c11e 0 2024-09-18T21:13:02.443 INFO:tasks.workunit.client.1.smithi103.stdout:1/812: stat d0/d11/d5f/d19/cba 0 2024-09-18T21:13:02.444 INFO:tasks.workunit.client.1.smithi103.stdout:8/954: unlink d4/d2d/d3d/da0/dab/de7/c3c 0 2024-09-18T21:13:02.461 INFO:tasks.workunit.client.0.smithi077.stdout:0/846: symlink d8/d1a/d39/d109/l10d 0 2024-09-18T21:13:02.466 INFO:tasks.workunit.client.0.smithi077.stdout:5/840: stat d0/d43/ffa 0 2024-09-18T21:13:02.470 INFO:tasks.workunit.client.0.smithi077.stdout:0/847: dwrite d8/d1a/d39/d56/fb6 [0,4194304] 0 2024-09-18T21:13:02.470 INFO:tasks.workunit.client.0.smithi077.stdout:0/848: readlink l2 0 2024-09-18T21:13:02.473 INFO:tasks.workunit.client.0.smithi077.stdout:7/797: mknod d12/d31/d77/c10c 0 2024-09-18T21:13:02.475 INFO:tasks.workunit.client.0.smithi077.stdout:5/841: creat d0/df/d10/d5c/d74/d89/f116 x:0 0 0 2024-09-18T21:13:02.480 INFO:tasks.workunit.client.1.smithi103.stdout:7/835: truncate d1/df/d42/d1f/d2e/f41 4308951 0 2024-09-18T21:13:02.480 INFO:tasks.workunit.client.1.smithi103.stdout:4/950: dwrite d9/d38/d72/df0/f49 [0,4194304] 0 2024-09-18T21:13:02.480 INFO:tasks.workunit.client.1.smithi103.stdout:8/955: write d4/d81/dd7/dde/d59/f119 [905736,58196] 0 2024-09-18T21:13:02.480 INFO:tasks.workunit.client.1.smithi103.stdout:3/847: write d1/d23/d25/d4f/d72/f87 [660577,34724] 0 2024-09-18T21:13:02.483 INFO:tasks.workunit.client.1.smithi103.stdout:8/956: chown d4/d81/d71/fc4 91 1 2024-09-18T21:13:02.485 INFO:tasks.workunit.client.0.smithi077.stdout:5/842: mkdir d0/d6/dd/d5d/d117 0 2024-09-18T21:13:02.494 INFO:tasks.workunit.client.1.smithi103.stdout:0/803: getdents d1/d5/de/dc0/dbf 0 2024-09-18T21:13:02.496 INFO:tasks.workunit.client.1.smithi103.stdout:2/772: dread d3/d5/d2f/d32/d90/feb [0,4194304] 0 2024-09-18T21:13:02.496 INFO:tasks.workunit.client.1.smithi103.stdout:2/773: readlink d3/d5/d4a/l10c 0 2024-09-18T21:13:02.497 INFO:tasks.workunit.client.1.smithi103.stdout:3/848: mknod d1/d23/d25/da1/c100 0 2024-09-18T21:13:02.497 INFO:tasks.workunit.client.1.smithi103.stdout:6/860: sync 2024-09-18T21:13:02.498 INFO:tasks.workunit.client.0.smithi077.stdout:6/712: link d7/d7e/d11/fd2 d7/d7e/d11/ff6 0 2024-09-18T21:13:02.499 INFO:tasks.workunit.client.1.smithi103.stdout:6/861: write d2/d24/d5a/d67/d76/d43/d44/f6e [3453482,46234] 0 2024-09-18T21:13:02.501 INFO:tasks.workunit.client.0.smithi077.stdout:3/743: dwrite db/d14/d22/d36/fb4 [0,4194304] 0 2024-09-18T21:13:02.502 INFO:tasks.workunit.client.1.smithi103.stdout:7/836: creat d1/df/d44/db4/f111 x:0 0 0 2024-09-18T21:13:02.503 INFO:tasks.workunit.client.0.smithi077.stdout:3/744: chown db/d14/d32/d49/da4/cbf 567656 1 2024-09-18T21:13:02.504 INFO:tasks.workunit.client.0.smithi077.stdout:0/849: write d8/d37/f48 [3009669,9867] 0 2024-09-18T21:13:02.506 INFO:tasks.workunit.client.0.smithi077.stdout:6/713: stat d7/d7e/d11/d3e/d42/dbb/d49/d96/ccb 0 2024-09-18T21:13:02.506 INFO:tasks.workunit.client.1.smithi103.stdout:9/869: write d18/d29/f4b [1748094,28412] 0 2024-09-18T21:13:02.507 INFO:tasks.workunit.client.0.smithi077.stdout:0/850: chown d8/d37/dd2 18 1 2024-09-18T21:13:02.507 INFO:tasks.workunit.client.1.smithi103.stdout:0/804: symlink d1/d5/de/dc0/db0/l11d 0 2024-09-18T21:13:02.510 INFO:tasks.workunit.client.1.smithi103.stdout:3/849: creat d1/d23/d25/d4f/d72/d85/dd9/dcd/f101 x:0 0 0 2024-09-18T21:13:02.510 INFO:tasks.workunit.client.1.smithi103.stdout:0/805: dread d1/d5/de/dc0/d8c/dce/f10d [0,4194304] 0 2024-09-18T21:13:02.516 INFO:tasks.workunit.client.1.smithi103.stdout:0/806: dwrite d1/d5/fc [4194304,4194304] 0 2024-09-18T21:13:02.518 INFO:tasks.workunit.client.0.smithi077.stdout:8/725: write d2/d5f/d6f/f95 [570437,59901] 0 2024-09-18T21:13:02.519 INFO:tasks.workunit.client.0.smithi077.stdout:0/851: rmdir d8/d1a/d39/dd0 39 2024-09-18T21:13:02.519 INFO:tasks.workunit.client.0.smithi077.stdout:7/798: dread d12/d31/d77/da0/fa7 [0,4194304] 0 2024-09-18T21:13:02.522 INFO:tasks.workunit.client.1.smithi103.stdout:6/862: creat d2/d3/d8/f110 x:0 0 0 2024-09-18T21:13:02.524 INFO:tasks.workunit.client.1.smithi103.stdout:7/837: mknod d1/df/d42/d1f/d5d/d85/c112 0 2024-09-18T21:13:02.524 INFO:tasks.workunit.client.1.smithi103.stdout:7/838: chown d1/df/d54 18 1 2024-09-18T21:13:02.526 INFO:tasks.workunit.client.0.smithi077.stdout:5/843: dwrite d0/df/f1c [0,4194304] 0 2024-09-18T21:13:02.530 INFO:tasks.workunit.client.0.smithi077.stdout:7/799: creat d12/d31/d77/d93/d89/d99/da9/f10d x:0 0 0 2024-09-18T21:13:02.536 INFO:tasks.workunit.client.1.smithi103.stdout:2/774: mknod d3/d5/d2f/d32/d90/dd7/c114 0 2024-09-18T21:13:02.536 INFO:tasks.workunit.client.0.smithi077.stdout:0/852: creat d8/d26/f10e x:0 0 0 2024-09-18T21:13:02.536 INFO:tasks.workunit.client.0.smithi077.stdout:6/714: write d7/d7e/d11/d3e/d42/d88/da4/f26 [2678038,94827] 0 2024-09-18T21:13:02.536 INFO:tasks.workunit.client.1.smithi103.stdout:3/850: creat d1/d23/d25/d4f/d58/d86/f102 x:0 0 0 2024-09-18T21:13:02.538 INFO:tasks.workunit.client.1.smithi103.stdout:8/957: dread d4/d2d/d3d/da0/dab/de7/fb5 [0,4194304] 0 2024-09-18T21:13:02.538 INFO:tasks.workunit.client.1.smithi103.stdout:6/863: rename d2/d3/fdf to d2/d3/d7f/d91/f111 0 2024-09-18T21:13:02.539 INFO:tasks.workunit.client.0.smithi077.stdout:5/844: creat d0/df/d10/de1/d110/f118 x:0 0 0 2024-09-18T21:13:02.540 INFO:tasks.workunit.client.1.smithi103.stdout:4/951: truncate d9/d38/f51 2221487 0 2024-09-18T21:13:02.541 INFO:tasks.workunit.client.1.smithi103.stdout:4/952: readlink d9/d38/d72/df0/d83/db6/d21/l139 0 2024-09-18T21:13:02.542 INFO:tasks.workunit.client.0.smithi077.stdout:0/853: mknod d8/d1a/d39/ded/c10f 0 2024-09-18T21:13:02.542 INFO:tasks.workunit.client.0.smithi077.stdout:8/726: write d2/d27/d29/f9c [949593,35678] 0 2024-09-18T21:13:02.543 INFO:tasks.workunit.client.1.smithi103.stdout:9/870: write d18/d8d/f58 [7618641,97788] 0 2024-09-18T21:13:02.544 INFO:tasks.workunit.client.0.smithi077.stdout:6/715: mkdir d7/d7e/d11/d3e/dcd/df7 0 2024-09-18T21:13:02.544 INFO:tasks.workunit.client.0.smithi077.stdout:6/716: chown d7/d7e/d11/c63 227392086 1 2024-09-18T21:13:02.546 INFO:tasks.workunit.client.0.smithi077.stdout:7/800: rename d12/d31/d77/d93/d2a/d6c/f96 to d12/d22/daa/dc0/f10e 0 2024-09-18T21:13:02.548 INFO:tasks.workunit.client.0.smithi077.stdout:8/727: mkdir d2/d5f/d6f/d105 0 2024-09-18T21:13:02.550 INFO:tasks.workunit.client.1.smithi103.stdout:5/883: sync 2024-09-18T21:13:02.552 INFO:tasks.workunit.client.0.smithi077.stdout:6/717: mkdir d7/d7e/d11/d3e/d42/d88/da4/df8 0 2024-09-18T21:13:02.556 INFO:tasks.workunit.client.0.smithi077.stdout:5/845: rename d0/df/d10/d4b/dc5 to d0/d6/dd/da5/d119 0 2024-09-18T21:13:02.558 INFO:tasks.workunit.client.0.smithi077.stdout:8/728: mkdir d2/d5f/da8/d26/d106 0 2024-09-18T21:13:02.560 INFO:tasks.workunit.client.0.smithi077.stdout:5/846: dread d0/df/d10/f7 [4194304,4194304] 0 2024-09-18T21:13:02.561 INFO:tasks.workunit.client.0.smithi077.stdout:5/847: readlink d0/df/d84/l87 0 2024-09-18T21:13:02.567 INFO:tasks.workunit.client.0.smithi077.stdout:5/848: dwrite d0/d6/d3b/d64/d67/f10b [0,4194304] 0 2024-09-18T21:13:02.569 INFO:tasks.workunit.client.0.smithi077.stdout:5/849: dread - d0/de6/feb zero size 2024-09-18T21:13:02.569 INFO:tasks.workunit.client.0.smithi077.stdout:7/801: creat d12/f10f x:0 0 0 2024-09-18T21:13:02.570 INFO:tasks.workunit.client.0.smithi077.stdout:8/729: dread d2/d5/f93 [0,4194304] 0 2024-09-18T21:13:02.570 INFO:tasks.workunit.client.0.smithi077.stdout:7/802: stat d12/d31/d77/c9e 0 2024-09-18T21:13:02.579 INFO:tasks.workunit.client.0.smithi077.stdout:0/854: rename d8/d37/d66/db4 to d8/d1d/d110 0 2024-09-18T21:13:02.582 INFO:tasks.workunit.client.0.smithi077.stdout:8/730: creat d2/d5f/da8/d4f/d5a/d2a/dc8/df1/f107 x:0 0 0 2024-09-18T21:13:02.584 INFO:tasks.workunit.client.0.smithi077.stdout:6/718: write d7/d7e/d11/d3e/f78 [169743,54884] 0 2024-09-18T21:13:02.589 INFO:tasks.workunit.client.0.smithi077.stdout:8/731: mkdir d2/d5f/da8/d4f/d5a/d2a/d88/d108 0 2024-09-18T21:13:02.594 INFO:tasks.workunit.client.0.smithi077.stdout:5/850: dread d0/df/fa7 [0,4194304] 0 2024-09-18T21:13:02.603 INFO:tasks.workunit.client.0.smithi077.stdout:7/803: dwrite d12/d31/fda [0,4194304] 0 2024-09-18T21:13:02.606 INFO:tasks.workunit.client.0.smithi077.stdout:7/804: readlink d12/d31/d77/d93/d89/d99/da9/lff 0 2024-09-18T21:13:02.607 INFO:tasks.workunit.client.0.smithi077.stdout:0/855: getdents d8/d37/d66/d87/de0/dce/dcf 0 2024-09-18T21:13:02.607 INFO:tasks.workunit.client.0.smithi077.stdout:6/719: dwrite d7/f2c [0,4194304] 0 2024-09-18T21:13:02.608 INFO:tasks.workunit.client.0.smithi077.stdout:5/851: creat d0/d6/d3b/f11a x:0 0 0 2024-09-18T21:13:02.608 INFO:tasks.workunit.client.1.smithi103.stdout:1/813: sync 2024-09-18T21:13:02.611 INFO:tasks.workunit.client.0.smithi077.stdout:6/720: readlink d7/d7e/l3b 0 2024-09-18T21:13:02.611 INFO:tasks.workunit.client.0.smithi077.stdout:0/856: fsync d8/d1d/d80/fef 0 2024-09-18T21:13:02.611 INFO:tasks.workunit.client.0.smithi077.stdout:5/852: dread - d0/d6/d3b/f8f zero size 2024-09-18T21:13:02.612 INFO:tasks.workunit.client.0.smithi077.stdout:8/732: dwrite d2/d5f/da8/d4f/d5a/d2a/d67/f73 [0,4194304] 0 2024-09-18T21:13:02.622 INFO:tasks.workunit.client.0.smithi077.stdout:5/853: dwrite d0/df/d10/d5c/ff6 [0,4194304] 0 2024-09-18T21:13:02.625 INFO:tasks.workunit.client.0.smithi077.stdout:7/805: link d12/d22/cb7 d12/d56/ded/c110 0 2024-09-18T21:13:02.626 INFO:tasks.workunit.client.0.smithi077.stdout:8/733: dwrite d2/d5f/da8/d4f/d5a/d5e/d8f/dad/ff4 [0,4194304] 0 2024-09-18T21:13:02.626 INFO:tasks.workunit.client.0.smithi077.stdout:6/721: creat d7/d7e/d11/ff9 x:0 0 0 2024-09-18T21:13:02.632 INFO:tasks.workunit.client.0.smithi077.stdout:5/854: getdents d0/d6/dd/da5/d119 0 2024-09-18T21:13:02.641 INFO:tasks.workunit.client.0.smithi077.stdout:6/722: dread d7/d7e/d11/d3e/d42/dbb/d5c/f95 [0,4194304] 0 2024-09-18T21:13:02.641 INFO:tasks.workunit.client.0.smithi077.stdout:5/855: rmdir d0/d6/d3b/d64/d67 39 2024-09-18T21:13:02.645 INFO:tasks.workunit.client.0.smithi077.stdout:7/806: link d12/d31/f83 d12/f111 0 2024-09-18T21:13:02.646 INFO:tasks.workunit.client.0.smithi077.stdout:6/723: rmdir d7/d7e 39 2024-09-18T21:13:02.647 INFO:tasks.workunit.client.0.smithi077.stdout:8/734: dread d2/d5f/d6f/f95 [0,4194304] 0 2024-09-18T21:13:02.648 INFO:tasks.workunit.client.0.smithi077.stdout:8/735: fsync d2/d5f/da8/d4f/d5a/d2a/d88/fdd 0 2024-09-18T21:13:02.649 INFO:tasks.workunit.client.1.smithi103.stdout:0/807: symlink d1/d5/de/dc0/d8c/dce/d9f/d4f/de8/l11e 0 2024-09-18T21:13:02.650 INFO:tasks.workunit.client.0.smithi077.stdout:8/736: read d2/d5f/da8/d4f/d5a/d2a/d88/ffd [2451215,13458] 0 2024-09-18T21:13:02.653 INFO:tasks.workunit.client.1.smithi103.stdout:3/851: mkdir d1/d23/d25/d4f/dc6/d103 0 2024-09-18T21:13:02.654 INFO:tasks.workunit.client.0.smithi077.stdout:6/724: write d7/d7e/d11/d3e/d42/d88/da4/fd1 [1015820,1009] 0 2024-09-18T21:13:02.654 INFO:tasks.workunit.client.1.smithi103.stdout:3/852: fdatasync d1/d2/d18/d30/f38 0 2024-09-18T21:13:02.655 INFO:tasks.workunit.client.1.smithi103.stdout:3/853: readlink d1/da/df/l48 0 2024-09-18T21:13:02.655 INFO:tasks.workunit.client.0.smithi077.stdout:7/807: creat d12/dd5/d102/f112 x:0 0 0 2024-09-18T21:13:02.656 INFO:tasks.workunit.client.1.smithi103.stdout:7/839: link d1/df/d42/d1f/d5d/f7f d1/df/d42/d29/f113 0 2024-09-18T21:13:02.657 INFO:tasks.workunit.client.1.smithi103.stdout:7/840: chown d1/df/d42/d29/d48/d102 1 1 2024-09-18T21:13:02.659 INFO:tasks.workunit.client.0.smithi077.stdout:8/737: mknod d2/d5f/da8/d20/d3e/db4/c109 0 2024-09-18T21:13:02.661 INFO:tasks.workunit.client.1.smithi103.stdout:4/953: symlink d9/d38/db4/dec/l13b 0 2024-09-18T21:13:02.663 INFO:tasks.workunit.client.0.smithi077.stdout:7/808: truncate d12/d56/fd2 3361466 0 2024-09-18T21:13:02.665 INFO:tasks.workunit.client.1.smithi103.stdout:9/871: dread d18/d52/d6f/db9/dcb/fb0 [0,4194304] 0 2024-09-18T21:13:02.665 INFO:tasks.workunit.client.1.smithi103.stdout:6/864: dread d2/d3/d7f/fcd [0,4194304] 0 2024-09-18T21:13:02.666 INFO:tasks.workunit.client.0.smithi077.stdout:5/856: dwrite d0/d6/d3b/f4e [0,4194304] 0 2024-09-18T21:13:02.667 INFO:tasks.workunit.client.0.smithi077.stdout:7/809: dread d12/d22/daa/dc0/dac/dad/fb0 [0,4194304] 0 2024-09-18T21:13:02.668 INFO:tasks.workunit.client.1.smithi103.stdout:8/958: write d4/d2d/d3d/da0/dab/de7/f8a [2484934,62854] 0 2024-09-18T21:13:02.671 INFO:tasks.workunit.client.0.smithi077.stdout:5/857: dread d0/d6/dd/f24 [0,4194304] 0 2024-09-18T21:13:02.673 INFO:tasks.workunit.client.1.smithi103.stdout:1/814: truncate d0/d2/d9/dc/f7e 189494 0 2024-09-18T21:13:02.674 INFO:tasks.workunit.client.1.smithi103.stdout:2/775: creat d3/d110/f115 x:0 0 0 2024-09-18T21:13:02.674 INFO:tasks.workunit.client.1.smithi103.stdout:1/815: write d0/d2/d9/d9e/d7a/dd0/df9/d68/ff3 [518449,53785] 0 2024-09-18T21:13:02.676 INFO:tasks.workunit.client.0.smithi077.stdout:8/738: getdents d2/d5f/d6f/d105 0 2024-09-18T21:13:02.678 INFO:tasks.workunit.client.0.smithi077.stdout:7/810: dwrite d12/f24 [4194304,4194304] 0 2024-09-18T21:13:02.678 INFO:tasks.workunit.client.1.smithi103.stdout:7/841: creat d1/df/d42/d1f/d5d/dbe/f114 x:0 0 0 2024-09-18T21:13:02.681 INFO:tasks.workunit.client.1.smithi103.stdout:4/954: truncate d9/d1c/d77/f3d 2499800 0 2024-09-18T21:13:02.686 INFO:tasks.workunit.client.1.smithi103.stdout:5/884: write de/d1f/d3b/d58/dc4/d33/f53 [1031494,91410] 0 2024-09-18T21:13:02.687 INFO:tasks.workunit.client.0.smithi077.stdout:7/811: rename d12/d31/d77/d93/d89/c9d to d12/d22/d59/d5a/c113 0 2024-09-18T21:13:02.687 INFO:tasks.workunit.client.0.smithi077.stdout:7/812: fsync fa 0 2024-09-18T21:13:02.689 INFO:tasks.workunit.client.0.smithi077.stdout:8/739: creat d2/d5f/da8/d26/d106/f10a x:0 0 0 2024-09-18T21:13:02.691 INFO:tasks.workunit.client.1.smithi103.stdout:4/955: dwrite d9/d1c/dcd/dd1/f132 [0,4194304] 0 2024-09-18T21:13:02.693 INFO:tasks.workunit.client.0.smithi077.stdout:6/725: dwrite d7/d7e/d11/d3e/d42/dbb/d49/d55/dc2/fe5 [0,4194304] 0 2024-09-18T21:13:02.694 INFO:tasks.workunit.client.0.smithi077.stdout:6/726: fdatasync d7/fd9 0 2024-09-18T21:13:02.698 INFO:tasks.workunit.client.1.smithi103.stdout:7/842: creat d1/df/d42/d1f/d5d/f115 x:0 0 0 2024-09-18T21:13:02.702 INFO:tasks.workunit.client.1.smithi103.stdout:9/872: symlink d18/d52/d6f/d8e/d8f/dbd/df1/dfe/d117/l11f 0 2024-09-18T21:13:02.703 INFO:tasks.workunit.client.0.smithi077.stdout:5/858: write d0/d6/daa/fb8 [2360507,86926] 0 2024-09-18T21:13:02.703 INFO:tasks.workunit.client.0.smithi077.stdout:8/740: dread - d2/d5f/da8/d20/d3e/db4/fc5 zero size 2024-09-18T21:13:02.710 INFO:tasks.workunit.client.0.smithi077.stdout:5/859: creat d0/df/d10/d47/f11b x:0 0 0 2024-09-18T21:13:02.711 INFO:tasks.workunit.client.1.smithi103.stdout:5/885: creat de/d1f/d3b/d58/dc4/d33/d4f/da6/f124 x:0 0 0 2024-09-18T21:13:02.713 INFO:tasks.workunit.client.1.smithi103.stdout:3/854: write d1/da/df/f19 [208356,81377] 0 2024-09-18T21:13:02.714 INFO:tasks.workunit.client.1.smithi103.stdout:4/956: fdatasync d9/de3/f108 0 2024-09-18T21:13:02.715 INFO:tasks.workunit.client.0.smithi077.stdout:6/727: truncate d7/d7e/d11/d3e/d42/dbb/d4c/f86 869810 0 2024-09-18T21:13:02.717 INFO:tasks.workunit.client.1.smithi103.stdout:2/776: write d3/d5/f27 [1022267,88665] 0 2024-09-18T21:13:02.719 INFO:tasks.workunit.client.1.smithi103.stdout:6/865: link d2/f28 d2/d24/d5a/d67/d76/d43/dd4/f112 0 2024-09-18T21:13:02.720 INFO:tasks.workunit.client.1.smithi103.stdout:4/957: dwrite d9/d38/d72/df0/f49 [0,4194304] 0 2024-09-18T21:13:02.720 INFO:tasks.workunit.client.0.smithi077.stdout:8/741: write d2/d5f/da8/d4f/f69 [112394,22423] 0 2024-09-18T21:13:02.721 INFO:tasks.workunit.client.0.smithi077.stdout:6/728: truncate d7/d7e/d11/d3e/d42/d88/da4/f47 180678 0 2024-09-18T21:13:02.722 INFO:tasks.workunit.client.0.smithi077.stdout:7/813: link d12/d22/d59/d72/c8d d12/d31/d77/d93/c114 0 2024-09-18T21:13:02.724 INFO:tasks.workunit.client.1.smithi103.stdout:1/816: rename d0/d11/d5f/c5e to d0/d2/d2b/d3a/d42/d72/db0/da7/c11f 0 2024-09-18T21:13:02.724 INFO:tasks.workunit.client.0.smithi077.stdout:8/742: fdatasync d2/d5f/da8/d4f/f79 0 2024-09-18T21:13:02.726 INFO:tasks.workunit.client.1.smithi103.stdout:3/855: mknod d1/d23/d25/d4f/d72/d85/d93/c104 0 2024-09-18T21:13:02.727 INFO:tasks.workunit.client.0.smithi077.stdout:8/743: read d2/d27/d29/d72/f8c [3080941,100019] 0 2024-09-18T21:13:02.729 INFO:tasks.workunit.client.0.smithi077.stdout:8/744: chown d2/d5f/da8/d4f/d5a/d2a/dc8/df1/lf9 320 1 2024-09-18T21:13:02.731 INFO:tasks.workunit.client.0.smithi077.stdout:8/745: write d2/d27/d29/f9c [150567,110613] 0 2024-09-18T21:13:02.731 INFO:tasks.workunit.client.1.smithi103.stdout:9/873: dread d18/d29/d68/d92/d9c/dc8/fe9 [0,4194304] 0 2024-09-18T21:13:02.734 INFO:tasks.workunit.client.1.smithi103.stdout:1/817: unlink d0/d2/d9/dc/l3b 0 2024-09-18T21:13:02.739 INFO:tasks.workunit.client.1.smithi103.stdout:6/866: dread d2/f22 [0,4194304] 0 2024-09-18T21:13:02.740 INFO:tasks.workunit.client.0.smithi077.stdout:8/746: dread d2/d27/d29/f90 [0,4194304] 0 2024-09-18T21:13:02.740 INFO:tasks.workunit.client.1.smithi103.stdout:6/867: fdatasync d2/d3/d7f/d91/de5/fff 0 2024-09-18T21:13:02.741 INFO:tasks.workunit.client.0.smithi077.stdout:7/814: creat d12/d22/daa/dc0/f115 x:0 0 0 2024-09-18T21:13:02.745 INFO:tasks.workunit.client.1.smithi103.stdout:4/958: mkdir d9/d13c 0 2024-09-18T21:13:02.745 INFO:tasks.workunit.client.1.smithi103.stdout:4/959: stat f6 0 2024-09-18T21:13:02.748 INFO:tasks.workunit.client.1.smithi103.stdout:3/856: dread d1/da/f6b [0,4194304] 0 2024-09-18T21:13:02.748 INFO:tasks.workunit.client.0.smithi077.stdout:6/729: dwrite d7/d7e/d11/f6e [0,4194304] 0 2024-09-18T21:13:02.761 INFO:tasks.workunit.client.0.smithi077.stdout:7/815: truncate d12/f9a 1204987 0 2024-09-18T21:13:02.762 INFO:tasks.workunit.client.1.smithi103.stdout:2/777: truncate d3/d5/fe 7350930 0 2024-09-18T21:13:02.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:02 smithi103 ceph-mon[34827]: Updating smithi077:/var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T21:13:02.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:02 smithi103 ceph-mon[34827]: Updating smithi103:/etc/ceph/ceph.client.admin.keyring 2024-09-18T21:13:02.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:02 smithi103 ceph-mon[34827]: Updating smithi077:/etc/ceph/ceph.client.admin.keyring 2024-09-18T21:13:02.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:02 smithi103 ceph-mon[34827]: Updating smithi103:/var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T21:13:02.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:02 smithi103 ceph-mon[34827]: Updating smithi077:/var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T21:13:02.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:02 smithi103 ceph-mon[34827]: pgmap v22: 65 pgs: 65 active+clean; 3.1 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 106 MiB/s rd, 301 MiB/s wr, 605 op/s 2024-09-18T21:13:02.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:02 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:02.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:02 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:02.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:02 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:02.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:02 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:02.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:02 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:02.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:02 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:02.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:02 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:02.764 INFO:tasks.workunit.client.1.smithi103.stdout:6/868: creat d2/d3/d7f/d91/da2/de4/f113 x:0 0 0 2024-09-18T21:13:02.766 INFO:tasks.workunit.client.0.smithi077.stdout:6/730: read d7/d7e/d11/d3e/d42/dbb/d49/fbc [365841,106489] 0 2024-09-18T21:13:02.769 INFO:tasks.workunit.client.0.smithi077.stdout:8/747: rename d2/d5f/da8/d26/fa2 to d2/d27/d29/f10b 0 2024-09-18T21:13:02.770 INFO:tasks.workunit.client.1.smithi103.stdout:7/843: rename d1/df/d42/d29/d48/dbb/f4f to d1/df/f116 0 2024-09-18T21:13:02.773 INFO:tasks.workunit.client.1.smithi103.stdout:9/874: mkdir d18/d52/d5e/d120 0 2024-09-18T21:13:02.775 INFO:tasks.workunit.client.1.smithi103.stdout:1/818: dwrite d0/d11/fda [0,4194304] 0 2024-09-18T21:13:02.778 INFO:tasks.workunit.client.1.smithi103.stdout:4/960: write d9/d38/d72/df0/d83/db6/d41/fda [1109847,8072] 0 2024-09-18T21:13:02.778 INFO:tasks.workunit.client.1.smithi103.stdout:6/869: creat d2/d3/d8/f114 x:0 0 0 2024-09-18T21:13:02.778 INFO:tasks.workunit.client.0.smithi077.stdout:8/748: read d2/d5f/da8/d4f/d5a/d2a/d88/ffd [1697102,68335] 0 2024-09-18T21:13:02.780 INFO:tasks.workunit.client.1.smithi103.stdout:0/808: sync 2024-09-18T21:13:02.787 INFO:tasks.workunit.client.1.smithi103.stdout:3/857: dwrite d1/f24 [0,4194304] 0 2024-09-18T21:13:02.787 INFO:tasks.workunit.client.1.smithi103.stdout:3/858: stat d1/d64/la8 0 2024-09-18T21:13:02.788 INFO:tasks.workunit.client.1.smithi103.stdout:3/859: stat d1/d23/d25/d4f/d72/d7e 0 2024-09-18T21:13:02.790 INFO:tasks.workunit.client.1.smithi103.stdout:1/819: mknod d0/d2/d2b/d3a/d42/c120 0 2024-09-18T21:13:02.790 INFO:tasks.workunit.client.0.smithi077.stdout:7/816: creat d12/f116 x:0 0 0 2024-09-18T21:13:02.791 INFO:tasks.workunit.client.1.smithi103.stdout:2/778: creat d3/d5/d2f/d32/dfc/f116 x:0 0 0 2024-09-18T21:13:02.792 INFO:tasks.workunit.client.0.smithi077.stdout:6/731: rmdir d7/d7e/dd0 0 2024-09-18T21:13:02.794 INFO:tasks.workunit.client.0.smithi077.stdout:8/749: rename d2/d27/d29/l7f to d2/d5/d6/d9f/da6/l10c 0 2024-09-18T21:13:02.795 INFO:tasks.workunit.client.1.smithi103.stdout:0/809: truncate d1/d5/de/d19/d1e/d34/f45 290203 0 2024-09-18T21:13:02.798 INFO:tasks.workunit.client.1.smithi103.stdout:2/779: dwrite d3/d5/d2c/d77/d9c/db8/fdc [0,4194304] 0 2024-09-18T21:13:02.799 INFO:tasks.workunit.client.1.smithi103.stdout:7/844: fsync d1/df/d44/fa0 0 2024-09-18T21:13:02.799 INFO:tasks.workunit.client.1.smithi103.stdout:2/780: chown d3/d5/d2f/d32/ffb 28 1 2024-09-18T21:13:02.800 INFO:tasks.workunit.client.0.smithi077.stdout:7/817: symlink d12/l117 0 2024-09-18T21:13:02.801 INFO:tasks.workunit.client.1.smithi103.stdout:2/781: chown d3/f6e 5 1 2024-09-18T21:13:02.801 INFO:tasks.workunit.client.1.smithi103.stdout:3/860: mkdir d1/d2/d18/d30/d4e/db1/d105 0 2024-09-18T21:13:02.802 INFO:tasks.workunit.client.1.smithi103.stdout:7/845: chown d1/df/d44/db4/f111 3 1 2024-09-18T21:13:02.804 INFO:tasks.workunit.client.1.smithi103.stdout:0/810: dwrite d1/d9/f114 [0,4194304] 0 2024-09-18T21:13:02.806 INFO:tasks.workunit.client.1.smithi103.stdout:0/811: write d1/d5/f6 [67495,52404] 0 2024-09-18T21:13:02.806 INFO:tasks.workunit.client.1.smithi103.stdout:0/812: dread - d1/d9/d3e/f119 zero size 2024-09-18T21:13:02.810 INFO:tasks.workunit.client.0.smithi077.stdout:7/818: symlink d12/d31/d77/d93/d89/d99/l118 0 2024-09-18T21:13:02.811 INFO:tasks.workunit.client.0.smithi077.stdout:8/750: write d2/d5f/da8/d20/fa1 [158216,115433] 0 2024-09-18T21:13:02.811 INFO:tasks.workunit.client.0.smithi077.stdout:7/819: dread - d12/d22/daa/dc0/dac/dad/ff0 zero size 2024-09-18T21:13:02.813 INFO:tasks.workunit.client.0.smithi077.stdout:8/751: dread d2/d5/f93 [0,4194304] 0 2024-09-18T21:13:02.813 INFO:tasks.workunit.client.1.smithi103.stdout:5/886: rename de/d1f/d3b/db4 to de/d1f/d3b/d58/dc4/d125 0 2024-09-18T21:13:02.813 INFO:tasks.workunit.client.1.smithi103.stdout:5/887: fsync de/d2d/d7f/f4c 0 2024-09-18T21:13:02.814 INFO:tasks.workunit.client.0.smithi077.stdout:6/732: getdents d7/d7e/d11/d3e/d42/dbb/d49/d55 0 2024-09-18T21:13:02.815 INFO:tasks.workunit.client.0.smithi077.stdout:6/733: chown d7/d7e/d11/d3e/d42/dbb/d31/lea 448353703 1 2024-09-18T21:13:02.816 INFO:tasks.workunit.client.0.smithi077.stdout:7/820: creat d12/d31/d77/d93/d89/d99/da9/f119 x:0 0 0 2024-09-18T21:13:02.817 INFO:tasks.workunit.client.0.smithi077.stdout:7/821: stat d12/d31/f41 0 2024-09-18T21:13:02.817 INFO:tasks.workunit.client.1.smithi103.stdout:6/870: truncate d2/d3/d8/d4c/d7d/fea 75517 0 2024-09-18T21:13:02.819 INFO:tasks.workunit.client.0.smithi077.stdout:8/752: unlink d2/d27/d29/d41/dbc/f78 0 2024-09-18T21:13:02.821 INFO:tasks.workunit.client.0.smithi077.stdout:6/734: chown d7/d7e/d11/d3e/d42/dbb/d31/f71 1 1 2024-09-18T21:13:02.821 INFO:tasks.workunit.client.0.smithi077.stdout:8/753: chown d2/d5f/da8/d4f/d5a/d5e/d8f/dad 165 1 2024-09-18T21:13:02.823 INFO:tasks.workunit.client.0.smithi077.stdout:7/822: creat d12/d56/da1/f11a x:0 0 0 2024-09-18T21:13:02.824 INFO:tasks.workunit.client.0.smithi077.stdout:6/735: symlink d7/d7e/d11/d3e/d42/dbb/d50/lfa 0 2024-09-18T21:13:02.830 INFO:tasks.workunit.client.0.smithi077.stdout:7/823: dwrite d12/d31/fda [0,4194304] 0 2024-09-18T21:13:02.830 INFO:tasks.workunit.client.0.smithi077.stdout:6/736: dread d7/d7e/d11/f6e [0,4194304] 0 2024-09-18T21:13:02.831 INFO:tasks.workunit.client.0.smithi077.stdout:6/737: dread - d7/fd9 zero size 2024-09-18T21:13:02.835 INFO:tasks.workunit.client.0.smithi077.stdout:6/738: rmdir d7/d7e/d11/d3e/d42/dbb/d5c 39 2024-09-18T21:13:02.837 INFO:tasks.workunit.client.1.smithi103.stdout:6/871: chown d2/d3/f5b 5 1 2024-09-18T21:13:02.837 INFO:tasks.workunit.client.1.smithi103.stdout:3/861: mkdir d1/d23/d25/da1/dfa/d106 0 2024-09-18T21:13:02.839 INFO:tasks.workunit.client.1.smithi103.stdout:6/872: readlink d2/d3/d8/d4c/d7d/lec 0 2024-09-18T21:13:02.839 INFO:tasks.workunit.client.1.smithi103.stdout:5/888: write de/f2b [605889,129192] 0 2024-09-18T21:13:02.840 INFO:tasks.workunit.client.1.smithi103.stdout:0/813: fdatasync d1/d5/de/d19/d1e/d34/f45 0 2024-09-18T21:13:02.841 INFO:tasks.workunit.client.0.smithi077.stdout:6/739: getdents d7/d7e/d11/d3e/d42/dbb/d49/d55/dc2/def 0 2024-09-18T21:13:02.843 INFO:tasks.workunit.client.0.smithi077.stdout:6/740: read d7/d7e/f28 [1559913,2169] 0 2024-09-18T21:13:02.843 INFO:tasks.workunit.client.1.smithi103.stdout:7/846: creat d1/df/d43/d63/f117 x:0 0 0 2024-09-18T21:13:02.844 INFO:tasks.workunit.client.0.smithi077.stdout:6/741: chown d7/fa9 14011 1 2024-09-18T21:13:02.844 INFO:tasks.workunit.client.1.smithi103.stdout:2/782: link d3/d5/d25/f37 d3/d5/d2f/d48/dab/f117 0 2024-09-18T21:13:02.845 INFO:tasks.workunit.client.1.smithi103.stdout:3/862: dwrite d1/d23/d25/d4f/d58/d86/f102 [0,4194304] 0 2024-09-18T21:13:02.846 INFO:tasks.workunit.client.1.smithi103.stdout:7/847: chown d1/df/d42/d1f/d5d/d85/lac 922226666 1 2024-09-18T21:13:02.848 INFO:tasks.workunit.client.1.smithi103.stdout:4/961: rename d9/d1c/f11a to d9/d38/d72/df0/d61/d91/f13d 0 2024-09-18T21:13:02.852 INFO:tasks.workunit.client.1.smithi103.stdout:0/814: dread d1/d5/de/d24/d43/d76/f9c [0,4194304] 0 2024-09-18T21:13:02.853 INFO:tasks.workunit.client.1.smithi103.stdout:2/783: symlink d3/d5/d2c/d77/d9c/l118 0 2024-09-18T21:13:02.855 INFO:tasks.workunit.client.0.smithi077.stdout:6/742: rmdir d7/d7e/d11/d3e/d42/d88/da4/dd4 0 2024-09-18T21:13:02.856 INFO:tasks.workunit.client.1.smithi103.stdout:3/863: dwrite d1/d23/d25/d4f/d72/d85/fb3 [0,4194304] 0 2024-09-18T21:13:02.858 INFO:tasks.workunit.client.1.smithi103.stdout:6/873: dwrite d2/d24/d5a/d67/d76/d43/d44/f98 [0,4194304] 0 2024-09-18T21:13:02.858 INFO:tasks.workunit.client.1.smithi103.stdout:7/848: mknod d1/df/d43/d63/d67/d5b/c118 0 2024-09-18T21:13:02.859 INFO:tasks.workunit.client.0.smithi077.stdout:6/743: read d7/f1c [842033,97003] 0 2024-09-18T21:13:02.860 INFO:tasks.workunit.client.0.smithi077.stdout:7/824: dread d12/d56/f3a [0,4194304] 0 2024-09-18T21:13:02.861 INFO:tasks.workunit.client.0.smithi077.stdout:6/744: write d7/d7e/d11/d3e/dcd/fd3 [313430,75046] 0 2024-09-18T21:13:02.862 INFO:tasks.workunit.client.0.smithi077.stdout:7/825: fsync d12/d31/d77/d93/d89/faf 0 2024-09-18T21:13:02.863 INFO:tasks.workunit.client.1.smithi103.stdout:2/784: creat d3/d5/d2f/d32/f119 x:0 0 0 2024-09-18T21:13:02.865 INFO:tasks.workunit.client.1.smithi103.stdout:3/864: mkdir d1/d23/d25/d4f/d58/d68/d50/d54/d8c/d107 0 2024-09-18T21:13:02.867 INFO:tasks.workunit.client.1.smithi103.stdout:6/874: creat d2/d24/d5a/d67/d76/da4/dc7/f115 x:0 0 0 2024-09-18T21:13:02.867 INFO:tasks.workunit.client.1.smithi103.stdout:3/865: read - d1/d23/d25/d4f/d72/d7e/ffe zero size 2024-09-18T21:13:02.868 INFO:tasks.workunit.client.1.smithi103.stdout:6/875: chown d2/d24/d5a/d67/d76/da4 4197 1 2024-09-18T21:13:02.873 INFO:tasks.workunit.client.0.smithi077.stdout:6/745: read d7/d7e/f36 [2328816,52063] 0 2024-09-18T21:13:02.875 INFO:tasks.workunit.client.1.smithi103.stdout:4/962: getdents d9/d38/d72/d85/dd8/d10b 0 2024-09-18T21:13:02.875 INFO:tasks.workunit.client.0.smithi077.stdout:7/826: rmdir d12/d31/d77/d93/d89/d99 39 2024-09-18T21:13:02.880 INFO:tasks.workunit.client.0.smithi077.stdout:6/746: creat d7/d7e/d11/d3e/d42/dbb/d49/d55/dc2/ffb x:0 0 0 2024-09-18T21:13:02.882 INFO:tasks.workunit.client.0.smithi077.stdout:7/827: mkdir d12/d56/da1/db6/dbd/d11b 0 2024-09-18T21:13:02.884 INFO:tasks.workunit.client.1.smithi103.stdout:1/820: rename d0/d2/d9/d10/da0/ff1 to d0/d2/d2b/d3a/d42/d72/f121 0 2024-09-18T21:13:02.885 INFO:tasks.workunit.client.0.smithi077.stdout:6/747: creat d7/d7e/d11/d3e/d42/dbb/d49/d55/ffc x:0 0 0 2024-09-18T21:13:02.887 INFO:tasks.workunit.client.1.smithi103.stdout:0/815: creat d1/d5/de/f11f x:0 0 0 2024-09-18T21:13:02.888 INFO:tasks.workunit.client.1.smithi103.stdout:0/816: write d1/d9/f2b [270334,18843] 0 2024-09-18T21:13:02.890 INFO:tasks.workunit.client.1.smithi103.stdout:3/866: creat d1/d23/d25/d4f/d58/d68/d50/d54/ded/f108 x:0 0 0 2024-09-18T21:13:02.892 INFO:tasks.workunit.client.1.smithi103.stdout:3/867: truncate d1/d23/d25/d4f/d58/d68/fac 1666619 0 2024-09-18T21:13:02.893 INFO:tasks.workunit.client.1.smithi103.stdout:4/963: rename d9/d38/db4/dec to d9/d38/d72/d85/dd8/d10b/d13e 0 2024-09-18T21:13:02.894 INFO:tasks.workunit.client.0.smithi077.stdout:7/828: creat d12/d31/d77/d93/d89/d99/f11c x:0 0 0 2024-09-18T21:13:02.894 INFO:tasks.workunit.client.1.smithi103.stdout:4/964: read - d9/d38/d72/df0/d61/fa2 zero size 2024-09-18T21:13:02.894 INFO:tasks.workunit.client.1.smithi103.stdout:1/821: rmdir d0/d2/d9/d10/d5d 39 2024-09-18T21:13:02.898 INFO:tasks.workunit.client.0.smithi077.stdout:7/829: dread d12/d56/da1/db6/dbd/fd6 [0,4194304] 0 2024-09-18T21:13:02.899 INFO:tasks.workunit.client.1.smithi103.stdout:3/868: truncate d1/da/df/f77 1006515 0 2024-09-18T21:13:02.900 INFO:tasks.workunit.client.1.smithi103.stdout:3/869: fdatasync d1/d23/d25/d4f/d58/d68/fac 0 2024-09-18T21:13:02.901 INFO:tasks.workunit.client.1.smithi103.stdout:0/817: rename d1/lf2 to d1/d5/de/d24/d43/dfd/l120 0 2024-09-18T21:13:02.902 INFO:tasks.workunit.client.1.smithi103.stdout:7/849: write d1/df/d43/d61/fb8 [194344,3079] 0 2024-09-18T21:13:02.902 INFO:tasks.workunit.client.0.smithi077.stdout:7/830: rmdir d12/d22/d59 39 2024-09-18T21:13:02.904 INFO:tasks.workunit.client.1.smithi103.stdout:4/965: mknod d9/d38/d72/df0/d61/d91/d9e/d48/c13f 0 2024-09-18T21:13:02.906 INFO:tasks.workunit.client.0.smithi077.stdout:7/831: dread - d12/d22/daa/dc0/dac/dad/fca zero size 2024-09-18T21:13:02.907 INFO:tasks.workunit.client.0.smithi077.stdout:7/832: write d12/d22/f65 [974193,108220] 0 2024-09-18T21:13:02.907 INFO:tasks.workunit.client.1.smithi103.stdout:3/870: write d1/d2/d18/f44 [3986761,43921] 0 2024-09-18T21:13:02.909 INFO:tasks.workunit.client.1.smithi103.stdout:1/822: rename d0/d2/d9/d9e/d7a/dd0/df9/d68/d81/da2/da4/fdc to d0/d2/d2b/d111/f122 0 2024-09-18T21:13:02.913 INFO:tasks.workunit.client.0.smithi077.stdout:7/833: creat d12/d31/d77/da0/f11d x:0 0 0 2024-09-18T21:13:02.914 INFO:tasks.workunit.client.1.smithi103.stdout:4/966: truncate d9/f6a 106706 0 2024-09-18T21:13:02.915 INFO:tasks.workunit.client.0.smithi077.stdout:7/834: truncate d12/ff7 988195 0 2024-09-18T21:13:02.915 INFO:tasks.workunit.client.1.smithi103.stdout:2/785: dwrite d3/d5/d2f/d5b/f6c [0,4194304] 0 2024-09-18T21:13:02.915 INFO:tasks.workunit.client.1.smithi103.stdout:6/876: dwrite d2/d24/d5a/d67/d76/f8c [0,4194304] 0 2024-09-18T21:13:02.916 INFO:tasks.workunit.client.0.smithi077.stdout:7/835: dread - d12/d56/da1/db6/fb8 zero size 2024-09-18T21:13:02.916 INFO:tasks.workunit.client.1.smithi103.stdout:2/786: dread - d3/d5/d2c/d54/d68/f6b zero size 2024-09-18T21:13:02.916 INFO:tasks.workunit.client.1.smithi103.stdout:6/877: fdatasync d2/d24/f80 0 2024-09-18T21:13:02.917 INFO:tasks.workunit.client.0.smithi077.stdout:6/748: dwrite d7/d7e/d11/d3e/d42/dbb/f5d [0,4194304] 0 2024-09-18T21:13:02.918 INFO:tasks.workunit.client.0.smithi077.stdout:7/836: write d12/d31/d77/da0/fea [275462,75341] 0 2024-09-18T21:13:02.918 INFO:tasks.workunit.client.1.smithi103.stdout:2/787: write d3/d5/d4a/f5e [3830257,101177] 0 2024-09-18T21:13:02.925 INFO:tasks.workunit.client.0.smithi077.stdout:6/749: mkdir d7/d7e/da6/dfd 0 2024-09-18T21:13:02.926 INFO:tasks.workunit.client.0.smithi077.stdout:6/750: dread - d7/fa9 zero size 2024-09-18T21:13:02.929 INFO:tasks.workunit.client.0.smithi077.stdout:7/837: unlink d12/d56/l4b 0 2024-09-18T21:13:02.933 INFO:tasks.workunit.client.0.smithi077.stdout:7/838: mkdir d12/d56/da1/db6/d11e 0 2024-09-18T21:13:02.933 INFO:tasks.workunit.client.1.smithi103.stdout:0/818: dwrite d1/d9/d3e/d6e/f97 [0,4194304] 0 2024-09-18T21:13:02.934 INFO:tasks.workunit.client.1.smithi103.stdout:0/819: chown d1/d5/de/dc0/db0/f117 120 1 2024-09-18T21:13:02.935 INFO:tasks.workunit.client.0.smithi077.stdout:7/839: write d12/d22/f28 [1493650,96776] 0 2024-09-18T21:13:02.935 INFO:tasks.workunit.client.1.smithi103.stdout:6/878: write d2/d3/d7f/d91/f111 [2733062,53728] 0 2024-09-18T21:13:02.936 INFO:tasks.workunit.client.1.smithi103.stdout:8/959: sync 2024-09-18T21:13:02.937 INFO:tasks.workunit.client.1.smithi103.stdout:8/960: write d4/f118 [793438,104559] 0 2024-09-18T21:13:02.938 INFO:tasks.workunit.client.1.smithi103.stdout:6/879: write d2/d24/d5a/d67/d76/da4/fd8 [49091,25224] 0 2024-09-18T21:13:02.938 INFO:tasks.workunit.client.1.smithi103.stdout:3/871: rename d1/d23/d25/d4f/d72/d85/l97 to d1/l109 0 2024-09-18T21:13:02.941 INFO:tasks.workunit.client.0.smithi077.stdout:6/751: dread d7/d7e/d11/d3e/d42/dbb/d50/dd5/ff4 [0,4194304] 0 2024-09-18T21:13:02.941 INFO:tasks.workunit.client.1.smithi103.stdout:1/823: getdents d0/d2/da8 0 2024-09-18T21:13:02.943 INFO:tasks.workunit.client.1.smithi103.stdout:1/824: chown d0/d2/d9/dc/d6e/cce 1 1 2024-09-18T21:13:02.943 INFO:tasks.workunit.client.0.smithi077.stdout:7/840: dwrite d12/d31/d77/d93/d2a/d6c/fcf [0,4194304] 0 2024-09-18T21:13:02.944 INFO:tasks.workunit.client.1.smithi103.stdout:2/788: rename d3/d5/d25 to d3/d110/d11a 0 2024-09-18T21:13:02.945 INFO:tasks.workunit.client.0.smithi077.stdout:7/841: chown d12/d31/d77/da0/fa8 0 1 2024-09-18T21:13:02.946 INFO:tasks.workunit.client.1.smithi103.stdout:2/789: fdatasync d3/d5/f4c 0 2024-09-18T21:13:02.946 INFO:tasks.workunit.client.1.smithi103.stdout:0/820: write d1/f12 [8310156,42299] 0 2024-09-18T21:13:02.947 INFO:tasks.workunit.client.1.smithi103.stdout:3/872: dwrite d1/d2/d18/d30/f38 [0,4194304] 0 2024-09-18T21:13:02.947 INFO:tasks.workunit.client.1.smithi103.stdout:8/961: mkdir d4/d26/d56/d77/d131 0 2024-09-18T21:13:02.949 INFO:tasks.workunit.client.1.smithi103.stdout:2/790: stat d3/d5/d2c/d77/d9c/l118 0 2024-09-18T21:13:02.949 INFO:tasks.workunit.client.0.smithi077.stdout:6/752: mknod d7/d7e/d11/d3e/d42/dbb/d49/d55/cfe 0 2024-09-18T21:13:02.954 INFO:tasks.workunit.client.0.smithi077.stdout:7/842: mkdir d12/d22/daa/dc0/d11f 0 2024-09-18T21:13:02.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:02 smithi077 ceph-mon[27689]: Updating smithi077:/var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T21:13:02.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:02 smithi077 ceph-mon[27689]: Updating smithi103:/etc/ceph/ceph.client.admin.keyring 2024-09-18T21:13:02.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:02 smithi077 ceph-mon[27689]: Updating smithi077:/etc/ceph/ceph.client.admin.keyring 2024-09-18T21:13:02.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:02 smithi077 ceph-mon[27689]: Updating smithi103:/var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T21:13:02.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:02 smithi077 ceph-mon[27689]: Updating smithi077:/var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T21:13:02.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:02 smithi077 ceph-mon[27689]: pgmap v22: 65 pgs: 65 active+clean; 3.1 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 106 MiB/s rd, 301 MiB/s wr, 605 op/s 2024-09-18T21:13:02.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:02 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:02.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:02 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:02.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:02 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:02.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:02 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:02.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:02 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:02.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:02 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:02.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:02 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:02.976 INFO:tasks.workunit.client.0.smithi077.stdout:7/843: dread d12/d31/f83 [0,4194304] 0 2024-09-18T21:13:02.978 INFO:tasks.workunit.client.0.smithi077.stdout:7/844: symlink d12/d22/daa/dc0/dac/dad/l120 0 2024-09-18T21:13:02.980 INFO:tasks.workunit.client.0.smithi077.stdout:6/753: truncate d7/d7e/d11/dd8/fed 3800482 0 2024-09-18T21:13:02.981 INFO:tasks.workunit.client.0.smithi077.stdout:7/845: creat d12/d31/d77/d93/f121 x:0 0 0 2024-09-18T21:13:02.986 INFO:tasks.workunit.client.0.smithi077.stdout:6/754: write d7/d7e/da6/fc1 [5051256,122353] 0 2024-09-18T21:13:02.986 INFO:tasks.workunit.client.0.smithi077.stdout:7/846: write d12/d22/d59/d72/f9b [676704,49460] 0 2024-09-18T21:13:02.988 INFO:tasks.workunit.client.0.smithi077.stdout:7/847: rmdir d12/d31/d77/d93/d89/dfe/d103 39 2024-09-18T21:13:02.994 INFO:tasks.workunit.client.1.smithi103.stdout:8/962: chown d4/d81/dd7/dde/lb4 5857 1 2024-09-18T21:13:02.998 INFO:tasks.workunit.client.1.smithi103.stdout:6/880: dwrite d2/d24/d5a/f64 [4194304,4194304] 0 2024-09-18T21:13:02.998 INFO:tasks.workunit.client.0.smithi077.stdout:6/755: mknod d7/d7e/d11/d3e/d42/d88/da4/df8/cff 0 2024-09-18T21:13:02.999 INFO:tasks.workunit.client.1.smithi103.stdout:0/821: truncate d1/d5/de/dc0/d8c/dce/d9f/d4f/d68/f10f 68580 0 2024-09-18T21:13:02.999 INFO:tasks.workunit.client.0.smithi077.stdout:7/848: mkdir d12/d22/d122 0 2024-09-18T21:13:02.999 INFO:tasks.workunit.client.1.smithi103.stdout:4/967: dread d9/d38/d72/df0/d61/d91/d9e/f79 [4194304,4194304] 0 2024-09-18T21:13:03.000 INFO:tasks.workunit.client.1.smithi103.stdout:2/791: mknod d3/d5/d2f/d48/dab/c11b 0 2024-09-18T21:13:03.000 INFO:tasks.workunit.client.1.smithi103.stdout:7/850: dwrite d1/df/d42/f10d [0,4194304] 0 2024-09-18T21:13:03.001 INFO:tasks.workunit.client.1.smithi103.stdout:2/792: chown d3/d5/l14 0 1 2024-09-18T21:13:03.002 INFO:tasks.workunit.client.1.smithi103.stdout:7/851: stat d1/df/d42/d1f/d2e/fd9 0 2024-09-18T21:13:03.002 INFO:tasks.workunit.client.0.smithi077.stdout:7/849: fsync d12/d31/d77/d93/d2a/d7f/fb3 0 2024-09-18T21:13:03.005 INFO:tasks.workunit.client.1.smithi103.stdout:6/881: unlink d2/d3/d8/d4c/d79/d9e/cd5 0 2024-09-18T21:13:03.005 INFO:tasks.workunit.client.1.smithi103.stdout:2/793: dread d3/d110/d11a/d98/f9a [0,4194304] 0 2024-09-18T21:13:03.006 INFO:tasks.workunit.client.1.smithi103.stdout:6/882: write d2/d24/f108 [2095585,53013] 0 2024-09-18T21:13:03.007 INFO:tasks.workunit.client.1.smithi103.stdout:8/963: truncate d4/d26/d56/d77/d9f/fa6 445679 0 2024-09-18T21:13:03.009 INFO:tasks.workunit.client.0.smithi077.stdout:2/851: sync 2024-09-18T21:13:03.009 INFO:tasks.workunit.client.0.smithi077.stdout:7/850: mknod d12/d31/d77/d93/d2a/c123 0 2024-09-18T21:13:03.012 INFO:tasks.workunit.client.1.smithi103.stdout:7/852: creat d1/df/d43/d63/d67/d5b/f119 x:0 0 0 2024-09-18T21:13:03.013 INFO:tasks.workunit.client.0.smithi077.stdout:6/756: write d7/d7e/f36 [5183666,72208] 0 2024-09-18T21:13:03.014 INFO:tasks.workunit.client.1.smithi103.stdout:3/873: truncate d1/d23/fa6 2869655 0 2024-09-18T21:13:03.016 INFO:tasks.workunit.client.1.smithi103.stdout:2/794: mknod d3/d5/d2f/d32/d90/df0/c11c 0 2024-09-18T21:13:03.016 INFO:tasks.workunit.client.0.smithi077.stdout:7/851: getdents d12/d56/da1/db6/dbd/d11b 0 2024-09-18T21:13:03.017 INFO:tasks.workunit.client.0.smithi077.stdout:6/757: fdatasync d7/d7e/f58 0 2024-09-18T21:13:03.019 INFO:tasks.workunit.client.0.smithi077.stdout:7/852: mknod d12/d31/d77/d93/d89/d94/c124 0 2024-09-18T21:13:03.020 INFO:tasks.workunit.client.0.smithi077.stdout:6/758: mkdir d7/d7e/d11/d3e/d42/dbb/d50/dd5/d100 0 2024-09-18T21:13:03.022 INFO:tasks.workunit.client.0.smithi077.stdout:7/853: mknod d12/d22/daa/dbc/c125 0 2024-09-18T21:13:03.022 INFO:tasks.workunit.client.0.smithi077.stdout:7/854: chown d12/d56/ld4 17970 1 2024-09-18T21:13:03.023 INFO:tasks.workunit.client.1.smithi103.stdout:2/795: mknod d3/d5/d2f/d32/dae/c11d 0 2024-09-18T21:13:03.024 INFO:tasks.workunit.client.0.smithi077.stdout:6/759: creat d7/d7e/d11/d3e/d42/d88/da4/df8/f101 x:0 0 0 2024-09-18T21:13:03.026 INFO:tasks.workunit.client.0.smithi077.stdout:6/760: write d7/d7e/da6/fc1 [2565737,59607] 0 2024-09-18T21:13:03.027 INFO:tasks.workunit.client.1.smithi103.stdout:8/964: unlink d4/d2d/d87/l9e 0 2024-09-18T21:13:03.028 INFO:tasks.workunit.client.1.smithi103.stdout:8/965: truncate d4/d2d/dc1/f11c 357241 0 2024-09-18T21:13:03.028 INFO:tasks.workunit.client.0.smithi077.stdout:7/855: truncate d12/d31/f83 654228 0 2024-09-18T21:13:03.030 INFO:tasks.workunit.client.1.smithi103.stdout:5/889: sync 2024-09-18T21:13:03.030 INFO:tasks.workunit.client.1.smithi103.stdout:9/875: sync 2024-09-18T21:13:03.030 INFO:tasks.workunit.client.1.smithi103.stdout:0/822: write d1/f4 [1996705,4327] 0 2024-09-18T21:13:03.033 INFO:tasks.workunit.client.0.smithi077.stdout:6/761: mkdir d7/d7e/d11/d3e/d42/d88/da4/d102 0 2024-09-18T21:13:03.035 INFO:tasks.workunit.client.1.smithi103.stdout:2/796: write d3/fbc [5070157,70626] 0 2024-09-18T21:13:03.036 INFO:tasks.workunit.client.0.smithi077.stdout:6/762: mknod d7/d7e/d11/d3e/dcd/c103 0 2024-09-18T21:13:03.037 INFO:tasks.workunit.client.1.smithi103.stdout:2/797: stat d3/d5/d2c/d77/d9c 0 2024-09-18T21:13:03.037 INFO:tasks.workunit.client.1.smithi103.stdout:7/853: link d1/df/dbf/cdf d1/df/d42/d1f/d5d/c11a 0 2024-09-18T21:13:03.039 INFO:tasks.workunit.client.0.smithi077.stdout:7/856: dwrite d12/d22/d59/d5a/f70 [0,4194304] 0 2024-09-18T21:13:03.040 INFO:tasks.workunit.client.1.smithi103.stdout:6/883: dwrite d2/d24/f5e [0,4194304] 0 2024-09-18T21:13:03.040 INFO:tasks.workunit.client.0.smithi077.stdout:6/763: mknod d7/d7e/d11/d3e/dcd/c104 0 2024-09-18T21:13:03.041 INFO:tasks.workunit.client.0.smithi077.stdout:7/857: dread - d12/d22/daa/dc0/dac/dad/fca zero size 2024-09-18T21:13:03.043 INFO:tasks.workunit.client.1.smithi103.stdout:2/798: dread d3/d5/d2c/d77/fdb [0,4194304] 0 2024-09-18T21:13:03.044 INFO:tasks.workunit.client.1.smithi103.stdout:2/799: write d3/d5/d2f/d32/d46/fc9 [2189081,122052] 0 2024-09-18T21:13:03.045 INFO:tasks.workunit.client.0.smithi077.stdout:6/764: read d7/d7e/d11/f57 [172760,54474] 0 2024-09-18T21:13:03.046 INFO:tasks.workunit.client.1.smithi103.stdout:8/966: rename d4/de/de3 to d4/d81/dd7/dde/d59/d5e/d132 0 2024-09-18T21:13:03.049 INFO:tasks.workunit.client.0.smithi077.stdout:7/858: mkdir d12/d31/d77/d93/d89/d94/d126 0 2024-09-18T21:13:03.050 INFO:tasks.workunit.client.1.smithi103.stdout:0/823: mkdir d1/d9/d3e/d121 0 2024-09-18T21:13:03.053 INFO:tasks.workunit.client.1.smithi103.stdout:8/967: dwrite d4/d2d/d4e/de9/f124 [0,4194304] 0 2024-09-18T21:13:03.054 INFO:tasks.workunit.client.1.smithi103.stdout:7/854: unlink d1/df/d42/d29/d48/dbb/d33/f40 0 2024-09-18T21:13:03.070 INFO:tasks.workunit.client.1.smithi103.stdout:8/968: read d4/f116 [3213326,49958] 0 2024-09-18T21:13:03.070 INFO:tasks.workunit.client.1.smithi103.stdout:3/874: truncate d1/d2/d18/d30/d4e/f61 3176071 0 2024-09-18T21:13:03.070 INFO:tasks.workunit.client.1.smithi103.stdout:7/855: dread - d1/df/d44/dba/fcb zero size 2024-09-18T21:13:03.071 INFO:tasks.workunit.client.1.smithi103.stdout:5/890: link de/d1f/l4e de/d1f/d3b/d51/d57/d59/l126 0 2024-09-18T21:13:03.073 INFO:tasks.workunit.client.1.smithi103.stdout:0/824: symlink d1/d5/de/dc0/l122 0 2024-09-18T21:13:03.073 INFO:tasks.workunit.client.1.smithi103.stdout:7/856: readlink d1/df/l47 0 2024-09-18T21:13:03.073 INFO:tasks.workunit.client.1.smithi103.stdout:7/857: readlink d1/l8 0 2024-09-18T21:13:03.074 INFO:tasks.workunit.client.1.smithi103.stdout:8/969: symlink d4/d2d/dc1/dee/l133 0 2024-09-18T21:13:03.074 INFO:tasks.workunit.client.1.smithi103.stdout:7/858: read - d1/df/d42/d1f/ff2 zero size 2024-09-18T21:13:03.075 INFO:tasks.workunit.client.1.smithi103.stdout:5/891: creat de/d1f/d3b/d58/dc4/d125/f127 x:0 0 0 2024-09-18T21:13:03.076 INFO:tasks.workunit.client.1.smithi103.stdout:0/825: fdatasync d1/d5/de/d24/f32 0 2024-09-18T21:13:03.076 INFO:tasks.workunit.client.1.smithi103.stdout:5/892: chown de/d2d/d7f/f65 3 1 2024-09-18T21:13:03.077 INFO:tasks.workunit.client.1.smithi103.stdout:3/875: mknod d1/d23/d25/d4f/d72/c10a 0 2024-09-18T21:13:03.077 INFO:tasks.workunit.client.1.smithi103.stdout:5/893: write de/d1f/d3b/d51/d57/d79/d8d/fd6 [903268,89941] 0 2024-09-18T21:13:03.080 INFO:tasks.workunit.client.1.smithi103.stdout:9/876: dread d18/d29/d68/d92/d9c/fae [0,4194304] 0 2024-09-18T21:13:03.081 INFO:tasks.workunit.client.1.smithi103.stdout:0/826: mknod d1/d5/de/d24/d43/d81/c123 0 2024-09-18T21:13:03.084 INFO:tasks.workunit.client.1.smithi103.stdout:5/894: mknod de/d1f/d3b/dcd/c128 0 2024-09-18T21:13:03.087 INFO:tasks.workunit.client.1.smithi103.stdout:6/884: write d2/d3/dcb/f104 [994970,125741] 0 2024-09-18T21:13:03.088 INFO:tasks.workunit.client.1.smithi103.stdout:6/885: dread - d2/d24/d5a/d67/d76/d43/f101 zero size 2024-09-18T21:13:03.090 INFO:tasks.workunit.client.1.smithi103.stdout:3/876: unlink d1/d23/d25/d4f/d58/d86/lb0 0 2024-09-18T21:13:03.090 INFO:tasks.workunit.client.0.smithi077.stdout:6/765: dwrite d7/d7e/d11/f19 [0,4194304] 0 2024-09-18T21:13:03.091 INFO:tasks.workunit.client.0.smithi077.stdout:6/766: write d7/d7e/d11/f19 [169617,47869] 0 2024-09-18T21:13:03.094 INFO:tasks.workunit.client.1.smithi103.stdout:6/886: readlink d2/d24/d5a/d67/d76/l8a 0 2024-09-18T21:13:03.095 INFO:tasks.workunit.client.0.smithi077.stdout:7/859: dwrite d12/f9a [0,4194304] 0 2024-09-18T21:13:03.095 INFO:tasks.workunit.client.1.smithi103.stdout:5/895: rename de/d1f/d3b/c6d to de/d1f/d3b/d58/dc4/d7e/c129 0 2024-09-18T21:13:03.099 INFO:tasks.workunit.client.1.smithi103.stdout:9/877: creat d18/d52/f121 x:0 0 0 2024-09-18T21:13:03.102 INFO:tasks.workunit.client.1.smithi103.stdout:1/825: sync 2024-09-18T21:13:03.103 INFO:tasks.workunit.client.0.smithi077.stdout:7/860: mkdir d12/d31/d127 0 2024-09-18T21:13:03.103 INFO:tasks.workunit.client.1.smithi103.stdout:7/859: write d1/df/d42/d29/d48/dbb/d33/f6f [158877,123329] 0 2024-09-18T21:13:03.105 INFO:tasks.workunit.client.1.smithi103.stdout:6/887: creat d2/d24/d5a/d67/d76/d43/f116 x:0 0 0 2024-09-18T21:13:03.106 INFO:tasks.workunit.client.1.smithi103.stdout:0/827: getdents d1/d5/de/d24/d43 0 2024-09-18T21:13:03.106 INFO:tasks.workunit.client.1.smithi103.stdout:5/896: dwrite de/d1f/d3b/d51/d57/dc8/de8/f122 [0,4194304] 0 2024-09-18T21:13:03.110 INFO:tasks.workunit.client.1.smithi103.stdout:0/828: fdatasync d1/d9/f52 0 2024-09-18T21:13:03.112 INFO:tasks.workunit.client.1.smithi103.stdout:8/970: dwrite d4/d2d/d87/fc9 [0,4194304] 0 2024-09-18T21:13:03.112 INFO:tasks.workunit.client.0.smithi077.stdout:7/861: link d12/f45 d12/d31/d77/d93/d89/d94/f128 0 2024-09-18T21:13:03.115 INFO:tasks.workunit.client.0.smithi077.stdout:7/862: chown d12/c66 1 1 2024-09-18T21:13:03.118 INFO:tasks.workunit.client.0.smithi077.stdout:7/863: dread d12/d56/da1/db6/dbd/fd6 [0,4194304] 0 2024-09-18T21:13:03.122 INFO:tasks.workunit.client.1.smithi103.stdout:3/877: truncate d1/d2/d18/f44 3636247 0 2024-09-18T21:13:03.123 INFO:tasks.workunit.client.1.smithi103.stdout:3/878: stat d1/d2/d18/d30/d4e/db1 0 2024-09-18T21:13:03.124 INFO:tasks.workunit.client.0.smithi077.stdout:7/864: fsync d12/d22/d59/d72/f3b 0 2024-09-18T21:13:03.126 INFO:tasks.workunit.client.1.smithi103.stdout:7/860: creat d1/df/d43/d63/f11b x:0 0 0 2024-09-18T21:13:03.126 INFO:tasks.workunit.client.1.smithi103.stdout:1/826: link d0/d2/d2b/d3a/l117 d0/d11/d5f/d19/l123 0 2024-09-18T21:13:03.127 INFO:tasks.workunit.client.1.smithi103.stdout:9/878: getdents d18/d29/d68/d92/dd1 0 2024-09-18T21:13:03.128 INFO:tasks.workunit.client.1.smithi103.stdout:7/861: chown d1/df/d43/d52/cfb 2 1 2024-09-18T21:13:03.129 INFO:tasks.workunit.client.1.smithi103.stdout:3/879: symlink d1/d23/d25/da1/dfa/d106/l10b 0 2024-09-18T21:13:03.130 INFO:tasks.workunit.client.1.smithi103.stdout:1/827: unlink d0/d2/d9/d10/c82 0 2024-09-18T21:13:03.131 INFO:tasks.workunit.client.1.smithi103.stdout:9/879: write d18/d29/d68/d92/d9c/dc8/fe9 [1456982,80007] 0 2024-09-18T21:13:03.132 INFO:tasks.workunit.client.1.smithi103.stdout:7/862: rename d1/df/d43/d63/db9/d72/l9c to d1/df/d43/d52/l11c 0 2024-09-18T21:13:03.135 INFO:tasks.workunit.client.1.smithi103.stdout:8/971: dread d4/d2d/d3d/da0/dab/de7/fa9 [0,4194304] 0 2024-09-18T21:13:03.135 INFO:tasks.workunit.client.1.smithi103.stdout:5/897: dread de/d1f/d3b/d51/f64 [0,4194304] 0 2024-09-18T21:13:03.137 INFO:tasks.workunit.client.1.smithi103.stdout:7/863: creat d1/df/d42/d1f/f11d x:0 0 0 2024-09-18T21:13:03.137 INFO:tasks.workunit.client.1.smithi103.stdout:5/898: chown de/d1f/lab 155462393 1 2024-09-18T21:13:03.140 INFO:tasks.workunit.client.1.smithi103.stdout:6/888: dwrite d2/d24/d5a/d67/fa0 [0,4194304] 0 2024-09-18T21:13:03.142 INFO:tasks.workunit.client.1.smithi103.stdout:8/972: mknod d4/d2d/d3d/d9b/c134 0 2024-09-18T21:13:03.145 INFO:tasks.workunit.client.1.smithi103.stdout:7/864: symlink d1/df/d43/d63/d67/dc3/l11e 0 2024-09-18T21:13:03.147 INFO:tasks.workunit.client.1.smithi103.stdout:6/889: creat d2/d3/d8/d4c/d7a/f117 x:0 0 0 2024-09-18T21:13:03.149 INFO:tasks.workunit.client.0.smithi077.stdout:7/865: dwrite d12/d56/fd2 [0,4194304] 0 2024-09-18T21:13:03.149 INFO:tasks.workunit.client.1.smithi103.stdout:5/899: truncate de/d1f/d3b/d58/dc4/d33/f7c 2273516 0 2024-09-18T21:13:03.150 INFO:tasks.workunit.client.1.smithi103.stdout:5/900: write de/d1f/d3b/d51/d57/d59/f6e [1308855,66615] 0 2024-09-18T21:13:03.152 INFO:tasks.workunit.client.1.smithi103.stdout:3/880: write d1/da/df/f77 [111283,62447] 0 2024-09-18T21:13:03.152 INFO:tasks.workunit.client.1.smithi103.stdout:9/880: getdents d18/d29/d68/d92/d9c/dc8 0 2024-09-18T21:13:03.153 INFO:tasks.workunit.client.1.smithi103.stdout:7/865: symlink d1/df/d42/d1f/l11f 0 2024-09-18T21:13:03.156 INFO:tasks.workunit.client.1.smithi103.stdout:5/901: dread de/d1f/d3b/d3c/fb6 [0,4194304] 0 2024-09-18T21:13:03.156 INFO:tasks.workunit.client.1.smithi103.stdout:3/881: fdatasync d1/d2/f8 0 2024-09-18T21:13:03.156 INFO:tasks.workunit.client.1.smithi103.stdout:9/881: rmdir d18/d52/d5e 39 2024-09-18T21:13:03.157 INFO:tasks.workunit.client.0.smithi077.stdout:7/866: creat d12/d31/d77/d93/d89/f129 x:0 0 0 2024-09-18T21:13:03.160 INFO:tasks.workunit.client.1.smithi103.stdout:9/882: symlink d18/da4/l122 0 2024-09-18T21:13:03.160 INFO:tasks.workunit.client.1.smithi103.stdout:4/968: sync 2024-09-18T21:13:03.160 INFO:tasks.workunit.client.0.smithi077.stdout:7/867: mkdir d12/d31/d77/d93/d12a 0 2024-09-18T21:13:03.161 INFO:tasks.workunit.client.1.smithi103.stdout:7/866: mknod d1/df/d42/d29/d48/dbb/d33/d51/c120 0 2024-09-18T21:13:03.161 INFO:tasks.workunit.client.0.smithi077.stdout:9/764: sync 2024-09-18T21:13:03.162 INFO:tasks.workunit.client.0.smithi077.stdout:1/739: sync 2024-09-18T21:13:03.162 INFO:tasks.workunit.client.1.smithi103.stdout:5/902: write de/d1f/d3b/f11b [631097,93098] 0 2024-09-18T21:13:03.162 INFO:tasks.workunit.client.1.smithi103.stdout:3/882: mkdir d1/d23/d25/da1/dfa/d106/d10c 0 2024-09-18T21:13:03.163 INFO:tasks.workunit.client.1.smithi103.stdout:9/883: chown d18/d29/d68/fef 26 1 2024-09-18T21:13:03.163 INFO:tasks.workunit.client.0.smithi077.stdout:9/765: fdatasync d1/dd/d11/d1c/d38/d46/d55/d7f/fe2 0 2024-09-18T21:13:03.165 INFO:tasks.workunit.client.0.smithi077.stdout:1/740: mkdir d3/d8/d93/dd3/d99/dfd 0 2024-09-18T21:13:03.165 INFO:tasks.workunit.client.1.smithi103.stdout:7/867: read - d1/df/d42/d1f/f11d zero size 2024-09-18T21:13:03.166 INFO:tasks.workunit.client.1.smithi103.stdout:1/828: dwrite d0/d2/d9/d9e/d7a/dd0/df9/d68/d81/da2/da4/dc2/dd8/dae/fb4 [0,4194304] 0 2024-09-18T21:13:03.166 INFO:tasks.workunit.client.1.smithi103.stdout:6/890: link d2/d24/d5a/d67/d76/l41 d2/d3/d7f/d91/da2/de4/l118 0 2024-09-18T21:13:03.170 INFO:tasks.workunit.client.1.smithi103.stdout:8/973: dwrite d4/d26/f1a [4194304,4194304] 0 2024-09-18T21:13:03.175 INFO:tasks.workunit.client.1.smithi103.stdout:7/868: dwrite d1/df/d42/d1f/d5d/f115 [0,4194304] 0 2024-09-18T21:13:03.190 INFO:tasks.workunit.client.1.smithi103.stdout:2/800: sync 2024-09-18T21:13:03.198 INFO:tasks.workunit.client.0.smithi077.stdout:9/766: dwrite d1/d54/f12 [0,4194304] 0 2024-09-18T21:13:03.200 INFO:tasks.workunit.client.0.smithi077.stdout:1/741: dwrite d3/d6a/d9b/d68/fd0 [0,4194304] 0 2024-09-18T21:13:03.200 INFO:tasks.workunit.client.0.smithi077.stdout:9/767: read - d1/dd/d1a/d42/fcb zero size 2024-09-18T21:13:03.203 INFO:tasks.workunit.client.1.smithi103.stdout:5/903: creat de/d1f/d3b/d51/d57/d79/f12a x:0 0 0 2024-09-18T21:13:03.206 INFO:tasks.workunit.client.1.smithi103.stdout:9/884: mkdir d18/d52/d6f/db9/dcb/d123 0 2024-09-18T21:13:03.206 INFO:tasks.workunit.client.0.smithi077.stdout:9/768: dread d1/dd/d11/d15/d80/f8c [0,4194304] 0 2024-09-18T21:13:03.209 INFO:tasks.workunit.client.1.smithi103.stdout:4/969: rename d9/d38/db4/fbf to d9/d38/d72/df0/d61/d91/daa/f140 0 2024-09-18T21:13:03.211 INFO:tasks.workunit.client.1.smithi103.stdout:1/829: chown d0/d2/d9/d10/d5d/f88 75 1 2024-09-18T21:13:03.214 INFO:tasks.workunit.client.0.smithi077.stdout:9/769: creat d1/d54/d8f/f109 x:0 0 0 2024-09-18T21:13:03.215 INFO:tasks.workunit.client.1.smithi103.stdout:6/891: creat d2/d3/d8/d4c/d7d/f119 x:0 0 0 2024-09-18T21:13:03.215 INFO:tasks.workunit.client.1.smithi103.stdout:4/970: dwrite d9/d1c/d106/f115 [0,4194304] 0 2024-09-18T21:13:03.216 INFO:tasks.workunit.client.0.smithi077.stdout:7/868: link d12/f25 d12/d31/d77/d93/f12b 0 2024-09-18T21:13:03.218 INFO:tasks.workunit.client.1.smithi103.stdout:8/974: stat d4/d81/le5 0 2024-09-18T21:13:03.219 INFO:tasks.workunit.client.1.smithi103.stdout:8/975: readlink d4/d81/dd7/dde/d59/d5e/le8 0 2024-09-18T21:13:03.221 INFO:tasks.workunit.client.1.smithi103.stdout:2/801: truncate d3/d110/d11a/f8e 377332 0 2024-09-18T21:13:03.221 INFO:tasks.workunit.client.0.smithi077.stdout:7/869: getdents d12/d31/d77/d93/d12a 0 2024-09-18T21:13:03.222 INFO:tasks.workunit.client.1.smithi103.stdout:2/802: chown d3/db3 104 1 2024-09-18T21:13:03.223 INFO:tasks.workunit.client.0.smithi077.stdout:7/870: dread - d12/d22/daa/dc0/dac/dad/fca zero size 2024-09-18T21:13:03.223 INFO:tasks.workunit.client.1.smithi103.stdout:5/904: creat de/d1f/d3b/d51/d57/d59/f12b x:0 0 0 2024-09-18T21:13:03.223 INFO:tasks.workunit.client.1.smithi103.stdout:9/885: creat d18/d29/d68/d92/d9c/dc8/deb/f124 x:0 0 0 2024-09-18T21:13:03.226 INFO:tasks.workunit.client.1.smithi103.stdout:3/883: creat d1/d23/d25/d4f/d58/d68/da0/f10d x:0 0 0 2024-09-18T21:13:03.226 INFO:tasks.workunit.client.0.smithi077.stdout:7/871: rename d12/d22/d59/d5a/f67 to d12/d22/d122/f12c 0 2024-09-18T21:13:03.228 INFO:tasks.workunit.client.1.smithi103.stdout:3/884: dread - d1/d23/d25/d4f/fd2 zero size 2024-09-18T21:13:03.229 INFO:tasks.workunit.client.1.smithi103.stdout:8/976: dwrite d4/d2d/dc1/dee/f12b [0,4194304] 0 2024-09-18T21:13:03.229 INFO:tasks.workunit.client.1.smithi103.stdout:4/971: creat d9/d38/d58/f141 x:0 0 0 2024-09-18T21:13:03.230 INFO:tasks.workunit.client.0.smithi077.stdout:7/872: mkdir d12/d22/daa/dc0/dac/dad/d12d 0 2024-09-18T21:13:03.234 INFO:tasks.workunit.client.1.smithi103.stdout:1/830: mknod d0/d2/d9/d10/c124 0 2024-09-18T21:13:03.236 INFO:tasks.workunit.client.0.smithi077.stdout:7/873: truncate d12/d22/d59/d5a/f69 2140775 0 2024-09-18T21:13:03.238 INFO:tasks.workunit.client.1.smithi103.stdout:9/886: rename d18/d29/d68/d92/dd1/f111 to d18/d52/d6f/df8/d105/f125 0 2024-09-18T21:13:03.239 INFO:tasks.workunit.client.1.smithi103.stdout:0/829: sync 2024-09-18T21:13:03.239 INFO:tasks.workunit.client.1.smithi103.stdout:7/869: dread d1/df/d42/ff6 [0,4194304] 0 2024-09-18T21:13:03.239 INFO:tasks.workunit.client.1.smithi103.stdout:4/972: dwrite d9/d38/d72/df0/d83/db6/d41/fda [0,4194304] 0 2024-09-18T21:13:03.240 INFO:tasks.workunit.client.0.smithi077.stdout:1/742: dread d3/d6a/d9b/d68/f9d [0,4194304] 0 2024-09-18T21:13:03.243 INFO:tasks.workunit.client.1.smithi103.stdout:4/973: truncate d9/d1c/dcd/dd1/f10c 990833 0 2024-09-18T21:13:03.244 INFO:tasks.workunit.client.1.smithi103.stdout:1/831: fsync d0/d2/d2b/d3a/d42/d72/db0/f7f 0 2024-09-18T21:13:03.249 INFO:tasks.workunit.client.1.smithi103.stdout:6/892: dread d2/d3/d8/fc9 [0,4194304] 0 2024-09-18T21:13:03.253 INFO:tasks.workunit.client.1.smithi103.stdout:1/832: creat d0/d2/d2b/d111/f125 x:0 0 0 2024-09-18T21:13:03.254 INFO:tasks.workunit.client.1.smithi103.stdout:8/977: getdents d4/d2d/d4e/de9 0 2024-09-18T21:13:03.256 INFO:tasks.workunit.client.1.smithi103.stdout:6/893: symlink d2/d3/d7f/d91/l11a 0 2024-09-18T21:13:03.258 INFO:tasks.workunit.client.1.smithi103.stdout:2/803: dread d3/d5/d4a/d56/fc7 [0,4194304] 0 2024-09-18T21:13:03.258 INFO:tasks.workunit.client.1.smithi103.stdout:7/870: rename d1/df/d43/d63/db9 to d1/df/d42/d121 0 2024-09-18T21:13:03.259 INFO:tasks.workunit.client.0.smithi077.stdout:1/743: dread d3/d8/d13/f14 [0,4194304] 0 2024-09-18T21:13:03.260 INFO:tasks.workunit.client.1.smithi103.stdout:6/894: rename d2/d3/d8/d4c/d4e/c51 to d2/d24/d5a/d67/d76/da4/dc7/c11b 0 2024-09-18T21:13:03.263 INFO:tasks.workunit.client.1.smithi103.stdout:2/804: dread - d3/d5/d2f/d32/fda zero size 2024-09-18T21:13:03.263 INFO:tasks.workunit.client.1.smithi103.stdout:2/805: dread - d3/d5/d2c/f43 zero size 2024-09-18T21:13:03.264 INFO:tasks.workunit.client.1.smithi103.stdout:7/871: mkdir d1/df/d43/d61/d122 0 2024-09-18T21:13:03.264 INFO:tasks.workunit.client.1.smithi103.stdout:2/806: chown d3/d5/d2c/d54/d68/cbf 13 1 2024-09-18T21:13:03.265 INFO:tasks.workunit.client.1.smithi103.stdout:6/895: mkdir d2/d3/d8/de1/dfe/d11c 0 2024-09-18T21:13:03.266 INFO:tasks.workunit.client.1.smithi103.stdout:7/872: truncate d1/df/d42/d121/d72/fe8 4238231 0 2024-09-18T21:13:03.267 INFO:tasks.workunit.client.1.smithi103.stdout:5/905: write de/d1f/d3b/d3c/fc6 [532725,60224] 0 2024-09-18T21:13:03.267 INFO:tasks.workunit.client.1.smithi103.stdout:6/896: dread - d2/d24/d5a/d67/d76/f10e zero size 2024-09-18T21:13:03.269 INFO:tasks.workunit.client.1.smithi103.stdout:7/873: chown d1/df/d43/d63/d67/d5b/f81 7 1 2024-09-18T21:13:03.273 INFO:tasks.workunit.client.1.smithi103.stdout:0/830: write d1/d5/de/d24/d43/d76/f77 [5187426,45758] 0 2024-09-18T21:13:03.275 INFO:tasks.workunit.client.1.smithi103.stdout:7/874: rename d1/df/d43/d52/d95/fcc to d1/df/d43/d52/f123 0 2024-09-18T21:13:03.277 INFO:tasks.workunit.client.1.smithi103.stdout:5/906: link de/d1f/d3b/dcd/f10b de/d1f/d3b/d58/dc4/d33/f12c 0 2024-09-18T21:13:03.279 INFO:tasks.workunit.client.0.smithi077.stdout:1/744: write d3/d6a/d9b/d68/f3c [5222653,41182] 0 2024-09-18T21:13:03.280 INFO:tasks.workunit.client.0.smithi077.stdout:1/745: readlink d3/d8/d49/la2 0 2024-09-18T21:13:03.280 INFO:tasks.workunit.client.1.smithi103.stdout:3/885: dwrite d1/da/f16 [0,4194304] 0 2024-09-18T21:13:03.281 INFO:tasks.workunit.client.1.smithi103.stdout:8/978: dread d4/d2d/d3d/da0/dab/de7/f8a [0,4194304] 0 2024-09-18T21:13:03.281 INFO:tasks.workunit.client.1.smithi103.stdout:7/875: fsync d1/df/d43/d63/f117 0 2024-09-18T21:13:03.283 INFO:tasks.workunit.client.1.smithi103.stdout:0/831: rename d1/d5/f31 to d1/d5/de/d24/d43/d76/dc5/f124 0 2024-09-18T21:13:03.284 INFO:tasks.workunit.client.1.smithi103.stdout:9/887: dwrite d18/d52/d5e/f7b [4194304,4194304] 0 2024-09-18T21:13:03.286 INFO:tasks.workunit.client.1.smithi103.stdout:3/886: write d1/d23/d25/da1/da5/de8/ff4 [982428,22312] 0 2024-09-18T21:13:03.287 INFO:tasks.workunit.client.1.smithi103.stdout:8/979: symlink d4/d81/d71/l135 0 2024-09-18T21:13:03.290 INFO:tasks.workunit.client.0.smithi077.stdout:1/746: write d3/d8/d13/f1f [658322,57833] 0 2024-09-18T21:13:03.290 INFO:tasks.workunit.client.1.smithi103.stdout:2/807: dwrite d3/d110/d11a/f37 [0,4194304] 0 2024-09-18T21:13:03.291 INFO:tasks.workunit.client.1.smithi103.stdout:0/832: symlink d1/d5/de/d24/d43/l125 0 2024-09-18T21:13:03.293 INFO:tasks.workunit.client.0.smithi077.stdout:1/747: unlink d3/d6a/d9b/d68/f3c 0 2024-09-18T21:13:03.294 INFO:tasks.workunit.client.0.smithi077.stdout:1/748: stat d3/d6a/d9b/dbe/ce2 0 2024-09-18T21:13:03.295 INFO:tasks.workunit.client.0.smithi077.stdout:1/749: chown d3/d6a/d9b/d68/f44 76943 1 2024-09-18T21:13:03.297 INFO:tasks.workunit.client.0.smithi077.stdout:1/750: write d3/d8/d13/d77/fe4 [2828750,85077] 0 2024-09-18T21:13:03.297 INFO:tasks.workunit.client.1.smithi103.stdout:2/808: chown d3/f1e 265723098 1 2024-09-18T21:13:03.297 INFO:tasks.workunit.client.1.smithi103.stdout:8/980: stat d4/d2d/d4e/l63 0 2024-09-18T21:13:03.298 INFO:tasks.workunit.client.0.smithi077.stdout:1/751: stat d3/d8/d93/dd3/d99/de8/la4 0 2024-09-18T21:13:03.299 INFO:tasks.workunit.client.0.smithi077.stdout:1/752: stat d3/fee 0 2024-09-18T21:13:03.299 INFO:tasks.workunit.client.1.smithi103.stdout:7/876: rename d1/df/d42/d29/d48/dbb/ded/l110 to d1/df/d42/d1f/d5d/dbe/df1/l124 0 2024-09-18T21:13:03.301 INFO:tasks.workunit.client.0.smithi077.stdout:1/753: write d3/d8/d93/dd3/dc1/fd6 [969985,110391] 0 2024-09-18T21:13:03.301 INFO:tasks.workunit.client.1.smithi103.stdout:5/907: dwrite de/d1f/d3b/d58/dc4/f22 [0,4194304] 0 2024-09-18T21:13:03.303 INFO:tasks.workunit.client.1.smithi103.stdout:6/897: dread d2/d24/d5a/d67/d76/d43/d44/f6e [0,4194304] 0 2024-09-18T21:13:03.303 INFO:tasks.workunit.client.1.smithi103.stdout:3/887: dwrite d1/da/f6b [4194304,4194304] 0 2024-09-18T21:13:03.305 INFO:tasks.workunit.client.1.smithi103.stdout:7/877: symlink d1/df/d42/d1f/d5d/dbe/l125 0 2024-09-18T21:13:03.307 INFO:tasks.workunit.client.1.smithi103.stdout:2/809: getdents d3/d5/d2f/d48 0 2024-09-18T21:13:03.307 INFO:tasks.workunit.client.1.smithi103.stdout:7/878: rmdir d1 39 2024-09-18T21:13:03.310 INFO:tasks.workunit.client.1.smithi103.stdout:3/888: write d1/da/df/f19 [858965,123317] 0 2024-09-18T21:13:03.313 INFO:tasks.workunit.client.1.smithi103.stdout:3/889: write d1/d23/d25/da1/da5/fec [1323544,102301] 0 2024-09-18T21:13:03.317 INFO:tasks.workunit.client.1.smithi103.stdout:2/810: creat d3/d5/d2c/d54/d68/f11e x:0 0 0 2024-09-18T21:13:03.318 INFO:tasks.workunit.client.1.smithi103.stdout:2/811: stat d3/d5/d2f/d93/fa1 0 2024-09-18T21:13:03.318 INFO:tasks.workunit.client.1.smithi103.stdout:2/812: read - d3/d110/f115 zero size 2024-09-18T21:13:03.319 INFO:tasks.workunit.client.1.smithi103.stdout:5/908: link de/d1f/d3b/d51/db0/fbe de/d1f/d3b/d51/d57/d59/f12d 0 2024-09-18T21:13:03.322 INFO:tasks.workunit.client.1.smithi103.stdout:7/879: rename d1/df/d42/d1f/d5d/faf to d1/df/d44/dba/f126 0 2024-09-18T21:13:03.326 INFO:tasks.workunit.client.1.smithi103.stdout:3/890: rename d1/d23/d47 to d1/d2/d18/d30/d4e/db1/d10e 0 2024-09-18T21:13:03.338 INFO:tasks.workunit.client.0.smithi077.stdout:4/774: sync 2024-09-18T21:13:03.339 INFO:tasks.workunit.client.0.smithi077.stdout:4/775: truncate d3/dc/d32/d45/fdd 242961 0 2024-09-18T21:13:03.344 INFO:tasks.workunit.client.0.smithi077.stdout:4/776: dwrite d3/d7/d42/f5d [4194304,4194304] 0 2024-09-18T21:13:03.344 INFO:tasks.workunit.client.1.smithi103.stdout:4/974: sync 2024-09-18T21:13:03.345 INFO:tasks.workunit.client.0.smithi077.stdout:4/777: readlink d3/dc/d51/d53/lf2 0 2024-09-18T21:13:03.345 INFO:tasks.workunit.client.0.smithi077.stdout:4/778: fdatasync d3/d77/ff7 0 2024-09-18T21:13:03.348 INFO:tasks.workunit.client.0.smithi077.stdout:4/779: link d3/dc/d51/d53/f58 d3/d77/d9c/db9/ff9 0 2024-09-18T21:13:03.349 INFO:tasks.workunit.client.1.smithi103.stdout:6/898: getdents d2/d3/d8/d4c/d7a 0 2024-09-18T21:13:03.351 INFO:tasks.workunit.client.1.smithi103.stdout:3/891: stat d1/d2/d18/d30/d4e/db1/cef 0 2024-09-18T21:13:03.352 INFO:tasks.workunit.client.1.smithi103.stdout:2/813: write d3/d5/d2c/f64 [1478554,130365] 0 2024-09-18T21:13:03.352 INFO:tasks.workunit.client.1.smithi103.stdout:5/909: write de/d3e/d85/fac [508995,79333] 0 2024-09-18T21:13:03.352 INFO:tasks.workunit.client.1.smithi103.stdout:7/880: rename d1/df/d43/db1 to d1/df/dbf/d127 0 2024-09-18T21:13:03.353 INFO:tasks.workunit.client.1.smithi103.stdout:0/833: link d1/d5/de/d19/fef d1/d5/de/d24/d43/dfd/f126 0 2024-09-18T21:13:03.357 INFO:tasks.workunit.client.1.smithi103.stdout:6/899: creat d2/d24/d5a/d67/d76/d43/f11d x:0 0 0 2024-09-18T21:13:03.358 INFO:tasks.workunit.client.1.smithi103.stdout:3/892: truncate d1/d23/f2a 1827856 0 2024-09-18T21:13:03.360 INFO:tasks.workunit.client.1.smithi103.stdout:7/881: symlink d1/df/d43/d63/d67/dfd/l128 0 2024-09-18T21:13:03.361 INFO:tasks.workunit.client.1.smithi103.stdout:2/814: dwrite d3/d5/d2f/d32/dfc/f116 [0,4194304] 0 2024-09-18T21:13:03.363 INFO:tasks.workunit.client.1.smithi103.stdout:2/815: chown d3/d5/d2f/d32/d90/df0/c11c 2428 1 2024-09-18T21:13:03.364 INFO:tasks.workunit.client.1.smithi103.stdout:5/910: creat de/d1f/d3b/d58/dc4/d33/d4f/d101/f12e x:0 0 0 2024-09-18T21:13:03.365 INFO:tasks.workunit.client.1.smithi103.stdout:5/911: fsync de/d1f/d3b/d58/fff 0 2024-09-18T21:13:03.366 INFO:tasks.workunit.client.1.smithi103.stdout:2/816: fsync d3/f21 0 2024-09-18T21:13:03.367 INFO:tasks.workunit.client.1.smithi103.stdout:2/817: stat d3/d5/d2f/d32/dfc/f116 0 2024-09-18T21:13:03.369 INFO:tasks.workunit.client.1.smithi103.stdout:5/912: mknod de/d1f/d3b/dcd/c12f 0 2024-09-18T21:13:03.369 INFO:tasks.workunit.client.0.smithi077.stdout:4/780: dread d3/d7/d7b/f92 [0,4194304] 0 2024-09-18T21:13:03.371 INFO:tasks.workunit.client.1.smithi103.stdout:5/913: truncate de/d1f/d3b/d58/faa 2907957 0 2024-09-18T21:13:03.374 INFO:tasks.workunit.client.1.smithi103.stdout:2/818: link d3/f21 d3/d5/f11f 0 2024-09-18T21:13:03.376 INFO:tasks.workunit.client.1.smithi103.stdout:0/834: dread d1/d9/f54 [0,4194304] 0 2024-09-18T21:13:03.376 INFO:tasks.workunit.client.0.smithi077.stdout:4/781: dwrite d3/d7/d7b/d88/fcd [0,4194304] 0 2024-09-18T21:13:03.377 INFO:tasks.workunit.client.1.smithi103.stdout:5/914: rename de/d1f/d3b/d51/d57/db5/cd4 to de/d1f/d3b/d3c/d62/d108/c130 0 2024-09-18T21:13:03.379 INFO:tasks.workunit.client.1.smithi103.stdout:7/882: dwrite d1/df/d42/d29/d48/dbb/d33/d51/f80 [0,4194304] 0 2024-09-18T21:13:03.380 INFO:tasks.workunit.client.0.smithi077.stdout:4/782: creat d3/dc/ffa x:0 0 0 2024-09-18T21:13:03.382 INFO:tasks.workunit.client.1.smithi103.stdout:0/835: fdatasync d1/d5/de/d19/f7c 0 2024-09-18T21:13:03.388 INFO:tasks.workunit.client.0.smithi077.stdout:4/783: rename d3/l22 to d3/d77/de5/lfb 0 2024-09-18T21:13:03.390 INFO:tasks.workunit.client.1.smithi103.stdout:3/893: dread d1/d23/f2a [0,4194304] 0 2024-09-18T21:13:03.390 INFO:tasks.workunit.client.1.smithi103.stdout:0/836: symlink d1/d5/de/d19/d1e/d58/l127 0 2024-09-18T21:13:03.391 INFO:tasks.workunit.client.1.smithi103.stdout:6/900: dread d2/d3/d8/f10 [0,4194304] 0 2024-09-18T21:13:03.391 INFO:tasks.workunit.client.1.smithi103.stdout:0/837: dread - d1/d9/d3e/f119 zero size 2024-09-18T21:13:03.393 INFO:tasks.workunit.client.1.smithi103.stdout:0/838: chown d1/d5/de/dc0/f79 43158 1 2024-09-18T21:13:03.394 INFO:tasks.workunit.client.1.smithi103.stdout:0/839: chown d1/f3f 6 1 2024-09-18T21:13:03.395 INFO:tasks.workunit.client.1.smithi103.stdout:6/901: mknod d2/d24/d5a/d67/d76/da4/d10a/c11e 0 2024-09-18T21:13:03.397 INFO:tasks.workunit.client.1.smithi103.stdout:3/894: getdents d1/d23/d25/d4f/d58/d68/d50/d54/d8c 0 2024-09-18T21:13:03.399 INFO:tasks.workunit.client.1.smithi103.stdout:6/902: creat d2/d24/d38/d68/f11f x:0 0 0 2024-09-18T21:13:03.399 INFO:tasks.workunit.client.1.smithi103.stdout:5/915: write de/d1f/d3b/d3c/d62/f120 [103139,65000] 0 2024-09-18T21:13:03.400 INFO:tasks.workunit.client.1.smithi103.stdout:3/895: mknod d1/d23/d25/d4f/d58/d68/d50/dea/df3/c10f 0 2024-09-18T21:13:03.400 INFO:tasks.workunit.client.1.smithi103.stdout:5/916: stat de/d1f/d3b/d3c 0 2024-09-18T21:13:03.402 INFO:tasks.workunit.client.1.smithi103.stdout:5/917: write de/d1f/d3b/d58/dc4/d7e/f10e [818390,116930] 0 2024-09-18T21:13:03.403 INFO:tasks.workunit.client.1.smithi103.stdout:6/903: creat d2/d3/d8/de1/dfe/f120 x:0 0 0 2024-09-18T21:13:03.403 INFO:tasks.workunit.client.1.smithi103.stdout:1/833: sync 2024-09-18T21:13:03.403 INFO:tasks.workunit.client.1.smithi103.stdout:2/819: truncate d3/d5/d4a/d56/f97 5225103 0 2024-09-18T21:13:03.406 INFO:tasks.workunit.client.1.smithi103.stdout:6/904: write d2/d24/d5a/d67/d76/da4/dc7/f115 [831043,6572] 0 2024-09-18T21:13:03.407 INFO:tasks.workunit.client.1.smithi103.stdout:7/883: dread d1/df/d42/d1f/d5d/f71 [0,4194304] 0 2024-09-18T21:13:03.408 INFO:tasks.workunit.client.1.smithi103.stdout:5/918: dread de/d3e/d85/fac [0,4194304] 0 2024-09-18T21:13:03.416 INFO:tasks.workunit.client.0.smithi077.stdout:4/784: dread d3/d7/f4f [0,4194304] 0 2024-09-18T21:13:03.472 INFO:tasks.workunit.client.1.smithi103.stdout:9/888: sync 2024-09-18T21:13:03.477 INFO:tasks.workunit.client.1.smithi103.stdout:9/889: dwrite d18/d29/d68/f99 [0,4194304] 0 2024-09-18T21:13:03.485 INFO:tasks.workunit.client.1.smithi103.stdout:7/884: fsync d1/df/d42/ff6 0 2024-09-18T21:13:03.486 INFO:tasks.workunit.client.1.smithi103.stdout:0/840: dwrite d1/d5/de/d19/d1e/ff0 [0,4194304] 0 2024-09-18T21:13:03.487 INFO:tasks.workunit.client.1.smithi103.stdout:0/841: stat d1/d9/d3e/dfc/f116 0 2024-09-18T21:13:03.487 INFO:tasks.workunit.client.1.smithi103.stdout:0/842: chown d1/d5/de/d19 389111130 1 2024-09-18T21:13:03.492 INFO:tasks.workunit.client.1.smithi103.stdout:1/834: mkdir d0/d2/d2b/d3a/d42/d72/d126 0 2024-09-18T21:13:03.495 INFO:tasks.workunit.client.1.smithi103.stdout:2/820: link d3/f1d d3/d5/d2f/d32/d90/dd7/f120 0 2024-09-18T21:13:03.501 INFO:tasks.workunit.client.1.smithi103.stdout:2/821: dwrite d3/d5/d2f/d93/fa1 [0,4194304] 0 2024-09-18T21:13:03.503 INFO:tasks.workunit.client.1.smithi103.stdout:6/905: write d2/d24/d38/d68/fa6 [29962,126483] 0 2024-09-18T21:13:03.505 INFO:tasks.workunit.client.1.smithi103.stdout:5/919: mkdir de/d1f/d3b/d58/dc4/d131 0 2024-09-18T21:13:03.506 INFO:tasks.workunit.client.1.smithi103.stdout:8/981: sync 2024-09-18T21:13:03.506 INFO:tasks.workunit.client.1.smithi103.stdout:3/896: sync 2024-09-18T21:13:03.506 INFO:tasks.workunit.client.1.smithi103.stdout:4/975: sync 2024-09-18T21:13:03.508 INFO:tasks.workunit.client.1.smithi103.stdout:3/897: dread - d1/d23/d25/d4f/dce/fd7 zero size 2024-09-18T21:13:03.508 INFO:tasks.workunit.client.1.smithi103.stdout:0/843: unlink d1/d5/de/dc0/f79 0 2024-09-18T21:13:03.508 INFO:tasks.workunit.client.1.smithi103.stdout:4/976: chown d9/d38/d72/df0/d83/db6/d21/f63 15 1 2024-09-18T21:13:03.509 INFO:tasks.workunit.client.1.smithi103.stdout:3/898: write d1/d23/d25/d4f/dce/fd6 [871279,92856] 0 2024-09-18T21:13:03.512 INFO:tasks.workunit.client.1.smithi103.stdout:9/890: write d18/d29/d68/d92/d9c/fcc [859396,59315] 0 2024-09-18T21:13:03.513 INFO:tasks.workunit.client.1.smithi103.stdout:9/891: fdatasync d18/d8d/f100 0 2024-09-18T21:13:03.515 INFO:tasks.workunit.client.1.smithi103.stdout:2/822: write d3/d5/d2f/d32/d90/feb [2091016,130103] 0 2024-09-18T21:13:03.516 INFO:tasks.workunit.client.1.smithi103.stdout:7/885: mkdir d1/df/d43/d52/dfa/d129 0 2024-09-18T21:13:03.523 INFO:tasks.workunit.client.1.smithi103.stdout:4/977: dread - d9/d38/d72/d85/fa6 zero size 2024-09-18T21:13:03.526 INFO:tasks.workunit.client.1.smithi103.stdout:1/835: fdatasync d0/d2/d2b/d3a/d42/d72/db0/da7/fb9 0 2024-09-18T21:13:03.530 INFO:tasks.workunit.client.1.smithi103.stdout:9/892: creat d18/da4/f126 x:0 0 0 2024-09-18T21:13:03.530 INFO:tasks.workunit.client.1.smithi103.stdout:2/823: mkdir d3/d5/d2c/d54/d68/d102/d121 0 2024-09-18T21:13:03.539 INFO:tasks.workunit.client.1.smithi103.stdout:0/844: dread d1/d9/d3e/f67 [0,4194304] 0 2024-09-18T21:13:03.540 INFO:tasks.workunit.client.1.smithi103.stdout:5/920: mkdir de/d1f/d3b/d58/dc4/d33/d132 0 2024-09-18T21:13:03.540 INFO:tasks.workunit.client.1.smithi103.stdout:9/893: dwrite d18/d52/d5e/f7b [0,4194304] 0 2024-09-18T21:13:03.540 INFO:tasks.workunit.client.1.smithi103.stdout:3/899: write d1/d2/d18/d30/d4e/db1/d10e/dbb/f5c [1009161,33738] 0 2024-09-18T21:13:03.540 INFO:tasks.workunit.client.1.smithi103.stdout:4/978: truncate d9/d1c/f68 2787111 0 2024-09-18T21:13:03.541 INFO:tasks.workunit.client.1.smithi103.stdout:1/836: truncate d0/d2/d2b/d3a/d42/d72/ff6 762541 0 2024-09-18T21:13:03.544 INFO:tasks.workunit.client.1.smithi103.stdout:7/886: write d1/df/d42/d1f/f5e [2370440,120603] 0 2024-09-18T21:13:03.544 INFO:tasks.workunit.client.1.smithi103.stdout:2/824: fsync d3/d5/d2c/f65 0 2024-09-18T21:13:03.545 INFO:tasks.workunit.client.1.smithi103.stdout:3/900: stat d1/d23/d25/d4f/d58/d68/d50/d54/d8c/ce3 0 2024-09-18T21:13:03.547 INFO:tasks.workunit.client.1.smithi103.stdout:3/901: write d1/da/df/f77 [235652,84969] 0 2024-09-18T21:13:03.548 INFO:tasks.workunit.client.1.smithi103.stdout:3/902: stat d1/d2/d18/d30/fb8 0 2024-09-18T21:13:03.549 INFO:tasks.workunit.client.1.smithi103.stdout:3/903: readlink d1/da/df/l94 0 2024-09-18T21:13:03.551 INFO:tasks.workunit.client.1.smithi103.stdout:5/921: dwrite de/d1f/d3b/d58/dc4/d33/d4f/fa4 [0,4194304] 0 2024-09-18T21:13:03.553 INFO:tasks.workunit.client.1.smithi103.stdout:5/922: truncate de/d1f/d3b/d3c/d62/f120 1136734 0 2024-09-18T21:13:03.584 INFO:tasks.workunit.client.0.smithi077.stdout:3/745: sync 2024-09-18T21:13:03.589 INFO:tasks.workunit.client.0.smithi077.stdout:4/785: mknod d3/d35/cfc 0 2024-09-18T21:13:03.592 INFO:tasks.workunit.client.0.smithi077.stdout:4/786: creat d3/dc/d24/d72/ffd x:0 0 0 2024-09-18T21:13:03.594 INFO:tasks.workunit.client.0.smithi077.stdout:3/746: truncate db/d14/d32/d49/d4e/d6a/f5d 1568979 0 2024-09-18T21:13:03.596 INFO:tasks.workunit.client.1.smithi103.stdout:1/837: dread d0/d2/d2b/d3a/d42/d72/db0/f6b [0,4194304] 0 2024-09-18T21:13:03.597 INFO:tasks.workunit.client.1.smithi103.stdout:8/982: sync 2024-09-18T21:13:03.597 INFO:tasks.workunit.client.0.smithi077.stdout:3/747: creat db/d14/d32/d49/d6b/fe8 x:0 0 0 2024-09-18T21:13:03.603 INFO:tasks.workunit.client.0.smithi077.stdout:3/748: mkdir db/d14/d32/de9 0 2024-09-18T21:13:03.604 INFO:tasks.workunit.client.0.smithi077.stdout:3/749: readlink db/d14/d32/d49/da4/d71/l5f 0 2024-09-18T21:13:03.605 INFO:tasks.workunit.client.0.smithi077.stdout:4/787: getdents d3/d7 0 2024-09-18T21:13:03.607 INFO:tasks.workunit.client.0.smithi077.stdout:3/750: fsync db/f54 0 2024-09-18T21:13:03.609 INFO:tasks.workunit.client.0.smithi077.stdout:4/788: unlink d3/d7/f68 0 2024-09-18T21:13:03.613 INFO:tasks.workunit.client.0.smithi077.stdout:3/751: rename db/d14/d32/d49/da4/d71/d3b/f66 to db/d14/d22/d36/d39/d50/d5c/fea 0 2024-09-18T21:13:03.615 INFO:tasks.workunit.client.0.smithi077.stdout:3/752: read db/d14/d32/d49/d4e/d8b/fbd [7207437,78911] 0 2024-09-18T21:13:03.616 INFO:tasks.workunit.client.0.smithi077.stdout:3/753: dread - db/fd7 zero size 2024-09-18T21:13:03.621 INFO:tasks.workunit.client.0.smithi077.stdout:3/754: fsync db/d14/d22/d36/f7f 0 2024-09-18T21:13:03.634 INFO:tasks.workunit.client.1.smithi103.stdout:9/894: unlink d18/l67 0 2024-09-18T21:13:03.636 INFO:tasks.workunit.client.0.smithi077.stdout:3/755: dread fa [0,4194304] 0 2024-09-18T21:13:03.637 INFO:tasks.workunit.client.1.smithi103.stdout:0/845: rename d1/d5/de/dc0/db0/f117 to d1/d5/de/d19/d1e/d34/f128 0 2024-09-18T21:13:03.638 INFO:tasks.workunit.client.1.smithi103.stdout:6/906: getdents d2/d24/d5a/d67/d76/d43 0 2024-09-18T21:13:03.639 INFO:tasks.workunit.client.0.smithi077.stdout:4/789: write d3/dc/d20/f3b [775099,114014] 0 2024-09-18T21:13:03.639 INFO:tasks.workunit.client.1.smithi103.stdout:6/907: read d2/d24/d5a/f64 [2350473,23016] 0 2024-09-18T21:13:03.640 INFO:tasks.workunit.client.1.smithi103.stdout:3/904: creat d1/d64/f110 x:0 0 0 2024-09-18T21:13:03.642 INFO:tasks.workunit.client.1.smithi103.stdout:1/838: symlink d0/d2/d9/d9e/d7a/dd0/l127 0 2024-09-18T21:13:03.643 INFO:tasks.workunit.client.0.smithi077.stdout:3/756: dwrite db/d14/d32/d49/da4/d8a/d99/daf/fb0 [0,4194304] 0 2024-09-18T21:13:03.644 INFO:tasks.workunit.client.1.smithi103.stdout:8/983: rmdir d4/d81/dd7/dde/d59/d9c 39 2024-09-18T21:13:03.648 INFO:tasks.workunit.client.0.smithi077.stdout:3/757: fdatasync db/d14/d32/d49/d6b/f9a 0 2024-09-18T21:13:03.648 INFO:tasks.workunit.client.0.smithi077.stdout:3/758: chown db/d14/d32/d49 58578 1 2024-09-18T21:13:03.650 INFO:tasks.workunit.client.0.smithi077.stdout:3/759: chown db/d14/d32/d49/da4/d8a/d99/daf/le3 2 1 2024-09-18T21:13:03.650 INFO:tasks.workunit.client.1.smithi103.stdout:8/984: dwrite d4/d81/d71/d7f/f128 [0,4194304] 0 2024-09-18T21:13:03.650 INFO:tasks.workunit.client.1.smithi103.stdout:9/895: unlink d18/d8d/d2f/lde 0 2024-09-18T21:13:03.651 INFO:tasks.workunit.client.0.smithi077.stdout:4/790: creat d3/ffe x:0 0 0 2024-09-18T21:13:03.652 INFO:tasks.workunit.client.1.smithi103.stdout:9/896: chown d18/d52/l7c 2154 1 2024-09-18T21:13:03.657 INFO:tasks.workunit.client.0.smithi077.stdout:4/791: unlink d3/d77/d9c/fc1 0 2024-09-18T21:13:03.658 INFO:tasks.workunit.client.0.smithi077.stdout:4/792: chown d3/dc/d32/d45/l7e 1772 1 2024-09-18T21:13:03.658 INFO:tasks.workunit.client.1.smithi103.stdout:0/846: readlink d1/d5/de/dc0/lca 0 2024-09-18T21:13:03.661 INFO:tasks.workunit.client.1.smithi103.stdout:4/979: dwrite f6 [0,4194304] 0 2024-09-18T21:13:03.665 INFO:tasks.workunit.client.1.smithi103.stdout:5/923: symlink de/d1f/d3b/d58/dc4/d33/d132/l133 0 2024-09-18T21:13:03.669 INFO:tasks.workunit.client.1.smithi103.stdout:8/985: write d4/d2d/dc1/dee/f11d [504621,32618] 0 2024-09-18T21:13:03.669 INFO:tasks.workunit.client.1.smithi103.stdout:6/908: dread d2/d24/d5a/d67/d76/d43/fae [0,4194304] 0 2024-09-18T21:13:03.670 INFO:tasks.workunit.client.1.smithi103.stdout:9/897: readlink d18/d8d/l3a 0 2024-09-18T21:13:03.670 INFO:tasks.workunit.client.1.smithi103.stdout:8/986: readlink d4/d2d/dc1/dee/lff 0 2024-09-18T21:13:03.672 INFO:tasks.workunit.client.1.smithi103.stdout:6/909: write d2/d24/d5a/d67/d76/d43/f101 [528794,84643] 0 2024-09-18T21:13:03.672 INFO:tasks.workunit.client.1.smithi103.stdout:8/987: chown d4/d81/dd7/dde/d59/f119 952 1 2024-09-18T21:13:03.673 INFO:tasks.workunit.client.1.smithi103.stdout:5/924: creat de/d1f/d3b/d51/d57/dc8/f134 x:0 0 0 2024-09-18T21:13:03.677 INFO:tasks.workunit.client.1.smithi103.stdout:7/887: rename d1/df/d54/l65 to d1/df/d42/d29/d48/dbb/l12a 0 2024-09-18T21:13:03.678 INFO:tasks.workunit.client.1.smithi103.stdout:2/825: getdents d3/d5/d2f 0 2024-09-18T21:13:03.679 INFO:tasks.workunit.client.1.smithi103.stdout:7/888: chown d1/df/d42/d1f/d5d/d85/db0/dc5/ld2 26878 1 2024-09-18T21:13:03.679 INFO:tasks.workunit.client.1.smithi103.stdout:6/910: mknod d2/d24/d38/d68/dac/c121 0 2024-09-18T21:13:03.680 INFO:tasks.workunit.client.1.smithi103.stdout:1/839: link d0/d11/d5f/f93 d0/d2/d2b/d111/f128 0 2024-09-18T21:13:03.680 INFO:tasks.workunit.client.1.smithi103.stdout:4/980: creat d9/f142 x:0 0 0 2024-09-18T21:13:03.682 INFO:tasks.workunit.client.1.smithi103.stdout:4/981: stat d9/de3/f108 0 2024-09-18T21:13:03.683 INFO:tasks.workunit.client.1.smithi103.stdout:2/826: unlink d3/d5/d2c/d77/fa3 0 2024-09-18T21:13:03.684 INFO:tasks.workunit.client.1.smithi103.stdout:5/925: mknod de/d1f/d3b/c135 0 2024-09-18T21:13:03.685 INFO:tasks.workunit.client.1.smithi103.stdout:5/926: chown de/d1f/d3b/d58/feb 665129 1 2024-09-18T21:13:03.688 INFO:tasks.workunit.client.0.smithi077.stdout:4/793: dread d3/dc/d32/d5b/fa9 [0,4194304] 0 2024-09-18T21:13:03.689 INFO:tasks.workunit.client.1.smithi103.stdout:9/898: rename d18/d52/d5e/fac to d18/d52/d5e/f127 0 2024-09-18T21:13:03.690 INFO:tasks.workunit.client.1.smithi103.stdout:1/840: dread - d0/d2/d9/f92 zero size 2024-09-18T21:13:03.692 INFO:tasks.workunit.client.0.smithi077.stdout:3/760: dread db/f2e [4194304,4194304] 0 2024-09-18T21:13:03.693 INFO:tasks.workunit.client.1.smithi103.stdout:8/988: creat d4/d26/f136 x:0 0 0 2024-09-18T21:13:03.693 INFO:tasks.workunit.client.1.smithi103.stdout:0/847: write d1/d5/de/dc0/d8c/dce/d9f/fe5 [75907,114380] 0 2024-09-18T21:13:03.694 INFO:tasks.workunit.client.1.smithi103.stdout:4/982: unlink d9/d38/d72/df0/d61/d91/d9e/d48/f56 0 2024-09-18T21:13:03.695 INFO:tasks.workunit.client.0.smithi077.stdout:4/794: dread - d3/d7/d6c/fc7 zero size 2024-09-18T21:13:03.696 INFO:tasks.workunit.client.0.smithi077.stdout:0/857: sync 2024-09-18T21:13:03.697 INFO:tasks.workunit.client.1.smithi103.stdout:3/905: write d1/d64/f95 [2509203,69774] 0 2024-09-18T21:13:03.697 INFO:tasks.workunit.client.0.smithi077.stdout:0/858: chown d8/d37/ffa 17 1 2024-09-18T21:13:03.698 INFO:tasks.workunit.client.1.smithi103.stdout:5/927: read - de/d1f/d3b/d58/dd1/fe2 zero size 2024-09-18T21:13:03.700 INFO:tasks.workunit.client.1.smithi103.stdout:3/906: dread d1/d23/d25/d4f/dce/fd6 [0,4194304] 0 2024-09-18T21:13:03.702 INFO:tasks.workunit.client.1.smithi103.stdout:6/911: write d2/d24/d38/f89 [817639,6424] 0 2024-09-18T21:13:03.704 INFO:tasks.workunit.client.1.smithi103.stdout:9/899: creat d18/d29/d68/d78/f128 x:0 0 0 2024-09-18T21:13:03.706 INFO:tasks.workunit.client.1.smithi103.stdout:6/912: write d2/d3/d8/d4c/d7d/d9b/dd0/fda [780805,48377] 0 2024-09-18T21:13:03.707 INFO:tasks.workunit.client.0.smithi077.stdout:0/859: mknod d8/d1a/d39/c111 0 2024-09-18T21:13:03.707 INFO:tasks.workunit.client.0.smithi077.stdout:4/795: write d3/d77/de5/feb [452729,32677] 0 2024-09-18T21:13:03.708 INFO:tasks.workunit.client.0.smithi077.stdout:4/796: stat d3/dc/c6d 0 2024-09-18T21:13:03.708 INFO:tasks.workunit.client.0.smithi077.stdout:3/761: getdents db/d14/d22/d36/dd9 0 2024-09-18T21:13:03.709 INFO:tasks.workunit.client.1.smithi103.stdout:8/989: dread d4/d2d/d3d/f5a [4194304,4194304] 0 2024-09-18T21:13:03.709 INFO:tasks.workunit.client.1.smithi103.stdout:0/848: write d1/d5/de/dc0/d8c/fd1 [1093631,56559] 0 2024-09-18T21:13:03.710 INFO:tasks.workunit.client.1.smithi103.stdout:7/889: dwrite d1/df/d42/d29/d48/fe1 [0,4194304] 0 2024-09-18T21:13:03.713 INFO:tasks.workunit.client.0.smithi077.stdout:3/762: mkdir db/d14/d22/d36/d39/d50/d5c/deb 0 2024-09-18T21:13:03.714 INFO:tasks.workunit.client.1.smithi103.stdout:5/928: chown de/d1f/d3b/l116 11 1 2024-09-18T21:13:03.714 INFO:tasks.workunit.client.1.smithi103.stdout:4/983: read d9/d38/d72/d85/dd8/f10f [174318,85159] 0 2024-09-18T21:13:03.715 INFO:tasks.workunit.client.0.smithi077.stdout:0/860: rename d8/d1d/d80/fdd to d8/d1a/f112 0 2024-09-18T21:13:03.716 INFO:tasks.workunit.client.0.smithi077.stdout:4/797: dwrite d3/dc/d32/d45/faa [4194304,4194304] 0 2024-09-18T21:13:03.716 INFO:tasks.workunit.client.1.smithi103.stdout:2/827: dwrite d3/d5/d4a/f53 [0,4194304] 0 2024-09-18T21:13:03.719 INFO:tasks.workunit.client.1.smithi103.stdout:4/984: dread - d9/d1c/d77/f136 zero size 2024-09-18T21:13:03.720 INFO:tasks.workunit.client.1.smithi103.stdout:9/900: rmdir d18/d29/d68/d92 39 2024-09-18T21:13:03.721 INFO:tasks.workunit.client.1.smithi103.stdout:3/907: write d1/d2/d18/d30/d4e/db1/d10e/f56 [451207,3742] 0 2024-09-18T21:13:03.721 INFO:tasks.workunit.client.0.smithi077.stdout:0/861: mknod d8/d1a/d39/ded/c113 0 2024-09-18T21:13:03.723 INFO:tasks.workunit.client.0.smithi077.stdout:0/862: chown d8/d1a/d35/f82 43496 1 2024-09-18T21:13:03.724 INFO:tasks.workunit.client.0.smithi077.stdout:4/798: symlink d3/dc/d51/d53/lff 0 2024-09-18T21:13:03.724 INFO:tasks.workunit.client.1.smithi103.stdout:9/901: chown d18/d52/d6f/f88 7 1 2024-09-18T21:13:03.726 INFO:tasks.workunit.client.1.smithi103.stdout:3/908: fdatasync d1/d23/d25/d4f/d58/d68/da0/f10d 0 2024-09-18T21:13:03.726 INFO:tasks.workunit.client.1.smithi103.stdout:8/990: readlink d4/d81/dd7/dde/d59/l90 0 2024-09-18T21:13:03.728 INFO:tasks.workunit.client.1.smithi103.stdout:6/913: dread d2/d24/d38/d68/dac/fc8 [0,4194304] 0 2024-09-18T21:13:03.728 INFO:tasks.workunit.client.0.smithi077.stdout:4/799: symlink d3/dc/d51/d53/l100 0 2024-09-18T21:13:03.729 INFO:tasks.workunit.client.1.smithi103.stdout:5/929: dread de/d1f/d3b/d58/dc4/d33/d4f/fa4 [0,4194304] 0 2024-09-18T21:13:03.729 INFO:tasks.workunit.client.0.smithi077.stdout:4/800: readlink d3/dc/d51/d53/dce/lec 0 2024-09-18T21:13:03.729 INFO:tasks.workunit.client.0.smithi077.stdout:0/863: mknod d8/d1a/d39/d3b/c114 0 2024-09-18T21:13:03.730 INFO:tasks.workunit.client.0.smithi077.stdout:4/801: chown d3/dc/d51/f80 3 1 2024-09-18T21:13:03.730 INFO:tasks.workunit.client.1.smithi103.stdout:5/930: dread - de/d3e/d85/ffe zero size 2024-09-18T21:13:03.731 INFO:tasks.workunit.client.0.smithi077.stdout:3/763: getdents db/d14/d32/d49 0 2024-09-18T21:13:03.732 INFO:tasks.workunit.client.1.smithi103.stdout:5/931: dread - de/d1f/d3b/d58/dc4/d33/f12c zero size 2024-09-18T21:13:03.732 INFO:tasks.workunit.client.0.smithi077.stdout:0/864: mknod d8/d37/dd2/c115 0 2024-09-18T21:13:03.734 INFO:tasks.workunit.client.0.smithi077.stdout:4/802: creat d3/dc/d32/d45/d5e/f101 x:0 0 0 2024-09-18T21:13:03.734 INFO:tasks.workunit.client.1.smithi103.stdout:4/985: symlink d9/de3/l143 0 2024-09-18T21:13:03.735 INFO:tasks.workunit.client.0.smithi077.stdout:3/764: mkdir db/d14/d32/d49/d4e/d6a/dec 0 2024-09-18T21:13:03.736 INFO:tasks.workunit.client.1.smithi103.stdout:3/909: dwrite d1/d2/d18/d30/d4e/f61 [0,4194304] 0 2024-09-18T21:13:03.736 INFO:tasks.workunit.client.1.smithi103.stdout:9/902: creat d18/d52/d6f/d8e/d8f/dbd/f129 x:0 0 0 2024-09-18T21:13:03.736 INFO:tasks.workunit.client.1.smithi103.stdout:1/841: dread d0/d11/d5f/f107 [0,4194304] 0 2024-09-18T21:13:03.737 INFO:tasks.workunit.client.0.smithi077.stdout:3/765: stat db/d14/d32/d49/d4e/d6a/db5 0 2024-09-18T21:13:03.738 INFO:tasks.workunit.client.1.smithi103.stdout:7/890: mkdir d1/df/d42/d29/d48/dbb/ded/dfe/d12b 0 2024-09-18T21:13:03.738 INFO:tasks.workunit.client.0.smithi077.stdout:4/803: fdatasync d3/dc/d24/f4c 0 2024-09-18T21:13:03.739 INFO:tasks.workunit.client.0.smithi077.stdout:3/766: stat db/d14/cce 0 2024-09-18T21:13:03.740 INFO:tasks.workunit.client.0.smithi077.stdout:3/767: readlink db/d14/d72/l8e 0 2024-09-18T21:13:03.744 INFO:tasks.workunit.client.1.smithi103.stdout:8/991: rename d4/d81/d71/d7f/d9d/ld3 to d4/d2d/d3d/l137 0 2024-09-18T21:13:03.745 INFO:tasks.workunit.client.1.smithi103.stdout:8/992: stat d4/d2d/d87/dbb/dea/c10e 0 2024-09-18T21:13:03.749 INFO:tasks.workunit.client.0.smithi077.stdout:3/768: dwrite db/d14/d32/d49/d4e/d6a/fe5 [0,4194304] 0 2024-09-18T21:13:03.749 INFO:tasks.workunit.client.0.smithi077.stdout:4/804: mkdir d3/d7/d7b/d88/d102 0 2024-09-18T21:13:03.753 INFO:tasks.workunit.client.1.smithi103.stdout:0/849: write d1/d5/de/dc0/d8c/dce/d9f/f71 [2419987,34164] 0 2024-09-18T21:13:03.754 INFO:tasks.workunit.client.1.smithi103.stdout:7/891: rmdir d1/df/d44/dba 39 2024-09-18T21:13:03.756 INFO:tasks.workunit.client.0.smithi077.stdout:3/769: rename db/d14/d32/d49/fab to db/d14/d32/d49/da4/d8a/ddd/fed 0 2024-09-18T21:13:03.760 INFO:tasks.workunit.client.1.smithi103.stdout:5/932: rename de/d1f/d3b/dcd/c128 to de/d1f/d3b/d3c/d62/d108/c136 0 2024-09-18T21:13:03.760 INFO:tasks.workunit.client.1.smithi103.stdout:2/828: dread d3/d5/f11f [0,4194304] 0 2024-09-18T21:13:03.761 INFO:tasks.workunit.client.0.smithi077.stdout:3/770: rmdir db/d14/d93 39 2024-09-18T21:13:03.761 INFO:tasks.workunit.client.1.smithi103.stdout:1/842: dwrite d0/d2/d2b/d3a/d42/d9c/ffb [0,4194304] 0 2024-09-18T21:13:03.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:03 smithi103 ceph-mon[34827]: Reconfiguring node-exporter.smithi077 (dependencies changed)... 2024-09-18T21:13:03.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:03 smithi103 ceph-mon[34827]: Reconfiguring daemon node-exporter.smithi077 on smithi077 2024-09-18T21:13:03.765 INFO:tasks.workunit.client.1.smithi103.stdout:1/843: write d0/d2/d9/d9e/d7a/dd0/df9/d68/d81/da2/da4/dc2/dd8/dae/fb4 [4933960,37810] 0 2024-09-18T21:13:03.767 INFO:tasks.workunit.client.1.smithi103.stdout:0/850: symlink d1/d9/d3e/d6e/l129 0 2024-09-18T21:13:03.769 INFO:tasks.workunit.client.0.smithi077.stdout:3/771: read db/d14/d32/d49/da4/d8a/ddd/fed [3239153,31359] 0 2024-09-18T21:13:03.769 INFO:tasks.workunit.client.0.smithi077.stdout:0/865: dwrite d8/d1d/d80/f97 [0,4194304] 0 2024-09-18T21:13:03.770 INFO:tasks.workunit.client.0.smithi077.stdout:0/866: chown d8/d26/l29 3475 1 2024-09-18T21:13:03.771 INFO:tasks.workunit.client.1.smithi103.stdout:6/914: dwrite d2/d3/d8/f2a [0,4194304] 0 2024-09-18T21:13:03.771 INFO:tasks.workunit.client.1.smithi103.stdout:3/910: rename d1/d23/d25/d4f/d72/d85/fb3 to d1/d9a/f111 0 2024-09-18T21:13:03.773 INFO:tasks.workunit.client.1.smithi103.stdout:8/993: mknod d4/d2d/dc1/c138 0 2024-09-18T21:13:03.777 INFO:tasks.workunit.client.1.smithi103.stdout:1/844: mknod d0/d2/d9/d9e/d7a/dd0/d10f/c129 0 2024-09-18T21:13:03.778 INFO:tasks.workunit.client.0.smithi077.stdout:3/772: mkdir db/dee 0 2024-09-18T21:13:03.780 INFO:tasks.workunit.client.1.smithi103.stdout:7/892: mknod d1/df/d43/d61/d122/c12c 0 2024-09-18T21:13:03.780 INFO:tasks.workunit.client.1.smithi103.stdout:9/903: dwrite d18/d52/fbf [4194304,4194304] 0 2024-09-18T21:13:03.782 INFO:tasks.workunit.client.0.smithi077.stdout:0/867: creat d8/d1d/de3/f116 x:0 0 0 2024-09-18T21:13:03.782 INFO:tasks.workunit.client.1.smithi103.stdout:4/986: truncate d9/d1c/d69/fdc 396978 0 2024-09-18T21:13:03.784 INFO:tasks.workunit.client.1.smithi103.stdout:0/851: truncate d1/d9/d3e/fbe 966010 0 2024-09-18T21:13:03.785 INFO:tasks.workunit.client.0.smithi077.stdout:4/805: dread d3/dc/d20/f40 [0,4194304] 0 2024-09-18T21:13:03.786 INFO:tasks.workunit.client.1.smithi103.stdout:9/904: dread d18/d52/fbf [4194304,4194304] 0 2024-09-18T21:13:03.786 INFO:tasks.workunit.client.0.smithi077.stdout:4/806: stat d3/d7/d7b 0 2024-09-18T21:13:03.786 INFO:tasks.workunit.client.0.smithi077.stdout:3/773: dwrite db/d14/d32/d49/da4/f53 [0,4194304] 0 2024-09-18T21:13:03.788 INFO:tasks.workunit.client.1.smithi103.stdout:2/829: rename d3/d5/d4a/l10c to d3/d5/d2f/d32/d90/dd7/l122 0 2024-09-18T21:13:03.789 INFO:tasks.workunit.client.0.smithi077.stdout:4/807: write d3/d35/db1/ff5 [385132,15397] 0 2024-09-18T21:13:03.792 INFO:tasks.workunit.client.1.smithi103.stdout:3/911: creat d1/d23/d25/f112 x:0 0 0 2024-09-18T21:13:03.793 INFO:tasks.workunit.client.0.smithi077.stdout:3/774: mknod db/d14/d32/d49/da4/d8a/d99/daf/cef 0 2024-09-18T21:13:03.794 INFO:tasks.workunit.client.0.smithi077.stdout:3/775: chown db/d4d/c7d 1679349 1 2024-09-18T21:13:03.795 INFO:tasks.workunit.client.1.smithi103.stdout:5/933: truncate de/d1f/d3b/d58/fff 2087499 0 2024-09-18T21:13:03.796 INFO:tasks.workunit.client.1.smithi103.stdout:1/845: creat d0/d2/d9/dc/d6e/f12a x:0 0 0 2024-09-18T21:13:03.796 INFO:tasks.workunit.client.0.smithi077.stdout:3/776: write db/d14/d32/d49/da4/f53 [282477,59834] 0 2024-09-18T21:13:03.797 INFO:tasks.workunit.client.1.smithi103.stdout:7/893: symlink d1/df/dbf/l12d 0 2024-09-18T21:13:03.799 INFO:tasks.workunit.client.0.smithi077.stdout:3/777: dread - db/d14/d22/d36/d39/d50/fde zero size 2024-09-18T21:13:03.800 INFO:tasks.workunit.client.1.smithi103.stdout:3/912: dwrite d1/d2/d18/d30/f38 [4194304,4194304] 0 2024-09-18T21:13:03.802 INFO:tasks.workunit.client.0.smithi077.stdout:4/808: dwrite d3/d7/d42/dd8/fe1 [0,4194304] 0 2024-09-18T21:13:03.803 INFO:tasks.workunit.client.1.smithi103.stdout:6/915: rename d2/d3/d8/f114 to d2/d24/d38/d68/f122 0 2024-09-18T21:13:03.805 INFO:tasks.workunit.client.0.smithi077.stdout:3/778: fsync f4 0 2024-09-18T21:13:03.805 INFO:tasks.workunit.client.1.smithi103.stdout:2/830: rmdir d3/d5/d2f/d32/d90/df0 39 2024-09-18T21:13:03.807 INFO:tasks.workunit.client.0.smithi077.stdout:4/809: mkdir d3/dc/d32/d45/d5e/d103 0 2024-09-18T21:13:03.809 INFO:tasks.workunit.client.0.smithi077.stdout:3/779: readlink db/le 0 2024-09-18T21:13:03.812 INFO:tasks.workunit.client.0.smithi077.stdout:4/810: truncate d3/d77/f39 1819395 0 2024-09-18T21:13:03.814 INFO:tasks.workunit.client.0.smithi077.stdout:3/780: mknod db/d14/d90/cf0 0 2024-09-18T21:13:03.819 INFO:tasks.workunit.client.1.smithi103.stdout:7/894: creat d1/df/d42/d1f/d5d/d85/f12e x:0 0 0 2024-09-18T21:13:03.819 INFO:tasks.workunit.client.0.smithi077.stdout:4/811: dwrite d3/d7/d42/f5d [0,4194304] 0 2024-09-18T21:13:03.820 INFO:tasks.workunit.client.1.smithi103.stdout:1/846: dwrite d0/d2/d9/dc/d6e/dac/ffe [0,4194304] 0 2024-09-18T21:13:03.821 INFO:tasks.workunit.client.0.smithi077.stdout:3/781: rename db/d14/d22/d36/c44 to db/d14/d32/d49/da4/d8a/d99/daf/cf1 0 2024-09-18T21:13:03.823 INFO:tasks.workunit.client.0.smithi077.stdout:4/812: creat d3/d35/f104 x:0 0 0 2024-09-18T21:13:03.823 INFO:tasks.workunit.client.0.smithi077.stdout:3/782: dread - db/d14/d22/d36/fbc zero size 2024-09-18T21:13:03.824 INFO:tasks.workunit.client.1.smithi103.stdout:0/852: fdatasync d1/d5/de/d24/d43/d76/f90 0 2024-09-18T21:13:03.825 INFO:tasks.workunit.client.1.smithi103.stdout:9/905: fsync d18/d52/d6f/db9/fbc 0 2024-09-18T21:13:03.825 INFO:tasks.workunit.client.1.smithi103.stdout:0/853: fdatasync d1/d5/de/d24/d43/d76/dc5/f10b 0 2024-09-18T21:13:03.827 INFO:tasks.workunit.client.1.smithi103.stdout:0/854: readlink d1/d5/de/d19/d1e/l39 0 2024-09-18T21:13:03.830 INFO:tasks.workunit.client.0.smithi077.stdout:2/852: sync 2024-09-18T21:13:03.831 INFO:tasks.workunit.client.0.smithi077.stdout:8/754: sync 2024-09-18T21:13:03.831 INFO:tasks.workunit.client.0.smithi077.stdout:5/860: sync 2024-09-18T21:13:03.832 INFO:tasks.workunit.client.0.smithi077.stdout:4/813: dwrite d3/d77/d9c/fee [0,4194304] 0 2024-09-18T21:13:03.833 INFO:tasks.workunit.client.1.smithi103.stdout:4/987: write d9/d38/d72/df0/d83/db6/ff9 [226657,22417] 0 2024-09-18T21:13:03.835 INFO:tasks.workunit.client.0.smithi077.stdout:0/868: dread d8/d37/d66/d87/de0/f65 [0,4194304] 0 2024-09-18T21:13:03.836 INFO:tasks.workunit.client.0.smithi077.stdout:8/755: readlink d2/d5f/da8/d4f/d5a/d2a/l82 0 2024-09-18T21:13:03.837 INFO:tasks.workunit.client.1.smithi103.stdout:2/831: dread d3/d5/d2c/f65 [0,4194304] 0 2024-09-18T21:13:03.838 INFO:tasks.workunit.client.1.smithi103.stdout:2/832: chown d3/d5/d2f/d32/fda 13 1 2024-09-18T21:13:03.840 INFO:tasks.workunit.client.1.smithi103.stdout:3/913: mknod d1/da/c113 0 2024-09-18T21:13:03.841 INFO:tasks.workunit.client.1.smithi103.stdout:7/895: fsync d1/df/d54/fb6 0 2024-09-18T21:13:03.843 INFO:tasks.workunit.client.0.smithi077.stdout:3/783: dwrite db/d14/d93/fd4 [0,4194304] 0 2024-09-18T21:13:03.844 INFO:tasks.workunit.client.0.smithi077.stdout:3/784: chown db/d14/d90/cf0 2227 1 2024-09-18T21:13:03.853 INFO:tasks.workunit.client.0.smithi077.stdout:3/785: dwrite db/d14/d22/f2f [0,4194304] 0 2024-09-18T21:13:03.860 INFO:tasks.workunit.client.1.smithi103.stdout:5/934: write de/f16 [171787,65222] 0 2024-09-18T21:13:03.861 INFO:tasks.workunit.client.0.smithi077.stdout:4/814: getdents d3/d77/d9c/db9 0 2024-09-18T21:13:03.862 INFO:tasks.workunit.client.1.smithi103.stdout:5/935: fsync de/d1f/d3b/d51/d57/d59/f12b 0 2024-09-18T21:13:03.862 INFO:tasks.workunit.client.1.smithi103.stdout:5/936: chown de/d3e/cc9 6281858 1 2024-09-18T21:13:03.864 INFO:tasks.workunit.client.1.smithi103.stdout:7/896: creat d1/df/d42/d29/d48/f12f x:0 0 0 2024-09-18T21:13:03.864 INFO:tasks.workunit.client.1.smithi103.stdout:4/988: dread d9/d38/d72/df0/d61/d91/daa/fc0 [0,4194304] 0 2024-09-18T21:13:03.865 INFO:tasks.workunit.client.0.smithi077.stdout:4/815: mkdir d3/dc/d24/d105 0 2024-09-18T21:13:03.867 INFO:tasks.workunit.client.1.smithi103.stdout:9/906: unlink d18/d52/d6f/d8e/fa2 0 2024-09-18T21:13:03.868 INFO:tasks.workunit.client.1.smithi103.stdout:0/855: mknod d1/c12a 0 2024-09-18T21:13:03.869 INFO:tasks.workunit.client.1.smithi103.stdout:7/897: dwrite d1/df/d42/d1f/d2e/f41 [0,4194304] 0 2024-09-18T21:13:03.873 INFO:tasks.workunit.client.0.smithi077.stdout:0/869: write d8/d1d/fca [2661462,43183] 0 2024-09-18T21:13:03.874 INFO:tasks.workunit.client.0.smithi077.stdout:8/756: dread d2/d5f/da8/fd3 [0,4194304] 0 2024-09-18T21:13:03.875 INFO:tasks.workunit.client.1.smithi103.stdout:5/937: chown de/d1f/d3b/c55 11941 1 2024-09-18T21:13:03.877 INFO:tasks.workunit.client.0.smithi077.stdout:5/861: dread d0/d6/d3b/fb5 [0,4194304] 0 2024-09-18T21:13:03.878 INFO:tasks.workunit.client.1.smithi103.stdout:6/916: truncate d2/d24/d5a/d67/d76/f8c 3883749 0 2024-09-18T21:13:03.879 INFO:tasks.workunit.client.0.smithi077.stdout:5/862: write d0/df/d10/d47/db6/f100 [727654,60908] 0 2024-09-18T21:13:03.880 INFO:tasks.workunit.client.1.smithi103.stdout:4/989: creat d9/d38/db4/f144 x:0 0 0 2024-09-18T21:13:03.880 INFO:tasks.workunit.client.0.smithi077.stdout:2/853: dread d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d8e/f74 [4194304,4194304] 0 2024-09-18T21:13:03.881 INFO:tasks.workunit.client.0.smithi077.stdout:4/816: creat d3/d7/f106 x:0 0 0 2024-09-18T21:13:03.882 INFO:tasks.workunit.client.1.smithi103.stdout:5/938: dwrite de/d1f/d3b/d3c/d62/f76 [0,4194304] 0 2024-09-18T21:13:03.883 INFO:tasks.workunit.client.1.smithi103.stdout:9/907: rmdir d18/d52/d6f/db9 39 2024-09-18T21:13:03.884 INFO:tasks.workunit.client.0.smithi077.stdout:8/757: unlink d2/d5f/da8/c87 0 2024-09-18T21:13:03.889 INFO:tasks.workunit.client.1.smithi103.stdout:4/990: dwrite d9/d38/d72/df0/d61/f76 [0,4194304] 0 2024-09-18T21:13:03.890 INFO:tasks.workunit.client.1.smithi103.stdout:8/994: rename d4/d26/d56/d77/cd0 to d4/d81/dd7/dde/c139 0 2024-09-18T21:13:03.891 INFO:tasks.workunit.client.0.smithi077.stdout:4/817: dwrite d3/d77/d9c/fdb [0,4194304] 0 2024-09-18T21:13:03.892 INFO:tasks.workunit.client.0.smithi077.stdout:3/786: dread db/f35 [4194304,4194304] 0 2024-09-18T21:13:03.893 INFO:tasks.workunit.client.0.smithi077.stdout:3/787: fsync db/d14/d22/f9d 0 2024-09-18T21:13:03.893 INFO:tasks.workunit.client.0.smithi077.stdout:0/870: rename d8/d1a/d39/ded to d8/d1a/d39/dd0/d117 0 2024-09-18T21:13:03.894 INFO:tasks.workunit.client.0.smithi077.stdout:3/788: chown db/d14/d32/d49/d4e/d6a/cc0 3834 1 2024-09-18T21:13:03.895 INFO:tasks.workunit.client.1.smithi103.stdout:4/991: fsync d9/d38/d72/df0/d83/db6/d21/d80/f127 0 2024-09-18T21:13:03.895 INFO:tasks.workunit.client.1.smithi103.stdout:2/833: link d3/d5/d2c/f64 d3/d5/d2f/d32/d90/df0/f123 0 2024-09-18T21:13:03.896 INFO:tasks.workunit.client.0.smithi077.stdout:2/854: mkdir d1/d4/d5/d1a/d113/d81/d122 0 2024-09-18T21:13:03.897 INFO:tasks.workunit.client.1.smithi103.stdout:5/939: dwrite de/d1f/d3b/d51/f104 [0,4194304] 0 2024-09-18T21:13:03.898 INFO:tasks.workunit.client.1.smithi103.stdout:1/847: link d0/d2/d2b/d3a/d42/d9c/ld7 d0/d2/l12b 0 2024-09-18T21:13:03.899 INFO:tasks.workunit.client.0.smithi077.stdout:2/855: fdatasync d1/d4/d5/d1a/d113/d81/dc4/dc0/f8a 0 2024-09-18T21:13:03.899 INFO:tasks.workunit.client.0.smithi077.stdout:5/863: creat d0/ddd/f11c x:0 0 0 2024-09-18T21:13:03.900 INFO:tasks.workunit.client.0.smithi077.stdout:8/758: mknod d2/d5f/da8/d4f/d5a/d2a/d88/c10d 0 2024-09-18T21:13:03.902 INFO:tasks.workunit.client.1.smithi103.stdout:1/848: fsync d0/d2/d9/d9e/d7a/dd0/df9/d68/d81/da2/da4/dc2/dd8/dae/fff 0 2024-09-18T21:13:03.904 INFO:tasks.workunit.client.1.smithi103.stdout:6/917: dread d2/d3/d8/d4c/d7d/fea [0,4194304] 0 2024-09-18T21:13:03.905 INFO:tasks.workunit.client.0.smithi077.stdout:9/770: sync 2024-09-18T21:13:03.905 INFO:tasks.workunit.client.0.smithi077.stdout:6/767: sync 2024-09-18T21:13:03.905 INFO:tasks.workunit.client.0.smithi077.stdout:0/871: write d8/d1a/f42 [2973987,17986] 0 2024-09-18T21:13:03.906 INFO:tasks.workunit.client.0.smithi077.stdout:1/754: sync 2024-09-18T21:13:03.907 INFO:tasks.workunit.client.0.smithi077.stdout:7/874: sync 2024-09-18T21:13:03.910 INFO:tasks.workunit.client.1.smithi103.stdout:3/914: rename d1/d23/d25 to d1/d2/d18/d30/d4e/db1/d10e/d114 0 2024-09-18T21:13:03.912 INFO:tasks.workunit.client.1.smithi103.stdout:8/995: readlink d4/d26/d56/d77/l94 0 2024-09-18T21:13:03.913 INFO:tasks.workunit.client.0.smithi077.stdout:8/759: stat d2/d5/lb3 0 2024-09-18T21:13:03.916 INFO:tasks.workunit.client.1.smithi103.stdout:5/940: creat de/d1f/d3b/d58/dc4/d33/d4f/da6/f137 x:0 0 0 2024-09-18T21:13:03.917 INFO:tasks.workunit.client.0.smithi077.stdout:9/771: mknod d1/dd/d11/d1c/d38/d46/daf/c10a 0 2024-09-18T21:13:03.920 INFO:tasks.workunit.client.0.smithi077.stdout:0/872: rename d8/d1a/d39/d64/l94 to d8/d37/d66/d87/de0/l118 0 2024-09-18T21:13:03.920 INFO:tasks.workunit.client.1.smithi103.stdout:3/915: stat d1/d2/d18/d30/d4e/db1/d10e/d114/d4f/d58/d86/c91 0 2024-09-18T21:13:03.923 INFO:tasks.workunit.client.1.smithi103.stdout:3/916: write d1/d2/d18/d30/d4e/db1/d10e/d114/d4f/d58/d68/f36 [1472805,118664] 0 2024-09-18T21:13:03.923 INFO:tasks.workunit.client.1.smithi103.stdout:4/992: mkdir d9/d13c/d145 0 2024-09-18T21:13:03.927 INFO:tasks.workunit.client.0.smithi077.stdout:9/772: symlink d1/dd/d57/d97/l10b 0 2024-09-18T21:13:03.927 INFO:tasks.workunit.client.0.smithi077.stdout:9/773: chown d1/dd/d11/d1c/d38/d46/fac 1046719 1 2024-09-18T21:13:03.929 INFO:tasks.workunit.client.0.smithi077.stdout:6/768: rename d7/d7e/da6/fc1 to d7/d7e/d11/d3e/d42/d88/da4/f105 0 2024-09-18T21:13:03.929 INFO:tasks.workunit.client.1.smithi103.stdout:8/996: truncate d4/d81/d65/f31 781239 0 2024-09-18T21:13:03.930 INFO:tasks.workunit.client.0.smithi077.stdout:0/873: symlink d8/d10b/l119 0 2024-09-18T21:13:03.931 INFO:tasks.workunit.client.0.smithi077.stdout:6/769: dread - d7/d7e/d11/d3e/dcd/fec zero size 2024-09-18T21:13:03.933 INFO:tasks.workunit.client.0.smithi077.stdout:3/789: dread db/d14/d32/d49/da4/f60 [0,4194304] 0 2024-09-18T21:13:03.934 INFO:tasks.workunit.client.1.smithi103.stdout:1/849: dread d0/d2/d2b/d3a/d42/d72/db0/f7f [0,4194304] 0 2024-09-18T21:13:03.935 INFO:tasks.workunit.client.0.smithi077.stdout:7/875: creat d12/d22/daa/dc0/f12e x:0 0 0 2024-09-18T21:13:03.938 INFO:tasks.workunit.client.0.smithi077.stdout:9/774: rename d1/dd/d11/d2d/d59/de1 to d1/dd/d11/d1c/d38/d46/d55/d7f/d10c 0 2024-09-18T21:13:03.942 INFO:tasks.workunit.client.1.smithi103.stdout:7/898: rename d1/df/d42/f1e to d1/df/d42/d1f/d2e/f130 0 2024-09-18T21:13:03.942 INFO:tasks.workunit.client.0.smithi077.stdout:1/755: link d3/d8/d49/d4e/d5a/c87 d3/d8/d93/dd3/dc1/cfe 0 2024-09-18T21:13:03.945 INFO:tasks.workunit.client.0.smithi077.stdout:6/770: unlink d7/d7e/d11/d3e/d42/d88/f90 0 2024-09-18T21:13:03.947 INFO:tasks.workunit.client.0.smithi077.stdout:8/760: link d2/d5f/da8/d20/cb1 d2/d27/d29/d72/d81/c10e 0 2024-09-18T21:13:03.948 INFO:tasks.workunit.client.1.smithi103.stdout:3/917: rmdir d1/d2/d18/d30/d4e/db1/d10e/d114/d4f/d58/d68/d50/d54/d8c/d107 0 2024-09-18T21:13:03.952 INFO:tasks.workunit.client.1.smithi103.stdout:9/908: rename f1 to d18/d52/d6f/d8e/d8f/dbd/df1/dfe/d117/f12a 0 2024-09-18T21:13:03.954 INFO:tasks.workunit.client.0.smithi077.stdout:9/775: creat d1/dd/d11/d1c/d38/d46/d55/d7f/f10d x:0 0 0 2024-09-18T21:13:03.955 INFO:tasks.workunit.client.1.smithi103.stdout:7/899: symlink d1/df/d42/d1f/d5d/l131 0 2024-09-18T21:13:03.956 INFO:tasks.workunit.client.0.smithi077.stdout:9/776: dread - d1/dd/d11/d1c/d38/d46/d55/d7f/d10c/f101 zero size 2024-09-18T21:13:03.956 INFO:tasks.workunit.client.1.smithi103.stdout:8/997: link d4/d2d/d87/c12f d4/de/c13a 0 2024-09-18T21:13:03.961 INFO:tasks.workunit.client.1.smithi103.stdout:3/918: mkdir d1/d2/d18/d30/d4e/db1/d10e/d114/d4f/d58/d68/d50/d54/d8c/d115 0 2024-09-18T21:13:03.961 INFO:tasks.workunit.client.0.smithi077.stdout:1/756: dwrite d3/d8/d13/f14 [4194304,4194304] 0 2024-09-18T21:13:03.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:03 smithi077 ceph-mon[27689]: Reconfiguring node-exporter.smithi077 (dependencies changed)... 2024-09-18T21:13:03.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:03 smithi077 ceph-mon[27689]: Reconfiguring daemon node-exporter.smithi077 on smithi077 2024-09-18T21:13:03.965 INFO:tasks.workunit.client.1.smithi103.stdout:5/941: rename de/d3e/d85/ffe to de/d1f/d3b/d58/dc4/d9c/f138 0 2024-09-18T21:13:03.967 INFO:tasks.workunit.client.0.smithi077.stdout:8/761: creat d2/d5/d6/d9f/f10f x:0 0 0 2024-09-18T21:13:03.969 INFO:tasks.workunit.client.0.smithi077.stdout:3/790: creat db/d14/d32/d49/d4e/d6a/dec/ff2 x:0 0 0 2024-09-18T21:13:03.970 INFO:tasks.workunit.client.0.smithi077.stdout:3/791: stat db/d14/d32/d49/da4/d71/f3e 0 2024-09-18T21:13:03.970 INFO:tasks.workunit.client.1.smithi103.stdout:1/850: creat d0/d11/f12c x:0 0 0 2024-09-18T21:13:03.971 INFO:tasks.workunit.client.1.smithi103.stdout:7/900: truncate d1/df/d43/d63/fd1 586030 0 2024-09-18T21:13:03.972 INFO:tasks.workunit.client.0.smithi077.stdout:4/818: write d3/dc/d51/f80 [743988,4932] 0 2024-09-18T21:13:03.972 INFO:tasks.workunit.client.1.smithi103.stdout:0/856: write d1/d5/de/d19/fef [514147,81085] 0 2024-09-18T21:13:03.976 INFO:tasks.workunit.client.1.smithi103.stdout:7/901: read d1/df/d42/d29/d48/dbb/d33/f6f [1274594,69431] 0 2024-09-18T21:13:03.977 INFO:tasks.workunit.client.0.smithi077.stdout:6/771: dread d7/d7e/d11/d3e/d42/dbb/d4c/f86 [0,4194304] 0 2024-09-18T21:13:03.982 INFO:tasks.workunit.client.0.smithi077.stdout:4/819: dwrite d3/dc/d51/f80 [0,4194304] 0 2024-09-18T21:13:03.988 INFO:tasks.workunit.client.1.smithi103.stdout:9/909: creat d18/d52/d6f/db9/de0/de7/f12b x:0 0 0 2024-09-18T21:13:03.988 INFO:tasks.workunit.client.0.smithi077.stdout:1/757: dread d3/d6a/d9b/f5b [0,4194304] 0 2024-09-18T21:13:03.988 INFO:tasks.workunit.client.1.smithi103.stdout:6/918: write d2/d3/d8/d4c/d79/fd1 [1477189,112144] 0 2024-09-18T21:13:03.989 INFO:tasks.workunit.client.0.smithi077.stdout:7/876: rmdir d12/d31/d77/d93/d89/d94/d126 0 2024-09-18T21:13:03.989 INFO:tasks.workunit.client.1.smithi103.stdout:9/910: chown d18/d29/fcf 1441 1 2024-09-18T21:13:03.990 INFO:tasks.workunit.client.0.smithi077.stdout:2/856: dwrite d1/d4/d9/d4f/ff0 [4194304,4194304] 0 2024-09-18T21:13:03.992 INFO:tasks.workunit.client.1.smithi103.stdout:2/834: write d3/d5/d2f/d32/f7d [389803,39278] 0 2024-09-18T21:13:03.993 INFO:tasks.workunit.client.0.smithi077.stdout:5/864: dwrite d0/df/d10/d5c/d74/d89/fcb [0,4194304] 0 2024-09-18T21:13:03.993 INFO:tasks.workunit.client.0.smithi077.stdout:4/820: dread d3/d77/de5/feb [0,4194304] 0 2024-09-18T21:13:03.994 INFO:tasks.workunit.client.0.smithi077.stdout:4/821: readlink d3/dc/la5 0 2024-09-18T21:13:03.994 INFO:tasks.workunit.client.0.smithi077.stdout:5/865: fsync d0/df/d10/d4b/d80/fec 0 2024-09-18T21:13:03.996 INFO:tasks.workunit.client.0.smithi077.stdout:0/874: getdents d8/d26 0 2024-09-18T21:13:03.998 INFO:tasks.workunit.client.0.smithi077.stdout:9/777: mknod d1/dd/d11/d1c/dd7/c10e 0 2024-09-18T21:13:03.998 INFO:tasks.workunit.client.0.smithi077.stdout:2/857: write d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d83/dba/dcd/f10e [944671,79219] 0 2024-09-18T21:13:03.999 INFO:tasks.workunit.client.1.smithi103.stdout:0/857: fdatasync d1/d5/de/d24/d43/d81/fb2 0 2024-09-18T21:13:04.001 INFO:tasks.workunit.client.1.smithi103.stdout:7/902: rmdir d1/df/d42/d29/d48/ddb 39 2024-09-18T21:13:04.006 INFO:tasks.workunit.client.1.smithi103.stdout:0/858: dwrite d1/fd [0,4194304] 0 2024-09-18T21:13:04.007 INFO:tasks.workunit.client.0.smithi077.stdout:6/772: truncate d7/d7e/d11/d3e/d42/d88/da4/fb1 596423 0 2024-09-18T21:13:04.008 INFO:tasks.workunit.client.1.smithi103.stdout:6/919: symlink d2/d3/d7f/l123 0 2024-09-18T21:13:04.016 INFO:tasks.workunit.client.0.smithi077.stdout:7/877: creat d12/d31/d77/d93/d2a/f12f x:0 0 0 2024-09-18T21:13:04.019 INFO:tasks.workunit.client.1.smithi103.stdout:2/835: rmdir d3/d5/d2f/d32/dfc 39 2024-09-18T21:13:04.021 INFO:tasks.workunit.client.0.smithi077.stdout:0/875: symlink d8/d10b/l11a 0 2024-09-18T21:13:04.024 INFO:tasks.workunit.client.1.smithi103.stdout:8/998: write d4/d81/dd7/f109 [1587012,52077] 0 2024-09-18T21:13:04.025 INFO:tasks.workunit.client.0.smithi077.stdout:2/858: truncate d1/d4/d5/d1a/d113/d81/dc4/fb8 823908 0 2024-09-18T21:13:04.027 INFO:tasks.workunit.client.0.smithi077.stdout:3/792: write db/d14/d32/d49/da4/d8a/fa7 [785026,94035] 0 2024-09-18T21:13:04.030 INFO:tasks.workunit.client.0.smithi077.stdout:7/878: stat d12/d22/daa/dc0/dac/dad/cd1 0 2024-09-18T21:13:04.031 INFO:tasks.workunit.client.1.smithi103.stdout:3/919: dwrite d1/d2/d18/d30/d4e/db1/d10e/d114/d4f/d58/d68/d50/d54/f9d [0,4194304] 0 2024-09-18T21:13:04.032 INFO:tasks.workunit.client.0.smithi077.stdout:4/822: rename d3/d7/c2f to d3/dc/d24/d105/c107 0 2024-09-18T21:13:04.033 INFO:tasks.workunit.client.1.smithi103.stdout:5/942: dwrite de/d1f/d3b/d58/dc4/d9c/ff0 [0,4194304] 0 2024-09-18T21:13:04.034 INFO:tasks.workunit.client.1.smithi103.stdout:7/903: dread d1/df/d42/d29/d48/dbb/d33/fae [0,4194304] 0 2024-09-18T21:13:04.040 INFO:tasks.workunit.client.1.smithi103.stdout:8/999: rmdir d4/d2d/d4e/d73 39 2024-09-18T21:13:04.040 INFO:tasks.workunit.client.1.smithi103.stdout:0/859: symlink d1/d5/de/dc0/d8c/dce/l12b 0 2024-09-18T21:13:04.040 INFO:tasks.workunit.client.0.smithi077.stdout:2/859: fsync d1/f1c 0 2024-09-18T21:13:04.041 INFO:tasks.workunit.client.1.smithi103.stdout:3/920: dread d1/d64/f95 [0,4194304] 0 2024-09-18T21:13:04.042 INFO:tasks.workunit.client.0.smithi077.stdout:1/758: dwrite d3/d6a/f81 [0,4194304] 0 2024-09-18T21:13:04.043 INFO:tasks.workunit.client.1.smithi103.stdout:3/921: readlink d1/da/l10 0 2024-09-18T21:13:04.043 INFO:tasks.workunit.client.1.smithi103.stdout:6/920: truncate d2/d3/f48 2781145 0 2024-09-18T21:13:04.044 INFO:tasks.workunit.client.1.smithi103.stdout:3/922: fdatasync d1/d2/fb 0 2024-09-18T21:13:04.044 INFO:tasks.workunit.client.0.smithi077.stdout:1/759: fsync d3/d8/f59 0 2024-09-18T21:13:04.045 INFO:tasks.workunit.client.1.smithi103.stdout:1/851: dwrite d0/d2/d9/d9e/d7a/dd0/df9/f29 [0,4194304] 0 2024-09-18T21:13:04.045 INFO:tasks.workunit.client.0.smithi077.stdout:3/793: mkdir db/d14/d32/d49/da4/d71/d3b/df3 0 2024-09-18T21:13:04.046 INFO:tasks.workunit.client.1.smithi103.stdout:6/921: write d2/d24/f108 [2052390,113685] 0 2024-09-18T21:13:04.047 INFO:tasks.workunit.client.0.smithi077.stdout:7/879: rmdir d12/d31/d77/d93/d2a/d6c 39 2024-09-18T21:13:04.048 INFO:tasks.workunit.client.1.smithi103.stdout:9/911: write d18/d29/d68/d92/d9c/fb8 [261385,79867] 0 2024-09-18T21:13:04.051 INFO:tasks.workunit.client.0.smithi077.stdout:4/823: creat d3/dc/d24/f108 x:0 0 0 2024-09-18T21:13:04.052 INFO:tasks.workunit.client.1.smithi103.stdout:2/836: write d3/d5/d2f/d48/dab/fd3 [967518,97976] 0 2024-09-18T21:13:04.053 INFO:tasks.workunit.client.1.smithi103.stdout:5/943: dread - de/d1f/d3b/d51/d57/d79/d8d/ff4 zero size 2024-09-18T21:13:04.053 INFO:tasks.workunit.client.1.smithi103.stdout:7/904: dread - d1/df/d42/d29/d48/dbb/d33/fa1 zero size 2024-09-18T21:13:04.054 INFO:tasks.workunit.client.0.smithi077.stdout:3/794: dwrite db/ff [0,4194304] 0 2024-09-18T21:13:04.055 INFO:tasks.workunit.client.0.smithi077.stdout:5/866: link d0/df/d10/d5c/d74/led d0/df/d10/d5c/d74/d89/l11d 0 2024-09-18T21:13:04.055 INFO:tasks.workunit.client.1.smithi103.stdout:0/860: unlink d1/d5/de/d24/d43/d76/lfa 0 2024-09-18T21:13:04.056 INFO:tasks.workunit.client.1.smithi103.stdout:2/837: stat d3/d5/d2c/d54 0 2024-09-18T21:13:04.056 INFO:tasks.workunit.client.1.smithi103.stdout:3/923: dread d1/da/f6b [4194304,4194304] 0 2024-09-18T21:13:04.056 INFO:tasks.workunit.client.1.smithi103.stdout:5/944: stat de/d3e/d85/caf 0 2024-09-18T21:13:04.057 INFO:tasks.workunit.client.1.smithi103.stdout:1/852: dread d0/d2/d2b/d3a/d42/d72/db0/f6b [0,4194304] 0 2024-09-18T21:13:04.058 INFO:tasks.workunit.client.1.smithi103.stdout:4/993: sync 2024-09-18T21:13:04.059 INFO:tasks.workunit.client.1.smithi103.stdout:4/994: stat d9/d1c/db1 0 2024-09-18T21:13:04.060 INFO:tasks.workunit.client.0.smithi077.stdout:6/773: creat d7/d7e/d11/d3e/f106 x:0 0 0 2024-09-18T21:13:04.062 INFO:tasks.workunit.client.1.smithi103.stdout:5/945: chown de/d1f/d3b/d58/dc4/d33/d4f/da6/f137 358 1 2024-09-18T21:13:04.062 INFO:tasks.workunit.client.1.smithi103.stdout:1/853: write d0/d2/fca [843572,119257] 0 2024-09-18T21:13:04.062 INFO:tasks.workunit.client.1.smithi103.stdout:9/912: creat d18/da4/f12c x:0 0 0 2024-09-18T21:13:04.062 INFO:tasks.workunit.client.0.smithi077.stdout:3/795: dwrite db/d14/d22/d36/f73 [0,4194304] 0 2024-09-18T21:13:04.063 INFO:tasks.workunit.client.1.smithi103.stdout:7/905: creat d1/df/d42/d29/f132 x:0 0 0 2024-09-18T21:13:04.065 INFO:tasks.workunit.client.1.smithi103.stdout:0/861: symlink d1/d5/de/dc0/db0/l12c 0 2024-09-18T21:13:04.067 INFO:tasks.workunit.client.0.smithi077.stdout:7/880: dread - d12/d31/d77/d93/d2a/d7f/fe4 zero size 2024-09-18T21:13:04.069 INFO:tasks.workunit.client.0.smithi077.stdout:4/824: unlink d3/d77/d9c/fdb 0 2024-09-18T21:13:04.069 INFO:tasks.workunit.client.1.smithi103.stdout:2/838: dwrite d3/d5/d2c/d77/d9c/fc8 [0,4194304] 0 2024-09-18T21:13:04.071 INFO:tasks.workunit.client.1.smithi103.stdout:4/995: mknod d9/d1c/db1/c146 0 2024-09-18T21:13:04.071 INFO:tasks.workunit.client.1.smithi103.stdout:6/922: mknod d2/d3/d8/de2/c124 0 2024-09-18T21:13:04.072 INFO:tasks.workunit.client.0.smithi077.stdout:7/881: dread d12/f24 [4194304,4194304] 0 2024-09-18T21:13:04.073 INFO:tasks.workunit.client.0.smithi077.stdout:2/860: mknod d1/d4/d5/d1a/d2e/d41/c123 0 2024-09-18T21:13:04.074 INFO:tasks.workunit.client.1.smithi103.stdout:3/924: rename d1/d2/d18/d30/d4e/db1/d105 to d1/d2/d18/d30/d4e/db1/d10e/d114/d4f/d72/d85/d93/d116 0 2024-09-18T21:13:04.074 INFO:tasks.workunit.client.0.smithi077.stdout:6/774: readlink d7/d7e/d11/d3e/d42/la3 0 2024-09-18T21:13:04.075 INFO:tasks.workunit.client.1.smithi103.stdout:1/854: chown d0/d2/d2b/d3a/d42/l5a 26513323 1 2024-09-18T21:13:04.078 INFO:tasks.workunit.client.1.smithi103.stdout:7/906: unlink d1/df/dbf/d127/fc9 0 2024-09-18T21:13:04.081 INFO:tasks.workunit.client.1.smithi103.stdout:2/839: dread d3/d110/d11a/f8e [0,4194304] 0 2024-09-18T21:13:04.081 INFO:tasks.workunit.client.1.smithi103.stdout:2/840: chown d3/d5/d2f/d48/dab/fb5 42 1 2024-09-18T21:13:04.082 INFO:tasks.workunit.client.0.smithi077.stdout:5/867: creat d0/d6/d3b/d64/d67/f11e x:0 0 0 2024-09-18T21:13:04.082 INFO:tasks.workunit.client.0.smithi077.stdout:9/778: write d1/d54/d27/f39 [1679423,113212] 0 2024-09-18T21:13:04.084 INFO:tasks.workunit.client.0.smithi077.stdout:9/779: truncate d1/ff4 189724 0 2024-09-18T21:13:04.085 INFO:tasks.workunit.client.0.smithi077.stdout:7/882: creat d12/d56/f130 x:0 0 0 2024-09-18T21:13:04.086 INFO:tasks.workunit.client.0.smithi077.stdout:9/780: dread - d1/d54/d81/f8b zero size 2024-09-18T21:13:04.086 INFO:tasks.workunit.client.1.smithi103.stdout:4/996: truncate d9/d1c/d77/f59 408185 0 2024-09-18T21:13:04.087 INFO:tasks.workunit.client.1.smithi103.stdout:2/841: dwrite d3/d5/d2f/d32/d90/feb [4194304,4194304] 0 2024-09-18T21:13:04.088 INFO:tasks.workunit.client.1.smithi103.stdout:2/842: readlink d3/d5/lb6 0 2024-09-18T21:13:04.088 INFO:tasks.workunit.client.1.smithi103.stdout:4/997: write d9/d1c/d77/fbc [299544,31838] 0 2024-09-18T21:13:04.089 INFO:tasks.workunit.client.1.smithi103.stdout:2/843: readlink d3/db3/ld4 0 2024-09-18T21:13:04.089 INFO:tasks.workunit.client.0.smithi077.stdout:4/825: dwrite d3/d7/d6c/f90 [4194304,4194304] 0 2024-09-18T21:13:04.092 INFO:tasks.workunit.client.0.smithi077.stdout:4/826: write d3/dc/d24/f78 [1229065,28444] 0 2024-09-18T21:13:04.093 INFO:tasks.workunit.client.0.smithi077.stdout:3/796: fsync db/f95 0 2024-09-18T21:13:04.096 INFO:tasks.workunit.client.1.smithi103.stdout:1/855: truncate d0/d2/fc8 5128201 0 2024-09-18T21:13:04.099 INFO:tasks.workunit.client.0.smithi077.stdout:0/876: truncate d8/f2d 1575437 0 2024-09-18T21:13:04.104 INFO:tasks.workunit.client.0.smithi077.stdout:7/883: truncate d12/d31/f7e 3866890 0 2024-09-18T21:13:04.105 INFO:tasks.workunit.client.1.smithi103.stdout:4/998: creat d9/d1c/db1/f147 x:0 0 0 2024-09-18T21:13:04.106 INFO:tasks.workunit.client.1.smithi103.stdout:2/844: creat d3/d110/f124 x:0 0 0 2024-09-18T21:13:04.106 INFO:tasks.workunit.client.1.smithi103.stdout:9/913: link d18/d29/l69 d18/d52/d6f/d8e/df7/l12d 0 2024-09-18T21:13:04.110 INFO:tasks.workunit.client.0.smithi077.stdout:4/827: stat d3/dc/d24/d105/c107 0 2024-09-18T21:13:04.111 INFO:tasks.workunit.client.1.smithi103.stdout:3/925: mknod d1/d2/d18/d30/d4e/db1/d10e/d114/d4f/d58/d68/d50/d54/d8c/d115/c117 0 2024-09-18T21:13:04.111 INFO:tasks.workunit.client.0.smithi077.stdout:6/775: mknod d7/d7e/d11/d3e/d42/d88/da4/d102/c107 0 2024-09-18T21:13:04.113 INFO:tasks.workunit.client.0.smithi077.stdout:6/776: chown d7/d7e/d11/d3e/d42/dbb/d50/lfa 60952476 1 2024-09-18T21:13:04.113 INFO:tasks.workunit.client.0.smithi077.stdout:1/760: getdents d3/d8/d49/d4e/dbd 0 2024-09-18T21:13:04.114 INFO:tasks.workunit.client.0.smithi077.stdout:6/777: write d7/d7e/f36 [4036229,13369] 0 2024-09-18T21:13:04.115 INFO:tasks.workunit.client.0.smithi077.stdout:1/761: chown d3/d8/d13/d77/c7c 1 1 2024-09-18T21:13:04.116 INFO:tasks.workunit.client.0.smithi077.stdout:6/778: chown d7/d7e/d11/caa 241749680 1 2024-09-18T21:13:04.116 INFO:tasks.workunit.client.0.smithi077.stdout:1/762: write d3/d8/d13/f1f [1183495,62271] 0 2024-09-18T21:13:04.117 INFO:tasks.workunit.client.1.smithi103.stdout:2/845: mknod d3/d5/d2c/c125 0 2024-09-18T21:13:04.118 INFO:tasks.workunit.client.1.smithi103.stdout:2/846: fdatasync d3/d5/d2c/d54/d68/f11e 0 2024-09-18T21:13:04.119 INFO:tasks.workunit.client.1.smithi103.stdout:9/914: symlink d18/d52/d6f/df8/d105/l12e 0 2024-09-18T21:13:04.121 INFO:tasks.workunit.client.0.smithi077.stdout:5/868: dread d0/d6/daa/fb8 [0,4194304] 0 2024-09-18T21:13:04.122 INFO:tasks.workunit.client.0.smithi077.stdout:5/869: readlink d0/d6/d3b/l59 0 2024-09-18T21:13:04.122 INFO:tasks.workunit.client.0.smithi077.stdout:3/797: dread db/d14/d32/d49/da4/d8a/ddd/fed [0,4194304] 0 2024-09-18T21:13:04.122 INFO:tasks.workunit.client.0.smithi077.stdout:4/828: symlink d3/d77/de5/l109 0 2024-09-18T21:13:04.123 INFO:tasks.workunit.client.1.smithi103.stdout:0/862: write d1/d9/f52 [1730896,7366] 0 2024-09-18T21:13:04.123 INFO:tasks.workunit.client.1.smithi103.stdout:1/856: symlink d0/d2/d2b/d3a/l12d 0 2024-09-18T21:13:04.124 INFO:tasks.workunit.client.0.smithi077.stdout:4/829: dread - d3/dc/d32/d45/d5e/f101 zero size 2024-09-18T21:13:04.125 INFO:tasks.workunit.client.1.smithi103.stdout:3/926: mknod d1/d2/d18/d30/d4e/d62/c118 0 2024-09-18T21:13:04.126 INFO:tasks.workunit.client.1.smithi103.stdout:3/927: chown d1/d2/d18/d30/d4e/db1/d10e/d114/d4f/d72/d7e/l96 65841666 1 2024-09-18T21:13:04.127 INFO:tasks.workunit.client.1.smithi103.stdout:6/923: write d2/d3/d8/f2d [2432308,53217] 0 2024-09-18T21:13:04.130 INFO:tasks.workunit.client.1.smithi103.stdout:6/924: truncate d2/d3/d8/de1/dfe/f120 299529 0 2024-09-18T21:13:04.130 INFO:tasks.workunit.client.0.smithi077.stdout:6/779: fdatasync d7/d7e/f32 0 2024-09-18T21:13:04.130 INFO:tasks.workunit.client.0.smithi077.stdout:4/830: dwrite d3/dc/d32/d45/faa [8388608,4194304] 0 2024-09-18T21:13:04.131 INFO:tasks.workunit.client.1.smithi103.stdout:2/847: creat d3/d5/d2c/f126 x:0 0 0 2024-09-18T21:13:04.132 INFO:tasks.workunit.client.1.smithi103.stdout:6/925: fsync d2/d24/d5a/d67/d76/d43/f101 0 2024-09-18T21:13:04.133 INFO:tasks.workunit.client.1.smithi103.stdout:3/928: dwrite d1/d2/d18/d30/d4e/db1/d10e/d114/d4f/d72/d7e/feb [0,4194304] 0 2024-09-18T21:13:04.133 INFO:tasks.workunit.client.0.smithi077.stdout:1/763: write d3/d38/f60 [2956466,41859] 0 2024-09-18T21:13:04.134 INFO:tasks.workunit.client.0.smithi077.stdout:4/831: dread - d3/dc/d32/d45/fd1 zero size 2024-09-18T21:13:04.136 INFO:tasks.workunit.client.1.smithi103.stdout:3/929: fdatasync d1/d2/d18/d30/d4e/db1/d10e/d114/d4f/d58/d86/fdc 0 2024-09-18T21:13:04.139 INFO:tasks.workunit.client.0.smithi077.stdout:2/861: dwrite d1/d4/d9/f65 [0,4194304] 0 2024-09-18T21:13:04.139 INFO:tasks.workunit.client.0.smithi077.stdout:4/832: write d3/dc/d20/f27 [3969753,11573] 0 2024-09-18T21:13:04.139 INFO:tasks.workunit.client.1.smithi103.stdout:1/857: chown d0/d2/l12b 10755 1 2024-09-18T21:13:04.146 INFO:tasks.workunit.client.1.smithi103.stdout:3/930: dwrite d1/d2/d18/d30/d4e/db1/d10e/d114/d4f/d58/d68/d50/d54/ded/f108 [0,4194304] 0 2024-09-18T21:13:04.148 INFO:tasks.workunit.client.0.smithi077.stdout:3/798: creat db/d14/d22/d36/d39/ff4 x:0 0 0 2024-09-18T21:13:04.150 INFO:tasks.workunit.client.0.smithi077.stdout:0/877: rename d8/d1d/f2b to d8/d1d/f11b 0 2024-09-18T21:13:04.153 INFO:tasks.workunit.client.1.smithi103.stdout:2/848: mknod d3/d5/d2f/d48/dab/c127 0 2024-09-18T21:13:04.155 INFO:tasks.workunit.client.1.smithi103.stdout:7/907: truncate d1/df/d43/d61/fd6 3443452 0 2024-09-18T21:13:04.155 INFO:tasks.workunit.client.1.smithi103.stdout:3/931: dwrite d1/d2/d18/d30/d4e/d62/fe7 [0,4194304] 0 2024-09-18T21:13:04.156 INFO:tasks.workunit.client.1.smithi103.stdout:6/926: creat d2/d3/d8/d4c/d7d/d9b/f125 x:0 0 0 2024-09-18T21:13:04.157 INFO:tasks.workunit.client.0.smithi077.stdout:7/884: write d12/f73 [265901,7208] 0 2024-09-18T21:13:04.160 INFO:tasks.workunit.client.0.smithi077.stdout:0/878: dwrite d8/d1d/d110/f104 [0,4194304] 0 2024-09-18T21:13:04.160 INFO:tasks.workunit.client.0.smithi077.stdout:9/781: link d1/dd/d1a/fdf d1/dd/d11/d1c/d38/d46/f10f 0 2024-09-18T21:13:04.162 INFO:tasks.workunit.client.1.smithi103.stdout:0/863: fdatasync d1/d5/de/dc0/d62/fdb 0 2024-09-18T21:13:04.163 INFO:tasks.workunit.client.1.smithi103.stdout:2/849: dwrite d3/d5/d2f/d93/fa1 [0,4194304] 0 2024-09-18T21:13:04.166 INFO:tasks.workunit.client.1.smithi103.stdout:4/999: truncate d9/d38/f4c 8198080 0 2024-09-18T21:13:04.166 INFO:tasks.workunit.client.0.smithi077.stdout:9/782: dread d1/d54/f12 [0,4194304] 0 2024-09-18T21:13:04.167 INFO:tasks.workunit.client.0.smithi077.stdout:4/833: mknod d3/dc/d32/d45/c10a 0 2024-09-18T21:13:04.168 INFO:tasks.workunit.client.0.smithi077.stdout:7/885: dread d12/d31/d77/d93/d2a/f82 [0,4194304] 0 2024-09-18T21:13:04.169 INFO:tasks.workunit.client.0.smithi077.stdout:5/870: readlink d0/df/d10/d5c/d9b/lb4 0 2024-09-18T21:13:04.169 INFO:tasks.workunit.client.1.smithi103.stdout:0/864: read d1/d5/f6 [5257482,103270] 0 2024-09-18T21:13:04.169 INFO:tasks.workunit.client.1.smithi103.stdout:3/932: read d1/d2/d18/d30/d4e/db1/d10e/d114/da1/fbe [831918,63909] 0 2024-09-18T21:13:04.170 INFO:tasks.workunit.client.0.smithi077.stdout:9/783: write d1/dd/d11/d72/f98 [746613,44534] 0 2024-09-18T21:13:04.170 INFO:tasks.workunit.client.0.smithi077.stdout:4/834: write d3/dc/d32/fd3 [311343,18287] 0 2024-09-18T21:13:04.173 INFO:tasks.workunit.client.1.smithi103.stdout:9/915: dread d18/d52/d6f/f81 [0,4194304] 0 2024-09-18T21:13:04.175 INFO:tasks.workunit.client.1.smithi103.stdout:3/933: write d1/d2/d18/d30/d4e/db1/d10e/d114/d4f/d58/f6d [852873,76194] 0 2024-09-18T21:13:04.178 INFO:tasks.workunit.client.1.smithi103.stdout:3/934: chown d1/d2/d18/d30/d4e/db1/d10e/d114/d4f/d72 21411 1 2024-09-18T21:13:04.178 INFO:tasks.workunit.client.1.smithi103.stdout:3/935: stat d1/da/df/lbf 0 2024-09-18T21:13:04.179 INFO:tasks.workunit.client.1.smithi103.stdout:3/936: chown d1/d64/f110 3 1 2024-09-18T21:13:04.180 INFO:tasks.workunit.client.1.smithi103.stdout:3/937: write d1/da/df/f19 [388296,32042] 0 2024-09-18T21:13:04.183 INFO:tasks.workunit.client.1.smithi103.stdout:3/938: write d1/d2/d18/d30/d4e/db1/d10e/d114/d4f/d58/d68/fda [539755,122612] 0 2024-09-18T21:13:04.186 INFO:tasks.workunit.client.1.smithi103.stdout:1/858: mkdir d0/d2/d9/dc/d36/d52/d12e 0 2024-09-18T21:13:04.188 INFO:tasks.workunit.client.0.smithi077.stdout:5/871: mkdir d0/de6/d11f 0 2024-09-18T21:13:04.188 INFO:tasks.workunit.client.1.smithi103.stdout:0/865: write d1/d9/d3e/d6e/f11c [116479,65879] 0 2024-09-18T21:13:04.189 INFO:tasks.workunit.client.0.smithi077.stdout:5/872: dread - d0/d6/dd/d5d/ff3 zero size 2024-09-18T21:13:04.189 INFO:tasks.workunit.client.0.smithi077.stdout:5/873: stat d0/d6/d3b/l59 0 2024-09-18T21:13:04.190 INFO:tasks.workunit.client.0.smithi077.stdout:5/874: chown d0/df/d10/l23 12584870 1 2024-09-18T21:13:04.194 INFO:tasks.workunit.client.1.smithi103.stdout:7/908: dread d1/df/f22 [0,4194304] 0 2024-09-18T21:13:04.194 INFO:tasks.workunit.client.1.smithi103.stdout:9/916: symlink d18/d52/d6f/d8e/d8f/db5/l12f 0 2024-09-18T21:13:04.196 INFO:tasks.workunit.client.0.smithi077.stdout:9/784: creat d1/dd/d11/d2d/d59/dfc/f110 x:0 0 0 2024-09-18T21:13:04.197 INFO:tasks.workunit.client.1.smithi103.stdout:5/946: sync 2024-09-18T21:13:04.198 INFO:tasks.workunit.client.1.smithi103.stdout:5/947: chown de/d3e/f17 4929 1 2024-09-18T21:13:04.199 INFO:tasks.workunit.client.1.smithi103.stdout:5/948: write de/d1f/d3b/d3c/fc6 [441036,68004] 0 2024-09-18T21:13:04.200 INFO:tasks.workunit.client.0.smithi077.stdout:6/780: truncate d7/d7e/d11/f56 1745166 0 2024-09-18T21:13:04.202 INFO:tasks.workunit.client.1.smithi103.stdout:6/927: dread d2/d24/d38/d68/dac/fc6 [0,4194304] 0 2024-09-18T21:13:04.204 INFO:tasks.workunit.client.1.smithi103.stdout:1/859: symlink d0/d2/d2b/d3a/d42/d72/db0/l12f 0 2024-09-18T21:13:04.205 INFO:tasks.workunit.client.0.smithi077.stdout:0/879: mkdir d8/d1a/d39/d11c 0 2024-09-18T21:13:04.206 INFO:tasks.workunit.client.1.smithi103.stdout:6/928: dread d2/d24/d38/d68/dac/fc6 [0,4194304] 0 2024-09-18T21:13:04.207 INFO:tasks.workunit.client.0.smithi077.stdout:1/764: link d3/d6a/d9b/dbe/fdf d3/d8/d49/d4e/d5a/fff 0 2024-09-18T21:13:04.209 INFO:tasks.workunit.client.1.smithi103.stdout:0/866: dread d1/d5/de/d24/d43/dfd/f126 [0,4194304] 0 2024-09-18T21:13:04.209 INFO:tasks.workunit.client.1.smithi103.stdout:7/909: mkdir d1/df/d54/d133 0 2024-09-18T21:13:04.210 INFO:tasks.workunit.client.0.smithi077.stdout:4/835: mkdir d3/d7/d42/d10b 0 2024-09-18T21:13:04.211 INFO:tasks.workunit.client.0.smithi077.stdout:4/836: dread - d3/d7/d42/dd8/fda zero size 2024-09-18T21:13:04.212 INFO:tasks.workunit.client.0.smithi077.stdout:4/837: chown d3/ffe 305928 1 2024-09-18T21:13:04.212 INFO:tasks.workunit.client.0.smithi077.stdout:7/886: mknod d12/d22/daa/dc0/dac/dad/d12d/c131 0 2024-09-18T21:13:04.213 INFO:tasks.workunit.client.1.smithi103.stdout:5/949: mkdir de/d1f/d3b/d51/d57/dc8/de8/d139 0 2024-09-18T21:13:04.215 INFO:tasks.workunit.client.0.smithi077.stdout:9/785: creat d1/dd/d11/d1c/dd7/f111 x:0 0 0 2024-09-18T21:13:04.215 INFO:tasks.workunit.client.1.smithi103.stdout:3/939: truncate d1/d2/d18/d30/d4e/db1/d10e/d114/da1/fbe 1383152 0 2024-09-18T21:13:04.216 INFO:tasks.workunit.client.0.smithi077.stdout:9/786: readlink d1/dd/d1a/l40 0 2024-09-18T21:13:04.217 INFO:tasks.workunit.client.1.smithi103.stdout:9/917: dread d18/d8d/d2f/f65 [4194304,4194304] 0 2024-09-18T21:13:04.217 INFO:tasks.workunit.client.0.smithi077.stdout:2/862: mknod d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d8e/c124 0 2024-09-18T21:13:04.217 INFO:tasks.workunit.client.0.smithi077.stdout:9/787: truncate d1/dd/d11/d2d/d59/fb4 182413 0 2024-09-18T21:13:04.218 INFO:tasks.workunit.client.0.smithi077.stdout:3/799: link db/d14/d93/la5 db/d14/d32/d49/da4/d8a/d99/daf/de6/lf5 0 2024-09-18T21:13:04.224 INFO:tasks.workunit.client.0.smithi077.stdout:0/880: dread d8/d1a/f51 [0,4194304] 0 2024-09-18T21:13:04.225 INFO:tasks.workunit.client.0.smithi077.stdout:6/781: dread d7/d7e/d11/d3e/d42/d88/da4/fb1 [0,4194304] 0 2024-09-18T21:13:04.226 INFO:tasks.workunit.client.0.smithi077.stdout:9/788: dwrite d1/dd/d11/d1c/f53 [0,4194304] 0 2024-09-18T21:13:04.226 INFO:tasks.workunit.client.0.smithi077.stdout:1/765: rename d3/f10 to d3/d38/d97/dea/f100 0 2024-09-18T21:13:04.233 INFO:tasks.workunit.client.1.smithi103.stdout:0/867: mknod d1/d5/de/d24/d43/d76/c12d 0 2024-09-18T21:13:04.234 INFO:tasks.workunit.client.1.smithi103.stdout:6/929: dwrite d2/d24/d5a/d67/d76/d43/d44/f6e [4194304,4194304] 0 2024-09-18T21:13:04.237 INFO:tasks.workunit.client.1.smithi103.stdout:5/950: readlink de/d3e/lc5 0 2024-09-18T21:13:04.237 INFO:tasks.workunit.client.1.smithi103.stdout:6/930: chown d2/d3/f74 3556 1 2024-09-18T21:13:04.237 INFO:tasks.workunit.client.1.smithi103.stdout:2/850: getdents d3/d5/d2f/d32/d90 0 2024-09-18T21:13:04.239 INFO:tasks.workunit.client.0.smithi077.stdout:0/881: read - d8/d1a/fdc zero size 2024-09-18T21:13:04.240 INFO:tasks.workunit.client.1.smithi103.stdout:7/910: dread d1/df/d42/f26 [4194304,4194304] 0 2024-09-18T21:13:04.241 INFO:tasks.workunit.client.1.smithi103.stdout:7/911: truncate d1/df/dc7/f108 312292 0 2024-09-18T21:13:04.242 INFO:tasks.workunit.client.1.smithi103.stdout:9/918: rename d18/d52/f121 to d18/d8d/d2f/ddd/f130 0 2024-09-18T21:13:04.246 INFO:tasks.workunit.client.0.smithi077.stdout:6/782: creat d7/d7e/d11/d3e/d42/dbb/d31/f108 x:0 0 0 2024-09-18T21:13:04.246 INFO:tasks.workunit.client.0.smithi077.stdout:6/783: chown d7/d7e/da6 2 1 2024-09-18T21:13:04.247 INFO:tasks.workunit.client.0.smithi077.stdout:5/875: truncate d0/fbf 3344115 0 2024-09-18T21:13:04.249 INFO:tasks.workunit.client.0.smithi077.stdout:3/800: dread db/d14/d22/d36/f73 [4194304,4194304] 0 2024-09-18T21:13:04.249 INFO:tasks.workunit.client.1.smithi103.stdout:0/868: mkdir d1/d9/d3e/d6e/d12e 0 2024-09-18T21:13:04.251 INFO:tasks.workunit.client.1.smithi103.stdout:0/869: chown d1/d9/d3e/dfc/f116 1 1 2024-09-18T21:13:04.252 INFO:tasks.workunit.client.0.smithi077.stdout:4/838: mkdir d3/d77/d9c/db6/d10c 0 2024-09-18T21:13:04.252 INFO:tasks.workunit.client.0.smithi077.stdout:3/801: write db/d14/d32/d49/da4/d8a/d99/daf/fb0 [2635829,26449] 0 2024-09-18T21:13:04.252 INFO:tasks.workunit.client.0.smithi077.stdout:3/802: chown db/d14/d22/f2f 170895946 1 2024-09-18T21:13:04.252 INFO:tasks.workunit.client.0.smithi077.stdout:2/863: symlink d1/d4/d5/d1a/d113/d81/d122/l125 0 2024-09-18T21:13:04.253 INFO:tasks.workunit.client.1.smithi103.stdout:1/860: write d0/d2/fc8 [1973990,68347] 0 2024-09-18T21:13:04.254 INFO:tasks.workunit.client.1.smithi103.stdout:2/851: unlink d3/d110/d11a/f33 0 2024-09-18T21:13:04.255 INFO:tasks.workunit.client.0.smithi077.stdout:0/882: fdatasync d8/d1a/d39/f86 0 2024-09-18T21:13:04.262 INFO:tasks.workunit.client.1.smithi103.stdout:3/940: link d1/d2/d18/d30/d4e/db1/d10e/d114/d4f/d58/d68/d50/dea/df3/ff9 d1/d2/d18/d30/d4e/db1/d10e/d114/d4f/dc6/f119 0 2024-09-18T21:13:04.262 INFO:tasks.workunit.client.0.smithi077.stdout:5/876: truncate d0/f18 4019532 0 2024-09-18T21:13:04.267 INFO:tasks.workunit.client.1.smithi103.stdout:1/861: creat d0/d2/d2b/d3a/d42/d9c/f130 x:0 0 0 2024-09-18T21:13:04.269 INFO:tasks.workunit.client.1.smithi103.stdout:2/852: fdatasync d3/d5/d4a/d56/fc7 0 2024-09-18T21:13:04.271 INFO:tasks.workunit.client.0.smithi077.stdout:6/784: dread d7/d7e/d11/d3e/d42/dbb/d49/f84 [0,4194304] 0 2024-09-18T21:13:04.273 INFO:tasks.workunit.client.0.smithi077.stdout:6/785: chown d7/d7e/d11/d3e/d42/dbb/d31/f71 943 1 2024-09-18T21:13:04.273 INFO:tasks.workunit.client.0.smithi077.stdout:9/789: creat d1/f112 x:0 0 0 2024-09-18T21:13:04.274 INFO:tasks.workunit.client.1.smithi103.stdout:6/931: write d2/d3/f55 [2865899,126261] 0 2024-09-18T21:13:04.275 INFO:tasks.workunit.client.0.smithi077.stdout:9/790: read - d1/dd/d11/d1c/d38/d46/daf/fd5 zero size 2024-09-18T21:13:04.275 INFO:tasks.workunit.client.0.smithi077.stdout:0/883: symlink d8/d1d/de3/l11d 0 2024-09-18T21:13:04.276 INFO:tasks.workunit.client.1.smithi103.stdout:0/870: symlink d1/d9/l12f 0 2024-09-18T21:13:04.276 INFO:tasks.workunit.client.0.smithi077.stdout:0/884: write d8/d37/d95/dab/ffc [7709,127652] 0 2024-09-18T21:13:04.278 INFO:tasks.workunit.client.0.smithi077.stdout:0/885: fsync d8/d37/d66/d87/de0/fcc 0 2024-09-18T21:13:04.279 INFO:tasks.workunit.client.0.smithi077.stdout:1/766: rename d3/d38/d97/f98 to d3/d8/d13/f101 0 2024-09-18T21:13:04.279 INFO:tasks.workunit.client.0.smithi077.stdout:2/864: write d1/f1d [1803855,39282] 0 2024-09-18T21:13:04.279 INFO:tasks.workunit.client.1.smithi103.stdout:3/941: rmdir d1/d2/d18/d30/d4e/db1/d10e/d114/d4f/d58/d68/d50/d54 39 2024-09-18T21:13:04.284 INFO:tasks.workunit.client.0.smithi077.stdout:3/803: symlink db/d14/d22/dae/lf6 0 2024-09-18T21:13:04.284 INFO:tasks.workunit.client.1.smithi103.stdout:7/912: dwrite d1/df/d43/d52/d95/fbc [0,4194304] 0 2024-09-18T21:13:04.291 INFO:tasks.workunit.client.1.smithi103.stdout:9/919: rename d18/d8d/d2f/l6e to d18/d29/d68/l131 0 2024-09-18T21:13:04.292 INFO:tasks.workunit.client.1.smithi103.stdout:6/932: read d2/d3/d8/d4c/f61 [923005,3809] 0 2024-09-18T21:13:04.293 INFO:tasks.workunit.client.1.smithi103.stdout:0/871: mkdir d1/d5/de/d19/d1e/d58/d130 0 2024-09-18T21:13:04.293 INFO:tasks.workunit.client.1.smithi103.stdout:6/933: fsync d2/d3/d8/f2d 0 2024-09-18T21:13:04.294 INFO:tasks.workunit.client.1.smithi103.stdout:0/872: write d1/d5/de/d19/fd2 [1405570,42968] 0 2024-09-18T21:13:04.294 INFO:tasks.workunit.client.1.smithi103.stdout:6/934: readlink d2/d3/d8/d4c/d7d/d9b/l109 0 2024-09-18T21:13:04.297 INFO:tasks.workunit.client.0.smithi077.stdout:0/886: mkdir d8/d1a/d39/d3b/d70/d11e 0 2024-09-18T21:13:04.300 INFO:tasks.workunit.client.1.smithi103.stdout:5/951: sync 2024-09-18T21:13:04.300 INFO:tasks.workunit.client.0.smithi077.stdout:5/877: creat d0/d6/d40/d107/f120 x:0 0 0 2024-09-18T21:13:04.302 INFO:tasks.workunit.client.0.smithi077.stdout:9/791: write d1/dd/d11/d1c/d38/d46/f5b [851469,52508] 0 2024-09-18T21:13:04.302 INFO:tasks.workunit.client.0.smithi077.stdout:3/804: chown db/d14/d32/d49/da4/d8a/d99/daf/de6/lf5 1349318217 1 2024-09-18T21:13:04.304 INFO:tasks.workunit.client.1.smithi103.stdout:9/920: creat d18/da4/f132 x:0 0 0 2024-09-18T21:13:04.305 INFO:tasks.workunit.client.0.smithi077.stdout:4/839: rename d3/l1d to d3/d35/db1/l10d 0 2024-09-18T21:13:04.307 INFO:tasks.workunit.client.0.smithi077.stdout:0/887: unlink d8/d37/dd2/c115 0 2024-09-18T21:13:04.307 INFO:tasks.workunit.client.1.smithi103.stdout:3/942: dwrite d1/d2/d18/d30/d4e/db1/d10e/d114/d4f/d58/d68/d50/dea/df3/ff9 [0,4194304] 0 2024-09-18T21:13:04.308 INFO:tasks.workunit.client.1.smithi103.stdout:1/862: truncate d0/d2/d9/d9e/d7a/dd0/df9/d68/d81/da2/da4/dc2/dd8/dae/fb4 3288751 0 2024-09-18T21:13:04.308 INFO:tasks.workunit.client.0.smithi077.stdout:2/865: symlink d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d83/dba/dfd/l126 0 2024-09-18T21:13:04.309 INFO:tasks.workunit.client.1.smithi103.stdout:1/863: readlink d0/d2/da8/ldf 0 2024-09-18T21:13:04.309 INFO:tasks.workunit.client.1.smithi103.stdout:3/943: chown d1/da/f15 4 1 2024-09-18T21:13:04.309 INFO:tasks.workunit.client.0.smithi077.stdout:5/878: creat d0/df/d10/de1/f121 x:0 0 0 2024-09-18T21:13:04.313 INFO:tasks.workunit.client.0.smithi077.stdout:6/786: rename d7/d7e/d11/d3e/d42/d88/da4/de7/l9d to d7/d7e/d11/d3e/d42/dbb/d50/dd5/l109 0 2024-09-18T21:13:04.314 INFO:tasks.workunit.client.1.smithi103.stdout:7/913: mkdir d1/df/d42/d134 0 2024-09-18T21:13:04.317 INFO:tasks.workunit.client.0.smithi077.stdout:0/888: dread - d8/d1a/d35/fb9 zero size 2024-09-18T21:13:04.320 INFO:tasks.workunit.client.0.smithi077.stdout:2/866: fsync d1/d4/d5/d1a/d11e/f105 0 2024-09-18T21:13:04.322 INFO:tasks.workunit.client.1.smithi103.stdout:9/921: dread d18/d29/d68/d92/d9c/dc8/deb/ffc [0,4194304] 0 2024-09-18T21:13:04.324 INFO:tasks.workunit.client.0.smithi077.stdout:9/792: write d1/f49 [4299444,48476] 0 2024-09-18T21:13:04.325 INFO:tasks.workunit.client.0.smithi077.stdout:3/805: mknod db/d14/d32/d49/da4/d8a/d99/daf/de6/cf7 0 2024-09-18T21:13:04.325 INFO:tasks.workunit.client.0.smithi077.stdout:2/867: dread d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d95/ff5 [0,4194304] 0 2024-09-18T21:13:04.325 INFO:tasks.workunit.client.1.smithi103.stdout:1/864: stat d0/d2/d2b/d3a/c43 0 2024-09-18T21:13:04.328 INFO:tasks.workunit.client.1.smithi103.stdout:3/944: creat d1/d2/d18/d30/d4e/db1/d10e/d114/d4f/d72/d85/d93/d116/f11a x:0 0 0 2024-09-18T21:13:04.328 INFO:tasks.workunit.client.1.smithi103.stdout:3/945: readlink d1/d2/d18/d30/l39 0 2024-09-18T21:13:04.333 INFO:tasks.workunit.client.1.smithi103.stdout:3/946: dwrite d1/d2/d18/d30/d4e/db1/d10e/d114/d4f/d58/f6d [0,4194304] 0 2024-09-18T21:13:04.334 INFO:tasks.workunit.client.1.smithi103.stdout:3/947: chown d1/d2/d18/f29 2 1 2024-09-18T21:13:04.335 INFO:tasks.workunit.client.1.smithi103.stdout:3/948: write d1/d2/d18/d30/d4e/db1/d10e/f56 [784621,13796] 0 2024-09-18T21:13:04.370 INFO:tasks.workunit.client.0.smithi077.stdout:1/767: rename d3/d8/d93/dd3/d99/de8/da6/fcd to d3/d8/d49/d4e/f102 0 2024-09-18T21:13:04.371 INFO:tasks.workunit.client.1.smithi103.stdout:6/935: mknod d2/d3/d8/d4c/c126 0 2024-09-18T21:13:04.371 INFO:tasks.workunit.client.0.smithi077.stdout:4/840: mknod d3/d7/de8/c10e 0 2024-09-18T21:13:04.372 INFO:tasks.workunit.client.0.smithi077.stdout:0/889: creat d8/d1d/d110/f11f x:0 0 0 2024-09-18T21:13:04.373 INFO:tasks.workunit.client.1.smithi103.stdout:7/914: mknod d1/df/d42/d1f/d5d/d85/db0/dc5/c135 0 2024-09-18T21:13:04.374 INFO:tasks.workunit.client.0.smithi077.stdout:0/890: chown d8/d37/d66/d87/de0/l92 642525 1 2024-09-18T21:13:04.374 INFO:tasks.workunit.client.1.smithi103.stdout:7/915: readlink d1/df/l47 0 2024-09-18T21:13:04.375 INFO:tasks.workunit.client.0.smithi077.stdout:5/879: unlink d0/df/d10/d5c/c9f 0 2024-09-18T21:13:04.376 INFO:tasks.workunit.client.0.smithi077.stdout:9/793: rmdir d1/dd/d11/d15/d80 39 2024-09-18T21:13:04.378 INFO:tasks.workunit.client.0.smithi077.stdout:3/806: readlink db/d14/d32/d49/da4/d71/d3b/l4c 0 2024-09-18T21:13:04.378 INFO:tasks.workunit.client.1.smithi103.stdout:9/922: unlink d18/d29/d68/f9a 0 2024-09-18T21:13:04.379 INFO:tasks.workunit.client.0.smithi077.stdout:3/807: write db/d14/f20 [5205253,8409] 0 2024-09-18T21:13:04.379 INFO:tasks.workunit.client.1.smithi103.stdout:9/923: fdatasync d18/d29/d68/d92/d9c/fb8 0 2024-09-18T21:13:04.379 INFO:tasks.workunit.client.1.smithi103.stdout:1/865: readlink d0/d11/l75 0 2024-09-18T21:13:04.379 INFO:tasks.workunit.client.0.smithi077.stdout:6/787: mknod d7/d7e/c10a 0 2024-09-18T21:13:04.383 INFO:tasks.workunit.client.0.smithi077.stdout:1/768: fdatasync d3/d6a/d9b/f31 0 2024-09-18T21:13:04.384 INFO:tasks.workunit.client.1.smithi103.stdout:3/949: mkdir d1/d2/d18/d30/d4e/db1/d10e/d114/da1/d11b 0 2024-09-18T21:13:04.385 INFO:tasks.workunit.client.1.smithi103.stdout:6/936: chown d2/d3/l7 404702784 1 2024-09-18T21:13:04.386 INFO:tasks.workunit.client.1.smithi103.stdout:0/873: creat d1/d5/de/d19/d1e/f131 x:0 0 0 2024-09-18T21:13:04.389 INFO:tasks.workunit.client.0.smithi077.stdout:0/891: creat d8/d37/d95/f120 x:0 0 0 2024-09-18T21:13:04.389 INFO:tasks.workunit.client.1.smithi103.stdout:7/916: fsync d1/f1c 0 2024-09-18T21:13:04.391 INFO:tasks.workunit.client.1.smithi103.stdout:9/924: dread d18/d52/d6f/d8e/d8f/dbd/df1/dfe/d117/f12a [0,4194304] 0 2024-09-18T21:13:04.396 INFO:tasks.workunit.client.0.smithi077.stdout:3/808: fdatasync db/d14/d22/d36/fa2 0 2024-09-18T21:13:04.399 INFO:tasks.workunit.client.1.smithi103.stdout:3/950: mkdir d1/d2/d18/d30/d4e/db1/d10e/d114/d4f/d72/d85/d93/d11c 0 2024-09-18T21:13:04.400 INFO:tasks.workunit.client.0.smithi077.stdout:2/868: rename d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d8e/f55 to d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d83/dba/ddc/dff/f127 0 2024-09-18T21:13:04.402 INFO:tasks.workunit.client.1.smithi103.stdout:6/937: creat d2/d24/d5a/d67/d76/da4/dc7/f127 x:0 0 0 2024-09-18T21:13:04.404 INFO:tasks.workunit.client.1.smithi103.stdout:5/952: getdents de/d1f/d3b/d58 0 2024-09-18T21:13:04.404 INFO:tasks.workunit.client.0.smithi077.stdout:4/841: symlink d3/d77/d9c/db6/d10c/l10f 0 2024-09-18T21:13:04.405 INFO:tasks.workunit.client.0.smithi077.stdout:0/892: creat d8/d26/f121 x:0 0 0 2024-09-18T21:13:04.406 INFO:tasks.workunit.client.1.smithi103.stdout:7/917: truncate d1/df/d42/ff6 1373033 0 2024-09-18T21:13:04.407 INFO:tasks.workunit.client.1.smithi103.stdout:0/874: dwrite d1/d93/fe0 [0,4194304] 0 2024-09-18T21:13:04.407 INFO:tasks.workunit.client.1.smithi103.stdout:2/853: getdents d3/d5/d2f/d32/d90/dd7 0 2024-09-18T21:13:04.412 INFO:tasks.workunit.client.1.smithi103.stdout:9/925: dread d18/d8d/d2f/f4e [0,4194304] 0 2024-09-18T21:13:04.415 INFO:tasks.workunit.client.0.smithi077.stdout:3/809: mkdir db/d14/d22/d36/df8 0 2024-09-18T21:13:04.416 INFO:tasks.workunit.client.0.smithi077.stdout:6/788: fdatasync d7/d7e/d11/d3e/d42/dbb/d5c/f6b 0 2024-09-18T21:13:04.417 INFO:tasks.workunit.client.1.smithi103.stdout:6/938: dwrite d2/d24/fb6 [0,4194304] 0 2024-09-18T21:13:04.418 INFO:tasks.workunit.client.1.smithi103.stdout:5/953: mkdir de/d1f/d3b/d3c/d62/d118/d13a 0 2024-09-18T21:13:04.421 INFO:tasks.workunit.client.0.smithi077.stdout:5/880: truncate d0/df/d10/f26 3525688 0 2024-09-18T21:13:04.422 INFO:tasks.workunit.client.1.smithi103.stdout:7/918: mknod d1/df/d43/d52/dfa/c136 0 2024-09-18T21:13:04.422 INFO:tasks.workunit.client.0.smithi077.stdout:1/769: getdents d3/d8/d49/d4e/dbd 0 2024-09-18T21:13:04.424 INFO:tasks.workunit.client.1.smithi103.stdout:0/875: unlink d1/d5/de/d19/fd2 0 2024-09-18T21:13:04.425 INFO:tasks.workunit.client.0.smithi077.stdout:4/842: creat d3/d35/f110 x:0 0 0 2024-09-18T21:13:04.426 INFO:tasks.workunit.client.0.smithi077.stdout:4/843: readlink d3/dd2/led 0 2024-09-18T21:13:04.427 INFO:tasks.workunit.client.0.smithi077.stdout:9/794: dwrite d1/dd/d11/d1c/d38/d46/f10f [0,4194304] 0 2024-09-18T21:13:04.427 INFO:tasks.workunit.client.1.smithi103.stdout:1/866: dwrite d0/d2/d9/d9e/d7a/dd0/df9/d68/d81/da2/da4/dc2/dd8/dae/fb4 [0,4194304] 0 2024-09-18T21:13:04.427 INFO:tasks.workunit.client.1.smithi103.stdout:2/854: creat d3/d5/d2f/d32/dae/ddf/f128 x:0 0 0 2024-09-18T21:13:04.430 INFO:tasks.workunit.client.1.smithi103.stdout:3/951: symlink d1/d2/d18/d30/d4e/db1/d10e/d114/d4f/d58/d68/d50/d54/l11d 0 2024-09-18T21:13:04.434 INFO:tasks.workunit.client.1.smithi103.stdout:9/926: symlink d18/d52/d6f/d8e/d8f/dbd/df1/dfe/l133 0 2024-09-18T21:13:04.435 INFO:tasks.workunit.client.0.smithi077.stdout:4/844: dwrite d3/d77/ff7 [0,4194304] 0 2024-09-18T21:13:04.444 INFO:tasks.workunit.client.1.smithi103.stdout:5/954: dread de/d1f/d3b/ff8 [0,4194304] 0 2024-09-18T21:13:04.446 INFO:tasks.workunit.client.1.smithi103.stdout:0/876: unlink d1/d93/le9 0 2024-09-18T21:13:04.452 INFO:tasks.workunit.client.1.smithi103.stdout:6/939: rename d2/d3/f19 to d2/d3/d8/f128 0 2024-09-18T21:13:04.455 INFO:tasks.workunit.client.1.smithi103.stdout:2/855: fsync d3/fa5 0 2024-09-18T21:13:04.457 INFO:tasks.workunit.client.1.smithi103.stdout:6/940: dwrite d2/d3/d8/d4c/d4e/fc3 [0,4194304] 0 2024-09-18T21:13:04.458 INFO:tasks.workunit.client.1.smithi103.stdout:0/877: mkdir d1/d5/de/dc0/d8c/dce/d9f/d4f/d68/d132 0 2024-09-18T21:13:04.458 INFO:tasks.workunit.client.1.smithi103.stdout:6/941: chown d2/d3/dcb/lcf 0 1 2024-09-18T21:13:04.460 INFO:tasks.workunit.client.1.smithi103.stdout:1/867: fsync d0/d2/d9/dc/d36/f6d 0 2024-09-18T21:13:04.462 INFO:tasks.workunit.client.1.smithi103.stdout:3/952: unlink d1/d2/d18/d30/d4e/db1/d10e/d114/d4f/d58/d68/d50/d54/caf 0 2024-09-18T21:13:04.462 INFO:tasks.workunit.client.1.smithi103.stdout:3/953: stat d1/d64 0 2024-09-18T21:13:04.463 INFO:tasks.workunit.client.1.smithi103.stdout:3/954: write d1/f24 [3666930,128840] 0 2024-09-18T21:13:04.464 INFO:tasks.workunit.client.1.smithi103.stdout:0/878: dwrite d1/d5/de/dc0/d8c/dce/d9f/d4f/d68/fc8 [0,4194304] 0 2024-09-18T21:13:04.466 INFO:tasks.workunit.client.1.smithi103.stdout:3/955: chown d1/d2/d18/d30/d4e/db1/d10e/d114/l37 0 1 2024-09-18T21:13:04.466 INFO:tasks.workunit.client.1.smithi103.stdout:7/919: rename d1/df/d42/d1f/d5d/f115 to d1/df/d42/d121/f137 0 2024-09-18T21:13:04.469 INFO:tasks.workunit.client.1.smithi103.stdout:7/920: write d1/df/d42/d29/d48/dbb/f9a [3869054,10910] 0 2024-09-18T21:13:04.483 INFO:tasks.workunit.client.0.smithi077.stdout:8/762: sync 2024-09-18T21:13:04.488 INFO:tasks.workunit.client.1.smithi103.stdout:5/955: creat de/d1f/d3b/d58/dc4/f13b x:0 0 0 2024-09-18T21:13:04.492 INFO:tasks.workunit.client.1.smithi103.stdout:7/921: creat d1/df/d44/db4/f138 x:0 0 0 2024-09-18T21:13:04.495 INFO:tasks.workunit.client.1.smithi103.stdout:6/942: symlink d2/d3/d8/d4c/d4e/d10d/l129 0 2024-09-18T21:13:04.495 INFO:tasks.workunit.client.1.smithi103.stdout:1/868: write d0/d2/d9/d10/d5d/d6f/f8b [903295,123533] 0 2024-09-18T21:13:04.496 INFO:tasks.workunit.client.1.smithi103.stdout:2/856: dwrite d3/d5/d2f/d48/dab/fad [0,4194304] 0 2024-09-18T21:13:04.498 INFO:tasks.workunit.client.1.smithi103.stdout:9/927: getdents d18/d52/d6f/d8e/d8f/db5 0 2024-09-18T21:13:04.499 INFO:tasks.workunit.client.1.smithi103.stdout:0/879: mknod d1/c133 0 2024-09-18T21:13:04.500 INFO:tasks.workunit.client.1.smithi103.stdout:3/956: mkdir d1/d2/d18/d30/d4e/db1/d10e/d114/da1/dd8/d11e 0 2024-09-18T21:13:04.500 INFO:tasks.workunit.client.1.smithi103.stdout:3/957: chown d1/f31 2757905 1 2024-09-18T21:13:04.505 INFO:tasks.workunit.client.1.smithi103.stdout:6/943: mknod d2/d24/d38/c12a 0 2024-09-18T21:13:04.507 INFO:tasks.workunit.client.1.smithi103.stdout:3/958: dwrite d1/d2/f8 [0,4194304] 0 2024-09-18T21:13:04.507 INFO:tasks.workunit.client.1.smithi103.stdout:1/869: rmdir d0/d2/d2b/d3a/d42/d72/db0 39 2024-09-18T21:13:04.510 INFO:tasks.workunit.client.0.smithi077.stdout:3/810: rmdir db/d14/d32/d49/da4/d8a 39 2024-09-18T21:13:04.511 INFO:tasks.workunit.client.1.smithi103.stdout:5/956: rename de/d1f/f52 to de/d1f/d3b/d58/dc4/d33/d4f/da6/f13c 0 2024-09-18T21:13:04.511 INFO:tasks.workunit.client.1.smithi103.stdout:2/857: dread - d3/d5/d2f/d32/dfc/f10b zero size 2024-09-18T21:13:04.513 INFO:tasks.workunit.client.1.smithi103.stdout:1/870: symlink d0/d2/d9/d9e/l131 0 2024-09-18T21:13:04.514 INFO:tasks.workunit.client.0.smithi077.stdout:6/789: chown d7/d7e/d11/d3e/d42/dbb/l21 165 1 2024-09-18T21:13:04.516 INFO:tasks.workunit.client.0.smithi077.stdout:1/770: mkdir d3/d8/d75/d89/d103 0 2024-09-18T21:13:04.518 INFO:tasks.workunit.client.0.smithi077.stdout:1/771: dread - d3/d8/d93/dd3/f74 zero size 2024-09-18T21:13:04.521 INFO:tasks.workunit.client.1.smithi103.stdout:2/858: creat d3/d5/d2f/d32/d90/dd7/f129 x:0 0 0 2024-09-18T21:13:04.523 INFO:tasks.workunit.client.1.smithi103.stdout:3/959: mkdir d1/d2/d18/d30/d4e/db1/d10e/d114/dcf/d11f 0 2024-09-18T21:13:04.524 INFO:tasks.workunit.client.1.smithi103.stdout:3/960: fdatasync d1/d2/d18/d30/d4e/db1/d10e/d114/d4f/dce/fd7 0 2024-09-18T21:13:04.525 INFO:tasks.workunit.client.0.smithi077.stdout:4/845: rmdir d3/d7 39 2024-09-18T21:13:04.526 INFO:tasks.workunit.client.0.smithi077.stdout:4/846: chown d3/d77/ff7 965894047 1 2024-09-18T21:13:04.527 INFO:tasks.workunit.client.1.smithi103.stdout:1/871: creat d0/d2/d9/d9e/d7a/dd0/df9/d68/f132 x:0 0 0 2024-09-18T21:13:04.532 INFO:tasks.workunit.client.1.smithi103.stdout:6/944: creat d2/d3/d8/d4c/f12b x:0 0 0 2024-09-18T21:13:04.533 INFO:tasks.workunit.client.0.smithi077.stdout:3/811: creat db/d14/d32/d49/d4e/d8b/ff9 x:0 0 0 2024-09-18T21:13:04.535 INFO:tasks.workunit.client.0.smithi077.stdout:5/881: dread d0/d6/f50 [0,4194304] 0 2024-09-18T21:13:04.536 INFO:tasks.workunit.client.0.smithi077.stdout:6/790: chown d7/d7e/d11/d3e/d42/dbb/l41 28857 1 2024-09-18T21:13:04.536 INFO:tasks.workunit.client.0.smithi077.stdout:5/882: chown d0/d43/d6d/l83 0 1 2024-09-18T21:13:04.537 INFO:tasks.workunit.client.1.smithi103.stdout:5/957: dread de/d2d/fa5 [0,4194304] 0 2024-09-18T21:13:04.537 INFO:tasks.workunit.client.1.smithi103.stdout:7/922: dwrite d1/f21 [0,4194304] 0 2024-09-18T21:13:04.539 INFO:tasks.workunit.client.1.smithi103.stdout:0/880: link d1/d5/de/d24/d43/l9d d1/d5/de/dc0/dbf/d4e/l134 0 2024-09-18T21:13:04.539 INFO:tasks.workunit.client.0.smithi077.stdout:1/772: symlink d3/d6a/d9b/d7f/l104 0 2024-09-18T21:13:04.539 INFO:tasks.workunit.client.0.smithi077.stdout:7/887: sync 2024-09-18T21:13:04.541 INFO:tasks.workunit.client.0.smithi077.stdout:1/773: dread - d3/d8/d49/d4e/d50/fef zero size 2024-09-18T21:13:04.542 INFO:tasks.workunit.client.0.smithi077.stdout:2/869: write d1/d4/d5/d1a/d49/f72 [141218,104837] 0 2024-09-18T21:13:04.544 INFO:tasks.workunit.client.1.smithi103.stdout:2/859: unlink d3/db3/cf6 0 2024-09-18T21:13:04.545 INFO:tasks.workunit.client.0.smithi077.stdout:0/893: truncate d8/d26/f34 2444222 0 2024-09-18T21:13:04.547 INFO:tasks.workunit.client.1.smithi103.stdout:6/945: dread d2/d24/f5f [0,4194304] 0 2024-09-18T21:13:04.548 INFO:tasks.workunit.client.1.smithi103.stdout:0/881: dread d1/d5/de/d19/fef [0,4194304] 0 2024-09-18T21:13:04.548 INFO:tasks.workunit.client.0.smithi077.stdout:4/847: chown d3/d7/d42/f5c 3742 1 2024-09-18T21:13:04.549 INFO:tasks.workunit.client.1.smithi103.stdout:1/872: symlink d0/l133 0 2024-09-18T21:13:04.549 INFO:tasks.workunit.client.1.smithi103.stdout:0/882: stat d1/d5/de/dc0/d8c/dce/d9f/f37 0 2024-09-18T21:13:04.550 INFO:tasks.workunit.client.0.smithi077.stdout:8/763: fsync d2/d27/f57 0 2024-09-18T21:13:04.551 INFO:tasks.workunit.client.0.smithi077.stdout:8/764: stat d2/d5f/da8/d20/d3e/db4/fc5 0 2024-09-18T21:13:04.553 INFO:tasks.workunit.client.0.smithi077.stdout:3/812: creat db/d14/d22/ffa x:0 0 0 2024-09-18T21:13:04.555 INFO:tasks.workunit.client.0.smithi077.stdout:5/883: symlink d0/df/d3d/l122 0 2024-09-18T21:13:04.555 INFO:tasks.workunit.client.1.smithi103.stdout:1/873: dwrite d0/d2/d2b/d111/f125 [0,4194304] 0 2024-09-18T21:13:04.555 INFO:tasks.workunit.client.0.smithi077.stdout:8/765: dread d2/d5f/da8/fd3 [0,4194304] 0 2024-09-18T21:13:04.556 INFO:tasks.workunit.client.0.smithi077.stdout:6/791: symlink d7/d7e/d11/d3e/d42/dbb/d49/d96/l10b 0 2024-09-18T21:13:04.558 INFO:tasks.workunit.client.0.smithi077.stdout:9/795: truncate d1/dd/d1a/fdf 2634673 0 2024-09-18T21:13:04.559 INFO:tasks.workunit.client.0.smithi077.stdout:7/888: symlink d12/d56/l132 0 2024-09-18T21:13:04.560 INFO:tasks.workunit.client.0.smithi077.stdout:9/796: read d1/dd/d11/d1c/d38/d46/d55/d9c/fb8 [498312,66483] 0 2024-09-18T21:13:04.561 INFO:tasks.workunit.client.0.smithi077.stdout:1/774: stat d3/d38/d97/cc9 0 2024-09-18T21:13:04.563 INFO:tasks.workunit.client.1.smithi103.stdout:3/961: truncate d1/d23/f2a 1148130 0 2024-09-18T21:13:04.568 INFO:tasks.workunit.client.1.smithi103.stdout:3/962: dwrite d1/da/df/f77 [0,4194304] 0 2024-09-18T21:13:04.593 INFO:tasks.workunit.client.1.smithi103.stdout:2/860: rename d3/d5/d2c/d77/d9c/db8 to d3/db3/d12a 0 2024-09-18T21:13:04.594 INFO:tasks.workunit.client.1.smithi103.stdout:6/946: symlink d2/d3/d8/d4c/d7d/d9b/dd0/l12c 0 2024-09-18T21:13:04.596 INFO:tasks.workunit.client.1.smithi103.stdout:7/923: symlink d1/df/d42/d29/d48/ddb/l139 0 2024-09-18T21:13:04.597 INFO:tasks.workunit.client.1.smithi103.stdout:5/958: symlink de/d1f/d3b/d3c/d62/d118/d13a/l13d 0 2024-09-18T21:13:04.599 INFO:tasks.workunit.client.1.smithi103.stdout:5/959: write de/d1f/d3b/d58/dc4/d125/df2/f10c [650673,120093] 0 2024-09-18T21:13:04.599 INFO:tasks.workunit.client.1.smithi103.stdout:1/874: mkdir d0/d2/d9/d9e/d7a/dd0/d10f/d134 0 2024-09-18T21:13:04.599 INFO:tasks.workunit.client.1.smithi103.stdout:9/928: sync 2024-09-18T21:13:04.604 INFO:tasks.workunit.client.1.smithi103.stdout:6/947: creat d2/d3/d8/d4c/d4e/d10d/f12d x:0 0 0 2024-09-18T21:13:04.605 INFO:tasks.workunit.client.1.smithi103.stdout:7/924: mkdir d1/d13a 0 2024-09-18T21:13:04.605 INFO:tasks.workunit.client.1.smithi103.stdout:1/875: dwrite d0/d2/d9/d9e/d7a/dd0/df9/f29 [0,4194304] 0 2024-09-18T21:13:04.606 INFO:tasks.workunit.client.1.smithi103.stdout:5/960: symlink de/d1f/d3b/d3c/d62/d118/d11c/l13e 0 2024-09-18T21:13:04.608 INFO:tasks.workunit.client.1.smithi103.stdout:3/963: link d1/f24 d1/d2/d18/d30/d4e/db1/d10e/dbb/df7/f120 0 2024-09-18T21:13:04.610 INFO:tasks.workunit.client.1.smithi103.stdout:9/929: creat d18/d29/d68/d92/d9c/dc8/f134 x:0 0 0 2024-09-18T21:13:04.611 INFO:tasks.workunit.client.0.smithi077.stdout:6/792: symlink d7/d7e/d11/d3e/dcd/l10c 0 2024-09-18T21:13:04.611 INFO:tasks.workunit.client.1.smithi103.stdout:9/930: write d18/d29/d68/d92/d9c/fcc [890590,45019] 0 2024-09-18T21:13:04.612 INFO:tasks.workunit.client.0.smithi077.stdout:7/889: rename d12/d22/f28 to d12/d22/daa/f133 0 2024-09-18T21:13:04.612 INFO:tasks.workunit.client.1.smithi103.stdout:0/883: creat d1/d5/de/dc0/f135 x:0 0 0 2024-09-18T21:13:04.613 INFO:tasks.workunit.client.0.smithi077.stdout:2/870: mknod d1/d4/d5/d1a/d2e/c128 0 2024-09-18T21:13:04.613 INFO:tasks.workunit.client.1.smithi103.stdout:0/884: write d1/d5/f44 [6903,80827] 0 2024-09-18T21:13:04.614 INFO:tasks.workunit.client.1.smithi103.stdout:0/885: write d1/d5/de/d19/d1e/ff0 [3032645,87363] 0 2024-09-18T21:13:04.616 INFO:tasks.workunit.client.0.smithi077.stdout:9/797: write d1/dd/d11/d1c/d38/d46/d55/dce/fc9 [1888415,93055] 0 2024-09-18T21:13:04.617 INFO:tasks.workunit.client.0.smithi077.stdout:0/894: write d8/d26/f96 [350578,1182] 0 2024-09-18T21:13:04.619 INFO:tasks.workunit.client.1.smithi103.stdout:7/925: dread d1/df/d43/d63/fd1 [0,4194304] 0 2024-09-18T21:13:04.623 INFO:tasks.workunit.client.1.smithi103.stdout:3/964: mkdir d1/d2/d18/d30/d4e/db1/d10e/d114/d4f/d72/d7e/d121 0 2024-09-18T21:13:04.623 INFO:tasks.workunit.client.0.smithi077.stdout:6/793: chown d7/d7e/d11/d3e/c6a 142225 1 2024-09-18T21:13:04.624 INFO:tasks.workunit.client.1.smithi103.stdout:3/965: chown d1/da/df/f77 142653177 1 2024-09-18T21:13:04.624 INFO:tasks.workunit.client.0.smithi077.stdout:4/848: dwrite d3/d7/d73/d9f/fe7 [0,4194304] 0 2024-09-18T21:13:04.625 INFO:tasks.workunit.client.1.smithi103.stdout:3/966: dread - d1/d2/d18/d30/d4e/db1/d10e/d114/d4f/fd2 zero size 2024-09-18T21:13:04.628 INFO:tasks.workunit.client.0.smithi077.stdout:8/766: dwrite d2/d27/d29/feb [0,4194304] 0 2024-09-18T21:13:04.631 INFO:tasks.workunit.client.1.smithi103.stdout:9/931: mkdir d18/d29/d68/d92/dd1/d135 0 2024-09-18T21:13:04.631 INFO:tasks.workunit.client.1.smithi103.stdout:5/961: dread de/d1f/d3b/d58/dc4/f5b [0,4194304] 0 2024-09-18T21:13:04.633 INFO:tasks.workunit.client.0.smithi077.stdout:9/798: dwrite d1/dd/d11/d1c/d38/d46/d55/dce/fc9 [0,4194304] 0 2024-09-18T21:13:04.636 INFO:tasks.workunit.client.1.smithi103.stdout:2/861: write d3/d5/d2c/f50 [665927,89269] 0 2024-09-18T21:13:04.636 INFO:tasks.workunit.client.1.smithi103.stdout:2/862: stat d3/d5/d2c/d77 0 2024-09-18T21:13:04.637 INFO:tasks.workunit.client.1.smithi103.stdout:2/863: chown d3/d5/d2f/d32/ffb 94 1 2024-09-18T21:13:04.638 INFO:tasks.workunit.client.1.smithi103.stdout:2/864: readlink d3/d5/d2c/l30 0 2024-09-18T21:13:04.639 INFO:tasks.workunit.client.1.smithi103.stdout:2/865: chown d3/d5/d2f/d32/d90/cfd 95764 1 2024-09-18T21:13:04.640 INFO:tasks.workunit.client.0.smithi077.stdout:1/775: creat d3/d8/f105 x:0 0 0 2024-09-18T21:13:04.641 INFO:tasks.workunit.client.1.smithi103.stdout:1/876: rmdir d0/d2/d2b/d3a/d42/d87 39 2024-09-18T21:13:04.642 INFO:tasks.workunit.client.0.smithi077.stdout:1/776: dread - d3/d38/d97/dea/feb zero size 2024-09-18T21:13:04.646 INFO:tasks.workunit.client.1.smithi103.stdout:6/948: write d2/d24/d5a/f11 [3092768,57917] 0 2024-09-18T21:13:04.647 INFO:tasks.workunit.client.0.smithi077.stdout:0/895: dread d8/d26/f32 [0,4194304] 0 2024-09-18T21:13:04.647 INFO:tasks.workunit.client.1.smithi103.stdout:9/932: creat d18/da4/f136 x:0 0 0 2024-09-18T21:13:04.648 INFO:tasks.workunit.client.0.smithi077.stdout:2/871: truncate d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/f90 3993006 0 2024-09-18T21:13:04.649 INFO:tasks.workunit.client.1.smithi103.stdout:5/962: symlink de/d1f/d3b/d51/d57/d79/d8d/l13f 0 2024-09-18T21:13:04.649 INFO:tasks.workunit.client.0.smithi077.stdout:4/849: symlink d3/dc/d32/d45/l111 0 2024-09-18T21:13:04.650 INFO:tasks.workunit.client.1.smithi103.stdout:2/866: mknod d3/d5/d2f/d32/d90/df0/c12b 0 2024-09-18T21:13:04.652 INFO:tasks.workunit.client.1.smithi103.stdout:2/867: write d3/d5/d2f/d32/d90/dd7/f120 [3133055,82603] 0 2024-09-18T21:13:04.653 INFO:tasks.workunit.client.0.smithi077.stdout:7/890: mknod d12/d56/da1/ddf/d100/c134 0 2024-09-18T21:13:04.654 INFO:tasks.workunit.client.1.smithi103.stdout:7/926: creat d1/df/d42/d29/d48/dbb/ded/dfe/d12b/f13b x:0 0 0 2024-09-18T21:13:04.657 INFO:tasks.workunit.client.1.smithi103.stdout:9/933: fdatasync d18/d29/d68/d78/fa8 0 2024-09-18T21:13:04.658 INFO:tasks.workunit.client.1.smithi103.stdout:5/963: stat de/d1f/d3b/d58/dc4/d33/l26 0 2024-09-18T21:13:04.660 INFO:tasks.workunit.client.1.smithi103.stdout:1/877: mknod d0/d2/d9/d9e/d7a/dd0/df9/d68/d81/da2/da4/c135 0 2024-09-18T21:13:04.661 INFO:tasks.workunit.client.1.smithi103.stdout:0/886: write d1/d5/de/d24/f38 [3828698,76788] 0 2024-09-18T21:13:04.662 INFO:tasks.workunit.client.1.smithi103.stdout:0/887: write d1/d9/d3e/d6e/f11c [674606,70678] 0 2024-09-18T21:13:04.664 INFO:tasks.workunit.client.1.smithi103.stdout:2/868: creat d3/d5/d2f/d32/d46/f12c x:0 0 0 2024-09-18T21:13:04.665 INFO:tasks.workunit.client.0.smithi077.stdout:8/767: truncate d2/d5/d6/f2c 4029645 0 2024-09-18T21:13:04.666 INFO:tasks.workunit.client.1.smithi103.stdout:7/927: mkdir d1/df/d43/d61/d13c 0 2024-09-18T21:13:04.668 INFO:tasks.workunit.client.1.smithi103.stdout:3/967: dwrite d1/d2/d18/d30/d4e/db1/d10e/dbb/fba [0,4194304] 0 2024-09-18T21:13:04.673 INFO:tasks.workunit.client.1.smithi103.stdout:5/964: symlink de/d1f/d3b/d58/dc4/d33/d4f/l140 0 2024-09-18T21:13:04.673 INFO:tasks.workunit.client.0.smithi077.stdout:1/777: getdents d3/d8/d75/d89/d103 0 2024-09-18T21:13:04.673 INFO:tasks.workunit.client.0.smithi077.stdout:9/799: write d1/dd/d1a/fa2 [990813,76769] 0 2024-09-18T21:13:04.674 INFO:tasks.workunit.client.1.smithi103.stdout:1/878: creat d0/d2/d9/d9e/d7a/dd0/df9/d68/f136 x:0 0 0 2024-09-18T21:13:04.676 INFO:tasks.workunit.client.0.smithi077.stdout:3/813: rename db/d14/d32/d49/da4/d8a/d99/daf/cf1 to db/d14/d32/d49/da4/cfb 0 2024-09-18T21:13:04.678 INFO:tasks.workunit.client.0.smithi077.stdout:0/896: dread d8/d26/f18 [0,4194304] 0 2024-09-18T21:13:04.679 INFO:tasks.workunit.client.0.smithi077.stdout:3/814: write db/d14/d32/d49/d4e/d8b/ff9 [414483,26941] 0 2024-09-18T21:13:04.681 INFO:tasks.workunit.client.0.smithi077.stdout:4/850: write d3/d77/f7a [4708119,16706] 0 2024-09-18T21:13:04.681 INFO:tasks.workunit.client.0.smithi077.stdout:7/891: mknod d12/d22/d59/c135 0 2024-09-18T21:13:04.682 INFO:tasks.workunit.client.0.smithi077.stdout:7/892: stat d12/d22/f7b 0 2024-09-18T21:13:04.687 INFO:tasks.workunit.client.0.smithi077.stdout:6/794: truncate d7/d7e/d11/d3e/d42/dbb/d50/fca 3055902 0 2024-09-18T21:13:04.689 INFO:tasks.workunit.client.0.smithi077.stdout:8/768: rename d2/d5f/da8/d20/d3e/db4 to d2/d5/d6/d9f/da6/d110 0 2024-09-18T21:13:04.691 INFO:tasks.workunit.client.0.smithi077.stdout:0/897: mkdir d8/d37/d66/d87/de0/dce/dcf/d122 0 2024-09-18T21:13:04.693 INFO:tasks.workunit.client.0.smithi077.stdout:3/815: mknod db/d14/d90/db2/cfc 0 2024-09-18T21:13:04.696 INFO:tasks.workunit.client.0.smithi077.stdout:8/769: dread d2/d5f/da8/d26/f84 [0,4194304] 0 2024-09-18T21:13:04.697 INFO:tasks.workunit.client.0.smithi077.stdout:1/778: dread d3/d8/f17 [0,4194304] 0 2024-09-18T21:13:04.700 INFO:tasks.workunit.client.0.smithi077.stdout:3/816: unlink db/d14/d22/d36/fbc 0 2024-09-18T21:13:04.701 INFO:tasks.workunit.client.0.smithi077.stdout:3/817: write db/d14/d32/d49/fa0 [1063927,39749] 0 2024-09-18T21:13:04.702 INFO:tasks.workunit.client.0.smithi077.stdout:9/800: creat d1/d54/d81/f113 x:0 0 0 2024-09-18T21:13:04.703 INFO:tasks.workunit.client.0.smithi077.stdout:8/770: readlink d2/d5f/da8/d4f/d5a/d2a/d67/lff 0 2024-09-18T21:13:04.707 INFO:tasks.workunit.client.0.smithi077.stdout:6/795: mkdir d7/d7e/d11/d3e/d42/dbb/d10d 0 2024-09-18T21:13:04.708 INFO:tasks.workunit.client.0.smithi077.stdout:0/898: creat d8/d37/d66/d102/f123 x:0 0 0 2024-09-18T21:13:04.708 INFO:tasks.workunit.client.1.smithi103.stdout:5/965: dwrite de/d1f/f23 [0,4194304] 0 2024-09-18T21:13:04.709 INFO:tasks.workunit.client.1.smithi103.stdout:0/888: rename d1/d5/de/d22/d6a/f91 to d1/d5/de/d19/d1e/d34/f136 0 2024-09-18T21:13:04.709 INFO:tasks.workunit.client.1.smithi103.stdout:2/869: truncate d3/d5/d2c/d54/d68/f6b 518176 0 2024-09-18T21:13:04.714 INFO:tasks.workunit.client.1.smithi103.stdout:3/968: creat d1/d2/d18/d30/d4e/db1/d10e/f122 x:0 0 0 2024-09-18T21:13:04.714 INFO:tasks.workunit.client.1.smithi103.stdout:9/934: mknod d18/d52/d6f/db9/dcb/d123/c137 0 2024-09-18T21:13:04.714 INFO:tasks.workunit.client.1.smithi103.stdout:1/879: mknod d0/d2/d9/d10/d5d/d6f/c137 0 2024-09-18T21:13:04.714 INFO:tasks.workunit.client.1.smithi103.stdout:1/880: readlink d0/d11/d5f/d19/l9f 0 2024-09-18T21:13:04.715 INFO:tasks.workunit.client.0.smithi077.stdout:7/893: rmdir d12/d31/d127 0 2024-09-18T21:13:04.715 INFO:tasks.workunit.client.0.smithi077.stdout:6/796: dwrite d7/f2c [4194304,4194304] 0 2024-09-18T21:13:04.717 INFO:tasks.workunit.client.0.smithi077.stdout:3/818: fdatasync db/d14/d32/d49/da4/d71/f78 0 2024-09-18T21:13:04.718 INFO:tasks.workunit.client.1.smithi103.stdout:9/935: dwrite d18/d29/d68/d78/f128 [0,4194304] 0 2024-09-18T21:13:04.720 INFO:tasks.workunit.client.0.smithi077.stdout:4/851: truncate d3/dc/d51/d53/d89/fad 7055985 0 2024-09-18T21:13:04.721 INFO:tasks.workunit.client.1.smithi103.stdout:9/936: truncate d18/d29/d68/d92/d9c/dc8/deb/ffc 4915812 0 2024-09-18T21:13:04.722 INFO:tasks.workunit.client.0.smithi077.stdout:9/801: mkdir d1/dd/d11/d1c/d38/d46/d55/d9c/d114 0 2024-09-18T21:13:04.724 INFO:tasks.workunit.client.0.smithi077.stdout:9/802: readlink d1/dd/d11/d1c/d38/d46/d55/dce/lbc 0 2024-09-18T21:13:04.726 INFO:tasks.workunit.client.0.smithi077.stdout:1/779: write d3/d6a/d9b/dbe/fce [1775883,120356] 0 2024-09-18T21:13:04.727 INFO:tasks.workunit.client.0.smithi077.stdout:9/803: truncate d1/dd/d11/d1c/d38/d46/d55/d7f/fb3 772003 0 2024-09-18T21:13:04.729 INFO:tasks.workunit.client.1.smithi103.stdout:1/881: chown d0/d2/d9/d9e/d7a/dd0/df9/d68/l76 13 1 2024-09-18T21:13:04.731 INFO:tasks.workunit.client.0.smithi077.stdout:7/894: creat d12/d31/d77/da3/f136 x:0 0 0 2024-09-18T21:13:04.732 INFO:tasks.workunit.client.1.smithi103.stdout:5/966: dread de/d1f/d3b/d58/dc4/d33/f7c [0,4194304] 0 2024-09-18T21:13:04.733 INFO:tasks.workunit.client.0.smithi077.stdout:6/797: fdatasync d7/d7e/d11/d3e/d42/dbb/d5c/f91 0 2024-09-18T21:13:04.734 INFO:tasks.workunit.client.1.smithi103.stdout:0/889: dread d1/d9/f5c [0,4194304] 0 2024-09-18T21:13:04.737 INFO:tasks.workunit.client.1.smithi103.stdout:3/969: mkdir d1/d2/d123 0 2024-09-18T21:13:04.738 INFO:tasks.workunit.client.0.smithi077.stdout:4/852: rename d3/d77/d9c/db6/d10c to d3/d7/de8/d112 0 2024-09-18T21:13:04.741 INFO:tasks.workunit.client.0.smithi077.stdout:3/819: dread db/d14/d32/f56 [4194304,4194304] 0 2024-09-18T21:13:04.741 INFO:tasks.workunit.client.0.smithi077.stdout:1/780: dread - d3/d8/d75/d89/dbb/fc6 zero size 2024-09-18T21:13:04.742 INFO:tasks.workunit.client.0.smithi077.stdout:9/804: unlink d1/dd/d11/d1c/f7d 0 2024-09-18T21:13:04.742 INFO:tasks.workunit.client.1.smithi103.stdout:9/937: dread d18/d52/d6f/d8e/db4/fd2 [0,4194304] 0 2024-09-18T21:13:04.743 INFO:tasks.workunit.client.0.smithi077.stdout:0/899: symlink d8/d26/l124 0 2024-09-18T21:13:04.748 INFO:tasks.workunit.client.1.smithi103.stdout:6/949: sync 2024-09-18T21:13:04.748 INFO:tasks.workunit.client.1.smithi103.stdout:3/970: readlink d1/d2/d18/d30/d4e/db1/d10e/d114/d4f/l69 0 2024-09-18T21:13:04.749 INFO:tasks.workunit.client.0.smithi077.stdout:6/798: unlink d7/d7e/d11/d3e/d42/dbb/d31/la8 0 2024-09-18T21:13:04.751 INFO:tasks.workunit.client.0.smithi077.stdout:7/895: dread d12/d22/daa/dc0/fe0 [0,4194304] 0 2024-09-18T21:13:04.753 INFO:tasks.workunit.client.0.smithi077.stdout:4/853: rename d3/dc/d32/fc0 to d3/dc/d32/d45/d5e/df0/f113 0 2024-09-18T21:13:04.753 INFO:tasks.workunit.client.0.smithi077.stdout:4/854: stat d3/d7/d6c/c9a 0 2024-09-18T21:13:04.754 INFO:tasks.workunit.client.1.smithi103.stdout:9/938: creat d18/d52/d6f/df8/d105/f138 x:0 0 0 2024-09-18T21:13:04.754 INFO:tasks.workunit.client.1.smithi103.stdout:1/882: dread d0/d2/d9/dc/f28 [0,4194304] 0 2024-09-18T21:13:04.756 INFO:tasks.workunit.client.1.smithi103.stdout:5/967: truncate de/d2d/d7f/f87 480296 0 2024-09-18T21:13:04.757 INFO:tasks.workunit.client.0.smithi077.stdout:9/805: mkdir d1/dd/d11/d1c/d38/d46/d55/dce/d115 0 2024-09-18T21:13:04.758 INFO:tasks.workunit.client.1.smithi103.stdout:0/890: symlink d1/d5/de/d19/d1e/l137 0 2024-09-18T21:13:04.759 INFO:tasks.workunit.client.0.smithi077.stdout:0/900: mknod d8/d1a/d39/d56/c125 0 2024-09-18T21:13:04.759 INFO:tasks.workunit.client.0.smithi077.stdout:9/806: write d1/dd/d11/d1c/d38/d46/d55/d7f/fde [333088,66263] 0 2024-09-18T21:13:04.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:04 smithi103 ceph-mon[34827]: pgmap v23: 65 pgs: 65 active+clean; 3.1 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 88 MiB/s rd, 234 MiB/s wr, 474 op/s 2024-09-18T21:13:04.763 INFO:tasks.workunit.client.1.smithi103.stdout:2/870: link d3/d5/d2f/d5b/le5 d3/d5/d4a/d56/l12d 0 2024-09-18T21:13:04.768 INFO:tasks.workunit.client.0.smithi077.stdout:3/820: rename db/d14/d32/d49/da4/d71/d3b/c80 to db/d14/d32/d49/cfd 0 2024-09-18T21:13:04.770 INFO:tasks.workunit.client.1.smithi103.stdout:5/968: rmdir de/d1f/d3b/d58/dc4/d33/d4f/d101 39 2024-09-18T21:13:04.770 INFO:tasks.workunit.client.1.smithi103.stdout:9/939: dread d18/d29/d68/d92/d9c/dc8/f10c [0,4194304] 0 2024-09-18T21:13:04.771 INFO:tasks.workunit.client.0.smithi077.stdout:1/781: dwrite d3/d8/d49/d4e/d5a/f78 [0,4194304] 0 2024-09-18T21:13:04.775 INFO:tasks.workunit.client.1.smithi103.stdout:7/928: sync 2024-09-18T21:13:04.776 INFO:tasks.workunit.client.0.smithi077.stdout:0/901: mkdir d8/d1a/d39/d56/d126 0 2024-09-18T21:13:04.779 INFO:tasks.workunit.client.1.smithi103.stdout:1/883: getdents d0/d2/d9/dc/d6e/dac/dfa 0 2024-09-18T21:13:04.780 INFO:tasks.workunit.client.1.smithi103.stdout:1/884: readlink d0/d2/d9/d9e/d7a/dd0/df9/d68/d81/da2/lc9 0 2024-09-18T21:13:04.780 INFO:tasks.workunit.client.0.smithi077.stdout:3/821: symlink db/d14/d32/d87/lfe 0 2024-09-18T21:13:04.781 INFO:tasks.workunit.client.1.smithi103.stdout:5/969: fsync de/d1f/d3b/d58/fff 0 2024-09-18T21:13:04.782 INFO:tasks.workunit.client.1.smithi103.stdout:9/940: dread - d18/d52/d6f/fdb zero size 2024-09-18T21:13:04.785 INFO:tasks.workunit.client.0.smithi077.stdout:9/807: link d1/dd/d1a/d42/f89 d1/dd/d11/d1c/dd7/f116 0 2024-09-18T21:13:04.787 INFO:tasks.workunit.client.1.smithi103.stdout:3/971: creat d1/d2/d18/f124 x:0 0 0 2024-09-18T21:13:04.787 INFO:tasks.workunit.client.1.smithi103.stdout:5/970: dwrite de/d1f/d3b/d58/dc4/d33/d4f/da6/f137 [0,4194304] 0 2024-09-18T21:13:04.788 INFO:tasks.workunit.client.0.smithi077.stdout:6/799: rmdir d7/d7e/d11/d3e/d42/dbb/d10d 0 2024-09-18T21:13:04.790 INFO:tasks.workunit.client.0.smithi077.stdout:3/822: creat db/d14/d32/d49/d4e/d6a/db5/fff x:0 0 0 2024-09-18T21:13:04.790 INFO:tasks.workunit.client.0.smithi077.stdout:1/782: write d3/d6a/d9b/f3b [5425016,73375] 0 2024-09-18T21:13:04.791 INFO:tasks.workunit.client.1.smithi103.stdout:6/950: creat d2/d24/d5a/d67/d76/f12e x:0 0 0 2024-09-18T21:13:04.791 INFO:tasks.workunit.client.0.smithi077.stdout:3/823: write db/d14/d22/f2f [303163,1502] 0 2024-09-18T21:13:04.792 INFO:tasks.workunit.client.1.smithi103.stdout:2/871: symlink d3/d5/d2f/d32/d90/df0/d112/l12e 0 2024-09-18T21:13:04.793 INFO:tasks.workunit.client.1.smithi103.stdout:6/951: write d2/d24/f108 [4595145,56463] 0 2024-09-18T21:13:04.796 INFO:tasks.workunit.client.0.smithi077.stdout:6/800: unlink d7/d7e/d11/d3e/d42/d88/da4/de7/lb2 0 2024-09-18T21:13:04.796 INFO:tasks.workunit.client.0.smithi077.stdout:6/801: chown d7/d7e/d11/d3e/f65 1898 1 2024-09-18T21:13:04.798 INFO:tasks.workunit.client.1.smithi103.stdout:9/941: symlink d18/d52/d6f/d8e/d8f/dbd/df1/dfe/d117/l139 0 2024-09-18T21:13:04.801 INFO:tasks.workunit.client.1.smithi103.stdout:5/971: symlink de/d2d/l141 0 2024-09-18T21:13:04.801 INFO:tasks.workunit.client.1.smithi103.stdout:3/972: creat d1/d2/d18/d30/d4e/db1/f125 x:0 0 0 2024-09-18T21:13:04.803 INFO:tasks.workunit.client.1.smithi103.stdout:7/929: unlink d1/df/d43/d52/f123 0 2024-09-18T21:13:04.803 INFO:tasks.workunit.client.1.smithi103.stdout:7/930: chown d1/df/d43/d63/d67/dfd 7534 1 2024-09-18T21:13:04.804 INFO:tasks.workunit.client.0.smithi077.stdout:6/802: rename d7/d7e/d11/d3e/d42/dbb/d50/fca to d7/d7e/d11/d3e/dcd/f10e 0 2024-09-18T21:13:04.806 INFO:tasks.workunit.client.1.smithi103.stdout:1/885: unlink d0/d2/d2b/d3a/l117 0 2024-09-18T21:13:04.807 INFO:tasks.workunit.client.1.smithi103.stdout:2/872: mkdir d3/d5/d2c/d54/d68/d12f 0 2024-09-18T21:13:04.808 INFO:tasks.workunit.client.0.smithi077.stdout:6/803: fdatasync d7/d7e/d11/d3e/d42/dbb/d5c/f95 0 2024-09-18T21:13:04.809 INFO:tasks.workunit.client.0.smithi077.stdout:6/804: readlink d7/d7e/d11/d3e/d42/dbb/d31/l35 0 2024-09-18T21:13:04.809 INFO:tasks.workunit.client.0.smithi077.stdout:6/805: chown d7/d7e/l3b 2713934 1 2024-09-18T21:13:04.810 INFO:tasks.workunit.client.1.smithi103.stdout:6/952: mkdir d2/d3/d8/d4c/d4e/d10d/d12f 0 2024-09-18T21:13:04.811 INFO:tasks.workunit.client.1.smithi103.stdout:0/891: getdents d1/d5/de/d24/d43/d76/dc5 0 2024-09-18T21:13:04.812 INFO:tasks.workunit.client.1.smithi103.stdout:0/892: chown d1/d5/de/d19/d1e 2 1 2024-09-18T21:13:04.812 INFO:tasks.workunit.client.1.smithi103.stdout:9/942: unlink fa 0 2024-09-18T21:13:04.813 INFO:tasks.workunit.client.0.smithi077.stdout:0/902: write d8/d26/f34 [3171006,11061] 0 2024-09-18T21:13:04.817 INFO:tasks.workunit.client.1.smithi103.stdout:7/931: truncate d1/df/d42/f4e 1807402 0 2024-09-18T21:13:04.818 INFO:tasks.workunit.client.1.smithi103.stdout:7/932: truncate d1/df/d43/d63/f11b 670307 0 2024-09-18T21:13:04.819 INFO:tasks.workunit.client.0.smithi077.stdout:9/808: dwrite d1/dd/d11/d2d/d79/fa6 [0,4194304] 0 2024-09-18T21:13:04.820 INFO:tasks.workunit.client.0.smithi077.stdout:9/809: fsync d1/d54/f5c 0 2024-09-18T21:13:04.821 INFO:tasks.workunit.client.0.smithi077.stdout:9/810: stat d1/ff4 0 2024-09-18T21:13:04.822 INFO:tasks.workunit.client.1.smithi103.stdout:2/873: creat d3/d5/d2f/d48/f130 x:0 0 0 2024-09-18T21:13:04.823 INFO:tasks.workunit.client.1.smithi103.stdout:6/953: symlink d2/d24/d38/d68/l130 0 2024-09-18T21:13:04.824 INFO:tasks.workunit.client.0.smithi077.stdout:3/824: dwrite db/f35 [4194304,4194304] 0 2024-09-18T21:13:04.825 INFO:tasks.workunit.client.1.smithi103.stdout:2/874: write d3/d5/d2f/d93/f113 [542684,82598] 0 2024-09-18T21:13:04.827 INFO:tasks.workunit.client.1.smithi103.stdout:2/875: chown d3/d5/d2f/d32/d90/dd7/dc4/l106 3296342 1 2024-09-18T21:13:04.829 INFO:tasks.workunit.client.1.smithi103.stdout:9/943: fdatasync d18/d29/d68/d92/d9c/dc8/f10c 0 2024-09-18T21:13:04.830 INFO:tasks.workunit.client.0.smithi077.stdout:9/811: dwrite d1/dd/d11/d72/f98 [0,4194304] 0 2024-09-18T21:13:04.833 INFO:tasks.workunit.client.0.smithi077.stdout:3/825: fdatasync db/d14/d32/d49/da4/d71/f78 0 2024-09-18T21:13:04.841 INFO:tasks.workunit.client.0.smithi077.stdout:6/806: truncate d7/d7e/d11/d3e/d42/d88/da4/f105 2586509 0 2024-09-18T21:13:04.844 INFO:tasks.workunit.client.0.smithi077.stdout:3/826: link db/f28 db/d14/d32/d49/da4/d8a/d99/daf/f100 0 2024-09-18T21:13:04.844 INFO:tasks.workunit.client.0.smithi077.stdout:0/903: truncate d8/d10b/fd6 2062546 0 2024-09-18T21:13:04.845 INFO:tasks.workunit.client.1.smithi103.stdout:6/954: mknod d2/d3/d8/d4c/d4e/d10d/c131 0 2024-09-18T21:13:04.846 INFO:tasks.workunit.client.1.smithi103.stdout:1/886: dwrite d0/d2/d9/d10/f44 [0,4194304] 0 2024-09-18T21:13:04.849 INFO:tasks.workunit.client.1.smithi103.stdout:9/944: truncate f17 839823 0 2024-09-18T21:13:04.851 INFO:tasks.workunit.client.0.smithi077.stdout:3/827: dread db/d14/d22/d36/d39/f45 [0,4194304] 0 2024-09-18T21:13:04.851 INFO:tasks.workunit.client.0.smithi077.stdout:0/904: link d8/d37/ff1 d8/d1d/d110/f127 0 2024-09-18T21:13:04.857 INFO:tasks.workunit.client.1.smithi103.stdout:6/955: stat d2/d24/d5a/c1d 0 2024-09-18T21:13:04.858 INFO:tasks.workunit.client.1.smithi103.stdout:6/956: readlink d2/d3/d8/d4c/d79/led 0 2024-09-18T21:13:04.859 INFO:tasks.workunit.client.0.smithi077.stdout:3/828: dread db/d14/d22/d36/fc8 [0,4194304] 0 2024-09-18T21:13:04.859 INFO:tasks.workunit.client.0.smithi077.stdout:0/905: mkdir d8/d1a/d35/d6d/d128 0 2024-09-18T21:13:04.860 INFO:tasks.workunit.client.1.smithi103.stdout:0/893: rmdir d1/d5/de/dc0/d8c/dce/d9f/d4f/d68/d132 0 2024-09-18T21:13:04.861 INFO:tasks.workunit.client.1.smithi103.stdout:1/887: fsync d0/d2/d9/d9e/d7a/dd0/df9/f66 0 2024-09-18T21:13:04.864 INFO:tasks.workunit.client.1.smithi103.stdout:6/957: dwrite d2/d24/f108 [0,4194304] 0 2024-09-18T21:13:04.864 INFO:tasks.workunit.client.1.smithi103.stdout:5/972: link de/d1f/d3b/l84 de/d1f/d3b/d58/dc4/d33/d4f/da6/l142 0 2024-09-18T21:13:04.865 INFO:tasks.workunit.client.1.smithi103.stdout:6/958: fdatasync d2/d3/d7f/d91/de5/ff1 0 2024-09-18T21:13:04.871 INFO:tasks.workunit.client.0.smithi077.stdout:0/906: mkdir d8/d37/d95/d129 0 2024-09-18T21:13:04.871 INFO:tasks.workunit.client.1.smithi103.stdout:3/973: write d1/d2/d18/f46 [397075,48758] 0 2024-09-18T21:13:04.872 INFO:tasks.workunit.client.1.smithi103.stdout:0/894: mknod d1/d5/de/d22/d98/c138 0 2024-09-18T21:13:04.873 INFO:tasks.workunit.client.1.smithi103.stdout:0/895: dread - d1/d5/de/d24/d43/d76/f90 zero size 2024-09-18T21:13:04.874 INFO:tasks.workunit.client.0.smithi077.stdout:6/807: dread d7/d7e/d11/d3e/d42/f72 [0,4194304] 0 2024-09-18T21:13:04.874 INFO:tasks.workunit.client.1.smithi103.stdout:7/933: write d1/df/f18 [1565960,19670] 0 2024-09-18T21:13:04.878 INFO:tasks.workunit.client.1.smithi103.stdout:3/974: dread d1/d2/d18/d30/d4e/db1/d10e/f56 [0,4194304] 0 2024-09-18T21:13:04.885 INFO:tasks.workunit.client.1.smithi103.stdout:2/876: getdents d3/d5/d2f/d32/d90/dd7 0 2024-09-18T21:13:04.886 INFO:tasks.workunit.client.0.smithi077.stdout:6/808: symlink d7/d7e/d11/d3e/d42/dbb/d50/dd5/d100/l10f 0 2024-09-18T21:13:04.886 INFO:tasks.workunit.client.1.smithi103.stdout:2/877: write d3/d5/d2f/d32/f7d [1418999,88497] 0 2024-09-18T21:13:04.887 INFO:tasks.workunit.client.1.smithi103.stdout:2/878: truncate d3/d5/f4c 4907531 0 2024-09-18T21:13:04.887 INFO:tasks.workunit.client.1.smithi103.stdout:0/896: creat d1/d9/d48/f139 x:0 0 0 2024-09-18T21:13:04.888 INFO:tasks.workunit.client.1.smithi103.stdout:0/897: dread - d1/d5/de/d22/d98/f110 zero size 2024-09-18T21:13:04.888 INFO:tasks.workunit.client.1.smithi103.stdout:0/898: stat d1/d9/f52 0 2024-09-18T21:13:04.889 INFO:tasks.workunit.client.0.smithi077.stdout:0/907: rename d8/d1a/d39/d56/fde to d8/d1d/d110/f12a 0 2024-09-18T21:13:04.891 INFO:tasks.workunit.client.1.smithi103.stdout:1/888: mkdir d0/d2/d9/dc/d6e/deb/d138 0 2024-09-18T21:13:04.894 INFO:tasks.workunit.client.1.smithi103.stdout:7/934: unlink d1/df/d42/d29/d48/dbb/d33/d51/f80 0 2024-09-18T21:13:04.900 INFO:tasks.workunit.client.0.smithi077.stdout:3/829: truncate db/d14/d93/f96 552723 0 2024-09-18T21:13:04.900 INFO:tasks.workunit.client.1.smithi103.stdout:7/935: dwrite d1/df/d42/f83 [0,4194304] 0 2024-09-18T21:13:04.901 INFO:tasks.workunit.client.0.smithi077.stdout:6/809: dread d7/d7e/d11/d3e/d42/dbb/d49/fbc [0,4194304] 0 2024-09-18T21:13:04.902 INFO:tasks.workunit.client.0.smithi077.stdout:0/908: rename d8/d1a/f42 to d8/d1a/d39/d3b/f12b 0 2024-09-18T21:13:04.905 INFO:tasks.workunit.client.0.smithi077.stdout:3/830: mknod db/d14/d93/db6/c101 0 2024-09-18T21:13:04.907 INFO:tasks.workunit.client.0.smithi077.stdout:0/909: mkdir d8/d37/d66/d87/de0/d12c 0 2024-09-18T21:13:04.910 INFO:tasks.workunit.client.0.smithi077.stdout:0/910: symlink d8/d1d/d80/l12d 0 2024-09-18T21:13:04.913 INFO:tasks.workunit.client.1.smithi103.stdout:0/899: unlink d1/d9/d3e/fac 0 2024-09-18T21:13:04.914 INFO:tasks.workunit.client.1.smithi103.stdout:1/889: mknod d0/d11/d5f/c139 0 2024-09-18T21:13:04.918 INFO:tasks.workunit.client.1.smithi103.stdout:1/890: dread d0/f9d [0,4194304] 0 2024-09-18T21:13:04.919 INFO:tasks.workunit.client.0.smithi077.stdout:0/911: dwrite d8/d1a/d39/f59 [0,4194304] 0 2024-09-18T21:13:04.920 INFO:tasks.workunit.client.0.smithi077.stdout:6/810: rename d7/d7e/d11/d3e/d42/dbb/d50/dd5/d100 to d7/d7e/d11/d3e/d42/dbb/d49/d55/dc2/d110 0 2024-09-18T21:13:04.922 INFO:tasks.workunit.client.0.smithi077.stdout:6/811: chown d7/d7e/d11/d3e/d42/dbb/d49/f84 900887 1 2024-09-18T21:13:04.922 INFO:tasks.workunit.client.0.smithi077.stdout:6/812: stat d7/d7e/d11/d3e/d42/dbb/d31 0 2024-09-18T21:13:04.924 INFO:tasks.workunit.client.0.smithi077.stdout:3/831: rename db/d4d/c7d to db/d14/d32/d49/da4/d8a/d99/daf/de6/c102 0 2024-09-18T21:13:04.925 INFO:tasks.workunit.client.0.smithi077.stdout:3/832: read - db/d14/d22/dae/fc5 zero size 2024-09-18T21:13:04.927 INFO:tasks.workunit.client.1.smithi103.stdout:5/973: rmdir de/d1f/d3b/d51/d57/dc8/de8/d139 0 2024-09-18T21:13:04.929 INFO:tasks.workunit.client.1.smithi103.stdout:3/975: mknod d1/d23/c126 0 2024-09-18T21:13:04.930 INFO:tasks.workunit.client.1.smithi103.stdout:2/879: dread d3/d110/d11a/f37 [0,4194304] 0 2024-09-18T21:13:04.932 INFO:tasks.workunit.client.1.smithi103.stdout:3/976: truncate d1/d2/d18/d30/d4e/db1/d10e/d114/d4f/dce/ff0 590373 0 2024-09-18T21:13:04.933 INFO:tasks.workunit.client.0.smithi077.stdout:3/833: fsync db/d14/d22/d36/fa2 0 2024-09-18T21:13:04.934 INFO:tasks.workunit.client.1.smithi103.stdout:3/977: write d1/d2/d18/d30/d4e/db1/d10e/d114/d4f/d58/d68/d50/dea/df3/ff9 [3241524,40959] 0 2024-09-18T21:13:04.935 INFO:tasks.workunit.client.1.smithi103.stdout:3/978: stat d1/d2/d18/f46 0 2024-09-18T21:13:04.935 INFO:tasks.workunit.client.0.smithi077.stdout:0/912: rename d8/d26/f18 to d8/d1a/d39/d109/f12e 0 2024-09-18T21:13:04.936 INFO:tasks.workunit.client.1.smithi103.stdout:3/979: fsync d1/d2/d18/d30/d4e/db1/d10e/d114/da1/da5/de8/ff4 0 2024-09-18T21:13:04.936 INFO:tasks.workunit.client.1.smithi103.stdout:0/900: mknod d1/d5/de/dc0/dbf/d4e/c13a 0 2024-09-18T21:13:04.939 INFO:tasks.workunit.client.0.smithi077.stdout:3/834: creat db/d14/d22/d36/dd9/f103 x:0 0 0 2024-09-18T21:13:04.940 INFO:tasks.workunit.client.0.smithi077.stdout:3/835: truncate db/d14/d22/d36/fb4 4631274 0 2024-09-18T21:13:04.944 INFO:tasks.workunit.client.0.smithi077.stdout:6/813: rename d7/d7e/lbe to d7/d7e/d11/d3e/d42/dbb/d49/d55/dc2/d110/l111 0 2024-09-18T21:13:04.945 INFO:tasks.workunit.client.1.smithi103.stdout:5/974: mknod de/d1f/d3b/d51/c143 0 2024-09-18T21:13:04.946 INFO:tasks.workunit.client.0.smithi077.stdout:3/836: mknod db/d14/d32/d49/d4e/d6a/dec/c104 0 2024-09-18T21:13:04.948 INFO:tasks.workunit.client.1.smithi103.stdout:2/880: creat d3/d5/d2c/d54/d68/d102/d111/f131 x:0 0 0 2024-09-18T21:13:04.949 INFO:tasks.workunit.client.1.smithi103.stdout:2/881: chown c2 79875747 1 2024-09-18T21:13:04.950 INFO:tasks.workunit.client.0.smithi077.stdout:3/837: dread db/f54 [0,4194304] 0 2024-09-18T21:13:04.951 INFO:tasks.workunit.client.1.smithi103.stdout:6/959: sync 2024-09-18T21:13:04.952 INFO:tasks.workunit.client.1.smithi103.stdout:5/975: dwrite de/f2b [0,4194304] 0 2024-09-18T21:13:04.952 INFO:tasks.workunit.client.1.smithi103.stdout:7/936: dwrite d1/f17 [0,4194304] 0 2024-09-18T21:13:04.953 INFO:tasks.workunit.client.1.smithi103.stdout:6/960: dread - d2/d3/d8/d4c/d4e/d10d/f12d zero size 2024-09-18T21:13:04.954 INFO:tasks.workunit.client.1.smithi103.stdout:6/961: fdatasync d2/d24/d38/ffd 0 2024-09-18T21:13:04.955 INFO:tasks.workunit.client.1.smithi103.stdout:3/980: unlink d1/da/df/f77 0 2024-09-18T21:13:04.957 INFO:tasks.workunit.client.1.smithi103.stdout:3/981: chown d1/d2/d18/d30/d4e/db1/d10e/d114/d4f/d58/d68/d50/d54/d8c 3787425 1 2024-09-18T21:13:04.959 INFO:tasks.workunit.client.0.smithi077.stdout:0/913: rmdir d8/d1a/d39/d3b/d70/d11e 0 2024-09-18T21:13:04.960 INFO:tasks.workunit.client.0.smithi077.stdout:0/914: chown d8/d1a/d35/f82 6544080 1 2024-09-18T21:13:04.962 INFO:tasks.workunit.client.0.smithi077.stdout:3/838: mknod db/d14/d93/db6/c105 0 2024-09-18T21:13:04.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:04 smithi077 ceph-mon[27689]: pgmap v23: 65 pgs: 65 active+clean; 3.1 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 88 MiB/s rd, 234 MiB/s wr, 474 op/s 2024-09-18T21:13:04.972 INFO:tasks.workunit.client.0.smithi077.stdout:3/839: symlink db/d14/d32/d49/l106 0 2024-09-18T21:13:04.973 INFO:tasks.workunit.client.0.smithi077.stdout:6/814: rmdir d7/d7e/d11/d3e/d42/dbb/d49/d55/dc2/def 0 2024-09-18T21:13:04.973 INFO:tasks.workunit.client.1.smithi103.stdout:7/937: mknod d1/df/d42/d29/d48/dbb/ded/c13d 0 2024-09-18T21:13:04.975 INFO:tasks.workunit.client.1.smithi103.stdout:6/962: mknod d2/d3/d8/d4c/d79/c132 0 2024-09-18T21:13:04.975 INFO:tasks.workunit.client.1.smithi103.stdout:2/882: dwrite d3/d5/d2f/d48/dab/f117 [0,4194304] 0 2024-09-18T21:13:04.978 INFO:tasks.workunit.client.0.smithi077.stdout:6/815: rename d7/d7e/d11/d3e/d42/dbb/l41 to d7/d7e/d11/d3e/d42/dbb/d31/l112 0 2024-09-18T21:13:04.979 INFO:tasks.workunit.client.1.smithi103.stdout:5/976: dread de/d1f/d3b/d58/f9b [0,4194304] 0 2024-09-18T21:13:04.979 INFO:tasks.workunit.client.1.smithi103.stdout:7/938: read d1/df/d42/d1f/d2e/f41 [3965820,67147] 0 2024-09-18T21:13:04.979 INFO:tasks.workunit.client.1.smithi103.stdout:9/945: link d18/d52/d6f/d8e/d8f/dbd/dc3/fc4 d18/d52/d6f/db9/dcb/f13a 0 2024-09-18T21:13:04.979 INFO:tasks.workunit.client.1.smithi103.stdout:7/939: readlink d1/df/d43/d52/l92 0 2024-09-18T21:13:04.980 INFO:tasks.workunit.client.1.smithi103.stdout:9/946: write d18/da4/f126 [68668,25593] 0 2024-09-18T21:13:04.982 INFO:tasks.workunit.client.1.smithi103.stdout:6/963: creat d2/d24/d5a/d67/d76/d43/d44/f133 x:0 0 0 2024-09-18T21:13:04.984 INFO:tasks.workunit.client.1.smithi103.stdout:2/883: creat d3/d5/d2c/d77/d9c/f132 x:0 0 0 2024-09-18T21:13:04.987 INFO:tasks.workunit.client.1.smithi103.stdout:1/891: getdents d0/d11 0 2024-09-18T21:13:04.989 INFO:tasks.workunit.client.1.smithi103.stdout:5/977: creat de/d1f/d3b/d3c/d62/d118/f144 x:0 0 0 2024-09-18T21:13:04.991 INFO:tasks.workunit.client.1.smithi103.stdout:7/940: unlink d1/df/d44/db4/f111 0 2024-09-18T21:13:04.992 INFO:tasks.workunit.client.1.smithi103.stdout:9/947: symlink d18/d29/d68/d78/l13b 0 2024-09-18T21:13:04.993 INFO:tasks.workunit.client.1.smithi103.stdout:6/964: chown d2/d24/d5a/d67/d76/l41 598373 1 2024-09-18T21:13:04.994 INFO:tasks.workunit.client.1.smithi103.stdout:6/965: truncate d2/d3/d8/d4c/f12b 1017838 0 2024-09-18T21:13:05.000 INFO:tasks.workunit.client.0.smithi077.stdout:0/915: dread d8/d1a/d39/d3b/f5b [0,4194304] 0 2024-09-18T21:13:05.002 INFO:tasks.workunit.client.0.smithi077.stdout:0/916: creat d8/d10b/f12f x:0 0 0 2024-09-18T21:13:05.003 INFO:tasks.workunit.client.0.smithi077.stdout:6/816: truncate d7/f1f 2970553 0 2024-09-18T21:13:05.005 INFO:tasks.workunit.client.1.smithi103.stdout:5/978: link de/d1f/d3b/d3c/d62/d118/d11c/f11e de/d1f/d3b/d3c/d62/d118/d11c/f145 0 2024-09-18T21:13:05.005 INFO:tasks.workunit.client.1.smithi103.stdout:0/901: truncate d1/d5/de/d19/d1e/d34/f136 3162978 0 2024-09-18T21:13:05.006 INFO:tasks.workunit.client.0.smithi077.stdout:3/840: dwrite db/f68 [0,4194304] 0 2024-09-18T21:13:05.007 INFO:tasks.workunit.client.1.smithi103.stdout:2/884: write d3/d5/d2f/d48/f70 [193879,84065] 0 2024-09-18T21:13:05.008 INFO:tasks.workunit.client.1.smithi103.stdout:5/979: dread - de/d1f/d3b/d51/d57/dc8/f134 zero size 2024-09-18T21:13:05.008 INFO:tasks.workunit.client.1.smithi103.stdout:9/948: truncate d18/f24 936387 0 2024-09-18T21:13:05.009 INFO:tasks.workunit.client.1.smithi103.stdout:6/966: mkdir d2/d3/d8/d4c/d4e/d10d/d12f/d134 0 2024-09-18T21:13:05.012 INFO:tasks.workunit.client.1.smithi103.stdout:0/902: mknod d1/d5/de/dc0/d8c/dce/d9f/d4f/de8/c13b 0 2024-09-18T21:13:05.014 INFO:tasks.workunit.client.1.smithi103.stdout:3/982: dread d1/d2/d18/f44 [0,4194304] 0 2024-09-18T21:13:05.014 INFO:tasks.workunit.client.0.smithi077.stdout:6/817: dwrite d7/d7e/d11/d3e/d42/d88/fbd [0,4194304] 0 2024-09-18T21:13:05.015 INFO:tasks.workunit.client.1.smithi103.stdout:2/885: mkdir d3/d5/d2f/d133 0 2024-09-18T21:13:05.015 INFO:tasks.workunit.client.1.smithi103.stdout:0/903: dread - d1/d5/de/d24/d43/d76/dc5/f10b zero size 2024-09-18T21:13:05.016 INFO:tasks.workunit.client.1.smithi103.stdout:7/941: dwrite d1/df/d42/d29/d48/dbb/d33/fb3 [0,4194304] 0 2024-09-18T21:13:05.018 INFO:tasks.workunit.client.1.smithi103.stdout:9/949: symlink d18/d29/d68/dff/l13c 0 2024-09-18T21:13:05.020 INFO:tasks.workunit.client.1.smithi103.stdout:9/950: write d18/d29/d68/d92/d9c/dc8/f134 [675925,42203] 0 2024-09-18T21:13:05.022 INFO:tasks.workunit.client.1.smithi103.stdout:9/951: chown d18/d29/d68/d92/dd1/le6 159450955 1 2024-09-18T21:13:05.022 INFO:tasks.workunit.client.1.smithi103.stdout:9/952: read - d18/d52/d6f/db9/fbc zero size 2024-09-18T21:13:05.023 INFO:tasks.workunit.client.0.smithi077.stdout:6/818: dwrite d7/d7e/d11/d3e/f78 [0,4194304] 0 2024-09-18T21:13:05.025 INFO:tasks.workunit.client.1.smithi103.stdout:2/886: chown d3/l1f 47779535 1 2024-09-18T21:13:05.029 INFO:tasks.workunit.client.0.smithi077.stdout:3/841: dwrite db/d14/d32/f55 [4194304,4194304] 0 2024-09-18T21:13:05.031 INFO:tasks.workunit.client.1.smithi103.stdout:7/942: unlink d1/df/d42/d1f/d5d/dbe/cd3 0 2024-09-18T21:13:05.032 INFO:tasks.workunit.client.1.smithi103.stdout:7/943: chown d1/df/d42/d1f/d5d/d85 83970895 1 2024-09-18T21:13:05.037 INFO:tasks.workunit.client.1.smithi103.stdout:9/953: symlink d18/d29/d68/d92/dd1/l13d 0 2024-09-18T21:13:05.038 INFO:tasks.workunit.client.1.smithi103.stdout:0/904: mknod d1/d5/de/c13c 0 2024-09-18T21:13:05.038 INFO:tasks.workunit.client.1.smithi103.stdout:7/944: read d1/df/d42/d1f/d2e/d3f/f91 [3393317,94073] 0 2024-09-18T21:13:05.039 INFO:tasks.workunit.client.1.smithi103.stdout:3/983: mkdir d1/d2/d18/d30/d4e/db1/d10e/d114/d4f/d72/d127 0 2024-09-18T21:13:05.040 INFO:tasks.workunit.client.1.smithi103.stdout:7/945: stat d1/df/d43/d63/d67/dc3/l11e 0 2024-09-18T21:13:05.042 INFO:tasks.workunit.client.1.smithi103.stdout:7/946: mknod d1/df/d43/d61/d122/c13e 0 2024-09-18T21:13:05.042 INFO:tasks.workunit.client.1.smithi103.stdout:9/954: write d18/d52/d6f/d8e/d8f/dbd/f129 [683849,106764] 0 2024-09-18T21:13:05.044 INFO:tasks.workunit.client.1.smithi103.stdout:3/984: read - d1/d2/d18/d30/d4e/db1/d10e/dbb/f9b zero size 2024-09-18T21:13:05.045 INFO:tasks.workunit.client.1.smithi103.stdout:0/905: dread d1/d5/de/d24/f32 [0,4194304] 0 2024-09-18T21:13:05.045 INFO:tasks.workunit.client.1.smithi103.stdout:7/947: mkdir d1/df/d43/d52/dfa/d13f 0 2024-09-18T21:13:05.046 INFO:tasks.workunit.client.1.smithi103.stdout:7/948: readlink d1/l1a 0 2024-09-18T21:13:05.047 INFO:tasks.workunit.client.1.smithi103.stdout:0/906: symlink d1/dcf/l13d 0 2024-09-18T21:13:05.048 INFO:tasks.workunit.client.1.smithi103.stdout:9/955: truncate d18/d52/f8b 1175513 0 2024-09-18T21:13:05.048 INFO:tasks.workunit.client.1.smithi103.stdout:0/907: chown d1/d5/de/d19/ff7 5 1 2024-09-18T21:13:05.049 INFO:tasks.workunit.client.1.smithi103.stdout:9/956: chown d18/d29/d68/d92/d9c/fae 41970477 1 2024-09-18T21:13:05.049 INFO:tasks.workunit.client.1.smithi103.stdout:0/908: readlink d1/d5/de/dc0/d8c/dce/d9f/d8d/l115 0 2024-09-18T21:13:05.049 INFO:tasks.workunit.client.1.smithi103.stdout:0/909: fdatasync d1/d9/f2b 0 2024-09-18T21:13:05.050 INFO:tasks.workunit.client.1.smithi103.stdout:7/949: mkdir d1/df/d42/d1f/d5d/d85/db0/dc2/d140 0 2024-09-18T21:13:05.051 INFO:tasks.workunit.client.1.smithi103.stdout:0/910: chown d1/d5/de/dc0/d8c/dce/d9f/d4f/de8/c13b 1 1 2024-09-18T21:13:05.052 INFO:tasks.workunit.client.1.smithi103.stdout:9/957: rmdir d18/d52/d6f/d8e/df7 39 2024-09-18T21:13:05.055 INFO:tasks.workunit.client.1.smithi103.stdout:5/980: write de/d1f/d3b/d51/f64 [2516980,71412] 0 2024-09-18T21:13:05.056 INFO:tasks.workunit.client.1.smithi103.stdout:9/958: creat d18/d52/d6f/d8e/d8f/dbd/dc3/f13e x:0 0 0 2024-09-18T21:13:05.060 INFO:tasks.workunit.client.1.smithi103.stdout:9/959: dread - d18/d52/d6f/db9/dcb/ffa zero size 2024-09-18T21:13:05.060 INFO:tasks.workunit.client.1.smithi103.stdout:6/967: truncate d2/d24/d38/f89 138730 0 2024-09-18T21:13:05.061 INFO:tasks.workunit.client.1.smithi103.stdout:9/960: read - d18/d52/d6f/fdb zero size 2024-09-18T21:13:05.061 INFO:tasks.workunit.client.0.smithi077.stdout:3/842: write f4 [1177244,64201] 0 2024-09-18T21:13:05.062 INFO:tasks.workunit.client.1.smithi103.stdout:9/961: write d18/d52/d6f/d8e/d8f/fb3 [223607,14199] 0 2024-09-18T21:13:05.063 INFO:tasks.workunit.client.0.smithi077.stdout:3/843: dread - db/d14/d22/d36/dd9/f103 zero size 2024-09-18T21:13:05.065 INFO:tasks.workunit.client.0.smithi077.stdout:6/819: dwrite d7/f1c [0,4194304] 0 2024-09-18T21:13:05.067 INFO:tasks.workunit.client.1.smithi103.stdout:9/962: fsync d18/d52/d6f/db9/fbc 0 2024-09-18T21:13:05.069 INFO:tasks.workunit.client.1.smithi103.stdout:2/887: truncate d3/d110/d11a/d98/fbb 921330 0 2024-09-18T21:13:05.073 INFO:tasks.workunit.client.0.smithi077.stdout:3/844: creat db/d14/d32/d49/d4e/d8b/dc9/f107 x:0 0 0 2024-09-18T21:13:05.074 INFO:tasks.workunit.client.1.smithi103.stdout:3/985: truncate d1/f2e 1436519 0 2024-09-18T21:13:05.074 INFO:tasks.workunit.client.0.smithi077.stdout:6/820: dwrite d7/d7e/d11/d3e/f106 [0,4194304] 0 2024-09-18T21:13:05.076 INFO:tasks.workunit.client.1.smithi103.stdout:3/986: fsync d1/d2/d18/d30/d4e/db1/d10e/d114/d4f/d72/d85/d93/d116/f11a 0 2024-09-18T21:13:05.079 INFO:tasks.workunit.client.1.smithi103.stdout:2/888: fsync d3/d5/d2c/f3e 0 2024-09-18T21:13:05.080 INFO:tasks.workunit.client.0.smithi077.stdout:3/845: mkdir db/d14/d32/d49/d4e/d8b/d108 0 2024-09-18T21:13:05.081 INFO:tasks.workunit.client.1.smithi103.stdout:9/963: creat d18/d8d/d11d/f13f x:0 0 0 2024-09-18T21:13:05.082 INFO:tasks.workunit.client.1.smithi103.stdout:9/964: fsync d18/d52/d6f/db9/f104 0 2024-09-18T21:13:05.082 INFO:tasks.workunit.client.1.smithi103.stdout:7/950: write d1/df/d42/d1f/d2e/f87 [1976990,43539] 0 2024-09-18T21:13:05.083 INFO:tasks.workunit.client.1.smithi103.stdout:0/911: truncate d1/d93/fe0 3585301 0 2024-09-18T21:13:05.086 INFO:tasks.workunit.client.0.smithi077.stdout:3/846: getdents db/d14/d32/de9 0 2024-09-18T21:13:05.088 INFO:tasks.workunit.client.1.smithi103.stdout:6/968: write d2/d3/d8/f128 [224690,50072] 0 2024-09-18T21:13:05.088 INFO:tasks.workunit.client.0.smithi077.stdout:6/821: link d7/le6 d7/d7e/da6/l113 0 2024-09-18T21:13:05.088 INFO:tasks.workunit.client.1.smithi103.stdout:5/981: dwrite de/d1f/d3b/d3c/d62/ffc [0,4194304] 0 2024-09-18T21:13:05.089 INFO:tasks.workunit.client.1.smithi103.stdout:3/987: creat d1/d2/d18/d30/d4e/db1/d10e/d114/da1/dd8/d11e/f128 x:0 0 0 2024-09-18T21:13:05.090 INFO:tasks.workunit.client.0.smithi077.stdout:6/822: truncate d7/d7e/d11/d3e/d42/d88/ff1 286167 0 2024-09-18T21:13:05.091 INFO:tasks.workunit.client.1.smithi103.stdout:3/988: dread - d1/d2/d18/d30/d4e/db1/d10e/dbb/f9b zero size 2024-09-18T21:13:05.092 INFO:tasks.workunit.client.0.smithi077.stdout:3/847: mknod db/d14/d32/de9/c109 0 2024-09-18T21:13:05.092 INFO:tasks.workunit.client.1.smithi103.stdout:1/892: sync 2024-09-18T21:13:05.095 INFO:tasks.workunit.client.0.smithi077.stdout:3/848: fsync db/d14/d32/f56 0 2024-09-18T21:13:05.097 INFO:tasks.workunit.client.1.smithi103.stdout:5/982: mknod de/d1f/d3b/d3c/d62/d108/c146 0 2024-09-18T21:13:05.097 INFO:tasks.workunit.client.1.smithi103.stdout:3/989: dwrite d1/d2/d18/d30/f38 [4194304,4194304] 0 2024-09-18T21:13:05.098 INFO:tasks.workunit.client.1.smithi103.stdout:7/951: creat d1/df/d43/d63/d67/d5b/d10e/f141 x:0 0 0 2024-09-18T21:13:05.100 INFO:tasks.workunit.client.1.smithi103.stdout:5/983: chown de/d1f/d3b/d51/d57/d59/fb3 1734758878 1 2024-09-18T21:13:05.101 INFO:tasks.workunit.client.1.smithi103.stdout:7/952: write d1/df/dbf/feb [421197,51254] 0 2024-09-18T21:13:05.102 INFO:tasks.workunit.client.1.smithi103.stdout:3/990: fdatasync d1/d2/d18/d30/d4e/db1/d10e/d114/d4f/d72/d85/dd9/dcd/f101 0 2024-09-18T21:13:05.104 INFO:tasks.workunit.client.1.smithi103.stdout:6/969: dwrite d2/d24/d38/d68/dac/fc8 [0,4194304] 0 2024-09-18T21:13:05.109 INFO:tasks.workunit.client.1.smithi103.stdout:5/984: dwrite de/d1f/d3b/d58/dc4/d33/d4f/da6/f137 [0,4194304] 0 2024-09-18T21:13:05.155 INFO:tasks.workunit.client.0.smithi077.stdout:5/884: sync 2024-09-18T21:13:05.224 INFO:tasks.workunit.client.0.smithi077.stdout:3/849: rename db/d14/d32/d49/cfd to db/d14/d22/d36/dd9/c10a 0 2024-09-18T21:13:05.226 INFO:tasks.workunit.client.0.smithi077.stdout:5/885: unlink d0/df/d10/d5c/d9b/lb4 0 2024-09-18T21:13:05.227 INFO:tasks.workunit.client.0.smithi077.stdout:5/886: chown d0/df/d10/d5c/d9b 11664615 1 2024-09-18T21:13:05.228 INFO:tasks.workunit.client.0.smithi077.stdout:3/850: mkdir db/d14/d32/d49/d6b/d10b 0 2024-09-18T21:13:05.229 INFO:tasks.workunit.client.0.smithi077.stdout:3/851: readlink db/d14/d93/db6/ldb 0 2024-09-18T21:13:05.232 INFO:tasks.workunit.client.1.smithi103.stdout:7/953: write d1/df/f116 [3457889,71439] 0 2024-09-18T21:13:05.232 INFO:tasks.workunit.client.0.smithi077.stdout:3/852: read db/d14/d32/d49/d4e/d6a/f88 [104468,51083] 0 2024-09-18T21:13:05.238 INFO:tasks.workunit.client.1.smithi103.stdout:6/970: mknod d2/d24/d38/d68/dac/c135 0 2024-09-18T21:13:05.239 INFO:tasks.workunit.client.0.smithi077.stdout:3/853: fdatasync db/d14/d32/d49/d4e/d6a/f6c 0 2024-09-18T21:13:05.240 INFO:tasks.workunit.client.0.smithi077.stdout:5/887: link d0/d6/c3f d0/d6/dd/da5/c123 0 2024-09-18T21:13:05.241 INFO:tasks.workunit.client.1.smithi103.stdout:3/991: dwrite d1/d9a/f111 [0,4194304] 0 2024-09-18T21:13:05.243 INFO:tasks.workunit.client.1.smithi103.stdout:2/889: getdents d3/d110/d11a/d98 0 2024-09-18T21:13:05.245 INFO:tasks.workunit.client.1.smithi103.stdout:0/912: getdents d1/d5/de/d24/d43/dfd 0 2024-09-18T21:13:05.245 INFO:tasks.workunit.client.1.smithi103.stdout:9/965: dwrite d18/d52/d6f/db9/ff2 [0,4194304] 0 2024-09-18T21:13:05.246 INFO:tasks.workunit.client.1.smithi103.stdout:0/913: fdatasync d1/d5/de/d22/d6a/f10c 0 2024-09-18T21:13:05.252 INFO:tasks.workunit.client.0.smithi077.stdout:5/888: dwrite d0/df/d10/d5c/d74/d89/f10e [0,4194304] 0 2024-09-18T21:13:05.252 INFO:tasks.workunit.client.0.smithi077.stdout:6/823: dwrite d7/d7e/d11/d3e/d42/dbb/d50/fdb [0,4194304] 0 2024-09-18T21:13:05.256 INFO:tasks.workunit.client.0.smithi077.stdout:3/854: dwrite db/f2e [0,4194304] 0 2024-09-18T21:13:05.262 INFO:tasks.workunit.client.1.smithi103.stdout:5/985: mkdir de/d1f/d3b/d147 0 2024-09-18T21:13:05.263 INFO:tasks.workunit.client.0.smithi077.stdout:5/889: fsync d0/df/d10/d4b/f60 0 2024-09-18T21:13:05.265 INFO:tasks.workunit.client.1.smithi103.stdout:1/893: write d0/d2/d9/dc/d36/f6d [382437,22275] 0 2024-09-18T21:13:05.265 INFO:tasks.workunit.client.0.smithi077.stdout:5/890: dread - d0/d6/daa/f106 zero size 2024-09-18T21:13:05.266 INFO:tasks.workunit.client.0.smithi077.stdout:6/824: chown d7/d7e/d11/d3e/d42/dbb/d4c/cae 31995002 1 2024-09-18T21:13:05.274 INFO:tasks.workunit.client.1.smithi103.stdout:1/894: dwrite d0/d2/d9/dc/d6e/dac/ffe [0,4194304] 0 2024-09-18T21:13:05.275 INFO:tasks.workunit.client.0.smithi077.stdout:6/825: mkdir d7/d7e/d11/d3e/d42/dbb/d5c/d114 0 2024-09-18T21:13:05.277 INFO:tasks.workunit.client.1.smithi103.stdout:0/914: rename d1/d9/d3e/f67 to d1/d9/d3e/d121/f13e 0 2024-09-18T21:13:05.280 INFO:tasks.workunit.client.0.smithi077.stdout:5/891: link d0/d6/dd/d5d/le4 d0/df/d10/d5c/d74/d89/l124 0 2024-09-18T21:13:05.281 INFO:tasks.workunit.client.1.smithi103.stdout:9/966: dwrite d18/d52/d6f/df8/d105/f125 [0,4194304] 0 2024-09-18T21:13:05.285 INFO:tasks.workunit.client.0.smithi077.stdout:5/892: link d0/d6/d3b/f4e d0/d6/dd/f125 0 2024-09-18T21:13:05.286 INFO:tasks.workunit.client.1.smithi103.stdout:0/915: truncate d1/d5/de/d24/d43/d76/dc5/f124 912251 0 2024-09-18T21:13:05.286 INFO:tasks.workunit.client.1.smithi103.stdout:2/890: mkdir d3/d5/d2f/d48/d134 0 2024-09-18T21:13:05.287 INFO:tasks.workunit.client.0.smithi077.stdout:5/893: dread - d0/d6/dde/f102 zero size 2024-09-18T21:13:05.287 INFO:tasks.workunit.client.1.smithi103.stdout:9/967: read d18/d52/d6f/db9/f104 [3670244,104840] 0 2024-09-18T21:13:05.288 INFO:tasks.workunit.client.0.smithi077.stdout:5/894: chown d0/d6/l17 186532 1 2024-09-18T21:13:05.289 INFO:tasks.workunit.client.1.smithi103.stdout:2/891: read - d3/d5/d2f/d32/ffb zero size 2024-09-18T21:13:05.289 INFO:tasks.workunit.client.0.smithi077.stdout:5/895: mkdir d0/d6/d40/d107/d126 0 2024-09-18T21:13:05.291 INFO:tasks.workunit.client.1.smithi103.stdout:0/916: rename d1/d5/de/d24/d43/d76/f90 to d1/d5/de/d22/d6a/f13f 0 2024-09-18T21:13:05.292 INFO:tasks.workunit.client.0.smithi077.stdout:5/896: creat d0/df/d10/d47/db6/f127 x:0 0 0 2024-09-18T21:13:05.315 INFO:tasks.workunit.client.0.smithi077.stdout:2/872: sync 2024-09-18T21:13:05.315 INFO:tasks.workunit.client.0.smithi077.stdout:8/771: sync 2024-09-18T21:13:05.316 INFO:tasks.workunit.client.0.smithi077.stdout:8/772: chown d2/d5f/da8/d4f/ldf 23 1 2024-09-18T21:13:05.318 INFO:tasks.workunit.client.0.smithi077.stdout:8/773: write f1 [2828491,33959] 0 2024-09-18T21:13:05.319 INFO:tasks.workunit.client.0.smithi077.stdout:5/897: dread d0/df/d10/d5c/d74/ff0 [0,4194304] 0 2024-09-18T21:13:05.320 INFO:tasks.workunit.client.0.smithi077.stdout:2/873: chown d1/d4/d5/d1a/d2e/d41/c84 90822364 1 2024-09-18T21:13:05.324 INFO:tasks.workunit.client.0.smithi077.stdout:2/874: mkdir d1/d4/d5/d1a/d113/d81/d122/d129 0 2024-09-18T21:13:05.325 INFO:tasks.workunit.client.0.smithi077.stdout:2/875: truncate d1/d4/fbd 1603645 0 2024-09-18T21:13:05.326 INFO:tasks.workunit.client.0.smithi077.stdout:2/876: read d1/fd [1683922,1012] 0 2024-09-18T21:13:05.332 INFO:tasks.workunit.client.1.smithi103.stdout:7/954: write d1/df/d42/d1f/d2e/fa8 [1364139,25583] 0 2024-09-18T21:13:05.332 INFO:tasks.workunit.client.1.smithi103.stdout:3/992: dwrite d1/d2/d18/d30/d4e/f84 [0,4194304] 0 2024-09-18T21:13:05.334 INFO:tasks.workunit.client.0.smithi077.stdout:3/855: dwrite db/d14/d32/d49/da4/d71/d3b/f7e [0,4194304] 0 2024-09-18T21:13:05.335 INFO:tasks.workunit.client.1.smithi103.stdout:5/986: write de/d2d/d7f/f78 [165425,15472] 0 2024-09-18T21:13:05.335 INFO:tasks.workunit.client.1.smithi103.stdout:1/895: write d0/d2/d9/f92 [980184,107593] 0 2024-09-18T21:13:05.336 INFO:tasks.workunit.client.0.smithi077.stdout:5/898: getdents d0/d6/d40/d107 0 2024-09-18T21:13:05.337 INFO:tasks.workunit.client.1.smithi103.stdout:7/955: symlink d1/l142 0 2024-09-18T21:13:05.339 INFO:tasks.workunit.client.1.smithi103.stdout:9/968: write d18/d29/d68/d92/d9c/fae [4753472,117145] 0 2024-09-18T21:13:05.341 INFO:tasks.workunit.client.1.smithi103.stdout:7/956: write d1/df/d42/d29/d48/dbb/ded/f10f [328065,5560] 0 2024-09-18T21:13:05.342 INFO:tasks.workunit.client.1.smithi103.stdout:3/993: symlink d1/d64/l129 0 2024-09-18T21:13:05.342 INFO:tasks.workunit.client.1.smithi103.stdout:1/896: dwrite d0/d2/d9/d10/d5d/d6f/f8b [0,4194304] 0 2024-09-18T21:13:05.344 INFO:tasks.workunit.client.0.smithi077.stdout:3/856: creat db/d14/d22/d36/f10c x:0 0 0 2024-09-18T21:13:05.344 INFO:tasks.workunit.client.1.smithi103.stdout:3/994: fdatasync d1/d2/d18/d30/d4e/db1/d10e/d114/d4f/dce/fdb 0 2024-09-18T21:13:05.346 INFO:tasks.workunit.client.0.smithi077.stdout:3/857: truncate db/d14/d22/ffa 498267 0 2024-09-18T21:13:05.347 INFO:tasks.workunit.client.1.smithi103.stdout:0/917: write d1/d5/de/d19/d1e/fb8 [791217,77260] 0 2024-09-18T21:13:05.348 INFO:tasks.workunit.client.1.smithi103.stdout:9/969: mknod d18/d52/d6f/df8/d105/c140 0 2024-09-18T21:13:05.350 INFO:tasks.workunit.client.1.smithi103.stdout:0/918: write d1/fd [2705686,117053] 0 2024-09-18T21:13:05.352 INFO:tasks.workunit.client.0.smithi077.stdout:8/774: dwrite d2/d5f/da8/f1b [0,4194304] 0 2024-09-18T21:13:05.352 INFO:tasks.workunit.client.0.smithi077.stdout:2/877: write d1/d4/d5/d1a/d2e/d7e/ff4 [146114,45374] 0 2024-09-18T21:13:05.352 INFO:tasks.workunit.client.0.smithi077.stdout:5/899: dread d0/d6/d3b/fe0 [0,4194304] 0 2024-09-18T21:13:05.353 INFO:tasks.workunit.client.1.smithi103.stdout:2/892: dwrite d3/d5/d4a/d56/fd8 [0,4194304] 0 2024-09-18T21:13:05.356 INFO:tasks.workunit.client.0.smithi077.stdout:3/858: dread db/d14/d32/d49/da4/d8a/d99/daf/fbe [0,4194304] 0 2024-09-18T21:13:05.357 INFO:tasks.workunit.client.1.smithi103.stdout:7/957: creat d1/df/d42/d29/de5/f143 x:0 0 0 2024-09-18T21:13:05.358 INFO:tasks.workunit.client.1.smithi103.stdout:0/919: dwrite d1/d5/de/d19/d1e/ff0 [0,4194304] 0 2024-09-18T21:13:05.359 INFO:tasks.workunit.client.0.smithi077.stdout:3/859: fsync db/d14/d22/ffa 0 2024-09-18T21:13:05.361 INFO:tasks.workunit.client.0.smithi077.stdout:3/860: read db/f2e [463940,29235] 0 2024-09-18T21:13:05.363 INFO:tasks.workunit.client.0.smithi077.stdout:5/900: dread d0/df/d10/d5c/d74/d89/f10e [0,4194304] 0 2024-09-18T21:13:05.364 INFO:tasks.workunit.client.0.smithi077.stdout:8/775: fsync d2/d5f/da8/d4f/d5a/d5e/f83 0 2024-09-18T21:13:05.365 INFO:tasks.workunit.client.0.smithi077.stdout:2/878: dwrite d1/d4/d5/d1a/d2e/f97 [4194304,4194304] 0 2024-09-18T21:13:05.366 INFO:tasks.workunit.client.1.smithi103.stdout:0/920: dwrite d1/d5/de/d19/fdc [0,4194304] 0 2024-09-18T21:13:05.368 INFO:tasks.workunit.client.1.smithi103.stdout:9/970: rmdir d18/d52/d6f/df8 39 2024-09-18T21:13:05.369 INFO:tasks.workunit.client.1.smithi103.stdout:1/897: dread - d0/d2/d2b/d3a/d42/d9c/f130 zero size 2024-09-18T21:13:05.371 INFO:tasks.workunit.client.0.smithi077.stdout:3/861: creat db/d14/d22/d36/f10d x:0 0 0 2024-09-18T21:13:05.372 INFO:tasks.workunit.client.0.smithi077.stdout:8/776: creat d2/d5f/da8/d4f/d5a/d2a/dc8/df1/f111 x:0 0 0 2024-09-18T21:13:05.373 INFO:tasks.workunit.client.0.smithi077.stdout:5/901: read d0/d6/d3b/fb5 [1355990,130762] 0 2024-09-18T21:13:05.374 INFO:tasks.workunit.client.0.smithi077.stdout:8/777: chown d2/d27/c86 9627208 1 2024-09-18T21:13:05.375 INFO:tasks.workunit.client.1.smithi103.stdout:2/893: dwrite d3/d5/d2f/fc5 [0,4194304] 0 2024-09-18T21:13:05.375 INFO:tasks.workunit.client.0.smithi077.stdout:5/902: chown d0/df 49 1 2024-09-18T21:13:05.376 INFO:tasks.workunit.client.1.smithi103.stdout:2/894: chown d3/db3/d12a/fdc 246 1 2024-09-18T21:13:05.381 INFO:tasks.workunit.client.0.smithi077.stdout:3/862: rmdir db/d14/d32/d49/da4/d8a/ddd 39 2024-09-18T21:13:05.382 INFO:tasks.workunit.client.1.smithi103.stdout:7/958: mknod d1/df/d44/dba/c144 0 2024-09-18T21:13:05.383 INFO:tasks.workunit.client.1.smithi103.stdout:0/921: rmdir d1/daf 39 2024-09-18T21:13:05.383 INFO:tasks.workunit.client.1.smithi103.stdout:6/971: sync 2024-09-18T21:13:05.384 INFO:tasks.workunit.client.1.smithi103.stdout:6/972: fdatasync d2/d3/d8/f2d 0 2024-09-18T21:13:05.386 INFO:tasks.workunit.client.1.smithi103.stdout:6/973: chown d2/d24/d5a/d67/d76/d43/d44/f133 59880174 1 2024-09-18T21:13:05.387 INFO:tasks.workunit.client.1.smithi103.stdout:6/974: fsync d2/d24/d5a/d67/d76/d43/f11d 0 2024-09-18T21:13:05.388 INFO:tasks.workunit.client.0.smithi077.stdout:8/778: symlink d2/d5f/da8/d4f/d5a/d2a/dc8/l112 0 2024-09-18T21:13:05.388 INFO:tasks.workunit.client.1.smithi103.stdout:0/922: dread d1/d9/d3e/d6e/f11c [0,4194304] 0 2024-09-18T21:13:05.390 INFO:tasks.workunit.client.0.smithi077.stdout:8/779: truncate d2/d5f/da8/d20/fa1 992039 0 2024-09-18T21:13:05.390 INFO:tasks.workunit.client.1.smithi103.stdout:7/959: fdatasync d1/df/d42/d121/f137 0 2024-09-18T21:13:05.391 INFO:tasks.workunit.client.1.smithi103.stdout:7/960: write d1/df/f116 [1217480,104418] 0 2024-09-18T21:13:05.391 INFO:tasks.workunit.client.0.smithi077.stdout:2/879: getdents d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d95 0 2024-09-18T21:13:05.392 INFO:tasks.workunit.client.0.smithi077.stdout:8/780: chown d2/d5f/da8/d4f/d5a/d2a/dc8/df1/lf9 2083845 1 2024-09-18T21:13:05.392 INFO:tasks.workunit.client.1.smithi103.stdout:7/961: write d1/df/d42/d121/d72/fe8 [4217111,94083] 0 2024-09-18T21:13:05.393 INFO:tasks.workunit.client.1.smithi103.stdout:3/995: getdents d1/d2/d18/d30/d4e/db1/d10e/d114/d4f/d58/d86 0 2024-09-18T21:13:05.394 INFO:tasks.workunit.client.1.smithi103.stdout:7/962: write d1/df/d43/d61/fb8 [415030,70925] 0 2024-09-18T21:13:05.395 INFO:tasks.workunit.client.1.smithi103.stdout:6/975: creat d2/d3/d8/f136 x:0 0 0 2024-09-18T21:13:05.396 INFO:tasks.workunit.client.1.smithi103.stdout:7/963: truncate d1/df/d42/d1f/f11d 474209 0 2024-09-18T21:13:05.396 INFO:tasks.workunit.client.1.smithi103.stdout:6/976: chown d2/d3/d8/d4c/d4e/l73 0 1 2024-09-18T21:13:05.397 INFO:tasks.workunit.client.1.smithi103.stdout:0/923: creat d1/d5/de/d24/d43/d76/dc5/f140 x:0 0 0 2024-09-18T21:13:05.398 INFO:tasks.workunit.client.1.smithi103.stdout:1/898: mknod d0/d2/d2b/d3a/d42/d72/d126/c13a 0 2024-09-18T21:13:05.398 INFO:tasks.workunit.client.0.smithi077.stdout:2/880: dwrite d1/d4/fbd [0,4194304] 0 2024-09-18T21:13:05.402 INFO:tasks.workunit.client.1.smithi103.stdout:9/971: rename d18/d52/d6f/db9/de0/de7/c119 to d18/c141 0 2024-09-18T21:13:05.403 INFO:tasks.workunit.client.1.smithi103.stdout:9/972: stat d18/d52/d6f/d8e/d8f/dbd/df1/dfe 0 2024-09-18T21:13:05.404 INFO:tasks.workunit.client.1.smithi103.stdout:3/996: symlink d1/d2/d18/d30/d4e/db1/d10e/d114/dcf/l12a 0 2024-09-18T21:13:05.406 INFO:tasks.workunit.client.1.smithi103.stdout:3/997: truncate d1/d2/d18/d30/d4e/db1/d10e/dbb/f5c 1456869 0 2024-09-18T21:13:05.409 INFO:tasks.workunit.client.0.smithi077.stdout:2/881: getdents d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d83/dba/dcd 0 2024-09-18T21:13:05.410 INFO:tasks.workunit.client.1.smithi103.stdout:0/924: creat d1/dcf/d109/f141 x:0 0 0 2024-09-18T21:13:05.412 INFO:tasks.workunit.client.0.smithi077.stdout:2/882: mkdir d1/d12a 0 2024-09-18T21:13:05.413 INFO:tasks.workunit.client.1.smithi103.stdout:0/925: mknod d1/d5/de/dc0/d8c/dce/d9f/d8d/c142 0 2024-09-18T21:13:05.414 INFO:tasks.workunit.client.1.smithi103.stdout:1/899: creat d0/d2/d9/d9e/d7a/dd0/df9/d68/d81/da2/da4/f13b x:0 0 0 2024-09-18T21:13:05.415 INFO:tasks.workunit.client.1.smithi103.stdout:9/973: creat d18/d52/d6f/d8e/f142 x:0 0 0 2024-09-18T21:13:05.418 INFO:tasks.workunit.client.1.smithi103.stdout:0/926: symlink d1/d5/de/l143 0 2024-09-18T21:13:05.419 INFO:tasks.workunit.client.0.smithi077.stdout:2/883: fsync d1/d4/d5/d1a/d2e/d41/fc3 0 2024-09-18T21:13:05.420 INFO:tasks.workunit.client.1.smithi103.stdout:9/974: mkdir d18/d8d/d11d/d143 0 2024-09-18T21:13:05.422 INFO:tasks.workunit.client.1.smithi103.stdout:0/927: symlink d1/d9/d3e/dfc/l144 0 2024-09-18T21:13:05.429 INFO:tasks.workunit.client.1.smithi103.stdout:5/987: sync 2024-09-18T21:13:05.430 INFO:tasks.workunit.client.1.smithi103.stdout:5/988: chown de/d2d/d7f/f65 7 1 2024-09-18T21:13:05.431 INFO:tasks.workunit.client.1.smithi103.stdout:5/989: symlink de/d1f/d3b/d3c/l148 0 2024-09-18T21:13:05.432 INFO:tasks.workunit.client.1.smithi103.stdout:5/990: write de/d1f/d3b/d3c/fb6 [1131391,33534] 0 2024-09-18T21:13:05.434 INFO:tasks.workunit.client.1.smithi103.stdout:5/991: symlink de/d1f/d3b/d51/d57/d79/d8d/l149 0 2024-09-18T21:13:05.436 INFO:tasks.workunit.client.1.smithi103.stdout:5/992: fdatasync de/d1f/d3b/d58/dc4/d33/f7c 0 2024-09-18T21:13:05.440 INFO:tasks.workunit.client.1.smithi103.stdout:5/993: creat de/d1f/d3b/dfb/f14a x:0 0 0 2024-09-18T21:13:05.442 INFO:tasks.workunit.client.1.smithi103.stdout:5/994: mkdir de/d1f/d3b/d58/dc4/d9c/d14b 0 2024-09-18T21:13:05.444 INFO:tasks.workunit.client.1.smithi103.stdout:5/995: mkdir de/d1f/d3b/d51/d57/d59/d14c 0 2024-09-18T21:13:05.446 INFO:tasks.workunit.client.1.smithi103.stdout:5/996: unlink de/d2d/f123 0 2024-09-18T21:13:05.446 INFO:tasks.workunit.client.1.smithi103.stdout:5/997: chown de/d3e/l5e 332 1 2024-09-18T21:13:05.448 INFO:tasks.workunit.client.0.smithi077.stdout:2/884: chown d1/d4/d5/d1a/d2e/cb7 7078 1 2024-09-18T21:13:05.451 INFO:tasks.workunit.client.1.smithi103.stdout:5/998: dwrite de/d2d/d7f/f4c [0,4194304] 0 2024-09-18T21:13:05.453 INFO:tasks.workunit.client.1.smithi103.stdout:5/999: creat de/d1f/d3b/d58/dc4/d9c/d14b/f14d x:0 0 0 2024-09-18T21:13:05.460 INFO:tasks.workunit.client.1.smithi103.stdout:3/998: dread d1/da/df/f19 [0,4194304] 0 2024-09-18T21:13:05.463 INFO:tasks.workunit.client.1.smithi103.stdout:3/999: creat d1/d2/d18/d30/d4e/db1/d10e/d114/d4f/d58/d68/d50/d54/d8c/f12b x:0 0 0 2024-09-18T21:13:05.478 INFO:tasks.workunit.client.0.smithi077.stdout:7/896: sync 2024-09-18T21:13:05.485 INFO:tasks.workunit.client.0.smithi077.stdout:5/903: write d0/d6/d3b/fe0 [573125,62383] 0 2024-09-18T21:13:05.485 INFO:tasks.workunit.client.1.smithi103.stdout:0/928: sync 2024-09-18T21:13:05.489 INFO:tasks.workunit.client.1.smithi103.stdout:1/900: getdents d0/d2/d2b/d3a/d42/d72/d126 0 2024-09-18T21:13:05.490 INFO:tasks.workunit.client.1.smithi103.stdout:2/895: dwrite d3/d5/d2c/f43 [0,4194304] 0 2024-09-18T21:13:05.492 INFO:tasks.workunit.client.1.smithi103.stdout:1/901: dread - d0/d2/d9/d9e/d7a/dd0/df9/d68/f132 zero size 2024-09-18T21:13:05.493 INFO:tasks.workunit.client.0.smithi077.stdout:3/863: dwrite db/d14/d32/d49/d4e/d6a/f6c [0,4194304] 0 2024-09-18T21:13:05.494 INFO:tasks.workunit.client.1.smithi103.stdout:0/929: dwrite d1/d5/de/d19/d1e/d34/f118 [0,4194304] 0 2024-09-18T21:13:05.494 INFO:tasks.workunit.client.0.smithi077.stdout:8/781: dwrite d2/d27/d29/f90 [0,4194304] 0 2024-09-18T21:13:05.499 INFO:tasks.workunit.client.0.smithi077.stdout:8/782: unlink d2/d5f/d7a/lb8 0 2024-09-18T21:13:05.499 INFO:tasks.workunit.client.1.smithi103.stdout:7/964: write d1/df/d42/d1f/d2e/f37 [1141693,33753] 0 2024-09-18T21:13:05.502 INFO:tasks.workunit.client.0.smithi077.stdout:3/864: chown db/d14/d32/d49/d4e/ld5 147 1 2024-09-18T21:13:05.507 INFO:tasks.workunit.client.1.smithi103.stdout:6/977: dwrite d2/d3/d8/d4c/d7d/fea [0,4194304] 0 2024-09-18T21:13:05.507 INFO:tasks.workunit.client.1.smithi103.stdout:0/930: creat d1/daf/f145 x:0 0 0 2024-09-18T21:13:05.507 INFO:tasks.workunit.client.0.smithi077.stdout:3/865: truncate db/d14/d32/f86 584517 0 2024-09-18T21:13:05.509 INFO:tasks.workunit.client.1.smithi103.stdout:0/931: fsync d1/d5/de/dc0/d8c/dce/f101 0 2024-09-18T21:13:05.511 INFO:tasks.workunit.client.1.smithi103.stdout:6/978: rename d2/d3/d7f/d91/cca to d2/d3/d7f/d91/c137 0 2024-09-18T21:13:05.513 INFO:tasks.workunit.client.1.smithi103.stdout:6/979: stat d2/d24/c6d 0 2024-09-18T21:13:05.514 INFO:tasks.workunit.client.1.smithi103.stdout:6/980: chown d2/d3/d8/de2 35644 1 2024-09-18T21:13:05.514 INFO:tasks.workunit.client.1.smithi103.stdout:7/965: unlink d1/df/d42/d1f/d5d/d85/db0/c103 0 2024-09-18T21:13:05.515 INFO:tasks.workunit.client.1.smithi103.stdout:9/975: dwrite d18/d52/d5e/f7d [0,4194304] 0 2024-09-18T21:13:05.516 INFO:tasks.workunit.client.1.smithi103.stdout:0/932: creat d1/d5/de/dc0/d8c/dce/d9f/d8d/da7/f146 x:0 0 0 2024-09-18T21:13:05.518 INFO:tasks.workunit.client.1.smithi103.stdout:7/966: truncate d1/df/d43/d63/d67/d5b/d10e/f141 999659 0 2024-09-18T21:13:05.522 INFO:tasks.workunit.client.1.smithi103.stdout:6/981: rename d2/d24/d38/d68/dac/fc8 to d2/d24/d5a/f138 0 2024-09-18T21:13:05.524 INFO:tasks.workunit.client.1.smithi103.stdout:0/933: fdatasync d1/d9/d3e/fbe 0 2024-09-18T21:13:05.525 INFO:tasks.workunit.client.1.smithi103.stdout:7/967: dwrite d1/df/d44/db4/fc1 [0,4194304] 0 2024-09-18T21:13:05.529 INFO:tasks.workunit.client.1.smithi103.stdout:6/982: symlink d2/d3/dcb/l139 0 2024-09-18T21:13:05.529 INFO:tasks.workunit.client.1.smithi103.stdout:0/934: chown d1/d5/de/l15 1 1 2024-09-18T21:13:05.529 INFO:tasks.workunit.client.1.smithi103.stdout:7/968: creat d1/df/d42/d29/d48/dbb/d33/d51/f145 x:0 0 0 2024-09-18T21:13:05.532 INFO:tasks.workunit.client.1.smithi103.stdout:0/935: unlink d1/d5/de/d19/d1e/d58/l127 0 2024-09-18T21:13:05.536 INFO:tasks.workunit.client.1.smithi103.stdout:0/936: rename d1/d9/c84 to d1/d5/de/d19/d1e/d58/d130/c147 0 2024-09-18T21:13:05.537 INFO:tasks.workunit.client.1.smithi103.stdout:0/937: read d1/d5/f44 [1220364,110796] 0 2024-09-18T21:13:05.539 INFO:tasks.workunit.client.1.smithi103.stdout:7/969: dread d1/df/dbf/d127/fc4 [0,4194304] 0 2024-09-18T21:13:05.541 INFO:tasks.workunit.client.1.smithi103.stdout:7/970: creat d1/df/d54/f146 x:0 0 0 2024-09-18T21:13:05.543 INFO:tasks.workunit.client.1.smithi103.stdout:7/971: mknod d1/df/d42/d1f/d2e/c147 0 2024-09-18T21:13:05.545 INFO:tasks.workunit.client.0.smithi077.stdout:8/783: dread d2/d5f/da8/d18/f4c [4194304,4194304] 0 2024-09-18T21:13:05.548 INFO:tasks.workunit.client.0.smithi077.stdout:5/904: write d0/d6/d3b/f55 [241573,1350] 0 2024-09-18T21:13:05.549 INFO:tasks.workunit.client.0.smithi077.stdout:8/784: unlink d2/d5f/da8/d4f/d5a/c100 0 2024-09-18T21:13:05.549 INFO:tasks.workunit.client.0.smithi077.stdout:5/905: chown d0/d6/dd/da5 0 1 2024-09-18T21:13:05.549 INFO:tasks.workunit.client.1.smithi103.stdout:7/972: creat d1/df/d43/d52/f148 x:0 0 0 2024-09-18T21:13:05.552 INFO:tasks.workunit.client.0.smithi077.stdout:8/785: chown d2/d5f/da8/d4f/d5a/d2a/dc8/le3 95 1 2024-09-18T21:13:05.552 INFO:tasks.workunit.client.0.smithi077.stdout:7/897: dwrite d12/d31/f7e [0,4194304] 0 2024-09-18T21:13:05.557 INFO:tasks.workunit.client.1.smithi103.stdout:1/902: dwrite d0/ff [0,4194304] 0 2024-09-18T21:13:05.557 INFO:tasks.workunit.client.1.smithi103.stdout:1/903: chown d0/d11/d5f 330 1 2024-09-18T21:13:05.566 INFO:tasks.workunit.client.0.smithi077.stdout:3/866: dwrite db/d14/d32/d49/da4/d8a/d99/daf/f100 [0,4194304] 0 2024-09-18T21:13:05.567 INFO:tasks.workunit.client.1.smithi103.stdout:9/976: dwrite d18/d52/d6f/f81 [0,4194304] 0 2024-09-18T21:13:05.569 INFO:tasks.workunit.client.1.smithi103.stdout:9/977: read d18/d29/d68/d78/f128 [2534599,43212] 0 2024-09-18T21:13:05.572 INFO:tasks.workunit.client.1.smithi103.stdout:9/978: chown d18/d52/d6f/d8e/d8f/dbd/f10a 3830371 1 2024-09-18T21:13:05.573 INFO:tasks.workunit.client.0.smithi077.stdout:7/898: getdents d12/d56/da1/ddf/d100 0 2024-09-18T21:13:05.576 INFO:tasks.workunit.client.1.smithi103.stdout:6/983: write d2/d3/d8/d4c/d79/fd3 [1410837,25437] 0 2024-09-18T21:13:05.577 INFO:tasks.workunit.client.1.smithi103.stdout:0/938: dread d1/f4 [0,4194304] 0 2024-09-18T21:13:05.577 INFO:tasks.workunit.client.0.smithi077.stdout:7/899: mknod d12/d22/daa/dc0/dac/c137 0 2024-09-18T21:13:05.578 INFO:tasks.workunit.client.1.smithi103.stdout:2/896: sync 2024-09-18T21:13:05.578 INFO:tasks.workunit.client.1.smithi103.stdout:6/984: write d2/d24/d38/d68/fa6 [725318,31676] 0 2024-09-18T21:13:05.578 INFO:tasks.workunit.client.1.smithi103.stdout:0/939: stat d1/d5/de/dc0/d8c/dce/d9f/c30 0 2024-09-18T21:13:05.580 INFO:tasks.workunit.client.0.smithi077.stdout:3/867: mkdir db/d14/d22/d36/d39/d50/d5c/deb/d10e 0 2024-09-18T21:13:05.581 INFO:tasks.workunit.client.0.smithi077.stdout:3/868: dread - db/d14/d32/d49/d6b/fe8 zero size 2024-09-18T21:13:05.588 INFO:tasks.workunit.client.0.smithi077.stdout:8/786: rmdir d2/d5f/da8 39 2024-09-18T21:13:05.588 INFO:tasks.workunit.client.0.smithi077.stdout:3/869: dwrite db/d14/d22/d36/dd9/f103 [0,4194304] 0 2024-09-18T21:13:05.590 INFO:tasks.workunit.client.0.smithi077.stdout:3/870: read - db/d14/d22/d36/f10c zero size 2024-09-18T21:13:05.592 INFO:tasks.workunit.client.0.smithi077.stdout:5/906: write d0/df/d10/d4b/d98/ff9 [994157,5334] 0 2024-09-18T21:13:05.593 INFO:tasks.workunit.client.0.smithi077.stdout:3/871: symlink db/d14/d32/d87/l10f 0 2024-09-18T21:13:05.599 INFO:tasks.workunit.client.0.smithi077.stdout:3/872: mknod db/d14/d22/d36/c110 0 2024-09-18T21:13:05.605 INFO:tasks.workunit.client.0.smithi077.stdout:3/873: dwrite db/d14/d32/d49/fdc [0,4194304] 0 2024-09-18T21:13:05.610 INFO:tasks.workunit.client.0.smithi077.stdout:7/900: write d12/d31/d77/d93/d2a/d6c/ff1 [468449,70974] 0 2024-09-18T21:13:05.611 INFO:tasks.workunit.client.0.smithi077.stdout:3/874: creat db/dee/f111 x:0 0 0 2024-09-18T21:13:05.615 INFO:tasks.workunit.client.0.smithi077.stdout:7/901: unlink d12/d22/d59/d5a/ce3 0 2024-09-18T21:13:05.617 INFO:tasks.workunit.client.0.smithi077.stdout:3/875: truncate db/d14/d32/d49/d4e/d6a/db5/dc3/fdf 2916748 0 2024-09-18T21:13:05.621 INFO:tasks.workunit.client.0.smithi077.stdout:3/876: rename db/d14/d22/d36/dd9/lda to db/d14/d72/l112 0 2024-09-18T21:13:05.624 INFO:tasks.workunit.client.0.smithi077.stdout:8/787: dwrite d2/d5f/da8/d4f/d5a/d5e/fe5 [0,4194304] 0 2024-09-18T21:13:05.626 INFO:tasks.workunit.client.0.smithi077.stdout:3/877: getdents db/d14/d32/d49/da4/d6d 0 2024-09-18T21:13:05.626 INFO:tasks.workunit.client.0.smithi077.stdout:7/902: dread d12/f111 [0,4194304] 0 2024-09-18T21:13:05.630 INFO:tasks.workunit.client.0.smithi077.stdout:8/788: creat d2/d5f/da8/d4f/d5a/d2a/d67/f113 x:0 0 0 2024-09-18T21:13:05.632 INFO:tasks.workunit.client.0.smithi077.stdout:8/789: write d2/d27/d29/d41/dbc/dce/df6/f103 [101802,96881] 0 2024-09-18T21:13:05.633 INFO:tasks.workunit.client.0.smithi077.stdout:3/878: mkdir db/d14/d32/d49/da4/d8a/d99/daf/de6/d113 0 2024-09-18T21:13:05.635 INFO:tasks.workunit.client.1.smithi103.stdout:6/985: creat d2/d3/d8/d4c/d79/f13a x:0 0 0 2024-09-18T21:13:05.635 INFO:tasks.workunit.client.0.smithi077.stdout:3/879: truncate db/d14/d22/d36/d39/f47 4521827 0 2024-09-18T21:13:05.636 INFO:tasks.workunit.client.1.smithi103.stdout:6/986: write d2/d3/d8/d4c/d7d/f119 [845294,9083] 0 2024-09-18T21:13:05.639 INFO:tasks.workunit.client.1.smithi103.stdout:1/904: stat d0/d11/d5f/d19/cb1 0 2024-09-18T21:13:05.640 INFO:tasks.workunit.client.1.smithi103.stdout:9/979: sync 2024-09-18T21:13:05.641 INFO:tasks.workunit.client.0.smithi077.stdout:8/790: symlink d2/d5/d6/d9f/da4/df8/l114 0 2024-09-18T21:13:05.642 INFO:tasks.workunit.client.1.smithi103.stdout:7/973: rmdir d1/df/d42/d1f/d5d/d85/dde 0 2024-09-18T21:13:05.643 INFO:tasks.workunit.client.1.smithi103.stdout:0/940: truncate d1/d5/de/d22/d6a/f13f 228068 0 2024-09-18T21:13:05.644 INFO:tasks.workunit.client.1.smithi103.stdout:6/987: rename d2/d3/d7f/d91/da2/ceb to d2/d3/d7f/d91/c13b 0 2024-09-18T21:13:05.645 INFO:tasks.workunit.client.0.smithi077.stdout:3/880: creat db/d14/f114 x:0 0 0 2024-09-18T21:13:05.646 INFO:tasks.workunit.client.0.smithi077.stdout:3/881: write db/d14/d32/d49/da4/f53 [483964,51382] 0 2024-09-18T21:13:05.648 INFO:tasks.workunit.client.0.smithi077.stdout:8/791: rename d2/d5f/da8/d20/f96 to d2/d5/d6/d9f/da4/df8/f115 0 2024-09-18T21:13:05.648 INFO:tasks.workunit.client.1.smithi103.stdout:2/897: dread d3/f20 [0,4194304] 0 2024-09-18T21:13:05.649 INFO:tasks.workunit.client.1.smithi103.stdout:7/974: dread - d1/df/dc7/fce zero size 2024-09-18T21:13:05.649 INFO:tasks.workunit.client.1.smithi103.stdout:7/975: chown d1/df/l47 7641 1 2024-09-18T21:13:05.652 INFO:tasks.workunit.client.0.smithi077.stdout:3/882: dwrite db/d14/d22/d36/fb4 [0,4194304] 0 2024-09-18T21:13:05.659 INFO:tasks.workunit.client.1.smithi103.stdout:6/988: creat d2/d24/d5a/d67/f13c x:0 0 0 2024-09-18T21:13:05.659 INFO:tasks.workunit.client.0.smithi077.stdout:8/792: mknod d2/d5f/da8/d4f/d5a/d2a/d67/c116 0 2024-09-18T21:13:05.660 INFO:tasks.workunit.client.1.smithi103.stdout:1/905: fsync d0/d2/d9/d9e/d7a/dd0/df9/f20 0 2024-09-18T21:13:05.663 INFO:tasks.workunit.client.0.smithi077.stdout:3/883: unlink db/d14/d32/d49/da4/d8a/d99/daf/fb0 0 2024-09-18T21:13:05.668 INFO:tasks.workunit.client.1.smithi103.stdout:9/980: rename d18/d52/d6f/c106 to d18/d52/d6f/db9/c144 0 2024-09-18T21:13:05.669 INFO:tasks.workunit.client.0.smithi077.stdout:3/884: write db/d14/d32/d49/da4/d8a/d99/daf/fbe [1354053,60051] 0 2024-09-18T21:13:05.671 INFO:tasks.workunit.client.0.smithi077.stdout:8/793: link d2/d5f/da8/d4f/d5a/d2a/dc8/df1/f111 d2/d5f/def/f117 0 2024-09-18T21:13:05.673 INFO:tasks.workunit.client.0.smithi077.stdout:3/885: unlink db/d14/d32/f7b 0 2024-09-18T21:13:05.674 INFO:tasks.workunit.client.0.smithi077.stdout:3/886: fdatasync db/d14/d22/f9d 0 2024-09-18T21:13:05.676 INFO:tasks.workunit.client.1.smithi103.stdout:2/898: mknod d3/d110/d11a/c135 0 2024-09-18T21:13:05.679 INFO:tasks.workunit.client.0.smithi077.stdout:8/794: dwrite d2/d5f/da8/f1b [0,4194304] 0 2024-09-18T21:13:05.679 INFO:tasks.workunit.client.0.smithi077.stdout:3/887: unlink db/f35 0 2024-09-18T21:13:05.681 INFO:tasks.workunit.client.1.smithi103.stdout:9/981: creat d18/d52/d6f/d8e/df7/f145 x:0 0 0 2024-09-18T21:13:05.682 INFO:tasks.workunit.client.0.smithi077.stdout:7/903: dwrite d12/d31/d77/d93/d2a/f82 [0,4194304] 0 2024-09-18T21:13:05.683 INFO:tasks.workunit.client.1.smithi103.stdout:0/941: rmdir d1/d5/de/d22/d6a 39 2024-09-18T21:13:05.692 INFO:tasks.workunit.client.1.smithi103.stdout:9/982: creat d18/d29/d68/dff/f146 x:0 0 0 2024-09-18T21:13:05.692 INFO:tasks.workunit.client.0.smithi077.stdout:7/904: rmdir d12/dd5 39 2024-09-18T21:13:05.694 INFO:tasks.workunit.client.1.smithi103.stdout:0/942: creat d1/d93/f148 x:0 0 0 2024-09-18T21:13:05.695 INFO:tasks.workunit.client.0.smithi077.stdout:3/888: unlink db/d14/d32/d49/da4/cfb 0 2024-09-18T21:13:05.696 INFO:tasks.workunit.client.0.smithi077.stdout:3/889: chown db/d14/d32/d49/da4/f82 34 1 2024-09-18T21:13:05.699 INFO:tasks.workunit.client.1.smithi103.stdout:2/899: mkdir d3/d136 0 2024-09-18T21:13:05.701 INFO:tasks.workunit.client.1.smithi103.stdout:6/989: write d2/d24/f6a [491836,105661] 0 2024-09-18T21:13:05.702 INFO:tasks.workunit.client.0.smithi077.stdout:3/890: truncate db/d14/d32/d49/d6b/f9a 1039671 0 2024-09-18T21:13:05.702 INFO:tasks.workunit.client.1.smithi103.stdout:7/976: dwrite d1/df/d43/d52/fb7 [0,4194304] 0 2024-09-18T21:13:05.705 INFO:tasks.workunit.client.1.smithi103.stdout:1/906: getdents d0/d2/d2b/d3a 0 2024-09-18T21:13:05.706 INFO:tasks.workunit.client.0.smithi077.stdout:3/891: mknod db/d14/d32/d49/d4e/d6a/db5/dc3/c115 0 2024-09-18T21:13:05.708 INFO:tasks.workunit.client.1.smithi103.stdout:2/900: read - d3/fcf zero size 2024-09-18T21:13:05.709 INFO:tasks.workunit.client.1.smithi103.stdout:9/983: fsync d18/d29/d68/d78/fee 0 2024-09-18T21:13:05.710 INFO:tasks.workunit.client.1.smithi103.stdout:7/977: dwrite d1/df/d42/d1f/f11d [0,4194304] 0 2024-09-18T21:13:05.712 INFO:tasks.workunit.client.1.smithi103.stdout:0/943: creat d1/d9/d3e/d6e/d12e/f149 x:0 0 0 2024-09-18T21:13:05.713 INFO:tasks.workunit.client.1.smithi103.stdout:0/944: dread - d1/d9/d48/f139 zero size 2024-09-18T21:13:05.713 INFO:tasks.workunit.client.0.smithi077.stdout:8/795: write d2/d5/f93 [1278019,57266] 0 2024-09-18T21:13:05.720 INFO:tasks.workunit.client.1.smithi103.stdout:2/901: mkdir d3/d5/d2c/d137 0 2024-09-18T21:13:05.722 INFO:tasks.workunit.client.0.smithi077.stdout:8/796: creat d2/d27/d29/d41/dbc/dce/f118 x:0 0 0 2024-09-18T21:13:05.724 INFO:tasks.workunit.client.0.smithi077.stdout:8/797: stat d2/d5f/da8/d4f/d5a/d5e/d8f/c44 0 2024-09-18T21:13:05.725 INFO:tasks.workunit.client.1.smithi103.stdout:2/902: dwrite d3/d110/d11a/fe0 [0,4194304] 0 2024-09-18T21:13:05.727 INFO:tasks.workunit.client.0.smithi077.stdout:9/812: sync 2024-09-18T21:13:05.727 INFO:tasks.workunit.client.0.smithi077.stdout:1/783: sync 2024-09-18T21:13:05.727 INFO:tasks.workunit.client.0.smithi077.stdout:4/855: sync 2024-09-18T21:13:05.727 INFO:tasks.workunit.client.0.smithi077.stdout:6/826: sync 2024-09-18T21:13:05.727 INFO:tasks.workunit.client.0.smithi077.stdout:0/917: sync 2024-09-18T21:13:05.728 INFO:tasks.workunit.client.0.smithi077.stdout:7/905: dwrite d12/d22/d122/f12c [0,4194304] 0 2024-09-18T21:13:05.733 INFO:tasks.workunit.client.0.smithi077.stdout:0/918: dread - d8/d1d/d80/fef zero size 2024-09-18T21:13:05.733 INFO:tasks.workunit.client.1.smithi103.stdout:0/945: mkdir d1/d5/de/d24/d43/dfd/d14a 0 2024-09-18T21:13:05.734 INFO:tasks.workunit.client.0.smithi077.stdout:3/892: truncate db/d14/d32/d49/da4/d8a/ddd/fed 851707 0 2024-09-18T21:13:05.735 INFO:tasks.workunit.client.1.smithi103.stdout:1/907: mknod d0/d2/d9/d9e/d7a/dd0/df9/d68/d81/da2/da4/c13c 0 2024-09-18T21:13:05.736 INFO:tasks.workunit.client.1.smithi103.stdout:1/908: write d0/d2/d2b/d111/f125 [712007,93929] 0 2024-09-18T21:13:05.737 INFO:tasks.workunit.client.1.smithi103.stdout:1/909: fdatasync d0/ff 0 2024-09-18T21:13:05.737 INFO:tasks.workunit.client.0.smithi077.stdout:6/827: rmdir d7/d7e/d11/d3e/d42/dbb/d4c 39 2024-09-18T21:13:05.738 INFO:tasks.workunit.client.1.smithi103.stdout:9/984: write d18/d8d/fc6 [3387563,36060] 0 2024-09-18T21:13:05.738 INFO:tasks.workunit.client.0.smithi077.stdout:4/856: dwrite d3/dc/d32/d45/d5e/fc2 [0,4194304] 0 2024-09-18T21:13:05.739 INFO:tasks.workunit.client.1.smithi103.stdout:9/985: chown d18/d8d/d2f/l51 2375358 1 2024-09-18T21:13:05.740 INFO:tasks.workunit.client.1.smithi103.stdout:2/903: rmdir d3/d5/d2f/d48/dab 39 2024-09-18T21:13:05.741 INFO:tasks.workunit.client.1.smithi103.stdout:6/990: truncate d2/f4a 573396 0 2024-09-18T21:13:05.743 INFO:tasks.workunit.client.1.smithi103.stdout:6/991: chown d2/d24/d5a/d67/d76/da4/c100 215869 1 2024-09-18T21:13:05.744 INFO:tasks.workunit.client.1.smithi103.stdout:7/978: dwrite d1/df/d42/f2b [0,4194304] 0 2024-09-18T21:13:05.744 INFO:tasks.workunit.client.0.smithi077.stdout:9/813: stat d1/dd/d11/d1c/d38/dae/ld9 0 2024-09-18T21:13:05.745 INFO:tasks.workunit.client.0.smithi077.stdout:7/906: dwrite d12/d56/f3a [0,4194304] 0 2024-09-18T21:13:05.748 INFO:tasks.workunit.client.0.smithi077.stdout:8/798: truncate d2/d5f/da8/d20/fa1 1037057 0 2024-09-18T21:13:05.753 INFO:tasks.workunit.client.1.smithi103.stdout:1/910: creat d0/d2/d9/dc/d6e/dac/f13d x:0 0 0 2024-09-18T21:13:05.754 INFO:tasks.workunit.client.1.smithi103.stdout:2/904: truncate d3/d5/d2f/d32/fda 817808 0 2024-09-18T21:13:05.755 INFO:tasks.workunit.client.0.smithi077.stdout:4/857: symlink d3/dc/d32/d45/d5e/df0/l114 0 2024-09-18T21:13:05.755 INFO:tasks.workunit.client.0.smithi077.stdout:4/858: chown d3/dc/d24 3764 1 2024-09-18T21:13:05.757 INFO:tasks.workunit.client.1.smithi103.stdout:6/992: unlink d2/d3/d8/d94/f10b 0 2024-09-18T21:13:05.758 INFO:tasks.workunit.client.0.smithi077.stdout:3/893: write db/f95 [789514,93548] 0 2024-09-18T21:13:05.760 INFO:tasks.workunit.client.0.smithi077.stdout:0/919: symlink d8/d1a/d39/l130 0 2024-09-18T21:13:05.761 INFO:tasks.workunit.client.1.smithi103.stdout:1/911: symlink d0/d2/d9/d9e/d7a/dd0/df9/d68/d81/l13e 0 2024-09-18T21:13:05.776 INFO:tasks.workunit.client.0.smithi077.stdout:2/885: sync 2024-09-18T21:13:05.779 INFO:tasks.workunit.client.1.smithi103.stdout:2/905: rename d3/d5/d2c/d54/d68/fbe to d3/d5/d2c/d137/f138 0 2024-09-18T21:13:05.780 INFO:tasks.workunit.client.1.smithi103.stdout:2/906: dread - d3/d5/d2c/d77/f101 zero size 2024-09-18T21:13:05.781 INFO:tasks.workunit.client.0.smithi077.stdout:1/784: creat d3/d38/f106 x:0 0 0 2024-09-18T21:13:05.781 INFO:tasks.workunit.client.1.smithi103.stdout:2/907: readlink d3/d5/d4a/lef 0 2024-09-18T21:13:05.781 INFO:tasks.workunit.client.1.smithi103.stdout:6/993: symlink d2/d3/dcb/l13d 0 2024-09-18T21:13:05.783 INFO:tasks.workunit.client.0.smithi077.stdout:0/920: dread d8/d1a/d35/d6d/fc2 [0,4194304] 0 2024-09-18T21:13:05.783 INFO:tasks.workunit.client.0.smithi077.stdout:9/814: mknod d1/d54/c117 0 2024-09-18T21:13:05.784 INFO:tasks.workunit.client.0.smithi077.stdout:3/894: symlink db/d14/d32/d87/l116 0 2024-09-18T21:13:05.786 INFO:tasks.workunit.client.1.smithi103.stdout:1/912: rename d0/d11/f11b to d0/d11/d5f/f13f 0 2024-09-18T21:13:05.790 INFO:tasks.workunit.client.1.smithi103.stdout:7/979: dread d1/df/d42/d1f/d2e/d3f/f4a [0,4194304] 0 2024-09-18T21:13:05.792 INFO:tasks.workunit.client.0.smithi077.stdout:3/895: dwrite db/d14/d22/d36/f7f [0,4194304] 0 2024-09-18T21:13:05.793 INFO:tasks.workunit.client.1.smithi103.stdout:6/994: mknod d2/d24/d38/d68/c13e 0 2024-09-18T21:13:05.794 INFO:tasks.workunit.client.0.smithi077.stdout:2/886: symlink d1/d4/l12b 0 2024-09-18T21:13:05.795 INFO:tasks.workunit.client.1.smithi103.stdout:6/995: write d2/d3/d8/d4c/d4e/fc3 [4326919,16969] 0 2024-09-18T21:13:05.795 INFO:tasks.workunit.client.1.smithi103.stdout:0/946: getdents d1/d5/de/d19/d1e/d58/d130 0 2024-09-18T21:13:05.795 INFO:tasks.workunit.client.0.smithi077.stdout:2/887: stat d1/d4/d5/d1a/d113/d81/dc4 0 2024-09-18T21:13:05.796 INFO:tasks.workunit.client.1.smithi103.stdout:6/996: read - d2/d24/d5a/d67/d76/d43/f11d zero size 2024-09-18T21:13:05.797 INFO:tasks.workunit.client.1.smithi103.stdout:6/997: chown d2/d24/d5a/d67/d76/d43 0 1 2024-09-18T21:13:05.801 INFO:tasks.workunit.client.1.smithi103.stdout:7/980: mknod d1/df/d43/d63/d67/d5b/c149 0 2024-09-18T21:13:05.803 INFO:tasks.workunit.client.0.smithi077.stdout:4/859: dwrite d3/d77/d9c/db9/ff9 [0,4194304] 0 2024-09-18T21:13:05.803 INFO:tasks.workunit.client.0.smithi077.stdout:9/815: rename d1/d54/d51/ce4 to d1/dd/d11/d1c/d38/d46/d55/d9c/d114/c118 0 2024-09-18T21:13:05.804 INFO:tasks.workunit.client.0.smithi077.stdout:8/799: truncate d2/d27/d29/feb 1025174 0 2024-09-18T21:13:05.805 INFO:tasks.workunit.client.1.smithi103.stdout:2/908: fdatasync d3/d5/d4a/d56/f97 0 2024-09-18T21:13:05.808 INFO:tasks.workunit.client.0.smithi077.stdout:7/907: creat d12/d31/d77/d93/f138 x:0 0 0 2024-09-18T21:13:05.810 INFO:tasks.workunit.client.0.smithi077.stdout:7/908: truncate d12/d56/f130 678653 0 2024-09-18T21:13:05.811 INFO:tasks.workunit.client.1.smithi103.stdout:1/913: mkdir d0/d2/d2b/d3a/d42/d87/d140 0 2024-09-18T21:13:05.812 INFO:tasks.workunit.client.0.smithi077.stdout:2/888: creat d1/d4/d5/d1a/d113/d81/f12c x:0 0 0 2024-09-18T21:13:05.814 INFO:tasks.workunit.client.1.smithi103.stdout:1/914: dread d0/d2/d9/d10/f44 [0,4194304] 0 2024-09-18T21:13:05.814 INFO:tasks.workunit.client.0.smithi077.stdout:9/816: dwrite d1/dd/d57/d97/ff7 [0,4194304] 0 2024-09-18T21:13:05.815 INFO:tasks.workunit.client.0.smithi077.stdout:9/817: readlink d1/dd/d11/lb9 0 2024-09-18T21:13:05.816 INFO:tasks.workunit.client.1.smithi103.stdout:0/947: mkdir d1/d5/de/d22/d6a/d14b 0 2024-09-18T21:13:05.816 INFO:tasks.workunit.client.0.smithi077.stdout:9/818: chown d1/d54/f5c 1936 1 2024-09-18T21:13:05.817 INFO:tasks.workunit.client.1.smithi103.stdout:9/986: sync 2024-09-18T21:13:05.817 INFO:tasks.workunit.client.1.smithi103.stdout:0/948: chown d1/d5/de/dc0/dbf/f86 985023 1 2024-09-18T21:13:05.817 INFO:tasks.workunit.client.0.smithi077.stdout:9/819: dread - d1/dd/d11/d2d/d59/dfc/fbb zero size 2024-09-18T21:13:05.817 INFO:tasks.workunit.client.1.smithi103.stdout:9/987: fsync d18/d8d/d2f/f97 0 2024-09-18T21:13:05.818 INFO:tasks.workunit.client.1.smithi103.stdout:9/988: read - d18/d52/d6f/db9/dcb/ded/f116 zero size 2024-09-18T21:13:05.820 INFO:tasks.workunit.client.1.smithi103.stdout:6/998: link d2/d3/d8/d4c/d7d/fea d2/d24/d5a/d67/d76/d43/d44/f13f 0 2024-09-18T21:13:05.820 INFO:tasks.workunit.client.0.smithi077.stdout:0/921: creat d8/d1a/d35/f131 x:0 0 0 2024-09-18T21:13:05.823 INFO:tasks.workunit.client.0.smithi077.stdout:8/800: rename d2/d5f/da8/d4f/d5a/d5e/d8f/dad to d2/d5f/da8/d4f/d5a/d119 0 2024-09-18T21:13:05.826 INFO:tasks.workunit.client.0.smithi077.stdout:2/889: unlink d1/d4/d5/d1a/d113/c117 0 2024-09-18T21:13:05.828 INFO:tasks.workunit.client.0.smithi077.stdout:4/860: mkdir d3/d7/d7b/d88/d115 0 2024-09-18T21:13:05.829 INFO:tasks.workunit.client.0.smithi077.stdout:4/861: chown d3/dc/d51/d53/l100 369 1 2024-09-18T21:13:05.831 INFO:tasks.workunit.client.0.smithi077.stdout:1/785: getdents d3/d6a/d9b/dbe 0 2024-09-18T21:13:05.831 INFO:tasks.workunit.client.0.smithi077.stdout:1/786: stat d3/d8/d49/d4e/fe9 0 2024-09-18T21:13:05.832 INFO:tasks.workunit.client.0.smithi077.stdout:0/922: dread - d8/d1d/d80/ffd zero size 2024-09-18T21:13:05.833 INFO:tasks.workunit.client.0.smithi077.stdout:0/923: stat d8/d37/dd2/fd9 0 2024-09-18T21:13:05.834 INFO:tasks.workunit.client.0.smithi077.stdout:8/801: fdatasync d2/d27/d29/f58 0 2024-09-18T21:13:05.835 INFO:tasks.workunit.client.1.smithi103.stdout:9/989: mkdir d18/d52/d6f/db9/d147 0 2024-09-18T21:13:05.836 INFO:tasks.workunit.client.0.smithi077.stdout:7/909: creat d12/d22/daa/dc0/d11f/f139 x:0 0 0 2024-09-18T21:13:05.837 INFO:tasks.workunit.client.1.smithi103.stdout:6/999: symlink d2/d3/d8/de1/dfe/l140 0 2024-09-18T21:13:05.839 INFO:tasks.workunit.client.1.smithi103.stdout:7/981: creat d1/df/d44/f14a x:0 0 0 2024-09-18T21:13:05.840 INFO:tasks.workunit.client.1.smithi103.stdout:7/982: chown d1/df/d42/d1f 4057 1 2024-09-18T21:13:05.840 INFO:tasks.workunit.client.0.smithi077.stdout:4/862: mknod d3/dc/d24/d72/c116 0 2024-09-18T21:13:05.843 INFO:tasks.workunit.client.0.smithi077.stdout:4/863: read d3/d7/d7b/d88/f8d [555106,58846] 0 2024-09-18T21:13:05.843 INFO:tasks.workunit.client.1.smithi103.stdout:1/915: rename d0/d2/d2b/d111/f128 to d0/d2/d9/d10/d5d/d6f/f141 0 2024-09-18T21:13:05.844 INFO:tasks.workunit.client.0.smithi077.stdout:1/787: creat d3/d38/d97/f107 x:0 0 0 2024-09-18T21:13:05.844 INFO:tasks.workunit.client.0.smithi077.stdout:4/864: write d3/dc/d24/d72/ffd [325090,7084] 0 2024-09-18T21:13:05.845 INFO:tasks.workunit.client.0.smithi077.stdout:4/865: stat d3/d7/d42/dd8/fda 0 2024-09-18T21:13:05.846 INFO:tasks.workunit.client.0.smithi077.stdout:0/924: dread d8/d10b/fa2 [0,4194304] 0 2024-09-18T21:13:05.847 INFO:tasks.workunit.client.0.smithi077.stdout:0/925: write d8/d1a/f20 [4762302,129653] 0 2024-09-18T21:13:05.847 INFO:tasks.workunit.client.1.smithi103.stdout:9/990: truncate d18/d52/d6f/db9/de0/ffb 229352 0 2024-09-18T21:13:05.848 INFO:tasks.workunit.client.1.smithi103.stdout:2/909: truncate d3/d5/f4c 1666125 0 2024-09-18T21:13:05.848 INFO:tasks.workunit.client.1.smithi103.stdout:9/991: write d18/d8d/f100 [900400,112880] 0 2024-09-18T21:13:05.849 INFO:tasks.workunit.client.0.smithi077.stdout:8/802: read d2/d5f/da8/d26/fba [146897,48877] 0 2024-09-18T21:13:05.850 INFO:tasks.workunit.client.1.smithi103.stdout:7/983: creat d1/df/d42/d1f/d5d/f14b x:0 0 0 2024-09-18T21:13:05.851 INFO:tasks.workunit.client.0.smithi077.stdout:7/910: creat d12/d56/da1/db6/dbd/f13a x:0 0 0 2024-09-18T21:13:05.852 INFO:tasks.workunit.client.1.smithi103.stdout:1/916: symlink d0/d2/d9/d9e/d7a/dd0/l142 0 2024-09-18T21:13:05.856 INFO:tasks.workunit.client.1.smithi103.stdout:0/949: dwrite d1/d5/de/d22/d98/fe7 [0,4194304] 0 2024-09-18T21:13:05.861 INFO:tasks.workunit.client.1.smithi103.stdout:0/950: dread d1/d5/de/d19/d1e/fb8 [0,4194304] 0 2024-09-18T21:13:05.862 INFO:tasks.workunit.client.1.smithi103.stdout:7/984: rename d1/df/c11 to d1/df/d43/d63/d67/c14c 0 2024-09-18T21:13:05.862 INFO:tasks.workunit.client.0.smithi077.stdout:2/890: write d1/f92 [856381,69089] 0 2024-09-18T21:13:05.865 INFO:tasks.workunit.client.0.smithi077.stdout:4/866: chown d3/d7/ce3 6 1 2024-09-18T21:13:05.865 INFO:tasks.workunit.client.0.smithi077.stdout:4/867: write d3/d77/ff7 [2130344,52077] 0 2024-09-18T21:13:05.869 INFO:tasks.workunit.client.0.smithi077.stdout:1/788: rmdir d3 39 2024-09-18T21:13:05.869 INFO:tasks.workunit.client.1.smithi103.stdout:1/917: creat d0/d2/d9/d9e/d7a/dd0/df9/d68/d81/da2/da4/dc2/dd8/dae/f143 x:0 0 0 2024-09-18T21:13:05.871 INFO:tasks.workunit.client.0.smithi077.stdout:8/803: dread - d2/d5f/d7a/fec zero size 2024-09-18T21:13:05.875 INFO:tasks.workunit.client.1.smithi103.stdout:9/992: write d18/da4/fce [3162037,91421] 0 2024-09-18T21:13:05.877 INFO:tasks.workunit.client.1.smithi103.stdout:7/985: rmdir d1/df/d43/d52/d95 39 2024-09-18T21:13:05.878 INFO:tasks.workunit.client.0.smithi077.stdout:2/891: read - d1/d4/d5/f9d zero size 2024-09-18T21:13:05.880 INFO:tasks.workunit.client.1.smithi103.stdout:2/910: truncate d3/d5/d4a/d56/ff8 3146310 0 2024-09-18T21:13:05.882 INFO:tasks.workunit.client.0.smithi077.stdout:4/868: rmdir d3/dc/d24 39 2024-09-18T21:13:05.888 INFO:tasks.workunit.client.0.smithi077.stdout:7/911: unlink d12/d31/d77/d93/c2c 0 2024-09-18T21:13:05.892 INFO:tasks.workunit.client.0.smithi077.stdout:0/926: dread d8/d37/d66/d87/de0/f8f [0,4194304] 0 2024-09-18T21:13:05.892 INFO:tasks.workunit.client.0.smithi077.stdout:4/869: unlink d3/dc/c6d 0 2024-09-18T21:13:05.893 INFO:tasks.workunit.client.0.smithi077.stdout:4/870: write d3/dc/d20/f27 [2541174,30621] 0 2024-09-18T21:13:05.894 INFO:tasks.workunit.client.1.smithi103.stdout:1/918: dread d0/d2/d9/d10/f67 [0,4194304] 0 2024-09-18T21:13:05.894 INFO:tasks.workunit.client.0.smithi077.stdout:1/789: mknod d3/d8/d75/d89/dbb/c108 0 2024-09-18T21:13:05.900 INFO:tasks.workunit.client.0.smithi077.stdout:7/912: rename d12/l17 to d12/d56/da1/l13b 0 2024-09-18T21:13:05.901 INFO:tasks.workunit.client.0.smithi077.stdout:7/913: chown d12 5137025 1 2024-09-18T21:13:05.908 INFO:tasks.workunit.client.1.smithi103.stdout:0/951: rename d1/d5/de/l3a to d1/d5/de/d22/l14c 0 2024-09-18T21:13:05.909 INFO:tasks.workunit.client.0.smithi077.stdout:0/927: dwrite d8/d1a/f51 [0,4194304] 0 2024-09-18T21:13:05.911 INFO:tasks.workunit.client.0.smithi077.stdout:1/790: dread - d3/d8/d75/d89/f8c zero size 2024-09-18T21:13:05.912 INFO:tasks.workunit.client.0.smithi077.stdout:1/791: chown d3/d6a/f9e 8299764 1 2024-09-18T21:13:05.913 INFO:tasks.workunit.client.0.smithi077.stdout:7/914: rmdir d12/d22/daa 39 2024-09-18T21:13:05.915 INFO:tasks.workunit.client.0.smithi077.stdout:7/915: dread - d12/d22/f8b zero size 2024-09-18T21:13:05.916 INFO:tasks.workunit.client.0.smithi077.stdout:2/892: dread d1/fd [0,4194304] 0 2024-09-18T21:13:05.917 INFO:tasks.workunit.client.0.smithi077.stdout:2/893: read d1/d4/fbd [1013143,42860] 0 2024-09-18T21:13:05.918 INFO:tasks.workunit.client.1.smithi103.stdout:2/911: getdents d3/d5/d2c 0 2024-09-18T21:13:05.919 INFO:tasks.workunit.client.0.smithi077.stdout:8/804: dwrite d2/f19 [0,4194304] 0 2024-09-18T21:13:05.920 INFO:tasks.workunit.client.0.smithi077.stdout:1/792: rename d3/d8/f67 to d3/d6a/d9b/d68/f109 0 2024-09-18T21:13:05.922 INFO:tasks.workunit.client.1.smithi103.stdout:9/993: dwrite d18/d29/d68/fef [0,4194304] 0 2024-09-18T21:13:05.929 INFO:tasks.workunit.client.0.smithi077.stdout:8/805: dwrite d2/d5f/da8/d4f/f69 [0,4194304] 0 2024-09-18T21:13:05.929 INFO:tasks.workunit.client.1.smithi103.stdout:7/986: dwrite d1/df/d42/d1f/d5d/d85/db0/fd8 [0,4194304] 0 2024-09-18T21:13:05.933 INFO:tasks.workunit.client.1.smithi103.stdout:0/952: creat d1/d5/de/d19/d1e/f14d x:0 0 0 2024-09-18T21:13:05.933 INFO:tasks.workunit.client.1.smithi103.stdout:2/912: dread d3/d5/f27 [0,4194304] 0 2024-09-18T21:13:05.935 INFO:tasks.workunit.client.1.smithi103.stdout:1/919: fdatasync d0/d11/d5f/d19/f34 0 2024-09-18T21:13:05.937 INFO:tasks.workunit.client.1.smithi103.stdout:0/953: read d1/d9/fb5 [443607,129189] 0 2024-09-18T21:13:05.946 INFO:tasks.workunit.client.0.smithi077.stdout:7/916: mkdir d12/dd5/d13c 0 2024-09-18T21:13:05.947 INFO:tasks.workunit.client.1.smithi103.stdout:7/987: chown d1/df/d42/cfc 4204 1 2024-09-18T21:13:05.947 INFO:tasks.workunit.client.0.smithi077.stdout:4/871: dwrite d3/dc/d32/d45/fba [0,4194304] 0 2024-09-18T21:13:05.949 INFO:tasks.workunit.client.0.smithi077.stdout:8/806: mknod d2/d27/d29/d72/c11a 0 2024-09-18T21:13:05.951 INFO:tasks.workunit.client.0.smithi077.stdout:0/928: getdents d8/d37/d66 0 2024-09-18T21:13:05.952 INFO:tasks.workunit.client.1.smithi103.stdout:1/920: creat d0/d2/d9/dc/d6e/dac/f144 x:0 0 0 2024-09-18T21:13:05.954 INFO:tasks.workunit.client.1.smithi103.stdout:7/988: dwrite d1/df/d42/d1f/ff2 [0,4194304] 0 2024-09-18T21:13:05.955 INFO:tasks.workunit.client.1.smithi103.stdout:2/913: dwrite d3/d5/d2f/d93/fa1 [0,4194304] 0 2024-09-18T21:13:05.955 INFO:tasks.workunit.client.0.smithi077.stdout:7/917: mkdir d12/d56/da1/db6/d13d 0 2024-09-18T21:13:05.957 INFO:tasks.workunit.client.1.smithi103.stdout:2/914: fsync d3/d5/d4a/d56/fd8 0 2024-09-18T21:13:05.957 INFO:tasks.workunit.client.1.smithi103.stdout:9/994: rename d18/d52/d6f/db9/dcb/l118 to d18/d29/d68/l148 0 2024-09-18T21:13:05.958 INFO:tasks.workunit.client.0.smithi077.stdout:0/929: creat d8/d1d/d110/f132 x:0 0 0 2024-09-18T21:13:05.959 INFO:tasks.workunit.client.0.smithi077.stdout:7/918: readlink d12/d31/d77/d93/d2a/d6c/l60 0 2024-09-18T21:13:05.960 INFO:tasks.workunit.client.1.smithi103.stdout:7/989: rmdir d1/df/d42/d1f/d2e/d3f 39 2024-09-18T21:13:05.962 INFO:tasks.workunit.client.0.smithi077.stdout:4/872: rename d3/dc/d32/d45/f9b to d3/dc/d51/f117 0 2024-09-18T21:13:05.966 INFO:tasks.workunit.client.1.smithi103.stdout:1/921: mknod d0/d2/d2b/d3a/d42/c145 0 2024-09-18T21:13:05.967 INFO:tasks.workunit.client.1.smithi103.stdout:9/995: mkdir d18/d29/d68/d92/d9c/dc8/deb/d149 0 2024-09-18T21:13:05.969 INFO:tasks.workunit.client.0.smithi077.stdout:0/930: symlink d8/d37/d66/d87/de0/d12c/l133 0 2024-09-18T21:13:05.969 INFO:tasks.workunit.client.1.smithi103.stdout:7/990: creat d1/df/d43/d61/d122/f14d x:0 0 0 2024-09-18T21:13:05.972 INFO:tasks.workunit.client.0.smithi077.stdout:8/807: rename d2/d27/d29/c34 to d2/c11b 0 2024-09-18T21:13:05.973 INFO:tasks.workunit.client.1.smithi103.stdout:2/915: mkdir d3/d5/d2f/d5b/d139 0 2024-09-18T21:13:05.973 INFO:tasks.workunit.client.0.smithi077.stdout:5/907: sync 2024-09-18T21:13:05.974 INFO:tasks.workunit.client.0.smithi077.stdout:2/894: write d1/d4/d5/d1a/d11e/fbc [284204,7057] 0 2024-09-18T21:13:05.979 INFO:tasks.workunit.client.1.smithi103.stdout:0/954: rename d1/d9/d3e/d6e/l8e to d1/d9/l14e 0 2024-09-18T21:13:05.981 INFO:tasks.workunit.client.1.smithi103.stdout:7/991: creat d1/df/d43/d63/d67/d5b/f14e x:0 0 0 2024-09-18T21:13:05.982 INFO:tasks.workunit.client.0.smithi077.stdout:0/931: symlink d8/d37/d95/d129/l134 0 2024-09-18T21:13:05.983 INFO:tasks.workunit.client.0.smithi077.stdout:1/793: truncate d3/d8/d13/f14 5552020 0 2024-09-18T21:13:05.983 INFO:tasks.workunit.client.0.smithi077.stdout:0/932: dread - d8/d1d/d80/ffd zero size 2024-09-18T21:13:05.983 INFO:tasks.workunit.client.1.smithi103.stdout:1/922: symlink d0/d2/d2b/d3a/d42/d87/d140/l146 0 2024-09-18T21:13:05.985 INFO:tasks.workunit.client.0.smithi077.stdout:5/908: mkdir d0/d6/dd/da5/d119/d128 0 2024-09-18T21:13:05.985 INFO:tasks.workunit.client.1.smithi103.stdout:2/916: truncate d3/d5/d2c/fd6 1088535 0 2024-09-18T21:13:05.987 INFO:tasks.workunit.client.0.smithi077.stdout:2/895: mknod d1/d4/d5/d1a/d2e/d7e/c12d 0 2024-09-18T21:13:05.987 INFO:tasks.workunit.client.0.smithi077.stdout:7/919: rmdir d12/d56 39 2024-09-18T21:13:05.990 INFO:tasks.workunit.client.0.smithi077.stdout:4/873: getdents d3 0 2024-09-18T21:13:05.990 INFO:tasks.workunit.client.1.smithi103.stdout:0/955: creat d1/d9/d3e/d6e/d12e/f14f x:0 0 0 2024-09-18T21:13:05.992 INFO:tasks.workunit.client.0.smithi077.stdout:2/896: dread d1/d4/fbd [0,4194304] 0 2024-09-18T21:13:05.992 INFO:tasks.workunit.client.0.smithi077.stdout:4/874: truncate d3/d77/d9c/db9/ff9 4251366 0 2024-09-18T21:13:05.995 INFO:tasks.workunit.client.1.smithi103.stdout:2/917: mknod d3/d5/d2f/d5b/c13a 0 2024-09-18T21:13:05.996 INFO:tasks.workunit.client.1.smithi103.stdout:2/918: write d3/d110/f115 [105302,73667] 0 2024-09-18T21:13:06.000 INFO:tasks.workunit.client.0.smithi077.stdout:1/794: symlink d3/d8/d13/l10a 0 2024-09-18T21:13:06.000 INFO:tasks.workunit.client.1.smithi103.stdout:7/992: dread d1/df/d42/d1f/d5d/f71 [0,4194304] 0 2024-09-18T21:13:06.000 INFO:tasks.workunit.client.1.smithi103.stdout:9/996: write d18/d29/d68/d78/fee [2457614,18696] 0 2024-09-18T21:13:06.002 INFO:tasks.workunit.client.1.smithi103.stdout:2/919: readlink d3/d5/d2c/d77/l10f 0 2024-09-18T21:13:06.004 INFO:tasks.workunit.client.0.smithi077.stdout:2/897: creat d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d83/dba/dcd/f12e x:0 0 0 2024-09-18T21:13:06.005 INFO:tasks.workunit.client.0.smithi077.stdout:2/898: chown d1/d4/d5/d1a/d113/d81/dc4/cec 0 1 2024-09-18T21:13:06.008 INFO:tasks.workunit.client.0.smithi077.stdout:4/875: dread d3/d7/d7b/d88/fcd [0,4194304] 0 2024-09-18T21:13:06.009 INFO:tasks.workunit.client.1.smithi103.stdout:7/993: fsync d1/df/dc7/fce 0 2024-09-18T21:13:06.011 INFO:tasks.workunit.client.1.smithi103.stdout:9/997: creat d18/d29/d68/dff/f14a x:0 0 0 2024-09-18T21:13:06.015 INFO:tasks.workunit.client.0.smithi077.stdout:5/909: write d0/df/d10/d5c/d74/ff0 [947118,100886] 0 2024-09-18T21:13:06.016 INFO:tasks.workunit.client.1.smithi103.stdout:1/923: dwrite d0/d2/fb [0,4194304] 0 2024-09-18T21:13:06.017 INFO:tasks.workunit.client.0.smithi077.stdout:2/899: read d1/d4/d5/d1a/d113/d81/fa8 [17850,80255] 0 2024-09-18T21:13:06.018 INFO:tasks.workunit.client.1.smithi103.stdout:1/924: truncate d0/d11/d5f/f13f 412649 0 2024-09-18T21:13:06.018 INFO:tasks.workunit.client.1.smithi103.stdout:7/994: creat d1/df/d42/d29/d48/dbb/ded/dfe/d12b/f14f x:0 0 0 2024-09-18T21:13:06.019 INFO:tasks.workunit.client.0.smithi077.stdout:4/876: mkdir d3/dc/d32/d45/d5e/df0/d118 0 2024-09-18T21:13:06.020 INFO:tasks.workunit.client.0.smithi077.stdout:0/933: write d8/d37/d95/dab/f7f [3312086,77115] 0 2024-09-18T21:13:06.022 INFO:tasks.workunit.client.0.smithi077.stdout:8/808: mkdir d2/d27/d29/d41/dbc/d11c 0 2024-09-18T21:13:06.024 INFO:tasks.workunit.client.0.smithi077.stdout:1/795: write d3/d8/d93/dd3/f46 [3202865,10157] 0 2024-09-18T21:13:06.025 INFO:tasks.workunit.client.1.smithi103.stdout:0/956: dwrite d1/d5/de/d22/d6a/f13f [0,4194304] 0 2024-09-18T21:13:06.025 INFO:tasks.workunit.client.0.smithi077.stdout:1/796: readlink d3/d8/d49/d4e/d5a/ld7 0 2024-09-18T21:13:06.025 INFO:tasks.workunit.client.1.smithi103.stdout:1/925: unlink d0/d2/d9/dc/d36/d52/f102 0 2024-09-18T21:13:06.026 INFO:tasks.workunit.client.1.smithi103.stdout:7/995: dwrite d1/df/d43/d52/f148 [0,4194304] 0 2024-09-18T21:13:06.026 INFO:tasks.workunit.client.0.smithi077.stdout:5/910: creat d0/df/d10/de1/d110/f129 x:0 0 0 2024-09-18T21:13:06.027 INFO:tasks.workunit.client.0.smithi077.stdout:2/900: symlink d1/d4/d5/d1a/d113/d81/dc4/l12f 0 2024-09-18T21:13:06.028 INFO:tasks.workunit.client.1.smithi103.stdout:9/998: creat d18/d29/d68/d92/d9c/dc8/deb/d149/f14b x:0 0 0 2024-09-18T21:13:06.031 INFO:tasks.workunit.client.1.smithi103.stdout:2/920: creat d3/f13b x:0 0 0 2024-09-18T21:13:06.034 INFO:tasks.workunit.client.1.smithi103.stdout:2/921: chown d3/d5/d2c/d54/d68/f11e 133559660 1 2024-09-18T21:13:06.034 INFO:tasks.workunit.client.1.smithi103.stdout:7/996: creat d1/df/d43/d63/d67/f150 x:0 0 0 2024-09-18T21:13:06.035 INFO:tasks.workunit.client.0.smithi077.stdout:1/797: creat d3/d8/d49/d4e/d50/f10b x:0 0 0 2024-09-18T21:13:06.037 INFO:tasks.workunit.client.0.smithi077.stdout:1/798: chown d3/d6a/d9b/f3b 2 1 2024-09-18T21:13:06.037 INFO:tasks.workunit.client.1.smithi103.stdout:0/957: dwrite d1/d5/de/dc0/d8c/dce/d9f/f37 [4194304,4194304] 0 2024-09-18T21:13:06.038 INFO:tasks.workunit.client.1.smithi103.stdout:0/958: write d1/d5/de/d22/f57 [680600,108665] 0 2024-09-18T21:13:06.042 INFO:tasks.workunit.client.1.smithi103.stdout:1/926: readlink d0/d2/d2b/d3a/d42/d72/db0/da7/lc7 0 2024-09-18T21:13:06.048 INFO:tasks.workunit.client.1.smithi103.stdout:2/922: creat d3/d5/d2f/d32/d90/df0/d112/f13c x:0 0 0 2024-09-18T21:13:06.052 INFO:tasks.workunit.client.1.smithi103.stdout:7/997: dwrite d1/f8e [4194304,4194304] 0 2024-09-18T21:13:06.054 INFO:tasks.workunit.client.1.smithi103.stdout:1/927: read - d0/d11/d5f/f93 zero size 2024-09-18T21:13:06.056 INFO:tasks.workunit.client.1.smithi103.stdout:2/923: dread - d3/d5/f36 zero size 2024-09-18T21:13:06.057 INFO:tasks.workunit.client.1.smithi103.stdout:9/999: dread d18/d8d/d2f/f101 [0,4194304] 0 2024-09-18T21:13:06.058 INFO:tasks.workunit.client.0.smithi077.stdout:4/877: rmdir d3/dc/d32/d45/d5e/d103 0 2024-09-18T21:13:06.058 INFO:tasks.workunit.client.1.smithi103.stdout:2/924: truncate d3/d5/d2f/d32/d90/df0/d112/f13c 349636 0 2024-09-18T21:13:06.059 INFO:tasks.workunit.client.0.smithi077.stdout:0/934: dwrite d8/d37/dd2/fd9 [0,4194304] 0 2024-09-18T21:13:06.062 INFO:tasks.workunit.client.0.smithi077.stdout:5/911: creat d0/d6/f12a x:0 0 0 2024-09-18T21:13:06.065 INFO:tasks.workunit.client.0.smithi077.stdout:8/809: dread d2/d5f/da8/d4f/d5a/fc7 [0,4194304] 0 2024-09-18T21:13:06.066 INFO:tasks.workunit.client.1.smithi103.stdout:0/959: write d1/d5/de/dc0/d8c/dce/d9f/f46 [167543,30056] 0 2024-09-18T21:13:06.067 INFO:tasks.workunit.client.0.smithi077.stdout:2/901: dwrite d1/d4/d9/d4f/fe4 [0,4194304] 0 2024-09-18T21:13:06.069 INFO:tasks.workunit.client.1.smithi103.stdout:1/928: mkdir d0/d2/d9/dc/d6e/dac/dfa/d147 0 2024-09-18T21:13:06.069 INFO:tasks.workunit.client.0.smithi077.stdout:1/799: dwrite d3/d8/d49/d4e/fe9 [4194304,4194304] 0 2024-09-18T21:13:06.071 INFO:tasks.workunit.client.0.smithi077.stdout:1/800: dread - d3/d8/d93/dd3/f74 zero size 2024-09-18T21:13:06.073 INFO:tasks.workunit.client.0.smithi077.stdout:4/878: dread d3/dc/d32/d45/d5e/fc2 [0,4194304] 0 2024-09-18T21:13:06.074 INFO:tasks.workunit.client.1.smithi103.stdout:2/925: mknod d3/d5/d2f/d5b/d139/c13d 0 2024-09-18T21:13:06.075 INFO:tasks.workunit.client.0.smithi077.stdout:4/879: write d3/d35/f104 [395531,52919] 0 2024-09-18T21:13:06.077 INFO:tasks.workunit.client.1.smithi103.stdout:0/960: symlink d1/d5/de/dc0/d8c/dce/d9f/d4f/de8/l150 0 2024-09-18T21:13:06.079 INFO:tasks.workunit.client.1.smithi103.stdout:7/998: creat d1/df/f151 x:0 0 0 2024-09-18T21:13:06.080 INFO:tasks.workunit.client.0.smithi077.stdout:1/801: creat d3/d8/d49/df0/f10c x:0 0 0 2024-09-18T21:13:06.080 INFO:tasks.workunit.client.1.smithi103.stdout:1/929: mknod d0/d2/d9/dc/d6e/dac/c148 0 2024-09-18T21:13:06.082 INFO:tasks.workunit.client.1.smithi103.stdout:2/926: fsync d3/d5/d2c/f88 0 2024-09-18T21:13:06.083 INFO:tasks.workunit.client.1.smithi103.stdout:2/927: read d3/d5/d2f/d93/fa1 [2222225,9351] 0 2024-09-18T21:13:06.083 INFO:tasks.workunit.client.1.smithi103.stdout:0/961: truncate d1/d5/de/dc0/dbf/d4e/f66 3439639 0 2024-09-18T21:13:06.085 INFO:tasks.workunit.client.0.smithi077.stdout:8/810: rename d2/d5/d6/d9f to d2/d5f/da8/d4f/d5a/d2a/dc8/df1/d11d 0 2024-09-18T21:13:06.085 INFO:tasks.workunit.client.0.smithi077.stdout:8/811: dread - d2/d5f/def/f117 zero size 2024-09-18T21:13:06.086 INFO:tasks.workunit.client.0.smithi077.stdout:2/902: symlink d1/d4/d5/d1a/d113/d81/d122/d129/l130 0 2024-09-18T21:13:06.086 INFO:tasks.workunit.client.1.smithi103.stdout:1/930: dwrite d0/d2/fc8 [0,4194304] 0 2024-09-18T21:13:06.087 INFO:tasks.workunit.client.1.smithi103.stdout:1/931: chown d0/d2/d2b/d3a/d42/d87 1909 1 2024-09-18T21:13:06.089 INFO:tasks.workunit.client.0.smithi077.stdout:0/935: link d8/d1a/d35/f131 d8/d1a/d39/d3b/d70/f135 0 2024-09-18T21:13:06.091 INFO:tasks.workunit.client.1.smithi103.stdout:2/928: write d3/d5/d2f/f108 [215110,55387] 0 2024-09-18T21:13:06.093 INFO:tasks.workunit.client.1.smithi103.stdout:0/962: unlink d1/d5/de/l143 0 2024-09-18T21:13:06.096 INFO:tasks.workunit.client.1.smithi103.stdout:7/999: mkdir d1/df/d42/d1f/d2e/d3f/d152 0 2024-09-18T21:13:06.097 INFO:tasks.workunit.client.0.smithi077.stdout:8/812: write d2/d5f/da8/d4f/d5a/d2a/dc8/df1/d11d/da6/d110/fbf [3666271,105428] 0 2024-09-18T21:13:06.099 INFO:tasks.workunit.client.0.smithi077.stdout:1/802: mknod d3/d8/d13/c10d 0 2024-09-18T21:13:06.100 INFO:tasks.workunit.client.1.smithi103.stdout:0/963: dwrite d1/d5/de/dc0/dbf/f111 [0,4194304] 0 2024-09-18T21:13:06.101 INFO:tasks.workunit.client.0.smithi077.stdout:1/803: fsync d3/d8/d93/dd3/f46 0 2024-09-18T21:13:06.102 INFO:tasks.workunit.client.0.smithi077.stdout:4/880: dread d3/dc/d24/f8e [0,4194304] 0 2024-09-18T21:13:06.104 INFO:tasks.workunit.client.1.smithi103.stdout:2/929: rename d3/f20 to d3/d5/d2c/f13e 0 2024-09-18T21:13:06.106 INFO:tasks.workunit.client.0.smithi077.stdout:8/813: dwrite d2/d5f/da8/d26/d106/f10a [0,4194304] 0 2024-09-18T21:13:06.110 INFO:tasks.workunit.client.1.smithi103.stdout:1/932: symlink d0/d2/d2b/d3a/d42/d72/db0/da7/l149 0 2024-09-18T21:13:06.114 INFO:tasks.workunit.client.1.smithi103.stdout:2/930: mknod d3/d110/d11a/c13f 0 2024-09-18T21:13:06.116 INFO:tasks.workunit.client.1.smithi103.stdout:1/933: symlink d0/d2/d2b/d3a/d42/d9c/l14a 0 2024-09-18T21:13:06.117 INFO:tasks.workunit.client.0.smithi077.stdout:1/804: mknod d3/d38/d97/dea/c10e 0 2024-09-18T21:13:06.117 INFO:tasks.workunit.client.0.smithi077.stdout:2/903: dread d1/d4/d5/d1a/d2e/d7e/ff4 [0,4194304] 0 2024-09-18T21:13:06.119 INFO:tasks.workunit.client.0.smithi077.stdout:8/814: mkdir d2/d5f/da8/d4f/d5a/d5e/d8f/d6e/d11e 0 2024-09-18T21:13:06.121 INFO:tasks.workunit.client.1.smithi103.stdout:1/934: creat d0/d2/d2b/d111/f14b x:0 0 0 2024-09-18T21:13:06.124 INFO:tasks.workunit.client.0.smithi077.stdout:0/936: creat d8/d37/d66/d87/de0/dce/f136 x:0 0 0 2024-09-18T21:13:06.125 INFO:tasks.workunit.client.0.smithi077.stdout:2/904: symlink d1/d4/d5/d1a/d49/l131 0 2024-09-18T21:13:06.127 INFO:tasks.workunit.client.0.smithi077.stdout:8/815: rmdir d2/d5f/da8/d4f/d5a/d2a/dc8/df1 39 2024-09-18T21:13:06.128 INFO:tasks.workunit.client.1.smithi103.stdout:1/935: dwrite d0/d2/d9/d9e/d7a/dd0/df9/d68/d81/da2/da4/dc2/dd8/dae/f143 [0,4194304] 0 2024-09-18T21:13:06.128 INFO:tasks.workunit.client.1.smithi103.stdout:1/936: readlink d0/d2/d9/d10/lec 0 2024-09-18T21:13:06.131 INFO:tasks.workunit.client.0.smithi077.stdout:1/805: mkdir d3/d8/d93/dd3/d99/dfd/d10f 0 2024-09-18T21:13:06.132 INFO:tasks.workunit.client.0.smithi077.stdout:1/806: readlink d3/d8/d49/d4e/ldb 0 2024-09-18T21:13:06.133 INFO:tasks.workunit.client.0.smithi077.stdout:2/905: truncate d1/d4/d9/f51 699347 0 2024-09-18T21:13:06.135 INFO:tasks.workunit.client.0.smithi077.stdout:2/906: write d1/d4/d5/d1a/d2e/d41/f120 [27171,78653] 0 2024-09-18T21:13:06.136 INFO:tasks.workunit.client.1.smithi103.stdout:1/937: rename d0/d11/c64 to d0/d2/d9/d9e/d7a/dd0/df9/d68/d119/c14c 0 2024-09-18T21:13:06.138 INFO:tasks.workunit.client.1.smithi103.stdout:1/938: dread - d0/d2/d9/d10/d5d/d6f/f141 zero size 2024-09-18T21:13:06.138 INFO:tasks.workunit.client.1.smithi103.stdout:2/931: dwrite d3/fcf [0,4194304] 0 2024-09-18T21:13:06.143 INFO:tasks.workunit.client.0.smithi077.stdout:2/907: symlink d1/d4/d5/d1a/d49/l132 0 2024-09-18T21:13:06.144 INFO:tasks.workunit.client.1.smithi103.stdout:2/932: dwrite d3/d5/d2f/d32/d90/dd7/f120 [4194304,4194304] 0 2024-09-18T21:13:06.147 INFO:tasks.workunit.client.0.smithi077.stdout:4/881: dwrite d3/d7/f11 [0,4194304] 0 2024-09-18T21:13:06.149 INFO:tasks.workunit.client.0.smithi077.stdout:2/908: mkdir d1/d4/d5/d1a/d113/d133 0 2024-09-18T21:13:06.153 INFO:tasks.workunit.client.0.smithi077.stdout:1/807: dwrite d3/d8/d13/f101 [4194304,4194304] 0 2024-09-18T21:13:06.154 INFO:tasks.workunit.client.0.smithi077.stdout:0/937: write d8/d1a/fe5 [195454,42130] 0 2024-09-18T21:13:06.155 INFO:tasks.workunit.client.0.smithi077.stdout:8/816: write d2/d5f/da8/d20/f24 [473898,43430] 0 2024-09-18T21:13:06.156 INFO:tasks.workunit.client.0.smithi077.stdout:1/808: write d3/d8/f105 [646690,89198] 0 2024-09-18T21:13:06.158 INFO:tasks.workunit.client.0.smithi077.stdout:2/909: rmdir d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d83/dba 39 2024-09-18T21:13:06.161 INFO:tasks.workunit.client.0.smithi077.stdout:8/817: readlink d2/d5/d6/l59 0 2024-09-18T21:13:06.161 INFO:tasks.workunit.client.0.smithi077.stdout:0/938: rmdir d8/d1a/d39/d3b 39 2024-09-18T21:13:06.163 INFO:tasks.workunit.client.0.smithi077.stdout:1/809: mknod d3/d6a/c110 0 2024-09-18T21:13:06.164 INFO:tasks.workunit.client.0.smithi077.stdout:2/910: truncate d1/d4/d5/d1a/d113/f8b 2300433 0 2024-09-18T21:13:06.165 INFO:tasks.workunit.client.0.smithi077.stdout:8/818: mknod d2/d5f/da8/d4f/d5a/d5e/d8f/c11f 0 2024-09-18T21:13:06.166 INFO:tasks.workunit.client.1.smithi103.stdout:1/939: write d0/d2/d9/d9e/d7a/f9b [861158,69661] 0 2024-09-18T21:13:06.168 INFO:tasks.workunit.client.0.smithi077.stdout:1/810: rename d3/d8/d13/l10a to d3/d8/d93/l111 0 2024-09-18T21:13:06.169 INFO:tasks.workunit.client.0.smithi077.stdout:1/811: chown d3/d8/d49/df0/ff7 24466 1 2024-09-18T21:13:06.170 INFO:tasks.workunit.client.0.smithi077.stdout:2/911: symlink d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d8e/de7/l134 0 2024-09-18T21:13:06.172 INFO:tasks.workunit.client.1.smithi103.stdout:1/940: symlink d0/d2/d9/d9e/d7a/dd0/d10f/d10a/l14d 0 2024-09-18T21:13:06.172 INFO:tasks.workunit.client.1.smithi103.stdout:2/933: write d3/d5/d2c/d54/f7b [1720995,40572] 0 2024-09-18T21:13:06.172 INFO:tasks.workunit.client.0.smithi077.stdout:2/912: stat d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d95/ff5 0 2024-09-18T21:13:06.174 INFO:tasks.workunit.client.0.smithi077.stdout:8/819: dread - d2/d5f/da8/d4f/d5a/d2a/dc8/df1/f107 zero size 2024-09-18T21:13:06.175 INFO:tasks.workunit.client.0.smithi077.stdout:1/812: rename d3/d8/d93/dd3/dc1 to d3/d6a/d112 0 2024-09-18T21:13:06.177 INFO:tasks.workunit.client.0.smithi077.stdout:2/913: fdatasync d1/d4/d5/d1a/d2e/d40/f99 0 2024-09-18T21:13:06.178 INFO:tasks.workunit.client.1.smithi103.stdout:2/934: dwrite d3/d5/d2c/d77/fdb [4194304,4194304] 0 2024-09-18T21:13:06.178 INFO:tasks.workunit.client.0.smithi077.stdout:8/820: dread - d2/d5f/da8/d4f/d5a/d2a/dc8/df1/d11d/f10f zero size 2024-09-18T21:13:06.179 INFO:tasks.workunit.client.1.smithi103.stdout:2/935: dread - d3/d5/d2f/d32/d90/dd7/f129 zero size 2024-09-18T21:13:06.179 INFO:tasks.workunit.client.0.smithi077.stdout:4/882: dwrite d3/d7/d42/fb8 [0,4194304] 0 2024-09-18T21:13:06.184 INFO:tasks.workunit.client.1.smithi103.stdout:1/941: link d0/c1 d0/d2/d9/dc/d6e/deb/c14e 0 2024-09-18T21:13:06.184 INFO:tasks.workunit.client.0.smithi077.stdout:4/883: symlink d3/dc/d20/l119 0 2024-09-18T21:13:06.192 INFO:tasks.workunit.client.0.smithi077.stdout:4/884: creat d3/dc/d51/d53/dce/f11a x:0 0 0 2024-09-18T21:13:06.193 INFO:tasks.workunit.client.0.smithi077.stdout:0/939: dread d8/d1d/f11b [0,4194304] 0 2024-09-18T21:13:06.199 INFO:tasks.workunit.client.0.smithi077.stdout:0/940: creat d8/d1a/d39/dd0/f137 x:0 0 0 2024-09-18T21:13:06.206 INFO:tasks.workunit.client.0.smithi077.stdout:4/885: link d3/d35/db1/l10d d3/d77/d9c/db9/l11b 0 2024-09-18T21:13:06.208 INFO:tasks.workunit.client.0.smithi077.stdout:1/813: dwrite d3/d8/d93/dd3/f91 [0,4194304] 0 2024-09-18T21:13:06.209 INFO:tasks.workunit.client.1.smithi103.stdout:1/942: write d0/d2/d9/dc/f7e [386276,43286] 0 2024-09-18T21:13:06.209 INFO:tasks.workunit.client.0.smithi077.stdout:8/821: write d2/d5f/da8/d4f/d5a/f5c [2397607,92081] 0 2024-09-18T21:13:06.209 INFO:tasks.workunit.client.1.smithi103.stdout:1/943: dread - d0/d2/d2b/d3a/d42/d72/db0/f10b zero size 2024-09-18T21:13:06.211 INFO:tasks.workunit.client.1.smithi103.stdout:1/944: chown d0/d2/d2b/d3a/d42/d87/d140 24 1 2024-09-18T21:13:06.213 INFO:tasks.workunit.client.0.smithi077.stdout:0/941: write d8/d37/f63 [3466758,60845] 0 2024-09-18T21:13:06.216 INFO:tasks.workunit.client.0.smithi077.stdout:1/814: mknod d3/d6a/d9b/d7f/c113 0 2024-09-18T21:13:06.218 INFO:tasks.workunit.client.1.smithi103.stdout:1/945: rename d0/d11/d5f/c6a to d0/d2/d2b/c14f 0 2024-09-18T21:13:06.218 INFO:tasks.workunit.client.0.smithi077.stdout:2/914: dwrite d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d83/dba/ddc/dff/f127 [0,4194304] 0 2024-09-18T21:13:06.221 INFO:tasks.workunit.client.1.smithi103.stdout:1/946: fsync d0/d2/d2b/fcf 0 2024-09-18T21:13:06.222 INFO:tasks.workunit.client.0.smithi077.stdout:4/886: dread d3/d77/d9c/db9/ff9 [0,4194304] 0 2024-09-18T21:13:06.223 INFO:tasks.workunit.client.0.smithi077.stdout:0/942: symlink d8/d37/d66/d87/de0/dce/dcf/l138 0 2024-09-18T21:13:06.223 INFO:tasks.workunit.client.0.smithi077.stdout:4/887: dread - d3/dc/d32/d45/d5e/f101 zero size 2024-09-18T21:13:06.224 INFO:tasks.workunit.client.1.smithi103.stdout:0/964: sync 2024-09-18T21:13:06.224 INFO:tasks.workunit.client.0.smithi077.stdout:1/815: creat d3/d38/dd5/f114 x:0 0 0 2024-09-18T21:13:06.224 INFO:tasks.workunit.client.0.smithi077.stdout:0/943: chown d8/d1a/cbe 341 1 2024-09-18T21:13:06.226 INFO:tasks.workunit.client.1.smithi103.stdout:0/965: fsync d1/d9/d3e/d6e/f11c 0 2024-09-18T21:13:06.226 INFO:tasks.workunit.client.0.smithi077.stdout:0/944: fsync d8/d37/d66/d102/f123 0 2024-09-18T21:13:06.227 INFO:tasks.workunit.client.1.smithi103.stdout:0/966: dread - d1/d9/d48/f139 zero size 2024-09-18T21:13:06.228 INFO:tasks.workunit.client.1.smithi103.stdout:1/947: link d0/d2/d9/d9e/d7a/dd0/df9/d68/d81/da2/da4/dc2/dd8/dae/cb5 d0/d2/d2b/d3a/d42/d87/d140/c150 0 2024-09-18T21:13:06.233 INFO:tasks.workunit.client.1.smithi103.stdout:1/948: rmdir d0/d2/d9/dc/d6e/dac 39 2024-09-18T21:13:06.234 INFO:tasks.workunit.client.0.smithi077.stdout:1/816: dwrite d3/d8/d49/df0/f10c [0,4194304] 0 2024-09-18T21:13:06.235 INFO:tasks.workunit.client.0.smithi077.stdout:8/822: write d2/d5/d6/f14 [5627177,117373] 0 2024-09-18T21:13:06.238 INFO:tasks.workunit.client.1.smithi103.stdout:1/949: creat d0/d2/d9/d10/d5d/f151 x:0 0 0 2024-09-18T21:13:06.239 INFO:tasks.workunit.client.1.smithi103.stdout:0/967: link d1/d5/de/d22/f5b d1/d9/d3e/d6e/d12e/f151 0 2024-09-18T21:13:06.240 INFO:tasks.workunit.client.0.smithi077.stdout:0/945: rename d8/d37/d66/d87/de0/d12c/l133 to d8/d37/d95/dab/l139 0 2024-09-18T21:13:06.243 INFO:tasks.workunit.client.1.smithi103.stdout:1/950: fsync d0/d2/d2b/d3a/d42/d72/f8f 0 2024-09-18T21:13:06.244 INFO:tasks.workunit.client.1.smithi103.stdout:0/968: stat d1/d93/fe0 0 2024-09-18T21:13:06.246 INFO:tasks.workunit.client.0.smithi077.stdout:4/888: truncate d3/dc/d32/d45/faa 8932219 0 2024-09-18T21:13:06.250 INFO:tasks.workunit.client.0.smithi077.stdout:1/817: mknod d3/d8/d93/dd3/d99/dfd/d10f/c115 0 2024-09-18T21:13:06.250 INFO:tasks.workunit.client.0.smithi077.stdout:1/818: stat d3/d6a/lfb 0 2024-09-18T21:13:06.251 INFO:tasks.workunit.client.1.smithi103.stdout:0/969: write d1/f29 [4600673,42993] 0 2024-09-18T21:13:06.251 INFO:tasks.workunit.client.0.smithi077.stdout:1/819: chown d3/d8/d93/dd3 27 1 2024-09-18T21:13:06.252 INFO:tasks.workunit.client.0.smithi077.stdout:1/820: readlink d3/d8/d49/d4e/lbf 0 2024-09-18T21:13:06.253 INFO:tasks.workunit.client.1.smithi103.stdout:1/951: mkdir d0/d2/d9/dc/d36/d52/d12e/d152 0 2024-09-18T21:13:06.254 INFO:tasks.workunit.client.1.smithi103.stdout:1/952: fsync d0/d2/d2b/d3a/d42/d72/db0/f10b 0 2024-09-18T21:13:06.254 INFO:tasks.workunit.client.1.smithi103.stdout:0/970: readlink d1/d5/de/d24/d43/l7b 0 2024-09-18T21:13:06.257 INFO:tasks.workunit.client.0.smithi077.stdout:2/915: dread d1/fd [8388608,4194304] 0 2024-09-18T21:13:06.258 INFO:tasks.workunit.client.0.smithi077.stdout:8/823: getdents d2/d5f/da8/d4f 0 2024-09-18T21:13:06.258 INFO:tasks.workunit.client.1.smithi103.stdout:2/936: sync 2024-09-18T21:13:06.259 INFO:tasks.workunit.client.1.smithi103.stdout:0/971: rename d1/d5/de/d22/l95 to d1/d5/de/d24/d43/d76/dc5/l152 0 2024-09-18T21:13:06.260 INFO:tasks.workunit.client.0.smithi077.stdout:0/946: dwrite d8/d1a/d39/f86 [0,4194304] 0 2024-09-18T21:13:06.263 INFO:tasks.workunit.client.1.smithi103.stdout:0/972: creat d1/d5/de/d22/d6a/f153 x:0 0 0 2024-09-18T21:13:06.264 INFO:tasks.workunit.client.0.smithi077.stdout:1/821: getdents d3/d6a/d9b/d4c 0 2024-09-18T21:13:06.265 INFO:tasks.workunit.client.1.smithi103.stdout:0/973: write d1/d5/de/d24/d43/d81/fb2 [4512783,2013] 0 2024-09-18T21:13:06.265 INFO:tasks.workunit.client.1.smithi103.stdout:1/953: dread d0/d2/d9/d9e/d7a/dd0/df9/f29 [4194304,4194304] 0 2024-09-18T21:13:06.266 INFO:tasks.workunit.client.0.smithi077.stdout:2/916: mknod d1/d12a/c135 0 2024-09-18T21:13:06.266 INFO:tasks.workunit.client.1.smithi103.stdout:0/974: stat d1/d5/ca1 0 2024-09-18T21:13:06.266 INFO:tasks.workunit.client.1.smithi103.stdout:1/954: chown d0/d2/fb 607 1 2024-09-18T21:13:06.267 INFO:tasks.workunit.client.0.smithi077.stdout:8/824: creat d2/d27/d29/d41/dbc/d11c/f120 x:0 0 0 2024-09-18T21:13:06.268 INFO:tasks.workunit.client.0.smithi077.stdout:1/822: write d3/d38/d97/dea/feb [993425,14456] 0 2024-09-18T21:13:06.268 INFO:tasks.workunit.client.0.smithi077.stdout:2/917: write d1/f92 [613731,40185] 0 2024-09-18T21:13:06.271 INFO:tasks.workunit.client.0.smithi077.stdout:0/947: dwrite d8/d1d/de3/f116 [0,4194304] 0 2024-09-18T21:13:06.272 INFO:tasks.workunit.client.1.smithi103.stdout:1/955: truncate d0/d2/d9/fee 840903 0 2024-09-18T21:13:06.272 INFO:tasks.workunit.client.1.smithi103.stdout:1/956: chown d0/d2/d9/d9e/d7a/dd0/d10f/d134 523161 1 2024-09-18T21:13:06.273 INFO:tasks.workunit.client.0.smithi077.stdout:2/918: chown d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d83/dba/ddc/dff/l108 178 1 2024-09-18T21:13:06.273 INFO:tasks.workunit.client.1.smithi103.stdout:1/957: readlink d0/d2/d2b/lf0 0 2024-09-18T21:13:06.275 INFO:tasks.workunit.client.0.smithi077.stdout:2/919: dread - d1/d4/d5/d1a/d11e/f11d zero size 2024-09-18T21:13:06.276 INFO:tasks.workunit.client.1.smithi103.stdout:1/958: write d0/d2/d9/d9e/d7a/dd0/df9/d68/d81/da2/da4/dc2/dd8/fb6 [1564740,74297] 0 2024-09-18T21:13:06.276 INFO:tasks.workunit.client.1.smithi103.stdout:0/975: rename d1/d5/de/d24/d43/dfd/l120 to d1/d5/de/dc0/d8c/dce/d9f/d4f/de8/l154 0 2024-09-18T21:13:06.279 INFO:tasks.workunit.client.0.smithi077.stdout:1/823: mknod d3/d8/d93/dd3/d99/dfd/c116 0 2024-09-18T21:13:06.280 INFO:tasks.workunit.client.0.smithi077.stdout:2/920: truncate d1/d4/d9/fb 1245841 0 2024-09-18T21:13:06.280 INFO:tasks.workunit.client.1.smithi103.stdout:2/937: dwrite d3/d5/f38 [0,4194304] 0 2024-09-18T21:13:06.283 INFO:tasks.workunit.client.0.smithi077.stdout:1/824: creat d3/d8/d93/dd3/d99/dfc/f117 x:0 0 0 2024-09-18T21:13:06.283 INFO:tasks.workunit.client.0.smithi077.stdout:8/825: link d2/d5/d6/c3a d2/d27/d29/d41/dbc/c121 0 2024-09-18T21:13:06.286 INFO:tasks.workunit.client.1.smithi103.stdout:1/959: dwrite d0/d2/d2b/d111/f14b [0,4194304] 0 2024-09-18T21:13:06.288 INFO:tasks.workunit.client.1.smithi103.stdout:1/960: chown d0/d2/d9/dc/d6e/c9a 1064 1 2024-09-18T21:13:06.288 INFO:tasks.workunit.client.1.smithi103.stdout:0/976: symlink d1/d5/de/dc0/d8c/dce/l155 0 2024-09-18T21:13:06.290 INFO:tasks.workunit.client.1.smithi103.stdout:2/938: dwrite d3/d5/d2f/d93/f113 [0,4194304] 0 2024-09-18T21:13:06.290 INFO:tasks.workunit.client.1.smithi103.stdout:2/939: stat d3/d136 0 2024-09-18T21:13:06.291 INFO:tasks.workunit.client.0.smithi077.stdout:1/825: creat d3/d8/d49/d4e/d5a/f118 x:0 0 0 2024-09-18T21:13:06.291 INFO:tasks.workunit.client.0.smithi077.stdout:2/921: dwrite d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d83/dba/dcd/f10e [0,4194304] 0 2024-09-18T21:13:06.291 INFO:tasks.workunit.client.1.smithi103.stdout:2/940: stat d3/d5/d2c/d54/d68/d102/d111 0 2024-09-18T21:13:06.292 INFO:tasks.workunit.client.1.smithi103.stdout:2/941: readlink d3/d5/d2c/d77/d9c/l118 0 2024-09-18T21:13:06.293 INFO:tasks.workunit.client.1.smithi103.stdout:1/961: mknod d0/d2/d2b/d3a/d42/c153 0 2024-09-18T21:13:06.295 INFO:tasks.workunit.client.0.smithi077.stdout:0/948: link d8/d26/f15 d8/d37/d95/d129/f13a 0 2024-09-18T21:13:06.295 INFO:tasks.workunit.client.0.smithi077.stdout:8/826: dread d2/d5f/da8/d4f/f69 [0,4194304] 0 2024-09-18T21:13:06.297 INFO:tasks.workunit.client.0.smithi077.stdout:1/826: creat d3/d8/d93/f119 x:0 0 0 2024-09-18T21:13:06.298 INFO:tasks.workunit.client.1.smithi103.stdout:2/942: fdatasync d3/d5/d2f/d48/f4f 0 2024-09-18T21:13:06.300 INFO:tasks.workunit.client.0.smithi077.stdout:2/922: symlink d1/d4/d5/d1a/d113/d81/d122/d129/l136 0 2024-09-18T21:13:06.371 INFO:tasks.workunit.client.0.smithi077.stdout:8/827: dread d2/d5f/da8/d26/f32 [0,4194304] 0 2024-09-18T21:13:06.428 INFO:tasks.workunit.client.0.smithi077.stdout:8/828: mkdir d2/d27/d29/d41/dbc/dce/d122 0 2024-09-18T21:13:06.429 INFO:tasks.workunit.client.0.smithi077.stdout:2/923: getdents d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d95 0 2024-09-18T21:13:06.429 INFO:tasks.workunit.client.1.smithi103.stdout:0/977: dwrite d1/d9/fb5 [0,4194304] 0 2024-09-18T21:13:06.431 INFO:tasks.workunit.client.1.smithi103.stdout:2/943: rmdir d3/d5/d2c/d54/d68/d12f 0 2024-09-18T21:13:06.438 INFO:tasks.workunit.client.0.smithi077.stdout:1/827: dread d3/d8/d13/f26 [0,4194304] 0 2024-09-18T21:13:06.439 INFO:tasks.workunit.client.1.smithi103.stdout:1/962: dwrite d0/d2/d2b/d3a/d42/d72/f8f [0,4194304] 0 2024-09-18T21:13:06.440 INFO:tasks.workunit.client.1.smithi103.stdout:2/944: dwrite d3/d5/d2f/d5b/ffe [0,4194304] 0 2024-09-18T21:13:06.447 INFO:tasks.workunit.client.1.smithi103.stdout:0/978: dread d1/d5/de/d24/f32 [0,4194304] 0 2024-09-18T21:13:06.451 INFO:tasks.workunit.client.1.smithi103.stdout:0/979: dread d1/d5/f6 [4194304,4194304] 0 2024-09-18T21:13:06.458 INFO:tasks.workunit.client.0.smithi077.stdout:0/949: dread d8/d37/d95/d129/f13a [0,4194304] 0 2024-09-18T21:13:06.458 INFO:tasks.workunit.client.0.smithi077.stdout:0/950: chown d8/d1d/d80 1 1 2024-09-18T21:13:06.460 INFO:tasks.workunit.client.1.smithi103.stdout:0/980: creat d1/d5/de/d19/f156 x:0 0 0 2024-09-18T21:13:06.460 INFO:tasks.workunit.client.1.smithi103.stdout:0/981: readlink d1/d9/l12f 0 2024-09-18T21:13:06.461 INFO:tasks.workunit.client.1.smithi103.stdout:0/982: dread - d1/d5/de/d24/d43/d76/dc5/f140 zero size 2024-09-18T21:13:06.462 INFO:tasks.workunit.client.1.smithi103.stdout:0/983: truncate d1/d9/d3e/dfc/f116 134240 0 2024-09-18T21:13:06.462 INFO:tasks.workunit.client.1.smithi103.stdout:2/945: truncate d3/d5/d2c/fd6 351621 0 2024-09-18T21:13:06.480 INFO:tasks.workunit.client.1.smithi103.stdout:2/946: dwrite d3/d5/d2f/d48/dab/fb5 [0,4194304] 0 2024-09-18T21:13:06.485 INFO:tasks.workunit.client.1.smithi103.stdout:2/947: creat d3/d5/d2f/d48/dab/f140 x:0 0 0 2024-09-18T21:13:06.491 INFO:tasks.workunit.client.1.smithi103.stdout:2/948: mkdir d3/d5/d2f/d32/d90/dd7/dc4/d141 0 2024-09-18T21:13:06.495 INFO:tasks.workunit.client.1.smithi103.stdout:2/949: write d3/f6e [721379,7748] 0 2024-09-18T21:13:06.501 INFO:tasks.workunit.client.1.smithi103.stdout:2/950: read d3/d5/d4a/fb9 [2429168,29086] 0 2024-09-18T21:13:06.508 INFO:tasks.workunit.client.1.smithi103.stdout:2/951: symlink d3/d5/d2c/d54/d68/d102/d121/l142 0 2024-09-18T21:13:06.525 INFO:tasks.workunit.client.0.smithi077.stdout:1/828: creat d3/d8/d49/d4e/d50/f11a x:0 0 0 2024-09-18T21:13:06.526 INFO:tasks.workunit.client.0.smithi077.stdout:0/951: rmdir d8/d1a/d39/dd0/d117 39 2024-09-18T21:13:06.535 INFO:tasks.workunit.client.0.smithi077.stdout:1/829: rmdir d3/d38/d97/dea/df6 0 2024-09-18T21:13:06.540 INFO:tasks.workunit.client.0.smithi077.stdout:8/829: dread d2/d5f/da8/d26/fcd [0,4194304] 0 2024-09-18T21:13:06.541 INFO:tasks.workunit.client.0.smithi077.stdout:8/830: chown d2/d5f/da8/d4f/d5a/d2a/d67 5 1 2024-09-18T21:13:06.544 INFO:tasks.workunit.client.0.smithi077.stdout:8/831: dread - d2/d27/d29/d41/dbc/fc1 zero size 2024-09-18T21:13:06.547 INFO:tasks.workunit.client.0.smithi077.stdout:8/832: symlink d2/d27/d29/d41/dbc/dce/l123 0 2024-09-18T21:13:06.552 INFO:tasks.workunit.client.0.smithi077.stdout:8/833: unlink d2/d5f/da8/d4f/d5a/d2a/dc8/df1/f111 0 2024-09-18T21:13:06.563 INFO:tasks.workunit.client.0.smithi077.stdout:6/828: sync 2024-09-18T21:13:06.569 INFO:tasks.workunit.client.0.smithi077.stdout:6/829: mknod d7/d7e/d11/d3e/d42/d88/da4/c115 0 2024-09-18T21:13:06.577 INFO:tasks.workunit.client.0.smithi077.stdout:6/830: truncate d7/d7e/d11/f56 792941 0 2024-09-18T21:13:06.581 INFO:tasks.workunit.client.0.smithi077.stdout:6/831: chown d7/d7e/d11/c40 4302 1 2024-09-18T21:13:06.584 INFO:tasks.workunit.client.0.smithi077.stdout:6/832: truncate d7/d7e/d11/d3e/d42/d88/fbd 4911301 0 2024-09-18T21:13:06.585 INFO:tasks.workunit.client.0.smithi077.stdout:0/952: unlink d8/d37/d66/d87/de0/dce/lff 0 2024-09-18T21:13:06.589 INFO:tasks.workunit.client.0.smithi077.stdout:6/833: symlink d7/d7e/d11/d3e/d42/d88/da4/d102/l116 0 2024-09-18T21:13:06.591 INFO:tasks.workunit.client.0.smithi077.stdout:0/953: mknod d8/d10b/dbd/c13b 0 2024-09-18T21:13:06.595 INFO:tasks.workunit.client.0.smithi077.stdout:6/834: symlink d7/d7e/d11/d3e/d42/d88/da4/de7/l117 0 2024-09-18T21:13:06.595 INFO:tasks.workunit.client.0.smithi077.stdout:6/835: readlink d7/l37 0 2024-09-18T21:13:06.598 INFO:tasks.workunit.client.0.smithi077.stdout:3/896: sync 2024-09-18T21:13:06.598 INFO:tasks.workunit.client.0.smithi077.stdout:4/889: sync 2024-09-18T21:13:06.598 INFO:tasks.workunit.client.0.smithi077.stdout:9/820: sync 2024-09-18T21:13:06.599 INFO:tasks.workunit.client.0.smithi077.stdout:7/920: sync 2024-09-18T21:13:06.599 INFO:tasks.workunit.client.0.smithi077.stdout:5/912: sync 2024-09-18T21:13:06.607 INFO:tasks.workunit.client.0.smithi077.stdout:4/890: dwrite d3/dc/d51/d53/dce/f11a [0,4194304] 0 2024-09-18T21:13:06.608 INFO:tasks.workunit.client.0.smithi077.stdout:4/891: fdatasync d3/dc/d32/d45/fdd 0 2024-09-18T21:13:06.609 INFO:tasks.workunit.client.0.smithi077.stdout:4/892: chown d3/dc/d24 1688656 1 2024-09-18T21:13:06.611 INFO:tasks.workunit.client.0.smithi077.stdout:3/897: rmdir db/d14/d22 39 2024-09-18T21:13:06.619 INFO:tasks.workunit.client.0.smithi077.stdout:3/898: dwrite db/d14/d32/d49/d4e/d6a/f6c [0,4194304] 0 2024-09-18T21:13:06.621 INFO:tasks.workunit.client.0.smithi077.stdout:3/899: write f4 [3827447,119139] 0 2024-09-18T21:13:06.634 INFO:tasks.workunit.client.0.smithi077.stdout:6/836: getdents d7/d7e/d11/d3e 0 2024-09-18T21:13:06.639 INFO:tasks.workunit.client.0.smithi077.stdout:1/830: creat d3/d38/dd5/f11b x:0 0 0 2024-09-18T21:13:06.660 INFO:tasks.workunit.client.0.smithi077.stdout:6/837: dread d7/d7e/d11/fbf [0,4194304] 0 2024-09-18T21:13:06.665 INFO:tasks.workunit.client.0.smithi077.stdout:6/838: stat d7/d7e/d11/d3e/d42/dbb/d49/d55/l73 0 2024-09-18T21:13:06.677 INFO:tasks.workunit.client.1.smithi103.stdout:1/963: dwrite d0/f37 [0,4194304] 0 2024-09-18T21:13:06.681 INFO:tasks.workunit.client.1.smithi103.stdout:1/964: mkdir d0/d2/d9/d154 0 2024-09-18T21:13:06.691 INFO:tasks.workunit.client.0.smithi077.stdout:6/839: creat d7/d7e/d11/d3e/d42/f118 x:0 0 0 2024-09-18T21:13:06.693 INFO:tasks.workunit.client.0.smithi077.stdout:6/840: fdatasync d7/d7e/f28 0 2024-09-18T21:13:06.696 INFO:tasks.workunit.client.0.smithi077.stdout:5/913: rename d0/df/f1c to d0/df/d3d/f12b 0 2024-09-18T21:13:06.697 INFO:tasks.workunit.client.0.smithi077.stdout:6/841: read d7/d7e/f14 [213949,14359] 0 2024-09-18T21:13:06.699 INFO:tasks.workunit.client.0.smithi077.stdout:5/914: truncate d0/df/d10/f7 1102747 0 2024-09-18T21:13:06.703 INFO:tasks.workunit.client.0.smithi077.stdout:5/915: getdents d0/df/d10/d4b/d98 0 2024-09-18T21:13:06.704 INFO:tasks.workunit.client.0.smithi077.stdout:5/916: dread - d0/d6/dbd/f109 zero size 2024-09-18T21:13:06.707 INFO:tasks.workunit.client.0.smithi077.stdout:5/917: creat d0/d6/d3b/f12c x:0 0 0 2024-09-18T21:13:06.708 INFO:tasks.workunit.client.1.smithi103.stdout:2/952: truncate d3/d5/d2f/d32/d46/fc9 592520 0 2024-09-18T21:13:06.709 INFO:tasks.workunit.client.1.smithi103.stdout:2/953: chown d3/d110/f124 983 1 2024-09-18T21:13:06.709 INFO:tasks.workunit.client.0.smithi077.stdout:5/918: creat d0/df/d3d/f12d x:0 0 0 2024-09-18T21:13:06.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:06 smithi077 ceph-mon[27689]: pgmap v24: 65 pgs: 65 active+clean; 3.7 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 139 MiB/s rd, 334 MiB/s wr, 720 op/s 2024-09-18T21:13:06.714 INFO:tasks.workunit.client.1.smithi103.stdout:2/954: getdents d3/d5/d2f/d93 0 2024-09-18T21:13:06.716 INFO:tasks.workunit.client.1.smithi103.stdout:1/965: mknod d0/d2/d9/d9e/d7a/dd0/df9/d68/d81/da2/c155 0 2024-09-18T21:13:06.716 INFO:tasks.workunit.client.0.smithi077.stdout:2/924: write d1/d4/d5/d1a/d2e/d40/d69/fa6 [3077598,34724] 0 2024-09-18T21:13:06.718 INFO:tasks.workunit.client.1.smithi103.stdout:2/955: getdents d3/d5/d4a/d56 0 2024-09-18T21:13:06.719 INFO:tasks.workunit.client.0.smithi077.stdout:2/925: write d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d83/dba/ddc/dff/f127 [3525217,91559] 0 2024-09-18T21:13:06.719 INFO:tasks.workunit.client.1.smithi103.stdout:1/966: fsync d0/d2/d2b/d3a/d42/d87/fbf 0 2024-09-18T21:13:06.720 INFO:tasks.workunit.client.1.smithi103.stdout:1/967: read d0/ff [2663665,9110] 0 2024-09-18T21:13:06.724 INFO:tasks.workunit.client.1.smithi103.stdout:2/956: rename d3/d5/d2f/d48/fa7 to d3/d5/d2f/d32/d90/dd7/dc4/d141/f143 0 2024-09-18T21:13:06.728 INFO:tasks.workunit.client.1.smithi103.stdout:2/957: getdents d3/d5/d4a/d56 0 2024-09-18T21:13:06.729 INFO:tasks.workunit.client.1.smithi103.stdout:2/958: dread - d3/d5/d2f/d48/f130 zero size 2024-09-18T21:13:06.732 INFO:tasks.workunit.client.0.smithi077.stdout:8/834: rmdir d2/d5f/da8/d4f/d5a/d2a/dc8/df1 39 2024-09-18T21:13:06.733 INFO:tasks.workunit.client.0.smithi077.stdout:8/835: readlink d2/d5/lb3 0 2024-09-18T21:13:06.735 INFO:tasks.workunit.client.0.smithi077.stdout:2/926: dread d1/d4/d9/d4f/ff0 [0,4194304] 0 2024-09-18T21:13:06.736 INFO:tasks.workunit.client.0.smithi077.stdout:2/927: chown d1/d4/c9a 77186502 1 2024-09-18T21:13:06.738 INFO:tasks.workunit.client.0.smithi077.stdout:2/928: chown d1/d4/d5/d1a/d113/d81/dc4/dc0/l110 0 1 2024-09-18T21:13:06.753 INFO:tasks.workunit.client.0.smithi077.stdout:2/929: dread d1/d4/d5/d1a/f4a [4194304,4194304] 0 2024-09-18T21:13:06.756 INFO:tasks.workunit.client.0.smithi077.stdout:0/954: dwrite d8/d37/d66/d87/de0/dce/ff7 [0,4194304] 0 2024-09-18T21:13:06.757 INFO:tasks.workunit.client.0.smithi077.stdout:8/836: symlink d2/d27/d29/d41/dbc/l124 0 2024-09-18T21:13:06.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:06 smithi103 ceph-mon[34827]: pgmap v24: 65 pgs: 65 active+clean; 3.7 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 139 MiB/s rd, 334 MiB/s wr, 720 op/s 2024-09-18T21:13:06.764 INFO:tasks.workunit.client.0.smithi077.stdout:8/837: creat d2/f125 x:0 0 0 2024-09-18T21:13:06.765 INFO:tasks.workunit.client.0.smithi077.stdout:4/893: truncate d3/dc/d20/f97 143135 0 2024-09-18T21:13:06.767 INFO:tasks.workunit.client.0.smithi077.stdout:7/921: dwrite d12/d31/d77/d93/d2a/fde [0,4194304] 0 2024-09-18T21:13:06.770 INFO:tasks.workunit.client.0.smithi077.stdout:4/894: readlink d3/dc/d51/d53/d89/lc3 0 2024-09-18T21:13:06.771 INFO:tasks.workunit.client.0.smithi077.stdout:0/955: dwrite d8/d26/dc9/f101 [0,4194304] 0 2024-09-18T21:13:06.773 INFO:tasks.workunit.client.0.smithi077.stdout:4/895: chown d3/dc/f1b 1347301 1 2024-09-18T21:13:06.773 INFO:tasks.workunit.client.0.smithi077.stdout:8/838: readlink d2/d5f/da8/d20/l66 0 2024-09-18T21:13:06.774 INFO:tasks.workunit.client.0.smithi077.stdout:4/896: stat d3/d7/d42/cc4 0 2024-09-18T21:13:06.775 INFO:tasks.workunit.client.0.smithi077.stdout:0/956: symlink d8/d1a/d35/d6d/l13c 0 2024-09-18T21:13:06.779 INFO:tasks.workunit.client.1.smithi103.stdout:0/984: creat d1/d5/de/dc0/d8c/f157 x:0 0 0 2024-09-18T21:13:06.779 INFO:tasks.workunit.client.0.smithi077.stdout:4/897: mkdir d3/d7/d73/d9f/d11c 0 2024-09-18T21:13:06.780 INFO:tasks.workunit.client.0.smithi077.stdout:8/839: read d2/d5/d6/fac [1104943,84904] 0 2024-09-18T21:13:06.782 INFO:tasks.workunit.client.0.smithi077.stdout:3/900: dwrite db/d14/d93/f96 [0,4194304] 0 2024-09-18T21:13:06.783 INFO:tasks.workunit.client.0.smithi077.stdout:7/922: link d12/d31/d77/d93/d2a/f12f d12/d31/d77/d93/d89/dfe/d103/f13e 0 2024-09-18T21:13:06.784 INFO:tasks.workunit.client.0.smithi077.stdout:2/930: dread d1/d4/d5/d1a/d2e/f7f [4194304,4194304] 0 2024-09-18T21:13:06.786 INFO:tasks.workunit.client.1.smithi103.stdout:0/985: truncate d1/d5/de/dc0/d8c/dce/d9f/d4f/f103 694243 0 2024-09-18T21:13:06.786 INFO:tasks.workunit.client.0.smithi077.stdout:7/923: chown d12/d31/d77/d93/d89/d99/da9/lff 26516 1 2024-09-18T21:13:06.787 INFO:tasks.workunit.client.1.smithi103.stdout:0/986: write d1/d5/de/d22/d6a/f13f [161041,67064] 0 2024-09-18T21:13:06.792 INFO:tasks.workunit.client.0.smithi077.stdout:4/898: symlink d3/d77/d9c/l11d 0 2024-09-18T21:13:06.793 INFO:tasks.workunit.client.1.smithi103.stdout:0/987: dread d1/daf/fdf [0,4194304] 0 2024-09-18T21:13:06.794 INFO:tasks.workunit.client.0.smithi077.stdout:4/899: truncate d3/dc/d24/f108 67927 0 2024-09-18T21:13:06.794 INFO:tasks.workunit.client.0.smithi077.stdout:2/931: creat d1/d4/f137 x:0 0 0 2024-09-18T21:13:06.798 INFO:tasks.workunit.client.0.smithi077.stdout:8/840: mkdir d2/d5f/da8/d126 0 2024-09-18T21:13:06.805 INFO:tasks.workunit.client.0.smithi077.stdout:2/932: dread d1/d4/f22 [0,4194304] 0 2024-09-18T21:13:06.806 INFO:tasks.workunit.client.0.smithi077.stdout:2/933: fsync d1/d4/d5/d1a/d11e/f11d 0 2024-09-18T21:13:06.808 INFO:tasks.workunit.client.0.smithi077.stdout:7/924: rename d12/d56/da1/db6/dbd/fd6 to d12/d22/d59/d72/f13f 0 2024-09-18T21:13:06.808 INFO:tasks.workunit.client.0.smithi077.stdout:2/934: write d1/d4/d5/d1a/d11e/f11d [999835,44847] 0 2024-09-18T21:13:06.809 INFO:tasks.workunit.client.0.smithi077.stdout:7/925: stat d12/d31/d77/d93/d2a/f32 0 2024-09-18T21:13:06.811 INFO:tasks.workunit.client.0.smithi077.stdout:7/926: chown d12/d56/da1/ddf/l109 517647063 1 2024-09-18T21:13:06.811 INFO:tasks.workunit.client.0.smithi077.stdout:2/935: truncate d1/d4/d5/d1a/d113/f101 787620 0 2024-09-18T21:13:06.811 INFO:tasks.workunit.client.0.smithi077.stdout:7/927: dread - d12/d22/f8b zero size 2024-09-18T21:13:06.818 INFO:tasks.workunit.client.0.smithi077.stdout:7/928: dread d12/d22/d59/d72/f9b [0,4194304] 0 2024-09-18T21:13:06.818 INFO:tasks.workunit.client.1.smithi103.stdout:1/968: sync 2024-09-18T21:13:06.822 INFO:tasks.workunit.client.0.smithi077.stdout:2/936: dwrite d1/d4/d9/d4f/fe4 [0,4194304] 0 2024-09-18T21:13:06.823 INFO:tasks.workunit.client.0.smithi077.stdout:7/929: truncate d12/d31/f41 6121143 0 2024-09-18T21:13:06.825 INFO:tasks.workunit.client.0.smithi077.stdout:7/930: stat d12/d22/d59/fdc 0 2024-09-18T21:13:06.825 INFO:tasks.workunit.client.0.smithi077.stdout:8/841: dread d2/d27/d29/d41/fd4 [0,4194304] 0 2024-09-18T21:13:06.825 INFO:tasks.workunit.client.0.smithi077.stdout:5/919: dwrite d0/d6/f50 [4194304,4194304] 0 2024-09-18T21:13:06.827 INFO:tasks.workunit.client.1.smithi103.stdout:2/959: dwrite d3/f16 [0,4194304] 0 2024-09-18T21:13:06.828 INFO:tasks.workunit.client.0.smithi077.stdout:5/920: chown d0/d43/c4a 10078414 1 2024-09-18T21:13:06.830 INFO:tasks.workunit.client.0.smithi077.stdout:5/921: chown d0/d6/c21 17958360 1 2024-09-18T21:13:06.834 INFO:tasks.workunit.client.1.smithi103.stdout:2/960: dwrite d3/d5/d2f/fc5 [0,4194304] 0 2024-09-18T21:13:06.838 INFO:tasks.workunit.client.0.smithi077.stdout:7/931: truncate d12/d22/d59/f79 161490 0 2024-09-18T21:13:06.839 INFO:tasks.workunit.client.0.smithi077.stdout:5/922: chown d0/d6/lc 2841611 1 2024-09-18T21:13:06.840 INFO:tasks.workunit.client.0.smithi077.stdout:8/842: mkdir d2/d5/d6/d127 0 2024-09-18T21:13:06.841 INFO:tasks.workunit.client.0.smithi077.stdout:8/843: chown d2/d27/d29/f68 12 1 2024-09-18T21:13:06.842 INFO:tasks.workunit.client.0.smithi077.stdout:7/932: creat d12/dd5/f140 x:0 0 0 2024-09-18T21:13:06.843 INFO:tasks.workunit.client.0.smithi077.stdout:5/923: symlink d0/df/d10/d5c/d74/d89/l12e 0 2024-09-18T21:13:06.845 INFO:tasks.workunit.client.0.smithi077.stdout:5/924: dread - d0/d6/d8a/f111 zero size 2024-09-18T21:13:06.846 INFO:tasks.workunit.client.0.smithi077.stdout:5/925: chown d0/d6/daa/f106 0 1 2024-09-18T21:13:06.847 INFO:tasks.workunit.client.0.smithi077.stdout:7/933: creat d12/d31/d77/d93/d89/d99/da9/f141 x:0 0 0 2024-09-18T21:13:06.848 INFO:tasks.workunit.client.0.smithi077.stdout:0/957: write d8/d1a/d39/d3b/d70/f135 [839917,49475] 0 2024-09-18T21:13:06.849 INFO:tasks.workunit.client.0.smithi077.stdout:8/844: mknod d2/d5f/da8/d4f/d5a/d2a/dc8/c128 0 2024-09-18T21:13:06.851 INFO:tasks.workunit.client.0.smithi077.stdout:7/934: rmdir d12/d56/da1/db6 39 2024-09-18T21:13:06.853 INFO:tasks.workunit.client.0.smithi077.stdout:0/958: rename d8/d37/ffa to d8/d10b/f13d 0 2024-09-18T21:13:06.853 INFO:tasks.workunit.client.0.smithi077.stdout:0/959: fdatasync d8/d1a/d35/f85 0 2024-09-18T21:13:06.854 INFO:tasks.workunit.client.0.smithi077.stdout:5/926: creat d0/d6/dd/d5d/d117/f12f x:0 0 0 2024-09-18T21:13:06.855 INFO:tasks.workunit.client.0.smithi077.stdout:7/935: fdatasync d12/d22/daa/dc0/f12e 0 2024-09-18T21:13:06.857 INFO:tasks.workunit.client.0.smithi077.stdout:3/901: truncate db/d14/d32/f55 3721930 0 2024-09-18T21:13:06.859 INFO:tasks.workunit.client.1.smithi103.stdout:0/988: dwrite d1/d5/de/dc0/d62/fcc [0,4194304] 0 2024-09-18T21:13:06.863 INFO:tasks.workunit.client.0.smithi077.stdout:2/937: dread d1/d4/f2f [4194304,4194304] 0 2024-09-18T21:13:06.864 INFO:tasks.workunit.client.0.smithi077.stdout:8/845: rename d2/d5f/da8/ca9 to d2/d5f/da8/d126/c129 0 2024-09-18T21:13:06.865 INFO:tasks.workunit.client.1.smithi103.stdout:0/989: mknod d1/d5/de/d19/d1e/d34/c158 0 2024-09-18T21:13:06.869 INFO:tasks.workunit.client.0.smithi077.stdout:4/900: dwrite d3/f76 [0,4194304] 0 2024-09-18T21:13:06.870 INFO:tasks.workunit.client.0.smithi077.stdout:4/901: write d3/d77/ff7 [3322199,12651] 0 2024-09-18T21:13:06.872 INFO:tasks.workunit.client.0.smithi077.stdout:8/846: chown d2/d5f/da8/c53 0 1 2024-09-18T21:13:06.873 INFO:tasks.workunit.client.0.smithi077.stdout:8/847: chown d2/d5f/da8/d26/d106/f10a 99 1 2024-09-18T21:13:06.876 INFO:tasks.workunit.client.0.smithi077.stdout:0/960: rename d8/d37/faa to d8/d37/d66/d87/de0/dce/dcf/f13e 0 2024-09-18T21:13:06.877 INFO:tasks.workunit.client.0.smithi077.stdout:3/902: dread db/d14/d32/d49/da4/d8a/fa7 [0,4194304] 0 2024-09-18T21:13:06.878 INFO:tasks.workunit.client.1.smithi103.stdout:1/969: dwrite d0/f9d [0,4194304] 0 2024-09-18T21:13:06.883 INFO:tasks.workunit.client.0.smithi077.stdout:3/903: read db/d14/d32/d49/da4/d8a/d99/daf/f100 [2995152,114657] 0 2024-09-18T21:13:06.883 INFO:tasks.workunit.client.1.smithi103.stdout:0/990: link d1/d5/de/d24/d43/c11a d1/dcf/c159 0 2024-09-18T21:13:06.885 INFO:tasks.workunit.client.0.smithi077.stdout:5/927: getdents d0/df/d10/d5c/d9b 0 2024-09-18T21:13:06.885 INFO:tasks.workunit.client.1.smithi103.stdout:2/961: write d3/d5/f4c [2099388,114987] 0 2024-09-18T21:13:06.892 INFO:tasks.workunit.client.1.smithi103.stdout:1/970: dread d0/d2/d9/d9e/d7a/dd0/df9/d68/d81/da2/da4/dc2/dd8/fb6 [0,4194304] 0 2024-09-18T21:13:06.899 INFO:tasks.workunit.client.1.smithi103.stdout:0/991: unlink d1/d9/d3e/d121/f13e 0 2024-09-18T21:13:06.899 INFO:tasks.workunit.client.1.smithi103.stdout:0/992: stat d1/d5/de/dc0/d8c/dce/d9f/lbd 0 2024-09-18T21:13:06.900 INFO:tasks.workunit.client.0.smithi077.stdout:3/904: creat db/d14/d32/d49/d4e/d6a/f117 x:0 0 0 2024-09-18T21:13:06.903 INFO:tasks.workunit.client.0.smithi077.stdout:5/928: creat d0/df/dd2/df5/f130 x:0 0 0 2024-09-18T21:13:06.904 INFO:tasks.workunit.client.0.smithi077.stdout:7/936: dwrite d12/d22/d59/d72/fbb [0,4194304] 0 2024-09-18T21:13:06.905 INFO:tasks.workunit.client.1.smithi103.stdout:0/993: symlink d1/d5/de/dc0/dbf/d4e/l15a 0 2024-09-18T21:13:06.906 INFO:tasks.workunit.client.0.smithi077.stdout:8/848: dread d2/d5f/da8/d4f/d5a/d2a/d88/fa3 [0,4194304] 0 2024-09-18T21:13:06.906 INFO:tasks.workunit.client.1.smithi103.stdout:1/971: dwrite d0/d2/d9/dc/d6e/dac/f13d [0,4194304] 0 2024-09-18T21:13:06.909 INFO:tasks.workunit.client.1.smithi103.stdout:2/962: getdents d3/d5/d2f/d32/d90/dd7 0 2024-09-18T21:13:06.914 INFO:tasks.workunit.client.1.smithi103.stdout:0/994: dwrite d1/d5/de/dc0/d8c/dce/f101 [0,4194304] 0 2024-09-18T21:13:06.917 INFO:tasks.workunit.client.1.smithi103.stdout:2/963: creat d3/d5/d4a/d56/f144 x:0 0 0 2024-09-18T21:13:06.923 INFO:tasks.workunit.client.0.smithi077.stdout:2/938: getdents d1/d4/d5/d1a/d113/d81/dc4/dc0 0 2024-09-18T21:13:06.926 INFO:tasks.workunit.client.1.smithi103.stdout:2/964: creat d3/d5/d2c/d54/d68/f145 x:0 0 0 2024-09-18T21:13:06.927 INFO:tasks.workunit.client.0.smithi077.stdout:4/902: write d3/dc/d32/d5b/f83 [3010416,80178] 0 2024-09-18T21:13:06.929 INFO:tasks.workunit.client.1.smithi103.stdout:2/965: creat d3/d110/d11a/dd5/f146 x:0 0 0 2024-09-18T21:13:06.929 INFO:tasks.workunit.client.1.smithi103.stdout:2/966: dread - d3/d5/d2c/f126 zero size 2024-09-18T21:13:06.930 INFO:tasks.workunit.client.1.smithi103.stdout:2/967: write d3/db3/d12a/fdc [2641935,22074] 0 2024-09-18T21:13:06.932 INFO:tasks.workunit.client.0.smithi077.stdout:7/937: link d12/d31/d77/d93/d2a/fde d12/d56/da1/ddf/d100/f142 0 2024-09-18T21:13:06.934 INFO:tasks.workunit.client.1.smithi103.stdout:0/995: getdents d1/d5/de/d24/d43/d76 0 2024-09-18T21:13:06.936 INFO:tasks.workunit.client.0.smithi077.stdout:2/939: fsync d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/f90 0 2024-09-18T21:13:06.943 INFO:tasks.workunit.client.1.smithi103.stdout:0/996: mknod d1/c15b 0 2024-09-18T21:13:06.944 INFO:tasks.workunit.client.1.smithi103.stdout:0/997: dread - d1/d9/d3e/d6e/d12e/f14f zero size 2024-09-18T21:13:06.945 INFO:tasks.workunit.client.0.smithi077.stdout:3/905: dread db/d14/d32/d49/da4/d71/f43 [0,4194304] 0 2024-09-18T21:13:06.945 INFO:tasks.workunit.client.0.smithi077.stdout:7/938: rename d12/d56/da1/db6/d11e to d12/d31/d77/d93/d2a/d7f/d143 0 2024-09-18T21:13:06.949 INFO:tasks.workunit.client.1.smithi103.stdout:1/972: dwrite d0/fbd [0,4194304] 0 2024-09-18T21:13:06.949 INFO:tasks.workunit.client.0.smithi077.stdout:8/849: dread d2/d5/d6/f21 [0,4194304] 0 2024-09-18T21:13:06.949 INFO:tasks.workunit.client.0.smithi077.stdout:5/929: write d0/d6/d3b/f8f [255140,95703] 0 2024-09-18T21:13:06.949 INFO:tasks.workunit.client.0.smithi077.stdout:3/906: dread - db/d14/d22/d36/f10d zero size 2024-09-18T21:13:06.952 INFO:tasks.workunit.client.0.smithi077.stdout:2/940: dwrite d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d95/f103 [0,4194304] 0 2024-09-18T21:13:06.952 INFO:tasks.workunit.client.1.smithi103.stdout:1/973: mkdir d0/d11/d5f/d19/d156 0 2024-09-18T21:13:06.953 INFO:tasks.workunit.client.1.smithi103.stdout:1/974: read - d0/d2/d2b/d3a/d42/d9c/f130 zero size 2024-09-18T21:13:06.955 INFO:tasks.workunit.client.0.smithi077.stdout:7/939: mknod d12/d22/d59/d72/c144 0 2024-09-18T21:13:06.956 INFO:tasks.workunit.client.1.smithi103.stdout:0/998: getdents d1/d5/de/d24 0 2024-09-18T21:13:06.957 INFO:tasks.workunit.client.1.smithi103.stdout:0/999: fdatasync d1/d9/f52 0 2024-09-18T21:13:06.958 INFO:tasks.workunit.client.0.smithi077.stdout:2/941: dread d1/f92 [0,4194304] 0 2024-09-18T21:13:06.961 INFO:tasks.workunit.client.0.smithi077.stdout:8/850: creat d2/d5f/da8/d4f/d5a/d5e/d8f/f12a x:0 0 0 2024-09-18T21:13:06.962 INFO:tasks.workunit.client.1.smithi103.stdout:2/968: write d3/d5/d4a/d56/fce [923454,112501] 0 2024-09-18T21:13:06.963 INFO:tasks.workunit.client.0.smithi077.stdout:3/907: mkdir db/d14/d32/d49/d6b/d118 0 2024-09-18T21:13:06.963 INFO:tasks.workunit.client.1.smithi103.stdout:2/969: stat d3/db3/cf7 0 2024-09-18T21:13:06.963 INFO:tasks.workunit.client.1.smithi103.stdout:1/975: mkdir d0/d11/d5f/d19/d156/d157 0 2024-09-18T21:13:06.965 INFO:tasks.workunit.client.1.smithi103.stdout:1/976: write d0/d2/d9/dc/f7e [1173214,41191] 0 2024-09-18T21:13:06.966 INFO:tasks.workunit.client.1.smithi103.stdout:2/970: symlink d3/d5/d2c/d77/l147 0 2024-09-18T21:13:06.967 INFO:tasks.workunit.client.0.smithi077.stdout:2/942: creat d1/d4/d5/d1a/d2e/d41/d2c/dab/f138 x:0 0 0 2024-09-18T21:13:06.971 INFO:tasks.workunit.client.0.smithi077.stdout:3/908: symlink db/d14/d90/db2/l119 0 2024-09-18T21:13:06.971 INFO:tasks.workunit.client.0.smithi077.stdout:3/909: dread - db/dee/f111 zero size 2024-09-18T21:13:06.972 INFO:tasks.workunit.client.1.smithi103.stdout:2/971: creat d3/d110/d11a/d98/f148 x:0 0 0 2024-09-18T21:13:06.973 INFO:tasks.workunit.client.0.smithi077.stdout:5/930: write d0/df/d10/d4b/d80/ffc [783087,110934] 0 2024-09-18T21:13:06.973 INFO:tasks.workunit.client.1.smithi103.stdout:2/972: write d3/d110/f124 [125289,9447] 0 2024-09-18T21:13:06.977 INFO:tasks.workunit.client.1.smithi103.stdout:2/973: creat d3/d110/f149 x:0 0 0 2024-09-18T21:13:06.981 INFO:tasks.workunit.client.0.smithi077.stdout:2/943: dread d1/f2a [0,4194304] 0 2024-09-18T21:13:06.985 INFO:tasks.workunit.client.1.smithi103.stdout:2/974: creat d3/d5/f14a x:0 0 0 2024-09-18T21:13:06.986 INFO:tasks.workunit.client.0.smithi077.stdout:2/944: truncate d1/d4/d9/d4f/f63 1119905 0 2024-09-18T21:13:06.989 INFO:tasks.workunit.client.1.smithi103.stdout:2/975: dread d3/d5/d2c/f88 [0,4194304] 0 2024-09-18T21:13:06.989 INFO:tasks.workunit.client.0.smithi077.stdout:3/910: write db/f54 [525889,56242] 0 2024-09-18T21:13:06.992 INFO:tasks.workunit.client.1.smithi103.stdout:1/977: dwrite d0/d2/d2b/d3a/d42/f97 [0,4194304] 0 2024-09-18T21:13:06.993 INFO:tasks.workunit.client.0.smithi077.stdout:2/945: mkdir d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d83/dba/dcd/d139 0 2024-09-18T21:13:06.994 INFO:tasks.workunit.client.1.smithi103.stdout:2/976: creat d3/d5/d2f/d5b/d139/f14b x:0 0 0 2024-09-18T21:13:06.994 INFO:tasks.workunit.client.1.smithi103.stdout:2/977: chown d3/d5/d2f/d32/dfc 6922261 1 2024-09-18T21:13:06.996 INFO:tasks.workunit.client.1.smithi103.stdout:1/978: mkdir d0/d2/d2b/d3a/d42/d72/db0/d158 0 2024-09-18T21:13:06.997 INFO:tasks.workunit.client.0.smithi077.stdout:7/940: dwrite d12/d31/d77/d93/f7c [0,4194304] 0 2024-09-18T21:13:06.997 INFO:tasks.workunit.client.0.smithi077.stdout:5/931: dread d0/d6/f48 [0,4194304] 0 2024-09-18T21:13:07.000 INFO:tasks.workunit.client.1.smithi103.stdout:2/978: rename d3/d5/d2f/d48/l82 to d3/d5/d2f/d32/d90/l14c 0 2024-09-18T21:13:07.000 INFO:tasks.workunit.client.0.smithi077.stdout:8/851: dwrite d2/d5f/da8/d4f/d5a/d2a/dc8/df1/d11d/da6/d110/fc5 [0,4194304] 0 2024-09-18T21:13:07.003 INFO:tasks.workunit.client.0.smithi077.stdout:3/911: symlink db/d14/d22/d36/df8/l11a 0 2024-09-18T21:13:07.004 INFO:tasks.workunit.client.1.smithi103.stdout:1/979: mkdir d0/d2/d159 0 2024-09-18T21:13:07.005 INFO:tasks.workunit.client.0.smithi077.stdout:2/946: mknod d1/d4/d5/d10b/c13a 0 2024-09-18T21:13:07.006 INFO:tasks.workunit.client.1.smithi103.stdout:2/979: truncate d3/d5/d2c/d54/dec/ff9 343379 0 2024-09-18T21:13:07.007 INFO:tasks.workunit.client.0.smithi077.stdout:3/912: chown db/d14/d22/d36/c110 30657 1 2024-09-18T21:13:07.011 INFO:tasks.workunit.client.0.smithi077.stdout:7/941: mknod d12/d56/ded/d101/c145 0 2024-09-18T21:13:07.011 INFO:tasks.workunit.client.0.smithi077.stdout:8/852: dwrite d2/d5f/da8/d4f/d5a/d2a/d67/f113 [0,4194304] 0 2024-09-18T21:13:07.012 INFO:tasks.workunit.client.1.smithi103.stdout:1/980: dwrite d0/d2/d9/d10/d5d/f88 [0,4194304] 0 2024-09-18T21:13:07.013 INFO:tasks.workunit.client.0.smithi077.stdout:3/913: unlink db/d14/d22/c33 0 2024-09-18T21:13:07.014 INFO:tasks.workunit.client.0.smithi077.stdout:2/947: mkdir d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d83/dba/ddc/dff/d13b 0 2024-09-18T21:13:07.019 INFO:tasks.workunit.client.1.smithi103.stdout:1/981: write d0/d11/d5f/f13f [845585,126142] 0 2024-09-18T21:13:07.023 INFO:tasks.workunit.client.1.smithi103.stdout:2/980: getdents d3/d5/d2f/d32/dfc 0 2024-09-18T21:13:07.023 INFO:tasks.workunit.client.0.smithi077.stdout:7/942: read d12/d22/d59/d72/f3b [218100,19071] 0 2024-09-18T21:13:07.025 INFO:tasks.workunit.client.0.smithi077.stdout:2/948: readlink d1/d4/d5/d1a/d2e/d41/la4 0 2024-09-18T21:13:07.027 INFO:tasks.workunit.client.1.smithi103.stdout:1/982: rename d0/d2/d9/d10/d5d/f88 to d0/d11/d5f/d19/d156/d157/f15a 0 2024-09-18T21:13:07.032 INFO:tasks.workunit.client.1.smithi103.stdout:1/983: dwrite d0/d2/d9/d9e/d7a/dd0/df9/d68/d81/da2/da4/dc2/dd8/dae/fb4 [0,4194304] 0 2024-09-18T21:13:07.033 INFO:tasks.workunit.client.0.smithi077.stdout:5/932: dwrite d0/d6/d3b/d64/fc6 [0,4194304] 0 2024-09-18T21:13:07.034 INFO:tasks.workunit.client.0.smithi077.stdout:2/949: mknod d1/d4/d9/c13c 0 2024-09-18T21:13:07.037 INFO:tasks.workunit.client.1.smithi103.stdout:2/981: creat d3/d5/f14d x:0 0 0 2024-09-18T21:13:07.038 INFO:tasks.workunit.client.1.smithi103.stdout:2/982: truncate d3/d5/d2f/f108 975886 0 2024-09-18T21:13:07.038 INFO:tasks.workunit.client.0.smithi077.stdout:7/943: link d12/d31/d77/d93/d89/d99/da9/lab d12/d31/d77/l146 0 2024-09-18T21:13:07.043 INFO:tasks.workunit.client.0.smithi077.stdout:2/950: readlink d1/d4/d5/d1a/d113/d81/dc4/dc0/l110 0 2024-09-18T21:13:07.043 INFO:tasks.workunit.client.0.smithi077.stdout:7/944: chown d12/l2e 18096753 1 2024-09-18T21:13:07.046 INFO:tasks.workunit.client.1.smithi103.stdout:1/984: link d0/d2/d9/d9e/d7a/dd0/df9/d68/d81/c103 d0/d2/d2b/d3a/d42/d72/db0/d158/c15b 0 2024-09-18T21:13:07.046 INFO:tasks.workunit.client.1.smithi103.stdout:2/983: creat d3/f14e x:0 0 0 2024-09-18T21:13:07.047 INFO:tasks.workunit.client.0.smithi077.stdout:8/853: dwrite d2/d27/d29/d41/fd4 [4194304,4194304] 0 2024-09-18T21:13:07.047 INFO:tasks.workunit.client.0.smithi077.stdout:5/933: fdatasync d0/d43/fff 0 2024-09-18T21:13:07.047 INFO:tasks.workunit.client.1.smithi103.stdout:1/985: dread - d0/d2/d2b/d3a/d42/d72/f121 zero size 2024-09-18T21:13:07.050 INFO:tasks.workunit.client.0.smithi077.stdout:3/914: dwrite db/d14/d22/d36/d39/d50/fc1 [0,4194304] 0 2024-09-18T21:13:07.050 INFO:tasks.workunit.client.1.smithi103.stdout:2/984: creat d3/d110/d11a/dd5/f14f x:0 0 0 2024-09-18T21:13:07.053 INFO:tasks.workunit.client.0.smithi077.stdout:5/934: mkdir d0/df/d3d/d131 0 2024-09-18T21:13:07.054 INFO:tasks.workunit.client.0.smithi077.stdout:2/951: rename d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d95/feb to d1/d4/d5/d1a/d113/d133/f13d 0 2024-09-18T21:13:07.058 INFO:tasks.workunit.client.0.smithi077.stdout:3/915: symlink db/d14/d32/d49/d4e/l11b 0 2024-09-18T21:13:07.059 INFO:tasks.workunit.client.0.smithi077.stdout:2/952: write d1/d4/d5/d1a/d2e/f97 [5734686,1654] 0 2024-09-18T21:13:07.059 INFO:tasks.workunit.client.0.smithi077.stdout:3/916: chown db/d14/d90/f97 43 1 2024-09-18T21:13:07.061 INFO:tasks.workunit.client.1.smithi103.stdout:1/986: link d0/d2/d9/d9e/d7a/dd0/l127 d0/d2/d9/d10/l15c 0 2024-09-18T21:13:07.061 INFO:tasks.workunit.client.0.smithi077.stdout:5/935: mknod d0/df/d10/d4b/d80/de9/c132 0 2024-09-18T21:13:07.062 INFO:tasks.workunit.client.0.smithi077.stdout:8/854: getdents d2/d5f/da8/d4f/d5a/d2a/dc8/df1/d11d/da4 0 2024-09-18T21:13:07.062 INFO:tasks.workunit.client.1.smithi103.stdout:1/987: stat d0/d2/d9/d9e/d7a/dd0/df9/d68/d81/faa 0 2024-09-18T21:13:07.063 INFO:tasks.workunit.client.0.smithi077.stdout:8/855: stat d2/d5/d6/fac 0 2024-09-18T21:13:07.063 INFO:tasks.workunit.client.1.smithi103.stdout:2/985: getdents d3/d5/d2c/d54/d68/d102/d121 0 2024-09-18T21:13:07.064 INFO:tasks.workunit.client.0.smithi077.stdout:8/856: readlink d2/d27/d29/d72/d81/lc4 0 2024-09-18T21:13:07.065 INFO:tasks.workunit.client.0.smithi077.stdout:8/857: chown d2/d5f/da8/d126 3475301 1 2024-09-18T21:13:07.065 INFO:tasks.workunit.client.0.smithi077.stdout:5/936: mkdir d0/d6/d3b/d133 0 2024-09-18T21:13:07.066 INFO:tasks.workunit.client.0.smithi077.stdout:8/858: write d2/d5f/da8/d4f/d5a/d2a/d88/ffd [7721233,105779] 0 2024-09-18T21:13:07.069 INFO:tasks.workunit.client.0.smithi077.stdout:3/917: dread db/d14/f20 [4194304,4194304] 0 2024-09-18T21:13:07.069 INFO:tasks.workunit.client.0.smithi077.stdout:8/859: chown d2/d5f/l89 5 1 2024-09-18T21:13:07.070 INFO:tasks.workunit.client.0.smithi077.stdout:5/937: rmdir d0/d6 39 2024-09-18T21:13:07.071 INFO:tasks.workunit.client.0.smithi077.stdout:5/938: dread - d0/df/d10/de1/d110/f118 zero size 2024-09-18T21:13:07.073 INFO:tasks.workunit.client.0.smithi077.stdout:8/860: mkdir d2/d5f/da8/d4f/d5a/d12b 0 2024-09-18T21:13:07.074 INFO:tasks.workunit.client.0.smithi077.stdout:8/861: chown d2/d5f/da8/d4f/d5a/d5e/d8f/d6e/d11e 92293828 1 2024-09-18T21:13:07.077 INFO:tasks.workunit.client.0.smithi077.stdout:3/918: read db/d14/d22/f30 [1992,126185] 0 2024-09-18T21:13:07.079 INFO:tasks.workunit.client.0.smithi077.stdout:3/919: fdatasync db/d14/d22/d36/fc8 0 2024-09-18T21:13:07.082 INFO:tasks.workunit.client.0.smithi077.stdout:3/920: mknod db/d14/d32/d49/da4/d71/d3b/c11c 0 2024-09-18T21:13:07.085 INFO:tasks.workunit.client.0.smithi077.stdout:7/945: dread d12/d31/d77/fd3 [0,4194304] 0 2024-09-18T21:13:07.086 INFO:tasks.workunit.client.1.smithi103.stdout:2/986: write d3/d5/d2f/d48/f4f [1356257,5849] 0 2024-09-18T21:13:07.087 INFO:tasks.workunit.client.0.smithi077.stdout:5/939: write d0/df/d10/fb0 [9003354,18883] 0 2024-09-18T21:13:07.087 INFO:tasks.workunit.client.1.smithi103.stdout:2/987: stat d3/d5/d2f/d32/d90/dd7/l122 0 2024-09-18T21:13:07.088 INFO:tasks.workunit.client.0.smithi077.stdout:7/946: truncate d12/dd5/d102/f112 945807 0 2024-09-18T21:13:07.090 INFO:tasks.workunit.client.0.smithi077.stdout:3/921: dwrite db/d14/d32/d49/fdc [0,4194304] 0 2024-09-18T21:13:07.090 INFO:tasks.workunit.client.0.smithi077.stdout:7/947: write d12/d31/d77/d93/f7c [3619693,2008] 0 2024-09-18T21:13:07.091 INFO:tasks.workunit.client.1.smithi103.stdout:1/988: dwrite d0/d2/d9/d9e/fe9 [0,4194304] 0 2024-09-18T21:13:07.091 INFO:tasks.workunit.client.0.smithi077.stdout:5/940: symlink d0/df/d10/d5c/d74/d89/l134 0 2024-09-18T21:13:07.092 INFO:tasks.workunit.client.1.smithi103.stdout:2/988: mkdir d3/d5/d2f/d32/d90/dd7/dc4/d150 0 2024-09-18T21:13:07.093 INFO:tasks.workunit.client.1.smithi103.stdout:2/989: readlink d3/d5/d2f/d32/d90/dd7/l122 0 2024-09-18T21:13:07.093 INFO:tasks.workunit.client.0.smithi077.stdout:8/862: dread d2/d5f/da8/d4f/d5a/d2a/d88/fb9 [0,4194304] 0 2024-09-18T21:13:07.094 INFO:tasks.workunit.client.1.smithi103.stdout:2/990: write d3/f14e [156198,1224] 0 2024-09-18T21:13:07.095 INFO:tasks.workunit.client.0.smithi077.stdout:8/863: chown d2/d5f/da8/d20/cb1 181 1 2024-09-18T21:13:07.096 INFO:tasks.workunit.client.0.smithi077.stdout:7/948: read d12/d31/fda [3570649,5585] 0 2024-09-18T21:13:07.098 INFO:tasks.workunit.client.1.smithi103.stdout:2/991: symlink d3/d110/l151 0 2024-09-18T21:13:07.100 INFO:tasks.workunit.client.1.smithi103.stdout:1/989: dwrite d0/d2/d2b/d3a/d42/d72/f121 [0,4194304] 0 2024-09-18T21:13:07.101 INFO:tasks.workunit.client.0.smithi077.stdout:5/941: link d0/df/dd2/df5/c103 d0/d6/daa/c135 0 2024-09-18T21:13:07.101 INFO:tasks.workunit.client.1.smithi103.stdout:2/992: write d3/d5/d2f/d48/dab/f140 [60108,13539] 0 2024-09-18T21:13:07.102 INFO:tasks.workunit.client.0.smithi077.stdout:7/949: fdatasync d12/d56/ded/f105 0 2024-09-18T21:13:07.103 INFO:tasks.workunit.client.1.smithi103.stdout:1/990: write d0/d2/d2b/d3a/d42/d72/f121 [1147463,130135] 0 2024-09-18T21:13:07.103 INFO:tasks.workunit.client.1.smithi103.stdout:1/991: readlink d0/l133 0 2024-09-18T21:13:07.105 INFO:tasks.workunit.client.0.smithi077.stdout:8/864: unlink d2/d5f/da8/d20/l40 0 2024-09-18T21:13:07.107 INFO:tasks.workunit.client.0.smithi077.stdout:8/865: chown d2/d5f/da8/d4f/d5a/d5e/d8f/c11f 23336959 1 2024-09-18T21:13:07.108 INFO:tasks.workunit.client.0.smithi077.stdout:7/950: mkdir d12/d31/d77/d93/d2a/d7f/d147 0 2024-09-18T21:13:07.113 INFO:tasks.workunit.client.0.smithi077.stdout:8/866: mknod d2/c12c 0 2024-09-18T21:13:07.118 INFO:tasks.workunit.client.0.smithi077.stdout:7/951: dwrite d12/d56/fd2 [0,4194304] 0 2024-09-18T21:13:07.118 INFO:tasks.workunit.client.0.smithi077.stdout:8/867: read d2/f19 [3319695,119767] 0 2024-09-18T21:13:07.119 INFO:tasks.workunit.client.1.smithi103.stdout:2/993: write d3/db3/d12a/fc3 [444346,34386] 0 2024-09-18T21:13:07.124 INFO:tasks.workunit.client.0.smithi077.stdout:8/868: symlink d2/d27/d29/d41/dbc/d11c/l12d 0 2024-09-18T21:13:07.125 INFO:tasks.workunit.client.1.smithi103.stdout:1/992: dwrite d0/d2/d9/fee [0,4194304] 0 2024-09-18T21:13:07.125 INFO:tasks.workunit.client.0.smithi077.stdout:7/952: mkdir d12/d31/d148 0 2024-09-18T21:13:07.126 INFO:tasks.workunit.client.0.smithi077.stdout:7/953: chown d12/d56/ff8 5 1 2024-09-18T21:13:07.128 INFO:tasks.workunit.client.1.smithi103.stdout:1/993: truncate d0/d2/d2b/d3a/d42/d72/fed 602925 0 2024-09-18T21:13:07.131 INFO:tasks.workunit.client.0.smithi077.stdout:7/954: creat d12/d56/da1/f149 x:0 0 0 2024-09-18T21:13:07.132 INFO:tasks.workunit.client.0.smithi077.stdout:5/942: dread d0/d6/d3b/fb5 [0,4194304] 0 2024-09-18T21:13:07.132 INFO:tasks.workunit.client.1.smithi103.stdout:1/994: creat d0/d2/d2b/d111/f15d x:0 0 0 2024-09-18T21:13:07.133 INFO:tasks.workunit.client.1.smithi103.stdout:2/994: write d3/d5/f61 [231999,103854] 0 2024-09-18T21:13:07.133 INFO:tasks.workunit.client.0.smithi077.stdout:7/955: dread - d12/d22/daa/dc0/dac/dad/fca zero size 2024-09-18T21:13:07.133 INFO:tasks.workunit.client.0.smithi077.stdout:8/869: dread d2/d27/d29/d41/fb7 [0,4194304] 0 2024-09-18T21:13:07.133 INFO:tasks.workunit.client.0.smithi077.stdout:5/943: stat d0/d6/lf1 0 2024-09-18T21:13:07.134 INFO:tasks.workunit.client.0.smithi077.stdout:7/956: readlink d12/l1c 0 2024-09-18T21:13:07.135 INFO:tasks.workunit.client.0.smithi077.stdout:5/944: chown d0/d6/d3b/f8f 141984 1 2024-09-18T21:13:07.135 INFO:tasks.workunit.client.1.smithi103.stdout:2/995: unlink d3/d5/d4a/d56/l92 0 2024-09-18T21:13:07.136 INFO:tasks.workunit.client.0.smithi077.stdout:5/945: dread - d0/df/d10/d47/f93 zero size 2024-09-18T21:13:07.137 INFO:tasks.workunit.client.0.smithi077.stdout:8/870: mknod d2/d27/d29/d104/c12e 0 2024-09-18T21:13:07.137 INFO:tasks.workunit.client.0.smithi077.stdout:7/957: write d12/d31/d77/da0/f11d [980022,67527] 0 2024-09-18T21:13:07.137 INFO:tasks.workunit.client.1.smithi103.stdout:1/995: truncate d0/d2/d9/d9e/d7a/dd0/df9/d68/d81/da2/da4/dc2/f114 133920 0 2024-09-18T21:13:07.139 INFO:tasks.workunit.client.1.smithi103.stdout:2/996: unlink d3/d5/d4a/f5e 0 2024-09-18T21:13:07.140 INFO:tasks.workunit.client.0.smithi077.stdout:5/946: dread - d0/d6/d8a/fab zero size 2024-09-18T21:13:07.140 INFO:tasks.workunit.client.0.smithi077.stdout:5/947: stat d0/d6 0 2024-09-18T21:13:07.141 INFO:tasks.workunit.client.0.smithi077.stdout:5/948: chown d0/f78 85822261 1 2024-09-18T21:13:07.141 INFO:tasks.workunit.client.1.smithi103.stdout:1/996: truncate d0/d2/d9/d10/d5d/d6f/f141 902227 0 2024-09-18T21:13:07.144 INFO:tasks.workunit.client.1.smithi103.stdout:1/997: truncate d0/d2/d9/d10/d5d/f8a 4513672 0 2024-09-18T21:13:07.147 INFO:tasks.workunit.client.0.smithi077.stdout:5/949: unlink d0/l8d 0 2024-09-18T21:13:07.148 INFO:tasks.workunit.client.1.smithi103.stdout:1/998: creat d0/d2/d9/d10/d5d/d6f/f15e x:0 0 0 2024-09-18T21:13:07.152 INFO:tasks.workunit.client.1.smithi103.stdout:2/997: getdents d3/d5/d2f/d32/d46 0 2024-09-18T21:13:07.153 INFO:tasks.workunit.client.0.smithi077.stdout:8/871: write d2/d5f/d7a/fec [972324,57536] 0 2024-09-18T21:13:07.153 INFO:tasks.workunit.client.0.smithi077.stdout:7/958: dread d12/d22/d59/d72/f81 [0,4194304] 0 2024-09-18T21:13:07.155 INFO:tasks.workunit.client.1.smithi103.stdout:1/999: dwrite d0/d2/d2b/d3a/f10d [0,4194304] 0 2024-09-18T21:13:07.156 INFO:tasks.workunit.client.1.smithi103.stdout:2/998: creat d3/d136/f152 x:0 0 0 2024-09-18T21:13:07.160 INFO:tasks.workunit.client.0.smithi077.stdout:7/959: rmdir d12/d22/d59/d72/d91 39 2024-09-18T21:13:07.163 INFO:tasks.workunit.client.0.smithi077.stdout:5/950: dwrite d0/d6/f48 [0,4194304] 0 2024-09-18T21:13:07.169 INFO:tasks.workunit.client.0.smithi077.stdout:5/951: rename d0/df/d10/l69 to d0/d6/d40/d107/d126/l136 0 2024-09-18T21:13:07.170 INFO:tasks.workunit.client.0.smithi077.stdout:8/872: truncate d2/d5f/da8/d4f/d5a/f5c 1299463 0 2024-09-18T21:13:07.171 INFO:tasks.workunit.client.1.smithi103.stdout:2/999: write d3/d5/fe [699782,30294] 0 2024-09-18T21:13:07.171 INFO:tasks.workunit.client.0.smithi077.stdout:8/873: chown d2/d27/d29/d72/d81/fe9 364624 1 2024-09-18T21:13:07.172 INFO:tasks.workunit.client.0.smithi077.stdout:5/952: mknod d0/d6/dde/c137 0 2024-09-18T21:13:07.173 INFO:tasks.workunit.client.0.smithi077.stdout:5/953: fsync d0/df/d10/d4b/f65 0 2024-09-18T21:13:07.174 INFO:tasks.workunit.client.0.smithi077.stdout:5/954: chown d0/df/d84/c8b 2249619 1 2024-09-18T21:13:07.175 INFO:tasks.workunit.client.0.smithi077.stdout:8/874: creat d2/d5f/da8/d4f/d5a/d2a/dc8/df1/d11d/da6/f12f x:0 0 0 2024-09-18T21:13:07.176 INFO:tasks.workunit.client.1.smithi103.stderr:+ rm -rf -- ./tmp.aJeDW0uknx 2024-09-18T21:13:07.183 INFO:tasks.workunit.client.0.smithi077.stdout:7/960: dread d12/d22/d59/d72/f57 [0,4194304] 0 2024-09-18T21:13:07.184 INFO:tasks.workunit.client.0.smithi077.stdout:8/875: write d2/d5f/da8/d26/f39 [56341,29126] 0 2024-09-18T21:13:07.185 INFO:tasks.workunit.client.0.smithi077.stdout:5/955: write d0/df/d10/f26 [1966682,13416] 0 2024-09-18T21:13:07.188 INFO:tasks.workunit.client.0.smithi077.stdout:5/956: mknod d0/df/d10/d5c/d74/c138 0 2024-09-18T21:13:07.189 INFO:tasks.workunit.client.0.smithi077.stdout:8/876: symlink d2/d5f/da8/d4f/d5a/d2a/dc8/df1/d11d/da4/df8/l130 0 2024-09-18T21:13:07.193 INFO:tasks.workunit.client.0.smithi077.stdout:7/961: dwrite d12/d31/d77/d93/d2a/f82 [0,4194304] 0 2024-09-18T21:13:07.194 INFO:tasks.workunit.client.0.smithi077.stdout:8/877: creat d2/d5f/da8/d4f/d5a/d2a/dc8/df1/d11d/da6/f131 x:0 0 0 2024-09-18T21:13:07.197 INFO:tasks.workunit.client.0.smithi077.stdout:5/957: dwrite d0/d6/dd/d5d/fea [0,4194304] 0 2024-09-18T21:13:07.200 INFO:tasks.workunit.client.0.smithi077.stdout:8/878: creat d2/d5f/da8/d26/f132 x:0 0 0 2024-09-18T21:13:07.203 INFO:tasks.workunit.client.0.smithi077.stdout:5/958: chown d0/df/d10/d5c/d74/led 26 1 2024-09-18T21:13:07.205 INFO:tasks.workunit.client.0.smithi077.stdout:8/879: symlink d2/d5f/da8/d4f/l133 0 2024-09-18T21:13:07.207 INFO:tasks.workunit.client.0.smithi077.stdout:8/880: symlink d2/d27/d29/d41/dbc/dce/l134 0 2024-09-18T21:13:07.209 INFO:tasks.workunit.client.0.smithi077.stdout:8/881: creat d2/d27/d29/d41/dbc/dce/f135 x:0 0 0 2024-09-18T21:13:07.209 INFO:tasks.workunit.client.0.smithi077.stdout:8/882: chown d2/d27/d29 43 1 2024-09-18T21:13:07.213 INFO:tasks.workunit.client.0.smithi077.stdout:8/883: rmdir d2/d5f/da8/d4f/d5a/d2a/d88/d108 0 2024-09-18T21:13:07.214 INFO:tasks.workunit.client.0.smithi077.stdout:8/884: chown d2/d5/f16 571192529 1 2024-09-18T21:13:07.216 INFO:tasks.workunit.client.0.smithi077.stdout:8/885: symlink d2/d27/d29/d41/dc2/l136 0 2024-09-18T21:13:07.219 INFO:tasks.workunit.client.0.smithi077.stdout:5/959: dwrite d0/df/d10/d5c/d74/fc4 [0,4194304] 0 2024-09-18T21:13:07.222 INFO:tasks.workunit.client.0.smithi077.stdout:8/886: dread d2/d5f/da8/d4f/d5a/d2a/d88/fb9 [0,4194304] 0 2024-09-18T21:13:07.223 INFO:tasks.workunit.client.0.smithi077.stdout:5/960: symlink d0/de6/d11f/l139 0 2024-09-18T21:13:07.225 INFO:tasks.workunit.client.0.smithi077.stdout:8/887: creat d2/d5f/da8/d4f/d5a/d2a/dc8/df1/d11d/f137 x:0 0 0 2024-09-18T21:13:07.225 INFO:tasks.workunit.client.0.smithi077.stdout:5/961: creat d0/d6/daa/f13a x:0 0 0 2024-09-18T21:13:07.227 INFO:tasks.workunit.client.0.smithi077.stdout:8/888: symlink d2/d5f/d6f/l138 0 2024-09-18T21:13:07.229 INFO:tasks.workunit.client.0.smithi077.stdout:8/889: mknod d2/d5f/da8/d4f/d5a/d2a/d67/c139 0 2024-09-18T21:13:07.230 INFO:tasks.workunit.client.0.smithi077.stdout:5/962: rename d0/df/d10/d5c/d74/fc4 to d0/d6/dd/f13b 0 2024-09-18T21:13:07.232 INFO:tasks.workunit.client.0.smithi077.stdout:5/963: creat d0/df/d84/f13c x:0 0 0 2024-09-18T21:13:07.248 INFO:tasks.workunit.client.0.smithi077.stdout:5/964: write d0/df/f52 [2798868,45878] 0 2024-09-18T21:13:07.249 INFO:tasks.workunit.client.0.smithi077.stdout:5/965: chown d0/d6/f3c 6 1 2024-09-18T21:13:07.252 INFO:tasks.workunit.client.0.smithi077.stdout:5/966: rename d0/df/d10/de1 to d0/df/d10/d4b/d80/de9/d13d 0 2024-09-18T21:13:07.255 INFO:tasks.workunit.client.0.smithi077.stdout:5/967: rename d0/df/d10/d4b/d80/fec to d0/de6/d11f/f13e 0 2024-09-18T21:13:07.258 INFO:tasks.workunit.client.0.smithi077.stdout:5/968: rename d0/d6/c108 to d0/df/d10/d4b/d80/de9/d13d/d110/c13f 0 2024-09-18T21:13:07.269 INFO:tasks.workunit.client.0.smithi077.stdout:5/969: dread d0/d6/d3b/f7e [0,4194304] 0 2024-09-18T21:13:07.269 INFO:tasks.workunit.client.0.smithi077.stdout:5/970: dread - d0/de6/feb zero size 2024-09-18T21:13:07.280 INFO:tasks.workunit.client.0.smithi077.stdout:5/971: symlink d0/df/d10/d4b/d80/de9/d13d/d110/l140 0 2024-09-18T21:13:07.283 INFO:tasks.workunit.client.0.smithi077.stdout:5/972: symlink d0/df/d3d/d131/l141 0 2024-09-18T21:13:07.314 INFO:tasks.workunit.client.0.smithi077.stdout:5/973: rename d0/df/d3d/d85 to d0/d43/d142 0 2024-09-18T21:13:07.319 INFO:tasks.workunit.client.0.smithi077.stdout:5/974: link d0/df/d10/d4b/f65 d0/df/d84/f143 0 2024-09-18T21:13:07.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:07 smithi103 ceph-mon[34827]: pgmap v25: 65 pgs: 65 active+clean; 3.7 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 99 MiB/s rd, 214 MiB/s wr, 494 op/s 2024-09-18T21:13:07.824 INFO:tasks.workunit.client.0.smithi077.stdout:0/961: sync 2024-09-18T21:13:07.824 INFO:tasks.workunit.client.0.smithi077.stdout:2/953: sync 2024-09-18T21:13:07.824 INFO:tasks.workunit.client.0.smithi077.stdout:5/975: sync 2024-09-18T21:13:07.824 INFO:tasks.workunit.client.0.smithi077.stdout:8/890: sync 2024-09-18T21:13:07.824 INFO:tasks.workunit.client.0.smithi077.stdout:6/842: sync 2024-09-18T21:13:07.824 INFO:tasks.workunit.client.0.smithi077.stdout:4/903: sync 2024-09-18T21:13:07.824 INFO:tasks.workunit.client.0.smithi077.stdout:9/821: sync 2024-09-18T21:13:07.824 INFO:tasks.workunit.client.0.smithi077.stdout:1/831: sync 2024-09-18T21:13:07.824 INFO:tasks.workunit.client.0.smithi077.stdout:7/962: sync 2024-09-18T21:13:07.824 INFO:tasks.workunit.client.0.smithi077.stdout:3/922: sync 2024-09-18T21:13:07.826 INFO:tasks.workunit.client.0.smithi077.stdout:7/963: chown d12/d22/daa/dc0/f12e 20833830 1 2024-09-18T21:13:07.828 INFO:tasks.workunit.client.0.smithi077.stdout:5/976: unlink d0/d6/d3b/l92 0 2024-09-18T21:13:07.829 INFO:tasks.workunit.client.0.smithi077.stdout:4/904: creat d3/d35/db1/f11e x:0 0 0 2024-09-18T21:13:07.893 INFO:tasks.workunit.client.0.smithi077.stdout:8/891: mknod d2/d27/d29/d41/dbc/c13a 0 2024-09-18T21:13:07.894 INFO:tasks.workunit.client.0.smithi077.stdout:4/905: stat d3/dc/d51/d53/d89 0 2024-09-18T21:13:07.895 INFO:tasks.workunit.client.0.smithi077.stdout:1/832: creat d3/d8/d93/dd3/d99/de8/da6/f11c x:0 0 0 2024-09-18T21:13:07.895 INFO:tasks.workunit.client.0.smithi077.stdout:7/964: creat d12/d31/d77/da3/f14a x:0 0 0 2024-09-18T21:13:07.896 INFO:tasks.workunit.client.0.smithi077.stdout:6/843: dwrite d7/d7e/d11/ff9 [0,4194304] 0 2024-09-18T21:13:07.896 INFO:tasks.workunit.client.0.smithi077.stdout:9/822: getdents d1/dd/d57/de8 0 2024-09-18T21:13:07.901 INFO:tasks.workunit.client.0.smithi077.stdout:7/965: write d12/d31/d77/d93/d2a/d6c/ff1 [1166479,84056] 0 2024-09-18T21:13:07.907 INFO:tasks.workunit.client.0.smithi077.stdout:8/892: link d2/d27/d29/f90 d2/d5f/d7a/f13b 0 2024-09-18T21:13:07.910 INFO:tasks.workunit.client.0.smithi077.stdout:3/923: dwrite db/d14/d32/d49/da4/d71/f78 [0,4194304] 0 2024-09-18T21:13:07.910 INFO:tasks.workunit.client.0.smithi077.stdout:6/844: rename d7/d7e/d11/d3e/d42/dbb/cf3 to d7/d7e/d11/d3e/dcd/df7/c119 0 2024-09-18T21:13:07.915 INFO:tasks.workunit.client.0.smithi077.stdout:5/977: dread d0/d36/f75 [4194304,4194304] 0 2024-09-18T21:13:07.915 INFO:tasks.workunit.client.0.smithi077.stdout:7/966: mknod d12/d31/d77/d93/d89/dfe/d103/c14b 0 2024-09-18T21:13:07.921 INFO:tasks.workunit.client.0.smithi077.stdout:5/978: mkdir d0/d43/d6d/d144 0 2024-09-18T21:13:07.923 INFO:tasks.workunit.client.0.smithi077.stdout:8/893: creat d2/d5f/da8/d4f/d5a/d12b/f13c x:0 0 0 2024-09-18T21:13:07.923 INFO:tasks.workunit.client.0.smithi077.stdout:1/833: write d3/d8/d49/d4e/d50/f2c [2328892,68540] 0 2024-09-18T21:13:07.925 INFO:tasks.workunit.client.0.smithi077.stdout:7/967: rename d12/d31/d77/da0/fa8 to d12/d56/da1/db6/f14c 0 2024-09-18T21:13:07.928 INFO:tasks.workunit.client.0.smithi077.stdout:4/906: write d3/dc/d32/d45/faa [1049712,92141] 0 2024-09-18T21:13:07.932 INFO:tasks.workunit.client.0.smithi077.stdout:9/823: dwrite d1/dd/d11/d1c/dd7/f116 [0,4194304] 0 2024-09-18T21:13:07.932 INFO:tasks.workunit.client.0.smithi077.stdout:8/894: mkdir d2/d27/d29/d41/d13d 0 2024-09-18T21:13:07.936 INFO:tasks.workunit.client.0.smithi077.stdout:6/845: write d7/d7e/d11/d3e/d42/dbb/d31/fb4 [2714233,127152] 0 2024-09-18T21:13:07.940 INFO:tasks.workunit.client.0.smithi077.stdout:5/979: dread d0/d6/d3b/d64/d67/fcc [0,4194304] 0 2024-09-18T21:13:07.941 INFO:tasks.workunit.client.0.smithi077.stdout:9/824: creat d1/dd/d57/f119 x:0 0 0 2024-09-18T21:13:07.944 INFO:tasks.workunit.client.0.smithi077.stdout:1/834: truncate d3/d8/d93/dd3/f46 3827617 0 2024-09-18T21:13:07.945 INFO:tasks.workunit.client.0.smithi077.stdout:1/835: chown d3/d38 22205 1 2024-09-18T21:13:07.949 INFO:tasks.workunit.client.0.smithi077.stdout:6/846: mkdir d7/d7e/d11/d9a/d11a 0 2024-09-18T21:13:07.955 INFO:tasks.workunit.client.0.smithi077.stdout:7/968: dwrite d12/d22/f63 [0,4194304] 0 2024-09-18T21:13:07.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:07 smithi077 ceph-mon[27689]: pgmap v25: 65 pgs: 65 active+clean; 3.7 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 99 MiB/s rd, 214 MiB/s wr, 494 op/s 2024-09-18T21:13:07.963 INFO:tasks.workunit.client.0.smithi077.stdout:4/907: truncate d3/d7/d73/d9f/fe7 3974830 0 2024-09-18T21:13:07.964 INFO:tasks.workunit.client.0.smithi077.stdout:9/825: write d1/dd/d11/d1c/d38/d46/d55/d7f/fc3 [204753,122010] 0 2024-09-18T21:13:07.967 INFO:tasks.workunit.client.0.smithi077.stdout:7/969: mknod d12/d56/ded/c14d 0 2024-09-18T21:13:07.967 INFO:tasks.workunit.client.0.smithi077.stdout:1/836: dread d3/d8/d93/dd3/f91 [0,4194304] 0 2024-09-18T21:13:07.967 INFO:tasks.workunit.client.0.smithi077.stdout:8/895: link d2/d27/d29/d72/d81/c10e d2/d5f/da8/d4f/d5a/d2a/d88/c13e 0 2024-09-18T21:13:07.973 INFO:tasks.workunit.client.0.smithi077.stdout:6/847: link d7/d7e/d11/d3e/d42/d88/da4/f105 d7/d7e/d11/d3e/d42/d88/da4/d102/f11b 0 2024-09-18T21:13:07.976 INFO:tasks.workunit.client.0.smithi077.stdout:5/980: dread d0/d6/d3b/d64/f79 [0,4194304] 0 2024-09-18T21:13:07.977 INFO:tasks.workunit.client.0.smithi077.stdout:1/837: unlink d3/d8/d49/lc8 0 2024-09-18T21:13:07.981 INFO:tasks.workunit.client.0.smithi077.stdout:8/896: mkdir d2/d27/d29/d41/d13d/d13f 0 2024-09-18T21:13:07.983 INFO:tasks.workunit.client.0.smithi077.stdout:4/908: write d3/d7/d6c/fd6 [897464,127317] 0 2024-09-18T21:13:07.987 INFO:tasks.workunit.client.0.smithi077.stdout:5/981: creat d0/df/d10/f145 x:0 0 0 2024-09-18T21:13:07.988 INFO:tasks.workunit.client.0.smithi077.stdout:9/826: write d1/d54/f44 [3006860,126822] 0 2024-09-18T21:13:07.990 INFO:tasks.workunit.client.0.smithi077.stdout:7/970: write d12/d22/d59/f79 [75373,76102] 0 2024-09-18T21:13:07.991 INFO:tasks.workunit.client.0.smithi077.stdout:6/848: dread d7/d7e/f1b [0,4194304] 0 2024-09-18T21:13:07.992 INFO:tasks.workunit.client.0.smithi077.stdout:8/897: creat d2/d5/d6/d127/f140 x:0 0 0 2024-09-18T21:13:07.994 INFO:tasks.workunit.client.0.smithi077.stdout:8/898: fsync d2/d5f/da8/d4f/d5a/d2a/d88/fdd 0 2024-09-18T21:13:07.997 INFO:tasks.workunit.client.0.smithi077.stdout:4/909: symlink d3/d7/d73/d9f/d11c/l11f 0 2024-09-18T21:13:07.998 INFO:tasks.workunit.client.0.smithi077.stdout:1/838: dread d3/d6a/d9b/f55 [0,4194304] 0 2024-09-18T21:13:07.999 INFO:tasks.workunit.client.0.smithi077.stdout:1/839: readlink d3/d8/d49/d4e/dbd/le7 0 2024-09-18T21:13:08.000 INFO:tasks.workunit.client.0.smithi077.stdout:7/971: fdatasync d12/d31/d77/da0/fa7 0 2024-09-18T21:13:08.003 INFO:tasks.workunit.client.0.smithi077.stdout:6/849: read d7/d7e/d11/d3e/d42/d88/da4/f47 [65932,70863] 0 2024-09-18T21:13:08.005 INFO:tasks.workunit.client.0.smithi077.stdout:5/982: link d0/df/d10/f26 d0/df/d84/f146 0 2024-09-18T21:13:08.006 INFO:tasks.workunit.client.0.smithi077.stdout:5/983: truncate d0/d6/d8a/f111 471415 0 2024-09-18T21:13:08.008 INFO:tasks.workunit.client.0.smithi077.stdout:4/910: truncate d3/fb 231297 0 2024-09-18T21:13:08.014 INFO:tasks.workunit.client.0.smithi077.stdout:5/984: truncate d0/df/d10/d5c/d74/d89/f10e 3766761 0 2024-09-18T21:13:08.015 INFO:tasks.workunit.client.0.smithi077.stdout:9/827: link d1/dd/d1a/f23 d1/dd/d11/d1c/dd7/f11a 0 2024-09-18T21:13:08.016 INFO:tasks.workunit.client.0.smithi077.stdout:5/985: chown d0/d6/dde 74883652 1 2024-09-18T21:13:08.017 INFO:tasks.workunit.client.0.smithi077.stdout:5/986: write d0/df/f52 [2653192,19884] 0 2024-09-18T21:13:08.018 INFO:tasks.workunit.client.0.smithi077.stdout:6/850: dread d7/d7e/d11/d3e/d42/dbb/d50/fdb [0,4194304] 0 2024-09-18T21:13:08.023 INFO:tasks.workunit.client.0.smithi077.stdout:8/899: truncate d2/d5/f93 854435 0 2024-09-18T21:13:08.024 INFO:tasks.workunit.client.0.smithi077.stdout:9/828: creat d1/dd/d57/f11b x:0 0 0 2024-09-18T21:13:08.025 INFO:tasks.workunit.client.0.smithi077.stdout:4/911: write d3/d7/d6c/fdc [2130772,5345] 0 2024-09-18T21:13:08.027 INFO:tasks.workunit.client.0.smithi077.stdout:5/987: dwrite d0/df/d10/d4b/d98/ff9 [0,4194304] 0 2024-09-18T21:13:08.033 INFO:tasks.workunit.client.0.smithi077.stdout:7/972: creat d12/d22/d59/f14e x:0 0 0 2024-09-18T21:13:08.034 INFO:tasks.workunit.client.0.smithi077.stdout:7/973: chown d12/d22/daa/dc0/dac/cd0 464369 1 2024-09-18T21:13:08.037 INFO:tasks.workunit.client.0.smithi077.stdout:9/829: mknod d1/d54/d51/c11c 0 2024-09-18T21:13:08.038 INFO:tasks.workunit.client.0.smithi077.stdout:8/900: symlink d2/d5f/da8/d4f/d5a/d119/l141 0 2024-09-18T21:13:08.040 INFO:tasks.workunit.client.0.smithi077.stdout:1/840: write d3/d8/d75/d89/dbb/fc6 [121613,24212] 0 2024-09-18T21:13:08.044 INFO:tasks.workunit.client.0.smithi077.stdout:6/851: mkdir d7/d7e/d11/d3e/d42/dbb/d11c 0 2024-09-18T21:13:08.047 INFO:tasks.workunit.client.0.smithi077.stdout:9/830: mkdir d1/dd/d11/d1c/d38/d46/d11d 0 2024-09-18T21:13:08.052 INFO:tasks.workunit.client.0.smithi077.stdout:8/901: rename d2/d5f/da8/d4f/d5a/d5e/d8f/l8d to d2/d5f/d6f/d105/l142 0 2024-09-18T21:13:08.054 INFO:tasks.workunit.client.0.smithi077.stdout:5/988: mkdir d0/df/d10/d147 0 2024-09-18T21:13:08.055 INFO:tasks.workunit.client.0.smithi077.stdout:7/974: write d12/d22/d59/d72/ff2 [836938,71526] 0 2024-09-18T21:13:08.055 INFO:tasks.workunit.client.0.smithi077.stdout:1/841: mknod d3/d6a/d9b/d68/d3e/c11d 0 2024-09-18T21:13:08.056 INFO:tasks.workunit.client.0.smithi077.stdout:5/989: chown d0/d6/d3b/f11a 798 1 2024-09-18T21:13:08.057 INFO:tasks.workunit.client.0.smithi077.stdout:1/842: write d3/d38/f60 [301470,26773] 0 2024-09-18T21:13:08.058 INFO:tasks.workunit.client.0.smithi077.stdout:6/852: symlink d7/d7e/d11/d3e/d42/dbb/d49/d55/dc2/l11d 0 2024-09-18T21:13:08.060 INFO:tasks.workunit.client.0.smithi077.stdout:9/831: fdatasync d1/dd/d11/d1c/d38/d46/d55/dce/fba 0 2024-09-18T21:13:08.064 INFO:tasks.workunit.client.0.smithi077.stdout:9/832: dread d1/dd/d1a/d42/f89 [0,4194304] 0 2024-09-18T21:13:08.065 INFO:tasks.workunit.client.0.smithi077.stdout:9/833: readlink d1/dd/lf2 0 2024-09-18T21:13:08.067 INFO:tasks.workunit.client.0.smithi077.stdout:5/990: symlink d0/d6/daa/l148 0 2024-09-18T21:13:08.067 INFO:tasks.workunit.client.0.smithi077.stdout:5/991: read - d0/df/d3d/f12d zero size 2024-09-18T21:13:08.068 INFO:tasks.workunit.client.0.smithi077.stdout:1/843: symlink d3/d6a/d9b/d68/l11e 0 2024-09-18T21:13:08.071 INFO:tasks.workunit.client.0.smithi077.stdout:4/912: getdents d3/d7/d7b/d88 0 2024-09-18T21:13:08.072 INFO:tasks.workunit.client.0.smithi077.stdout:4/913: chown d3/dc/d32/d45/c10a 3 1 2024-09-18T21:13:08.073 INFO:tasks.workunit.client.0.smithi077.stdout:7/975: mknod d12/d31/d77/d93/d2a/d7f/d147/c14f 0 2024-09-18T21:13:08.075 INFO:tasks.workunit.client.0.smithi077.stdout:1/844: creat d3/d8/d93/f11f x:0 0 0 2024-09-18T21:13:08.077 INFO:tasks.workunit.client.0.smithi077.stdout:8/902: link d2/d27/d29/d41/dbc/lc3 d2/d27/d29/d41/d13d/l143 0 2024-09-18T21:13:08.078 INFO:tasks.workunit.client.0.smithi077.stdout:4/914: truncate d3/f5 2922993 0 2024-09-18T21:13:08.079 INFO:tasks.workunit.client.0.smithi077.stdout:4/915: chown d3/dc/d51/fd7 542 1 2024-09-18T21:13:08.079 INFO:tasks.workunit.client.0.smithi077.stdout:9/834: symlink d1/d54/l11e 0 2024-09-18T21:13:08.082 INFO:tasks.workunit.client.0.smithi077.stdout:8/903: symlink d2/d27/d29/d72/l144 0 2024-09-18T21:13:08.083 INFO:tasks.workunit.client.0.smithi077.stdout:6/853: getdents d7/d7e/d11/d3e/d42/dbb/d50 0 2024-09-18T21:13:08.085 INFO:tasks.workunit.client.0.smithi077.stdout:4/916: mknod d3/dc/d32/c120 0 2024-09-18T21:13:08.087 INFO:tasks.workunit.client.0.smithi077.stdout:7/976: dread d12/f45 [0,4194304] 0 2024-09-18T21:13:08.088 INFO:tasks.workunit.client.0.smithi077.stdout:6/854: creat d7/d7e/d11/d3e/f11e x:0 0 0 2024-09-18T21:13:08.094 INFO:tasks.workunit.client.0.smithi077.stdout:8/904: dwrite d2/d5f/da8/d4f/d5a/fc7 [0,4194304] 0 2024-09-18T21:13:08.096 INFO:tasks.workunit.client.0.smithi077.stdout:7/977: rename d12/d31/d77/d93/d89/lc8 to d12/d22/d122/l150 0 2024-09-18T21:13:08.097 INFO:tasks.workunit.client.0.smithi077.stdout:1/845: dread d3/ff [0,4194304] 0 2024-09-18T21:13:08.098 INFO:tasks.workunit.client.0.smithi077.stdout:6/855: truncate d7/d7e/d11/fe2 593859 0 2024-09-18T21:13:08.099 INFO:tasks.workunit.client.0.smithi077.stdout:8/905: fsync d2/d5f/da8/d4f/d5a/d2a/d88/fb9 0 2024-09-18T21:13:08.101 INFO:tasks.workunit.client.0.smithi077.stdout:6/856: readlink d7/l39 0 2024-09-18T21:13:08.103 INFO:tasks.workunit.client.0.smithi077.stdout:4/917: write d3/d7/de8/fe9 [934349,6545] 0 2024-09-18T21:13:08.105 INFO:tasks.workunit.client.0.smithi077.stdout:4/918: chown d3/dc/d32/f48 2714022 1 2024-09-18T21:13:08.106 INFO:tasks.workunit.client.0.smithi077.stdout:7/978: creat d12/d31/d77/d93/f151 x:0 0 0 2024-09-18T21:13:08.181 INFO:tasks.workunit.client.0.smithi077.stdout:4/919: chown d3/d77/d9c/db9/cc6 78456 1 2024-09-18T21:13:08.181 INFO:tasks.workunit.client.0.smithi077.stdout:9/835: dwrite d1/dd/d11/d15/d80/f8c [0,4194304] 0 2024-09-18T21:13:08.181 INFO:tasks.workunit.client.0.smithi077.stdout:1/846: getdents d3/d8/d13 0 2024-09-18T21:13:08.181 INFO:tasks.workunit.client.0.smithi077.stdout:7/979: rmdir d12/d56/da1/ddf 39 2024-09-18T21:13:08.183 INFO:tasks.workunit.client.0.smithi077.stdout:4/920: creat d3/d7/d42/f121 x:0 0 0 2024-09-18T21:13:08.183 INFO:tasks.workunit.client.0.smithi077.stdout:7/980: chown d12/d56/da1/cc6 97819006 1 2024-09-18T21:13:08.207 INFO:tasks.workunit.client.0.smithi077.stdout:0/962: sync 2024-09-18T21:13:08.212 INFO:tasks.workunit.client.0.smithi077.stdout:1/847: mkdir d3/d6a/d9b/dbe/d120 0 2024-09-18T21:13:08.213 INFO:tasks.workunit.client.0.smithi077.stdout:6/857: dwrite d7/d7e/d11/d3e/d42/d88/ff1 [0,4194304] 0 2024-09-18T21:13:08.213 INFO:tasks.workunit.client.0.smithi077.stdout:4/921: rmdir d3/d7/d7b/d88 39 2024-09-18T21:13:08.215 INFO:tasks.workunit.client.0.smithi077.stdout:9/836: write d1/dd/d11/fad [1093308,59742] 0 2024-09-18T21:13:08.220 INFO:tasks.workunit.client.0.smithi077.stdout:0/963: creat d8/d1a/d39/d109/f13f x:0 0 0 2024-09-18T21:13:08.220 INFO:tasks.workunit.client.0.smithi077.stdout:0/964: read - d8/d1d/f55 zero size 2024-09-18T21:13:08.222 INFO:tasks.workunit.client.0.smithi077.stdout:7/981: truncate d12/d31/d77/d93/d2a/d7f/fb3 1120739 0 2024-09-18T21:13:08.224 INFO:tasks.workunit.client.0.smithi077.stdout:4/922: creat d3/d7/d73/d9f/f122 x:0 0 0 2024-09-18T21:13:08.225 INFO:tasks.workunit.client.0.smithi077.stdout:6/858: creat d7/d7e/d11/d3e/d42/d88/da4/f11f x:0 0 0 2024-09-18T21:13:08.226 INFO:tasks.workunit.client.0.smithi077.stdout:0/965: mknod d8/d26/dc9/c140 0 2024-09-18T21:13:08.228 INFO:tasks.workunit.client.0.smithi077.stdout:0/966: readlink d8/d37/d95/d129/l134 0 2024-09-18T21:13:08.229 INFO:tasks.workunit.client.0.smithi077.stdout:4/923: dread d3/d35/db1/ff5 [0,4194304] 0 2024-09-18T21:13:08.229 INFO:tasks.workunit.client.0.smithi077.stdout:7/982: unlink d12/d56/ff8 0 2024-09-18T21:13:08.230 INFO:tasks.workunit.client.0.smithi077.stdout:7/983: stat d12/d56/l132 0 2024-09-18T21:13:08.232 INFO:tasks.workunit.client.0.smithi077.stdout:6/859: mknod d7/d7e/d11/d3e/d42/dbb/d49/d96/c120 0 2024-09-18T21:13:08.234 INFO:tasks.workunit.client.0.smithi077.stdout:0/967: dread - d8/d37/d95/dab/f10c zero size 2024-09-18T21:13:08.235 INFO:tasks.workunit.client.0.smithi077.stdout:0/968: chown d8/d1a/f112 30901 1 2024-09-18T21:13:08.236 INFO:tasks.workunit.client.0.smithi077.stdout:4/924: mknod d3/d7/d6c/c123 0 2024-09-18T21:13:08.237 INFO:tasks.workunit.client.0.smithi077.stdout:1/848: write d3/d8/d93/fda [766902,10373] 0 2024-09-18T21:13:08.237 INFO:tasks.workunit.client.0.smithi077.stdout:4/925: chown d3/dc 1799636 1 2024-09-18T21:13:08.242 INFO:tasks.workunit.client.0.smithi077.stdout:0/969: dwrite d8/d37/d66/d102/f123 [0,4194304] 0 2024-09-18T21:13:08.244 INFO:tasks.workunit.client.0.smithi077.stdout:6/860: mkdir d7/d7e/d11/d3e/d42/dbb/d50/d121 0 2024-09-18T21:13:08.246 INFO:tasks.workunit.client.0.smithi077.stdout:7/984: symlink d12/d22/daa/dc0/l152 0 2024-09-18T21:13:08.248 INFO:tasks.workunit.client.0.smithi077.stdout:4/926: dread - d3/d7/d73/fa7 zero size 2024-09-18T21:13:08.251 INFO:tasks.workunit.client.0.smithi077.stdout:9/837: getdents d1/dd/d11/d2d 0 2024-09-18T21:13:08.253 INFO:tasks.workunit.client.0.smithi077.stdout:7/985: symlink d12/d31/d77/da3/l153 0 2024-09-18T21:13:08.253 INFO:tasks.workunit.client.0.smithi077.stdout:4/927: rmdir d3/dc/d32 39 2024-09-18T21:13:08.254 INFO:tasks.workunit.client.0.smithi077.stdout:9/838: mknod d1/d54/d8f/c11f 0 2024-09-18T21:13:08.256 INFO:tasks.workunit.client.0.smithi077.stdout:6/861: creat d7/d7e/d11/d3e/d42/dbb/d50/d121/f122 x:0 0 0 2024-09-18T21:13:08.256 INFO:tasks.workunit.client.0.smithi077.stdout:7/986: mknod d12/dd5/c154 0 2024-09-18T21:13:08.258 INFO:tasks.workunit.client.0.smithi077.stdout:0/970: creat d8/d37/f141 x:0 0 0 2024-09-18T21:13:08.259 INFO:tasks.workunit.client.0.smithi077.stdout:0/971: chown d8/d37/d66/d87/de0/dce/ff7 207 1 2024-09-18T21:13:08.260 INFO:tasks.workunit.client.0.smithi077.stdout:0/972: write d8/d37/d95/f120 [477793,115670] 0 2024-09-18T21:13:08.260 INFO:tasks.workunit.client.0.smithi077.stdout:7/987: fsync d12/d22/f8b 0 2024-09-18T21:13:08.262 INFO:tasks.workunit.client.0.smithi077.stdout:6/862: truncate d7/d7e/d11/d3e/d42/dbb/d5c/f6f 1292898 0 2024-09-18T21:13:08.263 INFO:tasks.workunit.client.0.smithi077.stdout:9/839: mknod d1/dd/d11/d1c/d38/d46/d11d/c120 0 2024-09-18T21:13:08.265 INFO:tasks.workunit.client.0.smithi077.stdout:0/973: rmdir d8/d1a/d39/d56 39 2024-09-18T21:13:08.267 INFO:tasks.workunit.client.0.smithi077.stdout:7/988: mknod d12/d56/ded/c155 0 2024-09-18T21:13:08.268 INFO:tasks.workunit.client.0.smithi077.stdout:1/849: dwrite d3/d8/f47 [0,4194304] 0 2024-09-18T21:13:08.270 INFO:tasks.workunit.client.0.smithi077.stdout:6/863: mknod d7/d7e/d11/d3e/d42/c123 0 2024-09-18T21:13:08.270 INFO:tasks.workunit.client.0.smithi077.stdout:6/864: dread - d7/d7e/f58 zero size 2024-09-18T21:13:08.274 INFO:tasks.workunit.client.0.smithi077.stdout:9/840: mkdir d1/dd/d11/d1c/d38/d46/d55/d9c/d114/d121 0 2024-09-18T21:13:08.279 INFO:tasks.workunit.client.0.smithi077.stdout:1/850: truncate d3/d8/d93/dd3/f83 1413308 0 2024-09-18T21:13:08.281 INFO:tasks.workunit.client.0.smithi077.stdout:6/865: dread d7/d7e/d11/ff6 [0,4194304] 0 2024-09-18T21:13:08.282 INFO:tasks.workunit.client.0.smithi077.stdout:9/841: creat d1/dd/d11/d15/d80/d85/de9/f122 x:0 0 0 2024-09-18T21:13:08.283 INFO:tasks.workunit.client.0.smithi077.stdout:4/928: link d3/dc/lab d3/dc/d32/l124 0 2024-09-18T21:13:08.283 INFO:tasks.workunit.client.0.smithi077.stdout:4/929: stat d3/d7/d42/d10b 0 2024-09-18T21:13:08.287 INFO:tasks.workunit.client.0.smithi077.stdout:1/851: mknod d3/d6a/d112/c121 0 2024-09-18T21:13:08.293 INFO:tasks.workunit.client.0.smithi077.stdout:9/842: mknod d1/dd/d11/d1c/d38/d46/d55/c123 0 2024-09-18T21:13:08.293 INFO:tasks.workunit.client.0.smithi077.stdout:0/974: dwrite d8/d1a/d39/d3b/d70/f71 [0,4194304] 0 2024-09-18T21:13:08.297 INFO:tasks.workunit.client.0.smithi077.stdout:1/852: creat d3/d6a/d9b/d68/f122 x:0 0 0 2024-09-18T21:13:08.299 INFO:tasks.workunit.client.0.smithi077.stdout:6/866: unlink d7/d7e/d11/d3e/d42/dbb/d4c/f8a 0 2024-09-18T21:13:08.301 INFO:tasks.workunit.client.0.smithi077.stdout:7/989: dwrite d12/d22/d59/d72/f80 [0,4194304] 0 2024-09-18T21:13:08.302 INFO:tasks.workunit.client.0.smithi077.stdout:6/867: readlink d7/d7e/d11/d3e/d42/dbb/d31/l8c 0 2024-09-18T21:13:08.306 INFO:tasks.workunit.client.0.smithi077.stdout:6/868: dread d7/d7e/f1e [0,4194304] 0 2024-09-18T21:13:08.307 INFO:tasks.workunit.client.0.smithi077.stdout:1/853: creat d3/d8/d49/d4e/dbd/f123 x:0 0 0 2024-09-18T21:13:08.307 INFO:tasks.workunit.client.0.smithi077.stdout:0/975: dread d8/d37/d66/d87/de0/f8a [0,4194304] 0 2024-09-18T21:13:08.309 INFO:tasks.workunit.client.0.smithi077.stdout:4/930: write d3/d35/f37 [4107100,4846] 0 2024-09-18T21:13:08.311 INFO:tasks.workunit.client.0.smithi077.stdout:6/869: chown d7/d7e/d11/d3e/dcd/l10c 174 1 2024-09-18T21:13:08.314 INFO:tasks.workunit.client.0.smithi077.stdout:1/854: creat d3/d8/d49/d4e/d5a/f124 x:0 0 0 2024-09-18T21:13:08.315 INFO:tasks.workunit.client.0.smithi077.stdout:7/990: fsync d12/d31/f41 0 2024-09-18T21:13:08.315 INFO:tasks.workunit.client.0.smithi077.stdout:1/855: dread - d3/d38/d97/f107 zero size 2024-09-18T21:13:08.319 INFO:tasks.workunit.client.0.smithi077.stdout:6/870: creat d7/d7e/d11/d3e/d42/dbb/d50/f124 x:0 0 0 2024-09-18T21:13:08.320 INFO:tasks.workunit.client.0.smithi077.stdout:0/976: link d8/d1a/f51 d8/d10b/f142 0 2024-09-18T21:13:08.322 INFO:tasks.workunit.client.0.smithi077.stdout:4/931: unlink d3/dc/d51/f117 0 2024-09-18T21:13:08.325 INFO:tasks.workunit.client.0.smithi077.stdout:1/856: rename d3/d8/f59 to d3/d8/d49/d4e/dbd/f125 0 2024-09-18T21:13:08.325 INFO:tasks.workunit.client.0.smithi077.stdout:9/843: write d1/dd/d11/d1c/d38/d46/d55/d9c/fd6 [1782249,124757] 0 2024-09-18T21:13:08.328 INFO:tasks.workunit.client.0.smithi077.stdout:0/977: truncate d8/d1d/d80/f5e 2948183 0 2024-09-18T21:13:08.333 INFO:tasks.workunit.client.0.smithi077.stdout:1/857: creat d3/d8/d93/dd3/d99/de8/da6/f126 x:0 0 0 2024-09-18T21:13:08.333 INFO:tasks.workunit.client.0.smithi077.stdout:9/844: dwrite d1/dd/d11/d1c/d38/d46/d55/d7f/fde [0,4194304] 0 2024-09-18T21:13:08.335 INFO:tasks.workunit.client.0.smithi077.stdout:7/991: write d12/d31/d77/d93/d2a/d7f/fe4 [358567,66587] 0 2024-09-18T21:13:08.336 INFO:tasks.workunit.client.0.smithi077.stdout:6/871: link d7/d7e/d11/d3e/d42/d88/da4/f105 d7/d7e/d11/d3e/d42/dbb/d4c/f125 0 2024-09-18T21:13:08.337 INFO:tasks.workunit.client.0.smithi077.stdout:1/858: dread - d3/d8/d49/df0/ff7 zero size 2024-09-18T21:13:08.338 INFO:tasks.workunit.client.0.smithi077.stdout:9/845: mknod d1/dd/d11/d1c/d38/d46/d11d/c124 0 2024-09-18T21:13:08.339 INFO:tasks.workunit.client.0.smithi077.stdout:9/846: truncate d1/f112 67044 0 2024-09-18T21:13:08.345 INFO:tasks.workunit.client.0.smithi077.stdout:1/859: dwrite d3/d8/f105 [0,4194304] 0 2024-09-18T21:13:08.347 INFO:tasks.workunit.client.0.smithi077.stdout:9/847: unlink d1/d54/f12 0 2024-09-18T21:13:08.348 INFO:tasks.workunit.client.0.smithi077.stdout:0/978: symlink d8/d1a/d39/d56/d126/l143 0 2024-09-18T21:13:08.349 INFO:tasks.workunit.client.0.smithi077.stdout:7/992: mknod d12/dd5/d13c/c156 0 2024-09-18T21:13:08.349 INFO:tasks.workunit.client.0.smithi077.stdout:4/932: getdents d3/d7/de8/d112 0 2024-09-18T21:13:08.350 INFO:tasks.workunit.client.0.smithi077.stdout:4/933: stat d3/d7/d6c/fd6 0 2024-09-18T21:13:08.350 INFO:tasks.workunit.client.0.smithi077.stdout:4/934: chown d3/dc/f1b 827 1 2024-09-18T21:13:08.357 INFO:tasks.workunit.client.0.smithi077.stdout:7/993: creat d12/d56/ded/f157 x:0 0 0 2024-09-18T21:13:08.358 INFO:tasks.workunit.client.0.smithi077.stdout:4/935: fsync d3/d7/d73/fa7 0 2024-09-18T21:13:08.360 INFO:tasks.workunit.client.0.smithi077.stdout:6/872: dwrite d7/d7e/d11/d3e/d42/dbb/d50/dd5/ff4 [0,4194304] 0 2024-09-18T21:13:08.361 INFO:tasks.workunit.client.0.smithi077.stdout:0/979: mkdir d8/d1a/d144 0 2024-09-18T21:13:08.362 INFO:tasks.workunit.client.0.smithi077.stdout:6/873: stat d7/d7e/d11/d3e/d42/dbb/d4c/c8f 0 2024-09-18T21:13:08.369 INFO:tasks.workunit.client.0.smithi077.stdout:4/936: creat d3/d7/d6c/f125 x:0 0 0 2024-09-18T21:13:08.371 INFO:tasks.workunit.client.0.smithi077.stdout:0/980: creat d8/d37/d66/d87/de0/dce/dcf/f145 x:0 0 0 2024-09-18T21:13:08.371 INFO:tasks.workunit.client.0.smithi077.stdout:9/848: write d1/f7c [4132824,119843] 0 2024-09-18T21:13:08.373 INFO:tasks.workunit.client.0.smithi077.stdout:9/849: truncate d1/dd/d11/d2d/d79/fa6 4579645 0 2024-09-18T21:13:08.374 INFO:tasks.workunit.client.0.smithi077.stdout:6/874: fdatasync d7/d7e/d11/d3e/d42/d88/da4/ff5 0 2024-09-18T21:13:08.380 INFO:tasks.workunit.client.0.smithi077.stdout:6/875: dwrite d7/d7e/d11/f19 [0,4194304] 0 2024-09-18T21:13:08.384 INFO:tasks.workunit.client.0.smithi077.stdout:6/876: stat d7/d7e/d11/d3e/d42/d88 0 2024-09-18T21:13:08.384 INFO:tasks.workunit.client.0.smithi077.stdout:7/994: truncate fa 1512447 0 2024-09-18T21:13:08.385 INFO:tasks.workunit.client.0.smithi077.stdout:4/937: rmdir d3/dc/d24/d105 39 2024-09-18T21:13:08.386 INFO:tasks.workunit.client.0.smithi077.stdout:0/981: creat d8/d1a/d39/d3b/d79/f146 x:0 0 0 2024-09-18T21:13:08.397 INFO:tasks.workunit.client.0.smithi077.stdout:4/938: creat d3/d7/d6c/f126 x:0 0 0 2024-09-18T21:13:08.400 INFO:tasks.workunit.client.0.smithi077.stdout:6/877: write d7/d7e/d11/d3e/d42/dbb/d49/fbc [600313,102586] 0 2024-09-18T21:13:08.401 INFO:tasks.workunit.client.0.smithi077.stdout:0/982: mknod d8/d1a/d39/dd0/c147 0 2024-09-18T21:13:08.401 INFO:tasks.workunit.client.0.smithi077.stdout:7/995: write d12/d22/fc2 [474915,102184] 0 2024-09-18T21:13:08.404 INFO:tasks.workunit.client.0.smithi077.stdout:6/878: creat d7/d7e/da6/de1/f126 x:0 0 0 2024-09-18T21:13:08.405 INFO:tasks.workunit.client.0.smithi077.stdout:9/850: getdents d1/dd/d1a 0 2024-09-18T21:13:08.407 INFO:tasks.workunit.client.0.smithi077.stdout:4/939: dwrite d3/dc/ffa [0,4194304] 0 2024-09-18T21:13:08.407 INFO:tasks.workunit.client.0.smithi077.stdout:0/983: symlink d8/d1a/d39/d109/l148 0 2024-09-18T21:13:08.407 INFO:tasks.workunit.client.0.smithi077.stdout:6/879: chown d7/d7e/d11/d3e/d42/d88/da4 24246921 1 2024-09-18T21:13:08.409 INFO:tasks.workunit.client.0.smithi077.stdout:0/984: chown d8/d1d/d80/ffd 77156 1 2024-09-18T21:13:08.409 INFO:tasks.workunit.client.0.smithi077.stdout:4/940: write d3/d7/d6c/fc7 [440788,61168] 0 2024-09-18T21:13:08.414 INFO:tasks.workunit.client.0.smithi077.stdout:4/941: symlink d3/dc/d51/d53/dce/l127 0 2024-09-18T21:13:08.416 INFO:tasks.workunit.client.0.smithi077.stdout:9/851: write d1/dd/d1a/d42/f104 [1002056,50009] 0 2024-09-18T21:13:08.417 INFO:tasks.workunit.client.0.smithi077.stdout:9/852: chown d1/dd/d1a/d42/f89 28564 1 2024-09-18T21:13:08.419 INFO:tasks.workunit.client.0.smithi077.stdout:6/880: getdents d7/d7e/d11/d3e 0 2024-09-18T21:13:08.421 INFO:tasks.workunit.client.0.smithi077.stdout:7/996: rename d12/dd5/d13c to d12/d22/d59/d5a/d158 0 2024-09-18T21:13:08.421 INFO:tasks.workunit.client.0.smithi077.stdout:0/985: creat d8/d1a/d39/dd0/f149 x:0 0 0 2024-09-18T21:13:08.425 INFO:tasks.workunit.client.0.smithi077.stdout:6/881: creat d7/d7e/d11/d3e/d42/d88/f127 x:0 0 0 2024-09-18T21:13:08.427 INFO:tasks.workunit.client.0.smithi077.stdout:6/882: write d7/fd9 [1012600,36017] 0 2024-09-18T21:13:08.437 INFO:tasks.workunit.client.0.smithi077.stdout:7/997: dwrite d12/d22/daa/dc0/f12e [0,4194304] 0 2024-09-18T21:13:08.438 INFO:tasks.workunit.client.0.smithi077.stdout:0/986: getdents d8/d1a/d39/dd0 0 2024-09-18T21:13:08.438 INFO:tasks.workunit.client.0.smithi077.stdout:9/853: creat d1/dd/d11/d1c/d38/d46/d55/dce/f125 x:0 0 0 2024-09-18T21:13:08.444 INFO:tasks.workunit.client.0.smithi077.stdout:4/942: dwrite d3/dc/fb0 [0,4194304] 0 2024-09-18T21:13:08.446 INFO:tasks.workunit.client.0.smithi077.stdout:9/854: read d1/dd/d11/d72/f98 [1611617,10024] 0 2024-09-18T21:13:08.447 INFO:tasks.workunit.client.0.smithi077.stdout:6/883: dread d7/d7e/d11/d3e/d42/dbb/d50/dd5/ff4 [0,4194304] 0 2024-09-18T21:13:08.469 INFO:tasks.workunit.client.0.smithi077.stdout:0/987: dread d8/f2f [0,4194304] 0 2024-09-18T21:13:08.473 INFO:tasks.workunit.client.0.smithi077.stdout:7/998: creat d12/d31/d77/d93/d2a/d7f/f159 x:0 0 0 2024-09-18T21:13:08.474 INFO:tasks.workunit.client.0.smithi077.stdout:7/999: truncate d12/dd5/d102/f112 1198769 0 2024-09-18T21:13:08.475 INFO:tasks.workunit.client.0.smithi077.stdout:4/943: rename d3/d77/d9c/db6 to d3/d77/d9c/d128 0 2024-09-18T21:13:08.476 INFO:tasks.workunit.client.0.smithi077.stdout:4/944: dread - d3/d35/db1/f11e zero size 2024-09-18T21:13:08.481 INFO:tasks.workunit.client.0.smithi077.stdout:9/855: rename d1/dd/d1a/f76 to d1/dd/d11/d1c/d38/d46/d55/dce/d115/f126 0 2024-09-18T21:13:08.484 INFO:tasks.workunit.client.0.smithi077.stdout:9/856: truncate d1/dd/f62 127257 0 2024-09-18T21:13:08.491 INFO:tasks.workunit.client.0.smithi077.stdout:9/857: getdents d1/dd/d11/d15/d80 0 2024-09-18T21:13:08.492 INFO:tasks.workunit.client.0.smithi077.stdout:0/988: dread d8/d26/f54 [4194304,4194304] 0 2024-09-18T21:13:08.493 INFO:tasks.workunit.client.0.smithi077.stdout:0/989: chown d8/d37/cd8 29200139 1 2024-09-18T21:13:08.494 INFO:tasks.workunit.client.0.smithi077.stdout:4/945: dread d3/dc/d51/d53/d89/fad [0,4194304] 0 2024-09-18T21:13:08.495 INFO:tasks.workunit.client.0.smithi077.stdout:4/946: chown d3/d35/db1/cb5 1612651 1 2024-09-18T21:13:08.495 INFO:tasks.workunit.client.0.smithi077.stdout:0/990: mknod d8/d1d/de3/c14a 0 2024-09-18T21:13:08.496 INFO:tasks.workunit.client.0.smithi077.stdout:4/947: chown d3/dc/d20/ff6 329 1 2024-09-18T21:13:08.496 INFO:tasks.workunit.client.0.smithi077.stdout:0/991: chown d8/d1a/d35/lb1 153175512 1 2024-09-18T21:13:08.498 INFO:tasks.workunit.client.0.smithi077.stdout:9/858: rename d1/dd/d1a/d42/f104 to d1/dd/f127 0 2024-09-18T21:13:08.498 INFO:tasks.workunit.client.0.smithi077.stdout:9/859: chown d1/cd0 5043260 1 2024-09-18T21:13:08.498 INFO:tasks.workunit.client.0.smithi077.stdout:2/954: sync 2024-09-18T21:13:08.498 INFO:tasks.workunit.client.0.smithi077.stdout:0/992: truncate d8/d1a/d39/d3b/d79/f146 478178 0 2024-09-18T21:13:08.499 INFO:tasks.workunit.client.0.smithi077.stdout:9/860: fdatasync d1/d54/d81/f113 0 2024-09-18T21:13:08.503 INFO:tasks.workunit.client.0.smithi077.stdout:0/993: unlink d8/d1a/d39/d3b/d70/f71 0 2024-09-18T21:13:08.508 INFO:tasks.workunit.client.0.smithi077.stdout:2/955: mknod d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d95/c13e 0 2024-09-18T21:13:08.510 INFO:tasks.workunit.client.0.smithi077.stdout:9/861: creat d1/dd/d11/d1c/d38/d46/d55/dce/d115/f128 x:0 0 0 2024-09-18T21:13:08.510 INFO:tasks.workunit.client.0.smithi077.stdout:4/948: write d3/d77/fe6 [52656,119760] 0 2024-09-18T21:13:08.514 INFO:tasks.workunit.client.0.smithi077.stdout:2/956: symlink d1/d12a/l13f 0 2024-09-18T21:13:08.521 INFO:tasks.workunit.client.0.smithi077.stdout:2/957: creat d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/f140 x:0 0 0 2024-09-18T21:13:08.523 INFO:tasks.workunit.client.0.smithi077.stdout:4/949: fsync d3/dc/d24/d72/fb2 0 2024-09-18T21:13:08.523 INFO:tasks.workunit.client.0.smithi077.stdout:0/994: write d8/f6a [1845098,73068] 0 2024-09-18T21:13:08.524 INFO:tasks.workunit.client.0.smithi077.stdout:4/950: chown d3/d35/f37 88443589 1 2024-09-18T21:13:08.524 INFO:tasks.workunit.client.0.smithi077.stdout:2/958: unlink d1/d4/d5/d1a/d11e/cc7 0 2024-09-18T21:13:08.526 INFO:tasks.workunit.client.0.smithi077.stdout:9/862: write d1/d54/fcf [356024,52439] 0 2024-09-18T21:13:08.531 INFO:tasks.workunit.client.0.smithi077.stdout:9/863: mknod d1/dd/d11/d1c/d38/d46/d55/c129 0 2024-09-18T21:13:08.532 INFO:tasks.workunit.client.0.smithi077.stdout:0/995: dwrite d8/d1d/ffb [0,4194304] 0 2024-09-18T21:13:08.534 INFO:tasks.workunit.client.0.smithi077.stdout:2/959: mknod d1/d4/d5/d1a/d2e/d41/d2c/c141 0 2024-09-18T21:13:08.535 INFO:tasks.workunit.client.0.smithi077.stdout:2/960: chown d1/d4/d5/d1a/d2e/f97 3 1 2024-09-18T21:13:08.537 INFO:tasks.workunit.client.0.smithi077.stdout:4/951: write d3/d7/d73/fa2 [239700,63326] 0 2024-09-18T21:13:08.544 INFO:tasks.workunit.client.0.smithi077.stdout:4/952: truncate d3/dc/d24/f4c 4902231 0 2024-09-18T21:13:08.545 INFO:tasks.workunit.client.0.smithi077.stdout:2/961: dwrite d1/d4/d5/d1a/d11e/f11d [0,4194304] 0 2024-09-18T21:13:08.548 INFO:tasks.workunit.client.0.smithi077.stdout:4/953: mkdir d3/dc/d32/d45/d129 0 2024-09-18T21:13:08.549 INFO:tasks.workunit.client.0.smithi077.stdout:9/864: dread d1/dd/d11/d1c/f31 [0,4194304] 0 2024-09-18T21:13:08.549 INFO:tasks.workunit.client.0.smithi077.stdout:0/996: write d8/d26/f75 [1947802,65747] 0 2024-09-18T21:13:08.551 INFO:tasks.workunit.client.0.smithi077.stdout:2/962: mknod d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d83/dba/dcd/c142 0 2024-09-18T21:13:08.553 INFO:tasks.workunit.client.0.smithi077.stdout:4/954: symlink d3/d77/d9c/l12a 0 2024-09-18T21:13:08.556 INFO:tasks.workunit.client.0.smithi077.stdout:9/865: unlink d1/dd/d11/d1c/d38/d46/d55/d7f/fde 0 2024-09-18T21:13:08.559 INFO:tasks.workunit.client.0.smithi077.stdout:9/866: write d1/dd/d11/d2d/d59/dfc/fbb [60718,52843] 0 2024-09-18T21:13:08.560 INFO:tasks.workunit.client.0.smithi077.stdout:4/955: dwrite d3/d35/db1/f11e [0,4194304] 0 2024-09-18T21:13:08.561 INFO:tasks.workunit.client.0.smithi077.stdout:0/997: rename d8/d37/cd8 to d8/d1a/d35/c14b 0 2024-09-18T21:13:08.575 INFO:tasks.workunit.client.0.smithi077.stdout:4/956: dread d3/dc/d20/f27 [0,4194304] 0 2024-09-18T21:13:08.575 INFO:tasks.workunit.client.0.smithi077.stdout:2/963: write d1/d4/d5/d1a/d2e/f7f [7204236,5754] 0 2024-09-18T21:13:08.579 INFO:tasks.workunit.client.0.smithi077.stdout:0/998: mknod d8/d37/d66/d87/de0/dce/dcf/d122/c14c 0 2024-09-18T21:13:08.588 INFO:tasks.workunit.client.0.smithi077.stdout:9/867: dwrite d1/dd/d11/d1c/d38/d46/d55/d7f/d10c/ff1 [0,4194304] 0 2024-09-18T21:13:08.592 INFO:tasks.workunit.client.0.smithi077.stdout:4/957: dread d3/d7/f11 [0,4194304] 0 2024-09-18T21:13:08.598 INFO:tasks.workunit.client.0.smithi077.stdout:2/964: write d1/d4/d5/d1a/d2e/f37 [925923,120586] 0 2024-09-18T21:13:08.605 INFO:tasks.workunit.client.0.smithi077.stdout:4/958: link d3/d7/d42/fb8 d3/d7/de8/f12b 0 2024-09-18T21:13:08.607 INFO:tasks.workunit.client.0.smithi077.stdout:2/965: fsync d1/d4/d5/d1a/d113/d81/fa8 0 2024-09-18T21:13:08.609 INFO:tasks.workunit.client.0.smithi077.stdout:0/999: dwrite d8/d37/ff1 [4194304,4194304] 0 2024-09-18T21:13:08.609 INFO:tasks.workunit.client.0.smithi077.stdout:4/959: read d3/f26 [1655522,34223] 0 2024-09-18T21:13:08.610 INFO:tasks.workunit.client.0.smithi077.stdout:9/868: truncate d1/dd/d11/d1c/d38/d46/d55/d7f/d10c/ff1 2328935 0 2024-09-18T21:13:08.616 INFO:tasks.workunit.client.0.smithi077.stdout:4/960: dwrite d3/dc/d32/d45/faa [4194304,4194304] 0 2024-09-18T21:13:08.618 INFO:tasks.workunit.client.0.smithi077.stdout:2/966: creat d1/d4/d5/d7d/f143 x:0 0 0 2024-09-18T21:13:08.619 INFO:tasks.workunit.client.0.smithi077.stdout:2/967: stat d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc 0 2024-09-18T21:13:08.624 INFO:tasks.workunit.client.0.smithi077.stdout:9/869: mkdir d1/dd/d11/d1c/d12a 0 2024-09-18T21:13:08.626 INFO:tasks.workunit.client.0.smithi077.stdout:2/968: rename d1/ced to d1/d4/d5/d7d/c144 0 2024-09-18T21:13:08.632 INFO:tasks.workunit.client.0.smithi077.stdout:2/969: rmdir d1/d4/d5/d1a/d2e/d41/d2c/dab 39 2024-09-18T21:13:08.635 INFO:tasks.workunit.client.0.smithi077.stdout:9/870: unlink d1/dd/d11/d1c/dd7/f11a 0 2024-09-18T21:13:08.642 INFO:tasks.workunit.client.0.smithi077.stdout:4/961: dwrite d3/f26 [0,4194304] 0 2024-09-18T21:13:08.643 INFO:tasks.workunit.client.0.smithi077.stdout:2/970: creat d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d8e/f145 x:0 0 0 2024-09-18T21:13:08.648 INFO:tasks.workunit.client.0.smithi077.stdout:2/971: rmdir d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d83 39 2024-09-18T21:13:08.649 INFO:tasks.workunit.client.0.smithi077.stdout:4/962: dread d3/dc/d32/d45/d5e/f84 [0,4194304] 0 2024-09-18T21:13:08.651 INFO:tasks.workunit.client.0.smithi077.stdout:2/972: rmdir d1/d4/d5/d1a/d2e/d7e 39 2024-09-18T21:13:08.655 INFO:tasks.workunit.client.0.smithi077.stdout:4/963: dwrite d3/d77/ff7 [0,4194304] 0 2024-09-18T21:13:08.662 INFO:tasks.workunit.client.0.smithi077.stdout:4/964: dwrite d3/d7/d73/d9f/f122 [0,4194304] 0 2024-09-18T21:13:08.664 INFO:tasks.workunit.client.0.smithi077.stdout:4/965: dread - d3/dc/d51/d53/fb4 zero size 2024-09-18T21:13:08.666 INFO:tasks.workunit.client.0.smithi077.stdout:3/924: sync 2024-09-18T21:13:08.673 INFO:tasks.workunit.client.0.smithi077.stdout:4/966: creat d3/d7/d42/d10b/f12c x:0 0 0 2024-09-18T21:13:08.674 INFO:tasks.workunit.client.0.smithi077.stdout:4/967: chown d3/d7/d6c/f126 53581 1 2024-09-18T21:13:08.676 INFO:tasks.workunit.client.0.smithi077.stdout:3/925: creat db/d14/d32/d49/d6b/d118/f11d x:0 0 0 2024-09-18T21:13:08.679 INFO:tasks.workunit.client.0.smithi077.stdout:4/968: rename d3/d7/d73/f96 to d3/d7/d7b/d88/f12d 0 2024-09-18T21:13:08.680 INFO:tasks.workunit.client.0.smithi077.stdout:4/969: write d3/dc/d32/d5b/f83 [2938878,73516] 0 2024-09-18T21:13:08.686 INFO:tasks.workunit.client.0.smithi077.stdout:4/970: read d3/dc/d32/d5b/fa9 [2240434,85611] 0 2024-09-18T21:13:08.686 INFO:tasks.workunit.client.0.smithi077.stdout:2/973: dwrite d1/d4/d5/d1a/d2e/d41/fc3 [0,4194304] 0 2024-09-18T21:13:08.692 INFO:tasks.workunit.client.0.smithi077.stdout:4/971: truncate d3/d35/db1/ff5 508211 0 2024-09-18T21:13:08.694 INFO:tasks.workunit.client.0.smithi077.stdout:2/974: dread d1/d4/d5/d1a/d2e/f37 [0,4194304] 0 2024-09-18T21:13:08.697 INFO:tasks.workunit.client.0.smithi077.stdout:4/972: creat d3/dc/d51/d53/d89/f12e x:0 0 0 2024-09-18T21:13:08.699 INFO:tasks.workunit.client.0.smithi077.stdout:3/926: dread db/d14/d32/d49/da4/f53 [0,4194304] 0 2024-09-18T21:13:08.701 INFO:tasks.workunit.client.0.smithi077.stdout:2/975: symlink d1/l146 0 2024-09-18T21:13:08.708 INFO:tasks.workunit.client.0.smithi077.stdout:2/976: link d1/d4/d5/d10b/c11b d1/d4/d5/d1a/d2e/d41/d2c/ddb/d106/c147 0 2024-09-18T21:13:08.710 INFO:tasks.workunit.client.0.smithi077.stdout:4/973: dwrite d3/dc/d24/f8e [0,4194304] 0 2024-09-18T21:13:08.716 INFO:tasks.workunit.client.0.smithi077.stdout:2/977: mknod d1/d4/d5/d1a/d2e/d40/c148 0 2024-09-18T21:13:08.719 INFO:tasks.workunit.client.0.smithi077.stdout:3/927: dread db/f28 [0,4194304] 0 2024-09-18T21:13:08.719 INFO:tasks.workunit.client.0.smithi077.stdout:4/974: unlink d3/d77/c2c 0 2024-09-18T21:13:08.720 INFO:tasks.workunit.client.0.smithi077.stdout:3/928: fdatasync db/d14/d22/d36/d39/f47 0 2024-09-18T21:13:08.722 INFO:tasks.workunit.client.0.smithi077.stdout:2/978: symlink d1/d4/l149 0 2024-09-18T21:13:08.728 INFO:tasks.workunit.client.0.smithi077.stdout:4/975: link d3/dc/d24/f78 d3/d7/d42/dd8/f12f 0 2024-09-18T21:13:08.732 INFO:tasks.workunit.client.0.smithi077.stdout:2/979: rmdir d1/d4/d5/d1a/d2e/d7e 39 2024-09-18T21:13:08.733 INFO:tasks.workunit.client.0.smithi077.stdout:4/976: rename d3/dc/d32/fd3 to d3/dc/d32/d45/d5e/f130 0 2024-09-18T21:13:08.738 INFO:tasks.workunit.client.0.smithi077.stdout:2/980: fdatasync d1/d4/d5/d1a/d113/d81/fa5 0 2024-09-18T21:13:08.742 INFO:tasks.workunit.client.0.smithi077.stdout:2/981: write d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d8e/f145 [537357,129920] 0 2024-09-18T21:13:08.742 INFO:tasks.workunit.client.0.smithi077.stdout:3/929: dwrite db/d14/d32/d49/d4e/fba [0,4194304] 0 2024-09-18T21:13:08.746 INFO:tasks.workunit.client.0.smithi077.stdout:3/930: read db/d14/d93/f96 [1531987,111907] 0 2024-09-18T21:13:08.753 INFO:tasks.workunit.client.0.smithi077.stdout:2/982: creat d1/d4/d5/d1a/d2e/d40/d69/f14a x:0 0 0 2024-09-18T21:13:08.754 INFO:tasks.workunit.client.0.smithi077.stdout:4/977: link d3/ccb d3/c131 0 2024-09-18T21:13:08.757 INFO:tasks.workunit.client.0.smithi077.stdout:3/931: creat db/d14/d22/d36/d39/f11e x:0 0 0 2024-09-18T21:13:08.765 INFO:tasks.workunit.client.0.smithi077.stdout:2/983: mknod d1/d4/d5/d1a/d2e/d41/d2c/ddb/c14b 0 2024-09-18T21:13:08.767 INFO:tasks.workunit.client.0.smithi077.stdout:3/932: rmdir db/d14/d32/de9 39 2024-09-18T21:13:08.768 INFO:tasks.workunit.client.0.smithi077.stdout:4/978: fdatasync d3/dc/d20/f27 0 2024-09-18T21:13:08.779 INFO:tasks.workunit.client.0.smithi077.stdout:2/984: rename d1/d4/d5/d1a/d113/d81/dc4/dc0/l110 to d1/d4/d5/d1a/d2e/d7e/d10f/l14c 0 2024-09-18T21:13:08.781 INFO:tasks.workunit.client.0.smithi077.stdout:3/933: write db/d14/d32/d49/da4/d71/f43 [922098,18624] 0 2024-09-18T21:13:08.783 INFO:tasks.workunit.client.0.smithi077.stdout:4/979: write d3/dc/d51/d53/d89/fad [7538551,96261] 0 2024-09-18T21:13:08.790 INFO:tasks.workunit.client.0.smithi077.stdout:3/934: rename db/d14/d22/d36/fc8 to db/d14/d32/de9/f11f 0 2024-09-18T21:13:08.790 INFO:tasks.workunit.client.0.smithi077.stdout:2/985: dwrite d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d83/dba/ddc/dff/f127 [0,4194304] 0 2024-09-18T21:13:08.791 INFO:tasks.workunit.client.0.smithi077.stdout:2/986: chown d1/d4/d5/d1a/d113/c6b 14142 1 2024-09-18T21:13:08.793 INFO:tasks.workunit.client.0.smithi077.stdout:3/935: chown db/d14/d72/l112 22841348 1 2024-09-18T21:13:08.794 INFO:tasks.workunit.client.0.smithi077.stdout:3/936: readlink db/d14/d72/l8e 0 2024-09-18T21:13:08.799 INFO:tasks.workunit.client.0.smithi077.stdout:4/980: dwrite d3/dc/d24/f4a [0,4194304] 0 2024-09-18T21:13:08.806 INFO:tasks.workunit.client.0.smithi077.stdout:2/987: dwrite d1/d4/d5/d1a/d49/fc9 [0,4194304] 0 2024-09-18T21:13:08.809 INFO:tasks.workunit.client.0.smithi077.stdout:3/937: link db/d14/d32/d49/da4/d71/l5f db/d14/d22/d36/dd9/l120 0 2024-09-18T21:13:08.815 INFO:tasks.workunit.client.0.smithi077.stdout:2/988: creat d1/d4/d5/d1a/d2e/d41/d2c/dab/dfc/d83/dba/f14d x:0 0 0 2024-09-18T21:13:08.815 INFO:tasks.workunit.client.0.smithi077.stdout:3/938: symlink db/d14/d32/d49/da4/d71/d3b/df3/l121 0 2024-09-18T21:13:08.816 INFO:tasks.workunit.client.0.smithi077.stdout:3/939: chown db/fd7 134570 1 2024-09-18T21:13:08.820 INFO:tasks.workunit.client.0.smithi077.stdout:3/940: rmdir db/d14/d22/d36/d39/d50 39 2024-09-18T21:13:08.822 INFO:tasks.workunit.client.0.smithi077.stdout:4/981: write d3/dc/d32/f44 [3019487,66469] 0 2024-09-18T21:13:08.830 INFO:tasks.workunit.client.0.smithi077.stdout:4/982: creat d3/dc/d32/d45/d5e/df0/f132 x:0 0 0 2024-09-18T21:13:08.832 INFO:tasks.workunit.client.0.smithi077.stdout:5/992: sync 2024-09-18T21:13:08.832 INFO:tasks.workunit.client.0.smithi077.stdout:8/906: sync 2024-09-18T21:13:08.836 INFO:tasks.workunit.client.0.smithi077.stdout:2/989: dwrite d1/d4/d5/d1a/d113/d81/dc4/fb8 [0,4194304] 0 2024-09-18T21:13:08.838 INFO:tasks.workunit.client.0.smithi077.stdout:5/993: rmdir d0/d43 39 2024-09-18T21:13:08.839 INFO:tasks.workunit.client.0.smithi077.stdout:3/941: dread db/d14/d32/d49/d4e/d6a/f6c [0,4194304] 0 2024-09-18T21:13:08.843 INFO:tasks.workunit.client.0.smithi077.stdout:8/907: read - d2/d5f/da8/d26/faf zero size 2024-09-18T21:13:08.843 INFO:tasks.workunit.client.0.smithi077.stdout:4/983: mkdir d3/d7/d42/dd8/d133 0 2024-09-18T21:13:08.846 INFO:tasks.workunit.client.0.smithi077.stdout:3/942: dread db/d14/d32/d49/da4/f53 [0,4194304] 0 2024-09-18T21:13:08.851 INFO:tasks.workunit.client.0.smithi077.stdout:3/943: rmdir db 39 2024-09-18T21:13:08.851 INFO:tasks.workunit.client.0.smithi077.stdout:8/908: write d2/d27/d29/f9c [4231321,46252] 0 2024-09-18T21:13:08.853 INFO:tasks.workunit.client.0.smithi077.stdout:5/994: creat d0/d6/d3b/d64/f149 x:0 0 0 2024-09-18T21:13:08.853 INFO:tasks.workunit.client.0.smithi077.stdout:2/990: getdents d1/d4/d5/d1a/d113/d81/d122 0 2024-09-18T21:13:08.854 INFO:tasks.workunit.client.0.smithi077.stdout:4/984: creat d3/dc/d32/d45/d5e/df0/d118/f134 x:0 0 0 2024-09-18T21:13:08.856 INFO:tasks.workunit.client.0.smithi077.stdout:8/909: symlink d2/d5f/da8/d4f/d5a/d2a/d67/l145 0 2024-09-18T21:13:08.864 INFO:tasks.workunit.client.0.smithi077.stdout:3/944: rename db/d14/d22/d36/d39/l83 to db/d14/d32/d49/d6b/l122 0 2024-09-18T21:13:08.868 INFO:tasks.workunit.client.0.smithi077.stdout:5/995: dwrite d0/d6/dd/ff7 [0,4194304] 0 2024-09-18T21:13:08.875 INFO:tasks.workunit.client.0.smithi077.stdout:1/860: sync 2024-09-18T21:13:08.875 INFO:tasks.workunit.client.0.smithi077.stdout:6/884: sync 2024-09-18T21:13:08.875 INFO:tasks.workunit.client.0.smithi077.stdout:9/871: sync 2024-09-18T21:13:08.877 INFO:tasks.workunit.client.0.smithi077.stdout:2/991: dread d1/d4/f5f [4194304,4194304] 0 2024-09-18T21:13:08.879 INFO:tasks.workunit.client.0.smithi077.stdout:3/945: rename db/d14/d32/d49/da4/d89/fb3 to db/d14/d90/db2/f123 0 2024-09-18T21:13:08.880 INFO:tasks.workunit.client.0.smithi077.stdout:5/996: truncate d0/df/d10/f9d 1195808 0 2024-09-18T21:13:08.883 INFO:tasks.workunit.client.0.smithi077.stdout:4/985: dwrite d3/dc/d32/f3e [4194304,4194304] 0 2024-09-18T21:13:08.883 INFO:tasks.workunit.client.0.smithi077.stdout:1/861: readlink d3/d6a/d9b/d68/lf9 0 2024-09-18T21:13:08.886 INFO:tasks.workunit.client.0.smithi077.stdout:6/885: fdatasync d7/d7e/d11/fbf 0 2024-09-18T21:13:08.888 INFO:tasks.workunit.client.0.smithi077.stdout:2/992: mkdir d1/d4/d5/d1a/d2e/d40/d14e 0 2024-09-18T21:13:08.897 INFO:tasks.workunit.client.0.smithi077.stdout:4/986: mknod d3/dc/d51/d53/c135 0 2024-09-18T21:13:08.898 INFO:tasks.workunit.client.0.smithi077.stdout:8/910: dread d2/d5f/da8/d4f/d5a/d119/ff4 [0,4194304] 0 2024-09-18T21:13:08.903 INFO:tasks.workunit.client.0.smithi077.stdout:3/946: mknod db/d14/d22/d36/d39/c124 0 2024-09-18T21:13:08.904 INFO:tasks.workunit.client.0.smithi077.stdout:9/872: dread d1/dd/d11/d1c/d38/d46/d55/d9c/fd6 [0,4194304] 0 2024-09-18T21:13:08.905 INFO:tasks.workunit.client.0.smithi077.stdout:5/997: creat d0/d6/dd/da5/d119/d128/f14a x:0 0 0 2024-09-18T21:13:08.912 INFO:tasks.workunit.client.0.smithi077.stdout:6/886: unlink d7/d7e/d11/d3e/d42/dbb/f77 0 2024-09-18T21:13:08.914 INFO:tasks.workunit.client.0.smithi077.stdout:2/993: creat d1/d4/d5/d1a/d2e/d40/d14e/f14f x:0 0 0 2024-09-18T21:13:08.916 INFO:tasks.workunit.client.0.smithi077.stdout:3/947: creat db/d14/d32/d49/da4/d8a/d99/daf/de6/f125 x:0 0 0 2024-09-18T21:13:08.918 INFO:tasks.workunit.client.0.smithi077.stdout:5/998: symlink d0/d6/dd/da5/l14b 0 2024-09-18T21:13:08.919 INFO:tasks.workunit.client.0.smithi077.stdout:5/999: write d0/d6/f48 [1095616,123161] 0 2024-09-18T21:13:08.920 INFO:tasks.workunit.client.0.smithi077.stdout:9/873: rename d1/d54/d51/fd4 to d1/dd/d11/d1c/d38/d46/daf/dc2/f12b 0 2024-09-18T21:13:08.922 INFO:tasks.workunit.client.0.smithi077.stdout:4/987: mknod d3/c136 0 2024-09-18T21:13:08.925 INFO:tasks.workunit.client.0.smithi077.stdout:2/994: creat d1/d4/d5/d1a/d113/d81/d122/d129/f150 x:0 0 0 2024-09-18T21:13:08.926 INFO:tasks.workunit.client.0.smithi077.stdout:4/988: dread d3/dc/d24/f4a [0,4194304] 0 2024-09-18T21:13:08.927 INFO:tasks.workunit.client.0.smithi077.stdout:3/948: mknod db/d14/d32/d49/d4e/d6a/dec/c126 0 2024-09-18T21:13:08.929 INFO:tasks.workunit.client.0.smithi077.stdout:9/874: creat d1/dd/d11/d1c/d38/d46/daf/f12c x:0 0 0 2024-09-18T21:13:08.930 INFO:tasks.workunit.client.0.smithi077.stdout:9/875: write d1/dd/d11/d1c/d38/d46/daf/f12c [390827,9150] 0 2024-09-18T21:13:08.931 INFO:tasks.workunit.client.0.smithi077.stdout:2/995: creat d1/d4/d5/d1a/d113/d81/d122/f151 x:0 0 0 2024-09-18T21:13:08.932 INFO:tasks.workunit.client.0.smithi077.stdout:1/862: link d3/d6a/d9b/l21 d3/d38/l127 0 2024-09-18T21:13:08.934 INFO:tasks.workunit.client.0.smithi077.stdout:3/949: mkdir db/d14/d32/d49/da4/d8a/d99/daf/de6/d127 0 2024-09-18T21:13:08.937 INFO:tasks.workunit.client.0.smithi077.stdout:9/876: truncate d1/d54/d81/f8b 307610 0 2024-09-18T21:13:08.938 INFO:tasks.workunit.client.0.smithi077.stdout:8/911: write d2/d27/d29/d41/dc2/ffb [623946,83550] 0 2024-09-18T21:13:08.941 INFO:tasks.workunit.client.0.smithi077.stdout:3/950: unlink db/ff 0 2024-09-18T21:13:08.941 INFO:tasks.workunit.client.0.smithi077.stdout:8/912: write d2/d5f/da8/d4f/d5a/d2a/d88/fdd [990974,25181] 0 2024-09-18T21:13:08.943 INFO:tasks.workunit.client.0.smithi077.stdout:9/877: truncate d1/d54/f1e 3147539 0 2024-09-18T21:13:08.944 INFO:tasks.workunit.client.0.smithi077.stdout:3/951: truncate db/d14/d32/d49/d4e/d6a/db5/fff 805114 0 2024-09-18T21:13:08.946 INFO:tasks.workunit.client.0.smithi077.stdout:1/863: creat d3/d8/d49/f128 x:0 0 0 2024-09-18T21:13:08.950 INFO:tasks.workunit.client.0.smithi077.stdout:1/864: creat d3/d8/d49/df0/f129 x:0 0 0 2024-09-18T21:13:08.951 INFO:tasks.workunit.client.0.smithi077.stdout:9/878: fsync d1/dd/d11/d1c/d38/d46/f10f 0 2024-09-18T21:13:08.952 INFO:tasks.workunit.client.0.smithi077.stdout:1/865: read d3/d8/d13/f101 [5428290,80375] 0 2024-09-18T21:13:08.954 INFO:tasks.workunit.client.0.smithi077.stdout:8/913: creat d2/d5f/da8/d4f/d5a/d5e/f146 x:0 0 0 2024-09-18T21:13:08.955 INFO:tasks.workunit.client.0.smithi077.stdout:8/914: write d2/d5f/d6f/f95 [1057686,44443] 0 2024-09-18T21:13:08.955 INFO:tasks.workunit.client.0.smithi077.stdout:8/915: chown d2/d5/d6 1 1 2024-09-18T21:13:08.960 INFO:tasks.workunit.client.0.smithi077.stdout:9/879: read d1/dd/d11/d1c/d38/d46/d55/d7f/fe2 [3469629,114327] 0 2024-09-18T21:13:08.960 INFO:tasks.workunit.client.0.smithi077.stdout:1/866: chown d3/d8/d93/dd3/f46 16949693 1 2024-09-18T21:13:08.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:08 smithi077 ceph-mon[27689]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:13:08.962 INFO:tasks.workunit.client.0.smithi077.stdout:6/887: write d7/d7e/d11/fe9 [911416,70178] 0 2024-09-18T21:13:08.964 INFO:tasks.workunit.client.0.smithi077.stdout:1/867: creat d3/d8/d49/d4e/d50/f12a x:0 0 0 2024-09-18T21:13:08.968 INFO:tasks.workunit.client.0.smithi077.stdout:6/888: mknod d7/d7e/d11/d3e/d42/dbb/d49/d55/dc2/d110/c128 0 2024-09-18T21:13:08.969 INFO:tasks.workunit.client.0.smithi077.stdout:6/889: readlink d7/d7e/d11/d3e/d42/dbb/d50/l6d 0 2024-09-18T21:13:08.969 INFO:tasks.workunit.client.0.smithi077.stdout:6/890: stat d7/d7e/l29 0 2024-09-18T21:13:08.974 INFO:tasks.workunit.client.0.smithi077.stdout:1/868: mkdir d3/d8/d75/d89/d103/d12b 0 2024-09-18T21:13:08.984 INFO:tasks.workunit.client.0.smithi077.stdout:4/989: dwrite d3/d7/de8/f12b [0,4194304] 0 2024-09-18T21:13:08.990 INFO:tasks.workunit.client.0.smithi077.stdout:4/990: rename d3/dc/d24/f4a to d3/d7/d7b/d88/f137 0 2024-09-18T21:13:08.992 INFO:tasks.workunit.client.0.smithi077.stdout:4/991: rmdir d3/d7/d42/dd8 39 2024-09-18T21:13:08.993 INFO:tasks.workunit.client.0.smithi077.stdout:4/992: readlink d3/d7/d73/d9f/d11c/l11f 0 2024-09-18T21:13:08.994 INFO:tasks.workunit.client.0.smithi077.stdout:1/869: fsync d3/d8/d49/df0/f129 0 2024-09-18T21:13:08.997 INFO:tasks.workunit.client.0.smithi077.stdout:1/870: creat d3/d6a/d9b/d68/d3e/f12c x:0 0 0 2024-09-18T21:13:08.999 INFO:tasks.workunit.client.0.smithi077.stdout:1/871: write d3/d6a/d9b/d68/d3e/f12c [496343,44421] 0 2024-09-18T21:13:09.001 INFO:tasks.workunit.client.0.smithi077.stdout:1/872: write d3/d8/d49/f128 [312120,93328] 0 2024-09-18T21:13:09.004 INFO:tasks.workunit.client.0.smithi077.stdout:3/952: dwrite db/d14/f34 [0,4194304] 0 2024-09-18T21:13:09.010 INFO:tasks.workunit.client.0.smithi077.stdout:3/953: creat db/d14/d93/db6/dc4/f128 x:0 0 0 2024-09-18T21:13:09.010 INFO:tasks.workunit.client.0.smithi077.stdout:1/873: link d3/d6a/d112/c121 d3/c12d 0 2024-09-18T21:13:09.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:08 smithi103 ceph-mon[34827]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:13:09.014 INFO:tasks.workunit.client.0.smithi077.stdout:1/874: rename d3/d6a/d9b/d4c/fae to d3/d38/d97/f12e 0 2024-09-18T21:13:09.017 INFO:tasks.workunit.client.0.smithi077.stdout:1/875: rename d3/d8/d13/c10d to d3/d38/dd5/c12f 0 2024-09-18T21:13:09.018 INFO:tasks.workunit.client.0.smithi077.stdout:1/876: stat d3/d38/dd5/f6f 0 2024-09-18T21:13:09.024 INFO:tasks.workunit.client.0.smithi077.stdout:9/880: dwrite d1/dd/d11/d1c/d38/d46/d55/dce/d115/f126 [0,4194304] 0 2024-09-18T21:13:09.026 INFO:tasks.workunit.client.0.smithi077.stdout:9/881: chown d1/dd/d11/d1c/d38/d46/d55/f7a 1 1 2024-09-18T21:13:09.030 INFO:tasks.workunit.client.0.smithi077.stdout:9/882: creat d1/dd/d57/f12d x:0 0 0 2024-09-18T21:13:09.033 INFO:tasks.workunit.client.0.smithi077.stdout:9/883: creat d1/dd/d1a/f12e x:0 0 0 2024-09-18T21:13:09.035 INFO:tasks.workunit.client.0.smithi077.stdout:6/891: dwrite d7/d7e/d11/d3e/d42/d88/da4/f26 [0,4194304] 0 2024-09-18T21:13:09.038 INFO:tasks.workunit.client.0.smithi077.stdout:6/892: creat d7/d7e/d11/d3e/d42/dbb/d31/f129 x:0 0 0 2024-09-18T21:13:09.041 INFO:tasks.workunit.client.0.smithi077.stdout:6/893: mknod d7/d7e/d11/d3e/d42/dbb/d5c/d114/c12a 0 2024-09-18T21:13:09.042 INFO:tasks.workunit.client.0.smithi077.stdout:6/894: stat d7/d7e/d11/d3e/d42/dbb/d49/c60 0 2024-09-18T21:13:09.046 INFO:tasks.workunit.client.0.smithi077.stdout:4/993: rmdir d3/dc 39 2024-09-18T21:13:09.062 INFO:tasks.workunit.client.0.smithi077.stdout:3/954: write db/d14/d22/f30 [557174,59246] 0 2024-09-18T21:13:09.063 INFO:tasks.workunit.client.0.smithi077.stdout:1/877: getdents d3/d38/dd5 0 2024-09-18T21:13:09.073 INFO:tasks.workunit.client.0.smithi077.stdout:3/955: truncate db/d14/d72/f91 546474 0 2024-09-18T21:13:09.077 INFO:tasks.workunit.client.0.smithi077.stdout:3/956: rename db/d14/d32/de9/c109 to db/d14/d90/c129 0 2024-09-18T21:13:09.084 INFO:tasks.workunit.client.0.smithi077.stdout:4/994: dread d3/dc/f47 [0,4194304] 0 2024-09-18T21:13:09.089 INFO:tasks.workunit.client.0.smithi077.stdout:3/957: link db/d14/d22/f75 db/d14/d90/db2/f12a 0 2024-09-18T21:13:09.091 INFO:tasks.workunit.client.0.smithi077.stdout:4/995: mknod d3/d7/d73/c138 0 2024-09-18T21:13:09.094 INFO:tasks.workunit.client.0.smithi077.stdout:3/958: rmdir db/d14/d72 39 2024-09-18T21:13:09.103 INFO:tasks.workunit.client.0.smithi077.stdout:9/884: write d1/dd/d11/d1c/d38/d46/f10f [2718391,19200] 0 2024-09-18T21:13:09.111 INFO:tasks.workunit.client.0.smithi077.stdout:6/895: dwrite d7/d7e/f28 [0,4194304] 0 2024-09-18T21:13:09.112 INFO:tasks.workunit.client.0.smithi077.stdout:6/896: chown d7/d7e/d11/d3e/d42/l74 81747 1 2024-09-18T21:13:09.115 INFO:tasks.workunit.client.0.smithi077.stdout:1/878: dread d3/d8/d13/d77/fe4 [0,4194304] 0 2024-09-18T21:13:09.130 INFO:tasks.workunit.client.0.smithi077.stdout:6/897: fsync d7/d7e/d11/d3e/d42/dbb/d4c/f86 0 2024-09-18T21:13:09.130 INFO:tasks.workunit.client.0.smithi077.stdout:1/879: creat d3/d8/d49/df0/f130 x:0 0 0 2024-09-18T21:13:09.130 INFO:tasks.workunit.client.0.smithi077.stdout:1/880: dread - d3/d8/d93/f119 zero size 2024-09-18T21:13:09.131 INFO:tasks.workunit.client.0.smithi077.stdout:1/881: chown d3/d8/d75/d89 9469492 1 2024-09-18T21:13:09.136 INFO:tasks.workunit.client.0.smithi077.stdout:1/882: read d3/d6a/f81 [1577105,121888] 0 2024-09-18T21:13:09.138 INFO:tasks.workunit.client.0.smithi077.stdout:3/959: dwrite db/d14/d32/d49/da4/d71/fe7 [0,4194304] 0 2024-09-18T21:13:09.138 INFO:tasks.workunit.client.0.smithi077.stdout:1/883: fsync d3/d38/d97/f107 0 2024-09-18T21:13:09.139 INFO:tasks.workunit.client.0.smithi077.stdout:3/960: stat db/d14/d32/d49/ca8 0 2024-09-18T21:13:09.144 INFO:tasks.workunit.client.0.smithi077.stdout:1/884: truncate d3/d8/d13/f14 5983449 0 2024-09-18T21:13:09.149 INFO:tasks.workunit.client.0.smithi077.stdout:4/996: truncate d3/d35/db1/f11e 2553620 0 2024-09-18T21:13:09.155 INFO:tasks.workunit.client.0.smithi077.stdout:1/885: getdents d3/d38/d97/dea 0 2024-09-18T21:13:09.158 INFO:tasks.workunit.client.0.smithi077.stdout:1/886: dread - d3/d38/dd5/f114 zero size 2024-09-18T21:13:09.161 INFO:tasks.workunit.client.0.smithi077.stdout:9/885: dwrite d1/dd/d11/d1c/d38/d46/d55/dce/fba [0,4194304] 0 2024-09-18T21:13:09.162 INFO:tasks.workunit.client.0.smithi077.stdout:9/886: chown d1/dd/d11/d1c/d38 14477 1 2024-09-18T21:13:09.163 INFO:tasks.workunit.client.0.smithi077.stdout:1/887: rmdir d3/d6a/d9b/d7f 39 2024-09-18T21:13:09.163 INFO:tasks.workunit.client.0.smithi077.stdout:4/997: link d3/d77/fe6 d3/d7/de8/d112/f139 0 2024-09-18T21:13:09.167 INFO:tasks.workunit.client.0.smithi077.stdout:1/888: chown d3/d8/d93/dd3/f5d 7315 1 2024-09-18T21:13:09.168 INFO:tasks.workunit.client.0.smithi077.stdout:1/889: fdatasync d3/d8/d49/d4e/d50/f10b 0 2024-09-18T21:13:09.173 INFO:tasks.workunit.client.0.smithi077.stdout:9/887: creat d1/dd/d11/d1c/f12f x:0 0 0 2024-09-18T21:13:09.173 INFO:tasks.workunit.client.0.smithi077.stdout:3/961: dread db/d14/d93/fd4 [0,4194304] 0 2024-09-18T21:13:09.174 INFO:tasks.workunit.client.0.smithi077.stdout:1/890: symlink d3/d8/d93/dd3/d99/dfd/l131 0 2024-09-18T21:13:09.176 INFO:tasks.workunit.client.0.smithi077.stdout:3/962: mkdir db/d14/d22/d36/df8/d12b 0 2024-09-18T21:13:09.178 INFO:tasks.workunit.client.0.smithi077.stdout:3/963: symlink db/d14/d32/d49/d4e/l12c 0 2024-09-18T21:13:09.179 INFO:tasks.workunit.client.0.smithi077.stdout:3/964: fdatasync db/fd7 0 2024-09-18T21:13:09.180 INFO:tasks.workunit.client.0.smithi077.stdout:9/888: creat d1/dd/d11/d1c/d38/d46/d55/dce/f130 x:0 0 0 2024-09-18T21:13:09.181 INFO:tasks.workunit.client.0.smithi077.stdout:9/889: chown d1/d54/d81/fca 447745 1 2024-09-18T21:13:09.181 INFO:tasks.workunit.client.0.smithi077.stdout:3/965: chown db/l4a 106 1 2024-09-18T21:13:09.184 INFO:tasks.workunit.client.0.smithi077.stdout:3/966: rmdir db/d14/d22/d36/d39 39 2024-09-18T21:13:09.185 INFO:tasks.workunit.client.0.smithi077.stdout:9/890: dread d1/dd/d1a/d42/fcb [0,4194304] 0 2024-09-18T21:13:09.187 INFO:tasks.workunit.client.0.smithi077.stdout:3/967: creat db/d14/d32/d49/f12d x:0 0 0 2024-09-18T21:13:09.188 INFO:tasks.workunit.client.0.smithi077.stdout:4/998: dread d3/dc/f60 [0,4194304] 0 2024-09-18T21:13:09.192 INFO:tasks.workunit.client.0.smithi077.stdout:9/891: creat d1/d54/d81/f131 x:0 0 0 2024-09-18T21:13:09.195 INFO:tasks.workunit.client.0.smithi077.stdout:3/968: rmdir db/d14/d32/d49/da4/d6d 0 2024-09-18T21:13:09.197 INFO:tasks.workunit.client.0.smithi077.stdout:9/892: rename d1/dd/d11/d1c/d38/d46/d55/d7f/d10c/ff1 to d1/dd/d1a/f132 0 2024-09-18T21:13:09.200 INFO:tasks.workunit.client.0.smithi077.stdout:3/969: read db/d14/d32/d49/d4e/d6a/f52 [4082758,113303] 0 2024-09-18T21:13:09.201 INFO:tasks.workunit.client.0.smithi077.stdout:4/999: dwrite d3/d7/d7b/d88/fca [0,4194304] 0 2024-09-18T21:13:09.201 INFO:tasks.workunit.client.0.smithi077.stdout:9/893: read - d1/dd/d11/d1c/d38/d46/daf/dc2/f12b zero size 2024-09-18T21:13:09.207 INFO:tasks.workunit.client.0.smithi077.stdout:3/970: unlink db/d14/d32/le1 0 2024-09-18T21:13:09.213 INFO:tasks.workunit.client.0.smithi077.stdout:3/971: mkdir db/d14/d32/d87/d9e/d12e 0 2024-09-18T21:13:09.213 INFO:tasks.workunit.client.0.smithi077.stdout:3/972: dread - db/d14/d32/d49/f12d zero size 2024-09-18T21:13:09.218 INFO:tasks.workunit.client.0.smithi077.stdout:3/973: truncate db/d14/d90/db2/f123 4137530 0 2024-09-18T21:13:09.223 INFO:tasks.workunit.client.0.smithi077.stdout:9/894: dwrite d1/d54/fbe [0,4194304] 0 2024-09-18T21:13:09.234 INFO:tasks.workunit.client.0.smithi077.stdout:9/895: rename d1/d54/f5c to d1/d54/d27/f133 0 2024-09-18T21:13:09.237 INFO:tasks.workunit.client.0.smithi077.stdout:3/974: creat db/d14/d32/d49/da4/f12f x:0 0 0 2024-09-18T21:13:09.246 INFO:tasks.workunit.client.0.smithi077.stdout:3/975: dwrite db/d14/d32/d49/da4/d8a/fa7 [0,4194304] 0 2024-09-18T21:13:09.249 INFO:tasks.workunit.client.0.smithi077.stdout:3/976: rmdir db/d14/d32/d87/d9e 39 2024-09-18T21:13:09.253 INFO:tasks.workunit.client.0.smithi077.stdout:3/977: symlink db/d14/d22/d36/d39/l130 0 2024-09-18T21:13:09.254 INFO:tasks.workunit.client.0.smithi077.stdout:9/896: dread d1/dd/f5a [0,4194304] 0 2024-09-18T21:13:09.255 INFO:tasks.workunit.client.0.smithi077.stdout:9/897: stat d1/dd/d11/d1c/d38/d46/d55/d7f/d10c 0 2024-09-18T21:13:09.256 INFO:tasks.workunit.client.0.smithi077.stdout:3/978: truncate db/d14/d22/d36/d39/d50/d5c/fea 3359936 0 2024-09-18T21:13:09.257 INFO:tasks.workunit.client.0.smithi077.stdout:3/979: readlink db/l26 0 2024-09-18T21:13:09.258 INFO:tasks.workunit.client.0.smithi077.stdout:9/898: mknod d1/dd/d11/d1c/d38/d46/d11d/c134 0 2024-09-18T21:13:09.259 INFO:tasks.workunit.client.0.smithi077.stdout:9/899: read - d1/dd/d57/fed zero size 2024-09-18T21:13:09.261 INFO:tasks.workunit.client.0.smithi077.stdout:3/980: rename db/d14/d22/d36/d39/f11e to db/d14/d32/d49/da4/d8a/d99/daf/de6/f131 0 2024-09-18T21:13:09.262 INFO:tasks.workunit.client.0.smithi077.stdout:9/900: mkdir d1/dd/d11/d72/d135 0 2024-09-18T21:13:09.263 INFO:tasks.workunit.client.0.smithi077.stdout:3/981: mkdir db/d14/d22/d36/d132 0 2024-09-18T21:13:09.265 INFO:tasks.workunit.client.0.smithi077.stdout:3/982: rmdir db/d14/d93/db6 39 2024-09-18T21:13:09.265 INFO:tasks.workunit.client.0.smithi077.stdout:9/901: dread d1/dd/d11/d1c/d38/d46/d55/d7f/fd2 [0,4194304] 0 2024-09-18T21:13:09.267 INFO:tasks.workunit.client.0.smithi077.stdout:3/983: creat db/d14/d32/d49/da4/d71/d3b/df3/f133 x:0 0 0 2024-09-18T21:13:09.270 INFO:tasks.workunit.client.0.smithi077.stdout:9/902: mkdir d1/dd/d11/d1c/d38/d46/d55/dce/d115/d136 0 2024-09-18T21:13:09.270 INFO:tasks.workunit.client.0.smithi077.stdout:9/903: stat d1/dd/d11/d1c/d38 0 2024-09-18T21:13:09.271 INFO:tasks.workunit.client.0.smithi077.stdout:9/904: readlink d1/dd/d11/d15/d80/l8d 0 2024-09-18T21:13:09.275 INFO:tasks.workunit.client.0.smithi077.stdout:3/984: getdents db/d14/d32/d49/d6b/d118 0 2024-09-18T21:13:09.276 INFO:tasks.workunit.client.0.smithi077.stdout:9/905: symlink d1/dd/d11/l137 0 2024-09-18T21:13:09.283 INFO:tasks.workunit.client.0.smithi077.stdout:9/906: dwrite d1/dd/f94 [0,4194304] 0 2024-09-18T21:13:09.284 INFO:tasks.workunit.client.0.smithi077.stdout:9/907: chown d1/d54/f6b 2998 1 2024-09-18T21:13:09.289 INFO:tasks.workunit.client.0.smithi077.stdout:9/908: fdatasync d1/d54/d27/fc1 0 2024-09-18T21:13:09.293 INFO:tasks.workunit.client.0.smithi077.stdout:3/985: dread db/d4d/f69 [0,4194304] 0 2024-09-18T21:13:09.295 INFO:tasks.workunit.client.0.smithi077.stdout:9/909: truncate d1/dd/d11/d1c/d38/d46/d55/d7f/fe2 4279048 0 2024-09-18T21:13:09.298 INFO:tasks.workunit.client.0.smithi077.stdout:3/986: unlink db/l4a 0 2024-09-18T21:13:09.304 INFO:tasks.workunit.client.0.smithi077.stdout:3/987: rename db/d14/d32/d49/da4/d8a/d99/daf/de6/cf7 to db/d4d/c134 0 2024-09-18T21:13:09.305 INFO:tasks.workunit.client.0.smithi077.stdout:3/988: fsync db/d14/d22/d36/dd9/f103 0 2024-09-18T21:13:09.310 INFO:tasks.workunit.client.0.smithi077.stdout:9/910: getdents d1/dd/d11/d1c/d38/d46/d55/dce 0 2024-09-18T21:13:09.310 INFO:tasks.workunit.client.0.smithi077.stdout:9/911: chown d1/f7c 1923449 1 2024-09-18T21:13:09.312 INFO:tasks.workunit.client.0.smithi077.stdout:9/912: stat d1/dd/d1a/d42/f5e 0 2024-09-18T21:13:09.313 INFO:tasks.workunit.client.0.smithi077.stdout:3/989: link db/d14/d32/d49/ca8 db/d14/d32/d87/d9e/c135 0 2024-09-18T21:13:09.316 INFO:tasks.workunit.client.0.smithi077.stdout:9/913: read d1/dd/d11/d2d/d59/fab [449183,79361] 0 2024-09-18T21:13:09.317 INFO:tasks.workunit.client.0.smithi077.stdout:9/914: chown d1/dd/d1a/f132 1 1 2024-09-18T21:13:09.319 INFO:tasks.workunit.client.0.smithi077.stdout:9/915: write d1/dd/d11/d1c/d38/d46/d55/d7f/fc3 [1118997,28907] 0 2024-09-18T21:13:09.321 INFO:tasks.workunit.client.0.smithi077.stdout:9/916: fsync d1/dd/d57/f74 0 2024-09-18T21:13:09.326 INFO:tasks.workunit.client.0.smithi077.stdout:9/917: creat d1/dd/d11/d1c/d38/d46/d55/d9c/d114/f138 x:0 0 0 2024-09-18T21:13:09.328 INFO:tasks.workunit.client.0.smithi077.stdout:3/990: dread db/f68 [0,4194304] 0 2024-09-18T21:13:09.330 INFO:tasks.workunit.client.0.smithi077.stdout:9/918: dread d1/dd/d11/d2d/d59/fab [0,4194304] 0 2024-09-18T21:13:09.332 INFO:tasks.workunit.client.0.smithi077.stdout:3/991: rename db/d14/d32/d49/d4e/d6a to db/d14/d32/d49/d4e/d8b/d136 0 2024-09-18T21:13:09.333 INFO:tasks.workunit.client.0.smithi077.stdout:3/992: write db/f54 [1104509,115002] 0 2024-09-18T21:13:09.333 INFO:tasks.workunit.client.0.smithi077.stdout:3/993: readlink db/d14/l21 0 2024-09-18T21:13:09.341 INFO:tasks.workunit.client.0.smithi077.stdout:3/994: rename db/d14/d32/d49/d4e/d8b/d136/cca to db/d14/d22/d36/d39/d50/d5c/c137 0 2024-09-18T21:13:09.344 INFO:tasks.workunit.client.0.smithi077.stdout:9/919: dwrite d1/dd/d11/d1c/d38/d46/d55/f102 [0,4194304] 0 2024-09-18T21:13:09.348 INFO:tasks.workunit.client.0.smithi077.stdout:3/995: getdents db/d14/d32/d49/d6b/d10b 0 2024-09-18T21:13:09.350 INFO:tasks.workunit.client.0.smithi077.stdout:9/920: mknod d1/c139 0 2024-09-18T21:13:09.351 INFO:tasks.workunit.client.0.smithi077.stdout:9/921: rename d1/dd/d11/d15/d80/d85 to d1/dd/d11/d15/d80/d85/d13a 22 2024-09-18T21:13:09.352 INFO:tasks.workunit.client.0.smithi077.stdout:3/996: symlink db/d14/d32/d87/d9e/d12e/l138 0 2024-09-18T21:13:09.353 INFO:tasks.workunit.client.0.smithi077.stdout:9/922: write d1/dd/d11/d1c/d38/d46/daf/fd5 [659927,99018] 0 2024-09-18T21:13:09.355 INFO:tasks.workunit.client.0.smithi077.stdout:9/923: write d1/dd/d57/f11b [630321,305] 0 2024-09-18T21:13:09.357 INFO:tasks.workunit.client.0.smithi077.stdout:3/997: getdents db/d14/d32/d49/da4/d8a/d99/daf 0 2024-09-18T21:13:09.359 INFO:tasks.workunit.client.0.smithi077.stdout:9/924: rename d1/dd/d11/d1c/d38/d46/c4f to d1/d54/d27/c13b 0 2024-09-18T21:13:09.360 INFO:tasks.workunit.client.0.smithi077.stdout:3/998: creat db/d14/d32/d49/da4/d89/f139 x:0 0 0 2024-09-18T21:13:09.361 INFO:tasks.workunit.client.0.smithi077.stdout:9/925: unlink d1/d54/c117 0 2024-09-18T21:13:09.361 INFO:tasks.workunit.client.0.smithi077.stdout:9/926: chown d1/d54/d8f/c11f 167 1 2024-09-18T21:13:09.363 INFO:tasks.workunit.client.0.smithi077.stdout:9/927: chown d1/dd/d11/d1c/d38/d46/daf 2 1 2024-09-18T21:13:09.364 INFO:tasks.workunit.client.0.smithi077.stdout:9/928: fdatasync d1/d54/d27/f39 0 2024-09-18T21:13:09.364 INFO:tasks.workunit.client.0.smithi077.stdout:3/999: getdents db/d14/d72 0 2024-09-18T21:13:09.366 INFO:tasks.workunit.client.0.smithi077.stdout:9/929: mkdir d1/dd/d11/d1c/d38/d46/d55/d7f/d10c/d13c 0 2024-09-18T21:13:09.367 INFO:tasks.workunit.client.0.smithi077.stdout:9/930: chown d1/d54/ce7 696 1 2024-09-18T21:13:09.368 INFO:tasks.workunit.client.0.smithi077.stdout:9/931: creat d1/dd/d11/d1c/dd7/f13d x:0 0 0 2024-09-18T21:13:09.369 INFO:tasks.workunit.client.0.smithi077.stdout:9/932: dread - d1/dd/d11/d15/d80/d85/de9/f122 zero size 2024-09-18T21:13:09.371 INFO:tasks.workunit.client.0.smithi077.stdout:9/933: mknod d1/dd/d11/d1c/d38/d46/d55/d9c/c13e 0 2024-09-18T21:13:09.371 INFO:tasks.workunit.client.0.smithi077.stdout:9/934: chown d1/f49 2712 1 2024-09-18T21:13:09.373 INFO:tasks.workunit.client.0.smithi077.stdout:9/935: mknod d1/dd/d11/d2d/d79/c13f 0 2024-09-18T21:13:09.374 INFO:tasks.workunit.client.0.smithi077.stdout:9/936: truncate d1/d54/fd3 452625 0 2024-09-18T21:13:09.381 INFO:tasks.workunit.client.0.smithi077.stdout:9/937: write d1/feb [483509,18099] 0 2024-09-18T21:13:09.389 INFO:tasks.workunit.client.0.smithi077.stdout:9/938: dwrite d1/dd/d11/d1c/d38/d46/fac [0,4194304] 0 2024-09-18T21:13:09.390 INFO:tasks.workunit.client.0.smithi077.stdout:9/939: rmdir d1 39 2024-09-18T21:13:09.394 INFO:tasks.workunit.client.0.smithi077.stdout:9/940: creat d1/dd/d11/d72/d135/f140 x:0 0 0 2024-09-18T21:13:09.400 INFO:tasks.workunit.client.0.smithi077.stdout:9/941: dwrite d1/dd/d11/d1c/d38/f107 [0,4194304] 0 2024-09-18T21:13:09.404 INFO:tasks.workunit.client.0.smithi077.stdout:9/942: symlink d1/dd/d11/d1c/d38/dae/l141 0 2024-09-18T21:13:09.404 INFO:tasks.workunit.client.0.smithi077.stdout:9/943: readlink d1/dd/d11/d15/d80/l8d 0 2024-09-18T21:13:09.412 INFO:tasks.workunit.client.0.smithi077.stdout:9/944: write d1/dd/d11/d15/d80/f91 [1988325,95487] 0 2024-09-18T21:13:09.413 INFO:tasks.workunit.client.0.smithi077.stdout:9/945: chown d1/dd/d11/d1c/d38/d46/d55/d7f/d10c/d13c 115 1 2024-09-18T21:13:09.414 INFO:tasks.workunit.client.0.smithi077.stdout:9/946: chown d1/dd/d11/d1c/d38/d46/d55/dce/fba 735033 1 2024-09-18T21:13:09.418 INFO:tasks.workunit.client.0.smithi077.stdout:9/947: rename d1/d54/d51/c100 to d1/dd/d11/d1c/dd7/c142 0 2024-09-18T21:13:09.419 INFO:tasks.workunit.client.0.smithi077.stdout:9/948: mknod d1/dd/d11/d2d/d59/dfc/c143 0 2024-09-18T21:13:09.430 INFO:tasks.workunit.client.0.smithi077.stdout:9/949: dwrite d1/d54/d27/fc1 [0,4194304] 0 2024-09-18T21:13:09.432 INFO:tasks.workunit.client.0.smithi077.stdout:9/950: write d1/dd/d11/d1c/d38/d46/d55/dce/f125 [351975,5180] 0 2024-09-18T21:13:09.435 INFO:tasks.workunit.client.0.smithi077.stdout:9/951: symlink d1/dd/d11/d1c/dd7/l144 0 2024-09-18T21:13:09.445 INFO:tasks.workunit.client.0.smithi077.stdout:9/952: fdatasync d1/d54/f3b 0 2024-09-18T21:13:09.446 INFO:tasks.workunit.client.0.smithi077.stdout:9/953: write d1/dd/d11/d15/d80/f91 [296266,40870] 0 2024-09-18T21:13:09.452 INFO:tasks.workunit.client.0.smithi077.stdout:9/954: dwrite d1/dd/f94 [0,4194304] 0 2024-09-18T21:13:09.474 INFO:tasks.workunit.client.0.smithi077.stdout:9/955: unlink d1/dd/d11/d1c/d38/d46/f10f 0 2024-09-18T21:13:09.477 INFO:tasks.workunit.client.0.smithi077.stdout:9/956: truncate d1/dd/f5d 2077756 0 2024-09-18T21:13:09.480 INFO:tasks.workunit.client.0.smithi077.stdout:9/957: creat d1/f145 x:0 0 0 2024-09-18T21:13:09.482 INFO:tasks.workunit.client.0.smithi077.stdout:9/958: chown d1/dd/d11/d1c/d38/d46/d55/dce/fba 8198093 1 2024-09-18T21:13:09.484 INFO:tasks.workunit.client.0.smithi077.stdout:9/959: symlink d1/dd/d11/d15/l146 0 2024-09-18T21:13:09.498 INFO:tasks.workunit.client.0.smithi077.stdout:9/960: dread d1/dd/d11/d1c/d38/d46/d55/dce/fc9 [0,4194304] 0 2024-09-18T21:13:09.503 INFO:tasks.workunit.client.0.smithi077.stdout:9/961: getdents d1/dd/d11/d1c/d38/d46/d55/d9c 0 2024-09-18T21:13:09.513 INFO:tasks.workunit.client.0.smithi077.stdout:9/962: truncate d1/dd/d11/d1c/d38/f107 4821959 0 2024-09-18T21:13:09.524 INFO:tasks.workunit.client.0.smithi077.stdout:9/963: dread d1/dd/d11/d2d/f56 [0,4194304] 0 2024-09-18T21:13:09.834 INFO:tasks.workunit.client.0.smithi077.stdout:2/996: sync 2024-09-18T21:13:09.840 INFO:tasks.workunit.client.0.smithi077.stdout:2/997: fdatasync d1/d4/d9/d4f/ff0 0 2024-09-18T21:13:09.842 INFO:tasks.workunit.client.0.smithi077.stdout:2/998: mknod d1/d4/d5/d1a/d113/d81/c152 0 2024-09-18T21:13:09.848 INFO:tasks.workunit.client.0.smithi077.stdout:2/999: dread d1/f2a [0,4194304] 0 2024-09-18T21:13:09.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:09 smithi077 ceph-mon[27689]: pgmap v26: 65 pgs: 65 active+clean; 3.9 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 122 MiB/s rd, 271 MiB/s wr, 660 op/s 2024-09-18T21:13:10.016 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:09 smithi103 ceph-mon[34827]: pgmap v26: 65 pgs: 65 active+clean; 3.9 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 122 MiB/s rd, 271 MiB/s wr, 660 op/s 2024-09-18T21:13:10.043 INFO:tasks.workunit.client.0.smithi077.stdout:8/916: sync 2024-09-18T21:13:10.046 INFO:tasks.workunit.client.0.smithi077.stdout:8/917: unlink d2/d5f/da8/d26/f32 0 2024-09-18T21:13:10.047 INFO:tasks.workunit.client.0.smithi077.stdout:8/918: chown d2/d27/d29/d41/f45 20745 1 2024-09-18T21:13:10.048 INFO:tasks.workunit.client.0.smithi077.stdout:8/919: rmdir d2/d5f/da8/d20 39 2024-09-18T21:13:10.049 INFO:tasks.workunit.client.0.smithi077.stdout:8/920: truncate d2/f125 586690 0 2024-09-18T21:13:10.052 INFO:tasks.workunit.client.0.smithi077.stdout:8/921: mknod d2/d5/d6/d7e/c147 0 2024-09-18T21:13:10.060 INFO:tasks.workunit.client.0.smithi077.stdout:8/922: rename d2/d5f/da8/d4f/d5a/d2a/d88/c13e to d2/d5f/def/c148 0 2024-09-18T21:13:10.069 INFO:tasks.workunit.client.0.smithi077.stdout:8/923: write d2/d5f/da8/d26/fcd [1089568,111739] 0 2024-09-18T21:13:10.072 INFO:tasks.workunit.client.0.smithi077.stdout:8/924: mknod d2/d27/d29/d41/dbc/dce/d122/c149 0 2024-09-18T21:13:10.074 INFO:tasks.workunit.client.0.smithi077.stdout:8/925: symlink d2/d27/d29/d41/dbc/dce/d122/l14a 0 2024-09-18T21:13:10.076 INFO:tasks.workunit.client.0.smithi077.stdout:8/926: write d2/d5f/da8/d4f/f69 [4004205,5063] 0 2024-09-18T21:13:10.079 INFO:tasks.workunit.client.0.smithi077.stdout:9/964: sync 2024-09-18T21:13:10.080 INFO:tasks.workunit.client.0.smithi077.stdout:1/891: sync 2024-09-18T21:13:10.080 INFO:tasks.workunit.client.0.smithi077.stdout:6/898: sync 2024-09-18T21:13:10.081 INFO:tasks.workunit.client.0.smithi077.stdout:8/927: fdatasync d2/d5f/def/f117 0 2024-09-18T21:13:10.083 INFO:tasks.workunit.client.0.smithi077.stdout:9/965: dread - d1/d54/d27/fdc zero size 2024-09-18T21:13:10.086 INFO:tasks.workunit.client.0.smithi077.stdout:6/899: mknod d7/d7e/d11/d3e/d42/dbb/d4c/c12b 0 2024-09-18T21:13:10.087 INFO:tasks.workunit.client.0.smithi077.stdout:6/900: chown d7/d7e/d11/d3e/d42/dbb/d5c/f91 5861814 1 2024-09-18T21:13:10.088 INFO:tasks.workunit.client.0.smithi077.stdout:8/928: truncate d2/d5f/da8/d20/fa1 1100082 0 2024-09-18T21:13:10.088 INFO:tasks.workunit.client.0.smithi077.stdout:9/966: symlink d1/d54/d51/l147 0 2024-09-18T21:13:10.088 INFO:tasks.workunit.client.0.smithi077.stdout:8/929: stat d2/d27/d101 0 2024-09-18T21:13:10.090 INFO:tasks.workunit.client.0.smithi077.stdout:8/930: chown d2/d5f/da8/d4f/d5a/d2a/d67/l145 116 1 2024-09-18T21:13:10.091 INFO:tasks.workunit.client.0.smithi077.stdout:6/901: fsync d7/d7e/d11/d3e/d42/dbb/d31/f71 0 2024-09-18T21:13:10.093 INFO:tasks.workunit.client.0.smithi077.stdout:8/931: write d2/d5f/da8/d4f/d5a/d2a/d67/f73 [2760693,51645] 0 2024-09-18T21:13:10.094 INFO:tasks.workunit.client.0.smithi077.stdout:9/967: unlink d1/dd/d11/fad 0 2024-09-18T21:13:10.095 INFO:tasks.workunit.client.0.smithi077.stdout:1/892: write d3/d8/d13/f14 [1860109,88345] 0 2024-09-18T21:13:10.096 INFO:tasks.workunit.client.0.smithi077.stdout:1/893: chown d3/d6a/d9b/d68 5431 1 2024-09-18T21:13:10.098 INFO:tasks.workunit.client.0.smithi077.stdout:8/932: creat d2/d5f/d7a/f14b x:0 0 0 2024-09-18T21:13:10.099 INFO:tasks.workunit.client.0.smithi077.stdout:8/933: dread - d2/d5f/def/f117 zero size 2024-09-18T21:13:10.100 INFO:tasks.workunit.client.0.smithi077.stdout:9/968: chown d1/dd/d11/d1c/d38/d46/d55/dce/lf6 4 1 2024-09-18T21:13:10.100 INFO:tasks.workunit.client.0.smithi077.stdout:6/902: creat d7/d7e/d11/d9a/d11a/f12c x:0 0 0 2024-09-18T21:13:10.102 INFO:tasks.workunit.client.0.smithi077.stdout:8/934: rmdir d2/d5f/da8/d20 39 2024-09-18T21:13:10.105 INFO:tasks.workunit.client.0.smithi077.stdout:9/969: mkdir d1/dd/d11/d1c/d38/d46/d55/dce/d115/d148 0 2024-09-18T21:13:10.105 INFO:tasks.workunit.client.0.smithi077.stdout:9/970: stat d1/dd/d1a/fec 0 2024-09-18T21:13:10.106 INFO:tasks.workunit.client.0.smithi077.stdout:9/971: stat d1/dd/d11/d1c/d38/lfe 0 2024-09-18T21:13:10.107 INFO:tasks.workunit.client.0.smithi077.stdout:9/972: fdatasync d1/dd/d1a/f12e 0 2024-09-18T21:13:10.109 INFO:tasks.workunit.client.0.smithi077.stdout:1/894: write d3/d38/d97/f12e [1705557,29200] 0 2024-09-18T21:13:10.110 INFO:tasks.workunit.client.0.smithi077.stdout:9/973: symlink d1/dd/d11/d1c/d38/dae/l149 0 2024-09-18T21:13:10.112 INFO:tasks.workunit.client.0.smithi077.stdout:6/903: write d7/d7e/d11/d3e/d42/dbb/d49/d55/f59 [4410470,53201] 0 2024-09-18T21:13:10.117 INFO:tasks.workunit.client.0.smithi077.stdout:6/904: dread d7/d7e/d11/d3e/d42/d88/da4/f47 [0,4194304] 0 2024-09-18T21:13:10.117 INFO:tasks.workunit.client.0.smithi077.stdout:1/895: dwrite d3/d8/d49/d4e/d5a/f78 [0,4194304] 0 2024-09-18T21:13:10.118 INFO:tasks.workunit.client.0.smithi077.stdout:9/974: write d1/d54/f21 [4358150,55039] 0 2024-09-18T21:13:10.123 INFO:tasks.workunit.client.0.smithi077.stdout:6/905: creat d7/d7e/d11/d3e/d42/d88/da4/f12d x:0 0 0 2024-09-18T21:13:10.124 INFO:tasks.workunit.client.0.smithi077.stdout:6/906: stat d7/d7e/d11/d3e/dcd/fd3 0 2024-09-18T21:13:10.126 INFO:tasks.workunit.client.0.smithi077.stdout:1/896: getdents d3/d8/d93/dd3/d99/de8 0 2024-09-18T21:13:10.127 INFO:tasks.workunit.client.0.smithi077.stdout:9/975: dread d1/dd/f127 [0,4194304] 0 2024-09-18T21:13:10.130 INFO:tasks.workunit.client.0.smithi077.stdout:6/907: mkdir d7/d7e/d11/d3e/d42/dbb/d50/d12e 0 2024-09-18T21:13:10.131 INFO:tasks.workunit.client.0.smithi077.stdout:1/897: creat d3/d8/d75/d89/f132 x:0 0 0 2024-09-18T21:13:10.133 INFO:tasks.workunit.client.0.smithi077.stdout:9/976: mknod d1/dd/d11/d2d/d59/c14a 0 2024-09-18T21:13:10.135 INFO:tasks.workunit.client.0.smithi077.stdout:6/908: creat d7/d7e/d11/d9a/d11a/f12f x:0 0 0 2024-09-18T21:13:10.137 INFO:tasks.workunit.client.0.smithi077.stdout:6/909: stat d7/d7e/d11/d3e/d42/dbb/d49/d55/f68 0 2024-09-18T21:13:10.139 INFO:tasks.workunit.client.0.smithi077.stdout:6/910: rmdir d7/d7e/d11/d3e/dcd/df7 39 2024-09-18T21:13:10.140 INFO:tasks.workunit.client.0.smithi077.stdout:9/977: dwrite d1/feb [0,4194304] 0 2024-09-18T21:13:10.147 INFO:tasks.workunit.client.0.smithi077.stdout:6/911: chown d7/d7e/d11/d3e/d42/dbb/l48 27658470 1 2024-09-18T21:13:10.148 INFO:tasks.workunit.client.0.smithi077.stdout:6/912: write d7/d7e/d11/d9a/d11a/f12f [417367,130279] 0 2024-09-18T21:13:10.151 INFO:tasks.workunit.client.0.smithi077.stdout:9/978: creat d1/dd/d11/d1c/d38/d46/d55/d9c/d114/d121/f14b x:0 0 0 2024-09-18T21:13:10.156 INFO:tasks.workunit.client.0.smithi077.stdout:9/979: dread - d1/dd/d11/d2d/d59/dfc/f110 zero size 2024-09-18T21:13:10.157 INFO:tasks.workunit.client.0.smithi077.stdout:6/913: rmdir d7/d7e/d11/d3e/d42/dbb/d50/d12e 0 2024-09-18T21:13:10.159 INFO:tasks.workunit.client.0.smithi077.stdout:1/898: dwrite d3/d8/d75/d89/dbb/fcf [0,4194304] 0 2024-09-18T21:13:10.162 INFO:tasks.workunit.client.0.smithi077.stdout:6/914: rename d7/d7e/f1e to d7/d7e/d11/d3e/d42/dbb/d31/f130 0 2024-09-18T21:13:10.168 INFO:tasks.workunit.client.0.smithi077.stdout:6/915: mknod d7/d7e/d11/d3e/d42/dbb/d50/dd5/c131 0 2024-09-18T21:13:10.169 INFO:tasks.workunit.client.0.smithi077.stdout:6/916: dread - d7/d7e/da6/de1/f126 zero size 2024-09-18T21:13:10.169 INFO:tasks.workunit.client.0.smithi077.stdout:6/917: chown d7/d7e/f14 621006 1 2024-09-18T21:13:10.171 INFO:tasks.workunit.client.0.smithi077.stdout:1/899: mkdir d3/d8/d49/d133 0 2024-09-18T21:13:10.178 INFO:tasks.workunit.client.0.smithi077.stdout:1/900: creat d3/d6a/d9b/d7f/f134 x:0 0 0 2024-09-18T21:13:10.179 INFO:tasks.workunit.client.0.smithi077.stdout:9/980: dwrite d1/dd/d11/d1c/d38/f107 [0,4194304] 0 2024-09-18T21:13:10.187 INFO:tasks.workunit.client.0.smithi077.stdout:9/981: mknod d1/dd/d11/d1c/d38/d46/d55/dce/c14c 0 2024-09-18T21:13:10.190 INFO:tasks.workunit.client.0.smithi077.stdout:9/982: fdatasync d1/dd/d11/f83 0 2024-09-18T21:13:10.194 INFO:tasks.workunit.client.0.smithi077.stdout:6/918: dread d7/d7e/d11/d3e/f78 [0,4194304] 0 2024-09-18T21:13:10.198 INFO:tasks.workunit.client.0.smithi077.stdout:1/901: dwrite d3/d8/d49/df0/ff7 [0,4194304] 0 2024-09-18T21:13:10.202 INFO:tasks.workunit.client.0.smithi077.stdout:9/983: write d1/dd/d11/d1c/d38/d46/f60 [3245981,99671] 0 2024-09-18T21:13:10.205 INFO:tasks.workunit.client.0.smithi077.stdout:9/984: write d1/dd/d11/d1c/d38/d46/d55/d7f/fb3 [106036,130357] 0 2024-09-18T21:13:10.205 INFO:tasks.workunit.client.0.smithi077.stdout:1/902: getdents d3/d8/d49/d133 0 2024-09-18T21:13:10.207 INFO:tasks.workunit.client.0.smithi077.stdout:6/919: rename d7/d7e/d11/d3e/d42/dbb/d31/fb4 to d7/d7e/d11/d3e/d42/dbb/f132 0 2024-09-18T21:13:10.210 INFO:tasks.workunit.client.0.smithi077.stdout:9/985: unlink d1/dd/d11/d1c/d38/d46/d55/d7f/d10c/f101 0 2024-09-18T21:13:10.211 INFO:tasks.workunit.client.0.smithi077.stdout:1/903: rename d3/d8/d49/d4e/d50/f11a to d3/d6a/d112/f135 0 2024-09-18T21:13:10.214 INFO:tasks.workunit.client.0.smithi077.stdout:9/986: truncate d1/f49 2243301 0 2024-09-18T21:13:10.215 INFO:tasks.workunit.client.0.smithi077.stdout:1/904: mknod d3/d8/d49/d4e/d5a/c136 0 2024-09-18T21:13:10.217 INFO:tasks.workunit.client.0.smithi077.stdout:6/920: fsync d7/d7e/d11/f9e 0 2024-09-18T21:13:10.221 INFO:tasks.workunit.client.0.smithi077.stdout:9/987: dwrite d1/dd/d11/d1c/f12f [0,4194304] 0 2024-09-18T21:13:10.225 INFO:tasks.workunit.client.0.smithi077.stdout:9/988: fsync d1/dd/d11/d1c/d38/d46/d55/d7f/fb3 0 2024-09-18T21:13:10.226 INFO:tasks.workunit.client.0.smithi077.stdout:1/905: creat d3/d8/d93/dd3/f137 x:0 0 0 2024-09-18T21:13:10.227 INFO:tasks.workunit.client.0.smithi077.stdout:1/906: chown d3/d8/f105 120 1 2024-09-18T21:13:10.229 INFO:tasks.workunit.client.0.smithi077.stdout:9/989: unlink d1/d54/f6b 0 2024-09-18T21:13:10.233 INFO:tasks.workunit.client.0.smithi077.stdout:9/990: dread d1/dd/d11/d1c/d38/d46/daf/f12c [0,4194304] 0 2024-09-18T21:13:10.234 INFO:tasks.workunit.client.0.smithi077.stdout:1/907: fdatasync d3/d8/d93/dd3/f83 0 2024-09-18T21:13:10.244 INFO:tasks.workunit.client.0.smithi077.stdout:9/991: dwrite d1/d54/fd3 [0,4194304] 0 2024-09-18T21:13:10.251 INFO:tasks.workunit.client.0.smithi077.stdout:9/992: dwrite d1/d54/fcf [0,4194304] 0 2024-09-18T21:13:10.253 INFO:tasks.workunit.client.0.smithi077.stdout:9/993: chown d1/d54/d81/f8b 206493 1 2024-09-18T21:13:10.254 INFO:tasks.workunit.client.0.smithi077.stdout:1/908: dwrite d3/d8/d49/d4e/d5a/fff [4194304,4194304] 0 2024-09-18T21:13:10.261 INFO:tasks.workunit.client.0.smithi077.stdout:9/994: unlink d1/d54/d27/l3a 0 2024-09-18T21:13:10.263 INFO:tasks.workunit.client.0.smithi077.stdout:9/995: dread - d1/d54/d8f/f109 zero size 2024-09-18T21:13:10.263 INFO:tasks.workunit.client.0.smithi077.stdout:1/909: getdents d3/d6a/d9b/dbe 0 2024-09-18T21:13:10.265 INFO:tasks.workunit.client.0.smithi077.stdout:9/996: fdatasync d1/dd/f5a 0 2024-09-18T21:13:10.268 INFO:tasks.workunit.client.0.smithi077.stdout:1/910: rename d3/d8/d93/dd3/f74 to d3/d38/dd5/da5/f138 0 2024-09-18T21:13:10.272 INFO:tasks.workunit.client.0.smithi077.stdout:1/911: symlink d3/d8/d13/l139 0 2024-09-18T21:13:10.277 INFO:tasks.workunit.client.0.smithi077.stdout:1/912: truncate d3/d8/d13/f2b 1618113 0 2024-09-18T21:13:10.287 INFO:tasks.workunit.client.0.smithi077.stdout:9/997: write d1/dd/d1a/d42/fcb [971624,15560] 0 2024-09-18T21:13:10.290 INFO:tasks.workunit.client.0.smithi077.stdout:9/998: mknod d1/dd/d11/d1c/d38/d46/d55/d9c/d114/c14d 0 2024-09-18T21:13:10.290 INFO:tasks.workunit.client.0.smithi077.stdout:9/999: readlink d1/dd/d11/l29 0 2024-09-18T21:13:10.295 INFO:tasks.workunit.client.0.smithi077.stdout:1/913: dwrite d3/d38/dd5/da5/f138 [0,4194304] 0 2024-09-18T21:13:10.307 INFO:tasks.workunit.client.0.smithi077.stdout:1/914: dwrite d3/f2a [0,4194304] 0 2024-09-18T21:13:10.310 INFO:tasks.workunit.client.0.smithi077.stdout:1/915: creat d3/d38/dd5/f13a x:0 0 0 2024-09-18T21:13:10.313 INFO:tasks.workunit.client.0.smithi077.stdout:1/916: mknod d3/d8/d49/d133/c13b 0 2024-09-18T21:13:10.321 INFO:tasks.workunit.client.0.smithi077.stdout:1/917: link d3/d8/d93/dd3/d99/de8/f96 d3/d8/d13/d77/f13c 0 2024-09-18T21:13:10.602 INFO:tasks.workunit.client.0.smithi077.stdout:8/935: sync 2024-09-18T21:13:10.604 INFO:tasks.workunit.client.0.smithi077.stdout:8/936: symlink d2/d5f/da8/d26/l14c 0 2024-09-18T21:13:10.608 INFO:tasks.workunit.client.0.smithi077.stdout:8/937: creat d2/d5f/da8/d20/d3e/f14d x:0 0 0 2024-09-18T21:13:10.629 INFO:tasks.workunit.client.0.smithi077.stdout:8/938: write d2/d5/d6/fac [2550159,96609] 0 2024-09-18T21:13:10.630 INFO:tasks.workunit.client.0.smithi077.stdout:8/939: stat d2/d27/d29/d41/d13d 0 2024-09-18T21:13:10.633 INFO:tasks.workunit.client.0.smithi077.stdout:8/940: fdatasync d2/d5f/da8/d4f/d5a/d5e/f83 0 2024-09-18T21:13:10.637 INFO:tasks.workunit.client.0.smithi077.stdout:8/941: creat d2/d5f/d6f/d105/f14e x:0 0 0 2024-09-18T21:13:10.638 INFO:tasks.workunit.client.0.smithi077.stdout:8/942: chown d2/d27/d29/d72/d81/cee 1994 1 2024-09-18T21:13:10.640 INFO:tasks.workunit.client.0.smithi077.stdout:8/943: rmdir d2/d5f/da8 39 2024-09-18T21:13:10.645 INFO:tasks.workunit.client.0.smithi077.stdout:8/944: dwrite d2/d27/d29/f58 [0,4194304] 0 2024-09-18T21:13:10.652 INFO:tasks.workunit.client.0.smithi077.stdout:8/945: creat d2/d5/f14f x:0 0 0 2024-09-18T21:13:10.653 INFO:tasks.workunit.client.0.smithi077.stdout:8/946: fdatasync d2/d5f/def/f117 0 2024-09-18T21:13:10.657 INFO:tasks.workunit.client.0.smithi077.stdout:8/947: rmdir d2/d5f/da8/d4f/d5a/d12b 39 2024-09-18T21:13:10.661 INFO:tasks.workunit.client.0.smithi077.stdout:8/948: creat d2/d5f/d6f/f150 x:0 0 0 2024-09-18T21:13:10.666 INFO:tasks.workunit.client.0.smithi077.stdout:8/949: unlink d2/d5f/da8/d4f/d5a/d2a/d67/c116 0 2024-09-18T21:13:10.678 INFO:tasks.workunit.client.0.smithi077.stdout:8/950: dwrite d2/d5f/da8/d4f/fcc [0,4194304] 0 2024-09-18T21:13:10.682 INFO:tasks.workunit.client.0.smithi077.stdout:8/951: symlink d2/d5f/da8/d4f/d5a/d2a/dc8/df1/l151 0 2024-09-18T21:13:10.684 INFO:tasks.workunit.client.0.smithi077.stdout:8/952: read d2/d5f/da8/d4f/f69 [3240846,89824] 0 2024-09-18T21:13:10.684 INFO:tasks.workunit.client.0.smithi077.stdout:8/953: fsync d2/d5/d6/f14 0 2024-09-18T21:13:10.686 INFO:tasks.workunit.client.0.smithi077.stdout:8/954: fsync d2/d5f/da8/d4f/d5a/d2a/dc8/df1/d11d/da6/d110/fc5 0 2024-09-18T21:13:10.688 INFO:tasks.workunit.client.0.smithi077.stdout:8/955: rmdir d2/d27 39 2024-09-18T21:13:10.690 INFO:tasks.workunit.client.0.smithi077.stdout:8/956: chown d2/d5f/da8/d4f/d5a/d2a/dc8/df1/d11d/da4/df8/l130 19485 1 2024-09-18T21:13:10.693 INFO:tasks.workunit.client.0.smithi077.stdout:8/957: fdatasync d2/d5f/da8/d20/fe2 0 2024-09-18T21:13:10.699 INFO:tasks.workunit.client.0.smithi077.stdout:8/958: rename d2/d5f/da8/d4f/d5a/d5e/cab to d2/d5f/da8/d4f/d5a/d5e/d8f/d6e/d11e/c152 0 2024-09-18T21:13:10.705 INFO:tasks.workunit.client.0.smithi077.stdout:8/959: link d2/d5f/d6f/f95 d2/d5f/da8/d4f/d5a/d2a/dc8/df1/d11d/f153 0 2024-09-18T21:13:10.707 INFO:tasks.workunit.client.0.smithi077.stdout:8/960: mknod d2/d5f/da8/d4f/d5a/d2a/dc8/c154 0 2024-09-18T21:13:10.710 INFO:tasks.workunit.client.0.smithi077.stdout:8/961: mknod d2/d27/d29/d41/d13d/c155 0 2024-09-18T21:13:10.721 INFO:tasks.workunit.client.0.smithi077.stdout:8/962: dwrite d2/d5f/d6f/fd1 [0,4194304] 0 2024-09-18T21:13:10.727 INFO:tasks.workunit.client.0.smithi077.stdout:8/963: dread d2/d5f/da8/d26/f84 [0,4194304] 0 2024-09-18T21:13:10.731 INFO:tasks.workunit.client.0.smithi077.stdout:8/964: mkdir d2/d156 0 2024-09-18T21:13:10.732 INFO:tasks.workunit.client.0.smithi077.stdout:8/965: dread - d2/d5f/da8/d26/faf zero size 2024-09-18T21:13:10.740 INFO:tasks.workunit.client.0.smithi077.stdout:8/966: write d2/d27/d29/f61 [3521886,122229] 0 2024-09-18T21:13:10.747 INFO:tasks.workunit.client.0.smithi077.stdout:8/967: dwrite d2/d5f/d7a/fec [0,4194304] 0 2024-09-18T21:13:10.754 INFO:tasks.workunit.client.0.smithi077.stdout:8/968: symlink d2/d5f/d6f/d105/l157 0 2024-09-18T21:13:10.764 INFO:tasks.workunit.client.0.smithi077.stdout:8/969: dwrite d2/d27/d29/d41/f45 [0,4194304] 0 2024-09-18T21:13:10.765 INFO:tasks.workunit.client.0.smithi077.stdout:8/970: readlink d2/d27/d29/d41/dbc/dce/l123 0 2024-09-18T21:13:10.769 INFO:tasks.workunit.client.0.smithi077.stdout:8/971: symlink d2/d5f/da8/d4f/d5a/d2a/dc8/l158 0 2024-09-18T21:13:10.771 INFO:tasks.workunit.client.0.smithi077.stdout:8/972: creat d2/d5f/da8/d126/f159 x:0 0 0 2024-09-18T21:13:10.773 INFO:tasks.workunit.client.0.smithi077.stdout:8/973: chown d2/d5f/d7a/ca0 7445 1 2024-09-18T21:13:10.773 INFO:tasks.workunit.client.0.smithi077.stdout:8/974: stat d2/d5f/d7a/ca0 0 2024-09-18T21:13:10.774 INFO:tasks.workunit.client.0.smithi077.stdout:8/975: fdatasync d2/d5/d6/fac 0 2024-09-18T21:13:10.777 INFO:tasks.workunit.client.0.smithi077.stdout:8/976: readlink d2/d5f/da8/d20/ld7 0 2024-09-18T21:13:10.784 INFO:tasks.workunit.client.0.smithi077.stdout:8/977: dwrite d2/d5f/da8/d4f/d5a/d2a/dc8/df1/d11d/da6/d110/fc5 [0,4194304] 0 2024-09-18T21:13:10.785 INFO:tasks.workunit.client.0.smithi077.stdout:8/978: readlink d2/d5f/da8/d26/l6b 0 2024-09-18T21:13:10.791 INFO:tasks.workunit.client.0.smithi077.stdout:8/979: truncate d2/d27/d29/f9c 2768574 0 2024-09-18T21:13:10.792 INFO:tasks.workunit.client.0.smithi077.stdout:8/980: chown d2/d5f/da8/f1b 13382 1 2024-09-18T21:13:10.797 INFO:tasks.workunit.client.0.smithi077.stdout:8/981: dread d2/d5/f93 [0,4194304] 0 2024-09-18T21:13:10.800 INFO:tasks.workunit.client.0.smithi077.stdout:8/982: creat d2/d5f/da8/d4f/d5a/d2a/dc8/df1/f15a x:0 0 0 2024-09-18T21:13:10.808 INFO:tasks.workunit.client.0.smithi077.stdout:8/983: write d2/d27/d29/d72/d81/fe9 [1034783,109148] 0 2024-09-18T21:13:10.810 INFO:tasks.workunit.client.0.smithi077.stdout:6/921: sync 2024-09-18T21:13:10.811 INFO:tasks.workunit.client.0.smithi077.stdout:8/984: getdents d2/d5f/da8/d4f/d5a 0 2024-09-18T21:13:10.813 INFO:tasks.workunit.client.0.smithi077.stdout:6/922: stat d7/d7e/d11/d3e/dcd/f10e 0 2024-09-18T21:13:10.815 INFO:tasks.workunit.client.0.smithi077.stdout:6/923: creat d7/d7e/d11/d3e/f133 x:0 0 0 2024-09-18T21:13:10.819 INFO:tasks.workunit.client.0.smithi077.stdout:8/985: rename d2/d5f/da8/d4f/d5a/d2a/dc8/df1/d11d/da6/fca to d2/d5f/da8/d4f/d5a/d5e/f15b 0 2024-09-18T21:13:10.819 INFO:tasks.workunit.client.0.smithi077.stdout:8/986: chown d2/d5f/da8/d4f/d5a/d12b 7244 1 2024-09-18T21:13:10.820 INFO:tasks.workunit.client.0.smithi077.stdout:8/987: chown d2/d5f/f9b 7 1 2024-09-18T21:13:10.825 INFO:tasks.workunit.client.0.smithi077.stdout:8/988: mknod d2/d27/d29/d104/c15c 0 2024-09-18T21:13:10.828 INFO:tasks.workunit.client.0.smithi077.stdout:8/989: write d2/d5f/da8/d4f/fc0 [2132639,72857] 0 2024-09-18T21:13:10.830 INFO:tasks.workunit.client.0.smithi077.stdout:8/990: mknod d2/d5f/da8/d126/c15d 0 2024-09-18T21:13:10.831 INFO:tasks.workunit.client.0.smithi077.stdout:8/991: stat d2/d5f/da8/d26/fba 0 2024-09-18T21:13:10.832 INFO:tasks.workunit.client.0.smithi077.stdout:6/924: unlink d7/d7e/d11/d3e/d42/dbb/d50/dd5/l109 0 2024-09-18T21:13:10.834 INFO:tasks.workunit.client.0.smithi077.stdout:8/992: chown d2/d5/d6/c54 2 1 2024-09-18T21:13:10.834 INFO:tasks.workunit.client.0.smithi077.stdout:8/993: chown d2 29 1 2024-09-18T21:13:10.835 INFO:tasks.workunit.client.0.smithi077.stdout:8/994: stat d2/d5/d6/f21 0 2024-09-18T21:13:10.836 INFO:tasks.workunit.client.0.smithi077.stdout:8/995: fsync d2/d5f/d7a/f14b 0 2024-09-18T21:13:10.837 INFO:tasks.workunit.client.0.smithi077.stdout:6/925: unlink d7/d7e/da6/l113 0 2024-09-18T21:13:10.838 INFO:tasks.workunit.client.0.smithi077.stdout:6/926: chown d7/d7e/d11/d3e/d42/dbb/d4c/c8f 95339345 1 2024-09-18T21:13:10.839 INFO:tasks.workunit.client.0.smithi077.stdout:8/996: creat d2/d27/d29/d41/dc2/f15e x:0 0 0 2024-09-18T21:13:10.841 INFO:tasks.workunit.client.0.smithi077.stdout:8/997: readlink d2/d5f/da8/d4f/d5a/d5e/d8f/lda 0 2024-09-18T21:13:10.844 INFO:tasks.workunit.client.0.smithi077.stdout:8/998: mknod d2/d5f/da8/d4f/d5a/d5e/c15f 0 2024-09-18T21:13:10.845 INFO:tasks.workunit.client.0.smithi077.stdout:8/999: fdatasync d2/d5f/da8/d20/fe2 0 2024-09-18T21:13:11.020 INFO:tasks.workunit.client.0.smithi077.stdout:1/918: sync 2024-09-18T21:13:11.034 INFO:tasks.workunit.client.0.smithi077.stdout:1/919: write d3/d6a/d9b/dbe/fce [5150867,40333] 0 2024-09-18T21:13:11.035 INFO:tasks.workunit.client.0.smithi077.stdout:1/920: symlink d3/d8/d75/d89/l13d 0 2024-09-18T21:13:11.037 INFO:tasks.workunit.client.0.smithi077.stdout:6/927: sync 2024-09-18T21:13:11.037 INFO:tasks.workunit.client.0.smithi077.stdout:1/921: mknod d3/d8/d93/dd3/d99/de8/c13e 0 2024-09-18T21:13:11.040 INFO:tasks.workunit.client.0.smithi077.stdout:6/928: fdatasync d7/d7e/d11/d3e/d42/dbb/d5c/f95 0 2024-09-18T21:13:11.044 INFO:tasks.workunit.client.0.smithi077.stdout:6/929: creat d7/d7e/d11/d3e/d42/dbb/d50/f134 x:0 0 0 2024-09-18T21:13:11.045 INFO:tasks.workunit.client.0.smithi077.stdout:6/930: write d7/d7e/d11/f19 [3818776,82086] 0 2024-09-18T21:13:11.049 INFO:tasks.workunit.client.0.smithi077.stdout:6/931: truncate d7/d7e/d11/d3e/d42/d88/da4/fd1 753298 0 2024-09-18T21:13:11.050 INFO:tasks.workunit.client.0.smithi077.stdout:6/932: stat d7/d7e/d11/d3e/d42/dbb/d49/d55/l73 0 2024-09-18T21:13:11.058 INFO:tasks.workunit.client.0.smithi077.stdout:6/933: write d7/d7e/f2a [6913408,91428] 0 2024-09-18T21:13:11.062 INFO:tasks.workunit.client.0.smithi077.stdout:6/934: creat d7/d7e/d11/dd8/f135 x:0 0 0 2024-09-18T21:13:11.076 INFO:tasks.workunit.client.0.smithi077.stdout:6/935: dread d7/d7e/d11/f19 [0,4194304] 0 2024-09-18T21:13:11.078 INFO:tasks.workunit.client.0.smithi077.stdout:6/936: symlink d7/d7e/d11/d3e/l136 0 2024-09-18T21:13:11.082 INFO:tasks.workunit.client.0.smithi077.stdout:6/937: read d7/d7e/d11/d3e/d42/dbb/d31/f130 [395301,4845] 0 2024-09-18T21:13:11.087 INFO:tasks.workunit.client.0.smithi077.stdout:6/938: link d7/d7e/d11/l80 d7/d7e/d11/l137 0 2024-09-18T21:13:11.091 INFO:tasks.workunit.client.0.smithi077.stdout:6/939: creat d7/d7e/d11/d3e/d42/dbb/d31/f138 x:0 0 0 2024-09-18T21:13:11.092 INFO:tasks.workunit.client.0.smithi077.stdout:6/940: chown d7/d7e/d11/d3e/d42/dbb/d49/d55/dc2/d110 76137423 1 2024-09-18T21:13:11.095 INFO:tasks.workunit.client.0.smithi077.stdout:6/941: creat d7/d7e/da6/de1/f139 x:0 0 0 2024-09-18T21:13:11.099 INFO:tasks.workunit.client.0.smithi077.stdout:6/942: creat d7/d7e/d11/d3e/d42/dbb/d49/d55/dc2/f13a x:0 0 0 2024-09-18T21:13:11.101 INFO:tasks.workunit.client.0.smithi077.stdout:6/943: symlink d7/d7e/d11/d3e/d42/dbb/d5c/d114/l13b 0 2024-09-18T21:13:11.112 INFO:tasks.workunit.client.0.smithi077.stdout:6/944: unlink d7/d7e/d11/d3e/d42/d88/da4/f2b 0 2024-09-18T21:13:11.115 INFO:tasks.workunit.client.0.smithi077.stdout:6/945: creat d7/d7e/da6/de1/f13c x:0 0 0 2024-09-18T21:13:11.309 INFO:tasks.workunit.client.0.smithi077.stdout:1/922: sync 2024-09-18T21:13:11.388 INFO:tasks.workunit.client.0.smithi077.stdout:1/923: getdents d3/d8/d13/d77 0 2024-09-18T21:13:11.389 INFO:tasks.workunit.client.0.smithi077.stdout:1/924: write d3/d38/dd5/f13a [905935,27175] 0 2024-09-18T21:13:11.390 INFO:tasks.workunit.client.0.smithi077.stdout:1/925: chown d3/d6a/ff8 8852705 1 2024-09-18T21:13:11.393 INFO:tasks.workunit.client.0.smithi077.stdout:1/926: mkdir d3/d8/d49/d4e/d5a/d13f 0 2024-09-18T21:13:11.394 INFO:tasks.workunit.client.0.smithi077.stdout:1/927: chown d3/d38/dd5/c12f 926 1 2024-09-18T21:13:11.400 INFO:tasks.workunit.client.0.smithi077.stdout:1/928: link d3/ca9 d3/d8/d49/d4e/d5a/c140 0 2024-09-18T21:13:11.402 INFO:tasks.workunit.client.0.smithi077.stdout:1/929: dread - d3/d8/d49/d4e/d50/fa3 zero size 2024-09-18T21:13:11.405 INFO:tasks.workunit.client.0.smithi077.stdout:1/930: symlink d3/d6a/d9b/dbe/d120/l141 0 2024-09-18T21:13:11.447 INFO:tasks.workunit.client.0.smithi077.stdout:6/946: sync 2024-09-18T21:13:11.508 INFO:tasks.workunit.client.0.smithi077.stdout:1/931: write d3/d8/d49/d4e/d50/f8b [988118,106448] 0 2024-09-18T21:13:11.511 INFO:tasks.workunit.client.0.smithi077.stdout:1/932: mkdir d3/d6a/d9b/d68/d3e/d142 0 2024-09-18T21:13:11.512 INFO:tasks.workunit.client.0.smithi077.stdout:1/933: rmdir d3/d6a/d9b/dbe 39 2024-09-18T21:13:11.514 INFO:tasks.workunit.client.0.smithi077.stdout:1/934: symlink d3/d8/l143 0 2024-09-18T21:13:11.516 INFO:tasks.workunit.client.0.smithi077.stdout:1/935: truncate d3/d6a/d9b/f3b 6546731 0 2024-09-18T21:13:11.517 INFO:tasks.workunit.client.0.smithi077.stdout:1/936: mkdir d3/d8/d93/dd3/d99/dfd/d144 0 2024-09-18T21:13:11.520 INFO:tasks.workunit.client.0.smithi077.stdout:1/937: creat d3/d8/d93/dd3/d99/de8/f145 x:0 0 0 2024-09-18T21:13:11.521 INFO:tasks.workunit.client.0.smithi077.stdout:1/938: unlink d3/d6a/lfb 0 2024-09-18T21:13:11.522 INFO:tasks.workunit.client.0.smithi077.stdout:1/939: chown d3/d6a/d9b/d68/lc7 0 1 2024-09-18T21:13:11.527 INFO:tasks.workunit.client.0.smithi077.stdout:1/940: dwrite d3/d38/fb3 [0,4194304] 0 2024-09-18T21:13:11.562 INFO:tasks.workunit.client.0.smithi077.stdout:6/947: dwrite d7/d7e/d11/fe2 [0,4194304] 0 2024-09-18T21:13:11.563 INFO:tasks.workunit.client.0.smithi077.stdout:1/941: truncate d3/d38/d97/f12e 1481287 0 2024-09-18T21:13:11.564 INFO:tasks.workunit.client.0.smithi077.stdout:6/948: mknod d7/d7e/da6/c13d 0 2024-09-18T21:13:11.568 INFO:tasks.workunit.client.0.smithi077.stdout:1/942: truncate d3/d8/d75/f61 3098991 0 2024-09-18T21:13:11.569 INFO:tasks.workunit.client.0.smithi077.stdout:1/943: stat d3/d8/d13/l139 0 2024-09-18T21:13:11.571 INFO:tasks.workunit.client.0.smithi077.stdout:1/944: truncate d3/f23 6845543 0 2024-09-18T21:13:11.573 INFO:tasks.workunit.client.0.smithi077.stdout:1/945: mknod d3/d8/d93/dd3/d99/dfc/c146 0 2024-09-18T21:13:11.581 INFO:tasks.workunit.client.0.smithi077.stdout:6/949: dwrite d7/d7e/d11/d3e/d42/dbb/d50/f5f [0,4194304] 0 2024-09-18T21:13:11.587 INFO:tasks.workunit.client.0.smithi077.stdout:6/950: fsync d7/d7e/f1b 0 2024-09-18T21:13:11.588 INFO:tasks.workunit.client.0.smithi077.stdout:1/946: write d3/d6a/d9b/d68/d3e/f73 [156614,54385] 0 2024-09-18T21:13:11.593 INFO:tasks.workunit.client.0.smithi077.stdout:6/951: mkdir d7/d7e/d11/d3e/d42/dbb/d49/d55/dc2/d110/d13e 0 2024-09-18T21:13:11.595 INFO:tasks.workunit.client.0.smithi077.stdout:1/947: truncate d3/d8/d75/d89/f8c 426791 0 2024-09-18T21:13:11.596 INFO:tasks.workunit.client.0.smithi077.stdout:1/948: chown d3/d8/d49/d4e/d50/ca1 53703180 1 2024-09-18T21:13:11.598 INFO:tasks.workunit.client.0.smithi077.stdout:6/952: mkdir d7/d7e/d11/d3e/d42/dbb/d50/dd5/d13f 0 2024-09-18T21:13:11.598 INFO:tasks.workunit.client.0.smithi077.stdout:1/949: rmdir d3/d38 39 2024-09-18T21:13:11.601 INFO:tasks.workunit.client.0.smithi077.stdout:1/950: fsync d3/d8/f17 0 2024-09-18T21:13:11.603 INFO:tasks.workunit.client.0.smithi077.stdout:6/953: rename d7/d7e/f2a to d7/d7e/d11/d3e/d42/dbb/d49/d96/f140 0 2024-09-18T21:13:11.613 INFO:tasks.workunit.client.0.smithi077.stdout:1/951: dread d3/d6a/d9b/f5b [0,4194304] 0 2024-09-18T21:13:11.614 INFO:tasks.workunit.client.0.smithi077.stdout:1/952: read d3/d8/d49/df0/ff7 [2801316,1189] 0 2024-09-18T21:13:11.622 INFO:tasks.workunit.client.0.smithi077.stdout:1/953: creat d3/d6a/d9b/f147 x:0 0 0 2024-09-18T21:13:11.624 INFO:tasks.workunit.client.0.smithi077.stdout:1/954: rmdir d3/d8/d75/d89/dbb 39 2024-09-18T21:13:11.628 INFO:tasks.workunit.client.0.smithi077.stdout:6/954: dwrite d7/d7e/d11/d3e/dcd/f10e [0,4194304] 0 2024-09-18T21:13:11.633 INFO:tasks.workunit.client.0.smithi077.stdout:1/955: dwrite d3/d8/d49/d4e/f102 [0,4194304] 0 2024-09-18T21:13:11.634 INFO:tasks.workunit.client.0.smithi077.stdout:1/956: stat d3/d8/d49/f128 0 2024-09-18T21:13:11.648 INFO:tasks.workunit.client.0.smithi077.stdout:1/957: dread d3/d6a/d9b/f3b [4194304,4194304] 0 2024-09-18T21:13:11.651 INFO:tasks.workunit.client.0.smithi077.stdout:1/958: symlink d3/d8/d93/dd3/l148 0 2024-09-18T21:13:11.652 INFO:tasks.workunit.client.0.smithi077.stdout:1/959: write d3/d6a/d9b/d68/d3e/f12c [1442858,8693] 0 2024-09-18T21:13:11.654 INFO:tasks.workunit.client.0.smithi077.stdout:1/960: truncate d3/d8/d49/df0/f10c 399919 0 2024-09-18T21:13:11.655 INFO:tasks.workunit.client.0.smithi077.stdout:6/955: truncate d7/d7e/d11/d3e/d42/dbb/d50/dd5/ff4 582872 0 2024-09-18T21:13:11.655 INFO:tasks.workunit.client.0.smithi077.stdout:1/961: stat d3/d6a/d9b/d7f/cb0 0 2024-09-18T21:13:11.656 INFO:tasks.workunit.client.0.smithi077.stdout:6/956: dread - d7/d7e/f58 zero size 2024-09-18T21:13:11.662 INFO:tasks.workunit.client.0.smithi077.stdout:1/962: dwrite d3/d8/d49/d4e/d50/f8b [0,4194304] 0 2024-09-18T21:13:11.670 INFO:tasks.workunit.client.0.smithi077.stdout:1/963: dwrite d3/d8/d13/f2b [0,4194304] 0 2024-09-18T21:13:11.671 INFO:tasks.workunit.client.0.smithi077.stdout:1/964: readlink d3/d6a/d9b/d68/l11e 0 2024-09-18T21:13:11.672 INFO:tasks.workunit.client.0.smithi077.stdout:6/957: write d7/d7e/d11/d3e/d42/dbb/d31/f108 [105567,120728] 0 2024-09-18T21:13:11.675 INFO:tasks.workunit.client.0.smithi077.stdout:1/965: mknod d3/d8/d93/dd3/d99/c149 0 2024-09-18T21:13:11.682 INFO:tasks.workunit.client.0.smithi077.stdout:6/958: mknod d7/d7e/d11/d3e/dcd/c141 0 2024-09-18T21:13:11.683 INFO:tasks.workunit.client.0.smithi077.stdout:1/966: read d3/d38/f60 [3493853,106016] 0 2024-09-18T21:13:11.686 INFO:tasks.workunit.client.0.smithi077.stdout:6/959: creat d7/d7e/d11/d3e/d42/dbb/d49/d96/f142 x:0 0 0 2024-09-18T21:13:11.689 INFO:tasks.workunit.client.0.smithi077.stdout:6/960: mkdir d7/d7e/da6/dfd/d143 0 2024-09-18T21:13:11.690 INFO:tasks.workunit.client.0.smithi077.stdout:6/961: rmdir d7/d7e/d11/d3e/d42/dbb/d50/dd5 39 2024-09-18T21:13:11.692 INFO:tasks.workunit.client.0.smithi077.stdout:6/962: fsync d7/d7e/d11/d3e/d42/fc9 0 2024-09-18T21:13:11.696 INFO:tasks.workunit.client.0.smithi077.stdout:6/963: read d7/d7e/d11/d3e/d42/dbb/d31/f5a [1344779,97083] 0 2024-09-18T21:13:11.698 INFO:tasks.workunit.client.0.smithi077.stdout:6/964: readlink d7/d7e/d11/d3e/d42/dbb/l48 0 2024-09-18T21:13:11.700 INFO:tasks.workunit.client.0.smithi077.stdout:1/967: dread d3/d8/d49/d4e/d50/f8d [0,4194304] 0 2024-09-18T21:13:11.702 INFO:tasks.workunit.client.0.smithi077.stdout:6/965: creat d7/d7e/d11/d3e/d42/dbb/d49/d55/dc2/f144 x:0 0 0 2024-09-18T21:13:11.703 INFO:tasks.workunit.client.0.smithi077.stdout:1/968: fsync d3/d38/dd5/f6f 0 2024-09-18T21:13:11.704 INFO:tasks.workunit.client.0.smithi077.stdout:1/969: dread - d3/d6a/d9b/d7f/f134 zero size 2024-09-18T21:13:11.705 INFO:tasks.workunit.client.0.smithi077.stdout:6/966: symlink d7/d7e/d11/d3e/d42/d88/da4/d102/l145 0 2024-09-18T21:13:11.716 INFO:tasks.workunit.client.0.smithi077.stdout:1/970: dread d3/d8/d75/f61 [0,4194304] 0 2024-09-18T21:13:11.717 INFO:tasks.workunit.client.0.smithi077.stdout:1/971: read - d3/d8/d93/f119 zero size 2024-09-18T21:13:11.720 INFO:tasks.workunit.client.0.smithi077.stdout:1/972: mknod d3/d8/d75/d89/dbb/c14a 0 2024-09-18T21:13:11.721 INFO:tasks.workunit.client.0.smithi077.stdout:1/973: symlink d3/d8/d75/d89/l14b 0 2024-09-18T21:13:11.723 INFO:tasks.workunit.client.0.smithi077.stdout:1/974: creat d3/d8/d49/d4e/f14c x:0 0 0 2024-09-18T21:13:12.604 INFO:tasks.workunit.client.0.smithi077.stdout:1/975: sync 2024-09-18T21:13:12.604 INFO:tasks.workunit.client.0.smithi077.stdout:6/967: sync 2024-09-18T21:13:12.613 INFO:tasks.workunit.client.0.smithi077.stdout:6/968: truncate d7/d7e/d11/d3e/f76 737190 0 2024-09-18T21:13:12.616 INFO:tasks.workunit.client.0.smithi077.stdout:1/976: fdatasync d3/d8/d49/df0/f10c 0 2024-09-18T21:13:12.618 INFO:tasks.workunit.client.0.smithi077.stdout:1/977: truncate d3/d8/d93/f119 642360 0 2024-09-18T21:13:12.625 INFO:tasks.workunit.client.0.smithi077.stdout:1/978: creat d3/d38/d97/dea/f14d x:0 0 0 2024-09-18T21:13:12.652 INFO:tasks.workunit.client.0.smithi077.stdout:1/979: truncate d3/d8/d49/f65 2226930 0 2024-09-18T21:13:12.655 INFO:tasks.workunit.client.0.smithi077.stdout:6/969: dwrite d7/d7e/d11/d3e/d42/dbb/d31/fc3 [0,4194304] 0 2024-09-18T21:13:12.673 INFO:tasks.workunit.client.0.smithi077.stdout:6/970: dwrite d7/d7e/d11/d3e/dcd/fec [0,4194304] 0 2024-09-18T21:13:12.674 INFO:tasks.workunit.client.0.smithi077.stdout:6/971: write d7/d7e/d11/d3e/d42/dbb/d50/f134 [374097,93661] 0 2024-09-18T21:13:12.681 INFO:tasks.workunit.client.0.smithi077.stdout:6/972: dread d7/d7e/d11/d3e/d42/d88/da4/d102/f11b [0,4194304] 0 2024-09-18T21:13:12.694 INFO:tasks.workunit.client.0.smithi077.stdout:6/973: dwrite d7/d7e/f58 [0,4194304] 0 2024-09-18T21:13:12.697 INFO:tasks.workunit.client.0.smithi077.stdout:6/974: write d7/d7e/d11/d3e/d42/dbb/f132 [1394498,56078] 0 2024-09-18T21:13:12.701 INFO:tasks.workunit.client.0.smithi077.stdout:6/975: symlink d7/d7e/d11/d3e/d42/dbb/d31/l146 0 2024-09-18T21:13:12.707 INFO:tasks.workunit.client.0.smithi077.stdout:6/976: write d7/d7e/d11/d3e/d42/dbb/d49/d55/dc2/fe5 [4205500,31003] 0 2024-09-18T21:13:12.709 INFO:tasks.workunit.client.0.smithi077.stdout:6/977: creat d7/d7e/d11/d3e/d42/dbb/d31/f147 x:0 0 0 2024-09-18T21:13:12.711 INFO:tasks.workunit.client.0.smithi077.stdout:6/978: truncate d7/d7e/d11/d3e/d42/d88/da4/fd1 1043874 0 2024-09-18T21:13:12.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:12 smithi077 ceph-mon[27689]: pgmap v27: 65 pgs: 65 active+clean; 3.9 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 102 MiB/s rd, 227 MiB/s wr, 596 op/s 2024-09-18T21:13:12.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:12 smithi103 ceph-mon[34827]: pgmap v27: 65 pgs: 65 active+clean; 3.9 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 102 MiB/s rd, 227 MiB/s wr, 596 op/s 2024-09-18T21:13:13.112 INFO:tasks.workunit.client.0.smithi077.stdout:1/980: sync 2024-09-18T21:13:13.112 INFO:tasks.workunit.client.0.smithi077.stdout:6/979: sync 2024-09-18T21:13:13.114 INFO:tasks.workunit.client.0.smithi077.stdout:1/981: rename d3/d38/f106 to d3/d38/dd5/da5/f14e 0 2024-09-18T21:13:13.120 INFO:tasks.workunit.client.0.smithi077.stdout:1/982: write d3/d8/d49/f79 [4920801,79118] 0 2024-09-18T21:13:13.122 INFO:tasks.workunit.client.0.smithi077.stdout:1/983: creat d3/d8/d49/d4e/f14f x:0 0 0 2024-09-18T21:13:13.124 INFO:tasks.workunit.client.0.smithi077.stdout:6/980: dwrite d7/d7e/d11/d3e/d42/dbb/d31/f71 [0,4194304] 0 2024-09-18T21:13:13.126 INFO:tasks.workunit.client.0.smithi077.stdout:1/984: creat d3/d8/d93/dd3/d99/dfd/f150 x:0 0 0 2024-09-18T21:13:13.129 INFO:tasks.workunit.client.0.smithi077.stdout:1/985: read d3/d38/d97/dea/feb [998438,38916] 0 2024-09-18T21:13:13.130 INFO:tasks.workunit.client.0.smithi077.stdout:6/981: rename d7/ldd to d7/d7e/d11/l148 0 2024-09-18T21:13:13.130 INFO:tasks.workunit.client.0.smithi077.stdout:1/986: dread - d3/d38/d97/dea/f14d zero size 2024-09-18T21:13:13.136 INFO:tasks.workunit.client.0.smithi077.stdout:1/987: link d3/d8/d49/d4e/d5a/l5e d3/d8/d75/d89/d103/d12b/l151 0 2024-09-18T21:13:13.136 INFO:tasks.workunit.client.0.smithi077.stdout:6/982: read d7/d7e/d11/d3e/d42/d88/ff1 [1449648,126133] 0 2024-09-18T21:13:13.139 INFO:tasks.workunit.client.0.smithi077.stdout:1/988: creat d3/d6a/d112/f152 x:0 0 0 2024-09-18T21:13:13.140 INFO:tasks.workunit.client.0.smithi077.stdout:1/989: chown d3/d8/d75/d89/dbb 41636999 1 2024-09-18T21:13:13.140 INFO:tasks.workunit.client.0.smithi077.stdout:6/983: symlink d7/d7e/d11/d9a/l149 0 2024-09-18T21:13:13.141 INFO:tasks.workunit.client.0.smithi077.stdout:6/984: stat d7/d7e/d11/d3e/d42/dbb/d31/f138 0 2024-09-18T21:13:13.143 INFO:tasks.workunit.client.0.smithi077.stdout:1/990: rename d3/d6a/d9b/d4c/f5c to d3/d8/d13/d77/f153 0 2024-09-18T21:13:13.144 INFO:tasks.workunit.client.0.smithi077.stdout:1/991: chown d3/d6a/c110 483 1 2024-09-18T21:13:13.145 INFO:tasks.workunit.client.0.smithi077.stdout:6/985: creat d7/d7e/d11/d3e/d42/dbb/d49/d55/dc2/d110/f14a x:0 0 0 2024-09-18T21:13:13.149 INFO:tasks.workunit.client.0.smithi077.stdout:1/992: rename d3/d8/d49/d4e/d50/f12a to d3/d8/d93/dd3/f154 0 2024-09-18T21:13:13.151 INFO:tasks.workunit.client.0.smithi077.stdout:6/986: dwrite d7/d7e/da6/de1/f126 [0,4194304] 0 2024-09-18T21:13:13.152 INFO:tasks.workunit.client.0.smithi077.stdout:1/993: write d3/d8/d93/dd3/d99/de8/f145 [709028,97291] 0 2024-09-18T21:13:13.157 INFO:tasks.workunit.client.0.smithi077.stdout:1/994: creat d3/d8/d13/d77/f155 x:0 0 0 2024-09-18T21:13:13.158 INFO:tasks.workunit.client.0.smithi077.stdout:6/987: symlink d7/d7e/d11/d3e/d42/dbb/d49/l14b 0 2024-09-18T21:13:13.162 INFO:tasks.workunit.client.0.smithi077.stdout:1/995: mkdir d3/d6a/d9b/dbe/d120/d156 0 2024-09-18T21:13:13.169 INFO:tasks.workunit.client.0.smithi077.stdout:6/988: write d7/d7e/d11/d3e/f106 [63984,96364] 0 2024-09-18T21:13:13.173 INFO:tasks.workunit.client.0.smithi077.stdout:6/989: truncate d7/d7e/d11/d3e/d42/dbb/d49/d55/dc2/d110/f14a 347035 0 2024-09-18T21:13:13.177 INFO:tasks.workunit.client.0.smithi077.stdout:1/996: dwrite d3/d8/d93/dd3/f6c [0,4194304] 0 2024-09-18T21:13:13.178 INFO:tasks.workunit.client.0.smithi077.stdout:6/990: rename d7/d7e/c12 to d7/d7e/c14c 0 2024-09-18T21:13:13.178 INFO:tasks.workunit.client.0.smithi077.stdout:1/997: dread - d3/d6a/d112/f135 zero size 2024-09-18T21:13:13.180 INFO:tasks.workunit.client.0.smithi077.stdout:6/991: stat d7/d7e/d11/d3e/d42/dbb/d5c/l89 0 2024-09-18T21:13:13.181 INFO:tasks.workunit.client.0.smithi077.stdout:6/992: fdatasync d7/fd9 0 2024-09-18T21:13:13.185 INFO:tasks.workunit.client.0.smithi077.stdout:1/998: link d3/d8/d49/d4e/d5a/f78 d3/d38/dd5/da5/f157 0 2024-09-18T21:13:13.188 INFO:tasks.workunit.client.0.smithi077.stdout:6/993: dwrite d7/d7e/d11/d9a/d11a/f12f [0,4194304] 0 2024-09-18T21:13:13.190 INFO:tasks.workunit.client.0.smithi077.stdout:6/994: chown d7/d7e/d11/d3e/d42/dbb/d49/d55/dc2/fe5 2318720 1 2024-09-18T21:13:13.191 INFO:tasks.workunit.client.0.smithi077.stdout:1/999: creat d3/d8/d75/d89/f158 x:0 0 0 2024-09-18T21:13:13.199 INFO:tasks.workunit.client.0.smithi077.stdout:6/995: rename d7/d7e/d11/d3e/d42/dbb to d7/d7e/d11/d3e/d42/d88/da4/df8/d14d 0 2024-09-18T21:13:13.200 INFO:tasks.workunit.client.0.smithi077.stdout:6/996: creat d7/d7e/da6/f14e x:0 0 0 2024-09-18T21:13:13.531 INFO:tasks.workunit.client.0.smithi077.stdout:6/997: sync 2024-09-18T21:13:13.534 INFO:tasks.workunit.client.0.smithi077.stdout:6/998: rename d7/d7e/d11/d3e/d42/d88/da4/df8/cff to d7/d7e/d11/d3e/d42/d88/da4/df8/d14d/d49/d55/c14f 0 2024-09-18T21:13:13.536 INFO:tasks.workunit.client.0.smithi077.stdout:6/999: read d7/d7e/d11/d3e/d42/d88/da4/df8/d14d/d5c/f95 [280836,65874] 0 2024-09-18T21:13:13.540 INFO:tasks.workunit.client.0.smithi077.stderr:+ rm -rf -- ./tmp.tJqcfsZOrz 2024-09-18T21:13:14.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:14 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:14.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:14 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:14.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:14 smithi077 ceph-mon[27689]: Reconfiguring alertmanager.smithi077 (dependencies changed)... 2024-09-18T21:13:14.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:14 smithi077 ceph-mon[27689]: Reconfiguring daemon alertmanager.smithi077 on smithi077 2024-09-18T21:13:14.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:14 smithi077 ceph-mon[27689]: pgmap v28: 65 pgs: 65 active+clean; 3.9 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 81 MiB/s rd, 173 MiB/s wr, 436 op/s 2024-09-18T21:13:14.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:14 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:14.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:14 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:14.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:14 smithi103 ceph-mon[34827]: Reconfiguring alertmanager.smithi077 (dependencies changed)... 2024-09-18T21:13:14.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:14 smithi103 ceph-mon[34827]: Reconfiguring daemon alertmanager.smithi077 on smithi077 2024-09-18T21:13:14.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:14 smithi103 ceph-mon[34827]: pgmap v28: 65 pgs: 65 active+clean; 3.9 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 81 MiB/s rd, 173 MiB/s wr, 436 op/s 2024-09-18T21:13:16.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:16 smithi077 ceph-mon[27689]: pgmap v29: 65 pgs: 65 active+clean; 3.5 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 84 MiB/s rd, 186 MiB/s wr, 523 op/s 2024-09-18T21:13:16.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:16 smithi103 ceph-mon[34827]: pgmap v29: 65 pgs: 65 active+clean; 3.5 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 84 MiB/s rd, 186 MiB/s wr, 523 op/s 2024-09-18T21:13:18.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:18 smithi077 ceph-mon[27689]: pgmap v30: 65 pgs: 65 active+clean; 3.5 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 33 MiB/s rd, 86 MiB/s wr, 278 op/s 2024-09-18T21:13:18.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:18 smithi103 ceph-mon[34827]: pgmap v30: 65 pgs: 65 active+clean; 3.5 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 33 MiB/s rd, 86 MiB/s wr, 278 op/s 2024-09-18T21:13:20.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:19 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:20.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:19 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:20.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:19 smithi077 ceph-mon[27689]: Reconfiguring grafana.smithi077 (dependencies changed)... 2024-09-18T21:13:20.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:19 smithi077 ceph-mon[27689]: Reconfiguring daemon grafana.smithi077 on smithi077 2024-09-18T21:13:20.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:19 smithi077 ceph-mon[27689]: pgmap v31: 65 pgs: 65 active+clean; 2.7 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 33 MiB/s rd, 86 MiB/s wr, 316 op/s 2024-09-18T21:13:20.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:19 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:20.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:19 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:20.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:19 smithi103 ceph-mon[34827]: Reconfiguring grafana.smithi077 (dependencies changed)... 2024-09-18T21:13:20.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:19 smithi103 ceph-mon[34827]: Reconfiguring daemon grafana.smithi077 on smithi077 2024-09-18T21:13:20.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:19 smithi103 ceph-mon[34827]: pgmap v31: 65 pgs: 65 active+clean; 2.7 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 33 MiB/s rd, 86 MiB/s wr, 316 op/s 2024-09-18T21:13:21.449 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-18T21:13:21.450 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-09-18T21:13:22.446 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:22 smithi077 ceph-mon[27689]: pgmap v32: 65 pgs: 65 active+clean; 2.2 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 9.4 MiB/s rd, 30 MiB/s wr, 209 op/s 2024-09-18T21:13:22.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:22 smithi103 ceph-mon[34827]: pgmap v32: 65 pgs: 65 active+clean; 2.2 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 9.4 MiB/s rd, 30 MiB/s wr, 209 op/s 2024-09-18T21:13:24.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:24 smithi077 ceph-mon[27689]: pgmap v33: 65 pgs: 65 active+clean; 2.2 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 2.7 MiB/s rd, 14 MiB/s wr, 185 op/s 2024-09-18T21:13:24.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:24 smithi077 ceph-mon[27689]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:13:24.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:24 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:24.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:24 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:24.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:24 smithi103 ceph-mon[34827]: pgmap v33: 65 pgs: 65 active+clean; 2.2 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 2.7 MiB/s rd, 14 MiB/s wr, 185 op/s 2024-09-18T21:13:24.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:24 smithi103 ceph-mon[34827]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:13:24.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:24 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:24.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:24 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:25.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.256+0000 7f045324c640 1 -- 172.21.15.77:0/1540174392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f044c0ffa60 msgr2=0x7f044c0ffed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:13:25.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.256+0000 7f045324c640 1 --2- 172.21.15.77:0/1540174392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f044c0ffa60 0x7f044c0ffed0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0440004810 tx=0x7f0440009da0 comp rx=0 tx=0).stop 2024-09-18T21:13:25.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.256+0000 7f045324c640 1 -- 172.21.15.77:0/1540174392 shutdown_connections 2024-09-18T21:13:25.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.256+0000 7f045324c640 1 --2- 172.21.15.77:0/1540174392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f044c0ffa60 0x7f044c0ffed0 secure :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0440004810 tx=0x7f0440009da0 comp rx=0 tx=0).stop 2024-09-18T21:13:25.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.256+0000 7f045324c640 1 --2- 172.21.15.77:0/1540174392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f044c0fe790 0x7f044c0feba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:25.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.256+0000 7f045324c640 1 -- 172.21.15.77:0/1540174392 >> 172.21.15.77:0/1540174392 conn(0x7f044c0fa060 msgr2=0x7f044c0fc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:13:25.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.257+0000 7f045324c640 1 -- 172.21.15.77:0/1540174392 shutdown_connections 2024-09-18T21:13:25.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.258+0000 7f045324c640 1 -- 172.21.15.77:0/1540174392 wait complete. 2024-09-18T21:13:25.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.258+0000 7f045324c640 1 Processor -- start 2024-09-18T21:13:25.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.259+0000 7f045324c640 1 -- start start 2024-09-18T21:13:25.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.260+0000 7f045324c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f044c0fe790 0x7f044c10af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:13:25.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.260+0000 7f045324c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f044c10b450 0x7f044c10c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:13:25.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.260+0000 7f045324c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f044c10b910 con 0x7f044c0fe790 2024-09-18T21:13:25.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.260+0000 7f045324c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f044c10ba50 con 0x7f044c10b450 2024-09-18T21:13:25.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.260+0000 7f0450fe8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f044c0fe790 0x7f044c10af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:13:25.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.260+0000 7f0450fe8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f044c0fe790 0x7f044c10af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42818/0 (socket says 172.21.15.77:42818) 2024-09-18T21:13:25.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.260+0000 7f0450fe8640 1 -- 172.21.15.77:0/1816142391 learned_addr learned my addr 172.21.15.77:0/1816142391 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:13:25.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.261+0000 7f0450fe8640 1 -- 172.21.15.77:0/1816142391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f044c10b450 msgr2=0x7f044c10c310 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-18T21:13:25.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.261+0000 7f0450fe8640 1 --2- 172.21.15.77:0/1816142391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f044c10b450 0x7f044c10c310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:25.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.261+0000 7f0450fe8640 1 -- 172.21.15.77:0/1816142391 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0440005040 con 0x7f044c0fe790 2024-09-18T21:13:25.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.261+0000 7f0450fe8640 1 --2- 172.21.15.77:0/1816142391 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f044c0fe790 0x7f044c10af10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f044400ec20 tx=0x7f044400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:13:25.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.261+0000 7f04497fa640 1 -- 172.21.15.77:0/1816142391 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f044400cad0 con 0x7f044c0fe790 2024-09-18T21:13:25.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.261+0000 7f045324c640 1 -- 172.21.15.77:0/1816142391 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f044c10c910 con 0x7f044c0fe790 2024-09-18T21:13:25.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.261+0000 7f04497fa640 1 -- 172.21.15.77:0/1816142391 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f044400f040 con 0x7f044c0fe790 2024-09-18T21:13:25.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.262+0000 7f045324c640 1 -- 172.21.15.77:0/1816142391 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f044c10cd70 con 0x7f044c0fe790 2024-09-18T21:13:25.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.262+0000 7f04497fa640 1 -- 172.21.15.77:0/1816142391 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0444009510 con 0x7f044c0fe790 2024-09-18T21:13:25.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.263+0000 7f045324c640 1 -- 172.21.15.77:0/1816142391 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f044c0fdbf0 con 0x7f044c0fe790 2024-09-18T21:13:25.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.264+0000 7f04497fa640 1 -- 172.21.15.77:0/1816142391 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 24) v1 ==== 91488+0+0 (secure 0 0 0) 0x7f044400ccc0 con 0x7f044c0fe790 2024-09-18T21:13:25.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.264+0000 7f04497fa640 1 --2- 172.21.15.77:0/1816142391 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f043406e4a0 0x7f0434070950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:13:25.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.264+0000 7f04497fa640 1 -- 172.21.15.77:0/1816142391 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f044408e2f0 con 0x7f044c0fe790 2024-09-18T21:13:25.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.265+0000 7f044bfff640 1 --2- 172.21.15.77:0/1816142391 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f043406e4a0 0x7f0434070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:13:25.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.267+0000 7f044bfff640 1 --2- 172.21.15.77:0/1816142391 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f043406e4a0 0x7f0434070950 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0440000c00 tx=0x7f0440009da0 comp rx=0 tx=0).ready entity=mgr.14578 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:13:25.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.272+0000 7f04497fa640 1 -- 172.21.15.77:0/1816142391 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f044405b9e0 con 0x7f044c0fe790 2024-09-18T21:13:25.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.501+0000 7f045324c640 1 -- 172.21.15.77:0/1816142391 --> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f044c05db50 con 0x7f043406e4a0 2024-09-18T21:13:25.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.502+0000 7f04497fa640 1 -- 172.21.15.77:0/1816142391 <== mgr.14578 v2:172.21.15.103:6828/1199124716 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f044c05db50 con 0x7f043406e4a0 2024-09-18T21:13:25.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.504+0000 7f045324c640 1 -- 172.21.15.77:0/1816142391 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f043406e4a0 msgr2=0x7f0434070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:13:25.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.504+0000 7f045324c640 1 --2- 172.21.15.77:0/1816142391 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f043406e4a0 0x7f0434070950 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0440000c00 tx=0x7f0440009da0 comp rx=0 tx=0).stop 2024-09-18T21:13:25.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.504+0000 7f045324c640 1 -- 172.21.15.77:0/1816142391 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f044c0fe790 msgr2=0x7f044c10af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:13:25.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.504+0000 7f045324c640 1 --2- 172.21.15.77:0/1816142391 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f044c0fe790 0x7f044c10af10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f044400ec20 tx=0x7f044400b040 comp rx=0 tx=0).stop 2024-09-18T21:13:25.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.504+0000 7f045324c640 1 -- 172.21.15.77:0/1816142391 shutdown_connections 2024-09-18T21:13:25.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.504+0000 7f045324c640 1 --2- 172.21.15.77:0/1816142391 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f043406e4a0 0x7f0434070950 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0440000c00 tx=0x7f0440009da0 comp rx=0 tx=0).stop 2024-09-18T21:13:25.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.504+0000 7f045324c640 1 --2- 172.21.15.77:0/1816142391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f044c10b450 0x7f044c10c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:25.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.504+0000 7f045324c640 1 --2- 172.21.15.77:0/1816142391 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f044c0fe790 0x7f044c10af10 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:25.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.504+0000 7f045324c640 1 -- 172.21.15.77:0/1816142391 >> 172.21.15.77:0/1816142391 conn(0x7f044c0fa060 msgr2=0x7f044c100c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:13:25.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.505+0000 7f045324c640 1 -- 172.21.15.77:0/1816142391 shutdown_connections 2024-09-18T21:13:25.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.505+0000 7f045324c640 1 -- 172.21.15.77:0/1816142391 wait complete. 2024-09-18T21:13:25.515 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-09-18T21:13:25.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.595+0000 7f70bcef4640 1 -- 172.21.15.77:0/788696489 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70b80fb430 msgr2=0x7f70b80fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:13:25.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.595+0000 7f70bcef4640 1 --2- 172.21.15.77:0/788696489 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70b80fb430 0x7f70b80fb840 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f70a80048d0 tx=0x7f70a8009da0 comp rx=0 tx=0).stop 2024-09-18T21:13:25.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.595+0000 7f70bcef4640 1 -- 172.21.15.77:0/788696489 shutdown_connections 2024-09-18T21:13:25.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.595+0000 7f70bcef4640 1 --2- 172.21.15.77:0/788696489 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70b80fc700 0x7f70b80fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:25.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.595+0000 7f70bcef4640 1 --2- 172.21.15.77:0/788696489 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70b80fb430 0x7f70b80fb840 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:25.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.595+0000 7f70bcef4640 1 -- 172.21.15.77:0/788696489 >> 172.21.15.77:0/788696489 conn(0x7f70b80f6c10 msgr2=0x7f70b80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:13:25.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.595+0000 7f70bcef4640 1 -- 172.21.15.77:0/788696489 shutdown_connections 2024-09-18T21:13:25.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.595+0000 7f70bcef4640 1 -- 172.21.15.77:0/788696489 wait complete. 2024-09-18T21:13:25.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.596+0000 7f70bcef4640 1 Processor -- start 2024-09-18T21:13:25.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.596+0000 7f70bcef4640 1 -- start start 2024-09-18T21:13:25.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.596+0000 7f70bcef4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70b80fb430 0x7f70b810fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:13:25.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.596+0000 7f70bcef4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70b80fc700 0x7f70b8112310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:13:25.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.596+0000 7f70bcef4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b8065c60 con 0x7f70b80fb430 2024-09-18T21:13:25.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.596+0000 7f70bcef4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b8065dd0 con 0x7f70b80fc700 2024-09-18T21:13:25.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.596+0000 7f70b659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70b80fb430 0x7f70b810fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:13:25.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.596+0000 7f70affff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70b80fc700 0x7f70b8112310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:13:25.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.596+0000 7f70affff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70b80fc700 0x7f70b8112310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:43836/0 (socket says 172.21.15.77:43836) 2024-09-18T21:13:25.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.596+0000 7f70affff640 1 -- 172.21.15.77:0/1309318106 learned_addr learned my addr 172.21.15.77:0/1309318106 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:13:25.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.597+0000 7f70affff640 1 -- 172.21.15.77:0/1309318106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70b80fb430 msgr2=0x7f70b810fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:13:25.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.597+0000 7f70affff640 1 --2- 172.21.15.77:0/1309318106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70b80fb430 0x7f70b810fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:25.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.597+0000 7f70affff640 1 -- 172.21.15.77:0/1309318106 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a8005040 con 0x7f70b80fc700 2024-09-18T21:13:25.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.597+0000 7f70affff640 1 --2- 172.21.15.77:0/1309318106 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70b80fc700 0x7f70b8112310 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f70a000eb70 tx=0x7f70a000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:13:25.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.597+0000 7f70aeffd640 1 -- 172.21.15.77:0/1309318106 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70a0007c30 con 0x7f70b80fc700 2024-09-18T21:13:25.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.597+0000 7f70aeffd640 1 -- 172.21.15.77:0/1309318106 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f70a000f040 con 0x7f70b80fc700 2024-09-18T21:13:25.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.597+0000 7f70bcef4640 1 -- 172.21.15.77:0/1309318106 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b810bba0 con 0x7f70b80fc700 2024-09-18T21:13:25.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.597+0000 7f70aeffd640 1 -- 172.21.15.77:0/1309318106 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70a000ca60 con 0x7f70b80fc700 2024-09-18T21:13:25.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.597+0000 7f70bcef4640 1 -- 172.21.15.77:0/1309318106 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b810c140 con 0x7f70b80fc700 2024-09-18T21:13:25.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.598+0000 7f70bcef4640 1 -- 172.21.15.77:0/1309318106 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70b80fa890 con 0x7f70b80fc700 2024-09-18T21:13:25.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.599+0000 7f70aeffd640 1 -- 172.21.15.77:0/1309318106 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 24) v1 ==== 91488+0+0 (secure 0 0 0) 0x7f70a000cbc0 con 0x7f70b80fc700 2024-09-18T21:13:25.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.600+0000 7f70aeffd640 1 --2- 172.21.15.77:0/1309318106 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f70a406e4a0 0x7f70a4070950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:13:25.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.600+0000 7f70aeffd640 1 -- 172.21.15.77:0/1309318106 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f70a008d750 con 0x7f70b80fc700 2024-09-18T21:13:25.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.600+0000 7f70b659c640 1 --2- 172.21.15.77:0/1309318106 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f70a406e4a0 0x7f70a4070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:13:25.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.600+0000 7f70b659c640 1 --2- 172.21.15.77:0/1309318106 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f70a406e4a0 0x7f70a4070950 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f70a8000c00 tx=0x7f70a8035040 comp rx=0 tx=0).ready entity=mgr.14578 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:13:25.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.604+0000 7f70aeffd640 1 -- 172.21.15.77:0/1309318106 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f70a0057330 con 0x7f70b80fc700 2024-09-18T21:13:25.664 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:25 smithi103 ceph-mon[34827]: Reconfiguring prometheus.smithi077 (dependencies changed)... 2024-09-18T21:13:25.665 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:25 smithi103 ceph-mon[34827]: Reconfiguring daemon prometheus.smithi077 on smithi077 2024-09-18T21:13:25.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:25 smithi077 ceph-mon[27689]: Reconfiguring prometheus.smithi077 (dependencies changed)... 2024-09-18T21:13:25.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:25 smithi077 ceph-mon[27689]: Reconfiguring daemon prometheus.smithi077 on smithi077 2024-09-18T21:13:25.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.872+0000 7f70bcef4640 1 -- 172.21.15.77:0/1309318106 --> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f70b8100b60 con 0x7f70a406e4a0 2024-09-18T21:13:25.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.873+0000 7f70aeffd640 1 -- 172.21.15.77:0/1309318106 <== mgr.14578 v2:172.21.15.103:6828/1199124716 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f70b8100b60 con 0x7f70a406e4a0 2024-09-18T21:13:25.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.876+0000 7f70bcef4640 1 -- 172.21.15.77:0/1309318106 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f70a406e4a0 msgr2=0x7f70a4070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:13:25.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.876+0000 7f70bcef4640 1 --2- 172.21.15.77:0/1309318106 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f70a406e4a0 0x7f70a4070950 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f70a8000c00 tx=0x7f70a8035040 comp rx=0 tx=0).stop 2024-09-18T21:13:25.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.876+0000 7f70bcef4640 1 -- 172.21.15.77:0/1309318106 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70b80fc700 msgr2=0x7f70b8112310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:13:25.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.876+0000 7f70bcef4640 1 --2- 172.21.15.77:0/1309318106 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70b80fc700 0x7f70b8112310 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f70a000eb70 tx=0x7f70a000b040 comp rx=0 tx=0).stop 2024-09-18T21:13:25.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.876+0000 7f70bcef4640 1 -- 172.21.15.77:0/1309318106 shutdown_connections 2024-09-18T21:13:25.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.876+0000 7f70bcef4640 1 --2- 172.21.15.77:0/1309318106 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f70a406e4a0 0x7f70a4070950 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:25.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.876+0000 7f70bcef4640 1 --2- 172.21.15.77:0/1309318106 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70b80fc700 0x7f70b8112310 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:25.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.876+0000 7f70bcef4640 1 --2- 172.21.15.77:0/1309318106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70b80fb430 0x7f70b810fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:25.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.876+0000 7f70bcef4640 1 -- 172.21.15.77:0/1309318106 >> 172.21.15.77:0/1309318106 conn(0x7f70b80f6c10 msgr2=0x7f70b80f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:13:25.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.876+0000 7f70bcef4640 1 -- 172.21.15.77:0/1309318106 shutdown_connections 2024-09-18T21:13:25.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.876+0000 7f70bcef4640 1 -- 172.21.15.77:0/1309318106 wait complete. 2024-09-18T21:13:25.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.969+0000 7f5e14d12640 1 -- 172.21.15.77:0/4079759960 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e10065a70 msgr2=0x7f5e100ff010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:13:25.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.969+0000 7f5e14d12640 1 --2- 172.21.15.77:0/4079759960 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e10065a70 0x7f5e100ff010 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f5e000048d0 tx=0x7f5e00009da0 comp rx=0 tx=0).stop 2024-09-18T21:13:25.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.969+0000 7f5e14d12640 1 -- 172.21.15.77:0/4079759960 shutdown_connections 2024-09-18T21:13:25.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.969+0000 7f5e14d12640 1 --2- 172.21.15.77:0/4079759960 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e100ff550 0x7f5e10101930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:25.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.969+0000 7f5e14d12640 1 --2- 172.21.15.77:0/4079759960 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e10065a70 0x7f5e100ff010 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:25.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.969+0000 7f5e14d12640 1 -- 172.21.15.77:0/4079759960 >> 172.21.15.77:0/4079759960 conn(0x7f5e100f6a40 msgr2=0x7f5e100f8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:13:25.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.969+0000 7f5e14d12640 1 -- 172.21.15.77:0/4079759960 shutdown_connections 2024-09-18T21:13:25.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.969+0000 7f5e14d12640 1 -- 172.21.15.77:0/4079759960 wait complete. 2024-09-18T21:13:25.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.969+0000 7f5e14d12640 1 Processor -- start 2024-09-18T21:13:25.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.970+0000 7f5e14d12640 1 -- start start 2024-09-18T21:13:25.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.970+0000 7f5e14d12640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e10065a70 0x7f5e1010cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:13:25.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.970+0000 7f5e14d12640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e100ff550 0x7f5e1010d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:13:25.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.970+0000 7f5e14d12640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1010dac0 con 0x7f5e100ff550 2024-09-18T21:13:25.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.970+0000 7f5e14d12640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1010e270 con 0x7f5e10065a70 2024-09-18T21:13:25.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.970+0000 7f5e0effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e100ff550 0x7f5e1010d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:13:25.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.970+0000 7f5e0effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e100ff550 0x7f5e1010d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42860/0 (socket says 172.21.15.77:42860) 2024-09-18T21:13:25.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.970+0000 7f5e0effd640 1 -- 172.21.15.77:0/3742070421 learned_addr learned my addr 172.21.15.77:0/3742070421 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:13:25.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.970+0000 7f5e0f7fe640 1 --2- 172.21.15.77:0/3742070421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e10065a70 0x7f5e1010cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:13:25.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.970+0000 7f5e0effd640 1 -- 172.21.15.77:0/3742070421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e10065a70 msgr2=0x7f5e1010cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:13:25.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.970+0000 7f5e0effd640 1 --2- 172.21.15.77:0/3742070421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e10065a70 0x7f5e1010cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:25.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.970+0000 7f5e0effd640 1 -- 172.21.15.77:0/3742070421 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e00005040 con 0x7f5e100ff550 2024-09-18T21:13:25.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.970+0000 7f5e0f7fe640 1 --2- 172.21.15.77:0/3742070421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e10065a70 0x7f5e1010cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T21:13:25.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.971+0000 7f5e0effd640 1 --2- 172.21.15.77:0/3742070421 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e100ff550 0x7f5e1010d470 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5e04002f40 tx=0x7f5e0400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:13:25.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.971+0000 7f5df7fff640 1 -- 172.21.15.77:0/3742070421 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e04007c30 con 0x7f5e100ff550 2024-09-18T21:13:25.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.971+0000 7f5e14d12640 1 -- 172.21.15.77:0/3742070421 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e1010e4a0 con 0x7f5e100ff550 2024-09-18T21:13:25.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.971+0000 7f5df7fff640 1 -- 172.21.15.77:0/3742070421 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5e0400f040 con 0x7f5e100ff550 2024-09-18T21:13:25.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.972+0000 7f5df7fff640 1 -- 172.21.15.77:0/3742070421 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e0400cb20 con 0x7f5e100ff550 2024-09-18T21:13:25.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.972+0000 7f5e14d12640 1 -- 172.21.15.77:0/3742070421 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e1010ea40 con 0x7f5e100ff550 2024-09-18T21:13:25.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.972+0000 7f5df7fff640 1 -- 172.21.15.77:0/3742070421 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 24) v1 ==== 91488+0+0 (secure 0 0 0) 0x7f5e0400cc80 con 0x7f5e100ff550 2024-09-18T21:13:25.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.973+0000 7f5e14d12640 1 -- 172.21.15.77:0/3742070421 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e1005ed70 con 0x7f5e100ff550 2024-09-18T21:13:25.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.973+0000 7f5df7fff640 1 --2- 172.21.15.77:0/3742070421 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f5df806e4a0 0x7f5df8070950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:13:25.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.973+0000 7f5df7fff640 1 -- 172.21.15.77:0/3742070421 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f5e0408d600 con 0x7f5e100ff550 2024-09-18T21:13:25.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.973+0000 7f5e0f7fe640 1 --2- 172.21.15.77:0/3742070421 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f5df806e4a0 0x7f5df8070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:13:25.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.974+0000 7f5e0f7fe640 1 --2- 172.21.15.77:0/3742070421 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f5df806e4a0 0x7f5df8070950 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5e00000c00 tx=0x7f5e00035040 comp rx=0 tx=0).ready entity=mgr.14578 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:13:25.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:25.977+0000 7f5df7fff640 1 -- 172.21.15.77:0/3742070421 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f5e04057240 con 0x7f5e100ff550 2024-09-18T21:13:26.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.231+0000 7f5e14d12640 1 -- 172.21.15.77:0/3742070421 --> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5e1010edc0 con 0x7f5df806e4a0 2024-09-18T21:13:26.251 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T21:13:26.251 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager.smithi077 smithi077 *:9093,9094 starting - - - - 2024-09-18T21:13:26.251 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi077 smithi077 running (8m) 44s ago 8m 6899k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 0beb64a8c2ea 2024-09-18T21:13:26.251 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi103 smithi103 running (7m) 40s ago 7m 6891k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 04981ca7bf34 2024-09-18T21:13:26.252 INFO:teuthology.orchestra.run.smithi077.stdout:grafana.smithi077 smithi077 *:3000 starting - - - - 2024-09-18T21:13:26.252 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.cqfhlw smithi077 running (3m) 44s ago 2m 12.7M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 a7ec3b7701b6 2024-09-18T21:13:26.252 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.vruydi smithi077 running (3m) 44s ago 3m 171M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 affbba097d3b 2024-09-18T21:13:26.252 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi103.opftmf smithi103 running (2m) 40s ago 2m 14.8M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 111f884c5a34 2024-09-18T21:13:26.252 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi103.zhdmdg smithi103 running (3m) 40s ago 3m 14.8M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 50b77d0edda5 2024-09-18T21:13:26.252 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi077.utkpjg smithi077 *:9283,8765,8443 running (9m) 44s ago 9m 224M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 5d334eb01bea 2024-09-18T21:13:26.252 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi103.zjztqc smithi103 *:8443,9283 running (71s) 40s ago 7m 483M - 19.1.1-17-g06b1b1de f79f744f586d 0fe6f5f18bf6 2024-09-18T21:13:26.252 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi077 smithi077 running (9m) 44s ago 9m 50.7M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bcbf289fe027 2024-09-18T21:13:26.252 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi103 smithi103 running (7m) 40s ago 7m 40.8M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 d6ae2062e5e3 2024-09-18T21:13:26.252 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi077 smithi077 *:9100 starting - - - - 2024-09-18T21:13:26.252 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi103 smithi103 *:9100 running (7m) 40s ago 7m 16.7M - 1.5.0 0da6a335fe13 f7a4da7753f2 2024-09-18T21:13:26.252 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (6m) 44s ago 6m 120M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 2e3563c32cf5 2024-09-18T21:13:26.252 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi077 running (6m) 44s ago 6m 122M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 39c2ccbb7603 2024-09-18T21:13:26.253 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi077 running (5m) 44s ago 5m 110M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 2ff2728057e2 2024-09-18T21:13:26.253 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi103 running (5m) 40s ago 5m 128M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 0e72b1bbb8ce 2024-09-18T21:13:26.253 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi103 running (4m) 40s ago 4m 117M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 85f1ce1e8bee 2024-09-18T21:13:26.253 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi103 running (4m) 40s ago 4m 110M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 cf8964b3ac6d 2024-09-18T21:13:26.253 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus.smithi077 smithi077 *:9095 running (6m) 44s ago 7m 56.5M - 2.43.0 a07b618ecd1d 81e0f3809b2f 2024-09-18T21:13:26.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.250+0000 7f5df7fff640 1 -- 172.21.15.77:0/3742070421 <== mgr.14578 v2:172.21.15.103:6828/1199124716 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f5e1010edc0 con 0x7f5df806e4a0 2024-09-18T21:13:26.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.253+0000 7f5e14d12640 1 -- 172.21.15.77:0/3742070421 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f5df806e4a0 msgr2=0x7f5df8070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:13:26.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.253+0000 7f5e14d12640 1 --2- 172.21.15.77:0/3742070421 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f5df806e4a0 0x7f5df8070950 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5e00000c00 tx=0x7f5e00035040 comp rx=0 tx=0).stop 2024-09-18T21:13:26.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.253+0000 7f5e14d12640 1 -- 172.21.15.77:0/3742070421 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e100ff550 msgr2=0x7f5e1010d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:13:26.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.253+0000 7f5e14d12640 1 --2- 172.21.15.77:0/3742070421 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e100ff550 0x7f5e1010d470 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5e04002f40 tx=0x7f5e0400b040 comp rx=0 tx=0).stop 2024-09-18T21:13:26.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.254+0000 7f5e14d12640 1 -- 172.21.15.77:0/3742070421 shutdown_connections 2024-09-18T21:13:26.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.254+0000 7f5e14d12640 1 --2- 172.21.15.77:0/3742070421 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f5df806e4a0 0x7f5df8070950 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:26.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.254+0000 7f5e14d12640 1 --2- 172.21.15.77:0/3742070421 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e100ff550 0x7f5e1010d470 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:26.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.254+0000 7f5e14d12640 1 --2- 172.21.15.77:0/3742070421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e10065a70 0x7f5e1010cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:26.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.254+0000 7f5e14d12640 1 -- 172.21.15.77:0/3742070421 >> 172.21.15.77:0/3742070421 conn(0x7f5e100f6a40 msgr2=0x7f5e100f6e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:13:26.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.255+0000 7f5e14d12640 1 -- 172.21.15.77:0/3742070421 shutdown_connections 2024-09-18T21:13:26.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.255+0000 7f5e14d12640 1 -- 172.21.15.77:0/3742070421 wait complete. 2024-09-18T21:13:26.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.378+0000 7faaa6fea640 1 -- 172.21.15.77:0/1109029619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faaa00fc700 msgr2=0x7faaa00fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:13:26.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.378+0000 7faaa6fea640 1 --2- 172.21.15.77:0/1109029619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faaa00fc700 0x7faaa00fcb70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7faa8c0048d0 tx=0x7faa8c009da0 comp rx=0 tx=0).stop 2024-09-18T21:13:26.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.378+0000 7faaa6fea640 1 -- 172.21.15.77:0/1109029619 shutdown_connections 2024-09-18T21:13:26.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.378+0000 7faaa6fea640 1 --2- 172.21.15.77:0/1109029619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faaa00fc700 0x7faaa00fcb70 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:26.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.378+0000 7faaa6fea640 1 --2- 172.21.15.77:0/1109029619 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faaa00fb430 0x7faaa00fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:26.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.378+0000 7faaa6fea640 1 -- 172.21.15.77:0/1109029619 >> 172.21.15.77:0/1109029619 conn(0x7faaa00f6c10 msgr2=0x7faaa00f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:13:26.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.378+0000 7faaa6fea640 1 -- 172.21.15.77:0/1109029619 shutdown_connections 2024-09-18T21:13:26.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.378+0000 7faaa6fea640 1 -- 172.21.15.77:0/1109029619 wait complete. 2024-09-18T21:13:26.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.379+0000 7faaa6fea640 1 Processor -- start 2024-09-18T21:13:26.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.379+0000 7faaa6fea640 1 -- start start 2024-09-18T21:13:26.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.379+0000 7faaa6fea640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faaa00fb430 0x7faaa010d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:13:26.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.379+0000 7faaa6fea640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faaa00fc700 0x7faaa010d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:13:26.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.379+0000 7faaa6fea640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa010dbc0 con 0x7faaa00fc700 2024-09-18T21:13:26.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.379+0000 7faaa6fea640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa010e3e0 con 0x7faaa00fb430 2024-09-18T21:13:26.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.379+0000 7faa9ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faaa00fc700 0x7faaa010d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:13:26.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.379+0000 7faaa4d86640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faaa00fb430 0x7faaa010d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:13:26.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.379+0000 7faaa4d86640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faaa00fb430 0x7faaa010d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:43864/0 (socket says 172.21.15.77:43864) 2024-09-18T21:13:26.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.379+0000 7faaa4d86640 1 -- 172.21.15.77:0/642296666 learned_addr learned my addr 172.21.15.77:0/642296666 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:13:26.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.380+0000 7faaa4d86640 1 -- 172.21.15.77:0/642296666 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faaa00fc700 msgr2=0x7faaa010d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:13:26.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.380+0000 7faaa4d86640 1 --2- 172.21.15.77:0/642296666 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faaa00fc700 0x7faaa010d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:26.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.380+0000 7faaa4d86640 1 -- 172.21.15.77:0/642296666 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa8c005040 con 0x7faaa00fb430 2024-09-18T21:13:26.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.380+0000 7faaa4d86640 1 --2- 172.21.15.77:0/642296666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faaa00fb430 0x7faaa010d030 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7faa9400eb70 tx=0x7faa9400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:13:26.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.380+0000 7faa9d7fa640 1 -- 172.21.15.77:0/642296666 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa94007c30 con 0x7faaa00fb430 2024-09-18T21:13:26.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.381+0000 7faaa6fea640 1 -- 172.21.15.77:0/642296666 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaa010e610 con 0x7faaa00fb430 2024-09-18T21:13:26.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.381+0000 7faa9d7fa640 1 -- 172.21.15.77:0/642296666 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7faa9400f040 con 0x7faaa00fb430 2024-09-18T21:13:26.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.381+0000 7faa9d7fa640 1 -- 172.21.15.77:0/642296666 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa94009550 con 0x7faaa00fb430 2024-09-18T21:13:26.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.381+0000 7faaa6fea640 1 -- 172.21.15.77:0/642296666 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaa010ebb0 con 0x7faaa00fb430 2024-09-18T21:13:26.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.382+0000 7faaa6fea640 1 -- 172.21.15.77:0/642296666 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaa00fa890 con 0x7faaa00fb430 2024-09-18T21:13:26.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.383+0000 7faa9d7fa640 1 -- 172.21.15.77:0/642296666 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 24) v1 ==== 91488+0+0 (secure 0 0 0) 0x7faa940096b0 con 0x7faaa00fb430 2024-09-18T21:13:26.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.383+0000 7faa9d7fa640 1 --2- 172.21.15.77:0/642296666 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7faa9006e5c0 0x7faa90070a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:13:26.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.383+0000 7faa9d7fa640 1 -- 172.21.15.77:0/642296666 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5722+0+0 (secure 0 0 0) 0x7faa9408d850 con 0x7faaa00fb430 2024-09-18T21:13:26.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.383+0000 7faa9ffff640 1 --2- 172.21.15.77:0/642296666 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7faa9006e5c0 0x7faa90070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:13:26.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.384+0000 7faa9ffff640 1 --2- 172.21.15.77:0/642296666 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7faa9006e5c0 0x7faa90070a70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7faaa010cde0 tx=0x7faa8c035040 comp rx=0 tx=0).ready entity=mgr.14578 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:13:26.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.388+0000 7faa9d7fa640 1 -- 172.21.15.77:0/642296666 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7faa94050670 con 0x7faaa00fb430 2024-09-18T21:13:26.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:26 smithi077 ceph-mon[27689]: pgmap v34: 65 pgs: 65 active+clean; 1.1 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 2.7 MiB/s rd, 14 MiB/s wr, 275 op/s 2024-09-18T21:13:26.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.722+0000 7faaa6fea640 1 -- 172.21.15.77:0/642296666 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7faaa004b720 con 0x7faaa00fb430 2024-09-18T21:13:26.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.723+0000 7faa9d7fa640 1 -- 172.21.15.77:0/642296666 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+853 (secure 0 0 0) 0x7faa940573f0 con 0x7faaa00fb430 2024-09-18T21:13:26.724 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-18T21:13:26.724 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": { 2024-09-18T21:13:26.724 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 2 2024-09-18T21:13:26.724 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:13:26.724 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": { 2024-09-18T21:13:26.724 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 1, 2024-09-18T21:13:26.724 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 1 2024-09-18T21:13:26.724 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:13:26.724 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": { 2024-09-18T21:13:26.724 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 6 2024-09-18T21:13:26.724 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:13:26.724 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-09-18T21:13:26.725 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4 2024-09-18T21:13:26.725 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:13:26.725 INFO:teuthology.orchestra.run.smithi077.stdout: "overall": { 2024-09-18T21:13:26.725 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 13, 2024-09-18T21:13:26.725 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 1 2024-09-18T21:13:26.725 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-18T21:13:26.725 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-18T21:13:26.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.725+0000 7faaa6fea640 1 -- 172.21.15.77:0/642296666 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7faa9006e5c0 msgr2=0x7faa90070a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:13:26.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.725+0000 7faaa6fea640 1 --2- 172.21.15.77:0/642296666 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7faa9006e5c0 0x7faa90070a70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7faaa010cde0 tx=0x7faa8c035040 comp rx=0 tx=0).stop 2024-09-18T21:13:26.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.725+0000 7faaa6fea640 1 -- 172.21.15.77:0/642296666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faaa00fb430 msgr2=0x7faaa010d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:13:26.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.725+0000 7faaa6fea640 1 --2- 172.21.15.77:0/642296666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faaa00fb430 0x7faaa010d030 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7faa9400eb70 tx=0x7faa9400b040 comp rx=0 tx=0).stop 2024-09-18T21:13:26.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.725+0000 7faaa6fea640 1 -- 172.21.15.77:0/642296666 shutdown_connections 2024-09-18T21:13:26.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.725+0000 7faaa6fea640 1 --2- 172.21.15.77:0/642296666 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7faa9006e5c0 0x7faa90070a70 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:26.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.725+0000 7faaa6fea640 1 --2- 172.21.15.77:0/642296666 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faaa00fc700 0x7faaa010d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:26.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.725+0000 7faaa6fea640 1 --2- 172.21.15.77:0/642296666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faaa00fb430 0x7faaa010d030 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:26.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.725+0000 7faaa6fea640 1 -- 172.21.15.77:0/642296666 >> 172.21.15.77:0/642296666 conn(0x7faaa00f6c10 msgr2=0x7faaa00656b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:13:26.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.725+0000 7faaa6fea640 1 -- 172.21.15.77:0/642296666 shutdown_connections 2024-09-18T21:13:26.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.725+0000 7faaa6fea640 1 -- 172.21.15.77:0/642296666 wait complete. 2024-09-18T21:13:26.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:26 smithi103 ceph-mon[34827]: pgmap v34: 65 pgs: 65 active+clean; 1.1 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 2.7 MiB/s rd, 14 MiB/s wr, 275 op/s 2024-09-18T21:13:26.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.813+0000 7f780badc640 1 -- 172.21.15.77:0/2165913718 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78040fb430 msgr2=0x7f78040fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:13:26.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.813+0000 7f780badc640 1 --2- 172.21.15.77:0/2165913718 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78040fb430 0x7f78040fb840 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f78000048d0 tx=0x7f7800009da0 comp rx=0 tx=0).stop 2024-09-18T21:13:26.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.813+0000 7f780badc640 1 -- 172.21.15.77:0/2165913718 shutdown_connections 2024-09-18T21:13:26.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.813+0000 7f780badc640 1 --2- 172.21.15.77:0/2165913718 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78040fc700 0x7f78040fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:26.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.813+0000 7f780badc640 1 --2- 172.21.15.77:0/2165913718 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78040fb430 0x7f78040fb840 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:26.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.813+0000 7f780badc640 1 -- 172.21.15.77:0/2165913718 >> 172.21.15.77:0/2165913718 conn(0x7f78040f6c10 msgr2=0x7f78040f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:13:26.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.813+0000 7f780badc640 1 -- 172.21.15.77:0/2165913718 shutdown_connections 2024-09-18T21:13:26.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.813+0000 7f780badc640 1 -- 172.21.15.77:0/2165913718 wait complete. 2024-09-18T21:13:26.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.814+0000 7f780badc640 1 Processor -- start 2024-09-18T21:13:26.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.814+0000 7f780badc640 1 -- start start 2024-09-18T21:13:26.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.814+0000 7f780badc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78040fb430 0x7f78040ff550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:13:26.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.814+0000 7f780badc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78040fc700 0x7f78040fda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:13:26.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.814+0000 7f780badc640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78040fdfd0 con 0x7f78040fb430 2024-09-18T21:13:26.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.814+0000 7f780badc640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78040fe110 con 0x7f78040fc700 2024-09-18T21:13:26.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.814+0000 7f7809878640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78040fb430 0x7f78040ff550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:13:26.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.814+0000 7f7809878640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78040fb430 0x7f78040ff550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42902/0 (socket says 172.21.15.77:42902) 2024-09-18T21:13:26.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.814+0000 7f7809878640 1 -- 172.21.15.77:0/2485836507 learned_addr learned my addr 172.21.15.77:0/2485836507 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:13:26.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.815+0000 7f7809077640 1 --2- 172.21.15.77:0/2485836507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78040fc700 0x7f78040fda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:13:26.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.815+0000 7f7809878640 1 -- 172.21.15.77:0/2485836507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78040fc700 msgr2=0x7f78040fda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:13:26.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.815+0000 7f7809878640 1 --2- 172.21.15.77:0/2485836507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78040fc700 0x7f78040fda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:26.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.815+0000 7f7809878640 1 -- 172.21.15.77:0/2485836507 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7800005040 con 0x7f78040fb430 2024-09-18T21:13:26.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.815+0000 7f7809077640 1 --2- 172.21.15.77:0/2485836507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78040fc700 0x7f78040fda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T21:13:26.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.815+0000 7f7809878640 1 --2- 172.21.15.77:0/2485836507 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78040fb430 0x7f78040ff550 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f78000048a0 tx=0x7f7800009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:13:26.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.815+0000 7f77fa7fc640 1 -- 172.21.15.77:0/2485836507 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7800038070 con 0x7f78040fb430 2024-09-18T21:13:26.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.815+0000 7f77fa7fc640 1 -- 172.21.15.77:0/2485836507 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7800004290 con 0x7f78040fb430 2024-09-18T21:13:26.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.815+0000 7f780badc640 1 -- 172.21.15.77:0/2485836507 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78040fe390 con 0x7f78040fb430 2024-09-18T21:13:26.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.815+0000 7f77fa7fc640 1 -- 172.21.15.77:0/2485836507 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7800033660 con 0x7f78040fb430 2024-09-18T21:13:26.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.816+0000 7f780badc640 1 -- 172.21.15.77:0/2485836507 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78041150d0 con 0x7f78040fb430 2024-09-18T21:13:26.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.816+0000 7f780badc640 1 -- 172.21.15.77:0/2485836507 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78040fa890 con 0x7f78040fb430 2024-09-18T21:13:26.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.818+0000 7f77fa7fc640 1 -- 172.21.15.77:0/2485836507 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 24) v1 ==== 91488+0+0 (secure 0 0 0) 0x7f7800030020 con 0x7f78040fb430 2024-09-18T21:13:26.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.819+0000 7f77fa7fc640 1 --2- 172.21.15.77:0/2485836507 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f77f006e4a0 0x7f77f0070950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:13:26.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.819+0000 7f77fa7fc640 1 -- 172.21.15.77:0/2485836507 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f78000adc30 con 0x7f78040fb430 2024-09-18T21:13:26.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.819+0000 7f7809077640 1 --2- 172.21.15.77:0/2485836507 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f77f006e4a0 0x7f77f0070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:13:26.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.820+0000 7f7809077640 1 --2- 172.21.15.77:0/2485836507 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f77f006e4a0 0x7f77f0070950 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f77f4004fd0 tx=0x7f77f400b040 comp rx=0 tx=0).ready entity=mgr.14578 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:13:26.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:26.822+0000 7f77fa7fc640 1 -- 172.21.15.77:0/2485836507 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f78000779a0 con 0x7f78040fb430 2024-09-18T21:13:27.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.118+0000 7f780badc640 1 -- 172.21.15.77:0/2485836507 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7804103eb0 con 0x7f78040fb430 2024-09-18T21:13:27.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.118+0000 7f77fa7fc640 1 -- 172.21.15.77:0/2485836507 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1807 (secure 0 0 0) 0x7f780002c870 con 0x7f78040fb430 2024-09-18T21:13:27.119 INFO:teuthology.orchestra.run.smithi077.stdout:e13 2024-09-18T21:13:27.119 INFO:teuthology.orchestra.run.smithi077.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T21:13:27.120 INFO:teuthology.orchestra.run.smithi077.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T21:13:27.120 INFO:teuthology.orchestra.run.smithi077.stdout:legacy client fscid: 1 2024-09-18T21:13:27.120 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:13:27.120 INFO:teuthology.orchestra.run.smithi077.stdout:Filesystem 'cephfs' (1) 2024-09-18T21:13:27.120 INFO:teuthology.orchestra.run.smithi077.stdout:fs_name cephfs 2024-09-18T21:13:27.120 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 13 2024-09-18T21:13:27.120 INFO:teuthology.orchestra.run.smithi077.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T21:13:27.120 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-09-18T21:10:17.230179+0000 2024-09-18T21:13:27.120 INFO:teuthology.orchestra.run.smithi077.stdout:modified 2024-09-18T21:10:33.373241+0000 2024-09-18T21:13:27.120 INFO:teuthology.orchestra.run.smithi077.stdout:tableserver 0 2024-09-18T21:13:27.120 INFO:teuthology.orchestra.run.smithi077.stdout:root 0 2024-09-18T21:13:27.120 INFO:teuthology.orchestra.run.smithi077.stdout:session_timeout 60 2024-09-18T21:13:27.120 INFO:teuthology.orchestra.run.smithi077.stdout:session_autoclose 300 2024-09-18T21:13:27.121 INFO:teuthology.orchestra.run.smithi077.stdout:max_file_size 1099511627776 2024-09-18T21:13:27.121 INFO:teuthology.orchestra.run.smithi077.stdout:required_client_features {} 2024-09-18T21:13:27.121 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure 0 2024-09-18T21:13:27.121 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure_osd_epoch 0 2024-09-18T21:13:27.121 INFO:teuthology.orchestra.run.smithi077.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T21:13:27.121 INFO:teuthology.orchestra.run.smithi077.stdout:max_mds 1 2024-09-18T21:13:27.121 INFO:teuthology.orchestra.run.smithi077.stdout:in 0 2024-09-18T21:13:27.121 INFO:teuthology.orchestra.run.smithi077.stdout:up {0=14446} 2024-09-18T21:13:27.121 INFO:teuthology.orchestra.run.smithi077.stdout:failed 2024-09-18T21:13:27.121 INFO:teuthology.orchestra.run.smithi077.stdout:damaged 2024-09-18T21:13:27.121 INFO:teuthology.orchestra.run.smithi077.stdout:stopped 2024-09-18T21:13:27.121 INFO:teuthology.orchestra.run.smithi077.stdout:data_pools [3] 2024-09-18T21:13:27.122 INFO:teuthology.orchestra.run.smithi077.stdout:metadata_pool 2 2024-09-18T21:13:27.122 INFO:teuthology.orchestra.run.smithi077.stdout:inline_data disabled 2024-09-18T21:13:27.122 INFO:teuthology.orchestra.run.smithi077.stdout:balancer 2024-09-18T21:13:27.122 INFO:teuthology.orchestra.run.smithi077.stdout:standby_count_wanted 1 2024-09-18T21:13:27.122 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.vruydi{0:14446} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.77:6826/334039954,v1:172.21.15.77:6827/334039954] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:13:27.122 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:13:27.122 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:13:27.122 INFO:teuthology.orchestra.run.smithi077.stdout:Standby daemons: 2024-09-18T21:13:27.122 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:13:27.122 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.cqfhlw{-1:14458} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.77:6828/862540650,v1:172.21.15.77:6829/862540650] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:13:27.122 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi103.zhdmdg{-1:24255} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.103:6824/2170237078,v1:172.21.15.103:6825/2170237078] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:13:27.122 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi103.opftmf{-1:24267} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.103:6826/4241818403,v1:172.21.15.103:6827/4241818403] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:13:27.123 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 13 2024-09-18T21:13:27.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.120+0000 7f780badc640 1 -- 172.21.15.77:0/2485836507 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f77f006e4a0 msgr2=0x7f77f0070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:13:27.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.120+0000 7f780badc640 1 --2- 172.21.15.77:0/2485836507 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f77f006e4a0 0x7f77f0070950 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f77f4004fd0 tx=0x7f77f400b040 comp rx=0 tx=0).stop 2024-09-18T21:13:27.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.120+0000 7f780badc640 1 -- 172.21.15.77:0/2485836507 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78040fb430 msgr2=0x7f78040ff550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:13:27.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.120+0000 7f780badc640 1 --2- 172.21.15.77:0/2485836507 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78040fb430 0x7f78040ff550 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f78000048a0 tx=0x7f7800009da0 comp rx=0 tx=0).stop 2024-09-18T21:13:27.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.120+0000 7f780badc640 1 -- 172.21.15.77:0/2485836507 shutdown_connections 2024-09-18T21:13:27.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.120+0000 7f780badc640 1 --2- 172.21.15.77:0/2485836507 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f77f006e4a0 0x7f77f0070950 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:27.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.120+0000 7f780badc640 1 --2- 172.21.15.77:0/2485836507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78040fc700 0x7f78040fda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:27.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.120+0000 7f780badc640 1 --2- 172.21.15.77:0/2485836507 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78040fb430 0x7f78040ff550 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:27.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.120+0000 7f780badc640 1 -- 172.21.15.77:0/2485836507 >> 172.21.15.77:0/2485836507 conn(0x7f78040f6c10 msgr2=0x7f78040655f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:13:27.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.120+0000 7f780badc640 1 -- 172.21.15.77:0/2485836507 shutdown_connections 2024-09-18T21:13:27.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.121+0000 7f780badc640 1 -- 172.21.15.77:0/2485836507 wait complete. 2024-09-18T21:13:27.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.241+0000 7f3edaa0b640 1 -- 172.21.15.77:0/3977082508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ed40fc700 msgr2=0x7f3ed40fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:13:27.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.241+0000 7f3edaa0b640 1 --2- 172.21.15.77:0/3977082508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ed40fc700 0x7f3ed40fcb70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc004810 tx=0x7f3ebc009da0 comp rx=0 tx=0).stop 2024-09-18T21:13:27.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.241+0000 7f3edaa0b640 1 -- 172.21.15.77:0/3977082508 shutdown_connections 2024-09-18T21:13:27.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.241+0000 7f3edaa0b640 1 --2- 172.21.15.77:0/3977082508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ed40fc700 0x7f3ed40fcb70 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:27.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.241+0000 7f3edaa0b640 1 --2- 172.21.15.77:0/3977082508 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ed40fb430 0x7f3ed40fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:27.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.241+0000 7f3edaa0b640 1 -- 172.21.15.77:0/3977082508 >> 172.21.15.77:0/3977082508 conn(0x7f3ed40f6c10 msgr2=0x7f3ed40f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:13:27.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.242+0000 7f3edaa0b640 1 -- 172.21.15.77:0/3977082508 shutdown_connections 2024-09-18T21:13:27.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.242+0000 7f3edaa0b640 1 -- 172.21.15.77:0/3977082508 wait complete. 2024-09-18T21:13:27.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.243+0000 7f3edaa0b640 1 Processor -- start 2024-09-18T21:13:27.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.243+0000 7f3edaa0b640 1 -- start start 2024-09-18T21:13:27.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.244+0000 7f3edaa0b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ed40fb430 0x7f3ed410ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:13:27.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.244+0000 7f3edaa0b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ed40fc700 0x7f3ed410b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:13:27.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.244+0000 7f3edaa0b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed410b920 con 0x7f3ed40fc700 2024-09-18T21:13:27.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.244+0000 7f3edaa0b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed410c1e0 con 0x7f3ed40fb430 2024-09-18T21:13:27.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.244+0000 7f3ed3fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ed40fb430 0x7f3ed410ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:13:27.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.244+0000 7f3ed3fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ed40fb430 0x7f3ed410ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:43902/0 (socket says 172.21.15.77:43902) 2024-09-18T21:13:27.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.245+0000 7f3ecb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ed40fc700 0x7f3ed410b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:13:27.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.245+0000 7f3ed3fff640 1 -- 172.21.15.77:0/3884214309 learned_addr learned my addr 172.21.15.77:0/3884214309 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:13:27.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.245+0000 7f3ed3fff640 1 -- 172.21.15.77:0/3884214309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ed40fc700 msgr2=0x7f3ed410b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:13:27.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.245+0000 7f3ed3fff640 1 --2- 172.21.15.77:0/3884214309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ed40fc700 0x7f3ed410b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:27.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.245+0000 7f3ed3fff640 1 -- 172.21.15.77:0/3884214309 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ebc005040 con 0x7f3ed40fb430 2024-09-18T21:13:27.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.245+0000 7f3ed3fff640 1 --2- 172.21.15.77:0/3884214309 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ed40fb430 0x7f3ed410ade0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3ec400eb40 tx=0x7f3ec400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:13:27.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.247+0000 7f3ed17fa640 1 -- 172.21.15.77:0/3884214309 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ec4007c30 con 0x7f3ed40fb430 2024-09-18T21:13:27.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.247+0000 7f3ed17fa640 1 -- 172.21.15.77:0/3884214309 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3ec400f040 con 0x7f3ed40fb430 2024-09-18T21:13:27.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.247+0000 7f3edaa0b640 1 -- 172.21.15.77:0/3884214309 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ed410c460 con 0x7f3ed40fb430 2024-09-18T21:13:27.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.247+0000 7f3ed17fa640 1 -- 172.21.15.77:0/3884214309 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ec400caa0 con 0x7f3ed40fb430 2024-09-18T21:13:27.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.247+0000 7f3edaa0b640 1 -- 172.21.15.77:0/3884214309 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ed410ca00 con 0x7f3ed40fb430 2024-09-18T21:13:27.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.249+0000 7f3edaa0b640 1 -- 172.21.15.77:0/3884214309 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ed40fa890 con 0x7f3ed40fb430 2024-09-18T21:13:27.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.251+0000 7f3ed17fa640 1 -- 172.21.15.77:0/3884214309 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 24) v1 ==== 91488+0+0 (secure 0 0 0) 0x7f3ec4009670 con 0x7f3ed40fb430 2024-09-18T21:13:27.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.251+0000 7f3ed17fa640 1 --2- 172.21.15.77:0/3884214309 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f3ec006e570 0x7f3ec0070a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:13:27.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.251+0000 7f3ed17fa640 1 -- 172.21.15.77:0/3884214309 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f3ec405f430 con 0x7f3ed40fb430 2024-09-18T21:13:27.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.252+0000 7f3ecb7fe640 1 --2- 172.21.15.77:0/3884214309 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f3ec006e570 0x7f3ec0070a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:13:27.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.253+0000 7f3ecb7fe640 1 --2- 172.21.15.77:0/3884214309 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f3ec006e570 0x7f3ec0070a20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc003080 tx=0x7f3ebc035040 comp rx=0 tx=0).ready entity=mgr.14578 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:13:27.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.258+0000 7f3ed17fa640 1 -- 172.21.15.77:0/3884214309 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f3ec4057b60 con 0x7f3ed40fb430 2024-09-18T21:13:27.522 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:27 smithi077 ceph-mon[27689]: from='client.14662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:13:27.522 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:27 smithi077 ceph-mon[27689]: from='client.24449 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:13:27.522 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:27 smithi077 ceph-mon[27689]: from='client.14670 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:13:27.522 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:27 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/642296666' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:13:27.522 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:27 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/2485836507' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T21:13:27.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.521+0000 7f3edaa0b640 1 -- 172.21.15.77:0/3884214309 --> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ed410cd80 con 0x7f3ec006e570 2024-09-18T21:13:27.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.522+0000 7f3ed17fa640 1 -- 172.21.15.77:0/3884214309 <== mgr.14578 v2:172.21.15.103:6828/1199124716 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f3ed410cd80 con 0x7f3ec006e570 2024-09-18T21:13:27.523 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-18T21:13:27.523 INFO:teuthology.orchestra.run.smithi077.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a", 2024-09-18T21:13:27.523 INFO:teuthology.orchestra.run.smithi077.stdout: "in_progress": true, 2024-09-18T21:13:27.523 INFO:teuthology.orchestra.run.smithi077.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T21:13:27.523 INFO:teuthology.orchestra.run.smithi077.stdout: "services_complete": [], 2024-09-18T21:13:27.523 INFO:teuthology.orchestra.run.smithi077.stdout: "progress": "1/21 daemons upgraded", 2024-09-18T21:13:27.523 INFO:teuthology.orchestra.run.smithi077.stdout: "message": "", 2024-09-18T21:13:27.523 INFO:teuthology.orchestra.run.smithi077.stdout: "is_paused": false 2024-09-18T21:13:27.524 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-18T21:13:27.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.525+0000 7f3edaa0b640 1 -- 172.21.15.77:0/3884214309 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f3ec006e570 msgr2=0x7f3ec0070a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:13:27.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.525+0000 7f3edaa0b640 1 --2- 172.21.15.77:0/3884214309 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f3ec006e570 0x7f3ec0070a20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc003080 tx=0x7f3ebc035040 comp rx=0 tx=0).stop 2024-09-18T21:13:27.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.525+0000 7f3edaa0b640 1 -- 172.21.15.77:0/3884214309 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ed40fb430 msgr2=0x7f3ed410ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:13:27.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.525+0000 7f3edaa0b640 1 --2- 172.21.15.77:0/3884214309 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ed40fb430 0x7f3ed410ade0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3ec400eb40 tx=0x7f3ec400b040 comp rx=0 tx=0).stop 2024-09-18T21:13:27.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.525+0000 7f3edaa0b640 1 -- 172.21.15.77:0/3884214309 shutdown_connections 2024-09-18T21:13:27.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.525+0000 7f3edaa0b640 1 --2- 172.21.15.77:0/3884214309 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f3ec006e570 0x7f3ec0070a20 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:27.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.525+0000 7f3edaa0b640 1 --2- 172.21.15.77:0/3884214309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ed40fc700 0x7f3ed410b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:27.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.525+0000 7f3edaa0b640 1 --2- 172.21.15.77:0/3884214309 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ed40fb430 0x7f3ed410ade0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:27.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.525+0000 7f3edaa0b640 1 -- 172.21.15.77:0/3884214309 >> 172.21.15.77:0/3884214309 conn(0x7f3ed40f6c10 msgr2=0x7f3ed40f83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:13:27.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.525+0000 7f3edaa0b640 1 -- 172.21.15.77:0/3884214309 shutdown_connections 2024-09-18T21:13:27.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.525+0000 7f3edaa0b640 1 -- 172.21.15.77:0/3884214309 wait complete. 2024-09-18T21:13:27.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.633+0000 7f2d1ab63640 1 -- 172.21.15.77:0/1125203253 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d140fc700 msgr2=0x7f2d140fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:13:27.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.633+0000 7f2d1ab63640 1 --2- 172.21.15.77:0/1125203253 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d140fc700 0x7f2d140fcb70 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2d000048d0 tx=0x7f2d00009da0 comp rx=0 tx=0).stop 2024-09-18T21:13:27.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.633+0000 7f2d1ab63640 1 -- 172.21.15.77:0/1125203253 shutdown_connections 2024-09-18T21:13:27.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.633+0000 7f2d1ab63640 1 --2- 172.21.15.77:0/1125203253 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d140fc700 0x7f2d140fcb70 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:27.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.633+0000 7f2d1ab63640 1 --2- 172.21.15.77:0/1125203253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d140fb430 0x7f2d140fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:27.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.633+0000 7f2d1ab63640 1 -- 172.21.15.77:0/1125203253 >> 172.21.15.77:0/1125203253 conn(0x7f2d140f6c10 msgr2=0x7f2d140f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:13:27.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.634+0000 7f2d1ab63640 1 -- 172.21.15.77:0/1125203253 shutdown_connections 2024-09-18T21:13:27.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.634+0000 7f2d1ab63640 1 -- 172.21.15.77:0/1125203253 wait complete. 2024-09-18T21:13:27.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.634+0000 7f2d1ab63640 1 Processor -- start 2024-09-18T21:13:27.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.634+0000 7f2d1ab63640 1 -- start start 2024-09-18T21:13:27.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.635+0000 7f2d1ab63640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d140fb430 0x7f2d1410bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:13:27.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.635+0000 7f2d1ab63640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d140fc700 0x7f2d1410c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:13:27.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.635+0000 7f2d1ab63640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1410cad0 con 0x7f2d140fc700 2024-09-18T21:13:27.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.635+0000 7f2d1ab63640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1410d2f0 con 0x7f2d140fb430 2024-09-18T21:13:27.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.635+0000 7f2d13fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d140fc700 0x7f2d1410c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:13:27.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.635+0000 7f2d13fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d140fc700 0x7f2d1410c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42934/0 (socket says 172.21.15.77:42934) 2024-09-18T21:13:27.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.635+0000 7f2d13fff640 1 -- 172.21.15.77:0/644940319 learned_addr learned my addr 172.21.15.77:0/644940319 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:13:27.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.635+0000 7f2d188ff640 1 --2- 172.21.15.77:0/644940319 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d140fb430 0x7f2d1410bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:13:27.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.636+0000 7f2d188ff640 1 -- 172.21.15.77:0/644940319 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d140fc700 msgr2=0x7f2d1410c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:13:27.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.636+0000 7f2d188ff640 1 --2- 172.21.15.77:0/644940319 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d140fc700 0x7f2d1410c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:27.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.636+0000 7f2d188ff640 1 -- 172.21.15.77:0/644940319 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d00005040 con 0x7f2d140fb430 2024-09-18T21:13:27.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.636+0000 7f2d13fff640 1 --2- 172.21.15.77:0/644940319 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d140fc700 0x7f2d1410c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T21:13:27.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.636+0000 7f2d188ff640 1 --2- 172.21.15.77:0/644940319 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d140fb430 0x7f2d1410bf40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2d0800e910 tx=0x7f2d0800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:13:27.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.636+0000 7f2d117fa640 1 -- 172.21.15.77:0/644940319 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d08007c30 con 0x7f2d140fb430 2024-09-18T21:13:27.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.636+0000 7f2d1ab63640 1 -- 172.21.15.77:0/644940319 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d1410d4f0 con 0x7f2d140fb430 2024-09-18T21:13:27.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.636+0000 7f2d117fa640 1 -- 172.21.15.77:0/644940319 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2d0800f040 con 0x7f2d140fb430 2024-09-18T21:13:27.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.636+0000 7f2d117fa640 1 -- 172.21.15.77:0/644940319 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d08007c30 con 0x7f2d140fb430 2024-09-18T21:13:27.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.636+0000 7f2d1ab63640 1 -- 172.21.15.77:0/644940319 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d1410da90 con 0x7f2d140fb430 2024-09-18T21:13:27.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.637+0000 7f2d1ab63640 1 -- 172.21.15.77:0/644940319 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d140fa890 con 0x7f2d140fb430 2024-09-18T21:13:27.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.638+0000 7f2d117fa640 1 -- 172.21.15.77:0/644940319 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 24) v1 ==== 91488+0+0 (secure 0 0 0) 0x7f2d0800c6a0 con 0x7f2d140fb430 2024-09-18T21:13:27.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.638+0000 7f2d117fa640 1 --2- 172.21.15.77:0/644940319 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f2d0406e560 0x7f2d04070a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:13:27.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.638+0000 7f2d117fa640 1 -- 172.21.15.77:0/644940319 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f2d0808d350 con 0x7f2d140fb430 2024-09-18T21:13:27.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.638+0000 7f2d13fff640 1 --2- 172.21.15.77:0/644940319 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f2d0406e560 0x7f2d04070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:13:27.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.639+0000 7f2d13fff640 1 --2- 172.21.15.77:0/644940319 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f2d0406e560 0x7f2d04070a10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2d1410bcf0 tx=0x7f2d00035040 comp rx=0 tx=0).ready entity=mgr.14578 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:13:27.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:27.643+0000 7f2d117fa640 1 -- 172.21.15.77:0/644940319 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f2d08050670 con 0x7f2d140fb430 2024-09-18T21:13:27.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:27 smithi103 ceph-mon[34827]: from='client.14662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:13:27.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:27 smithi103 ceph-mon[34827]: from='client.24449 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:13:27.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:27 smithi103 ceph-mon[34827]: from='client.14670 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:13:27.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:27 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/642296666' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:13:27.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:27 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/2485836507' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T21:13:28.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:28.022+0000 7f2d1ab63640 1 -- 172.21.15.77:0/644940319 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f2d14103e30 con 0x7f2d140fb430 2024-09-18T21:13:28.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:28.023+0000 7f2d117fa640 1 -- 172.21.15.77:0/644940319 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f2d08056f10 con 0x7f2d140fb430 2024-09-18T21:13:28.024 INFO:teuthology.orchestra.run.smithi077.stdout:HEALTH_OK 2024-09-18T21:13:28.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:28.025+0000 7f2d1ab63640 1 -- 172.21.15.77:0/644940319 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f2d0406e560 msgr2=0x7f2d04070a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:13:28.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:28.025+0000 7f2d1ab63640 1 --2- 172.21.15.77:0/644940319 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f2d0406e560 0x7f2d04070a10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2d1410bcf0 tx=0x7f2d00035040 comp rx=0 tx=0).stop 2024-09-18T21:13:28.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:28.025+0000 7f2d1ab63640 1 -- 172.21.15.77:0/644940319 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d140fb430 msgr2=0x7f2d1410bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:13:28.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:28.025+0000 7f2d1ab63640 1 --2- 172.21.15.77:0/644940319 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d140fb430 0x7f2d1410bf40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2d0800e910 tx=0x7f2d0800b040 comp rx=0 tx=0).stop 2024-09-18T21:13:28.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:28.025+0000 7f2d1ab63640 1 -- 172.21.15.77:0/644940319 shutdown_connections 2024-09-18T21:13:28.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:28.025+0000 7f2d1ab63640 1 --2- 172.21.15.77:0/644940319 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f2d0406e560 0x7f2d04070a10 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:28.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:28.025+0000 7f2d1ab63640 1 --2- 172.21.15.77:0/644940319 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d140fc700 0x7f2d1410c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:28.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:28.025+0000 7f2d1ab63640 1 --2- 172.21.15.77:0/644940319 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d140fb430 0x7f2d1410bf40 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:28.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:28.025+0000 7f2d1ab63640 1 -- 172.21.15.77:0/644940319 >> 172.21.15.77:0/644940319 conn(0x7f2d140f6c10 msgr2=0x7f2d140f83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:13:28.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:28.025+0000 7f2d1ab63640 1 -- 172.21.15.77:0/644940319 shutdown_connections 2024-09-18T21:13:28.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:28.025+0000 7f2d1ab63640 1 -- 172.21.15.77:0/644940319 wait complete. 2024-09-18T21:13:28.142 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-18T21:13:28.142 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-18T21:13:28.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:28 smithi077 ceph-mon[27689]: pgmap v35: 65 pgs: 65 active+clean; 1.1 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 27 KiB/s rd, 1.4 MiB/s wr, 188 op/s 2024-09-18T21:13:28.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:28 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/644940319' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T21:13:28.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:28 smithi103 ceph-mon[34827]: pgmap v35: 65 pgs: 65 active+clean; 1.1 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 27 KiB/s rd, 1.4 MiB/s wr, 188 op/s 2024-09-18T21:13:28.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:28 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/644940319' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T21:13:29.527 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:29 smithi077 ceph-mon[27689]: from='client.24465 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:13:29.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:29 smithi103 ceph-mon[34827]: from='client.24465 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:13:30.563 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:30 smithi103 ceph-mon[34827]: pgmap v36: 65 pgs: 65 active+clean; 374 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 44 KiB/s rd, 2.1 MiB/s wr, 330 op/s 2024-09-18T21:13:30.563 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:30 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:30.564 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:30 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:30.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:30 smithi077 ceph-mon[27689]: pgmap v36: 65 pgs: 65 active+clean; 374 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 44 KiB/s rd, 2.1 MiB/s wr, 330 op/s 2024-09-18T21:13:30.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:30 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:30.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:30 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:31.701 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:31 smithi103 ceph-mon[34827]: Reconfiguring node-exporter.smithi103 (dependencies changed)... 2024-09-18T21:13:31.701 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:31 smithi103 ceph-mon[34827]: Reconfiguring daemon node-exporter.smithi103 on smithi103 2024-09-18T21:13:31.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:31 smithi077 ceph-mon[27689]: Reconfiguring node-exporter.smithi103 (dependencies changed)... 2024-09-18T21:13:31.743 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:31 smithi077 ceph-mon[27689]: Reconfiguring daemon node-exporter.smithi103 on smithi103 2024-09-18T21:13:32.614 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:32 smithi077 ceph-mon[27689]: pgmap v37: 65 pgs: 65 active+clean; 374 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 29 KiB/s rd, 1.9 MiB/s wr, 291 op/s 2024-09-18T21:13:32.615 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:32 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:32.615 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:32 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:32.615 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:32 smithi077 ceph-mon[27689]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-18T21:13:32.615 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:32 smithi077 ceph-mon[27689]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-18T21:13:32.615 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:32 smithi077 ceph-mon[27689]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T21:13:32.615 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:32 smithi077 ceph-mon[27689]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:13:32.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:32 smithi103 ceph-mon[34827]: pgmap v37: 65 pgs: 65 active+clean; 374 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 29 KiB/s rd, 1.9 MiB/s wr, 291 op/s 2024-09-18T21:13:32.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:32 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:32.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:32 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:32.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:32 smithi103 ceph-mon[34827]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-18T21:13:32.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:32 smithi103 ceph-mon[34827]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-18T21:13:32.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:32 smithi103 ceph-mon[34827]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T21:13:32.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:32 smithi103 ceph-mon[34827]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:13:33.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:33 smithi077 ceph-mon[27689]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-18T21:13:33.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:33 smithi077 ceph-mon[27689]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-18T21:13:33.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:33 smithi077 ceph-mon[27689]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T21:13:33.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:33 smithi077 ceph-mon[27689]: Upgrade: Need to upgrade myself (mgr.smithi103.zjztqc) 2024-09-18T21:13:33.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:33 smithi077 ceph-mon[27689]: Upgrade: Need to upgrade myself (mgr.smithi103.zjztqc) 2024-09-18T21:13:33.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:33 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:33.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:33 smithi077 ceph-mon[27689]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi077.utkpjg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T21:13:33.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:33 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi077.utkpjg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T21:13:33.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:33 smithi077 ceph-mon[27689]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T21:13:33.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:33 smithi077 ceph-mon[27689]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:13:33.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:33 smithi103 ceph-mon[34827]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-18T21:13:33.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:33 smithi103 ceph-mon[34827]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-18T21:13:33.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:33 smithi103 ceph-mon[34827]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T21:13:33.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:33 smithi103 ceph-mon[34827]: Upgrade: Need to upgrade myself (mgr.smithi103.zjztqc) 2024-09-18T21:13:33.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:33 smithi103 ceph-mon[34827]: Upgrade: Need to upgrade myself (mgr.smithi103.zjztqc) 2024-09-18T21:13:33.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:33 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:33.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:33 smithi103 ceph-mon[34827]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi077.utkpjg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T21:13:33.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:33 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi077.utkpjg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T21:13:33.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:33 smithi103 ceph-mon[34827]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T21:13:33.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:33 smithi103 ceph-mon[34827]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:13:34.692 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:34 smithi103 ceph-mon[34827]: pgmap v38: 65 pgs: 65 active+clean; 374 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 29 KiB/s rd, 1.3 MiB/s wr, 232 op/s 2024-09-18T21:13:34.692 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:34 smithi103 ceph-mon[34827]: Upgrade: Updating mgr.smithi077.utkpjg 2024-09-18T21:13:34.693 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:34 smithi103 ceph-mon[34827]: Deploying daemon mgr.smithi077.utkpjg on smithi077 2024-09-18T21:13:34.699 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:34 smithi077 ceph-mon[27689]: pgmap v38: 65 pgs: 65 active+clean; 374 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 29 KiB/s rd, 1.3 MiB/s wr, 232 op/s 2024-09-18T21:13:34.699 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:34 smithi077 ceph-mon[27689]: Upgrade: Updating mgr.smithi077.utkpjg 2024-09-18T21:13:34.699 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:34 smithi077 ceph-mon[27689]: Deploying daemon mgr.smithi077.utkpjg on smithi077 2024-09-18T21:13:36.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:36 smithi077 ceph-mon[27689]: pgmap v39: 65 pgs: 65 active+clean; 285 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 48 KiB/s rd, 2.1 MiB/s wr, 380 op/s 2024-09-18T21:13:36.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:36 smithi103 ceph-mon[34827]: pgmap v39: 65 pgs: 65 active+clean; 285 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 48 KiB/s rd, 2.1 MiB/s wr, 380 op/s 2024-09-18T21:13:38.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:38 smithi077 ceph-mon[27689]: pgmap v40: 65 pgs: 65 active+clean; 285 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 35 KiB/s rd, 1.4 MiB/s wr, 290 op/s 2024-09-18T21:13:38.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:38 smithi103 ceph-mon[34827]: pgmap v40: 65 pgs: 65 active+clean; 285 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 35 KiB/s rd, 1.4 MiB/s wr, 290 op/s 2024-09-18T21:13:39.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:39 smithi077 ceph-mon[27689]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:13:39.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:39 smithi103 ceph-mon[34827]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:13:40.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:40 smithi077 ceph-mon[27689]: pgmap v41: 65 pgs: 65 active+clean; 288 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 53 KiB/s rd, 2.1 MiB/s wr, 493 op/s 2024-09-18T21:13:40.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:40 smithi103 ceph-mon[34827]: pgmap v41: 65 pgs: 65 active+clean; 288 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 53 KiB/s rd, 2.1 MiB/s wr, 493 op/s 2024-09-18T21:13:42.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:42 smithi077 ceph-mon[27689]: pgmap v42: 65 pgs: 65 active+clean; 288 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 1.4 MiB/s wr, 351 op/s 2024-09-18T21:13:42.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:42 smithi103 ceph-mon[34827]: pgmap v42: 65 pgs: 65 active+clean; 288 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 1.4 MiB/s wr, 351 op/s 2024-09-18T21:13:44.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:44 smithi077 ceph-mon[27689]: pgmap v43: 65 pgs: 65 active+clean; 288 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 1.4 MiB/s wr, 351 op/s 2024-09-18T21:13:44.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:44 smithi103 ceph-mon[34827]: pgmap v43: 65 pgs: 65 active+clean; 288 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 1.4 MiB/s wr, 351 op/s 2024-09-18T21:13:46.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:46 smithi077 ceph-mon[27689]: pgmap v44: 65 pgs: 65 active+clean; 286 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 50 KiB/s rd, 2.1 MiB/s wr, 513 op/s 2024-09-18T21:13:46.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:46 smithi103 ceph-mon[34827]: pgmap v44: 65 pgs: 65 active+clean; 286 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 50 KiB/s rd, 2.1 MiB/s wr, 513 op/s 2024-09-18T21:13:48.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:48 smithi103 ceph-mon[34827]: pgmap v45: 65 pgs: 65 active+clean; 286 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.3 MiB/s wr, 365 op/s 2024-09-18T21:13:48.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:48 smithi077 ceph-mon[27689]: pgmap v45: 65 pgs: 65 active+clean; 286 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.3 MiB/s wr, 365 op/s 2024-09-18T21:13:50.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:50 smithi103 ceph-mon[34827]: pgmap v46: 65 pgs: 65 active+clean; 282 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 52 KiB/s rd, 2.1 MiB/s wr, 579 op/s 2024-09-18T21:13:50.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:50 smithi077 ceph-mon[27689]: pgmap v46: 65 pgs: 65 active+clean; 282 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 52 KiB/s rd, 2.1 MiB/s wr, 579 op/s 2024-09-18T21:13:52.668 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:52 smithi077 ceph-mon[27689]: pgmap v47: 65 pgs: 65 active+clean; 282 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 34 KiB/s rd, 1.4 MiB/s wr, 377 op/s 2024-09-18T21:13:52.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:52 smithi103 ceph-mon[34827]: pgmap v47: 65 pgs: 65 active+clean; 282 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 34 KiB/s rd, 1.4 MiB/s wr, 377 op/s 2024-09-18T21:13:54.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:54 smithi077 ceph-mon[27689]: pgmap v48: 65 pgs: 65 active+clean; 282 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 34 KiB/s rd, 1.4 MiB/s wr, 377 op/s 2024-09-18T21:13:54.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:54 smithi077 ceph-mon[27689]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:13:54.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:54 smithi103 ceph-mon[34827]: pgmap v48: 65 pgs: 65 active+clean; 282 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 34 KiB/s rd, 1.4 MiB/s wr, 377 op/s 2024-09-18T21:13:54.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:54 smithi103 ceph-mon[34827]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:13:55.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:55 smithi077 ceph-mon[27689]: mgrmap e25: smithi103.zjztqc(active, since 91s), standbys: smithi077.utkpjg 2024-09-18T21:13:55.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:55 smithi103 ceph-mon[34827]: mgrmap e25: smithi103.zjztqc(active, since 91s), standbys: smithi077.utkpjg 2024-09-18T21:13:56.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:56 smithi103 ceph-mon[34827]: pgmap v49: 65 pgs: 65 active+clean; 275 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 52 KiB/s rd, 2.1 MiB/s wr, 788 op/s 2024-09-18T21:13:56.783 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:56 smithi077 ceph-mon[27689]: pgmap v49: 65 pgs: 65 active+clean; 275 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 52 KiB/s rd, 2.1 MiB/s wr, 788 op/s 2024-09-18T21:13:58.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.155+0000 7f6d14020640 1 -- 172.21.15.77:0/2855043528 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d0c0ffa30 msgr2=0x7f6d0c0ffea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:13:58.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.155+0000 7f6d14020640 1 --2- 172.21.15.77:0/2855043528 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d0c0ffa30 0x7f6d0c0ffea0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc0048d0 tx=0x7f6cfc009da0 comp rx=0 tx=0).stop 2024-09-18T21:13:58.156 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:57 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:58.156 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:57 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:58.157 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:57 smithi077 ceph-mon[27689]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:13:58.157 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:57 smithi077 ceph-mon[27689]: pgmap v50: 65 pgs: 65 active+clean; 275 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 1.4 MiB/s wr, 625 op/s 2024-09-18T21:13:58.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.155+0000 7f6d14020640 1 -- 172.21.15.77:0/2855043528 shutdown_connections 2024-09-18T21:13:58.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.155+0000 7f6d14020640 1 --2- 172.21.15.77:0/2855043528 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d0c0ffa30 0x7f6d0c0ffea0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:58.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.155+0000 7f6d14020640 1 --2- 172.21.15.77:0/2855043528 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d0c0fe760 0x7f6d0c0feb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:58.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.155+0000 7f6d14020640 1 -- 172.21.15.77:0/2855043528 >> 172.21.15.77:0/2855043528 conn(0x7f6d0c0f9f20 msgr2=0x7f6d0c0fc350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:13:58.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.155+0000 7f6d14020640 1 -- 172.21.15.77:0/2855043528 shutdown_connections 2024-09-18T21:13:58.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.155+0000 7f6d14020640 1 -- 172.21.15.77:0/2855043528 wait complete. 2024-09-18T21:13:58.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.156+0000 7f6d14020640 1 Processor -- start 2024-09-18T21:13:58.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.156+0000 7f6d14020640 1 -- start start 2024-09-18T21:13:58.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.156+0000 7f6d14020640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d0c0fe760 0x7f6d0c10f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:13:58.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.156+0000 7f6d14020640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d0c0ffa30 0x7f6d0c10f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:13:58.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.156+0000 7f6d14020640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0c10fbe0 con 0x7f6d0c0ffa30 2024-09-18T21:13:58.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.156+0000 7f6d14020640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0c110400 con 0x7f6d0c0fe760 2024-09-18T21:13:58.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.156+0000 7f6d11dbc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d0c0fe760 0x7f6d0c10f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:13:58.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.157+0000 7f6d11dbc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d0c0fe760 0x7f6d0c10f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:35998/0 (socket says 172.21.15.77:35998) 2024-09-18T21:13:58.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.157+0000 7f6d11dbc640 1 -- 172.21.15.77:0/3266761877 learned_addr learned my addr 172.21.15.77:0/3266761877 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:13:58.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.157+0000 7f6d115bb640 1 --2- 172.21.15.77:0/3266761877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d0c0ffa30 0x7f6d0c10f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:13:58.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.157+0000 7f6d11dbc640 1 -- 172.21.15.77:0/3266761877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d0c0ffa30 msgr2=0x7f6d0c10f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:13:58.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.157+0000 7f6d11dbc640 1 --2- 172.21.15.77:0/3266761877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d0c0ffa30 0x7f6d0c10f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:58.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.157+0000 7f6d11dbc640 1 -- 172.21.15.77:0/3266761877 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cfc005040 con 0x7f6d0c0fe760 2024-09-18T21:13:58.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.157+0000 7f6d11dbc640 1 --2- 172.21.15.77:0/3266761877 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d0c0fe760 0x7f6d0c10f050 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6d08002a50 tx=0x7f6d08004600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:13:58.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.157+0000 7f6d027fc640 1 -- 172.21.15.77:0/3266761877 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d08007c30 con 0x7f6d0c0fe760 2024-09-18T21:13:58.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.157+0000 7f6d027fc640 1 -- 172.21.15.77:0/3266761877 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6d0800f040 con 0x7f6d0c0fe760 2024-09-18T21:13:58.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.157+0000 7f6d027fc640 1 -- 172.21.15.77:0/3266761877 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d0800db50 con 0x7f6d0c0fe760 2024-09-18T21:13:58.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.157+0000 7f6d14020640 1 -- 172.21.15.77:0/3266761877 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d0c110690 con 0x7f6d0c0fe760 2024-09-18T21:13:58.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.158+0000 7f6d14020640 1 -- 172.21.15.77:0/3266761877 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d0c110a70 con 0x7f6d0c0fe760 2024-09-18T21:13:58.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.159+0000 7f6cf7fff640 1 -- 172.21.15.77:0/3266761877 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d0c0fdbc0 con 0x7f6d0c0fe760 2024-09-18T21:13:58.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.161+0000 7f6d027fc640 1 -- 172.21.15.77:0/3266761877 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 25) v1 ==== 91386+0+0 (secure 0 0 0) 0x7f6d0800dcb0 con 0x7f6d0c0fe760 2024-09-18T21:13:58.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.161+0000 7f6d027fc640 1 --2- 172.21.15.77:0/3266761877 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f6cf806e3d0 0x7f6cf8070880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:13:58.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.161+0000 7f6d115bb640 1 --2- 172.21.15.77:0/3266761877 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f6cf806e3d0 0x7f6cf8070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:13:58.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.162+0000 7f6d027fc640 1 -- 172.21.15.77:0/3266761877 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f6d0808d2d0 con 0x7f6d0c0fe760 2024-09-18T21:13:58.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.162+0000 7f6d115bb640 1 --2- 172.21.15.77:0/3266761877 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f6cf806e3d0 0x7f6cf8070880 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc000c00 tx=0x7f6cfc035040 comp rx=0 tx=0).ready entity=mgr.14578 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:13:58.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.166+0000 7f6d027fc640 1 -- 172.21.15.77:0/3266761877 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f6d08056f60 con 0x7f6d0c0fe760 2024-09-18T21:13:58.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:57 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:58.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:57 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:13:58.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:57 smithi103 ceph-mon[34827]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:13:58.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:57 smithi103 ceph-mon[34827]: pgmap v50: 65 pgs: 65 active+clean; 275 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 1.4 MiB/s wr, 625 op/s 2024-09-18T21:13:58.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.422+0000 7f6cf7fff640 1 -- 172.21.15.77:0/3266761877 --> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6d0c04b720 con 0x7f6cf806e3d0 2024-09-18T21:13:58.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.423+0000 7f6d027fc640 1 -- 172.21.15.77:0/3266761877 <== mgr.14578 v2:172.21.15.103:6828/1199124716 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7f6d0c04b720 con 0x7f6cf806e3d0 2024-09-18T21:13:58.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.426+0000 7f6cf7fff640 1 -- 172.21.15.77:0/3266761877 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f6cf806e3d0 msgr2=0x7f6cf8070880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:13:58.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.426+0000 7f6cf7fff640 1 --2- 172.21.15.77:0/3266761877 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f6cf806e3d0 0x7f6cf8070880 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc000c00 tx=0x7f6cfc035040 comp rx=0 tx=0).stop 2024-09-18T21:13:58.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.426+0000 7f6cf7fff640 1 -- 172.21.15.77:0/3266761877 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d0c0fe760 msgr2=0x7f6d0c10f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:13:58.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.426+0000 7f6cf7fff640 1 --2- 172.21.15.77:0/3266761877 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d0c0fe760 0x7f6d0c10f050 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6d08002a50 tx=0x7f6d08004600 comp rx=0 tx=0).stop 2024-09-18T21:13:58.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.426+0000 7f6cf7fff640 1 -- 172.21.15.77:0/3266761877 shutdown_connections 2024-09-18T21:13:58.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.426+0000 7f6cf7fff640 1 --2- 172.21.15.77:0/3266761877 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f6cf806e3d0 0x7f6cf8070880 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:58.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.426+0000 7f6cf7fff640 1 --2- 172.21.15.77:0/3266761877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d0c0ffa30 0x7f6d0c10f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:58.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.426+0000 7f6cf7fff640 1 --2- 172.21.15.77:0/3266761877 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d0c0fe760 0x7f6d0c10f050 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:58.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.426+0000 7f6cf7fff640 1 -- 172.21.15.77:0/3266761877 >> 172.21.15.77:0/3266761877 conn(0x7f6d0c0f9f20 msgr2=0x7f6d0c0fb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:13:58.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.426+0000 7f6cf7fff640 1 -- 172.21.15.77:0/3266761877 shutdown_connections 2024-09-18T21:13:58.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.426+0000 7f6cf7fff640 1 -- 172.21.15.77:0/3266761877 wait complete. 2024-09-18T21:13:58.436 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-09-18T21:13:58.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.528+0000 7fdf0f12a640 1 -- 172.21.15.77:0/190396161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf080ff740 msgr2=0x7fdf08101b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:13:58.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.528+0000 7fdf0f12a640 1 --2- 172.21.15.77:0/190396161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf080ff740 0x7fdf08101b20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fdef40048d0 tx=0x7fdef4009da0 comp rx=0 tx=0).stop 2024-09-18T21:13:58.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.528+0000 7fdf0f12a640 1 -- 172.21.15.77:0/190396161 shutdown_connections 2024-09-18T21:13:58.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.528+0000 7fdf0f12a640 1 --2- 172.21.15.77:0/190396161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf080ff740 0x7fdf08101b20 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:58.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.528+0000 7fdf0f12a640 1 --2- 172.21.15.77:0/190396161 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf08065b80 0x7fdf080ff200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:58.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.528+0000 7fdf0f12a640 1 -- 172.21.15.77:0/190396161 >> 172.21.15.77:0/190396161 conn(0x7fdf080f6c10 msgr2=0x7fdf080f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:13:58.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.528+0000 7fdf0f12a640 1 -- 172.21.15.77:0/190396161 shutdown_connections 2024-09-18T21:13:58.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.529+0000 7fdf0f12a640 1 -- 172.21.15.77:0/190396161 wait complete. 2024-09-18T21:13:58.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.529+0000 7fdf0f12a640 1 Processor -- start 2024-09-18T21:13:58.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.529+0000 7fdf0f12a640 1 -- start start 2024-09-18T21:13:58.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.529+0000 7fdf0f12a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf08065b80 0x7fdf080fcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:13:58.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.529+0000 7fdf0f12a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf080ff740 0x7fdf080fb100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:13:58.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.530+0000 7fdf0f12a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf080fb640 con 0x7fdf080ff740 2024-09-18T21:13:58.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.530+0000 7fdf0f12a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf080fb780 con 0x7fdf08065b80 2024-09-18T21:13:58.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.530+0000 7fdf07fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf080ff740 0x7fdf080fb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:13:58.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.530+0000 7fdf07fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf080ff740 0x7fdf080fb100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38716/0 (socket says 172.21.15.77:38716) 2024-09-18T21:13:58.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.530+0000 7fdf07fff640 1 -- 172.21.15.77:0/1764151589 learned_addr learned my addr 172.21.15.77:0/1764151589 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:13:58.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.530+0000 7fdf0cec6640 1 --2- 172.21.15.77:0/1764151589 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf08065b80 0x7fdf080fcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:13:58.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.530+0000 7fdf07fff640 1 -- 172.21.15.77:0/1764151589 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf08065b80 msgr2=0x7fdf080fcbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:13:58.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.530+0000 7fdf07fff640 1 --2- 172.21.15.77:0/1764151589 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf08065b80 0x7fdf080fcbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:58.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.530+0000 7fdf07fff640 1 -- 172.21.15.77:0/1764151589 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef4005040 con 0x7fdf080ff740 2024-09-18T21:13:58.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.530+0000 7fdf0cec6640 1 --2- 172.21.15.77:0/1764151589 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf08065b80 0x7fdf080fcbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T21:13:58.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.531+0000 7fdf07fff640 1 --2- 172.21.15.77:0/1764151589 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf080ff740 0x7fdf080fb100 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdef40048a0 tx=0x7fdef4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:13:58.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.531+0000 7fdf057fa640 1 -- 172.21.15.77:0/1764151589 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdef4038070 con 0x7fdf080ff740 2024-09-18T21:13:58.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.531+0000 7fdf057fa640 1 -- 172.21.15.77:0/1764151589 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdef4009800 con 0x7fdf080ff740 2024-09-18T21:13:58.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.531+0000 7fdf057fa640 1 -- 172.21.15.77:0/1764151589 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdef403e670 con 0x7fdf080ff740 2024-09-18T21:13:58.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.531+0000 7fdf0f12a640 1 -- 172.21.15.77:0/1764151589 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf080fba00 con 0x7fdf080ff740 2024-09-18T21:13:58.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.531+0000 7fdf0f12a640 1 -- 172.21.15.77:0/1764151589 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf080fbee0 con 0x7fdf080ff740 2024-09-18T21:13:58.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.533+0000 7fdf0f12a640 1 -- 172.21.15.77:0/1764151589 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf080fa890 con 0x7fdf080ff740 2024-09-18T21:13:58.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.533+0000 7fdf057fa640 1 -- 172.21.15.77:0/1764151589 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 25) v1 ==== 91386+0+0 (secure 0 0 0) 0x7fdef4030020 con 0x7fdf080ff740 2024-09-18T21:13:58.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.534+0000 7fdf057fa640 1 --2- 172.21.15.77:0/1764151589 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7fdef806e440 0x7fdef80708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:13:58.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.534+0000 7fdf057fa640 1 -- 172.21.15.77:0/1764151589 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fdef40ad990 con 0x7fdf080ff740 2024-09-18T21:13:58.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.534+0000 7fdf0cec6640 1 --2- 172.21.15.77:0/1764151589 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7fdef806e440 0x7fdef80708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:13:58.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.535+0000 7fdf0cec6640 1 --2- 172.21.15.77:0/1764151589 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7fdef806e440 0x7fdef80708f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdf080fc970 tx=0x7fdefc00b040 comp rx=0 tx=0).ready entity=mgr.14578 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:13:58.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.540+0000 7fdf057fa640 1 -- 172.21.15.77:0/1764151589 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fdef40777d0 con 0x7fdf080ff740 2024-09-18T21:13:58.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.836+0000 7fdf0f12a640 1 -- 172.21.15.77:0/1764151589 --> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdf080f8700 con 0x7fdef806e440 2024-09-18T21:13:58.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.837+0000 7fdf057fa640 1 -- 172.21.15.77:0/1764151589 <== mgr.14578 v2:172.21.15.103:6828/1199124716 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7fdf080f8700 con 0x7fdef806e440 2024-09-18T21:13:58.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.841+0000 7fdf0f12a640 1 -- 172.21.15.77:0/1764151589 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7fdef806e440 msgr2=0x7fdef80708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:13:58.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.841+0000 7fdf0f12a640 1 --2- 172.21.15.77:0/1764151589 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7fdef806e440 0x7fdef80708f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdf080fc970 tx=0x7fdefc00b040 comp rx=0 tx=0).stop 2024-09-18T21:13:58.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.841+0000 7fdf0f12a640 1 -- 172.21.15.77:0/1764151589 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf080ff740 msgr2=0x7fdf080fb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:13:58.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.841+0000 7fdf0f12a640 1 --2- 172.21.15.77:0/1764151589 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf080ff740 0x7fdf080fb100 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdef40048a0 tx=0x7fdef4009da0 comp rx=0 tx=0).stop 2024-09-18T21:13:58.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.841+0000 7fdf0f12a640 1 -- 172.21.15.77:0/1764151589 shutdown_connections 2024-09-18T21:13:58.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.841+0000 7fdf0f12a640 1 --2- 172.21.15.77:0/1764151589 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7fdef806e440 0x7fdef80708f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:58.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.841+0000 7fdf0f12a640 1 --2- 172.21.15.77:0/1764151589 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf080ff740 0x7fdf080fb100 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:58.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.841+0000 7fdf0f12a640 1 --2- 172.21.15.77:0/1764151589 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf08065b80 0x7fdf080fcbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:58.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.841+0000 7fdf0f12a640 1 -- 172.21.15.77:0/1764151589 >> 172.21.15.77:0/1764151589 conn(0x7fdf080f6c10 msgr2=0x7fdf080f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:13:58.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.841+0000 7fdf0f12a640 1 -- 172.21.15.77:0/1764151589 shutdown_connections 2024-09-18T21:13:58.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.841+0000 7fdf0f12a640 1 -- 172.21.15.77:0/1764151589 wait complete. 2024-09-18T21:13:58.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.945+0000 7fe02e484640 1 -- 172.21.15.77:0/2509589679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0280fb430 msgr2=0x7fe0280fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:13:58.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.945+0000 7fe02e484640 1 --2- 172.21.15.77:0/2509589679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0280fb430 0x7fe0280fb840 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe0180048d0 tx=0x7fe018009da0 comp rx=0 tx=0).stop 2024-09-18T21:13:58.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.945+0000 7fe02e484640 1 -- 172.21.15.77:0/2509589679 shutdown_connections 2024-09-18T21:13:58.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.945+0000 7fe02e484640 1 --2- 172.21.15.77:0/2509589679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0280fc700 0x7fe0280fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:58.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.945+0000 7fe02e484640 1 --2- 172.21.15.77:0/2509589679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0280fb430 0x7fe0280fb840 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:58.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.945+0000 7fe02e484640 1 -- 172.21.15.77:0/2509589679 >> 172.21.15.77:0/2509589679 conn(0x7fe0280f6c10 msgr2=0x7fe0280f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:13:58.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.945+0000 7fe02e484640 1 -- 172.21.15.77:0/2509589679 shutdown_connections 2024-09-18T21:13:58.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.945+0000 7fe02e484640 1 -- 172.21.15.77:0/2509589679 wait complete. 2024-09-18T21:13:58.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.946+0000 7fe02e484640 1 Processor -- start 2024-09-18T21:13:58.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.946+0000 7fe02e484640 1 -- start start 2024-09-18T21:13:58.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.946+0000 7fe02e484640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0280fb430 0x7fe02810fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:13:58.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.946+0000 7fe02e484640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0280fc700 0x7fe0281122b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:13:58.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.946+0000 7fe02e484640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe028065cc0 con 0x7fe0280fb430 2024-09-18T21:13:58.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.946+0000 7fe02e484640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe028065e30 con 0x7fe0280fc700 2024-09-18T21:13:58.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.947+0000 7fe0277fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0280fc700 0x7fe0281122b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:13:58.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.947+0000 7fe027fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0280fb430 0x7fe02810fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:13:58.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.947+0000 7fe0277fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0280fc700 0x7fe0281122b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:36028/0 (socket says 172.21.15.77:36028) 2024-09-18T21:13:58.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.947+0000 7fe0277fe640 1 -- 172.21.15.77:0/954541631 learned_addr learned my addr 172.21.15.77:0/954541631 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:13:58.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.947+0000 7fe027fff640 1 -- 172.21.15.77:0/954541631 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0280fc700 msgr2=0x7fe0281122b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:13:58.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.947+0000 7fe027fff640 1 --2- 172.21.15.77:0/954541631 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0280fc700 0x7fe0281122b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:58.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.947+0000 7fe027fff640 1 -- 172.21.15.77:0/954541631 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe018005040 con 0x7fe0280fb430 2024-09-18T21:13:58.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.947+0000 7fe027fff640 1 --2- 172.21.15.77:0/954541631 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0280fb430 0x7fe02810fd60 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe01802a530 tx=0x7fe018009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:13:58.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.947+0000 7fe024ff9640 1 -- 172.21.15.77:0/954541631 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe018038070 con 0x7fe0280fb430 2024-09-18T21:13:58.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.947+0000 7fe024ff9640 1 -- 172.21.15.77:0/954541631 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe01802ae90 con 0x7fe0280fb430 2024-09-18T21:13:58.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.948+0000 7fe024ff9640 1 -- 172.21.15.77:0/954541631 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe01803e670 con 0x7fe0280fb430 2024-09-18T21:13:58.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.948+0000 7fe02e484640 1 -- 172.21.15.77:0/954541631 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe028112850 con 0x7fe0280fb430 2024-09-18T21:13:58.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.948+0000 7fe02e484640 1 -- 172.21.15.77:0/954541631 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe028112dc0 con 0x7fe0280fb430 2024-09-18T21:13:58.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.949+0000 7fe00e7fc640 1 -- 172.21.15.77:0/954541631 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0280fa890 con 0x7fe0280fb430 2024-09-18T21:13:58.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.950+0000 7fe024ff9640 1 -- 172.21.15.77:0/954541631 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 25) v1 ==== 91386+0+0 (secure 0 0 0) 0x7fe018030020 con 0x7fe0280fb430 2024-09-18T21:13:58.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.950+0000 7fe024ff9640 1 --2- 172.21.15.77:0/954541631 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7fe01006e390 0x7fe010070840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:13:58.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.951+0000 7fe0277fe640 1 --2- 172.21.15.77:0/954541631 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7fe01006e390 0x7fe010070840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:13:58.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.951+0000 7fe024ff9640 1 -- 172.21.15.77:0/954541631 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fe0180ada10 con 0x7fe0280fb430 2024-09-18T21:13:58.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.951+0000 7fe0277fe640 1 --2- 172.21.15.77:0/954541631 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7fe01006e390 0x7fe010070840 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe01c004a50 tx=0x7fe01c00b040 comp rx=0 tx=0).ready entity=mgr.14578 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:13:58.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:58.956+0000 7fe024ff9640 1 -- 172.21.15.77:0/954541631 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fe018077800 con 0x7fe0280fb430 2024-09-18T21:13:59.201 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:58 smithi103 ceph-mon[34827]: from='client.24473 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:13:59.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:58 smithi077 ceph-mon[27689]: from='client.24473 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:13:59.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.270+0000 7fe00e7fc640 1 -- 172.21.15.77:0/954541631 --> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe028103fe0 con 0x7fe01006e390 2024-09-18T21:13:59.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.279+0000 7fe024ff9640 1 -- 172.21.15.77:0/954541631 <== mgr.14578 v2:172.21.15.103:6828/1199124716 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fe028103fe0 con 0x7fe01006e390 2024-09-18T21:13:59.280 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T21:13:59.281 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager.smithi077 smithi077 *:9093,9094 starting - - - - 2024-09-18T21:13:59.281 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi077 smithi077 running (8m) 77s ago 8m 6899k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 0beb64a8c2ea 2024-09-18T21:13:59.281 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi103 smithi103 running (8m) 73s ago 8m 6891k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 04981ca7bf34 2024-09-18T21:13:59.281 INFO:teuthology.orchestra.run.smithi077.stdout:grafana.smithi077 smithi077 *:3000 starting - - - - 2024-09-18T21:13:59.281 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.cqfhlw smithi077 running (3m) 77s ago 3m 12.7M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 a7ec3b7701b6 2024-09-18T21:13:59.281 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.vruydi smithi077 running (3m) 77s ago 3m 171M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 affbba097d3b 2024-09-18T21:13:59.281 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi103.opftmf smithi103 running (3m) 73s ago 3m 14.8M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 111f884c5a34 2024-09-18T21:13:59.281 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi103.zhdmdg smithi103 running (3m) 73s ago 3m 14.8M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 50b77d0edda5 2024-09-18T21:13:59.281 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi077.utkpjg smithi077 *:8443,9283,8765 starting - - - - 2024-09-18T21:13:59.281 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi103.zjztqc smithi103 *:8443,9283 running (104s) 73s ago 7m 483M - 19.1.1-17-g06b1b1de f79f744f586d 0fe6f5f18bf6 2024-09-18T21:13:59.281 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi077 smithi077 running (10m) 77s ago 10m 50.7M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bcbf289fe027 2024-09-18T21:13:59.281 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi103 smithi103 running (7m) 73s ago 7m 40.8M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 d6ae2062e5e3 2024-09-18T21:13:59.281 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi077 smithi077 *:9100 starting - - - - 2024-09-18T21:13:59.282 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi103 smithi103 *:9100 starting - - - - 2024-09-18T21:13:59.282 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (7m) 77s ago 7m 120M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 2e3563c32cf5 2024-09-18T21:13:59.282 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi077 running (6m) 77s ago 6m 122M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 39c2ccbb7603 2024-09-18T21:13:59.282 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi077 running (6m) 77s ago 6m 110M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 2ff2728057e2 2024-09-18T21:13:59.282 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi103 running (5m) 73s ago 5m 128M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 0e72b1bbb8ce 2024-09-18T21:13:59.282 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi103 running (5m) 73s ago 5m 117M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 85f1ce1e8bee 2024-09-18T21:13:59.282 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi103 running (5m) 73s ago 5m 110M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 cf8964b3ac6d 2024-09-18T21:13:59.282 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus.smithi077 smithi077 *:9095 starting - - - - 2024-09-18T21:13:59.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.283+0000 7fe00e7fc640 1 -- 172.21.15.77:0/954541631 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7fe01006e390 msgr2=0x7fe010070840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:13:59.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.283+0000 7fe00e7fc640 1 --2- 172.21.15.77:0/954541631 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7fe01006e390 0x7fe010070840 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe01c004a50 tx=0x7fe01c00b040 comp rx=0 tx=0).stop 2024-09-18T21:13:59.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.283+0000 7fe00e7fc640 1 -- 172.21.15.77:0/954541631 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0280fb430 msgr2=0x7fe02810fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:13:59.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.283+0000 7fe00e7fc640 1 --2- 172.21.15.77:0/954541631 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0280fb430 0x7fe02810fd60 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe01802a530 tx=0x7fe018009da0 comp rx=0 tx=0).stop 2024-09-18T21:13:59.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.283+0000 7fe00e7fc640 1 -- 172.21.15.77:0/954541631 shutdown_connections 2024-09-18T21:13:59.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.283+0000 7fe00e7fc640 1 --2- 172.21.15.77:0/954541631 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7fe01006e390 0x7fe010070840 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:59.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.283+0000 7fe00e7fc640 1 --2- 172.21.15.77:0/954541631 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0280fc700 0x7fe0281122b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:59.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.283+0000 7fe00e7fc640 1 --2- 172.21.15.77:0/954541631 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0280fb430 0x7fe02810fd60 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:59.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.283+0000 7fe00e7fc640 1 -- 172.21.15.77:0/954541631 >> 172.21.15.77:0/954541631 conn(0x7fe0280f6c10 msgr2=0x7fe0280f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:13:59.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.283+0000 7fe00e7fc640 1 -- 172.21.15.77:0/954541631 shutdown_connections 2024-09-18T21:13:59.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.283+0000 7fe00e7fc640 1 -- 172.21.15.77:0/954541631 wait complete. 2024-09-18T21:13:59.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.390+0000 7f151db96640 1 -- 172.21.15.77:0/3873696233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15180fb420 msgr2=0x7f15180fb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:13:59.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.390+0000 7f151db96640 1 --2- 172.21.15.77:0/3873696233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15180fb420 0x7f15180fb830 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f15080048d0 tx=0x7f1508009da0 comp rx=0 tx=0).stop 2024-09-18T21:13:59.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.390+0000 7f151db96640 1 -- 172.21.15.77:0/3873696233 shutdown_connections 2024-09-18T21:13:59.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.390+0000 7f151db96640 1 --2- 172.21.15.77:0/3873696233 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15180fc6f0 0x7f15180fcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:59.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.390+0000 7f151db96640 1 --2- 172.21.15.77:0/3873696233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15180fb420 0x7f15180fb830 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:59.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.390+0000 7f151db96640 1 -- 172.21.15.77:0/3873696233 >> 172.21.15.77:0/3873696233 conn(0x7f15180f6c00 msgr2=0x7f15180f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:13:59.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.390+0000 7f151db96640 1 -- 172.21.15.77:0/3873696233 shutdown_connections 2024-09-18T21:13:59.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.390+0000 7f151db96640 1 -- 172.21.15.77:0/3873696233 wait complete. 2024-09-18T21:13:59.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.391+0000 7f151db96640 1 Processor -- start 2024-09-18T21:13:59.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.391+0000 7f151db96640 1 -- start start 2024-09-18T21:13:59.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.392+0000 7f151db96640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15180fb420 0x7f151810bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:13:59.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.392+0000 7f151db96640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15180fc6f0 0x7f151810c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:13:59.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.392+0000 7f15177fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15180fb420 0x7f151810bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:13:59.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.392+0000 7f15177fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15180fb420 0x7f151810bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58476/0 (socket says 172.21.15.77:58476) 2024-09-18T21:13:59.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.392+0000 7f15177fe640 1 -- 172.21.15.77:0/2002344353 learned_addr learned my addr 172.21.15.77:0/2002344353 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:13:59.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.392+0000 7f151db96640 1 -- 172.21.15.77:0/2002344353 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151810cae0 con 0x7f15180fb420 2024-09-18T21:13:59.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.392+0000 7f151db96640 1 -- 172.21.15.77:0/2002344353 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151810d300 con 0x7f15180fc6f0 2024-09-18T21:13:59.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.392+0000 7f1516ffd640 1 --2- 172.21.15.77:0/2002344353 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15180fc6f0 0x7f151810c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:13:59.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.393+0000 7f15177fe640 1 -- 172.21.15.77:0/2002344353 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15180fc6f0 msgr2=0x7f151810c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:13:59.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.393+0000 7f15177fe640 1 --2- 172.21.15.77:0/2002344353 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15180fc6f0 0x7f151810c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:59.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.393+0000 7f15177fe640 1 -- 172.21.15.77:0/2002344353 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1508005040 con 0x7f15180fb420 2024-09-18T21:13:59.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.393+0000 7f15177fe640 1 --2- 172.21.15.77:0/2002344353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15180fb420 0x7f151810bf50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f15080043d0 tx=0x7f1508009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:13:59.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.393+0000 7f14fffff640 1 -- 172.21.15.77:0/2002344353 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1508038070 con 0x7f15180fb420 2024-09-18T21:13:59.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.393+0000 7f14fffff640 1 -- 172.21.15.77:0/2002344353 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f150802ae90 con 0x7f15180fb420 2024-09-18T21:13:59.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.393+0000 7f14fffff640 1 -- 172.21.15.77:0/2002344353 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f150803ce60 con 0x7f15180fb420 2024-09-18T21:13:59.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.393+0000 7f151db96640 1 -- 172.21.15.77:0/2002344353 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f151810d530 con 0x7f15180fb420 2024-09-18T21:13:59.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.394+0000 7f151db96640 1 -- 172.21.15.77:0/2002344353 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f151810da70 con 0x7f15180fb420 2024-09-18T21:13:59.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.395+0000 7f151db96640 1 -- 172.21.15.77:0/2002344353 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15180fa880 con 0x7f15180fb420 2024-09-18T21:13:59.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.396+0000 7f14fffff640 1 -- 172.21.15.77:0/2002344353 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 25) v1 ==== 91386+0+0 (secure 0 0 0) 0x7f1508030020 con 0x7f15180fb420 2024-09-18T21:13:59.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.396+0000 7f14fffff640 1 --2- 172.21.15.77:0/2002344353 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f150006e450 0x7f1500070900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:13:59.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.397+0000 7f14fffff640 1 -- 172.21.15.77:0/2002344353 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f15080b1b90 con 0x7f15180fb420 2024-09-18T21:13:59.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.397+0000 7f1516ffd640 1 --2- 172.21.15.77:0/2002344353 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f150006e450 0x7f1500070900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:13:59.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.397+0000 7f1516ffd640 1 --2- 172.21.15.77:0/2002344353 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f150006e450 0x7f1500070900 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f150c009fd0 tx=0x7f150c009e50 comp rx=0 tx=0).ready entity=mgr.14578 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:13:59.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.402+0000 7f14fffff640 1 -- 172.21.15.77:0/2002344353 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f150807b820 con 0x7f15180fb420 2024-09-18T21:13:59.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.759+0000 7f151db96640 1 -- 172.21.15.77:0/2002344353 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1518103e20 con 0x7f15180fb420 2024-09-18T21:13:59.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.760+0000 7f14fffff640 1 -- 172.21.15.77:0/2002344353 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+853 (secure 0 0 0) 0x7f150807eee0 con 0x7f15180fb420 2024-09-18T21:13:59.761 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-18T21:13:59.761 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": { 2024-09-18T21:13:59.761 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 2 2024-09-18T21:13:59.761 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:13:59.761 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": { 2024-09-18T21:13:59.762 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 1, 2024-09-18T21:13:59.762 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 1 2024-09-18T21:13:59.762 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:13:59.762 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": { 2024-09-18T21:13:59.762 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 6 2024-09-18T21:13:59.762 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:13:59.762 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-09-18T21:13:59.762 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4 2024-09-18T21:13:59.762 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:13:59.762 INFO:teuthology.orchestra.run.smithi077.stdout: "overall": { 2024-09-18T21:13:59.762 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 13, 2024-09-18T21:13:59.763 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 1 2024-09-18T21:13:59.763 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-18T21:13:59.763 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-18T21:13:59.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.762+0000 7f151db96640 1 -- 172.21.15.77:0/2002344353 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f150006e450 msgr2=0x7f1500070900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:13:59.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.762+0000 7f151db96640 1 --2- 172.21.15.77:0/2002344353 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f150006e450 0x7f1500070900 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f150c009fd0 tx=0x7f150c009e50 comp rx=0 tx=0).stop 2024-09-18T21:13:59.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.762+0000 7f151db96640 1 -- 172.21.15.77:0/2002344353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15180fb420 msgr2=0x7f151810bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:13:59.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.763+0000 7f151db96640 1 --2- 172.21.15.77:0/2002344353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15180fb420 0x7f151810bf50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f15080043d0 tx=0x7f1508009da0 comp rx=0 tx=0).stop 2024-09-18T21:13:59.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.763+0000 7f151db96640 1 -- 172.21.15.77:0/2002344353 shutdown_connections 2024-09-18T21:13:59.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.763+0000 7f151db96640 1 --2- 172.21.15.77:0/2002344353 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f150006e450 0x7f1500070900 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:59.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.763+0000 7f151db96640 1 --2- 172.21.15.77:0/2002344353 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f15180fc6f0 0x7f151810c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:59.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.763+0000 7f151db96640 1 --2- 172.21.15.77:0/2002344353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f15180fb420 0x7f151810bf50 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:59.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.763+0000 7f151db96640 1 -- 172.21.15.77:0/2002344353 >> 172.21.15.77:0/2002344353 conn(0x7f15180f6c00 msgr2=0x7f15180f83a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:13:59.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.763+0000 7f151db96640 1 -- 172.21.15.77:0/2002344353 shutdown_connections 2024-09-18T21:13:59.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.763+0000 7f151db96640 1 -- 172.21.15.77:0/2002344353 wait complete. 2024-09-18T21:13:59.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.887+0000 7f532cf1b640 1 -- 172.21.15.77:0/30814766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f532806e1e0 msgr2=0x7f532806e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:13:59.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.887+0000 7f532cf1b640 1 --2- 172.21.15.77:0/30814766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f532806e1e0 0x7f532806e5f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5320009c50 tx=0x7f5320004d10 comp rx=0 tx=0).stop 2024-09-18T21:13:59.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.887+0000 7f532cf1b640 1 -- 172.21.15.77:0/30814766 shutdown_connections 2024-09-18T21:13:59.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.887+0000 7f532cf1b640 1 --2- 172.21.15.77:0/30814766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f532806eb30 0x7f532806efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:59.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.887+0000 7f532cf1b640 1 --2- 172.21.15.77:0/30814766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f532806e1e0 0x7f532806e5f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:59.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.887+0000 7f532cf1b640 1 -- 172.21.15.77:0/30814766 >> 172.21.15.77:0/30814766 conn(0x7f5328069560 msgr2=0x7f532806b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:13:59.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.887+0000 7f532cf1b640 1 -- 172.21.15.77:0/30814766 shutdown_connections 2024-09-18T21:13:59.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.887+0000 7f532cf1b640 1 -- 172.21.15.77:0/30814766 wait complete. 2024-09-18T21:13:59.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.888+0000 7f532cf1b640 1 Processor -- start 2024-09-18T21:13:59.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.888+0000 7f532cf1b640 1 -- start start 2024-09-18T21:13:59.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.888+0000 7f532cf1b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f532806e1e0 0x7f5328117a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:13:59.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.888+0000 7f532cf1b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f532806eb30 0x7f5328117fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:13:59.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.888+0000 7f532cf1b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5328118610 con 0x7f532806eb30 2024-09-18T21:13:59.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.888+0000 7f532cf1b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5328118e30 con 0x7f532806e1e0 2024-09-18T21:13:59.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.889+0000 7f5325d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f532806eb30 0x7f5328117fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:13:59.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.889+0000 7f5325d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f532806eb30 0x7f5328117fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58500/0 (socket says 172.21.15.77:58500) 2024-09-18T21:13:59.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.889+0000 7f5325d9b640 1 -- 172.21.15.77:0/2987894202 learned_addr learned my addr 172.21.15.77:0/2987894202 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:13:59.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.889+0000 7f532659c640 1 --2- 172.21.15.77:0/2987894202 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f532806e1e0 0x7f5328117a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:13:59.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.889+0000 7f532659c640 1 -- 172.21.15.77:0/2987894202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f532806eb30 msgr2=0x7f5328117fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:13:59.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.889+0000 7f532659c640 1 --2- 172.21.15.77:0/2987894202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f532806eb30 0x7f5328117fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:13:59.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.889+0000 7f532659c640 1 -- 172.21.15.77:0/2987894202 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53200098b0 con 0x7f532806e1e0 2024-09-18T21:13:59.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.890+0000 7f532659c640 1 --2- 172.21.15.77:0/2987894202 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f532806e1e0 0x7f5328117a80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5320009c20 tx=0x7f5320004d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:13:59.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.890+0000 7f531effd640 1 -- 172.21.15.77:0/2987894202 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5320009710 con 0x7f532806e1e0 2024-09-18T21:13:59.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.890+0000 7f531effd640 1 -- 172.21.15.77:0/2987894202 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5320032b10 con 0x7f532806e1e0 2024-09-18T21:13:59.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.890+0000 7f531effd640 1 -- 172.21.15.77:0/2987894202 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f532003da40 con 0x7f532806e1e0 2024-09-18T21:13:59.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.890+0000 7f532cf1b640 1 -- 172.21.15.77:0/2987894202 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5328119060 con 0x7f532806e1e0 2024-09-18T21:13:59.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.890+0000 7f532cf1b640 1 -- 172.21.15.77:0/2987894202 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53281195d0 con 0x7f532806e1e0 2024-09-18T21:13:59.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.892+0000 7f532cf1b640 1 -- 172.21.15.77:0/2987894202 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f532806d1b0 con 0x7f532806e1e0 2024-09-18T21:13:59.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.892+0000 7f531effd640 1 -- 172.21.15.77:0/2987894202 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 25) v1 ==== 91386+0+0 (secure 0 0 0) 0x7f532002f030 con 0x7f532806e1e0 2024-09-18T21:13:59.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.893+0000 7f531effd640 1 --2- 172.21.15.77:0/2987894202 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f531406e390 0x7f5314070840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:13:59.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.893+0000 7f531effd640 1 -- 172.21.15.77:0/2987894202 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f53200ae990 con 0x7f532806e1e0 2024-09-18T21:13:59.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.893+0000 7f5325d9b640 1 --2- 172.21.15.77:0/2987894202 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f531406e390 0x7f5314070840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:13:59.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.894+0000 7f5325d9b640 1 --2- 172.21.15.77:0/2987894202 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f531406e390 0x7f5314070840 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5328117830 tx=0x7f531000b040 comp rx=0 tx=0).ready entity=mgr.14578 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:13:59.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:13:59.900+0000 7f531effd640 1 -- 172.21.15.77:0/2987894202 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f5320078740 con 0x7f532806e1e0 2024-09-18T21:14:00.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:59 smithi077 ceph-mon[27689]: from='client.14698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:14:00.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:59 smithi077 ceph-mon[27689]: from='client.14702 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:14:00.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:59 smithi077 ceph-mon[27689]: pgmap v51: 65 pgs: 65 active+clean; 262 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 57 KiB/s rd, 2.1 MiB/s wr, 1.01k op/s 2024-09-18T21:14:00.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:13:59 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/2002344353' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:14:00.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.254+0000 7f532cf1b640 1 -- 172.21.15.77:0/2987894202 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5328119950 con 0x7f532806e1e0 2024-09-18T21:14:00.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.255+0000 7f531effd640 1 -- 172.21.15.77:0/2987894202 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1807 (secure 0 0 0) 0x7f532002c140 con 0x7f532806e1e0 2024-09-18T21:14:00.256 INFO:teuthology.orchestra.run.smithi077.stdout:e13 2024-09-18T21:14:00.256 INFO:teuthology.orchestra.run.smithi077.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T21:14:00.256 INFO:teuthology.orchestra.run.smithi077.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T21:14:00.256 INFO:teuthology.orchestra.run.smithi077.stdout:legacy client fscid: 1 2024-09-18T21:14:00.256 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:14:00.256 INFO:teuthology.orchestra.run.smithi077.stdout:Filesystem 'cephfs' (1) 2024-09-18T21:14:00.256 INFO:teuthology.orchestra.run.smithi077.stdout:fs_name cephfs 2024-09-18T21:14:00.256 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 13 2024-09-18T21:14:00.257 INFO:teuthology.orchestra.run.smithi077.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T21:14:00.257 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-09-18T21:10:17.230179+0000 2024-09-18T21:14:00.257 INFO:teuthology.orchestra.run.smithi077.stdout:modified 2024-09-18T21:10:33.373241+0000 2024-09-18T21:14:00.257 INFO:teuthology.orchestra.run.smithi077.stdout:tableserver 0 2024-09-18T21:14:00.257 INFO:teuthology.orchestra.run.smithi077.stdout:root 0 2024-09-18T21:14:00.257 INFO:teuthology.orchestra.run.smithi077.stdout:session_timeout 60 2024-09-18T21:14:00.257 INFO:teuthology.orchestra.run.smithi077.stdout:session_autoclose 300 2024-09-18T21:14:00.257 INFO:teuthology.orchestra.run.smithi077.stdout:max_file_size 1099511627776 2024-09-18T21:14:00.257 INFO:teuthology.orchestra.run.smithi077.stdout:required_client_features {} 2024-09-18T21:14:00.257 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure 0 2024-09-18T21:14:00.257 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure_osd_epoch 0 2024-09-18T21:14:00.257 INFO:teuthology.orchestra.run.smithi077.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T21:14:00.257 INFO:teuthology.orchestra.run.smithi077.stdout:max_mds 1 2024-09-18T21:14:00.257 INFO:teuthology.orchestra.run.smithi077.stdout:in 0 2024-09-18T21:14:00.258 INFO:teuthology.orchestra.run.smithi077.stdout:up {0=14446} 2024-09-18T21:14:00.258 INFO:teuthology.orchestra.run.smithi077.stdout:failed 2024-09-18T21:14:00.258 INFO:teuthology.orchestra.run.smithi077.stdout:damaged 2024-09-18T21:14:00.258 INFO:teuthology.orchestra.run.smithi077.stdout:stopped 2024-09-18T21:14:00.258 INFO:teuthology.orchestra.run.smithi077.stdout:data_pools [3] 2024-09-18T21:14:00.258 INFO:teuthology.orchestra.run.smithi077.stdout:metadata_pool 2 2024-09-18T21:14:00.258 INFO:teuthology.orchestra.run.smithi077.stdout:inline_data disabled 2024-09-18T21:14:00.258 INFO:teuthology.orchestra.run.smithi077.stdout:balancer 2024-09-18T21:14:00.258 INFO:teuthology.orchestra.run.smithi077.stdout:standby_count_wanted 1 2024-09-18T21:14:00.258 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.vruydi{0:14446} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.77:6826/334039954,v1:172.21.15.77:6827/334039954] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:14:00.258 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:14:00.258 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:14:00.258 INFO:teuthology.orchestra.run.smithi077.stdout:Standby daemons: 2024-09-18T21:14:00.258 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:14:00.259 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.cqfhlw{-1:14458} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.77:6828/862540650,v1:172.21.15.77:6829/862540650] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:14:00.259 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi103.zhdmdg{-1:24255} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.103:6824/2170237078,v1:172.21.15.103:6825/2170237078] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:14:00.259 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi103.opftmf{-1:24267} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.103:6826/4241818403,v1:172.21.15.103:6827/4241818403] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:14:00.260 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 13 2024-09-18T21:14:00.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.258+0000 7f532cf1b640 1 -- 172.21.15.77:0/2987894202 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f531406e390 msgr2=0x7f5314070840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:14:00.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.258+0000 7f532cf1b640 1 --2- 172.21.15.77:0/2987894202 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f531406e390 0x7f5314070840 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5328117830 tx=0x7f531000b040 comp rx=0 tx=0).stop 2024-09-18T21:14:00.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.258+0000 7f532cf1b640 1 -- 172.21.15.77:0/2987894202 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f532806e1e0 msgr2=0x7f5328117a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:14:00.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.258+0000 7f532cf1b640 1 --2- 172.21.15.77:0/2987894202 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f532806e1e0 0x7f5328117a80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5320009c20 tx=0x7f5320004d10 comp rx=0 tx=0).stop 2024-09-18T21:14:00.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.258+0000 7f532cf1b640 1 -- 172.21.15.77:0/2987894202 shutdown_connections 2024-09-18T21:14:00.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.258+0000 7f532cf1b640 1 --2- 172.21.15.77:0/2987894202 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7f531406e390 0x7f5314070840 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:00.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.258+0000 7f532cf1b640 1 --2- 172.21.15.77:0/2987894202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f532806eb30 0x7f5328117fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:00.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.258+0000 7f532cf1b640 1 --2- 172.21.15.77:0/2987894202 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f532806e1e0 0x7f5328117a80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:00.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.258+0000 7f532cf1b640 1 -- 172.21.15.77:0/2987894202 >> 172.21.15.77:0/2987894202 conn(0x7f5328069560 msgr2=0x7f532806ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:14:00.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.258+0000 7f532cf1b640 1 -- 172.21.15.77:0/2987894202 shutdown_connections 2024-09-18T21:14:00.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.259+0000 7f532cf1b640 1 -- 172.21.15.77:0/2987894202 wait complete. 2024-09-18T21:14:00.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:59 smithi103 ceph-mon[34827]: from='client.14698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:14:00.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:59 smithi103 ceph-mon[34827]: from='client.14702 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:14:00.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:59 smithi103 ceph-mon[34827]: pgmap v51: 65 pgs: 65 active+clean; 262 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 57 KiB/s rd, 2.1 MiB/s wr, 1.01k op/s 2024-09-18T21:14:00.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:13:59 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/2002344353' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:14:00.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.367+0000 7fc3f0787640 1 -- 172.21.15.77:0/730702200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3e80fcad0 msgr2=0x7fc3e80fcee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:14:00.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.367+0000 7fc3f0787640 1 --2- 172.21.15.77:0/730702200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3e80fcad0 0x7fc3e80fcee0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc3e40048d0 tx=0x7fc3e4009da0 comp rx=0 tx=0).stop 2024-09-18T21:14:00.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.367+0000 7fc3f0787640 1 -- 172.21.15.77:0/730702200 shutdown_connections 2024-09-18T21:14:00.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.367+0000 7fc3f0787640 1 --2- 172.21.15.77:0/730702200 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3e80fd420 0x7fc3e8103d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:00.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.367+0000 7fc3f0787640 1 --2- 172.21.15.77:0/730702200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3e80fcad0 0x7fc3e80fcee0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:00.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.367+0000 7fc3f0787640 1 -- 172.21.15.77:0/730702200 >> 172.21.15.77:0/730702200 conn(0x7fc3e80f63a0 msgr2=0x7fc3e80f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:14:00.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.367+0000 7fc3f0787640 1 -- 172.21.15.77:0/730702200 shutdown_connections 2024-09-18T21:14:00.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.368+0000 7fc3f0787640 1 -- 172.21.15.77:0/730702200 wait complete. 2024-09-18T21:14:00.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.368+0000 7fc3f0787640 1 Processor -- start 2024-09-18T21:14:00.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.368+0000 7fc3f0787640 1 -- start start 2024-09-18T21:14:00.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.368+0000 7fc3f0787640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3e80fcad0 0x7fc3e810f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:14:00.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.368+0000 7fc3f0787640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3e80fd420 0x7fc3e810f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:14:00.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.368+0000 7fc3f0787640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e810fe10 con 0x7fc3e80fd420 2024-09-18T21:14:00.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.368+0000 7fc3f0787640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e8110630 con 0x7fc3e80fcad0 2024-09-18T21:14:00.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.368+0000 7fc3edd22640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3e80fd420 0x7fc3e810f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:14:00.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.368+0000 7fc3edd22640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3e80fd420 0x7fc3e810f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58516/0 (socket says 172.21.15.77:58516) 2024-09-18T21:14:00.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.368+0000 7fc3ee523640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3e80fcad0 0x7fc3e810f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:14:00.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.368+0000 7fc3edd22640 1 -- 172.21.15.77:0/1510897311 learned_addr learned my addr 172.21.15.77:0/1510897311 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:14:00.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.369+0000 7fc3edd22640 1 -- 172.21.15.77:0/1510897311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3e80fcad0 msgr2=0x7fc3e810f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:14:00.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.369+0000 7fc3edd22640 1 --2- 172.21.15.77:0/1510897311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3e80fcad0 0x7fc3e810f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:00.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.369+0000 7fc3edd22640 1 -- 172.21.15.77:0/1510897311 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e4005040 con 0x7fc3e80fd420 2024-09-18T21:14:00.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.369+0000 7fc3edd22640 1 --2- 172.21.15.77:0/1510897311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3e80fd420 0x7fc3e810f7c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc3d800eb70 tx=0x7fc3d800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:14:00.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.369+0000 7fc3deffd640 1 -- 172.21.15.77:0/1510897311 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3d8007c30 con 0x7fc3e80fd420 2024-09-18T21:14:00.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.369+0000 7fc3f0787640 1 -- 172.21.15.77:0/1510897311 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3e8110860 con 0x7fc3e80fd420 2024-09-18T21:14:00.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.369+0000 7fc3f0787640 1 -- 172.21.15.77:0/1510897311 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3e8110e00 con 0x7fc3e80fd420 2024-09-18T21:14:00.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.369+0000 7fc3deffd640 1 -- 172.21.15.77:0/1510897311 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc3d800f040 con 0x7fc3e80fd420 2024-09-18T21:14:00.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.369+0000 7fc3deffd640 1 -- 172.21.15.77:0/1510897311 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3d800c9a0 con 0x7fc3e80fd420 2024-09-18T21:14:00.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.371+0000 7fc3f0787640 1 -- 172.21.15.77:0/1510897311 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3cc005240 con 0x7fc3e80fd420 2024-09-18T21:14:00.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.371+0000 7fc3deffd640 1 -- 172.21.15.77:0/1510897311 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 25) v1 ==== 91386+0+0 (secure 0 0 0) 0x7fc3d800cc00 con 0x7fc3e80fd420 2024-09-18T21:14:00.374 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.372+0000 7fc3deffd640 1 --2- 172.21.15.77:0/1510897311 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7fc3d406e390 0x7fc3d4070840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:14:00.374 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.372+0000 7fc3deffd640 1 -- 172.21.15.77:0/1510897311 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fc3d808d4a0 con 0x7fc3e80fd420 2024-09-18T21:14:00.374 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.372+0000 7fc3ee523640 1 --2- 172.21.15.77:0/1510897311 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7fc3d406e390 0x7fc3d4070840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:14:00.374 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.373+0000 7fc3ee523640 1 --2- 172.21.15.77:0/1510897311 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7fc3d406e390 0x7fc3d4070840 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4004540 tx=0x7fc3e4035040 comp rx=0 tx=0).ready entity=mgr.14578 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:14:00.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.377+0000 7fc3deffd640 1 -- 172.21.15.77:0/1510897311 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fc3d8057260 con 0x7fc3e80fd420 2024-09-18T21:14:00.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.677+0000 7fc3f0787640 1 -- 172.21.15.77:0/1510897311 --> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3cc000bf0 con 0x7fc3d406e390 2024-09-18T21:14:00.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.678+0000 7fc3deffd640 1 -- 172.21.15.77:0/1510897311 <== mgr.14578 v2:172.21.15.103:6828/1199124716 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7fc3cc000bf0 con 0x7fc3d406e390 2024-09-18T21:14:00.679 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-18T21:14:00.679 INFO:teuthology.orchestra.run.smithi077.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a", 2024-09-18T21:14:00.679 INFO:teuthology.orchestra.run.smithi077.stdout: "in_progress": true, 2024-09-18T21:14:00.679 INFO:teuthology.orchestra.run.smithi077.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T21:14:00.679 INFO:teuthology.orchestra.run.smithi077.stdout: "services_complete": [], 2024-09-18T21:14:00.679 INFO:teuthology.orchestra.run.smithi077.stdout: "progress": "", 2024-09-18T21:14:00.680 INFO:teuthology.orchestra.run.smithi077.stdout: "message": "Currently upgrading mgr daemons", 2024-09-18T21:14:00.680 INFO:teuthology.orchestra.run.smithi077.stdout: "is_paused": false 2024-09-18T21:14:00.680 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-18T21:14:00.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.681+0000 7fc3f0787640 1 -- 172.21.15.77:0/1510897311 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7fc3d406e390 msgr2=0x7fc3d4070840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:14:00.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.681+0000 7fc3f0787640 1 --2- 172.21.15.77:0/1510897311 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7fc3d406e390 0x7fc3d4070840 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4004540 tx=0x7fc3e4035040 comp rx=0 tx=0).stop 2024-09-18T21:14:00.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.681+0000 7fc3f0787640 1 -- 172.21.15.77:0/1510897311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3e80fd420 msgr2=0x7fc3e810f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:14:00.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.681+0000 7fc3f0787640 1 --2- 172.21.15.77:0/1510897311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3e80fd420 0x7fc3e810f7c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc3d800eb70 tx=0x7fc3d800b040 comp rx=0 tx=0).stop 2024-09-18T21:14:00.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.681+0000 7fc3f0787640 1 -- 172.21.15.77:0/1510897311 shutdown_connections 2024-09-18T21:14:00.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.681+0000 7fc3f0787640 1 --2- 172.21.15.77:0/1510897311 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7fc3d406e390 0x7fc3d4070840 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:00.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.681+0000 7fc3f0787640 1 --2- 172.21.15.77:0/1510897311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3e80fd420 0x7fc3e810f7c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:00.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.681+0000 7fc3f0787640 1 --2- 172.21.15.77:0/1510897311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3e80fcad0 0x7fc3e810f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:00.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.681+0000 7fc3f0787640 1 -- 172.21.15.77:0/1510897311 >> 172.21.15.77:0/1510897311 conn(0x7fc3e80f63a0 msgr2=0x7fc3e80f67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:14:00.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.681+0000 7fc3f0787640 1 -- 172.21.15.77:0/1510897311 shutdown_connections 2024-09-18T21:14:00.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.681+0000 7fc3f0787640 1 -- 172.21.15.77:0/1510897311 wait complete. 2024-09-18T21:14:00.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.782+0000 7fa1c02a6640 1 -- 172.21.15.77:0/324689022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1b80fb8a0 msgr2=0x7fa1b80fbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:14:00.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.782+0000 7fa1c02a6640 1 --2- 172.21.15.77:0/324689022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1b80fb8a0 0x7fa1b80fbcb0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa1b40048d0 tx=0x7fa1b4009da0 comp rx=0 tx=0).stop 2024-09-18T21:14:00.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.782+0000 7fa1c02a6640 1 -- 172.21.15.77:0/324689022 shutdown_connections 2024-09-18T21:14:00.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.782+0000 7fa1c02a6640 1 --2- 172.21.15.77:0/324689022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1b80fc1f0 0x7fa1b80fa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:00.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.782+0000 7fa1c02a6640 1 --2- 172.21.15.77:0/324689022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1b80fb8a0 0x7fa1b80fbcb0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:00.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.782+0000 7fa1c02a6640 1 -- 172.21.15.77:0/324689022 >> 172.21.15.77:0/324689022 conn(0x7fa1b80f6390 msgr2=0x7fa1b80f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:14:00.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.783+0000 7fa1c02a6640 1 -- 172.21.15.77:0/324689022 shutdown_connections 2024-09-18T21:14:00.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.783+0000 7fa1c02a6640 1 -- 172.21.15.77:0/324689022 wait complete. 2024-09-18T21:14:00.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.783+0000 7fa1c02a6640 1 Processor -- start 2024-09-18T21:14:00.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.783+0000 7fa1c02a6640 1 -- start start 2024-09-18T21:14:00.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.783+0000 7fa1c02a6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1b80fb8a0 0x7fa1b811c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:14:00.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.783+0000 7fa1c02a6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1b80fc1f0 0x7fa1b811c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:14:00.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.783+0000 7fa1c02a6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b811d160 con 0x7fa1b80fb8a0 2024-09-18T21:14:00.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.784+0000 7fa1c02a6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b811d2d0 con 0x7fa1b80fc1f0 2024-09-18T21:14:00.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.784+0000 7fa1be042640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1b80fb8a0 0x7fa1b811c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:14:00.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.784+0000 7fa1be042640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1b80fb8a0 0x7fa1b811c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58526/0 (socket says 172.21.15.77:58526) 2024-09-18T21:14:00.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.784+0000 7fa1be042640 1 -- 172.21.15.77:0/3275872523 learned_addr learned my addr 172.21.15.77:0/3275872523 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:14:00.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.784+0000 7fa1bd841640 1 --2- 172.21.15.77:0/3275872523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1b80fc1f0 0x7fa1b811c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:14:00.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.784+0000 7fa1bd841640 1 -- 172.21.15.77:0/3275872523 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1b80fb8a0 msgr2=0x7fa1b811c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:14:00.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.784+0000 7fa1bd841640 1 --2- 172.21.15.77:0/3275872523 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1b80fb8a0 0x7fa1b811c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:00.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.784+0000 7fa1bd841640 1 -- 172.21.15.77:0/3275872523 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b4005040 con 0x7fa1b80fc1f0 2024-09-18T21:14:00.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.784+0000 7fa1bd841640 1 --2- 172.21.15.77:0/3275872523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1b80fc1f0 0x7fa1b811c820 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa1a800e910 tx=0x7fa1a800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:14:00.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.784+0000 7fa1aeffd640 1 -- 172.21.15.77:0/3275872523 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1a8007c30 con 0x7fa1b80fc1f0 2024-09-18T21:14:00.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.785+0000 7fa1aeffd640 1 -- 172.21.15.77:0/3275872523 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa1a800f040 con 0x7fa1b80fc1f0 2024-09-18T21:14:00.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.785+0000 7fa1aeffd640 1 -- 172.21.15.77:0/3275872523 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1a800ca20 con 0x7fa1b80fc1f0 2024-09-18T21:14:00.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.785+0000 7fa1c02a6640 1 -- 172.21.15.77:0/3275872523 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1b811d550 con 0x7fa1b80fc1f0 2024-09-18T21:14:00.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.785+0000 7fa1c02a6640 1 -- 172.21.15.77:0/3275872523 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1b811daa0 con 0x7fa1b80fc1f0 2024-09-18T21:14:00.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.786+0000 7fa1c02a6640 1 -- 172.21.15.77:0/3275872523 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1b80fa010 con 0x7fa1b80fc1f0 2024-09-18T21:14:00.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.787+0000 7fa1aeffd640 1 -- 172.21.15.77:0/3275872523 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 25) v1 ==== 91386+0+0 (secure 0 0 0) 0x7fa1a800cb80 con 0x7fa1b80fc1f0 2024-09-18T21:14:00.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.787+0000 7fa1aeffd640 1 --2- 172.21.15.77:0/3275872523 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7fa1a406e390 0x7fa1a4070840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:14:00.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.787+0000 7fa1aeffd640 1 -- 172.21.15.77:0/3275872523 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fa1a808d450 con 0x7fa1b80fc1f0 2024-09-18T21:14:00.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.788+0000 7fa1be042640 1 --2- 172.21.15.77:0/3275872523 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7fa1a406e390 0x7fa1a4070840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:14:00.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.790+0000 7fa1be042640 1 --2- 172.21.15.77:0/3275872523 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7fa1a406e390 0x7fa1a4070840 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa1b4000c00 tx=0x7fa1b4035040 comp rx=0 tx=0).ready entity=mgr.14578 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:14:00.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:00.792+0000 7fa1aeffd640 1 -- 172.21.15.77:0/3275872523 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fa1a8050670 con 0x7fa1b80fc1f0 2024-09-18T21:14:01.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:01.111+0000 7fa1c02a6640 1 -- 172.21.15.77:0/3275872523 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa1b804b720 con 0x7fa1b80fc1f0 2024-09-18T21:14:01.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:01.112+0000 7fa1aeffd640 1 -- 172.21.15.77:0/3275872523 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fa1a8057230 con 0x7fa1b80fc1f0 2024-09-18T21:14:01.113 INFO:teuthology.orchestra.run.smithi077.stdout:HEALTH_OK 2024-09-18T21:14:01.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:01.114+0000 7fa1c02a6640 1 -- 172.21.15.77:0/3275872523 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7fa1a406e390 msgr2=0x7fa1a4070840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:14:01.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:01.114+0000 7fa1c02a6640 1 --2- 172.21.15.77:0/3275872523 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7fa1a406e390 0x7fa1a4070840 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa1b4000c00 tx=0x7fa1b4035040 comp rx=0 tx=0).stop 2024-09-18T21:14:01.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:01.114+0000 7fa1c02a6640 1 -- 172.21.15.77:0/3275872523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1b80fc1f0 msgr2=0x7fa1b811c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:14:01.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:01.114+0000 7fa1c02a6640 1 --2- 172.21.15.77:0/3275872523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1b80fc1f0 0x7fa1b811c820 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa1a800e910 tx=0x7fa1a800b040 comp rx=0 tx=0).stop 2024-09-18T21:14:01.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:01.114+0000 7fa1c02a6640 1 -- 172.21.15.77:0/3275872523 shutdown_connections 2024-09-18T21:14:01.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:01.114+0000 7fa1c02a6640 1 --2- 172.21.15.77:0/3275872523 >> [v2:172.21.15.103:6828/1199124716,v1:172.21.15.103:6829/1199124716] conn(0x7fa1a406e390 0x7fa1a4070840 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:01.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:01.114+0000 7fa1c02a6640 1 --2- 172.21.15.77:0/3275872523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1b80fc1f0 0x7fa1b811c820 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:01.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:01.114+0000 7fa1c02a6640 1 --2- 172.21.15.77:0/3275872523 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1b80fb8a0 0x7fa1b811c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:01.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:01.114+0000 7fa1c02a6640 1 -- 172.21.15.77:0/3275872523 >> 172.21.15.77:0/3275872523 conn(0x7fa1b80f6390 msgr2=0x7fa1b80f7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:14:01.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:01.114+0000 7fa1c02a6640 1 -- 172.21.15.77:0/3275872523 shutdown_connections 2024-09-18T21:14:01.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:01.114+0000 7fa1c02a6640 1 -- 172.21.15.77:0/3275872523 wait complete. 2024-09-18T21:14:01.398 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:01 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:14:01.398 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:01 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:14:01.398 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:01 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/2987894202' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T21:14:01.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:01 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:14:01.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:01 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:14:01.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:01 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/2987894202' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T21:14:02.402 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:02 smithi077 ceph-mon[27689]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:14:02.403 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:02 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/3275872523' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T21:14:02.403 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:02 smithi077 ceph-mon[27689]: pgmap v52: 65 pgs: 65 active+clean; 262 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 36 KiB/s rd, 1.4 MiB/s wr, 800 op/s 2024-09-18T21:14:02.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:02 smithi103 ceph-mon[34827]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:14:02.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:02 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/3275872523' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T21:14:02.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:02 smithi103 ceph-mon[34827]: pgmap v52: 65 pgs: 65 active+clean; 262 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 36 KiB/s rd, 1.4 MiB/s wr, 800 op/s 2024-09-18T21:14:04.677 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:04 smithi077 ceph-mon[27689]: pgmap v53: 65 pgs: 65 active+clean; 262 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 36 KiB/s rd, 1.4 MiB/s wr, 800 op/s 2024-09-18T21:14:04.677 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:04 smithi077 ceph-mon[27689]: Standby manager daemon smithi077.utkpjg restarted 2024-09-18T21:14:04.677 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:04 smithi077 ceph-mon[27689]: Standby manager daemon smithi077.utkpjg started 2024-09-18T21:14:04.677 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:04 smithi077 ceph-mon[27689]: from='mgr.? 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi077.utkpjg/crt"}]: dispatch 2024-09-18T21:14:04.677 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:04 smithi077 ceph-mon[27689]: from='mgr.? 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T21:14:04.677 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:04 smithi077 ceph-mon[27689]: from='mgr.? 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi077.utkpjg/key"}]: dispatch 2024-09-18T21:14:04.677 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:04 smithi077 ceph-mon[27689]: from='mgr.? 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T21:14:04.693 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:04 smithi103 ceph-mon[34827]: pgmap v53: 65 pgs: 65 active+clean; 262 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 36 KiB/s rd, 1.4 MiB/s wr, 800 op/s 2024-09-18T21:14:04.693 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:04 smithi103 ceph-mon[34827]: Standby manager daemon smithi077.utkpjg restarted 2024-09-18T21:14:04.693 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:04 smithi103 ceph-mon[34827]: Standby manager daemon smithi077.utkpjg started 2024-09-18T21:14:04.693 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:04 smithi103 ceph-mon[34827]: from='mgr.? 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi077.utkpjg/crt"}]: dispatch 2024-09-18T21:14:04.693 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:04 smithi103 ceph-mon[34827]: from='mgr.? 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T21:14:04.693 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:04 smithi103 ceph-mon[34827]: from='mgr.? 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi077.utkpjg/key"}]: dispatch 2024-09-18T21:14:04.693 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:04 smithi103 ceph-mon[34827]: from='mgr.? 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T21:14:05.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:05 smithi077 ceph-mon[27689]: mgrmap e26: smithi103.zjztqc(active, since 101s), standbys: smithi077.utkpjg 2024-09-18T21:14:05.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:05 smithi103 ceph-mon[34827]: mgrmap e26: smithi103.zjztqc(active, since 101s), standbys: smithi077.utkpjg 2024-09-18T21:14:06.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:06 smithi077 ceph-mon[27689]: pgmap v54: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 51 KiB/s rd, 1.9 MiB/s wr, 988 op/s 2024-09-18T21:14:06.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:06 smithi103 ceph-mon[34827]: pgmap v54: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 51 KiB/s rd, 1.9 MiB/s wr, 988 op/s 2024-09-18T21:14:08.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:08 smithi077 ceph-mon[27689]: pgmap v55: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 33 KiB/s rd, 1.2 MiB/s wr, 577 op/s 2024-09-18T21:14:08.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:08 smithi103 ceph-mon[34827]: pgmap v55: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 33 KiB/s rd, 1.2 MiB/s wr, 577 op/s 2024-09-18T21:14:09.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:09 smithi077 ceph-mon[27689]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:14:09.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:09 smithi103 ceph-mon[34827]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:14:10.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:10 smithi077 ceph-mon[27689]: pgmap v56: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 48 KiB/s rd, 1.8 MiB/s wr, 713 op/s 2024-09-18T21:14:10.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:10 smithi103 ceph-mon[34827]: pgmap v56: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 48 KiB/s rd, 1.8 MiB/s wr, 713 op/s 2024-09-18T21:14:12.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:12 smithi077 ceph-mon[27689]: pgmap v57: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.1 MiB/s wr, 324 op/s 2024-09-18T21:14:12.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:12 smithi103 ceph-mon[34827]: pgmap v57: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.1 MiB/s wr, 324 op/s 2024-09-18T21:14:14.075 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:13 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:14:14.075 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:13 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:14:14.075 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:13 smithi077 ceph-mon[27689]: pgmap v58: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.1 MiB/s wr, 324 op/s 2024-09-18T21:14:14.075 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:13 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:14:14.075 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:13 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:14:14.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:13 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:14:14.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:13 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:14:14.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:13 smithi103 ceph-mon[34827]: pgmap v58: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.1 MiB/s wr, 324 op/s 2024-09-18T21:14:14.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:13 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:14:14.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:13 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:14:16.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:16 smithi077 ceph-mon[27689]: pgmap v59: 65 pgs: 65 active+clean; 240 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 46 KiB/s rd, 1.7 MiB/s wr, 506 op/s 2024-09-18T21:14:16.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:16 smithi103 ceph-mon[34827]: pgmap v59: 65 pgs: 65 active+clean; 240 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 46 KiB/s rd, 1.7 MiB/s wr, 506 op/s 2024-09-18T21:14:18.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:18 smithi077 ceph-mon[27689]: pgmap v60: 65 pgs: 65 active+clean; 240 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.2 MiB/s wr, 318 op/s 2024-09-18T21:14:18.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:18 smithi103 ceph-mon[34827]: pgmap v60: 65 pgs: 65 active+clean; 240 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.2 MiB/s wr, 318 op/s 2024-09-18T21:14:20.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:20 smithi077 ceph-mon[27689]: pgmap v61: 65 pgs: 65 active+clean; 227 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 46 KiB/s rd, 1.8 MiB/s wr, 489 op/s 2024-09-18T21:14:20.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:20 smithi103 ceph-mon[34827]: pgmap v61: 65 pgs: 65 active+clean; 227 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 46 KiB/s rd, 1.8 MiB/s wr, 489 op/s 2024-09-18T21:14:22.572 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:22 smithi077 ceph-mon[27689]: pgmap v62: 65 pgs: 65 active+clean; 227 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 1.2 MiB/s wr, 353 op/s 2024-09-18T21:14:22.761 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:22 smithi103 ceph-mon[34827]: pgmap v62: 65 pgs: 65 active+clean; 227 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 1.2 MiB/s wr, 353 op/s 2024-09-18T21:14:23.711 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-09-18T21:14:23.712 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-09-18T21:14:23.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:23 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:14:23.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:23 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:14:23.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:23 smithi077 ceph-mon[27689]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:14:23.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:23 smithi077 ceph-mon[27689]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:14:23.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:23 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:14:23.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:23 smithi077 ceph-mon[27689]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:14:23.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:23 smithi077 ceph-mon[27689]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "mgr fail", "who": "smithi103.zjztqc"}]: dispatch 2024-09-18T21:14:23.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:23 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "mgr fail", "who": "smithi103.zjztqc"}]: dispatch 2024-09-18T21:14:23.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:23 smithi077 ceph-mon[27689]: Activating manager daemon smithi077.utkpjg 2024-09-18T21:14:23.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:23 smithi077 ceph-mon[27689]: osdmap e45: 6 total, 6 up, 6 in 2024-09-18T21:14:23.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:23 smithi077 ceph-mon[27689]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' cmd='[{"prefix": "mgr fail", "who": "smithi103.zjztqc"}]': finished 2024-09-18T21:14:23.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:23 smithi077 ceph-mon[27689]: mgrmap e27: smithi077.utkpjg(active, starting, since 0.00598182s) 2024-09-18T21:14:23.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:23 smithi077 ceph-mon[27689]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mon metadata", "id": "smithi077"}]: dispatch 2024-09-18T21:14:23.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:23 smithi077 ceph-mon[27689]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mon metadata", "id": "smithi103"}]: dispatch 2024-09-18T21:14:23.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:23 smithi077 ceph-mon[27689]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.vruydi"}]: dispatch 2024-09-18T21:14:23.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:23 smithi077 ceph-mon[27689]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.cqfhlw"}]: dispatch 2024-09-18T21:14:23.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:23 smithi077 ceph-mon[27689]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi103.zhdmdg"}]: dispatch 2024-09-18T21:14:23.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:23 smithi077 ceph-mon[27689]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi103.opftmf"}]: dispatch 2024-09-18T21:14:23.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:23 smithi077 ceph-mon[27689]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mgr metadata", "who": "smithi077.utkpjg", "id": "smithi077.utkpjg"}]: dispatch 2024-09-18T21:14:23.715 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:23 smithi077 ceph-mon[27689]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T21:14:23.715 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:23 smithi077 ceph-mon[27689]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T21:14:23.715 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:23 smithi077 ceph-mon[27689]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T21:14:23.715 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:23 smithi077 ceph-mon[27689]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T21:14:23.715 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:23 smithi077 ceph-mon[27689]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T21:14:23.715 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:23 smithi077 ceph-mon[27689]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T21:14:23.715 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:23 smithi077 ceph-mon[27689]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-18T21:14:23.715 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:23 smithi077 ceph-mon[27689]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-18T21:14:23.715 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:23 smithi077 ceph-mon[27689]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-18T21:14:23.715 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:23 smithi077 ceph-mon[27689]: Manager daemon smithi077.utkpjg is now available 2024-09-18T21:14:23.715 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:23 smithi077 ceph-mon[27689]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:14:23.715 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:23 smithi077 ceph-mon[27689]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:14:23.716 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:23 smithi077 ceph-mon[27689]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi077.utkpjg/mirror_snapshot_schedule"}]: dispatch 2024-09-18T21:14:23.716 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:23 smithi077 ceph-mon[27689]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi077.utkpjg/mirror_snapshot_schedule"}]: dispatch 2024-09-18T21:14:23.716 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:23 smithi077 ceph-mon[27689]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi077.utkpjg/trash_purge_schedule"}]: dispatch 2024-09-18T21:14:23.716 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:23 smithi077 ceph-mon[27689]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi077.utkpjg/trash_purge_schedule"}]: dispatch 2024-09-18T21:14:23.738 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:23 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:14:23.738 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:23 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:14:23.738 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:23 smithi103 ceph-mon[34827]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:14:23.738 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:23 smithi103 ceph-mon[34827]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:14:23.738 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:23 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' 2024-09-18T21:14:23.739 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:23 smithi103 ceph-mon[34827]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:14:23.739 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:23 smithi103 ceph-mon[34827]: from='mgr.14578 172.21.15.103:0/1785518472' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "mgr fail", "who": "smithi103.zjztqc"}]: dispatch 2024-09-18T21:14:23.739 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:23 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "mgr fail", "who": "smithi103.zjztqc"}]: dispatch 2024-09-18T21:14:23.739 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:23 smithi103 ceph-mon[34827]: Activating manager daemon smithi077.utkpjg 2024-09-18T21:14:23.739 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:23 smithi103 ceph-mon[34827]: osdmap e45: 6 total, 6 up, 6 in 2024-09-18T21:14:23.739 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:23 smithi103 ceph-mon[34827]: from='mgr.14578 ' entity='mgr.smithi103.zjztqc' cmd='[{"prefix": "mgr fail", "who": "smithi103.zjztqc"}]': finished 2024-09-18T21:14:23.739 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:23 smithi103 ceph-mon[34827]: mgrmap e27: smithi077.utkpjg(active, starting, since 0.00598182s) 2024-09-18T21:14:23.739 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:23 smithi103 ceph-mon[34827]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mon metadata", "id": "smithi077"}]: dispatch 2024-09-18T21:14:23.739 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:23 smithi103 ceph-mon[34827]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mon metadata", "id": "smithi103"}]: dispatch 2024-09-18T21:14:23.739 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:23 smithi103 ceph-mon[34827]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.vruydi"}]: dispatch 2024-09-18T21:14:23.739 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:23 smithi103 ceph-mon[34827]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.cqfhlw"}]: dispatch 2024-09-18T21:14:23.739 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:23 smithi103 ceph-mon[34827]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi103.zhdmdg"}]: dispatch 2024-09-18T21:14:23.739 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:23 smithi103 ceph-mon[34827]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi103.opftmf"}]: dispatch 2024-09-18T21:14:23.739 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:23 smithi103 ceph-mon[34827]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mgr metadata", "who": "smithi077.utkpjg", "id": "smithi077.utkpjg"}]: dispatch 2024-09-18T21:14:23.739 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:23 smithi103 ceph-mon[34827]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T21:14:23.740 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:23 smithi103 ceph-mon[34827]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T21:14:23.740 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:23 smithi103 ceph-mon[34827]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T21:14:23.740 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:23 smithi103 ceph-mon[34827]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T21:14:23.740 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:23 smithi103 ceph-mon[34827]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T21:14:23.740 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:23 smithi103 ceph-mon[34827]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T21:14:23.740 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:23 smithi103 ceph-mon[34827]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-18T21:14:23.740 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:23 smithi103 ceph-mon[34827]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-18T21:14:23.740 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:23 smithi103 ceph-mon[34827]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-18T21:14:23.740 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:23 smithi103 ceph-mon[34827]: Manager daemon smithi077.utkpjg is now available 2024-09-18T21:14:23.740 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:23 smithi103 ceph-mon[34827]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:14:23.740 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:23 smithi103 ceph-mon[34827]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:14:23.740 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:23 smithi103 ceph-mon[34827]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi077.utkpjg/mirror_snapshot_schedule"}]: dispatch 2024-09-18T21:14:23.740 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:23 smithi103 ceph-mon[34827]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi077.utkpjg/mirror_snapshot_schedule"}]: dispatch 2024-09-18T21:14:23.741 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:23 smithi103 ceph-mon[34827]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi077.utkpjg/trash_purge_schedule"}]: dispatch 2024-09-18T21:14:23.741 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:23 smithi103 ceph-mon[34827]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi077.utkpjg/trash_purge_schedule"}]: dispatch 2024-09-18T21:14:24.063 DEBUG:teuthology.parallel:result is None 2024-09-18T21:14:24.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:24 smithi077 ceph-mon[27689]: mgrmap e28: smithi077.utkpjg(active, since 1.01117s) 2024-09-18T21:14:24.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:24 smithi077 ceph-mon[27689]: [18/Sep/2024:21:14:24] ENGINE Bus STARTING 2024-09-18T21:14:24.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:24 smithi077 ceph-mon[27689]: [18/Sep/2024:21:14:24] ENGINE Serving on http://172.21.15.77:8765 2024-09-18T21:14:24.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:24 smithi077 ceph-mon[27689]: [18/Sep/2024:21:14:24] ENGINE Serving on https://172.21.15.77:7150 2024-09-18T21:14:24.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:24 smithi077 ceph-mon[27689]: [18/Sep/2024:21:14:24] ENGINE Bus STARTED 2024-09-18T21:14:24.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:24 smithi077 ceph-mon[27689]: [18/Sep/2024:21:14:24] ENGINE Error in HTTPServer.serve 2024-09-18T21:14:24.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Traceback (most recent call last): 2024-09-18T21:14:24.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-18T21:14:24.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: self._connections.run(self.expiration_interval) 2024-09-18T21:14:24.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-18T21:14:24.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: self._run(expiration_interval) 2024-09-18T21:14:24.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-18T21:14:24.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-18T21:14:24.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-18T21:14:24.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-18T21:14:24.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-18T21:14:24.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: s = self.context.wrap_socket( 2024-09-18T21:14:24.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-18T21:14:24.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: return self.sslsocket_class._create( 2024-09-18T21:14:24.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-18T21:14:24.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: self.do_handshake() 2024-09-18T21:14:24.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-18T21:14:24.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: self._sslobj.do_handshake() 2024-09-18T21:14:24.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-18T21:14:25.140 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:24 smithi103 ceph-mon[34827]: mgrmap e28: smithi077.utkpjg(active, since 1.01117s) 2024-09-18T21:14:25.140 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:24 smithi103 ceph-mon[34827]: [18/Sep/2024:21:14:24] ENGINE Bus STARTING 2024-09-18T21:14:25.140 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:24 smithi103 ceph-mon[34827]: [18/Sep/2024:21:14:24] ENGINE Serving on http://172.21.15.77:8765 2024-09-18T21:14:25.140 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:24 smithi103 ceph-mon[34827]: [18/Sep/2024:21:14:24] ENGINE Serving on https://172.21.15.77:7150 2024-09-18T21:14:25.140 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:24 smithi103 ceph-mon[34827]: [18/Sep/2024:21:14:24] ENGINE Bus STARTED 2024-09-18T21:14:25.140 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:24 smithi103 ceph-mon[34827]: [18/Sep/2024:21:14:24] ENGINE Error in HTTPServer.serve 2024-09-18T21:14:25.141 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Traceback (most recent call last): 2024-09-18T21:14:25.141 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-18T21:14:25.141 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: self._connections.run(self.expiration_interval) 2024-09-18T21:14:25.141 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-18T21:14:25.141 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: self._run(expiration_interval) 2024-09-18T21:14:25.141 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-18T21:14:25.141 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-18T21:14:25.141 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-18T21:14:25.141 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-18T21:14:25.141 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-18T21:14:25.141 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: s = self.context.wrap_socket( 2024-09-18T21:14:25.141 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-18T21:14:25.141 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: return self.sslsocket_class._create( 2024-09-18T21:14:25.142 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-18T21:14:25.142 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: self.do_handshake() 2024-09-18T21:14:25.142 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-18T21:14:25.142 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: self._sslobj.do_handshake() 2024-09-18T21:14:25.142 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-18T21:14:25.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:25 smithi077 ceph-mon[27689]: pgmap v4: 65 pgs: 65 active+clean; 220 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:14:26.036 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:25 smithi103 ceph-mon[34827]: pgmap v4: 65 pgs: 65 active+clean; 220 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:14:26.955 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-18T21:14:26.956 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-18T21:14:27.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:26 smithi103 ceph-mon[34827]: mgrmap e29: smithi077.utkpjg(active, since 3s) 2024-09-18T21:14:27.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:26 smithi103 ceph-mon[34827]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:27.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:26 smithi103 ceph-mon[34827]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:27.024 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:26 smithi077 ceph-mon[27689]: mgrmap e29: smithi077.utkpjg(active, since 3s) 2024-09-18T21:14:27.024 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:26 smithi077 ceph-mon[27689]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:27.024 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:26 smithi077 ceph-mon[27689]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:27.315 DEBUG:teuthology.parallel:result is None 2024-09-18T21:14:27.316 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-18T21:14:27.395 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-18T21:14:27.396 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-09-18T21:14:27.447 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-09-18T21:14:27.447 DEBUG:teuthology.parallel:result is None 2024-09-18T21:14:28.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:28 smithi077 ceph-mon[27689]: pgmap v5: 65 pgs: 65 active+clean; 220 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:14:28.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:28 smithi077 ceph-mon[27689]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:28.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:28 smithi077 ceph-mon[27689]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:28.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:28 smithi077 ceph-mon[27689]: Standby manager daemon smithi103.zjztqc started 2024-09-18T21:14:28.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:28 smithi077 ceph-mon[27689]: from='mgr.? 172.21.15.103:0/2740427961' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi103.zjztqc/crt"}]: dispatch 2024-09-18T21:14:28.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:28 smithi077 ceph-mon[27689]: from='mgr.? 172.21.15.103:0/2740427961' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T21:14:28.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:28 smithi077 ceph-mon[27689]: from='mgr.? 172.21.15.103:0/2740427961' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi103.zjztqc/key"}]: dispatch 2024-09-18T21:14:28.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:28 smithi077 ceph-mon[27689]: from='mgr.? 172.21.15.103:0/2740427961' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T21:14:28.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:28 smithi103 ceph-mon[34827]: pgmap v5: 65 pgs: 65 active+clean; 220 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:14:28.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:28 smithi103 ceph-mon[34827]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:28.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:28 smithi103 ceph-mon[34827]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:28.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:28 smithi103 ceph-mon[34827]: Standby manager daemon smithi103.zjztqc started 2024-09-18T21:14:28.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:28 smithi103 ceph-mon[34827]: from='mgr.? 172.21.15.103:0/2740427961' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi103.zjztqc/crt"}]: dispatch 2024-09-18T21:14:28.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:28 smithi103 ceph-mon[34827]: from='mgr.? 172.21.15.103:0/2740427961' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T21:14:28.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:28 smithi103 ceph-mon[34827]: from='mgr.? 172.21.15.103:0/2740427961' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi103.zjztqc/key"}]: dispatch 2024-09-18T21:14:28.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:28 smithi103 ceph-mon[34827]: from='mgr.? 172.21.15.103:0/2740427961' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T21:14:29.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:29 smithi077 ceph-mon[27689]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mgr metadata", "who": "smithi103.zjztqc", "id": "smithi103.zjztqc"}]: dispatch 2024-09-18T21:14:29.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:29 smithi077 ceph-mon[27689]: mgrmap e30: smithi077.utkpjg(active, since 5s), standbys: smithi103.zjztqc 2024-09-18T21:14:29.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:29 smithi077 ceph-mon[27689]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:29.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:29 smithi077 ceph-mon[27689]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:30.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:29 smithi103 ceph-mon[34827]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mgr metadata", "who": "smithi103.zjztqc", "id": "smithi103.zjztqc"}]: dispatch 2024-09-18T21:14:30.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:29 smithi103 ceph-mon[34827]: mgrmap e30: smithi077.utkpjg(active, since 5s), standbys: smithi103.zjztqc 2024-09-18T21:14:30.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:29 smithi103 ceph-mon[34827]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:30.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:29 smithi103 ceph-mon[34827]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:30.896 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:30 smithi077 ceph-mon[27689]: pgmap v6: 65 pgs: 65 active+clean; 219 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 36 KiB/s rd, 725 KiB/s wr, 143 op/s 2024-09-18T21:14:30.896 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:30 smithi077 ceph-mon[27689]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:30.897 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:30 smithi077 ceph-mon[27689]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:31.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:30 smithi103 ceph-mon[34827]: pgmap v6: 65 pgs: 65 active+clean; 219 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 36 KiB/s rd, 725 KiB/s wr, 143 op/s 2024-09-18T21:14:31.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:30 smithi103 ceph-mon[34827]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:31.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:30 smithi103 ceph-mon[34827]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:31.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.200+0000 7f49d9b35640 1 -- 172.21.15.77:0/3119551766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49d40fb430 msgr2=0x7f49d40fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:14:31.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.200+0000 7f49d9b35640 1 --2- 172.21.15.77:0/3119551766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49d40fb430 0x7f49d40fb840 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f49c40048d0 tx=0x7f49c4009da0 comp rx=0 tx=0).stop 2024-09-18T21:14:31.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.201+0000 7f49d9b35640 1 -- 172.21.15.77:0/3119551766 shutdown_connections 2024-09-18T21:14:31.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.201+0000 7f49d9b35640 1 --2- 172.21.15.77:0/3119551766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49d40fc700 0x7f49d40fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:31.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.201+0000 7f49d9b35640 1 --2- 172.21.15.77:0/3119551766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49d40fb430 0x7f49d40fb840 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:31.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.201+0000 7f49d9b35640 1 -- 172.21.15.77:0/3119551766 >> 172.21.15.77:0/3119551766 conn(0x7f49d40f6c10 msgr2=0x7f49d40f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:14:31.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.201+0000 7f49d9b35640 1 -- 172.21.15.77:0/3119551766 shutdown_connections 2024-09-18T21:14:31.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.201+0000 7f49d9b35640 1 -- 172.21.15.77:0/3119551766 wait complete. 2024-09-18T21:14:31.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.201+0000 7f49d9b35640 1 Processor -- start 2024-09-18T21:14:31.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.201+0000 7f49d9b35640 1 -- start start 2024-09-18T21:14:31.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.202+0000 7f49d9b35640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49d40fb430 0x7f49d410fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:14:31.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.202+0000 7f49d9b35640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49d40fc700 0x7f49d4112370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:14:31.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.202+0000 7f49d9b35640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d4065cf0 con 0x7f49d40fc700 2024-09-18T21:14:31.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.202+0000 7f49d9b35640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d4065e60 con 0x7f49d40fb430 2024-09-18T21:14:31.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.202+0000 7f49caffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49d40fc700 0x7f49d4112370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:14:31.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.202+0000 7f49caffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49d40fc700 0x7f49d4112370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39134/0 (socket says 172.21.15.77:39134) 2024-09-18T21:14:31.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.202+0000 7f49caffd640 1 -- 172.21.15.77:0/1591938781 learned_addr learned my addr 172.21.15.77:0/1591938781 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:14:31.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.202+0000 7f49d37fe640 1 --2- 172.21.15.77:0/1591938781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49d40fb430 0x7f49d410fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:14:31.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.202+0000 7f49caffd640 1 -- 172.21.15.77:0/1591938781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49d40fb430 msgr2=0x7f49d410fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:14:31.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.202+0000 7f49caffd640 1 --2- 172.21.15.77:0/1591938781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49d40fb430 0x7f49d410fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:31.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.202+0000 7f49caffd640 1 -- 172.21.15.77:0/1591938781 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c4005040 con 0x7f49d40fc700 2024-09-18T21:14:31.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.202+0000 7f49caffd640 1 --2- 172.21.15.77:0/1591938781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49d40fc700 0x7f49d4112370 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f49bc00b790 tx=0x7f49bc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:14:31.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.202+0000 7f49d0ff9640 1 -- 172.21.15.77:0/1591938781 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49bc00c700 con 0x7f49d40fc700 2024-09-18T21:14:31.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.202+0000 7f49d0ff9640 1 -- 172.21.15.77:0/1591938781 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f49bc00cd00 con 0x7f49d40fc700 2024-09-18T21:14:31.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.202+0000 7f49d9b35640 1 -- 172.21.15.77:0/1591938781 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49d4112970 con 0x7f49d40fc700 2024-09-18T21:14:31.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.202+0000 7f49d0ff9640 1 -- 172.21.15.77:0/1591938781 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49bc015e80 con 0x7f49d40fc700 2024-09-18T21:14:31.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.203+0000 7f49d9b35640 1 -- 172.21.15.77:0/1591938781 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49d4112e90 con 0x7f49d40fc700 2024-09-18T21:14:31.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.203+0000 7f49d9b35640 1 -- 172.21.15.77:0/1591938781 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49d40fa890 con 0x7f49d40fc700 2024-09-18T21:14:31.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.204+0000 7f49d0ff9640 1 -- 172.21.15.77:0/1591938781 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 30) v1 ==== 92027+0+0 (secure 0 0 0) 0x7f49bc012070 con 0x7f49d40fc700 2024-09-18T21:14:31.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.204+0000 7f49d0ff9640 1 --2- 172.21.15.77:0/1591938781 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7f49c006dae0 0x7f49c006ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:14:31.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.205+0000 7f49d0ff9640 1 -- 172.21.15.77:0/1591938781 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f49bc08cb60 con 0x7f49d40fc700 2024-09-18T21:14:31.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.205+0000 7f49d37fe640 1 --2- 172.21.15.77:0/1591938781 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7f49c006dae0 0x7f49c006ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:14:31.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.205+0000 7f49d37fe640 1 --2- 172.21.15.77:0/1591938781 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7f49c006dae0 0x7f49c006ff90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f49c4000c00 tx=0x7f49c4035040 comp rx=0 tx=0).ready entity=mgr.14690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:14:31.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.209+0000 7f49d0ff9640 1 -- 172.21.15.77:0/1591938781 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f49bc056700 con 0x7f49d40fc700 2024-09-18T21:14:31.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.393+0000 7f49d9b35640 1 -- 172.21.15.77:0/1591938781 --> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f49d4100b20 con 0x7f49c006dae0 2024-09-18T21:14:31.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.394+0000 7f49d0ff9640 1 -- 172.21.15.77:0/1591938781 <== mgr.14690 v2:172.21.15.77:6800/3842438735 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f49d4100b20 con 0x7f49c006dae0 2024-09-18T21:14:31.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.397+0000 7f49d9b35640 1 -- 172.21.15.77:0/1591938781 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7f49c006dae0 msgr2=0x7f49c006ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:14:31.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.397+0000 7f49d9b35640 1 --2- 172.21.15.77:0/1591938781 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7f49c006dae0 0x7f49c006ff90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f49c4000c00 tx=0x7f49c4035040 comp rx=0 tx=0).stop 2024-09-18T21:14:31.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.397+0000 7f49d9b35640 1 -- 172.21.15.77:0/1591938781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49d40fc700 msgr2=0x7f49d4112370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:14:31.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.397+0000 7f49d9b35640 1 --2- 172.21.15.77:0/1591938781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49d40fc700 0x7f49d4112370 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f49bc00b790 tx=0x7f49bc0091d0 comp rx=0 tx=0).stop 2024-09-18T21:14:31.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.397+0000 7f49d9b35640 1 -- 172.21.15.77:0/1591938781 shutdown_connections 2024-09-18T21:14:31.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.397+0000 7f49d9b35640 1 --2- 172.21.15.77:0/1591938781 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7f49c006dae0 0x7f49c006ff90 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:31.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.397+0000 7f49d9b35640 1 --2- 172.21.15.77:0/1591938781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49d40fc700 0x7f49d4112370 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:31.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.397+0000 7f49d9b35640 1 --2- 172.21.15.77:0/1591938781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f49d40fb430 0x7f49d410fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:31.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.397+0000 7f49d9b35640 1 -- 172.21.15.77:0/1591938781 >> 172.21.15.77:0/1591938781 conn(0x7f49d40f6c10 msgr2=0x7f49d40f83c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:14:31.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.397+0000 7f49d9b35640 1 -- 172.21.15.77:0/1591938781 shutdown_connections 2024-09-18T21:14:31.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.397+0000 7f49d9b35640 1 -- 172.21.15.77:0/1591938781 wait complete. 2024-09-18T21:14:31.407 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-09-18T21:14:31.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.499+0000 7f981d780640 1 -- 172.21.15.77:0/2359492835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98180fb3f0 msgr2=0x7f98180fb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:14:31.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.499+0000 7f981d780640 1 --2- 172.21.15.77:0/2359492835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98180fb3f0 0x7f98180fb800 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9810009c50 tx=0x7f9810004d10 comp rx=0 tx=0).stop 2024-09-18T21:14:31.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.499+0000 7f981d780640 1 -- 172.21.15.77:0/2359492835 shutdown_connections 2024-09-18T21:14:31.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.499+0000 7f981d780640 1 --2- 172.21.15.77:0/2359492835 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98180fc6c0 0x7f98180fcb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:31.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.499+0000 7f981d780640 1 --2- 172.21.15.77:0/2359492835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98180fb3f0 0x7f98180fb800 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:31.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.499+0000 7f981d780640 1 -- 172.21.15.77:0/2359492835 >> 172.21.15.77:0/2359492835 conn(0x7f98180f6b90 msgr2=0x7f98180f8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:14:31.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.499+0000 7f981d780640 1 -- 172.21.15.77:0/2359492835 shutdown_connections 2024-09-18T21:14:31.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.499+0000 7f981d780640 1 -- 172.21.15.77:0/2359492835 wait complete. 2024-09-18T21:14:31.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.499+0000 7f981d780640 1 Processor -- start 2024-09-18T21:14:31.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.499+0000 7f981d780640 1 -- start start 2024-09-18T21:14:31.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.500+0000 7f981d780640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98180fb3f0 0x7f981810d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:14:31.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.500+0000 7f981d780640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98180fc6c0 0x7f981810d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:14:31.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.500+0000 7f981d780640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981810dbb0 con 0x7f98180fb3f0 2024-09-18T21:14:31.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.500+0000 7f981d780640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981810e3d0 con 0x7f98180fc6c0 2024-09-18T21:14:31.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.500+0000 7f9816ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98180fb3f0 0x7f981810d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:14:31.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.500+0000 7f9816ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98180fb3f0 0x7f981810d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39148/0 (socket says 172.21.15.77:39148) 2024-09-18T21:14:31.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.500+0000 7f9816ffd640 1 -- 172.21.15.77:0/3163173710 learned_addr learned my addr 172.21.15.77:0/3163173710 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:14:31.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.500+0000 7f98167fc640 1 --2- 172.21.15.77:0/3163173710 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98180fc6c0 0x7f981810d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:14:31.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.500+0000 7f9816ffd640 1 -- 172.21.15.77:0/3163173710 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98180fc6c0 msgr2=0x7f981810d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:14:31.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.500+0000 7f9816ffd640 1 --2- 172.21.15.77:0/3163173710 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98180fc6c0 0x7f981810d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:31.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.500+0000 7f9816ffd640 1 -- 172.21.15.77:0/3163173710 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98100098b0 con 0x7f98180fb3f0 2024-09-18T21:14:31.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.500+0000 7f9816ffd640 1 --2- 172.21.15.77:0/3163173710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98180fb3f0 0x7f981810d020 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9810004a30 tx=0x7f9810004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:14:31.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.500+0000 7f980f7fe640 1 -- 172.21.15.77:0/3163173710 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9810032850 con 0x7f98180fb3f0 2024-09-18T21:14:31.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.500+0000 7f980f7fe640 1 -- 172.21.15.77:0/3163173710 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9810009710 con 0x7f98180fb3f0 2024-09-18T21:14:31.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.500+0000 7f981d780640 1 -- 172.21.15.77:0/3163173710 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f981810e600 con 0x7f98180fb3f0 2024-09-18T21:14:31.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.500+0000 7f980f7fe640 1 -- 172.21.15.77:0/3163173710 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f981003dc20 con 0x7f98180fb3f0 2024-09-18T21:14:31.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.501+0000 7f981d780640 1 -- 172.21.15.77:0/3163173710 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f981810eba0 con 0x7f98180fb3f0 2024-09-18T21:14:31.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.502+0000 7f981d780640 1 -- 172.21.15.77:0/3163173710 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f981805ed70 con 0x7f98180fb3f0 2024-09-18T21:14:31.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.502+0000 7f980f7fe640 1 -- 172.21.15.77:0/3163173710 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 30) v1 ==== 92027+0+0 (secure 0 0 0) 0x7f981002f030 con 0x7f98180fb3f0 2024-09-18T21:14:31.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.502+0000 7f980f7fe640 1 --2- 172.21.15.77:0/3163173710 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7f980406dae0 0x7f980406ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:14:31.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.503+0000 7f980f7fe640 1 -- 172.21.15.77:0/3163173710 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f98100aeb50 con 0x7f98180fb3f0 2024-09-18T21:14:31.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.503+0000 7f98167fc640 1 --2- 172.21.15.77:0/3163173710 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7f980406dae0 0x7f980406ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:14:31.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.503+0000 7f98167fc640 1 --2- 172.21.15.77:0/3163173710 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7f980406dae0 0x7f980406ff90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f981810cdd0 tx=0x7f9800009040 comp rx=0 tx=0).ready entity=mgr.14690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:14:31.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.507+0000 7f980f7fe640 1 -- 172.21.15.77:0/3163173710 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f9810078560 con 0x7f98180fb3f0 2024-09-18T21:14:31.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.696+0000 7f981d780640 1 -- 172.21.15.77:0/3163173710 --> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9818103f60 con 0x7f980406dae0 2024-09-18T21:14:31.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.698+0000 7f980f7fe640 1 -- 172.21.15.77:0/3163173710 <== mgr.14690 v2:172.21.15.77:6800/3842438735 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f9818103f60 con 0x7f980406dae0 2024-09-18T21:14:31.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.700+0000 7f981d780640 1 -- 172.21.15.77:0/3163173710 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7f980406dae0 msgr2=0x7f980406ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:14:31.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.700+0000 7f981d780640 1 --2- 172.21.15.77:0/3163173710 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7f980406dae0 0x7f980406ff90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f981810cdd0 tx=0x7f9800009040 comp rx=0 tx=0).stop 2024-09-18T21:14:31.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.700+0000 7f981d780640 1 -- 172.21.15.77:0/3163173710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98180fb3f0 msgr2=0x7f981810d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:14:31.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.700+0000 7f981d780640 1 --2- 172.21.15.77:0/3163173710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98180fb3f0 0x7f981810d020 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9810004a30 tx=0x7f9810004d10 comp rx=0 tx=0).stop 2024-09-18T21:14:31.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.700+0000 7f981d780640 1 -- 172.21.15.77:0/3163173710 shutdown_connections 2024-09-18T21:14:31.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.700+0000 7f981d780640 1 --2- 172.21.15.77:0/3163173710 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7f980406dae0 0x7f980406ff90 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:31.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.700+0000 7f981d780640 1 --2- 172.21.15.77:0/3163173710 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98180fc6c0 0x7f981810d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:31.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.700+0000 7f981d780640 1 --2- 172.21.15.77:0/3163173710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98180fb3f0 0x7f981810d020 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:31.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.700+0000 7f981d780640 1 -- 172.21.15.77:0/3163173710 >> 172.21.15.77:0/3163173710 conn(0x7f98180f6b90 msgr2=0x7f9818065fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:14:31.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.700+0000 7f981d780640 1 -- 172.21.15.77:0/3163173710 shutdown_connections 2024-09-18T21:14:31.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.700+0000 7f981d780640 1 -- 172.21.15.77:0/3163173710 wait complete. 2024-09-18T21:14:31.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.780+0000 7f48ce56f640 1 -- 172.21.15.77:0/1369818304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48c80fc550 msgr2=0x7f48c80fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:14:31.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.780+0000 7f48ce56f640 1 --2- 172.21.15.77:0/1369818304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48c80fc550 0x7f48c80fc960 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f48b80048d0 tx=0x7f48b8009da0 comp rx=0 tx=0).stop 2024-09-18T21:14:31.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.781+0000 7f48ce56f640 1 -- 172.21.15.77:0/1369818304 shutdown_connections 2024-09-18T21:14:31.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.781+0000 7f48ce56f640 1 --2- 172.21.15.77:0/1369818304 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48c80fd820 0x7f48c80fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:31.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.781+0000 7f48ce56f640 1 --2- 172.21.15.77:0/1369818304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48c80fc550 0x7f48c80fc960 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:31.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.781+0000 7f48ce56f640 1 -- 172.21.15.77:0/1369818304 >> 172.21.15.77:0/1369818304 conn(0x7f48c80f7d30 msgr2=0x7f48c80fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:14:31.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.781+0000 7f48ce56f640 1 -- 172.21.15.77:0/1369818304 shutdown_connections 2024-09-18T21:14:31.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.781+0000 7f48ce56f640 1 -- 172.21.15.77:0/1369818304 wait complete. 2024-09-18T21:14:31.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.781+0000 7f48ce56f640 1 Processor -- start 2024-09-18T21:14:31.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.781+0000 7f48ce56f640 1 -- start start 2024-09-18T21:14:31.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.781+0000 7f48ce56f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48c80fc550 0x7f48c810d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:14:31.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.781+0000 7f48ce56f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48c80fd820 0x7f48c810d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:14:31.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.781+0000 7f48ce56f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c810dc10 con 0x7f48c80fc550 2024-09-18T21:14:31.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.781+0000 7f48ce56f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c810e430 con 0x7f48c80fd820 2024-09-18T21:14:31.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.782+0000 7f48c7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48c80fc550 0x7f48c810d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:14:31.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.782+0000 7f48c7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48c80fc550 0x7f48c810d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39166/0 (socket says 172.21.15.77:39166) 2024-09-18T21:14:31.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.782+0000 7f48c7fff640 1 -- 172.21.15.77:0/3073829346 learned_addr learned my addr 172.21.15.77:0/3073829346 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:14:31.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.782+0000 7f48c77fe640 1 --2- 172.21.15.77:0/3073829346 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48c80fd820 0x7f48c810d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:14:31.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.782+0000 7f48c7fff640 1 -- 172.21.15.77:0/3073829346 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48c80fd820 msgr2=0x7f48c810d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:14:31.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.782+0000 7f48c7fff640 1 --2- 172.21.15.77:0/3073829346 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48c80fd820 0x7f48c810d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:31.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.782+0000 7f48c7fff640 1 -- 172.21.15.77:0/3073829346 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b8005040 con 0x7f48c80fc550 2024-09-18T21:14:31.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.782+0000 7f48c7fff640 1 --2- 172.21.15.77:0/3073829346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48c80fc550 0x7f48c810d080 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f48b80043d0 tx=0x7f48b8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:14:31.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.782+0000 7f48c4ff9640 1 -- 172.21.15.77:0/3073829346 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48b8038070 con 0x7f48c80fc550 2024-09-18T21:14:31.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.782+0000 7f48c4ff9640 1 -- 172.21.15.77:0/3073829346 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f48b802ae90 con 0x7f48c80fc550 2024-09-18T21:14:31.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.782+0000 7f48ce56f640 1 -- 172.21.15.77:0/3073829346 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48c810e660 con 0x7f48c80fc550 2024-09-18T21:14:31.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.782+0000 7f48c4ff9640 1 -- 172.21.15.77:0/3073829346 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48b803e670 con 0x7f48c80fc550 2024-09-18T21:14:31.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.782+0000 7f48ce56f640 1 -- 172.21.15.77:0/3073829346 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48c810ec00 con 0x7f48c80fc550 2024-09-18T21:14:31.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.783+0000 7f48ce56f640 1 -- 172.21.15.77:0/3073829346 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48c80fb9b0 con 0x7f48c80fc550 2024-09-18T21:14:31.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.784+0000 7f48c4ff9640 1 -- 172.21.15.77:0/3073829346 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 30) v1 ==== 92027+0+0 (secure 0 0 0) 0x7f48b8030020 con 0x7f48c80fc550 2024-09-18T21:14:31.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.784+0000 7f48c4ff9640 1 --2- 172.21.15.77:0/3073829346 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7f48b406dae0 0x7f48b406ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:14:31.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.784+0000 7f48c77fe640 1 --2- 172.21.15.77:0/3073829346 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7f48b406dae0 0x7f48b406ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:14:31.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.784+0000 7f48c4ff9640 1 -- 172.21.15.77:0/3073829346 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f48b80ad5a0 con 0x7f48c80fc550 2024-09-18T21:14:31.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.785+0000 7f48c77fe640 1 --2- 172.21.15.77:0/3073829346 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7f48b406dae0 0x7f48b406ff90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f48b0007fd0 tx=0x7f48b0009e90 comp rx=0 tx=0).ready entity=mgr.14690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:14:31.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.789+0000 7f48c4ff9640 1 -- 172.21.15.77:0/3073829346 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f48b80770c0 con 0x7f48c80fc550 2024-09-18T21:14:31.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.966+0000 7f48ce56f640 1 -- 172.21.15.77:0/3073829346 --> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f48c810ef30 con 0x7f48b406dae0 2024-09-18T21:14:31.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.975+0000 7f48c4ff9640 1 -- 172.21.15.77:0/3073829346 <== mgr.14690 v2:172.21.15.77:6800/3842438735 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f48c810ef30 con 0x7f48b406dae0 2024-09-18T21:14:31.976 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T21:14:31.976 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager.smithi077 smithi077 *:9093,9094 running (73s) 2s ago 9m 16.6M - 0.25.0 c8568f914cd2 b201d325a55b 2024-09-18T21:14:31.977 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi077 smithi077 running (9m) 2s ago 9m 6899k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 0beb64a8c2ea 2024-09-18T21:14:31.977 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi103 smithi103 running (8m) 5s ago 8m 6891k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 04981ca7bf34 2024-09-18T21:14:31.977 INFO:teuthology.orchestra.run.smithi077.stdout:grafana.smithi077 smithi077 *:3000 running (68s) 2s ago 9m 80.1M - 9.4.7 954c08fa6188 d06ef3ab9e66 2024-09-18T21:14:31.977 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.cqfhlw smithi077 running (4m) 2s ago 4m 13.5M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 a7ec3b7701b6 2024-09-18T21:14:31.977 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.vruydi smithi077 running (4m) 2s ago 4m 175M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 affbba097d3b 2024-09-18T21:14:31.977 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi103.opftmf smithi103 running (4m) 5s ago 4m 15.6M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 111f884c5a34 2024-09-18T21:14:31.977 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi103.zhdmdg smithi103 running (4m) 5s ago 4m 15.0M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 50b77d0edda5 2024-09-18T21:14:31.977 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi077.utkpjg smithi077 *:8443,9283,8765 running (38s) 2s ago 10m 474M - 19.1.1-17-g06b1b1de f79f744f586d 99d4b0fd70f6 2024-09-18T21:14:31.977 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi103.zjztqc smithi103 *:8443,9283 running (2m) 5s ago 8m 108M - 19.1.1-17-g06b1b1de f79f744f586d 0fe6f5f18bf6 2024-09-18T21:14:31.977 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi077 smithi077 running (10m) 2s ago 10m 55.0M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bcbf289fe027 2024-09-18T21:14:31.977 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi103 smithi103 running (8m) 5s ago 8m 45.0M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 d6ae2062e5e3 2024-09-18T21:14:31.977 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi077 smithi077 *:9100 running (80s) 2s ago 9m 7914k - 1.5.0 0da6a335fe13 99144245c1af 2024-09-18T21:14:31.977 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi103 smithi103 *:9100 running (60s) 5s ago 8m 8715k - 1.5.0 0da6a335fe13 e5b51144d997 2024-09-18T21:14:31.977 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (7m) 2s ago 7m 221M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 2e3563c32cf5 2024-09-18T21:14:31.978 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi077 running (7m) 2s ago 7m 232M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 39c2ccbb7603 2024-09-18T21:14:31.978 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi077 running (6m) 2s ago 6m 197M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 2ff2728057e2 2024-09-18T21:14:31.978 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi103 running (6m) 5s ago 6m 275M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 0e72b1bbb8ce 2024-09-18T21:14:31.978 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi103 running (6m) 5s ago 6m 243M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 85f1ce1e8bee 2024-09-18T21:14:31.978 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi103 running (5m) 5s ago 5m 226M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 cf8964b3ac6d 2024-09-18T21:14:31.978 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus.smithi077 smithi077 *:9095 running (62s) 2s ago 8m 46.9M - 2.43.0 a07b618ecd1d 658d36d7bce2 2024-09-18T21:14:31.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.977+0000 7f48ce56f640 1 -- 172.21.15.77:0/3073829346 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7f48b406dae0 msgr2=0x7f48b406ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:14:31.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.977+0000 7f48ce56f640 1 --2- 172.21.15.77:0/3073829346 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7f48b406dae0 0x7f48b406ff90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f48b0007fd0 tx=0x7f48b0009e90 comp rx=0 tx=0).stop 2024-09-18T21:14:31.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.978+0000 7f48ce56f640 1 -- 172.21.15.77:0/3073829346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48c80fc550 msgr2=0x7f48c810d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:14:31.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.978+0000 7f48ce56f640 1 --2- 172.21.15.77:0/3073829346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48c80fc550 0x7f48c810d080 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f48b80043d0 tx=0x7f48b8009da0 comp rx=0 tx=0).stop 2024-09-18T21:14:31.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.978+0000 7f48ce56f640 1 -- 172.21.15.77:0/3073829346 shutdown_connections 2024-09-18T21:14:31.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.978+0000 7f48ce56f640 1 --2- 172.21.15.77:0/3073829346 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7f48b406dae0 0x7f48b406ff90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:31.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.978+0000 7f48ce56f640 1 --2- 172.21.15.77:0/3073829346 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48c80fd820 0x7f48c810d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:31.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.978+0000 7f48ce56f640 1 --2- 172.21.15.77:0/3073829346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48c80fc550 0x7f48c810d080 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:31.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.978+0000 7f48ce56f640 1 -- 172.21.15.77:0/3073829346 >> 172.21.15.77:0/3073829346 conn(0x7f48c80f7d30 msgr2=0x7f48c80f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:14:31.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.978+0000 7f48ce56f640 1 -- 172.21.15.77:0/3073829346 shutdown_connections 2024-09-18T21:14:31.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:31.978+0000 7f48ce56f640 1 -- 172.21.15.77:0/3073829346 wait complete. 2024-09-18T21:14:32.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.058+0000 7f2be01e8640 1 -- 172.21.15.77:0/4027377778 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bd80fc700 msgr2=0x7f2bd80fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:14:32.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.058+0000 7f2be01e8640 1 --2- 172.21.15.77:0/4027377778 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bd80fc700 0x7f2bd80fcb70 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2bc80048d0 tx=0x7f2bc8009da0 comp rx=0 tx=0).stop 2024-09-18T21:14:32.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.058+0000 7f2be01e8640 1 -- 172.21.15.77:0/4027377778 shutdown_connections 2024-09-18T21:14:32.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.058+0000 7f2be01e8640 1 --2- 172.21.15.77:0/4027377778 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bd80fc700 0x7f2bd80fcb70 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:32.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.058+0000 7f2be01e8640 1 --2- 172.21.15.77:0/4027377778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2bd80fb430 0x7f2bd80fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:32.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.058+0000 7f2be01e8640 1 -- 172.21.15.77:0/4027377778 >> 172.21.15.77:0/4027377778 conn(0x7f2bd80f6c10 msgr2=0x7f2bd80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:14:32.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.058+0000 7f2be01e8640 1 -- 172.21.15.77:0/4027377778 shutdown_connections 2024-09-18T21:14:32.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.058+0000 7f2be01e8640 1 -- 172.21.15.77:0/4027377778 wait complete. 2024-09-18T21:14:32.062 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.059+0000 7f2be01e8640 1 Processor -- start 2024-09-18T21:14:32.062 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.059+0000 7f2be01e8640 1 -- start start 2024-09-18T21:14:32.062 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.059+0000 7f2be01e8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bd80fb430 0x7f2bd810fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:14:32.062 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.059+0000 7f2be01e8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2bd80fc700 0x7f2bd81122d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:14:32.062 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.059+0000 7f2be01e8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd8065c60 con 0x7f2bd80fb430 2024-09-18T21:14:32.062 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.059+0000 7f2be01e8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd8065dd0 con 0x7f2bd80fc700 2024-09-18T21:14:32.062 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.059+0000 7f2bddf84640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bd80fb430 0x7f2bd810fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:14:32.062 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.059+0000 7f2bddf84640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bd80fb430 0x7f2bd810fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39190/0 (socket says 172.21.15.77:39190) 2024-09-18T21:14:32.062 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.059+0000 7f2bddf84640 1 -- 172.21.15.77:0/2748759818 learned_addr learned my addr 172.21.15.77:0/2748759818 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:14:32.062 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.059+0000 7f2bdd783640 1 --2- 172.21.15.77:0/2748759818 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2bd80fc700 0x7f2bd81122d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:14:32.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.060+0000 7f2bddf84640 1 -- 172.21.15.77:0/2748759818 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2bd80fc700 msgr2=0x7f2bd81122d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:14:32.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.060+0000 7f2bddf84640 1 --2- 172.21.15.77:0/2748759818 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2bd80fc700 0x7f2bd81122d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:32.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.060+0000 7f2bddf84640 1 -- 172.21.15.77:0/2748759818 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc8005040 con 0x7f2bd80fb430 2024-09-18T21:14:32.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.060+0000 7f2bddf84640 1 --2- 172.21.15.77:0/2748759818 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bd80fb430 0x7f2bd810fd80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2bd400c830 tx=0x7f2bd4004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:14:32.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.060+0000 7f2bce7fc640 1 -- 172.21.15.77:0/2748759818 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2bd400a7d0 con 0x7f2bd80fb430 2024-09-18T21:14:32.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.060+0000 7f2bce7fc640 1 -- 172.21.15.77:0/2748759818 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2bd400add0 con 0x7f2bd80fb430 2024-09-18T21:14:32.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.060+0000 7f2be01e8640 1 -- 172.21.15.77:0/2748759818 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bd8112870 con 0x7f2bd80fb430 2024-09-18T21:14:32.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.060+0000 7f2bce7fc640 1 -- 172.21.15.77:0/2748759818 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2bd40113a0 con 0x7f2bd80fb430 2024-09-18T21:14:32.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.060+0000 7f2be01e8640 1 -- 172.21.15.77:0/2748759818 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bd8112de0 con 0x7f2bd80fb430 2024-09-18T21:14:32.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.061+0000 7f2be01e8640 1 -- 172.21.15.77:0/2748759818 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bd80fa890 con 0x7f2bd80fb430 2024-09-18T21:14:32.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.062+0000 7f2bce7fc640 1 -- 172.21.15.77:0/2748759818 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 30) v1 ==== 92027+0+0 (secure 0 0 0) 0x7f2bd4012400 con 0x7f2bd80fb430 2024-09-18T21:14:32.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.062+0000 7f2bce7fc640 1 --2- 172.21.15.77:0/2748759818 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7f2bc406dae0 0x7f2bc406ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:14:32.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.063+0000 7f2bce7fc640 1 -- 172.21.15.77:0/2748759818 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f2bd408de10 con 0x7f2bd80fb430 2024-09-18T21:14:32.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.063+0000 7f2bdd783640 1 --2- 172.21.15.77:0/2748759818 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7f2bc406dae0 0x7f2bc406ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:14:32.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.063+0000 7f2bdd783640 1 --2- 172.21.15.77:0/2748759818 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7f2bc406dae0 0x7f2bc406ff90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8000c00 tx=0x7f2bc8035040 comp rx=0 tx=0).ready entity=mgr.14690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:14:32.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.066+0000 7f2bce7fc640 1 -- 172.21.15.77:0/2748759818 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f2bd4057b10 con 0x7f2bd80fb430 2024-09-18T21:14:32.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.306+0000 7f2be01e8640 1 -- 172.21.15.77:0/2748759818 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2bd8113100 con 0x7f2bd80fb430 2024-09-18T21:14:32.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.307+0000 7f2bce7fc640 1 -- 172.21.15.77:0/2748759818 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+745 (secure 0 0 0) 0x7f2bd405b1d0 con 0x7f2bd80fb430 2024-09-18T21:14:32.308 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-18T21:14:32.308 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": { 2024-09-18T21:14:32.308 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 2 2024-09-18T21:14:32.308 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:14:32.308 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": { 2024-09-18T21:14:32.308 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 2 2024-09-18T21:14:32.308 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:14:32.308 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": { 2024-09-18T21:14:32.308 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 6 2024-09-18T21:14:32.308 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:14:32.309 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-09-18T21:14:32.309 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4 2024-09-18T21:14:32.309 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:14:32.309 INFO:teuthology.orchestra.run.smithi077.stdout: "overall": { 2024-09-18T21:14:32.309 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 12, 2024-09-18T21:14:32.309 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 2 2024-09-18T21:14:32.309 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-18T21:14:32.309 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-18T21:14:32.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.309+0000 7f2be01e8640 1 -- 172.21.15.77:0/2748759818 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7f2bc406dae0 msgr2=0x7f2bc406ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:14:32.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.309+0000 7f2be01e8640 1 --2- 172.21.15.77:0/2748759818 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7f2bc406dae0 0x7f2bc406ff90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8000c00 tx=0x7f2bc8035040 comp rx=0 tx=0).stop 2024-09-18T21:14:32.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.309+0000 7f2be01e8640 1 -- 172.21.15.77:0/2748759818 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bd80fb430 msgr2=0x7f2bd810fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:14:32.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.309+0000 7f2be01e8640 1 --2- 172.21.15.77:0/2748759818 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bd80fb430 0x7f2bd810fd80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2bd400c830 tx=0x7f2bd4004430 comp rx=0 tx=0).stop 2024-09-18T21:14:32.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.310+0000 7f2be01e8640 1 -- 172.21.15.77:0/2748759818 shutdown_connections 2024-09-18T21:14:32.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.310+0000 7f2be01e8640 1 --2- 172.21.15.77:0/2748759818 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7f2bc406dae0 0x7f2bc406ff90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:32.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.310+0000 7f2be01e8640 1 --2- 172.21.15.77:0/2748759818 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2bd80fc700 0x7f2bd81122d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:32.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.310+0000 7f2be01e8640 1 --2- 172.21.15.77:0/2748759818 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bd80fb430 0x7f2bd810fd80 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:32.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.310+0000 7f2be01e8640 1 -- 172.21.15.77:0/2748759818 >> 172.21.15.77:0/2748759818 conn(0x7f2bd80f6c10 msgr2=0x7f2bd80f83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:14:32.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.310+0000 7f2be01e8640 1 -- 172.21.15.77:0/2748759818 shutdown_connections 2024-09-18T21:14:32.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.310+0000 7f2be01e8640 1 -- 172.21.15.77:0/2748759818 wait complete. 2024-09-18T21:14:32.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.392+0000 7ff96f3a0640 1 -- 172.21.15.77:0/2232052660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9680fdb70 msgr2=0x7ff9680fdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:14:32.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.392+0000 7ff96f3a0640 1 --2- 172.21.15.77:0/2232052660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9680fdb70 0x7ff9680fdf80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff9640048d0 tx=0x7ff964009da0 comp rx=0 tx=0).stop 2024-09-18T21:14:32.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.392+0000 7ff96f3a0640 1 -- 172.21.15.77:0/2232052660 shutdown_connections 2024-09-18T21:14:32.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.392+0000 7ff96f3a0640 1 --2- 172.21.15.77:0/2232052660 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9680fe4c0 0x7ff9680fa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:32.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.392+0000 7ff96f3a0640 1 --2- 172.21.15.77:0/2232052660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9680fdb70 0x7ff9680fdf80 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:32.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.392+0000 7ff96f3a0640 1 -- 172.21.15.77:0/2232052660 >> 172.21.15.77:0/2232052660 conn(0x7ff9680f6390 msgr2=0x7ff9680f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:14:32.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.392+0000 7ff96f3a0640 1 -- 172.21.15.77:0/2232052660 shutdown_connections 2024-09-18T21:14:32.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.392+0000 7ff96f3a0640 1 -- 172.21.15.77:0/2232052660 wait complete. 2024-09-18T21:14:32.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.392+0000 7ff96f3a0640 1 Processor -- start 2024-09-18T21:14:32.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.392+0000 7ff96f3a0640 1 -- start start 2024-09-18T21:14:32.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.393+0000 7ff96f3a0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9680fdb70 0x7ff96810d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:14:32.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.393+0000 7ff96f3a0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9680fe4c0 0x7ff96810d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:14:32.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.393+0000 7ff96f3a0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96810dc00 con 0x7ff9680fdb70 2024-09-18T21:14:32.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.393+0000 7ff96f3a0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96810e420 con 0x7ff9680fe4c0 2024-09-18T21:14:32.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.393+0000 7ff96d13c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9680fdb70 0x7ff96810d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:14:32.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.393+0000 7ff96d13c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9680fdb70 0x7ff96810d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39214/0 (socket says 172.21.15.77:39214) 2024-09-18T21:14:32.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.393+0000 7ff96d13c640 1 -- 172.21.15.77:0/2204056310 learned_addr learned my addr 172.21.15.77:0/2204056310 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:14:32.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.393+0000 7ff96c93b640 1 --2- 172.21.15.77:0/2204056310 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9680fe4c0 0x7ff96810d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:14:32.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.393+0000 7ff96d13c640 1 -- 172.21.15.77:0/2204056310 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9680fe4c0 msgr2=0x7ff96810d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:14:32.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.393+0000 7ff96d13c640 1 --2- 172.21.15.77:0/2204056310 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9680fe4c0 0x7ff96810d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:32.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.393+0000 7ff96d13c640 1 -- 172.21.15.77:0/2204056310 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff964005040 con 0x7ff9680fdb70 2024-09-18T21:14:32.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.393+0000 7ff96d13c640 1 --2- 172.21.15.77:0/2204056310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9680fdb70 0x7ff96810d070 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff9640043d0 tx=0x7ff964009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:14:32.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.394+0000 7ff95dffb640 1 -- 172.21.15.77:0/2204056310 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff964038070 con 0x7ff9680fdb70 2024-09-18T21:14:32.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.394+0000 7ff96f3a0640 1 -- 172.21.15.77:0/2204056310 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff96810e650 con 0x7ff9680fdb70 2024-09-18T21:14:32.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.394+0000 7ff95dffb640 1 -- 172.21.15.77:0/2204056310 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff96402ae90 con 0x7ff9680fdb70 2024-09-18T21:14:32.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.394+0000 7ff95dffb640 1 -- 172.21.15.77:0/2204056310 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff96403e670 con 0x7ff9680fdb70 2024-09-18T21:14:32.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.394+0000 7ff96f3a0640 1 -- 172.21.15.77:0/2204056310 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff96810ebf0 con 0x7ff9680fdb70 2024-09-18T21:14:32.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.395+0000 7ff96f3a0640 1 -- 172.21.15.77:0/2204056310 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9680fa010 con 0x7ff9680fdb70 2024-09-18T21:14:32.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.396+0000 7ff95dffb640 1 -- 172.21.15.77:0/2204056310 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 30) v1 ==== 92027+0+0 (secure 0 0 0) 0x7ff964030020 con 0x7ff9680fdb70 2024-09-18T21:14:32.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.396+0000 7ff95dffb640 1 --2- 172.21.15.77:0/2204056310 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7ff95406dae0 0x7ff95406ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:14:32.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.396+0000 7ff95dffb640 1 -- 172.21.15.77:0/2204056310 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5980+0+0 (secure 0 0 0) 0x7ff9640ad4f0 con 0x7ff9680fdb70 2024-09-18T21:14:32.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.397+0000 7ff96c93b640 1 --2- 172.21.15.77:0/2204056310 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7ff95406dae0 0x7ff95406ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:14:32.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.397+0000 7ff96c93b640 1 --2- 172.21.15.77:0/2204056310 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7ff95406dae0 0x7ff95406ff90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff96810ce20 tx=0x7ff95800b040 comp rx=0 tx=0).ready entity=mgr.14690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:14:32.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.401+0000 7ff95dffb640 1 -- 172.21.15.77:0/2204056310 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7ff9640770c0 con 0x7ff9680fdb70 2024-09-18T21:14:32.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.654+0000 7ff96f3a0640 1 -- 172.21.15.77:0/2204056310 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff968104f60 con 0x7ff9680fdb70 2024-09-18T21:14:32.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.654+0000 7ff95dffb640 1 -- 172.21.15.77:0/2204056310 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1807 (secure 0 0 0) 0x7ff96407a780 con 0x7ff9680fdb70 2024-09-18T21:14:32.656 INFO:teuthology.orchestra.run.smithi077.stdout:e13 2024-09-18T21:14:32.656 INFO:teuthology.orchestra.run.smithi077.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T21:14:32.656 INFO:teuthology.orchestra.run.smithi077.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T21:14:32.656 INFO:teuthology.orchestra.run.smithi077.stdout:legacy client fscid: 1 2024-09-18T21:14:32.656 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:14:32.656 INFO:teuthology.orchestra.run.smithi077.stdout:Filesystem 'cephfs' (1) 2024-09-18T21:14:32.656 INFO:teuthology.orchestra.run.smithi077.stdout:fs_name cephfs 2024-09-18T21:14:32.656 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 13 2024-09-18T21:14:32.656 INFO:teuthology.orchestra.run.smithi077.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T21:14:32.656 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-09-18T21:10:17.230179+0000 2024-09-18T21:14:32.656 INFO:teuthology.orchestra.run.smithi077.stdout:modified 2024-09-18T21:10:33.373241+0000 2024-09-18T21:14:32.656 INFO:teuthology.orchestra.run.smithi077.stdout:tableserver 0 2024-09-18T21:14:32.657 INFO:teuthology.orchestra.run.smithi077.stdout:root 0 2024-09-18T21:14:32.657 INFO:teuthology.orchestra.run.smithi077.stdout:session_timeout 60 2024-09-18T21:14:32.657 INFO:teuthology.orchestra.run.smithi077.stdout:session_autoclose 300 2024-09-18T21:14:32.657 INFO:teuthology.orchestra.run.smithi077.stdout:max_file_size 1099511627776 2024-09-18T21:14:32.657 INFO:teuthology.orchestra.run.smithi077.stdout:required_client_features {} 2024-09-18T21:14:32.657 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure 0 2024-09-18T21:14:32.657 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure_osd_epoch 0 2024-09-18T21:14:32.657 INFO:teuthology.orchestra.run.smithi077.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T21:14:32.657 INFO:teuthology.orchestra.run.smithi077.stdout:max_mds 1 2024-09-18T21:14:32.657 INFO:teuthology.orchestra.run.smithi077.stdout:in 0 2024-09-18T21:14:32.657 INFO:teuthology.orchestra.run.smithi077.stdout:up {0=14446} 2024-09-18T21:14:32.657 INFO:teuthology.orchestra.run.smithi077.stdout:failed 2024-09-18T21:14:32.657 INFO:teuthology.orchestra.run.smithi077.stdout:damaged 2024-09-18T21:14:32.658 INFO:teuthology.orchestra.run.smithi077.stdout:stopped 2024-09-18T21:14:32.658 INFO:teuthology.orchestra.run.smithi077.stdout:data_pools [3] 2024-09-18T21:14:32.658 INFO:teuthology.orchestra.run.smithi077.stdout:metadata_pool 2 2024-09-18T21:14:32.658 INFO:teuthology.orchestra.run.smithi077.stdout:inline_data disabled 2024-09-18T21:14:32.658 INFO:teuthology.orchestra.run.smithi077.stdout:balancer 2024-09-18T21:14:32.658 INFO:teuthology.orchestra.run.smithi077.stdout:standby_count_wanted 1 2024-09-18T21:14:32.658 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.vruydi{0:14446} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.77:6826/334039954,v1:172.21.15.77:6827/334039954] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:14:32.658 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:14:32.658 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:14:32.658 INFO:teuthology.orchestra.run.smithi077.stdout:Standby daemons: 2024-09-18T21:14:32.658 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:14:32.658 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.cqfhlw{-1:14458} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.77:6828/862540650,v1:172.21.15.77:6829/862540650] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:14:32.658 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi103.zhdmdg{-1:24255} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.103:6824/2170237078,v1:172.21.15.103:6825/2170237078] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:14:32.658 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi103.opftmf{-1:24267} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.103:6826/4241818403,v1:172.21.15.103:6827/4241818403] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:14:32.659 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 13 2024-09-18T21:14:32.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.657+0000 7ff96f3a0640 1 -- 172.21.15.77:0/2204056310 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7ff95406dae0 msgr2=0x7ff95406ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:14:32.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.657+0000 7ff96f3a0640 1 --2- 172.21.15.77:0/2204056310 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7ff95406dae0 0x7ff95406ff90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff96810ce20 tx=0x7ff95800b040 comp rx=0 tx=0).stop 2024-09-18T21:14:32.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.657+0000 7ff96f3a0640 1 -- 172.21.15.77:0/2204056310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9680fdb70 msgr2=0x7ff96810d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:14:32.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.657+0000 7ff96f3a0640 1 --2- 172.21.15.77:0/2204056310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9680fdb70 0x7ff96810d070 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff9640043d0 tx=0x7ff964009da0 comp rx=0 tx=0).stop 2024-09-18T21:14:32.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.657+0000 7ff96f3a0640 1 -- 172.21.15.77:0/2204056310 shutdown_connections 2024-09-18T21:14:32.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.657+0000 7ff96f3a0640 1 --2- 172.21.15.77:0/2204056310 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7ff95406dae0 0x7ff95406ff90 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:32.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.657+0000 7ff96f3a0640 1 --2- 172.21.15.77:0/2204056310 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9680fe4c0 0x7ff96810d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:32.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.657+0000 7ff96f3a0640 1 --2- 172.21.15.77:0/2204056310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9680fdb70 0x7ff96810d070 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:32.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.657+0000 7ff96f3a0640 1 -- 172.21.15.77:0/2204056310 >> 172.21.15.77:0/2204056310 conn(0x7ff9680f6390 msgr2=0x7ff9680f7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:14:32.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.657+0000 7ff96f3a0640 1 -- 172.21.15.77:0/2204056310 shutdown_connections 2024-09-18T21:14:32.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.657+0000 7ff96f3a0640 1 -- 172.21.15.77:0/2204056310 wait complete. 2024-09-18T21:14:32.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.760+0000 7fce462fa640 1 -- 172.21.15.77:0/855484382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce400fb430 msgr2=0x7fce400fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:14:32.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.760+0000 7fce462fa640 1 --2- 172.21.15.77:0/855484382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce400fb430 0x7fce400fb840 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fce300048d0 tx=0x7fce30009da0 comp rx=0 tx=0).stop 2024-09-18T21:14:32.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.760+0000 7fce462fa640 1 -- 172.21.15.77:0/855484382 shutdown_connections 2024-09-18T21:14:32.765 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.760+0000 7fce462fa640 1 --2- 172.21.15.77:0/855484382 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce400fc700 0x7fce400fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:32.765 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.760+0000 7fce462fa640 1 --2- 172.21.15.77:0/855484382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce400fb430 0x7fce400fb840 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:32.765 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.760+0000 7fce462fa640 1 -- 172.21.15.77:0/855484382 >> 172.21.15.77:0/855484382 conn(0x7fce400f6c10 msgr2=0x7fce400f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:14:32.765 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.760+0000 7fce462fa640 1 -- 172.21.15.77:0/855484382 shutdown_connections 2024-09-18T21:14:32.765 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.760+0000 7fce462fa640 1 -- 172.21.15.77:0/855484382 wait complete. 2024-09-18T21:14:32.765 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.761+0000 7fce462fa640 1 Processor -- start 2024-09-18T21:14:32.765 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.761+0000 7fce462fa640 1 -- start start 2024-09-18T21:14:32.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.761+0000 7fce462fa640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce400fb430 0x7fce4010bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:14:32.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.761+0000 7fce462fa640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce400fc700 0x7fce4010c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:14:32.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.761+0000 7fce462fa640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4010cb10 con 0x7fce400fb430 2024-09-18T21:14:32.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.761+0000 7fce462fa640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4010d330 con 0x7fce400fc700 2024-09-18T21:14:32.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.761+0000 7fce3ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce400fb430 0x7fce4010bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:14:32.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.761+0000 7fce3ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce400fb430 0x7fce4010bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39242/0 (socket says 172.21.15.77:39242) 2024-09-18T21:14:32.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.761+0000 7fce3ffff640 1 -- 172.21.15.77:0/2400942991 learned_addr learned my addr 172.21.15.77:0/2400942991 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:14:32.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.761+0000 7fce3f7fe640 1 --2- 172.21.15.77:0/2400942991 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce400fc700 0x7fce4010c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:14:32.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.762+0000 7fce3ffff640 1 -- 172.21.15.77:0/2400942991 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce400fc700 msgr2=0x7fce4010c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:14:32.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.762+0000 7fce3ffff640 1 --2- 172.21.15.77:0/2400942991 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce400fc700 0x7fce4010c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:32.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.762+0000 7fce3ffff640 1 -- 172.21.15.77:0/2400942991 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce30005040 con 0x7fce400fb430 2024-09-18T21:14:32.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.762+0000 7fce3f7fe640 1 --2- 172.21.15.77:0/2400942991 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce400fc700 0x7fce4010c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T21:14:32.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.762+0000 7fce3ffff640 1 --2- 172.21.15.77:0/2400942991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce400fb430 0x7fce4010bf80 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fce300048a0 tx=0x7fce30009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:14:32.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.762+0000 7fce3cff9640 1 -- 172.21.15.77:0/2400942991 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce3003a070 con 0x7fce400fb430 2024-09-18T21:14:32.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.762+0000 7fce3cff9640 1 -- 172.21.15.77:0/2400942991 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fce300338c0 con 0x7fce400fb430 2024-09-18T21:14:32.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.762+0000 7fce3cff9640 1 -- 172.21.15.77:0/2400942991 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce3003e930 con 0x7fce400fb430 2024-09-18T21:14:32.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.762+0000 7fce462fa640 1 -- 172.21.15.77:0/2400942991 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce4010d560 con 0x7fce400fb430 2024-09-18T21:14:32.769 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.762+0000 7fce462fa640 1 -- 172.21.15.77:0/2400942991 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce4010daa0 con 0x7fce400fb430 2024-09-18T21:14:32.769 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.763+0000 7fce462fa640 1 -- 172.21.15.77:0/2400942991 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce400fa890 con 0x7fce400fb430 2024-09-18T21:14:32.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.764+0000 7fce3cff9640 1 -- 172.21.15.77:0/2400942991 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 30) v1 ==== 92027+0+0 (secure 0 0 0) 0x7fce30030020 con 0x7fce400fb430 2024-09-18T21:14:32.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.764+0000 7fce3cff9640 1 --2- 172.21.15.77:0/2400942991 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7fce2806dae0 0x7fce2806ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:14:32.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.764+0000 7fce3cff9640 1 -- 172.21.15.77:0/2400942991 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fce300af420 con 0x7fce400fb430 2024-09-18T21:14:32.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.764+0000 7fce3f7fe640 1 --2- 172.21.15.77:0/2400942991 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7fce2806dae0 0x7fce2806ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:14:32.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.765+0000 7fce3f7fe640 1 --2- 172.21.15.77:0/2400942991 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7fce2806dae0 0x7fce2806ff90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fce4010bd30 tx=0x7fce3400b040 comp rx=0 tx=0).ready entity=mgr.14690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:14:32.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.769+0000 7fce3cff9640 1 -- 172.21.15.77:0/2400942991 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fce30079000 con 0x7fce400fb430 2024-09-18T21:14:32.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.954+0000 7fce462fa640 1 -- 172.21.15.77:0/2400942991 --> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fce4010def0 con 0x7fce2806dae0 2024-09-18T21:14:32.956 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:32 smithi077 ceph-mon[27689]: pgmap v7: 65 pgs: 65 active+clean; 211 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 55 KiB/s rd, 604 KiB/s wr, 272 op/s 2024-09-18T21:14:32.956 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:32 smithi077 ceph-mon[27689]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:14:32.956 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:32 smithi077 ceph-mon[27689]: from='client.14752 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:14:32.956 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:32 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/2748759818' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:14:32.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.956+0000 7fce3cff9640 1 -- 172.21.15.77:0/2400942991 <== mgr.14690 v2:172.21.15.77:6800/3842438735 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fce4010def0 con 0x7fce2806dae0 2024-09-18T21:14:32.957 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-18T21:14:32.957 INFO:teuthology.orchestra.run.smithi077.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a", 2024-09-18T21:14:32.957 INFO:teuthology.orchestra.run.smithi077.stdout: "in_progress": true, 2024-09-18T21:14:32.957 INFO:teuthology.orchestra.run.smithi077.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T21:14:32.957 INFO:teuthology.orchestra.run.smithi077.stdout: "services_complete": [ 2024-09-18T21:14:32.957 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr" 2024-09-18T21:14:32.958 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-18T21:14:32.958 INFO:teuthology.orchestra.run.smithi077.stdout: "progress": "2/21 daemons upgraded", 2024-09-18T21:14:32.958 INFO:teuthology.orchestra.run.smithi077.stdout: "message": "", 2024-09-18T21:14:32.958 INFO:teuthology.orchestra.run.smithi077.stdout: "is_paused": false 2024-09-18T21:14:32.958 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-18T21:14:32.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.958+0000 7fce462fa640 1 -- 172.21.15.77:0/2400942991 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7fce2806dae0 msgr2=0x7fce2806ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:14:32.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.958+0000 7fce462fa640 1 --2- 172.21.15.77:0/2400942991 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7fce2806dae0 0x7fce2806ff90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fce4010bd30 tx=0x7fce3400b040 comp rx=0 tx=0).stop 2024-09-18T21:14:32.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.958+0000 7fce462fa640 1 -- 172.21.15.77:0/2400942991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce400fb430 msgr2=0x7fce4010bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:14:32.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.958+0000 7fce462fa640 1 --2- 172.21.15.77:0/2400942991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce400fb430 0x7fce4010bf80 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fce300048a0 tx=0x7fce30009da0 comp rx=0 tx=0).stop 2024-09-18T21:14:32.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.958+0000 7fce462fa640 1 -- 172.21.15.77:0/2400942991 shutdown_connections 2024-09-18T21:14:32.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.958+0000 7fce462fa640 1 --2- 172.21.15.77:0/2400942991 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7fce2806dae0 0x7fce2806ff90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:32.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.958+0000 7fce462fa640 1 --2- 172.21.15.77:0/2400942991 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce400fc700 0x7fce4010c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:32.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.958+0000 7fce462fa640 1 --2- 172.21.15.77:0/2400942991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce400fb430 0x7fce4010bf80 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:32.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.958+0000 7fce462fa640 1 -- 172.21.15.77:0/2400942991 >> 172.21.15.77:0/2400942991 conn(0x7fce400f6c10 msgr2=0x7fce400f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:14:32.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.959+0000 7fce462fa640 1 -- 172.21.15.77:0/2400942991 shutdown_connections 2024-09-18T21:14:32.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:32.959+0000 7fce462fa640 1 -- 172.21.15.77:0/2400942991 wait complete. 2024-09-18T21:14:33.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:32 smithi103 ceph-mon[34827]: pgmap v7: 65 pgs: 65 active+clean; 211 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 55 KiB/s rd, 604 KiB/s wr, 272 op/s 2024-09-18T21:14:33.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:32 smithi103 ceph-mon[34827]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:14:33.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:32 smithi103 ceph-mon[34827]: from='client.14752 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:14:33.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:32 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/2748759818' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:14:33.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:33.043+0000 7f819739e640 1 -- 172.21.15.77:0/1595301245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81900fc520 msgr2=0x7f81900fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:14:33.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:33.043+0000 7f819739e640 1 --2- 172.21.15.77:0/1595301245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81900fc520 0x7f81900fc930 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f81880048d0 tx=0x7f8188009da0 comp rx=0 tx=0).stop 2024-09-18T21:14:33.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:33.043+0000 7f819739e640 1 -- 172.21.15.77:0/1595301245 shutdown_connections 2024-09-18T21:14:33.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:33.043+0000 7f819739e640 1 --2- 172.21.15.77:0/1595301245 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81900fd7f0 0x7f81900fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:33.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:33.043+0000 7f819739e640 1 --2- 172.21.15.77:0/1595301245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81900fc520 0x7f81900fc930 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:33.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:33.043+0000 7f819739e640 1 -- 172.21.15.77:0/1595301245 >> 172.21.15.77:0/1595301245 conn(0x7f81900f7ce0 msgr2=0x7f81900fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:14:33.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:33.043+0000 7f819739e640 1 -- 172.21.15.77:0/1595301245 shutdown_connections 2024-09-18T21:14:33.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:33.043+0000 7f819739e640 1 -- 172.21.15.77:0/1595301245 wait complete. 2024-09-18T21:14:33.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:33.043+0000 7f819739e640 1 Processor -- start 2024-09-18T21:14:33.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:33.043+0000 7f819739e640 1 -- start start 2024-09-18T21:14:33.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:33.044+0000 7f819739e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81900fc520 0x7f819010d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:14:33.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:33.044+0000 7f819739e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81900fd7f0 0x7f819010d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:14:33.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:33.044+0000 7f819739e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819010dc10 con 0x7f81900fc520 2024-09-18T21:14:33.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:33.044+0000 7f819739e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819010e430 con 0x7f81900fd7f0 2024-09-18T21:14:33.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:33.044+0000 7f819513a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81900fc520 0x7f819010d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:14:33.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:33.044+0000 7f819513a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81900fc520 0x7f819010d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39272/0 (socket says 172.21.15.77:39272) 2024-09-18T21:14:33.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:33.044+0000 7f819513a640 1 -- 172.21.15.77:0/1535777222 learned_addr learned my addr 172.21.15.77:0/1535777222 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:14:33.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:33.044+0000 7f8194939640 1 --2- 172.21.15.77:0/1535777222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81900fd7f0 0x7f819010d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:14:33.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:33.044+0000 7f819513a640 1 -- 172.21.15.77:0/1535777222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81900fd7f0 msgr2=0x7f819010d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:14:33.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:33.044+0000 7f819513a640 1 --2- 172.21.15.77:0/1535777222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81900fd7f0 0x7f819010d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:33.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:33.044+0000 7f819513a640 1 -- 172.21.15.77:0/1535777222 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8188005040 con 0x7f81900fc520 2024-09-18T21:14:33.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:33.044+0000 7f819513a640 1 --2- 172.21.15.77:0/1535777222 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81900fc520 0x7f819010d080 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8188003080 tx=0x7f8188009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:14:33.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:33.044+0000 7f818dffb640 1 -- 172.21.15.77:0/1535777222 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8188038070 con 0x7f81900fc520 2024-09-18T21:14:33.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:33.044+0000 7f818dffb640 1 -- 172.21.15.77:0/1535777222 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f818802abd0 con 0x7f81900fc520 2024-09-18T21:14:33.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:33.044+0000 7f819739e640 1 -- 172.21.15.77:0/1535777222 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f819010e660 con 0x7f81900fc520 2024-09-18T21:14:33.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:33.044+0000 7f818dffb640 1 -- 172.21.15.77:0/1535777222 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f818803e670 con 0x7f81900fc520 2024-09-18T21:14:33.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:33.045+0000 7f819739e640 1 -- 172.21.15.77:0/1535777222 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f819010ec00 con 0x7f81900fc520 2024-09-18T21:14:33.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:33.046+0000 7f819739e640 1 -- 172.21.15.77:0/1535777222 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81900fb980 con 0x7f81900fc520 2024-09-18T21:14:33.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:33.046+0000 7f818dffb640 1 -- 172.21.15.77:0/1535777222 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 30) v1 ==== 92027+0+0 (secure 0 0 0) 0x7f8188030020 con 0x7f81900fc520 2024-09-18T21:14:33.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:33.047+0000 7f818dffb640 1 --2- 172.21.15.77:0/1535777222 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7f817806dae0 0x7f817806ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:14:33.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:33.047+0000 7f818dffb640 1 -- 172.21.15.77:0/1535777222 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f81880ad680 con 0x7f81900fc520 2024-09-18T21:14:33.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:33.047+0000 7f8194939640 1 --2- 172.21.15.77:0/1535777222 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7f817806dae0 0x7f817806ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:14:33.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:33.047+0000 7f8194939640 1 --2- 172.21.15.77:0/1535777222 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7f817806dae0 0x7f817806ff90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f819010ce30 tx=0x7f8184009040 comp rx=0 tx=0).ready entity=mgr.14690 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:14:33.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:33.051+0000 7f818dffb640 1 -- 172.21.15.77:0/1535777222 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f8188077250 con 0x7f81900fc520 2024-09-18T21:14:33.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:33.293+0000 7f819739e640 1 -- 172.21.15.77:0/1535777222 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f8190104f20 con 0x7f81900fc520 2024-09-18T21:14:33.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:33.293+0000 7f818dffb640 1 -- 172.21.15.77:0/1535777222 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f818807a910 con 0x7f81900fc520 2024-09-18T21:14:33.295 INFO:teuthology.orchestra.run.smithi077.stdout:HEALTH_OK 2024-09-18T21:14:33.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:33.295+0000 7f819739e640 1 -- 172.21.15.77:0/1535777222 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7f817806dae0 msgr2=0x7f817806ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:14:33.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:33.295+0000 7f819739e640 1 --2- 172.21.15.77:0/1535777222 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7f817806dae0 0x7f817806ff90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f819010ce30 tx=0x7f8184009040 comp rx=0 tx=0).stop 2024-09-18T21:14:33.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:33.295+0000 7f819739e640 1 -- 172.21.15.77:0/1535777222 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81900fc520 msgr2=0x7f819010d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:14:33.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:33.295+0000 7f819739e640 1 --2- 172.21.15.77:0/1535777222 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81900fc520 0x7f819010d080 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8188003080 tx=0x7f8188009da0 comp rx=0 tx=0).stop 2024-09-18T21:14:33.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:33.295+0000 7f819739e640 1 -- 172.21.15.77:0/1535777222 shutdown_connections 2024-09-18T21:14:33.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:33.295+0000 7f819739e640 1 --2- 172.21.15.77:0/1535777222 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7f817806dae0 0x7f817806ff90 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:33.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:33.295+0000 7f819739e640 1 --2- 172.21.15.77:0/1535777222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81900fd7f0 0x7f819010d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:33.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:33.295+0000 7f819739e640 1 --2- 172.21.15.77:0/1535777222 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81900fc520 0x7f819010d080 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:14:33.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:33.295+0000 7f819739e640 1 -- 172.21.15.77:0/1535777222 >> 172.21.15.77:0/1535777222 conn(0x7f81900f7ce0 msgr2=0x7f81900f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:14:33.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:33.295+0000 7f819739e640 1 -- 172.21.15.77:0/1535777222 shutdown_connections 2024-09-18T21:14:33.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:14:33.296+0000 7f819739e640 1 -- 172.21.15.77:0/1535777222 wait complete. 2024-09-18T21:14:33.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:33 smithi077 ceph-mon[27689]: from='client.14756 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:14:33.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:33 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/2204056310' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T21:14:33.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:33 smithi077 ceph-mon[27689]: from='client.? 172.21.15.77:0/1535777222' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T21:14:33.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:33 smithi077 ceph-mon[27689]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:33.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:33 smithi077 ceph-mon[27689]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:33.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:33 smithi077 ceph-mon[27689]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:14:33.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:33 smithi077 ceph-mon[27689]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:14:34.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:33 smithi103 ceph-mon[34827]: from='client.14756 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:14:34.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:33 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/2204056310' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T21:14:34.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:33 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/1535777222' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T21:14:34.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:33 smithi103 ceph-mon[34827]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:34.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:33 smithi103 ceph-mon[34827]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:34.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:33 smithi103 ceph-mon[34827]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:14:34.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:33 smithi103 ceph-mon[34827]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:14:34.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:34 smithi077 ceph-mon[27689]: pgmap v8: 65 pgs: 65 active+clean; 211 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 469 KiB/s wr, 211 op/s 2024-09-18T21:14:34.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:34 smithi077 ceph-mon[27689]: from='client.14768 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:14:34.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:34 smithi077 ceph-mon[27689]: Updating smithi077:/etc/ceph/ceph.conf 2024-09-18T21:14:34.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:34 smithi077 ceph-mon[27689]: Updating smithi103:/etc/ceph/ceph.conf 2024-09-18T21:14:34.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:34 smithi077 ceph-mon[27689]: Updating smithi077:/var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T21:14:34.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:34 smithi077 ceph-mon[27689]: Updating smithi103:/var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T21:14:34.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:34 smithi077 ceph-mon[27689]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:34.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:34 smithi077 ceph-mon[27689]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:34.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:34 smithi077 ceph-mon[27689]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:34.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:34 smithi077 ceph-mon[27689]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:34.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:34 smithi077 ceph-mon[27689]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:35.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:34 smithi103 ceph-mon[34827]: pgmap v8: 65 pgs: 65 active+clean; 211 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 469 KiB/s wr, 211 op/s 2024-09-18T21:14:35.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:34 smithi103 ceph-mon[34827]: from='client.14768 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:14:35.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:34 smithi103 ceph-mon[34827]: Updating smithi077:/etc/ceph/ceph.conf 2024-09-18T21:14:35.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:34 smithi103 ceph-mon[34827]: Updating smithi103:/etc/ceph/ceph.conf 2024-09-18T21:14:35.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:34 smithi103 ceph-mon[34827]: Updating smithi077:/var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T21:14:35.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:34 smithi103 ceph-mon[34827]: Updating smithi103:/var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T21:14:35.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:34 smithi103 ceph-mon[34827]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:35.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:34 smithi103 ceph-mon[34827]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:35.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:34 smithi103 ceph-mon[34827]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:35.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:34 smithi103 ceph-mon[34827]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:35.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:34 smithi103 ceph-mon[34827]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:35.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:35 smithi077 ceph-mon[27689]: Updating smithi077:/etc/ceph/ceph.client.admin.keyring 2024-09-18T21:14:35.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:35 smithi077 ceph-mon[27689]: Updating smithi103:/etc/ceph/ceph.client.admin.keyring 2024-09-18T21:14:35.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:35 smithi077 ceph-mon[27689]: Updating smithi077:/var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T21:14:35.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:35 smithi077 ceph-mon[27689]: Updating smithi103:/var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T21:14:35.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:35 smithi077 ceph-mon[27689]: Reconfiguring prometheus.smithi077 (dependencies changed)... 2024-09-18T21:14:35.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:35 smithi077 ceph-mon[27689]: Reconfiguring daemon prometheus.smithi077 on smithi077 2024-09-18T21:14:36.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:35 smithi103 ceph-mon[34827]: Updating smithi077:/etc/ceph/ceph.client.admin.keyring 2024-09-18T21:14:36.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:35 smithi103 ceph-mon[34827]: Updating smithi103:/etc/ceph/ceph.client.admin.keyring 2024-09-18T21:14:36.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:35 smithi103 ceph-mon[34827]: Updating smithi077:/var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T21:14:36.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:35 smithi103 ceph-mon[34827]: Updating smithi103:/var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T21:14:36.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:35 smithi103 ceph-mon[34827]: Reconfiguring prometheus.smithi077 (dependencies changed)... 2024-09-18T21:14:36.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:35 smithi103 ceph-mon[34827]: Reconfiguring daemon prometheus.smithi077 on smithi077 2024-09-18T21:14:36.869 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:36 smithi077 ceph-mon[27689]: pgmap v9: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 36 KiB/s rd, 426 KiB/s wr, 182 op/s 2024-09-18T21:14:36.971 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:36 smithi103 ceph-mon[34827]: pgmap v9: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 36 KiB/s rd, 426 KiB/s wr, 182 op/s 2024-09-18T21:14:38.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:38 smithi077 ceph-mon[27689]: pgmap v10: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 33 KiB/s rd, 390 KiB/s wr, 167 op/s 2024-09-18T21:14:38.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:38 smithi077 ceph-mon[27689]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:14:39.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:38 smithi103 ceph-mon[34827]: pgmap v10: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 33 KiB/s rd, 390 KiB/s wr, 167 op/s 2024-09-18T21:14:39.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:38 smithi103 ceph-mon[34827]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:14:40.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:40 smithi103 ceph-mon[34827]: pgmap v11: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 33 KiB/s rd, 390 KiB/s wr, 167 op/s 2024-09-18T21:14:40.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:40 smithi103 ceph-mon[34827]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:40.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:40 smithi103 ceph-mon[34827]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:40.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:40 smithi103 ceph-mon[34827]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T21:14:40.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:40 smithi103 ceph-mon[34827]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T21:14:40.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:40 smithi103 ceph-mon[34827]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:14:40.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:40 smithi077 ceph-mon[27689]: pgmap v11: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 33 KiB/s rd, 390 KiB/s wr, 167 op/s 2024-09-18T21:14:40.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:40 smithi077 ceph-mon[27689]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:40.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:40 smithi077 ceph-mon[27689]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:40.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:40 smithi077 ceph-mon[27689]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T21:14:40.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:40 smithi077 ceph-mon[27689]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T21:14:40.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:40 smithi077 ceph-mon[27689]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:14:41.627 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:41 smithi103 ceph-mon[34827]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi103.zjztqc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T21:14:41.627 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:41 smithi103 ceph-mon[34827]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi103.zjztqc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T21:14:41.627 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:41 smithi103 ceph-mon[34827]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T21:14:41.627 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:41 smithi103 ceph-mon[34827]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:14:41.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:41 smithi077 ceph-mon[27689]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi103.zjztqc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T21:14:41.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:41 smithi077 ceph-mon[27689]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi103.zjztqc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T21:14:41.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:41 smithi077 ceph-mon[27689]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T21:14:41.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:41 smithi077 ceph-mon[27689]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:14:42.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:42 smithi103 ceph-mon[34827]: pgmap v12: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 89 KiB/s wr, 107 op/s 2024-09-18T21:14:42.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:42 smithi103 ceph-mon[34827]: Upgrade: Updating mgr.smithi103.zjztqc 2024-09-18T21:14:42.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:42 smithi103 ceph-mon[34827]: Deploying daemon mgr.smithi103.zjztqc on smithi103 2024-09-18T21:14:42.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:42 smithi077 ceph-mon[27689]: pgmap v12: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 89 KiB/s wr, 107 op/s 2024-09-18T21:14:42.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:42 smithi077 ceph-mon[27689]: Upgrade: Updating mgr.smithi103.zjztqc 2024-09-18T21:14:42.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:42 smithi077 ceph-mon[27689]: Deploying daemon mgr.smithi103.zjztqc on smithi103 2024-09-18T21:14:44.497 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:44 smithi103 ceph-mon[34827]: pgmap v13: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 39 KiB/s wr, 8 op/s 2024-09-18T21:14:44.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:44 smithi077 ceph-mon[27689]: pgmap v13: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 39 KiB/s wr, 8 op/s 2024-09-18T21:14:45.710 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:45 smithi103 ceph-mon[34827]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:45.710 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:45 smithi103 ceph-mon[34827]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:45.711 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:45 smithi103 ceph-mon[34827]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:14:45.711 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:45 smithi103 ceph-mon[34827]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:45.711 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:45 smithi103 ceph-mon[34827]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:45.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:45 smithi077 ceph-mon[27689]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:45.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:45 smithi077 ceph-mon[27689]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:45.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:45 smithi077 ceph-mon[27689]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:14:45.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:45 smithi077 ceph-mon[27689]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:45.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:45 smithi077 ceph-mon[27689]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:46.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:46 smithi077 ceph-mon[27689]: pgmap v14: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 39 KiB/s wr, 8 op/s 2024-09-18T21:14:46.847 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:46 smithi103 ceph-mon[34827]: pgmap v14: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 39 KiB/s wr, 8 op/s 2024-09-18T21:14:48.595 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:48 smithi103 ceph-mon[34827]: pgmap v15: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-18T21:14:48.595 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:48 smithi103 ceph-mon[34827]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:48.596 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:48 smithi103 ceph-mon[34827]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:48.596 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:48 smithi103 ceph-mon[34827]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:48.596 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:48 smithi103 ceph-mon[34827]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:48.660 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:48 smithi077 ceph-mon[27689]: pgmap v15: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-18T21:14:48.660 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:48 smithi077 ceph-mon[27689]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:48.660 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:48 smithi077 ceph-mon[27689]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:48.660 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:48 smithi077 ceph-mon[27689]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:48.660 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:48 smithi077 ceph-mon[27689]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:50.658 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:50 smithi103 ceph-mon[34827]: pgmap v16: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-18T21:14:50.658 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:50 smithi103 ceph-mon[34827]: Standby manager daemon smithi103.zjztqc restarted 2024-09-18T21:14:50.658 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:50 smithi103 ceph-mon[34827]: Standby manager daemon smithi103.zjztqc started 2024-09-18T21:14:50.658 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:50 smithi103 ceph-mon[34827]: from='mgr.? 172.21.15.103:0/3536542102' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi103.zjztqc/crt"}]: dispatch 2024-09-18T21:14:50.659 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:50 smithi103 ceph-mon[34827]: from='mgr.? 172.21.15.103:0/3536542102' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T21:14:50.659 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:50 smithi103 ceph-mon[34827]: from='mgr.? 172.21.15.103:0/3536542102' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi103.zjztqc/key"}]: dispatch 2024-09-18T21:14:50.659 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:50 smithi103 ceph-mon[34827]: from='mgr.? 172.21.15.103:0/3536542102' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T21:14:50.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:50 smithi077 ceph-mon[27689]: pgmap v16: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-18T21:14:50.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:50 smithi077 ceph-mon[27689]: Standby manager daemon smithi103.zjztqc restarted 2024-09-18T21:14:50.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:50 smithi077 ceph-mon[27689]: Standby manager daemon smithi103.zjztqc started 2024-09-18T21:14:50.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:50 smithi077 ceph-mon[27689]: from='mgr.? 172.21.15.103:0/3536542102' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi103.zjztqc/crt"}]: dispatch 2024-09-18T21:14:50.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:50 smithi077 ceph-mon[27689]: from='mgr.? 172.21.15.103:0/3536542102' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T21:14:50.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:50 smithi077 ceph-mon[27689]: from='mgr.? 172.21.15.103:0/3536542102' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi103.zjztqc/key"}]: dispatch 2024-09-18T21:14:50.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:50 smithi077 ceph-mon[27689]: from='mgr.? 172.21.15.103:0/3536542102' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T21:14:51.599 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:51 smithi077 ceph-mon[27689]: mgrmap e31: smithi077.utkpjg(active, since 27s), standbys: smithi103.zjztqc 2024-09-18T21:14:51.599 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:51 smithi077 ceph-mon[27689]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:51.600 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:51 smithi077 ceph-mon[27689]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:51.600 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:51 smithi077 ceph-mon[27689]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:51.600 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:51 smithi077 ceph-mon[27689]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:51.600 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:51 smithi077 ceph-mon[27689]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:14:51.600 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:51 smithi077 ceph-mon[27689]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:14:51.600 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:51 smithi077 ceph-mon[27689]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:51.600 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:51 smithi077 ceph-mon[27689]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:14:51.600 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:51 smithi077 ceph-mon[27689]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:14:51.600 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:51 smithi077 ceph-mon[27689]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:51.600 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:51 smithi077 ceph-mon[27689]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi077.utkpjg"}]: dispatch 2024-09-18T21:14:51.600 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:51 smithi077 ceph-mon[27689]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi077.utkpjg"}]: dispatch 2024-09-18T21:14:51.600 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:51 smithi077 ceph-mon[27689]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi077.utkpjg"}]': finished 2024-09-18T21:14:51.600 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:51 smithi077 ceph-mon[27689]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi103.zjztqc"}]: dispatch 2024-09-18T21:14:51.600 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:51 smithi077 ceph-mon[27689]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi103.zjztqc"}]: dispatch 2024-09-18T21:14:51.600 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:51 smithi077 ceph-mon[27689]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi103.zjztqc"}]': finished 2024-09-18T21:14:51.601 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:51 smithi077 ceph-mon[27689]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-18T21:14:51.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:51 smithi103 ceph-mon[34827]: mgrmap e31: smithi077.utkpjg(active, since 27s), standbys: smithi103.zjztqc 2024-09-18T21:14:51.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:51 smithi103 ceph-mon[34827]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:51.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:51 smithi103 ceph-mon[34827]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:51.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:51 smithi103 ceph-mon[34827]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:51.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:51 smithi103 ceph-mon[34827]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:51.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:51 smithi103 ceph-mon[34827]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:14:51.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:51 smithi103 ceph-mon[34827]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:14:51.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:51 smithi103 ceph-mon[34827]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:51.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:51 smithi103 ceph-mon[34827]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:14:51.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:51 smithi103 ceph-mon[34827]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:14:51.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:51 smithi103 ceph-mon[34827]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:51.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:51 smithi103 ceph-mon[34827]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi077.utkpjg"}]: dispatch 2024-09-18T21:14:51.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:51 smithi103 ceph-mon[34827]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi077.utkpjg"}]: dispatch 2024-09-18T21:14:51.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:51 smithi103 ceph-mon[34827]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi077.utkpjg"}]': finished 2024-09-18T21:14:51.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:51 smithi103 ceph-mon[34827]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi103.zjztqc"}]: dispatch 2024-09-18T21:14:51.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:51 smithi103 ceph-mon[34827]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi103.zjztqc"}]: dispatch 2024-09-18T21:14:51.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:51 smithi103 ceph-mon[34827]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi103.zjztqc"}]': finished 2024-09-18T21:14:51.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:51 smithi103 ceph-mon[34827]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-18T21:14:52.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:52 smithi077 ceph-mon[27689]: pgmap v17: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-09-18T21:14:52.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:52 smithi077 ceph-mon[27689]: Upgrade: Setting container_image for all mgr 2024-09-18T21:14:53.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:52 smithi103 ceph-mon[34827]: pgmap v17: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-09-18T21:14:53.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:52 smithi103 ceph-mon[34827]: Upgrade: Setting container_image for all mgr 2024-09-18T21:14:54.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:53 smithi077 ceph-mon[27689]: Upgrade: Updating mon.smithi077 2024-09-18T21:14:54.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:53 smithi077 ceph-mon[27689]: pgmap v18: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:14:54.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:53 smithi077 ceph-mon[27689]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:54.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:53 smithi077 ceph-mon[27689]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-18T21:14:54.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:53 smithi077 ceph-mon[27689]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-18T21:14:54.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:53 smithi077 ceph-mon[27689]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:14:54.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:53 smithi077 ceph-mon[27689]: Deploying daemon mon.smithi077 on smithi077 2024-09-18T21:14:54.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:53 smithi077 ceph-mon[27689]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:14:54.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:53 smithi103 ceph-mon[34827]: Upgrade: Updating mon.smithi077 2024-09-18T21:14:54.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:53 smithi103 ceph-mon[34827]: pgmap v18: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:14:54.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:53 smithi103 ceph-mon[34827]: from='mgr.14690 ' entity='mgr.smithi077.utkpjg' 2024-09-18T21:14:54.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:53 smithi103 ceph-mon[34827]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-18T21:14:54.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:53 smithi103 ceph-mon[34827]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-18T21:14:54.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:53 smithi103 ceph-mon[34827]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:14:54.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:53 smithi103 ceph-mon[34827]: Deploying daemon mon.smithi077 on smithi077 2024-09-18T21:14:54.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:53 smithi103 ceph-mon[34827]: from='mgr.14690 172.21.15.77:0/3204868699' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:14:56.066 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:14:55 smithi103 ceph-mon[34827]: pgmap v19: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:14:56.133 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:55 smithi077 ceph-mon[27689]: pgmap v19: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:14:56.408 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:56 smithi077 systemd[1]: Stopping Ceph mon.smithi077 for 5a76ec16-7601-11ef-bceb-c7b262605968... 2024-09-18T21:14:56.700 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:56 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-mon-smithi077[27685]: 2024-09-18T21:14:56.407+0000 7fdd2884c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi077 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T21:14:56.701 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:56 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-mon-smithi077[27685]: 2024-09-18T21:14:56.407+0000 7fdd2884c640 -1 mon.smithi077@0(leader) e2 *** Got Signal Terminated *** 2024-09-18T21:14:56.701 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:56 smithi077 podman[92511]: 2024-09-18 21:14:56.448445107 +0000 UTC m=+0.171089227 container died bcbf289fe027866c14b0abccecb439ed698b6c6e0495f5acce4c3a5a4b0c7e50 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-mon-smithi077, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=quincy-6e06d1e, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-18T21:14:56.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:56 smithi077 podman[92511]: 2024-09-18 21:14:56.790709187 +0000 UTC m=+0.513353299 container cleanup bcbf289fe027866c14b0abccecb439ed698b6c6e0495f5acce4c3a5a4b0c7e50 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-mon-smithi077, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=quincy-6e06d1e, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-18T21:14:56.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:56 smithi077 bash[92511]: ceph-5a76ec16-7601-11ef-bceb-c7b262605968-mon-smithi077 2024-09-18T21:14:57.417 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:56 smithi077 podman[92522]: 2024-09-18 21:14:56.984097932 +0000 UTC m=+0.531398074 container remove bcbf289fe027866c14b0abccecb439ed698b6c6e0495f5acce4c3a5a4b0c7e50 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-mon-smithi077, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=quincy-6e06d1e, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-18T21:14:57.417 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 systemd[1]: ceph-5a76ec16-7601-11ef-bceb-c7b262605968@mon.smithi077.service: Deactivated successfully. 2024-09-18T21:14:57.417 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 systemd[1]: Stopped Ceph mon.smithi077 for 5a76ec16-7601-11ef-bceb-c7b262605968. 2024-09-18T21:14:57.417 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 systemd[1]: ceph-5a76ec16-7601-11ef-bceb-c7b262605968@mon.smithi077.service: Consumed 10.092s CPU time. 2024-09-18T21:14:57.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 systemd[1]: Starting Ceph mon.smithi077 for 5a76ec16-7601-11ef-bceb-c7b262605968... 2024-09-18T21:14:57.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 podman[92653]: 2024-09-18 21:14:57.528679748 +0000 UTC m=+0.015784697 image pull f79f744f586d6ce8ddb4b06b7cf36a0f23174bbe29ea68264d2be49d8c6d9acd quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a 2024-09-18T21:14:57.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 podman[92653]: 2024-09-18 21:14:57.652159066 +0000 UTC m=+0.139263996 container create 2d0fbbea1264b983fc1a033032c62fd1cd68167e731f24dd8dfacf93a50be2b4 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-mon-smithi077, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-release-06b1b1d, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True) 2024-09-18T21:14:58.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 podman[92653]: 2024-09-18 21:14:57.887969357 +0000 UTC m=+0.375074301 container init 2d0fbbea1264b983fc1a033032c62fd1cd68167e731f24dd8dfacf93a50be2b4 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-mon-smithi077, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-release-06b1b1d, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-18T21:14:58.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 podman[92653]: 2024-09-18 21:14:57.891382715 +0000 UTC m=+0.378487647 container start 2d0fbbea1264b983fc1a033032c62fd1cd68167e731f24dd8dfacf93a50be2b4 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-mon-smithi077, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-release-06b1b1d, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-18T21:14:58.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: set uid:gid to 167:167 (ceph:ceph) 2024-09-18T21:14:58.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable), process ceph-mon, pid 2 2024-09-18T21:14:58.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: pidfile_write: ignore empty --pid-file 2024-09-18T21:14:58.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: load: jerasure load: lrc 2024-09-18T21:14:58.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: RocksDB version: 7.9.2 2024-09-18T21:14:58.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Git sha 0 2024-09-18T21:14:58.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Compile date 2024-09-18 18:43:21 2024-09-18T21:14:58.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: DB SUMMARY 2024-09-18T21:14:58.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: DB Session ID: X0IVD5S11SK0O1PIFDDE 2024-09-18T21:14:58.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: CURRENT file: CURRENT 2024-09-18T21:14:58.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: IDENTITY file: IDENTITY 2024-09-18T21:14:58.215 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: MANIFEST file: MANIFEST-000015 size: 968 Bytes 2024-09-18T21:14:58.215 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi077/store.db dir, Total Num: 1, files: 000030.sst 2024-09-18T21:14:58.215 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi077/store.db: 000028.log size: 2202729 ; 2024-09-18T21:14:58.215 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.error_if_exists: 0 2024-09-18T21:14:58.215 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.create_if_missing: 0 2024-09-18T21:14:58.215 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.paranoid_checks: 1 2024-09-18T21:14:58.215 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-18T21:14:58.215 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-18T21:14:58.215 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-18T21:14:58.215 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.env: 0x5584fb2147a0 2024-09-18T21:14:58.215 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.fs: PosixFileSystem 2024-09-18T21:14:58.215 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.info_log: 0x5584fc4d76e0 2024-09-18T21:14:58.216 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.max_file_opening_threads: 16 2024-09-18T21:14:58.216 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.statistics: (nil) 2024-09-18T21:14:58.216 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.use_fsync: 0 2024-09-18T21:14:58.216 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.max_log_file_size: 0 2024-09-18T21:14:58.216 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-18T21:14:58.216 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-18T21:14:58.216 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.keep_log_file_num: 1000 2024-09-18T21:14:58.216 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.recycle_log_file_num: 0 2024-09-18T21:14:58.216 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.allow_fallocate: 1 2024-09-18T21:14:58.216 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.allow_mmap_reads: 0 2024-09-18T21:14:58.216 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.allow_mmap_writes: 0 2024-09-18T21:14:58.216 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.use_direct_reads: 0 2024-09-18T21:14:58.216 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-18T21:14:58.217 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.create_missing_column_families: 0 2024-09-18T21:14:58.217 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.db_log_dir: 2024-09-18T21:14:58.217 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.wal_dir: 2024-09-18T21:14:58.217 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-18T21:14:58.217 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-18T21:14:58.217 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-18T21:14:58.217 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-18T21:14:58.217 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-18T21:14:58.217 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-18T21:14:58.217 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.advise_random_on_open: 1 2024-09-18T21:14:58.217 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.db_write_buffer_size: 0 2024-09-18T21:14:58.217 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.write_buffer_manager: 0x5584fc4e6dc0 2024-09-18T21:14:58.217 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-18T21:14:58.217 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-18T21:14:58.218 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-18T21:14:58.218 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.rate_limiter: (nil) 2024-09-18T21:14:58.218 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-18T21:14:58.218 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.wal_recovery_mode: 2 2024-09-18T21:14:58.218 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.enable_thread_tracking: 0 2024-09-18T21:14:58.218 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.enable_pipelined_write: 0 2024-09-18T21:14:58.218 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.unordered_write: 0 2024-09-18T21:14:58.218 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-18T21:14:58.218 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-18T21:14:58.218 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-18T21:14:58.218 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-18T21:14:58.218 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.row_cache: None 2024-09-18T21:14:58.218 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.wal_filter: None 2024-09-18T21:14:58.220 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-18T21:14:58.220 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.allow_ingest_behind: 0 2024-09-18T21:14:58.220 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.two_write_queues: 0 2024-09-18T21:14:58.220 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.manual_wal_flush: 0 2024-09-18T21:14:58.220 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.wal_compression: 0 2024-09-18T21:14:58.220 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.atomic_flush: 0 2024-09-18T21:14:58.220 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-18T21:14:58.220 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-18T21:14:58.220 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-18T21:14:58.221 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.log_readahead_size: 0 2024-09-18T21:14:58.221 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-18T21:14:58.221 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.best_efforts_recovery: 0 2024-09-18T21:14:58.221 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-18T21:14:58.221 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-18T21:14:58.221 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.allow_data_in_errors: 0 2024-09-18T21:14:58.221 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.db_host_id: __hostname__ 2024-09-18T21:14:58.221 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-18T21:14:58.221 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.max_background_jobs: 2 2024-09-18T21:14:58.221 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.max_background_compactions: -1 2024-09-18T21:14:58.221 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.max_subcompactions: 1 2024-09-18T21:14:58.221 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-18T21:14:58.221 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-18T21:14:58.221 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-18T21:14:58.222 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.max_total_wal_size: 0 2024-09-18T21:14:58.222 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-18T21:14:58.222 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-18T21:14:58.222 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-18T21:14:58.222 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-18T21:14:58.222 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.max_open_files: -1 2024-09-18T21:14:58.222 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.bytes_per_sync: 0 2024-09-18T21:14:58.222 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-18T21:14:58.222 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-18T21:14:58.222 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.compaction_readahead_size: 0 2024-09-18T21:14:58.222 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.max_background_flushes: -1 2024-09-18T21:14:58.222 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Compression algorithms supported: 2024-09-18T21:14:58.222 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: kZSTD supported: 0 2024-09-18T21:14:58.223 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: kXpressCompression supported: 0 2024-09-18T21:14:58.223 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: kBZip2Compression supported: 0 2024-09-18T21:14:58.223 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-18T21:14:58.223 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: kLZ4Compression supported: 1 2024-09-18T21:14:58.223 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: kZlibCompression supported: 1 2024-09-18T21:14:58.223 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: kLZ4HCCompression supported: 1 2024-09-18T21:14:58.223 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: kSnappyCompression supported: 1 2024-09-18T21:14:58.223 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-18T21:14:58.223 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-18T21:14:58.223 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi077/store.db/MANIFEST-000015 2024-09-18T21:14:58.223 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-18T21:14:58.223 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-18T21:14:58.223 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.merge_operator: 2024-09-18T21:14:58.223 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.compaction_filter: None 2024-09-18T21:14:58.224 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.compaction_filter_factory: None 2024-09-18T21:14:58.224 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.sst_partitioner_factory: None 2024-09-18T21:14:58.224 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-18T21:14:58.224 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-18T21:14:58.224 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5584fc4d7320) 2024-09-18T21:14:58.224 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: cache_index_and_filter_blocks: 1 2024-09-18T21:14:58.224 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-18T21:14:58.224 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-18T21:14:58.224 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: pin_top_level_index_and_filter: 1 2024-09-18T21:14:58.224 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: index_type: 0 2024-09-18T21:14:58.224 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: data_block_index_type: 0 2024-09-18T21:14:58.224 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: index_shortening: 1 2024-09-18T21:14:58.224 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-18T21:14:58.224 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: checksum: 4 2024-09-18T21:14:58.224 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: no_block_cache: 0 2024-09-18T21:14:58.225 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: block_cache: 0x5584fc4cb090 2024-09-18T21:14:58.225 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: block_cache_name: BinnedLRUCache 2024-09-18T21:14:58.225 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: block_cache_options: 2024-09-18T21:14:58.225 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: capacity : 536870912 2024-09-18T21:14:58.225 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: num_shard_bits : 4 2024-09-18T21:14:58.225 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: strict_capacity_limit : 0 2024-09-18T21:14:58.225 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: high_pri_pool_ratio: 0.000 2024-09-18T21:14:58.225 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: block_cache_compressed: (nil) 2024-09-18T21:14:58.225 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: persistent_cache: (nil) 2024-09-18T21:14:58.225 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: block_size: 4096 2024-09-18T21:14:58.225 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: block_size_deviation: 10 2024-09-18T21:14:58.225 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: block_restart_interval: 16 2024-09-18T21:14:58.225 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: index_block_restart_interval: 1 2024-09-18T21:14:58.225 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: metadata_block_size: 4096 2024-09-18T21:14:58.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: partition_filters: 0 2024-09-18T21:14:58.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: use_delta_encoding: 1 2024-09-18T21:14:58.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: filter_policy: bloomfilter 2024-09-18T21:14:58.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: whole_key_filtering: 1 2024-09-18T21:14:58.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: verify_compression: 0 2024-09-18T21:14:58.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: read_amp_bytes_per_bit: 0 2024-09-18T21:14:58.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: format_version: 5 2024-09-18T21:14:58.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: enable_index_compression: 1 2024-09-18T21:14:58.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: block_align: 0 2024-09-18T21:14:58.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: max_auto_readahead_size: 262144 2024-09-18T21:14:58.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: prepopulate_block_cache: 0 2024-09-18T21:14:58.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: initial_auto_readahead_size: 8192 2024-09-18T21:14:58.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: num_file_reads_for_auto_readahead: 2 2024-09-18T21:14:58.226 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.write_buffer_size: 33554432 2024-09-18T21:14:58.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.max_write_buffer_number: 2 2024-09-18T21:14:58.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.compression: NoCompression 2024-09-18T21:14:58.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.bottommost_compression: Disabled 2024-09-18T21:14:58.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.prefix_extractor: nullptr 2024-09-18T21:14:58.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-18T21:14:58.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.num_levels: 7 2024-09-18T21:14:58.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-18T21:14:58.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-18T21:14:58.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-18T21:14:58.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-18T21:14:58.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-18T21:14:58.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-18T21:14:58.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-18T21:14:58.227 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-18T21:14:58.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-18T21:14:58.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-18T21:14:58.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-18T21:14:58.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-18T21:14:58.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-18T21:14:58.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.compression_opts.level: 32767 2024-09-18T21:14:58.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.compression_opts.strategy: 0 2024-09-18T21:14:58.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-18T21:14:58.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-18T21:14:58.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-18T21:14:58.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-18T21:14:58.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.compression_opts.enabled: false 2024-09-18T21:14:58.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-18T21:14:58.228 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-18T21:14:58.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-18T21:14:58.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-18T21:14:58.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.target_file_size_base: 67108864 2024-09-18T21:14:58.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-18T21:14:58.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-18T21:14:58.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-18T21:14:58.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-18T21:14:58.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-18T21:14:58.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-18T21:14:58.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-18T21:14:58.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-18T21:14:58.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-18T21:14:58.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-18T21:14:58.229 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-18T21:14:58.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-18T21:14:58.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-18T21:14:58.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-18T21:14:58.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.arena_block_size: 1048576 2024-09-18T21:14:58.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-18T21:14:58.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-18T21:14:58.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.disable_auto_compactions: 0 2024-09-18T21:14:58.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-18T21:14:58.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-18T21:14:58.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-18T21:14:58.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-18T21:14:58.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-18T21:14:58.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-18T21:14:58.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-18T21:14:58.230 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-18T21:14:58.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-18T21:14:58.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-18T21:14:58.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-18T21:14:58.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.inplace_update_support: 0 2024-09-18T21:14:58.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-18T21:14:58.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-18T21:14:58.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-18T21:14:58.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-18T21:14:58.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.bloom_locality: 0 2024-09-18T21:14:58.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.max_successive_merges: 0 2024-09-18T21:14:58.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-18T21:14:58.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.paranoid_file_checks: 0 2024-09-18T21:14:58.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.force_consistency_checks: 1 2024-09-18T21:14:58.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.report_bg_io_stats: 0 2024-09-18T21:14:58.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.ttl: 2592000 2024-09-18T21:14:58.231 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-18T21:14:58.232 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-18T21:14:58.232 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-18T21:14:58.232 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.enable_blob_files: false 2024-09-18T21:14:58.232 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.min_blob_size: 0 2024-09-18T21:14:58.232 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.blob_file_size: 268435456 2024-09-18T21:14:58.232 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-18T21:14:58.232 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-18T21:14:58.232 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-18T21:14:58.232 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-18T21:14:58.232 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-18T21:14:58.232 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.blob_file_starting_level: 0 2024-09-18T21:14:58.232 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-18T21:14:58.232 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 30.sst 2024-09-18T21:14:58.232 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-18T21:14:58.233 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi077/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 32, last_sequence is 10090, log_number is 28,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-18T21:14:58.233 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 28 2024-09-18T21:14:58.233 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: c20a2af3-da49-484f-b107-bf22ed632360 2024-09-18T21:14:58.233 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726694097917314, "job": 1, "event": "recovery_started", "wal_files": [28]} 2024-09-18T21:14:58.233 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #28 mode 2 2024-09-18T21:14:58.233 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726694097923765, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 33, "file_size": 1992862, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 10091, "largest_seqno": 11005, "table_properties": {"data_size": 1987779, "index_size": 2954, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1093, "raw_key_size": 9750, "raw_average_key_size": 23, "raw_value_size": 1978553, "raw_average_value_size": 4722, "num_data_blocks": 136, "num_entries": 419, "num_filter_entries": 419, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726694097, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "c20a2af3-da49-484f-b107-bf22ed632360", "db_session_id": "X0IVD5S11SK0O1PIFDDE", "orig_file_number": 33, "seqno_to_time_mapping": "N/A"}} 2024-09-18T21:14:58.233 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726694097923858, "job": 1, "event": "recovery_finished"} 2024-09-18T21:14:58.233 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: [db/version_set.cc:5047] Creating manifest 35 2024-09-18T21:14:58.233 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-18T21:14:58.233 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi077/store.db/000028.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-18T21:14:58.233 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5584fc4f8e00 2024-09-18T21:14:58.233 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: DB pointer 0x5584fc5f2000 2024-09-18T21:14:58.233 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-18T21:14:58.233 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-18T21:14:58.234 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: ** DB Stats ** 2024-09-18T21:14:58.234 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-18T21:14:58.234 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-18T21:14:58.234 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-18T21:14:58.234 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-18T21:14:58.234 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-18T21:14:58.234 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-18T21:14:58.234 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-18T21:14:58.234 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: 2024-09-18T21:14:58.234 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: ** Compaction Stats [default] ** 2024-09-18T21:14:58.234 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-18T21:14:58.234 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-18T21:14:58.234 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: L0 1/0 1.90 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 571.1 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-18T21:14:58.234 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: L6 1/0 5.28 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-18T21:14:58.234 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Sum 2/0 7.18 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 571.1 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-18T21:14:58.234 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 571.1 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-18T21:14:58.235 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: 2024-09-18T21:14:58.235 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: ** Compaction Stats [default] ** 2024-09-18T21:14:58.235 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-18T21:14:58.235 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-18T21:14:58.235 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 571.1 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-18T21:14:58.235 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: 2024-09-18T21:14:58.235 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-18T21:14:58.235 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: 2024-09-18T21:14:58.235 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-18T21:14:58.235 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-09-18T21:14:58.235 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-18T21:14:58.235 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-18T21:14:58.235 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-18T21:14:58.235 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-18T21:14:58.235 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Cumulative compaction: 0.00 GB write, 214.39 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-18T21:14:58.236 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Interval compaction: 0.00 GB write, 214.39 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-18T21:14:58.236 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-18T21:14:58.236 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Block cache BinnedLRUCache@0x5584fc4cb090#2 capacity: 512.00 MB usage: 4.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-18T21:14:58.236 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.16 KB,0.000220537%) IndexBlock(1,3.08 KB,0.000587106%) Misc(1,0.00 KB,0%) 2024-09-18T21:14:58.236 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: 2024-09-18T21:14:58.236 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-18T21:14:58.236 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: starting mon.smithi077 rank 0 at public addrs [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] at bind addrs [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi077 fsid 5a76ec16-7601-11ef-bceb-c7b262605968 2024-09-18T21:14:58.236 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: mon.smithi077@-1(???) e2 preinit fsid 5a76ec16-7601-11ef-bceb-c7b262605968 2024-09-18T21:14:58.236 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: mon.smithi077@-1(???).mds e13 new map 2024-09-18T21:14:58.236 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: mon.smithi077@-1(???).mds e13 print_map 2024-09-18T21:14:58.236 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: e13 2024-09-18T21:14:58.236 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-18T21:14:58.236 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T21:14:58.236 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T21:14:58.236 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: legacy client fscid: 1 2024-09-18T21:14:58.236 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: 2024-09-18T21:14:58.237 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Filesystem 'cephfs' (1) 2024-09-18T21:14:58.237 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: fs_name cephfs 2024-09-18T21:14:58.237 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: epoch 13 2024-09-18T21:14:58.237 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T21:14:58.237 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: created 2024-09-18T21:10:17.230179+0000 2024-09-18T21:14:58.237 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: modified 2024-09-18T21:10:33.373241+0000 2024-09-18T21:14:58.237 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: tableserver 0 2024-09-18T21:14:58.237 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: root 0 2024-09-18T21:14:58.237 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: session_timeout 60 2024-09-18T21:14:58.237 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: session_autoclose 300 2024-09-18T21:14:58.237 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: max_file_size 1099511627776 2024-09-18T21:14:58.237 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: max_xattr_size 65536 2024-09-18T21:14:58.237 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: required_client_features {} 2024-09-18T21:14:58.237 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: last_failure 0 2024-09-18T21:14:58.237 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: last_failure_osd_epoch 0 2024-09-18T21:14:58.238 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T21:14:58.238 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: max_mds 1 2024-09-18T21:14:58.238 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: in 0 2024-09-18T21:14:58.238 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: up {0=14446} 2024-09-18T21:14:58.238 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: failed 2024-09-18T21:14:58.238 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: damaged 2024-09-18T21:14:58.238 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: stopped 2024-09-18T21:14:58.238 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: data_pools [3] 2024-09-18T21:14:58.238 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: metadata_pool 2 2024-09-18T21:14:58.238 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: inline_data disabled 2024-09-18T21:14:58.238 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: balancer 2024-09-18T21:14:58.238 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: bal_rank_mask -1 2024-09-18T21:14:58.238 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: standby_count_wanted 1 2024-09-18T21:14:58.238 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: qdb_cluster leader: 0 members: 2024-09-18T21:14:58.238 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: [mds.cephfs.smithi077.vruydi{0:14446} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.77:6826/334039954,v1:172.21.15.77:6827/334039954] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:14:58.238 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: 2024-09-18T21:14:58.239 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: 2024-09-18T21:14:58.239 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Standby daemons: 2024-09-18T21:14:58.239 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: 2024-09-18T21:14:58.239 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: [mds.cephfs.smithi077.cqfhlw{-1:14458} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.77:6828/862540650,v1:172.21.15.77:6829/862540650] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:14:58.239 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: [mds.cephfs.smithi103.zhdmdg{-1:24255} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.103:6824/2170237078,v1:172.21.15.103:6825/2170237078] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:14:58.239 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: [mds.cephfs.smithi103.opftmf{-1:24267} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.103:6826/4241818403,v1:172.21.15.103:6827/4241818403] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:14:58.239 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: mon.smithi077@-1(???).osd e45 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-18T21:14:58.239 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: mon.smithi077@-1(???).osd e45 crush map has features 288514051259236352, adjusting msgr requires 2024-09-18T21:14:58.239 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: mon.smithi077@-1(???).osd e45 crush map has features 288514051259236352, adjusting msgr requires 2024-09-18T21:14:58.239 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: mon.smithi077@-1(???).osd e45 crush map has features 288514051259236352, adjusting msgr requires 2024-09-18T21:14:58.239 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 ceph-mon[92672]: mon.smithi077@-1(???).paxosservice(auth 1..20) refresh upgraded, format 0 -> 3 2024-09-18T21:14:58.239 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 bash[92653]: 2d0fbbea1264b983fc1a033032c62fd1cd68167e731f24dd8dfacf93a50be2b4 2024-09-18T21:14:58.239 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:14:57 smithi077 systemd[1]: Started Ceph mon.smithi077 for 5a76ec16-7601-11ef-bceb-c7b262605968. 2024-09-18T21:15:01.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:01 smithi103 ceph-mon[34827]: pgmap v20: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:15:01.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:01 smithi103 ceph-mon[34827]: pgmap v21: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:15:01.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:01 smithi103 ceph-mon[34827]: mon.smithi077 calling monitor election 2024-09-18T21:15:01.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:01 smithi103 ceph-mon[34827]: mon.smithi077 is new leader, mons smithi077,smithi103 in quorum (ranks 0,1) 2024-09-18T21:15:01.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:01 smithi103 ceph-mon[34827]: monmap epoch 2 2024-09-18T21:15:01.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:01 smithi103 ceph-mon[34827]: fsid 5a76ec16-7601-11ef-bceb-c7b262605968 2024-09-18T21:15:01.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:01 smithi103 ceph-mon[34827]: last_changed 2024-09-18T21:06:07.324545+0000 2024-09-18T21:15:01.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:01 smithi103 ceph-mon[34827]: created 2024-09-18T21:03:43.159838+0000 2024-09-18T21:15:01.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:01 smithi103 ceph-mon[34827]: min_mon_release 17 (quincy) 2024-09-18T21:15:01.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:01 smithi103 ceph-mon[34827]: election_strategy: 1 2024-09-18T21:15:01.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:01 smithi103 ceph-mon[34827]: 0: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.smithi077 2024-09-18T21:15:01.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:01 smithi103 ceph-mon[34827]: 1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.smithi103 2024-09-18T21:15:01.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:01 smithi103 ceph-mon[34827]: fsmap cephfs:1 {0=cephfs.smithi077.vruydi=up:active} 3 up:standby 2024-09-18T21:15:01.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:01 smithi103 ceph-mon[34827]: osdmap e45: 6 total, 6 up, 6 in 2024-09-18T21:15:01.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:01 smithi103 ceph-mon[34827]: mgrmap e31: smithi077.utkpjg(active, since 38s), standbys: smithi103.zjztqc 2024-09-18T21:15:01.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:01 smithi103 ceph-mon[34827]: overall HEALTH_OK 2024-09-18T21:15:01.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:01 smithi103 ceph-mon[34827]: from='mgr.14690 ' entity='' 2024-09-18T21:15:01.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:01 smithi103 ceph-mon[34827]: mgrmap e32: smithi077.utkpjg(active, since 38s), standbys: smithi103.zjztqc 2024-09-18T21:15:01.316 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:01 smithi077 ceph-mon[92672]: pgmap v20: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:15:01.316 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:01 smithi077 ceph-mon[92672]: pgmap v21: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:15:01.316 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:01 smithi077 ceph-mon[92672]: mon.smithi077 calling monitor election 2024-09-18T21:15:01.316 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:01 smithi077 ceph-mon[92672]: mon.smithi077 is new leader, mons smithi077,smithi103 in quorum (ranks 0,1) 2024-09-18T21:15:01.317 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:01 smithi077 ceph-mon[92672]: monmap epoch 2 2024-09-18T21:15:01.317 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:01 smithi077 ceph-mon[92672]: fsid 5a76ec16-7601-11ef-bceb-c7b262605968 2024-09-18T21:15:01.317 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:01 smithi077 ceph-mon[92672]: last_changed 2024-09-18T21:06:07.324545+0000 2024-09-18T21:15:01.317 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:01 smithi077 ceph-mon[92672]: created 2024-09-18T21:03:43.159838+0000 2024-09-18T21:15:01.317 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:01 smithi077 ceph-mon[92672]: min_mon_release 17 (quincy) 2024-09-18T21:15:01.317 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:01 smithi077 ceph-mon[92672]: election_strategy: 1 2024-09-18T21:15:01.318 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:01 smithi077 ceph-mon[92672]: 0: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.smithi077 2024-09-18T21:15:01.318 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:01 smithi077 ceph-mon[92672]: 1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.smithi103 2024-09-18T21:15:01.318 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:01 smithi077 ceph-mon[92672]: fsmap cephfs:1 {0=cephfs.smithi077.vruydi=up:active} 3 up:standby 2024-09-18T21:15:01.318 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:01 smithi077 ceph-mon[92672]: osdmap e45: 6 total, 6 up, 6 in 2024-09-18T21:15:01.318 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:01 smithi077 ceph-mon[92672]: mgrmap e31: smithi077.utkpjg(active, since 38s), standbys: smithi103.zjztqc 2024-09-18T21:15:01.318 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:01 smithi077 ceph-mon[92672]: overall HEALTH_OK 2024-09-18T21:15:01.319 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:01 smithi077 ceph-mon[92672]: from='mgr.14690 ' entity='' 2024-09-18T21:15:01.319 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:01 smithi077 ceph-mon[92672]: mgrmap e32: smithi077.utkpjg(active, since 38s), standbys: smithi103.zjztqc 2024-09-18T21:15:03.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:03.378+0000 7f90a59ac640 1 -- 172.21.15.77:0/1685467364 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90a00fdba0 msgr2=0x7f90a00fdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:03.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:03.378+0000 7f90a59ac640 1 --2- 172.21.15.77:0/1685467364 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90a00fdba0 0x7f90a00fdfb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f90900048d0 tx=0x7f9090009da0 comp rx=0 tx=0).stop 2024-09-18T21:15:03.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:03.378+0000 7f90a59ac640 1 -- 172.21.15.77:0/1685467364 shutdown_connections 2024-09-18T21:15:03.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:03.378+0000 7f90a59ac640 1 --2- 172.21.15.77:0/1685467364 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90a00fe4f0 0x7f90a00fa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:03.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:03.378+0000 7f90a59ac640 1 --2- 172.21.15.77:0/1685467364 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90a00fdba0 0x7f90a00fdfb0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:03.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:03.378+0000 7f90a59ac640 1 -- 172.21.15.77:0/1685467364 >> 172.21.15.77:0/1685467364 conn(0x7f90a00f63a0 msgr2=0x7f90a00f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:15:03.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:03.378+0000 7f90a59ac640 1 -- 172.21.15.77:0/1685467364 shutdown_connections 2024-09-18T21:15:03.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:03.378+0000 7f90a59ac640 1 -- 172.21.15.77:0/1685467364 wait complete. 2024-09-18T21:15:03.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:03.379+0000 7f90a59ac640 1 Processor -- start 2024-09-18T21:15:03.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:03.379+0000 7f90a59ac640 1 -- start start 2024-09-18T21:15:03.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:03.379+0000 7f90a59ac640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90a00fdba0 0x7f90a00fd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:15:03.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:03.379+0000 7f90a59ac640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90a00fe4f0 0x7f90a00fb880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:15:03.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:03.379+0000 7f90a59ac640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a00fbe10 con 0x7f90a00fdba0 2024-09-18T21:15:03.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:03.379+0000 7f90a59ac640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a00fbf50 con 0x7f90a00fe4f0 2024-09-18T21:15:03.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:03.379+0000 7f909effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90a00fdba0 0x7f90a00fd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:15:03.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:03.379+0000 7f909effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90a00fdba0 0x7f90a00fd390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45608/0 (socket says 172.21.15.77:45608) 2024-09-18T21:15:03.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:03.379+0000 7f909effd640 1 -- 172.21.15.77:0/623529433 learned_addr learned my addr 172.21.15.77:0/623529433 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:15:03.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:03.379+0000 7f909e7fc640 1 --2- 172.21.15.77:0/623529433 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90a00fe4f0 0x7f90a00fb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:15:03.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:03.380+0000 7f909effd640 1 -- 172.21.15.77:0/623529433 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90a00fe4f0 msgr2=0x7f90a00fb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:03.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:03.380+0000 7f909effd640 1 --2- 172.21.15.77:0/623529433 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90a00fe4f0 0x7f90a00fb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:03.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:03.380+0000 7f909effd640 1 -- 172.21.15.77:0/623529433 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9090005040 con 0x7f90a00fdba0 2024-09-18T21:15:03.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:03.380+0000 7f909e7fc640 1 --2- 172.21.15.77:0/623529433 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90a00fe4f0 0x7f90a00fb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T21:15:03.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:03.380+0000 7f909effd640 1 --2- 172.21.15.77:0/623529433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90a00fdba0 0x7f90a00fd390 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f90900048a0 tx=0x7f9090009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:15:03.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:03.380+0000 7f90877fe640 1 -- 172.21.15.77:0/623529433 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9090038070 con 0x7f90a00fdba0 2024-09-18T21:15:03.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:03.380+0000 7f90a59ac640 1 -- 172.21.15.77:0/623529433 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90a00fc1d0 con 0x7f90a00fdba0 2024-09-18T21:15:03.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:03.380+0000 7f90877fe640 1 -- 172.21.15.77:0/623529433 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9090004290 con 0x7f90a00fdba0 2024-09-18T21:15:03.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:03.380+0000 7f90877fe640 1 -- 172.21.15.77:0/623529433 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9090033660 con 0x7f90a00fdba0 2024-09-18T21:15:03.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:03.380+0000 7f90a59ac640 1 -- 172.21.15.77:0/623529433 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a01150e0 con 0x7f90a00fdba0 2024-09-18T21:15:03.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:03.381+0000 7f90a59ac640 1 -- 172.21.15.77:0/623529433 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90a00fa040 con 0x7f90a00fdba0 2024-09-18T21:15:03.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:03.383+0000 7f90877fe640 1 -- 172.21.15.77:0/623529433 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 32) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f9090030020 con 0x7f90a00fdba0 2024-09-18T21:15:03.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:03.383+0000 7f90877fe640 1 --2- 172.21.15.77:0/623529433 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7f908806e1e0 0x7f9088070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:15:03.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:03.383+0000 7f909e7fc640 1 -- 172.21.15.77:0/623529433 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7f908806e1e0 msgr2=0x7f9088070690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/3842438735 2024-09-18T21:15:03.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:03.383+0000 7f90877fe640 1 -- 172.21.15.77:0/623529433 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f90900adc30 con 0x7f90a00fdba0 2024-09-18T21:15:03.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:03.383+0000 7f909e7fc640 1 --2- 172.21.15.77:0/623529433 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7f908806e1e0 0x7f9088070690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-18T21:15:03.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:03.387+0000 7f90877fe640 1 -- 172.21.15.77:0/623529433 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f9090077180 con 0x7f90a00fdba0 2024-09-18T21:15:03.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:03.578+0000 7f90a59ac640 1 -- 172.21.15.77:0/623529433 --> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f90a0101d40 con 0x7f908806e1e0 2024-09-18T21:15:03.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:03.584+0000 7f909e7fc640 1 -- 172.21.15.77:0/623529433 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7f908806e1e0 msgr2=0x7f9088070690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/3842438735 2024-09-18T21:15:03.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:03.584+0000 7f909e7fc640 1 --2- 172.21.15.77:0/623529433 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7f908806e1e0 0x7f9088070690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-18T21:15:03.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:03.985+0000 7f909e7fc640 1 -- 172.21.15.77:0/623529433 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7f908806e1e0 msgr2=0x7f9088070690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/3842438735 2024-09-18T21:15:03.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:03.985+0000 7f909e7fc640 1 --2- 172.21.15.77:0/623529433 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7f908806e1e0 0x7f9088070690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-18T21:15:04.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:04.786+0000 7f909e7fc640 1 -- 172.21.15.77:0/623529433 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7f908806e1e0 msgr2=0x7f9088070690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/3842438735 2024-09-18T21:15:04.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:04.786+0000 7f909e7fc640 1 --2- 172.21.15.77:0/623529433 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7f908806e1e0 0x7f9088070690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-18T21:15:05.769 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:05.766+0000 7f90877fe640 1 -- 172.21.15.77:0/623529433 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mgrmap(e 33) v1 ==== 91828+0+0 (secure 0 0 0) 0x7f909002c2a0 con 0x7f90a00fdba0 2024-09-18T21:15:05.769 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:05.767+0000 7f90877fe640 1 -- 172.21.15.77:0/623529433 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7f908806e1e0 msgr2=0x7f9088070690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-18T21:15:05.769 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:05.767+0000 7f90877fe640 1 --2- 172.21.15.77:0/623529433 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7f908806e1e0 0x7f9088070690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:06.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:05 smithi103 ceph-mon[34827]: Standby manager daemon smithi103.zjztqc restarted 2024-09-18T21:15:06.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:05 smithi103 ceph-mon[34827]: Standby manager daemon smithi103.zjztqc started 2024-09-18T21:15:06.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:05 smithi103 ceph-mon[34827]: from='mgr.? 172.21.15.103:0/2212144345' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi103.zjztqc/crt"}]: dispatch 2024-09-18T21:15:06.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:05 smithi103 ceph-mon[34827]: from='mgr.? 172.21.15.103:0/2212144345' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T21:15:06.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:05 smithi103 ceph-mon[34827]: from='mgr.? 172.21.15.103:0/2212144345' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi103.zjztqc/key"}]: dispatch 2024-09-18T21:15:06.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:05 smithi103 ceph-mon[34827]: from='mgr.? 172.21.15.103:0/2212144345' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T21:15:06.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:05 smithi103 ceph-mon[34827]: Active manager daemon smithi077.utkpjg restarted 2024-09-18T21:15:06.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:05 smithi103 ceph-mon[34827]: Activating manager daemon smithi077.utkpjg 2024-09-18T21:15:06.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:05 smithi103 ceph-mon[34827]: osdmap e46: 6 total, 6 up, 6 in 2024-09-18T21:15:06.053 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:05 smithi077 ceph-mon[92672]: Standby manager daemon smithi103.zjztqc restarted 2024-09-18T21:15:06.053 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:05 smithi077 ceph-mon[92672]: Standby manager daemon smithi103.zjztqc started 2024-09-18T21:15:06.054 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:05 smithi077 ceph-mon[92672]: from='mgr.? 172.21.15.103:0/2212144345' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi103.zjztqc/crt"}]: dispatch 2024-09-18T21:15:06.054 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:05 smithi077 ceph-mon[92672]: from='mgr.? 172.21.15.103:0/2212144345' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-18T21:15:06.054 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:05 smithi077 ceph-mon[92672]: from='mgr.? 172.21.15.103:0/2212144345' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi103.zjztqc/key"}]: dispatch 2024-09-18T21:15:06.054 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:05 smithi077 ceph-mon[92672]: from='mgr.? 172.21.15.103:0/2212144345' entity='mgr.smithi103.zjztqc' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-18T21:15:06.054 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:05 smithi077 ceph-mon[92672]: Active manager daemon smithi077.utkpjg restarted 2024-09-18T21:15:06.054 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:05 smithi077 ceph-mon[92672]: Activating manager daemon smithi077.utkpjg 2024-09-18T21:15:06.054 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:05 smithi077 ceph-mon[92672]: osdmap e46: 6 total, 6 up, 6 in 2024-09-18T21:15:06.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.780+0000 7f90877fe640 1 -- 172.21.15.77:0/623529433 <== mon.0 v2:172.21.15.77:3300/0 8 ==== mgrmap(e 34) v1 ==== 91955+0+0 (secure 0 0 0) 0x7f90900ac030 con 0x7f90a00fdba0 2024-09-18T21:15:06.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.780+0000 7f90877fe640 1 --2- 172.21.15.77:0/623529433 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f9088036b00 0x7f9088077d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:15:06.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.780+0000 7f90877fe640 1 -- 172.21.15.77:0/623529433 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f90a0101d40 con 0x7f9088036b00 2024-09-18T21:15:06.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.782+0000 7f909e7fc640 1 --2- 172.21.15.77:0/623529433 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f9088036b00 0x7f9088077d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:15:06.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.782+0000 7f909e7fc640 1 --2- 172.21.15.77:0/623529433 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f9088036b00 0x7f9088077d20 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f9094005010 tx=0x7f909400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:15:06.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.785+0000 7f90877fe640 1 -- 172.21.15.77:0/623529433 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f90a0101d40 con 0x7f9088036b00 2024-09-18T21:15:06.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.788+0000 7f90a59ac640 1 -- 172.21.15.77:0/623529433 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f9088036b00 msgr2=0x7f9088077d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:06.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.788+0000 7f90a59ac640 1 --2- 172.21.15.77:0/623529433 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f9088036b00 0x7f9088077d20 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f9094005010 tx=0x7f909400b040 comp rx=0 tx=0).stop 2024-09-18T21:15:06.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.788+0000 7f90a59ac640 1 -- 172.21.15.77:0/623529433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90a00fdba0 msgr2=0x7f90a00fd390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:06.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.788+0000 7f90a59ac640 1 --2- 172.21.15.77:0/623529433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90a00fdba0 0x7f90a00fd390 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f90900048a0 tx=0x7f9090009da0 comp rx=0 tx=0).stop 2024-09-18T21:15:06.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.788+0000 7f90a59ac640 1 -- 172.21.15.77:0/623529433 shutdown_connections 2024-09-18T21:15:06.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.788+0000 7f90a59ac640 1 --2- 172.21.15.77:0/623529433 >> [v2:172.21.15.77:6800/3842438735,v1:172.21.15.77:6801/3842438735] conn(0x7f908806e1e0 0x7f9088070690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:06.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.788+0000 7f90a59ac640 1 --2- 172.21.15.77:0/623529433 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f9088036b00 0x7f9088077d20 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:06.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.788+0000 7f90a59ac640 1 --2- 172.21.15.77:0/623529433 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f90a00fe4f0 0x7f90a00fb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:06.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.788+0000 7f90a59ac640 1 --2- 172.21.15.77:0/623529433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90a00fdba0 0x7f90a00fd390 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:06.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.788+0000 7f90a59ac640 1 -- 172.21.15.77:0/623529433 >> 172.21.15.77:0/623529433 conn(0x7f90a00f63a0 msgr2=0x7f90a00f7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:15:06.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.788+0000 7f90a59ac640 1 -- 172.21.15.77:0/623529433 shutdown_connections 2024-09-18T21:15:06.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.788+0000 7f90a59ac640 1 -- 172.21.15.77:0/623529433 wait complete. 2024-09-18T21:15:06.799 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-09-18T21:15:06.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.871+0000 7fcdd06aa640 1 -- 172.21.15.77:0/444597794 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdc80fc700 msgr2=0x7fcdc80fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:06.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.871+0000 7fcdd06aa640 1 --2- 172.21.15.77:0/444597794 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdc80fc700 0x7fcdc80fcb70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcdb80048d0 tx=0x7fcdb8009da0 comp rx=0 tx=0).stop 2024-09-18T21:15:06.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.872+0000 7fcdd06aa640 1 -- 172.21.15.77:0/444597794 shutdown_connections 2024-09-18T21:15:06.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.872+0000 7fcdd06aa640 1 --2- 172.21.15.77:0/444597794 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdc80fc700 0x7fcdc80fcb70 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:06.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.872+0000 7fcdd06aa640 1 --2- 172.21.15.77:0/444597794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcdc80fb430 0x7fcdc80fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:06.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.872+0000 7fcdd06aa640 1 -- 172.21.15.77:0/444597794 >> 172.21.15.77:0/444597794 conn(0x7fcdc80f6c10 msgr2=0x7fcdc80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:15:06.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.872+0000 7fcdd06aa640 1 -- 172.21.15.77:0/444597794 shutdown_connections 2024-09-18T21:15:06.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.872+0000 7fcdd06aa640 1 -- 172.21.15.77:0/444597794 wait complete. 2024-09-18T21:15:06.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.872+0000 7fcdd06aa640 1 Processor -- start 2024-09-18T21:15:06.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.872+0000 7fcdd06aa640 1 -- start start 2024-09-18T21:15:06.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.872+0000 7fcdd06aa640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdc80fb430 0x7fcdc810d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:15:06.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.872+0000 7fcdd06aa640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcdc80fc700 0x7fcdc810d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:15:06.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.872+0000 7fcdd06aa640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc810dbd0 con 0x7fcdc80fb430 2024-09-18T21:15:06.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.872+0000 7fcdd06aa640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc810e3f0 con 0x7fcdc80fc700 2024-09-18T21:15:06.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.873+0000 7fcdce446640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdc80fb430 0x7fcdc810d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:15:06.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.873+0000 7fcdce446640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdc80fb430 0x7fcdc810d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45718/0 (socket says 172.21.15.77:45718) 2024-09-18T21:15:06.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.873+0000 7fcdce446640 1 -- 172.21.15.77:0/3874267735 learned_addr learned my addr 172.21.15.77:0/3874267735 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:15:06.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.873+0000 7fcdce446640 1 -- 172.21.15.77:0/3874267735 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcdc80fc700 msgr2=0x7fcdc810d580 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-18T21:15:06.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.873+0000 7fcdce446640 1 --2- 172.21.15.77:0/3874267735 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcdc80fc700 0x7fcdc810d580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:06.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.873+0000 7fcdce446640 1 -- 172.21.15.77:0/3874267735 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb8005040 con 0x7fcdc80fb430 2024-09-18T21:15:06.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.873+0000 7fcdce446640 1 --2- 172.21.15.77:0/3874267735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdc80fb430 0x7fcdc810d040 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4002a50 tx=0x7fcdc4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:15:06.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.873+0000 7fcdbeffd640 1 -- 172.21.15.77:0/3874267735 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdc4007c30 con 0x7fcdc80fb430 2024-09-18T21:15:06.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.873+0000 7fcdd06aa640 1 -- 172.21.15.77:0/3874267735 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdc810e680 con 0x7fcdc80fb430 2024-09-18T21:15:06.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.873+0000 7fcdd06aa640 1 -- 172.21.15.77:0/3874267735 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdc810ec20 con 0x7fcdc80fb430 2024-09-18T21:15:06.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.874+0000 7fcdbeffd640 1 -- 172.21.15.77:0/3874267735 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcdc400f040 con 0x7fcdc80fb430 2024-09-18T21:15:06.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.874+0000 7fcdbeffd640 1 -- 172.21.15.77:0/3874267735 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdc400db50 con 0x7fcdc80fb430 2024-09-18T21:15:06.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.875+0000 7fcdd06aa640 1 -- 172.21.15.77:0/3874267735 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdac005240 con 0x7fcdc80fb430 2024-09-18T21:15:06.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.875+0000 7fcdbeffd640 1 -- 172.21.15.77:0/3874267735 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 34) v1 ==== 91955+0+0 (secure 0 0 0) 0x7fcdc4009700 con 0x7fcdc80fb430 2024-09-18T21:15:06.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.876+0000 7fcdbeffd640 1 --2- 172.21.15.77:0/3874267735 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fcdb406ddc0 0x7fcdb4070270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:15:06.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.876+0000 7fcdbeffd640 1 -- 172.21.15.77:0/3874267735 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fcdc408d4f0 con 0x7fcdc80fb430 2024-09-18T21:15:06.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.876+0000 7fcdcdc45640 1 --2- 172.21.15.77:0/3874267735 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fcdb406ddc0 0x7fcdb4070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:15:06.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.876+0000 7fcdcdc45640 1 --2- 172.21.15.77:0/3874267735 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fcdb406ddc0 0x7fcdb4070270 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcdb802a530 tx=0x7fcdb8009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:15:06.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:06.881+0000 7fcdbeffd640 1 -- 172.21.15.77:0/3874267735 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fcdc4056ba0 con 0x7fcdc80fb430 2024-09-18T21:15:07.058 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:06 smithi077 ceph-mon[92672]: mgrmap e33: smithi077.utkpjg(active, starting, since 0.00587851s), standbys: smithi103.zjztqc 2024-09-18T21:15:07.059 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:06 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mon metadata", "id": "smithi077"}]: dispatch 2024-09-18T21:15:07.059 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:06 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mon metadata", "id": "smithi103"}]: dispatch 2024-09-18T21:15:07.059 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:06 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.vruydi"}]: dispatch 2024-09-18T21:15:07.059 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:06 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.cqfhlw"}]: dispatch 2024-09-18T21:15:07.059 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:06 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi103.zhdmdg"}]: dispatch 2024-09-18T21:15:07.059 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:06 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi103.opftmf"}]: dispatch 2024-09-18T21:15:07.059 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:06 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mgr metadata", "who": "smithi077.utkpjg", "id": "smithi077.utkpjg"}]: dispatch 2024-09-18T21:15:07.059 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:06 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mgr metadata", "who": "smithi103.zjztqc", "id": "smithi103.zjztqc"}]: dispatch 2024-09-18T21:15:07.059 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:06 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T21:15:07.059 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:06 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T21:15:07.059 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:06 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T21:15:07.059 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:06 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T21:15:07.059 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:06 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T21:15:07.060 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:06 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T21:15:07.060 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:06 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-18T21:15:07.060 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:06 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-18T21:15:07.060 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:06 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-18T21:15:07.060 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:06 smithi077 ceph-mon[92672]: Manager daemon smithi077.utkpjg is now available 2024-09-18T21:15:07.060 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:06 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:15:07.060 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:06 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:15:07.060 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:06 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi077.utkpjg/mirror_snapshot_schedule"}]: dispatch 2024-09-18T21:15:07.060 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:06 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi077.utkpjg/trash_purge_schedule"}]: dispatch 2024-09-18T21:15:07.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.069+0000 7fcdd06aa640 1 -- 172.21.15.77:0/3874267735 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcdac000bf0 con 0x7fcdb406ddc0 2024-09-18T21:15:07.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.070+0000 7fcdbeffd640 1 -- 172.21.15.77:0/3874267735 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fcdac000bf0 con 0x7fcdb406ddc0 2024-09-18T21:15:07.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.072+0000 7fcdd06aa640 1 -- 172.21.15.77:0/3874267735 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fcdb406ddc0 msgr2=0x7fcdb4070270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:07.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.072+0000 7fcdd06aa640 1 --2- 172.21.15.77:0/3874267735 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fcdb406ddc0 0x7fcdb4070270 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcdb802a530 tx=0x7fcdb8009da0 comp rx=0 tx=0).stop 2024-09-18T21:15:07.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.073+0000 7fcdd06aa640 1 -- 172.21.15.77:0/3874267735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdc80fb430 msgr2=0x7fcdc810d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:07.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.073+0000 7fcdd06aa640 1 --2- 172.21.15.77:0/3874267735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdc80fb430 0x7fcdc810d040 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4002a50 tx=0x7fcdc4004600 comp rx=0 tx=0).stop 2024-09-18T21:15:07.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.073+0000 7fcdd06aa640 1 -- 172.21.15.77:0/3874267735 shutdown_connections 2024-09-18T21:15:07.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.073+0000 7fcdd06aa640 1 --2- 172.21.15.77:0/3874267735 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fcdb406ddc0 0x7fcdb4070270 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:07.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.073+0000 7fcdd06aa640 1 --2- 172.21.15.77:0/3874267735 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcdc80fc700 0x7fcdc810d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:07.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.073+0000 7fcdd06aa640 1 --2- 172.21.15.77:0/3874267735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcdc80fb430 0x7fcdc810d040 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:07.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.073+0000 7fcdd06aa640 1 -- 172.21.15.77:0/3874267735 >> 172.21.15.77:0/3874267735 conn(0x7fcdc80f6c10 msgr2=0x7fcdc80655e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:15:07.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.073+0000 7fcdd06aa640 1 -- 172.21.15.77:0/3874267735 shutdown_connections 2024-09-18T21:15:07.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.073+0000 7fcdd06aa640 1 -- 172.21.15.77:0/3874267735 wait complete. 2024-09-18T21:15:07.105 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:06 smithi103 ceph-mon[34827]: mgrmap e33: smithi077.utkpjg(active, starting, since 0.00587851s), standbys: smithi103.zjztqc 2024-09-18T21:15:07.105 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:06 smithi103 ceph-mon[34827]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mon metadata", "id": "smithi077"}]: dispatch 2024-09-18T21:15:07.105 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:06 smithi103 ceph-mon[34827]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mon metadata", "id": "smithi103"}]: dispatch 2024-09-18T21:15:07.105 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:06 smithi103 ceph-mon[34827]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.vruydi"}]: dispatch 2024-09-18T21:15:07.105 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:06 smithi103 ceph-mon[34827]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.cqfhlw"}]: dispatch 2024-09-18T21:15:07.105 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:06 smithi103 ceph-mon[34827]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi103.zhdmdg"}]: dispatch 2024-09-18T21:15:07.105 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:06 smithi103 ceph-mon[34827]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi103.opftmf"}]: dispatch 2024-09-18T21:15:07.105 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:06 smithi103 ceph-mon[34827]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mgr metadata", "who": "smithi077.utkpjg", "id": "smithi077.utkpjg"}]: dispatch 2024-09-18T21:15:07.106 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:06 smithi103 ceph-mon[34827]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mgr metadata", "who": "smithi103.zjztqc", "id": "smithi103.zjztqc"}]: dispatch 2024-09-18T21:15:07.106 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:06 smithi103 ceph-mon[34827]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T21:15:07.106 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:06 smithi103 ceph-mon[34827]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T21:15:07.106 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:06 smithi103 ceph-mon[34827]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T21:15:07.106 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:06 smithi103 ceph-mon[34827]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T21:15:07.106 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:06 smithi103 ceph-mon[34827]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T21:15:07.106 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:06 smithi103 ceph-mon[34827]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T21:15:07.106 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:06 smithi103 ceph-mon[34827]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-18T21:15:07.106 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:06 smithi103 ceph-mon[34827]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-18T21:15:07.106 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:06 smithi103 ceph-mon[34827]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-18T21:15:07.106 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:06 smithi103 ceph-mon[34827]: Manager daemon smithi077.utkpjg is now available 2024-09-18T21:15:07.106 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:06 smithi103 ceph-mon[34827]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:15:07.106 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:06 smithi103 ceph-mon[34827]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:15:07.106 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:06 smithi103 ceph-mon[34827]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi077.utkpjg/mirror_snapshot_schedule"}]: dispatch 2024-09-18T21:15:07.107 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:06 smithi103 ceph-mon[34827]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi077.utkpjg/trash_purge_schedule"}]: dispatch 2024-09-18T21:15:07.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.151+0000 7f5a40e6b640 1 -- 172.21.15.77:0/3326925127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a3c0fd820 msgr2=0x7f5a3c0fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:07.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.151+0000 7f5a40e6b640 1 --2- 172.21.15.77:0/3326925127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a3c0fd820 0x7f5a3c0fdc90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5a240048d0 tx=0x7f5a24009da0 comp rx=0 tx=0).stop 2024-09-18T21:15:07.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.151+0000 7f5a40e6b640 1 -- 172.21.15.77:0/3326925127 shutdown_connections 2024-09-18T21:15:07.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.151+0000 7f5a40e6b640 1 --2- 172.21.15.77:0/3326925127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a3c0fd820 0x7f5a3c0fdc90 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:07.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.151+0000 7f5a40e6b640 1 --2- 172.21.15.77:0/3326925127 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a3c0fc550 0x7f5a3c0fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:07.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.151+0000 7f5a40e6b640 1 -- 172.21.15.77:0/3326925127 >> 172.21.15.77:0/3326925127 conn(0x7f5a3c0f7d30 msgr2=0x7f5a3c0fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:15:07.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.151+0000 7f5a40e6b640 1 -- 172.21.15.77:0/3326925127 shutdown_connections 2024-09-18T21:15:07.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.151+0000 7f5a40e6b640 1 -- 172.21.15.77:0/3326925127 wait complete. 2024-09-18T21:15:07.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.152+0000 7f5a40e6b640 1 Processor -- start 2024-09-18T21:15:07.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.152+0000 7f5a40e6b640 1 -- start start 2024-09-18T21:15:07.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.152+0000 7f5a40e6b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a3c0fc550 0x7f5a3c10d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:15:07.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.152+0000 7f5a40e6b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a3c0fd820 0x7f5a3c10d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:15:07.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.152+0000 7f5a40e6b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3c10dc40 con 0x7f5a3c0fc550 2024-09-18T21:15:07.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.152+0000 7f5a40e6b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3c10e460 con 0x7f5a3c0fd820 2024-09-18T21:15:07.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.152+0000 7f5a3a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a3c0fc550 0x7f5a3c10d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:15:07.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.152+0000 7f5a3a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a3c0fc550 0x7f5a3c10d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45740/0 (socket says 172.21.15.77:45740) 2024-09-18T21:15:07.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.152+0000 7f5a3a59c640 1 -- 172.21.15.77:0/1037590130 learned_addr learned my addr 172.21.15.77:0/1037590130 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:15:07.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.152+0000 7f5a33fff640 1 --2- 172.21.15.77:0/1037590130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a3c0fd820 0x7f5a3c10d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:15:07.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.152+0000 7f5a3a59c640 1 -- 172.21.15.77:0/1037590130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a3c0fd820 msgr2=0x7f5a3c10d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:07.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.152+0000 7f5a3a59c640 1 --2- 172.21.15.77:0/1037590130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a3c0fd820 0x7f5a3c10d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:07.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.152+0000 7f5a3a59c640 1 -- 172.21.15.77:0/1037590130 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a24005040 con 0x7f5a3c0fc550 2024-09-18T21:15:07.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.152+0000 7f5a3a59c640 1 --2- 172.21.15.77:0/1037590130 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a3c0fc550 0x7f5a3c10d0b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c002a50 tx=0x7f5a2c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:15:07.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.153+0000 7f5a32ffd640 1 -- 172.21.15.77:0/1037590130 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a2c007c30 con 0x7f5a3c0fc550 2024-09-18T21:15:07.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.153+0000 7f5a40e6b640 1 -- 172.21.15.77:0/1037590130 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a3c10e6f0 con 0x7f5a3c0fc550 2024-09-18T21:15:07.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.153+0000 7f5a40e6b640 1 -- 172.21.15.77:0/1037590130 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a3c10ec90 con 0x7f5a3c0fc550 2024-09-18T21:15:07.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.153+0000 7f5a32ffd640 1 -- 172.21.15.77:0/1037590130 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5a2c00f040 con 0x7f5a3c0fc550 2024-09-18T21:15:07.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.153+0000 7f5a32ffd640 1 -- 172.21.15.77:0/1037590130 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a2c00d930 con 0x7f5a3c0fc550 2024-09-18T21:15:07.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.154+0000 7f5a40e6b640 1 -- 172.21.15.77:0/1037590130 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a1c005240 con 0x7f5a3c0fc550 2024-09-18T21:15:07.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.154+0000 7f5a32ffd640 1 -- 172.21.15.77:0/1037590130 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 34) v1 ==== 91955+0+0 (secure 0 0 0) 0x7f5a2c00dba0 con 0x7f5a3c0fc550 2024-09-18T21:15:07.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.154+0000 7f5a32ffd640 1 --2- 172.21.15.77:0/1037590130 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f5a2806ddb0 0x7f5a28070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:15:07.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.155+0000 7f5a32ffd640 1 -- 172.21.15.77:0/1037590130 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f5a2c08cdc0 con 0x7f5a3c0fc550 2024-09-18T21:15:07.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.155+0000 7f5a33fff640 1 --2- 172.21.15.77:0/1037590130 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f5a2806ddb0 0x7f5a28070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:15:07.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.155+0000 7f5a33fff640 1 --2- 172.21.15.77:0/1037590130 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f5a2806ddb0 0x7f5a28070260 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c10ce60 tx=0x7f5a24035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:15:07.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.159+0000 7f5a32ffd640 1 -- 172.21.15.77:0/1037590130 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f5a2c0564a0 con 0x7f5a3c0fc550 2024-09-18T21:15:07.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.347+0000 7f5a40e6b640 1 -- 172.21.15.77:0/1037590130 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5a1c000bf0 con 0x7f5a2806ddb0 2024-09-18T21:15:07.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.357+0000 7f5a32ffd640 1 -- 172.21.15.77:0/1037590130 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f5a1c000bf0 con 0x7f5a2806ddb0 2024-09-18T21:15:07.359 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T21:15:07.359 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager.smithi077 smithi077 *:9093,9094 running (109s) 16s ago 9m 16.6M - 0.25.0 c8568f914cd2 b201d325a55b 2024-09-18T21:15:07.359 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi077 smithi077 running (10m) 16s ago 10m 6899k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 0beb64a8c2ea 2024-09-18T21:15:07.359 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi103 smithi103 running (9m) 20s ago 9m 6891k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 04981ca7bf34 2024-09-18T21:15:07.359 INFO:teuthology.orchestra.run.smithi077.stdout:grafana.smithi077 smithi077 *:3000 running (104s) 16s ago 9m 80.1M - 9.4.7 954c08fa6188 d06ef3ab9e66 2024-09-18T21:15:07.359 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.cqfhlw smithi077 running (4m) 16s ago 4m 13.7M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 a7ec3b7701b6 2024-09-18T21:15:07.359 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.vruydi smithi077 running (4m) 16s ago 4m 142M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 affbba097d3b 2024-09-18T21:15:07.360 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi103.opftmf smithi103 running (4m) 20s ago 4m 15.8M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 111f884c5a34 2024-09-18T21:15:07.360 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi103.zhdmdg smithi103 running (4m) 20s ago 4m 15.1M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 50b77d0edda5 2024-09-18T21:15:07.360 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi077.utkpjg smithi077 *:8443,9283,8765 running (74s) 16s ago 11m 490M - 19.1.1-17-g06b1b1de f79f744f586d 99d4b0fd70f6 2024-09-18T21:15:07.360 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi103.zjztqc smithi103 *:8443,9283,8765 running (23s) 20s ago 9m 66.8M - 19.1.1-17-g06b1b1de f79f744f586d 54589547c4d7 2024-09-18T21:15:07.360 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi077 smithi077 running (11m) 16s ago 11m 55.1M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bcbf289fe027 2024-09-18T21:15:07.360 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi103 smithi103 running (9m) 20s ago 8m 44.0M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 d6ae2062e5e3 2024-09-18T21:15:07.360 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi077 smithi077 *:9100 running (116s) 16s ago 9m 8232k - 1.5.0 0da6a335fe13 99144245c1af 2024-09-18T21:15:07.360 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi103 smithi103 *:9100 running (96s) 20s ago 9m 16.2M - 1.5.0 0da6a335fe13 e5b51144d997 2024-09-18T21:15:07.360 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (8m) 16s ago 8m 223M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 2e3563c32cf5 2024-09-18T21:15:07.360 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi077 running (7m) 16s ago 7m 235M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 39c2ccbb7603 2024-09-18T21:15:07.360 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi077 running (7m) 16s ago 7m 199M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 2ff2728057e2 2024-09-18T21:15:07.360 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi103 running (7m) 20s ago 7m 276M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 0e72b1bbb8ce 2024-09-18T21:15:07.360 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi103 running (6m) 20s ago 6m 243M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 85f1ce1e8bee 2024-09-18T21:15:07.361 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi103 running (6m) 20s ago 6m 226M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 cf8964b3ac6d 2024-09-18T21:15:07.361 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus.smithi077 smithi077 *:9095 running (28s) 16s ago 9m 44.2M - 2.43.0 a07b618ecd1d 41f3729e3400 2024-09-18T21:15:07.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.359+0000 7f5a40e6b640 1 -- 172.21.15.77:0/1037590130 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f5a2806ddb0 msgr2=0x7f5a28070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:07.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.359+0000 7f5a40e6b640 1 --2- 172.21.15.77:0/1037590130 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f5a2806ddb0 0x7f5a28070260 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c10ce60 tx=0x7f5a24035040 comp rx=0 tx=0).stop 2024-09-18T21:15:07.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.359+0000 7f5a40e6b640 1 -- 172.21.15.77:0/1037590130 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a3c0fc550 msgr2=0x7f5a3c10d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:07.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.359+0000 7f5a40e6b640 1 --2- 172.21.15.77:0/1037590130 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a3c0fc550 0x7f5a3c10d0b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c002a50 tx=0x7f5a2c004600 comp rx=0 tx=0).stop 2024-09-18T21:15:07.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.360+0000 7f5a40e6b640 1 -- 172.21.15.77:0/1037590130 shutdown_connections 2024-09-18T21:15:07.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.360+0000 7f5a40e6b640 1 --2- 172.21.15.77:0/1037590130 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f5a2806ddb0 0x7f5a28070260 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:07.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.360+0000 7f5a40e6b640 1 --2- 172.21.15.77:0/1037590130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a3c0fd820 0x7f5a3c10d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:07.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.360+0000 7f5a40e6b640 1 --2- 172.21.15.77:0/1037590130 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a3c0fc550 0x7f5a3c10d0b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:07.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.360+0000 7f5a40e6b640 1 -- 172.21.15.77:0/1037590130 >> 172.21.15.77:0/1037590130 conn(0x7f5a3c0f7d30 msgr2=0x7f5a3c0f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:15:07.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.360+0000 7f5a40e6b640 1 -- 172.21.15.77:0/1037590130 shutdown_connections 2024-09-18T21:15:07.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.360+0000 7f5a40e6b640 1 -- 172.21.15.77:0/1037590130 wait complete. 2024-09-18T21:15:07.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.442+0000 7f406e42e640 1 -- 172.21.15.77:0/2703145693 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40680fc520 msgr2=0x7f40680fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:07.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.442+0000 7f406e42e640 1 --2- 172.21.15.77:0/2703145693 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40680fc520 0x7f40680fc930 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f40580048d0 tx=0x7f4058009da0 comp rx=0 tx=0).stop 2024-09-18T21:15:07.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.443+0000 7f406e42e640 1 -- 172.21.15.77:0/2703145693 shutdown_connections 2024-09-18T21:15:07.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.443+0000 7f406e42e640 1 --2- 172.21.15.77:0/2703145693 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40680fd7f0 0x7f40680fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:07.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.443+0000 7f406e42e640 1 --2- 172.21.15.77:0/2703145693 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40680fc520 0x7f40680fc930 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:07.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.443+0000 7f406e42e640 1 -- 172.21.15.77:0/2703145693 >> 172.21.15.77:0/2703145693 conn(0x7f40680f7ce0 msgr2=0x7f40680fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:15:07.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.443+0000 7f406e42e640 1 -- 172.21.15.77:0/2703145693 shutdown_connections 2024-09-18T21:15:07.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.443+0000 7f406e42e640 1 -- 172.21.15.77:0/2703145693 wait complete. 2024-09-18T21:15:07.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.443+0000 7f406e42e640 1 Processor -- start 2024-09-18T21:15:07.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.443+0000 7f406e42e640 1 -- start start 2024-09-18T21:15:07.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.444+0000 7f406e42e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40680fc520 0x7f406810d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:15:07.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.444+0000 7f406e42e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40680fd7f0 0x7f406810d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:15:07.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.444+0000 7f406e42e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406810dc10 con 0x7f40680fc520 2024-09-18T21:15:07.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.444+0000 7f406e42e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406810e430 con 0x7f40680fd7f0 2024-09-18T21:15:07.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.444+0000 7f4067fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40680fc520 0x7f406810d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:15:07.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.444+0000 7f4067fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40680fc520 0x7f406810d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45764/0 (socket says 172.21.15.77:45764) 2024-09-18T21:15:07.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.444+0000 7f4067fff640 1 -- 172.21.15.77:0/972473021 learned_addr learned my addr 172.21.15.77:0/972473021 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:15:07.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.444+0000 7f40677fe640 1 --2- 172.21.15.77:0/972473021 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40680fd7f0 0x7f406810d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:15:07.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.444+0000 7f4067fff640 1 -- 172.21.15.77:0/972473021 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40680fd7f0 msgr2=0x7f406810d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:07.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.444+0000 7f4067fff640 1 --2- 172.21.15.77:0/972473021 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40680fd7f0 0x7f406810d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:07.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.444+0000 7f4067fff640 1 -- 172.21.15.77:0/972473021 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4058005040 con 0x7f40680fc520 2024-09-18T21:15:07.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.444+0000 7f4067fff640 1 --2- 172.21.15.77:0/972473021 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40680fc520 0x7f406810d080 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4058003080 tx=0x7f4058009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:15:07.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.444+0000 7f4064ff9640 1 -- 172.21.15.77:0/972473021 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4058038070 con 0x7f40680fc520 2024-09-18T21:15:07.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.445+0000 7f4064ff9640 1 -- 172.21.15.77:0/972473021 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f405802abd0 con 0x7f40680fc520 2024-09-18T21:15:07.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.445+0000 7f4064ff9640 1 -- 172.21.15.77:0/972473021 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f405803e670 con 0x7f40680fc520 2024-09-18T21:15:07.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.445+0000 7f406e42e640 1 -- 172.21.15.77:0/972473021 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f406810e660 con 0x7f40680fc520 2024-09-18T21:15:07.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.445+0000 7f406e42e640 1 -- 172.21.15.77:0/972473021 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f406810ec00 con 0x7f40680fc520 2024-09-18T21:15:07.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.446+0000 7f406e42e640 1 -- 172.21.15.77:0/972473021 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40680fb980 con 0x7f40680fc520 2024-09-18T21:15:07.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.446+0000 7f4064ff9640 1 -- 172.21.15.77:0/972473021 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 34) v1 ==== 91955+0+0 (secure 0 0 0) 0x7f4058030020 con 0x7f40680fc520 2024-09-18T21:15:07.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.447+0000 7f4064ff9640 1 --2- 172.21.15.77:0/972473021 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f405006ddc0 0x7f4050070270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:15:07.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.447+0000 7f4064ff9640 1 -- 172.21.15.77:0/972473021 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f40580adaa0 con 0x7f40680fc520 2024-09-18T21:15:07.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.447+0000 7f40677fe640 1 --2- 172.21.15.77:0/972473021 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f405006ddc0 0x7f4050070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:15:07.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.447+0000 7f40677fe640 1 --2- 172.21.15.77:0/972473021 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f405006ddc0 0x7f4050070270 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f406810ce30 tx=0x7f405c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:15:07.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.453+0000 7f4064ff9640 1 -- 172.21.15.77:0/972473021 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f40580770d0 con 0x7f40680fc520 2024-09-18T21:15:07.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.690+0000 7f406e42e640 1 -- 172.21.15.77:0/972473021 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f406810ef10 con 0x7f40680fc520 2024-09-18T21:15:07.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.691+0000 7f4064ff9640 1 -- 172.21.15.77:0/972473021 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7f405807a790 con 0x7f40680fc520 2024-09-18T21:15:07.693 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-18T21:15:07.693 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": { 2024-09-18T21:15:07.693 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 1, 2024-09-18T21:15:07.693 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 1 2024-09-18T21:15:07.693 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:15:07.693 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": { 2024-09-18T21:15:07.693 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 2 2024-09-18T21:15:07.693 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:15:07.693 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": { 2024-09-18T21:15:07.693 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 6 2024-09-18T21:15:07.693 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:15:07.694 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-09-18T21:15:07.694 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4 2024-09-18T21:15:07.694 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:15:07.694 INFO:teuthology.orchestra.run.smithi077.stdout: "overall": { 2024-09-18T21:15:07.694 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 11, 2024-09-18T21:15:07.694 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 3 2024-09-18T21:15:07.694 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-18T21:15:07.694 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-18T21:15:07.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.693+0000 7f406e42e640 1 -- 172.21.15.77:0/972473021 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f405006ddc0 msgr2=0x7f4050070270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:07.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.693+0000 7f406e42e640 1 --2- 172.21.15.77:0/972473021 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f405006ddc0 0x7f4050070270 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f406810ce30 tx=0x7f405c009040 comp rx=0 tx=0).stop 2024-09-18T21:15:07.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.693+0000 7f406e42e640 1 -- 172.21.15.77:0/972473021 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40680fc520 msgr2=0x7f406810d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:07.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.693+0000 7f406e42e640 1 --2- 172.21.15.77:0/972473021 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40680fc520 0x7f406810d080 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4058003080 tx=0x7f4058009da0 comp rx=0 tx=0).stop 2024-09-18T21:15:07.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.693+0000 7f406e42e640 1 -- 172.21.15.77:0/972473021 shutdown_connections 2024-09-18T21:15:07.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.693+0000 7f406e42e640 1 --2- 172.21.15.77:0/972473021 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f405006ddc0 0x7f4050070270 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:07.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.693+0000 7f406e42e640 1 --2- 172.21.15.77:0/972473021 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f40680fd7f0 0x7f406810d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:07.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.693+0000 7f406e42e640 1 --2- 172.21.15.77:0/972473021 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f40680fc520 0x7f406810d080 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:07.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.693+0000 7f406e42e640 1 -- 172.21.15.77:0/972473021 >> 172.21.15.77:0/972473021 conn(0x7f40680f7ce0 msgr2=0x7f40680f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:15:07.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.693+0000 7f406e42e640 1 -- 172.21.15.77:0/972473021 shutdown_connections 2024-09-18T21:15:07.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.693+0000 7f406e42e640 1 -- 172.21.15.77:0/972473021 wait complete. 2024-09-18T21:15:07.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.774+0000 7fc651128640 1 -- 172.21.15.77:0/4065685934 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc64c0fb440 msgr2=0x7fc64c0fb850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:07.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.774+0000 7fc651128640 1 --2- 172.21.15.77:0/4065685934 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc64c0fb440 0x7fc64c0fb850 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc63c0048d0 tx=0x7fc63c009da0 comp rx=0 tx=0).stop 2024-09-18T21:15:07.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.774+0000 7fc651128640 1 -- 172.21.15.77:0/4065685934 shutdown_connections 2024-09-18T21:15:07.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.774+0000 7fc651128640 1 --2- 172.21.15.77:0/4065685934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc64c0fc710 0x7fc64c0fcb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:07.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.774+0000 7fc651128640 1 --2- 172.21.15.77:0/4065685934 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc64c0fb440 0x7fc64c0fb850 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:07.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.774+0000 7fc651128640 1 -- 172.21.15.77:0/4065685934 >> 172.21.15.77:0/4065685934 conn(0x7fc64c0f6c00 msgr2=0x7fc64c0f9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:15:07.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.774+0000 7fc651128640 1 -- 172.21.15.77:0/4065685934 shutdown_connections 2024-09-18T21:15:07.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.774+0000 7fc651128640 1 -- 172.21.15.77:0/4065685934 wait complete. 2024-09-18T21:15:07.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.774+0000 7fc651128640 1 Processor -- start 2024-09-18T21:15:07.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.775+0000 7fc651128640 1 -- start start 2024-09-18T21:15:07.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.775+0000 7fc651128640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc64c0fb440 0x7fc64c10d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:15:07.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.775+0000 7fc651128640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc64c0fc710 0x7fc64c10d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:15:07.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.775+0000 7fc651128640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c10dc30 con 0x7fc64c0fc710 2024-09-18T21:15:07.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.775+0000 7fc651128640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c10e400 con 0x7fc64c0fb440 2024-09-18T21:15:07.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.775+0000 7fc64a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc64c0fc710 0x7fc64c10d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:15:07.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.775+0000 7fc64a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc64c0fc710 0x7fc64c10d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45774/0 (socket says 172.21.15.77:45774) 2024-09-18T21:15:07.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.775+0000 7fc64a59c640 1 -- 172.21.15.77:0/1749441854 learned_addr learned my addr 172.21.15.77:0/1749441854 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:15:07.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.775+0000 7fc64ad9d640 1 --2- 172.21.15.77:0/1749441854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc64c0fb440 0x7fc64c10d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:15:07.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.775+0000 7fc64a59c640 1 -- 172.21.15.77:0/1749441854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc64c0fb440 msgr2=0x7fc64c10d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:07.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.775+0000 7fc64a59c640 1 --2- 172.21.15.77:0/1749441854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc64c0fb440 0x7fc64c10d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:07.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.775+0000 7fc64a59c640 1 -- 172.21.15.77:0/1749441854 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc63c005040 con 0x7fc64c0fc710 2024-09-18T21:15:07.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.775+0000 7fc64a59c640 1 --2- 172.21.15.77:0/1749441854 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc64c0fc710 0x7fc64c10d5e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc640002a50 tx=0x7fc640004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:15:07.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.775+0000 7fc6337fe640 1 -- 172.21.15.77:0/1749441854 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc640007c30 con 0x7fc64c0fc710 2024-09-18T21:15:07.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.775+0000 7fc6337fe640 1 -- 172.21.15.77:0/1749441854 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc64000f040 con 0x7fc64c0fc710 2024-09-18T21:15:07.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.775+0000 7fc6337fe640 1 -- 172.21.15.77:0/1749441854 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc64000da90 con 0x7fc64c0fc710 2024-09-18T21:15:07.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.775+0000 7fc651128640 1 -- 172.21.15.77:0/1749441854 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc64c10e690 con 0x7fc64c0fc710 2024-09-18T21:15:07.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.776+0000 7fc651128640 1 -- 172.21.15.77:0/1749441854 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc64c10ec30 con 0x7fc64c0fc710 2024-09-18T21:15:07.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.777+0000 7fc651128640 1 -- 172.21.15.77:0/1749441854 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc64c0fa8a0 con 0x7fc64c0fc710 2024-09-18T21:15:07.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.777+0000 7fc6337fe640 1 -- 172.21.15.77:0/1749441854 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 34) v1 ==== 91955+0+0 (secure 0 0 0) 0x7fc64000dc30 con 0x7fc64c0fc710 2024-09-18T21:15:07.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.777+0000 7fc6337fe640 1 --2- 172.21.15.77:0/1749441854 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fc63406ddc0 0x7fc634070270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:15:07.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.777+0000 7fc6337fe640 1 -- 172.21.15.77:0/1749441854 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fc64008ceb0 con 0x7fc64c0fc710 2024-09-18T21:15:07.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.777+0000 7fc64ad9d640 1 --2- 172.21.15.77:0/1749441854 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fc63406ddc0 0x7fc634070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:15:07.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.778+0000 7fc64ad9d640 1 --2- 172.21.15.77:0/1749441854 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fc63406ddc0 0x7fc634070270 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc63c000c00 tx=0x7fc63c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:15:07.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.782+0000 7fc6337fe640 1 -- 172.21.15.77:0/1749441854 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fc640056560 con 0x7fc64c0fc710 2024-09-18T21:15:07.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.794+0000 7fc6337fe640 1 -- 172.21.15.77:0/1749441854 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mgrmap(e 35) v1 ==== 92249+0+0 (secure 0 0 0) 0x7fc640056930 con 0x7fc64c0fc710 2024-09-18T21:15:07.868 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:07 smithi103 ceph-mon[34827]: mgrmap e34: smithi077.utkpjg(active, since 1.02067s), standbys: smithi103.zjztqc 2024-09-18T21:15:07.868 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:07 smithi103 ceph-mon[34827]: [18/Sep/2024:21:15:06] ENGINE Bus STARTING 2024-09-18T21:15:07.868 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:07 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/972473021' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:15:07.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:07 smithi077 ceph-mon[92672]: mgrmap e34: smithi077.utkpjg(active, since 1.02067s), standbys: smithi103.zjztqc 2024-09-18T21:15:07.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:07 smithi077 ceph-mon[92672]: [18/Sep/2024:21:15:06] ENGINE Bus STARTING 2024-09-18T21:15:07.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:07 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/972473021' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:15:08.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.999+0000 7fc651128640 1 -- 172.21.15.77:0/1749441854 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc64c04b720 con 0x7fc64c0fc710 2024-09-18T21:15:08.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:07.999+0000 7fc6337fe640 1 -- 172.21.15.77:0/1749441854 <== mon.0 v2:172.21.15.77:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1915 (secure 0 0 0) 0x7fc6400784f0 con 0x7fc64c0fc710 2024-09-18T21:15:08.002 INFO:teuthology.orchestra.run.smithi077.stdout:e13 2024-09-18T21:15:08.002 INFO:teuthology.orchestra.run.smithi077.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-18T21:15:08.002 INFO:teuthology.orchestra.run.smithi077.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T21:15:08.002 INFO:teuthology.orchestra.run.smithi077.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T21:15:08.002 INFO:teuthology.orchestra.run.smithi077.stdout:legacy client fscid: 1 2024-09-18T21:15:08.002 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:15:08.002 INFO:teuthology.orchestra.run.smithi077.stdout:Filesystem 'cephfs' (1) 2024-09-18T21:15:08.002 INFO:teuthology.orchestra.run.smithi077.stdout:fs_name cephfs 2024-09-18T21:15:08.002 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 13 2024-09-18T21:15:08.002 INFO:teuthology.orchestra.run.smithi077.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T21:15:08.002 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-09-18T21:10:17.230179+0000 2024-09-18T21:15:08.003 INFO:teuthology.orchestra.run.smithi077.stdout:modified 2024-09-18T21:10:33.373241+0000 2024-09-18T21:15:08.003 INFO:teuthology.orchestra.run.smithi077.stdout:tableserver 0 2024-09-18T21:15:08.003 INFO:teuthology.orchestra.run.smithi077.stdout:root 0 2024-09-18T21:15:08.003 INFO:teuthology.orchestra.run.smithi077.stdout:session_timeout 60 2024-09-18T21:15:08.003 INFO:teuthology.orchestra.run.smithi077.stdout:session_autoclose 300 2024-09-18T21:15:08.003 INFO:teuthology.orchestra.run.smithi077.stdout:max_file_size 1099511627776 2024-09-18T21:15:08.003 INFO:teuthology.orchestra.run.smithi077.stdout:max_xattr_size 65536 2024-09-18T21:15:08.003 INFO:teuthology.orchestra.run.smithi077.stdout:required_client_features {} 2024-09-18T21:15:08.003 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure 0 2024-09-18T21:15:08.003 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure_osd_epoch 0 2024-09-18T21:15:08.003 INFO:teuthology.orchestra.run.smithi077.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T21:15:08.003 INFO:teuthology.orchestra.run.smithi077.stdout:max_mds 1 2024-09-18T21:15:08.003 INFO:teuthology.orchestra.run.smithi077.stdout:in 0 2024-09-18T21:15:08.003 INFO:teuthology.orchestra.run.smithi077.stdout:up {0=14446} 2024-09-18T21:15:08.003 INFO:teuthology.orchestra.run.smithi077.stdout:failed 2024-09-18T21:15:08.004 INFO:teuthology.orchestra.run.smithi077.stdout:damaged 2024-09-18T21:15:08.004 INFO:teuthology.orchestra.run.smithi077.stdout:stopped 2024-09-18T21:15:08.004 INFO:teuthology.orchestra.run.smithi077.stdout:data_pools [3] 2024-09-18T21:15:08.004 INFO:teuthology.orchestra.run.smithi077.stdout:metadata_pool 2 2024-09-18T21:15:08.004 INFO:teuthology.orchestra.run.smithi077.stdout:inline_data disabled 2024-09-18T21:15:08.004 INFO:teuthology.orchestra.run.smithi077.stdout:balancer 2024-09-18T21:15:08.004 INFO:teuthology.orchestra.run.smithi077.stdout:bal_rank_mask -1 2024-09-18T21:15:08.004 INFO:teuthology.orchestra.run.smithi077.stdout:standby_count_wanted 1 2024-09-18T21:15:08.004 INFO:teuthology.orchestra.run.smithi077.stdout:qdb_cluster leader: 0 members: 2024-09-18T21:15:08.004 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.vruydi{0:14446} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.77:6826/334039954,v1:172.21.15.77:6827/334039954] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:15:08.004 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:15:08.004 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:15:08.004 INFO:teuthology.orchestra.run.smithi077.stdout:Standby daemons: 2024-09-18T21:15:08.004 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:15:08.005 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.cqfhlw{-1:14458} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.77:6828/862540650,v1:172.21.15.77:6829/862540650] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:15:08.005 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi103.zhdmdg{-1:24255} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.103:6824/2170237078,v1:172.21.15.103:6825/2170237078] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:15:08.005 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi103.opftmf{-1:24267} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.103:6826/4241818403,v1:172.21.15.103:6827/4241818403] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:15:08.005 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 13 2024-09-18T21:15:08.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.002+0000 7fc651128640 1 -- 172.21.15.77:0/1749441854 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fc63406ddc0 msgr2=0x7fc634070270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:08.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.002+0000 7fc651128640 1 --2- 172.21.15.77:0/1749441854 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fc63406ddc0 0x7fc634070270 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc63c000c00 tx=0x7fc63c009da0 comp rx=0 tx=0).stop 2024-09-18T21:15:08.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.002+0000 7fc651128640 1 -- 172.21.15.77:0/1749441854 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc64c0fc710 msgr2=0x7fc64c10d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:08.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.002+0000 7fc651128640 1 --2- 172.21.15.77:0/1749441854 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc64c0fc710 0x7fc64c10d5e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc640002a50 tx=0x7fc640004600 comp rx=0 tx=0).stop 2024-09-18T21:15:08.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.002+0000 7fc651128640 1 -- 172.21.15.77:0/1749441854 shutdown_connections 2024-09-18T21:15:08.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.002+0000 7fc651128640 1 --2- 172.21.15.77:0/1749441854 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc64c0fc710 0x7fc64c10d5e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:08.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.002+0000 7fc651128640 1 --2- 172.21.15.77:0/1749441854 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fc63406ddc0 0x7fc634070270 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:08.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.002+0000 7fc651128640 1 --2- 172.21.15.77:0/1749441854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc64c0fb440 0x7fc64c10d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:08.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.002+0000 7fc651128640 1 -- 172.21.15.77:0/1749441854 >> 172.21.15.77:0/1749441854 conn(0x7fc64c0f6c00 msgr2=0x7fc64c0660b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:15:08.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.002+0000 7fc651128640 1 -- 172.21.15.77:0/1749441854 shutdown_connections 2024-09-18T21:15:08.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.002+0000 7fc651128640 1 -- 172.21.15.77:0/1749441854 wait complete. 2024-09-18T21:15:08.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.081+0000 7fd565193640 1 -- 172.21.15.77:0/3274439257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd560065be0 msgr2=0x7fd5600ff1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:08.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.081+0000 7fd565193640 1 --2- 172.21.15.77:0/3274439257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd560065be0 0x7fd5600ff1a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd550009c50 tx=0x7fd550004d10 comp rx=0 tx=0).stop 2024-09-18T21:15:08.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.081+0000 7fd565193640 1 -- 172.21.15.77:0/3274439257 shutdown_connections 2024-09-18T21:15:08.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.081+0000 7fd565193640 1 --2- 172.21.15.77:0/3274439257 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5600ff6e0 0x7fd560101ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:08.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.081+0000 7fd565193640 1 --2- 172.21.15.77:0/3274439257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd560065be0 0x7fd5600ff1a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:08.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.081+0000 7fd565193640 1 -- 172.21.15.77:0/3274439257 >> 172.21.15.77:0/3274439257 conn(0x7fd5600f6c10 msgr2=0x7fd5600f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:15:08.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.082+0000 7fd565193640 1 -- 172.21.15.77:0/3274439257 shutdown_connections 2024-09-18T21:15:08.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.082+0000 7fd565193640 1 -- 172.21.15.77:0/3274439257 wait complete. 2024-09-18T21:15:08.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.082+0000 7fd565193640 1 Processor -- start 2024-09-18T21:15:08.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.082+0000 7fd565193640 1 -- start start 2024-09-18T21:15:08.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.083+0000 7fd565193640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd560065be0 0x7fd56010d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:15:08.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.083+0000 7fd565193640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5600ff6e0 0x7fd56010d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:15:08.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.083+0000 7fd565193640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56010dcc0 con 0x7fd5600ff6e0 2024-09-18T21:15:08.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.083+0000 7fd565193640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56010e490 con 0x7fd560065be0 2024-09-18T21:15:08.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.083+0000 7fd55e59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5600ff6e0 0x7fd56010d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:15:08.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.083+0000 7fd55e59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5600ff6e0 0x7fd56010d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45806/0 (socket says 172.21.15.77:45806) 2024-09-18T21:15:08.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.083+0000 7fd55e59c640 1 -- 172.21.15.77:0/1083003824 learned_addr learned my addr 172.21.15.77:0/1083003824 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:15:08.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.083+0000 7fd55ed9d640 1 --2- 172.21.15.77:0/1083003824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd560065be0 0x7fd56010d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:15:08.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.083+0000 7fd55e59c640 1 -- 172.21.15.77:0/1083003824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd560065be0 msgr2=0x7fd56010d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:08.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.083+0000 7fd55e59c640 1 --2- 172.21.15.77:0/1083003824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd560065be0 0x7fd56010d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:08.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.083+0000 7fd55e59c640 1 -- 172.21.15.77:0/1083003824 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5500098b0 con 0x7fd5600ff6e0 2024-09-18T21:15:08.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.083+0000 7fd55e59c640 1 --2- 172.21.15.77:0/1083003824 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5600ff6e0 0x7fd56010d670 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd55400eb70 tx=0x7fd55400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:15:08.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.084+0000 7fd5477fe640 1 -- 172.21.15.77:0/1083003824 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd554007c30 con 0x7fd5600ff6e0 2024-09-18T21:15:08.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.084+0000 7fd5477fe640 1 -- 172.21.15.77:0/1083003824 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd55400f040 con 0x7fd5600ff6e0 2024-09-18T21:15:08.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.084+0000 7fd565193640 1 -- 172.21.15.77:0/1083003824 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd56010e6c0 con 0x7fd5600ff6e0 2024-09-18T21:15:08.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.084+0000 7fd5477fe640 1 -- 172.21.15.77:0/1083003824 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5540094e0 con 0x7fd5600ff6e0 2024-09-18T21:15:08.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.084+0000 7fd565193640 1 -- 172.21.15.77:0/1083003824 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd56010ec60 con 0x7fd5600ff6e0 2024-09-18T21:15:08.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.085+0000 7fd565193640 1 -- 172.21.15.77:0/1083003824 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5600fa890 con 0x7fd5600ff6e0 2024-09-18T21:15:08.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.085+0000 7fd5477fe640 1 -- 172.21.15.77:0/1083003824 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 35) v1 ==== 92249+0+0 (secure 0 0 0) 0x7fd554009660 con 0x7fd5600ff6e0 2024-09-18T21:15:08.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.086+0000 7fd5477fe640 1 --2- 172.21.15.77:0/1083003824 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fd54806e140 0x7fd5480705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:15:08.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.086+0000 7fd5477fe640 1 -- 172.21.15.77:0/1083003824 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fd55408d920 con 0x7fd5600ff6e0 2024-09-18T21:15:08.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.086+0000 7fd55ed9d640 1 --2- 172.21.15.77:0/1083003824 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fd54806e140 0x7fd5480705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:15:08.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.086+0000 7fd55ed9d640 1 --2- 172.21.15.77:0/1083003824 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fd54806e140 0x7fd5480705f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd550004a30 tx=0x7fd550004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:15:08.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.093+0000 7fd5477fe640 1 -- 172.21.15.77:0/1083003824 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fd554056d40 con 0x7fd5600ff6e0 2024-09-18T21:15:08.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.289+0000 7fd565193640 1 -- 172.21.15.77:0/1083003824 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd56010ef90 con 0x7fd54806e140 2024-09-18T21:15:08.293 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.291+0000 7fd5477fe640 1 -- 172.21.15.77:0/1083003824 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fd56010ef90 con 0x7fd54806e140 2024-09-18T21:15:08.293 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-18T21:15:08.293 INFO:teuthology.orchestra.run.smithi077.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a", 2024-09-18T21:15:08.293 INFO:teuthology.orchestra.run.smithi077.stdout: "in_progress": true, 2024-09-18T21:15:08.293 INFO:teuthology.orchestra.run.smithi077.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T21:15:08.293 INFO:teuthology.orchestra.run.smithi077.stdout: "services_complete": [ 2024-09-18T21:15:08.293 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr" 2024-09-18T21:15:08.293 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-18T21:15:08.293 INFO:teuthology.orchestra.run.smithi077.stdout: "progress": "2/21 daemons upgraded", 2024-09-18T21:15:08.293 INFO:teuthology.orchestra.run.smithi077.stdout: "message": "", 2024-09-18T21:15:08.293 INFO:teuthology.orchestra.run.smithi077.stdout: "is_paused": false 2024-09-18T21:15:08.294 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-18T21:15:08.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.293+0000 7fd565193640 1 -- 172.21.15.77:0/1083003824 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fd54806e140 msgr2=0x7fd5480705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:08.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.293+0000 7fd565193640 1 --2- 172.21.15.77:0/1083003824 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fd54806e140 0x7fd5480705f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd550004a30 tx=0x7fd550004d10 comp rx=0 tx=0).stop 2024-09-18T21:15:08.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.293+0000 7fd565193640 1 -- 172.21.15.77:0/1083003824 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5600ff6e0 msgr2=0x7fd56010d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:08.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.293+0000 7fd565193640 1 --2- 172.21.15.77:0/1083003824 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5600ff6e0 0x7fd56010d670 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd55400eb70 tx=0x7fd55400b040 comp rx=0 tx=0).stop 2024-09-18T21:15:08.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.293+0000 7fd565193640 1 -- 172.21.15.77:0/1083003824 shutdown_connections 2024-09-18T21:15:08.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.293+0000 7fd565193640 1 --2- 172.21.15.77:0/1083003824 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5600ff6e0 0x7fd56010d670 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:08.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.293+0000 7fd565193640 1 --2- 172.21.15.77:0/1083003824 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fd54806e140 0x7fd5480705f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:08.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.293+0000 7fd565193640 1 --2- 172.21.15.77:0/1083003824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd560065be0 0x7fd56010d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:08.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.293+0000 7fd565193640 1 -- 172.21.15.77:0/1083003824 >> 172.21.15.77:0/1083003824 conn(0x7fd5600f6c10 msgr2=0x7fd5600f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:15:08.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.293+0000 7fd565193640 1 -- 172.21.15.77:0/1083003824 shutdown_connections 2024-09-18T21:15:08.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.293+0000 7fd565193640 1 -- 172.21.15.77:0/1083003824 wait complete. 2024-09-18T21:15:08.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.371+0000 7f63cc0f2640 1 -- 172.21.15.77:0/1479383175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63c40ff710 msgr2=0x7f63c4101af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:08.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.371+0000 7f63cc0f2640 1 --2- 172.21.15.77:0/1479383175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63c40ff710 0x7f63c4101af0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f63b40048d0 tx=0x7f63b4009da0 comp rx=0 tx=0).stop 2024-09-18T21:15:08.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.371+0000 7f63cc0f2640 1 -- 172.21.15.77:0/1479383175 shutdown_connections 2024-09-18T21:15:08.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.371+0000 7f63cc0f2640 1 --2- 172.21.15.77:0/1479383175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63c40ff710 0x7f63c4101af0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:08.374 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.371+0000 7f63cc0f2640 1 --2- 172.21.15.77:0/1479383175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63c4066430 0x7f63c40ff1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:08.374 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.371+0000 7f63cc0f2640 1 -- 172.21.15.77:0/1479383175 >> 172.21.15.77:0/1479383175 conn(0x7f63c40f6c00 msgr2=0x7f63c40f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:15:08.374 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.371+0000 7f63cc0f2640 1 -- 172.21.15.77:0/1479383175 shutdown_connections 2024-09-18T21:15:08.374 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.371+0000 7f63cc0f2640 1 -- 172.21.15.77:0/1479383175 wait complete. 2024-09-18T21:15:08.374 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.371+0000 7f63cc0f2640 1 Processor -- start 2024-09-18T21:15:08.374 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.371+0000 7f63cc0f2640 1 -- start start 2024-09-18T21:15:08.374 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.371+0000 7f63cc0f2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63c4066430 0x7f63c410d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:15:08.374 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.371+0000 7f63cc0f2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63c40ff710 0x7f63c410d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:15:08.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.371+0000 7f63cc0f2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c410dca0 con 0x7f63c40ff710 2024-09-18T21:15:08.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.371+0000 7f63cc0f2640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c410e470 con 0x7f63c4066430 2024-09-18T21:15:08.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.372+0000 7f63c968d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63c40ff710 0x7f63c410d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:15:08.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.372+0000 7f63c968d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63c40ff710 0x7f63c410d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45838/0 (socket says 172.21.15.77:45838) 2024-09-18T21:15:08.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.372+0000 7f63c968d640 1 -- 172.21.15.77:0/181624686 learned_addr learned my addr 172.21.15.77:0/181624686 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:15:08.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.372+0000 7f63c9e8e640 1 --2- 172.21.15.77:0/181624686 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63c4066430 0x7f63c410d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:15:08.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.372+0000 7f63c968d640 1 -- 172.21.15.77:0/181624686 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63c4066430 msgr2=0x7f63c410d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:08.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.372+0000 7f63c968d640 1 --2- 172.21.15.77:0/181624686 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63c4066430 0x7f63c410d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:08.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.372+0000 7f63c968d640 1 -- 172.21.15.77:0/181624686 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b4005040 con 0x7f63c40ff710 2024-09-18T21:15:08.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.372+0000 7f63c968d640 1 --2- 172.21.15.77:0/181624686 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63c40ff710 0x7f63c410d650 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f63b40043d0 tx=0x7f63b4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:15:08.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.372+0000 7f63ba7fc640 1 -- 172.21.15.77:0/181624686 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63b4038070 con 0x7f63c40ff710 2024-09-18T21:15:08.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.372+0000 7f63cc0f2640 1 -- 172.21.15.77:0/181624686 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63c410e6a0 con 0x7f63c40ff710 2024-09-18T21:15:08.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.372+0000 7f63ba7fc640 1 -- 172.21.15.77:0/181624686 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f63b4009800 con 0x7f63c40ff710 2024-09-18T21:15:08.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.372+0000 7f63ba7fc640 1 -- 172.21.15.77:0/181624686 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63b403e630 con 0x7f63c40ff710 2024-09-18T21:15:08.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.372+0000 7f63cc0f2640 1 -- 172.21.15.77:0/181624686 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c410ec40 con 0x7f63c40ff710 2024-09-18T21:15:08.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.373+0000 7f63cc0f2640 1 -- 172.21.15.77:0/181624686 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63c40fa880 con 0x7f63c40ff710 2024-09-18T21:15:08.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.374+0000 7f63ba7fc640 1 -- 172.21.15.77:0/181624686 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 35) v1 ==== 92249+0+0 (secure 0 0 0) 0x7f63b4030020 con 0x7f63c40ff710 2024-09-18T21:15:08.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.374+0000 7f63ba7fc640 1 --2- 172.21.15.77:0/181624686 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f63b006e140 0x7f63b00705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:15:08.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.374+0000 7f63ba7fc640 1 -- 172.21.15.77:0/181624686 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f63b40ade60 con 0x7f63c40ff710 2024-09-18T21:15:08.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.374+0000 7f63c9e8e640 1 --2- 172.21.15.77:0/181624686 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f63b006e140 0x7f63b00705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:15:08.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.375+0000 7f63c9e8e640 1 --2- 172.21.15.77:0/181624686 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f63b006e140 0x7f63b00705f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f63c4066190 tx=0x7f63c000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:15:08.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.379+0000 7f63ba7fc640 1 -- 172.21.15.77:0/181624686 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f63b40772b0 con 0x7f63c40ff710 2024-09-18T21:15:08.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.626+0000 7f63cc0f2640 1 -- 172.21.15.77:0/181624686 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f63c404b720 con 0x7f63c40ff710 2024-09-18T21:15:08.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.627+0000 7f63ba7fc640 1 -- 172.21.15.77:0/181624686 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f63b407a970 con 0x7f63c40ff710 2024-09-18T21:15:08.629 INFO:teuthology.orchestra.run.smithi077.stdout:HEALTH_OK 2024-09-18T21:15:08.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.629+0000 7f63cc0f2640 1 -- 172.21.15.77:0/181624686 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f63b006e140 msgr2=0x7f63b00705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:08.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.629+0000 7f63cc0f2640 1 --2- 172.21.15.77:0/181624686 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f63b006e140 0x7f63b00705f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f63c4066190 tx=0x7f63c000b040 comp rx=0 tx=0).stop 2024-09-18T21:15:08.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.629+0000 7f63cc0f2640 1 -- 172.21.15.77:0/181624686 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63c40ff710 msgr2=0x7f63c410d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:08.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.629+0000 7f63cc0f2640 1 --2- 172.21.15.77:0/181624686 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63c40ff710 0x7f63c410d650 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f63b40043d0 tx=0x7f63b4009da0 comp rx=0 tx=0).stop 2024-09-18T21:15:08.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.629+0000 7f63cc0f2640 1 -- 172.21.15.77:0/181624686 shutdown_connections 2024-09-18T21:15:08.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.629+0000 7f63cc0f2640 1 --2- 172.21.15.77:0/181624686 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63c40ff710 0x7f63c410d650 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:08.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.629+0000 7f63cc0f2640 1 --2- 172.21.15.77:0/181624686 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f63b006e140 0x7f63b00705f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:08.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.629+0000 7f63cc0f2640 1 --2- 172.21.15.77:0/181624686 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63c4066430 0x7f63c410d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:08.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.629+0000 7f63cc0f2640 1 -- 172.21.15.77:0/181624686 >> 172.21.15.77:0/181624686 conn(0x7f63c40f6c00 msgr2=0x7f63c40f6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:15:08.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.629+0000 7f63cc0f2640 1 -- 172.21.15.77:0/181624686 shutdown_connections 2024-09-18T21:15:08.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:08.629+0000 7f63cc0f2640 1 -- 172.21.15.77:0/181624686 wait complete. 2024-09-18T21:15:08.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:08 smithi077 ceph-mon[92672]: [18/Sep/2024:21:15:07] ENGINE Serving on http://172.21.15.77:8765 2024-09-18T21:15:08.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:08 smithi077 ceph-mon[92672]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:15:08.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:08 smithi077 ceph-mon[92672]: [18/Sep/2024:21:15:07] ENGINE Serving on https://172.21.15.77:7150 2024-09-18T21:15:08.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:08 smithi077 ceph-mon[92672]: [18/Sep/2024:21:15:07] ENGINE Bus STARTED 2024-09-18T21:15:08.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:08 smithi077 ceph-mon[92672]: [18/Sep/2024:21:15:07] ENGINE Error in HTTPServer.serve 2024-09-18T21:15:08.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: Traceback (most recent call last): 2024-09-18T21:15:08.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-18T21:15:08.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: self._connections.run(self.expiration_interval) 2024-09-18T21:15:08.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-18T21:15:08.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: self._run(expiration_interval) 2024-09-18T21:15:08.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-18T21:15:08.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-18T21:15:08.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-18T21:15:08.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-18T21:15:08.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-18T21:15:08.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: s = self.context.wrap_socket( 2024-09-18T21:15:08.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-18T21:15:08.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: return self.sslsocket_class._create( 2024-09-18T21:15:08.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-18T21:15:08.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: self.do_handshake() 2024-09-18T21:15:08.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-18T21:15:08.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: self._sslobj.do_handshake() 2024-09-18T21:15:08.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-18T21:15:08.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:08 smithi077 ceph-mon[92672]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:15:08.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:08 smithi077 ceph-mon[92672]: pgmap v4: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:15:08.965 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:08 smithi077 ceph-mon[92672]: mgrmap e35: smithi077.utkpjg(active, since 2s), standbys: smithi103.zjztqc 2024-09-18T21:15:08.965 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:08 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/1749441854' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T21:15:08.965 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:08 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/181624686' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T21:15:09.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:08 smithi103 ceph-mon[34827]: [18/Sep/2024:21:15:07] ENGINE Serving on http://172.21.15.77:8765 2024-09-18T21:15:09.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:08 smithi103 ceph-mon[34827]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:15:09.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:08 smithi103 ceph-mon[34827]: [18/Sep/2024:21:15:07] ENGINE Serving on https://172.21.15.77:7150 2024-09-18T21:15:09.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:08 smithi103 ceph-mon[34827]: [18/Sep/2024:21:15:07] ENGINE Bus STARTED 2024-09-18T21:15:09.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:08 smithi103 ceph-mon[34827]: [18/Sep/2024:21:15:07] ENGINE Error in HTTPServer.serve 2024-09-18T21:15:09.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Traceback (most recent call last): 2024-09-18T21:15:09.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-18T21:15:09.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: self._connections.run(self.expiration_interval) 2024-09-18T21:15:09.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-18T21:15:09.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: self._run(expiration_interval) 2024-09-18T21:15:09.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-18T21:15:09.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-18T21:15:09.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-18T21:15:09.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-18T21:15:09.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-18T21:15:09.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: s = self.context.wrap_socket( 2024-09-18T21:15:09.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-18T21:15:09.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: return self.sslsocket_class._create( 2024-09-18T21:15:09.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-18T21:15:09.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: self.do_handshake() 2024-09-18T21:15:09.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-18T21:15:09.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: self._sslobj.do_handshake() 2024-09-18T21:15:09.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-18T21:15:09.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:08 smithi103 ceph-mon[34827]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:15:09.266 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:08 smithi103 ceph-mon[34827]: pgmap v4: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:15:09.266 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:08 smithi103 ceph-mon[34827]: mgrmap e35: smithi077.utkpjg(active, since 2s), standbys: smithi103.zjztqc 2024-09-18T21:15:09.266 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:08 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/1749441854' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T21:15:09.266 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:08 smithi103 ceph-mon[34827]: from='client.? 172.21.15.77:0/181624686' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T21:15:10.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:09 smithi103 ceph-mon[34827]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:15:10.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:09 smithi103 ceph-mon[34827]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:10.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:09 smithi103 ceph-mon[34827]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:10.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:09 smithi103 ceph-mon[34827]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:10.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:09 smithi103 ceph-mon[34827]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:10.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:09 smithi077 ceph-mon[92672]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:15:10.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:09 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:10.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:09 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:10.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:09 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:10.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:09 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:11.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:11 smithi077 ceph-mon[92672]: pgmap v5: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:15:11.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:11 smithi077 ceph-mon[92672]: mgrmap e36: smithi077.utkpjg(active, since 4s), standbys: smithi103.zjztqc 2024-09-18T21:15:11.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:11 smithi103 ceph-mon[34827]: pgmap v5: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:15:11.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:11 smithi103 ceph-mon[34827]: mgrmap e36: smithi077.utkpjg(active, since 4s), standbys: smithi103.zjztqc 2024-09-18T21:15:12.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:12 smithi103 ceph-mon[34827]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:12.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:12 smithi103 ceph-mon[34827]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:12.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:12 smithi103 ceph-mon[34827]: pgmap v6: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:15:12.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:12 smithi103 ceph-mon[34827]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:12.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:12 smithi103 ceph-mon[34827]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:12.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:12 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:12.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:12 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:12.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:12 smithi077 ceph-mon[92672]: pgmap v6: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:15:12.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:12 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:12.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:12 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:14.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:13 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:14.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:13 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:14.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:13 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:15:14.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:13 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:15:14.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:13 smithi077 ceph-mon[92672]: Updating smithi077:/etc/ceph/ceph.conf 2024-09-18T21:15:14.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:13 smithi077 ceph-mon[92672]: Updating smithi103:/etc/ceph/ceph.conf 2024-09-18T21:15:14.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:13 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:14.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:13 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:14.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:13 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:14.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:13 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:14.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:13 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:14.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:13 smithi103 ceph-mon[34827]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:14.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:13 smithi103 ceph-mon[34827]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:14.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:13 smithi103 ceph-mon[34827]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:15:14.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:13 smithi103 ceph-mon[34827]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:15:14.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:13 smithi103 ceph-mon[34827]: Updating smithi077:/etc/ceph/ceph.conf 2024-09-18T21:15:14.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:13 smithi103 ceph-mon[34827]: Updating smithi103:/etc/ceph/ceph.conf 2024-09-18T21:15:14.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:13 smithi103 ceph-mon[34827]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:14.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:13 smithi103 ceph-mon[34827]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:14.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:13 smithi103 ceph-mon[34827]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:14.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:13 smithi103 ceph-mon[34827]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:14.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:13 smithi103 ceph-mon[34827]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:15.136 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:14 smithi103 ceph-mon[34827]: Updating smithi103:/var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T21:15:15.136 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:14 smithi103 ceph-mon[34827]: Updating smithi077:/var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T21:15:15.136 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:14 smithi103 ceph-mon[34827]: Updating smithi103:/etc/ceph/ceph.client.admin.keyring 2024-09-18T21:15:15.137 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:14 smithi103 ceph-mon[34827]: Updating smithi077:/etc/ceph/ceph.client.admin.keyring 2024-09-18T21:15:15.137 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:14 smithi103 ceph-mon[34827]: Updating smithi103:/var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T21:15:15.137 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:14 smithi103 ceph-mon[34827]: Updating smithi077:/var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T21:15:15.137 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:14 smithi103 ceph-mon[34827]: pgmap v7: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-09-18T21:15:15.137 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:14 smithi103 ceph-mon[34827]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:15:15.137 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:14 smithi103 ceph-mon[34827]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:15:15.137 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:14 smithi103 ceph-mon[34827]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-18T21:15:15.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:14 smithi077 ceph-mon[92672]: Updating smithi103:/var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T21:15:15.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:14 smithi077 ceph-mon[92672]: Updating smithi077:/var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-18T21:15:15.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:14 smithi077 ceph-mon[92672]: Updating smithi103:/etc/ceph/ceph.client.admin.keyring 2024-09-18T21:15:15.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:14 smithi077 ceph-mon[92672]: Updating smithi077:/etc/ceph/ceph.client.admin.keyring 2024-09-18T21:15:15.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:14 smithi077 ceph-mon[92672]: Updating smithi103:/var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T21:15:15.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:14 smithi077 ceph-mon[92672]: Updating smithi077:/var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-18T21:15:15.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:14 smithi077 ceph-mon[92672]: pgmap v7: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-09-18T21:15:15.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:14 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:15:15.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:14 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:15:15.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:14 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-18T21:15:16.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:16 smithi077 ceph-mon[92672]: Upgrade: Updating mon.smithi103 2024-09-18T21:15:16.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:16 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:16.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:16 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-18T21:15:16.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:16 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-18T21:15:16.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:16 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:15:16.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:16 smithi077 ceph-mon[92672]: Deploying daemon mon.smithi103 on smithi103 2024-09-18T21:15:16.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:16 smithi077 ceph-mon[92672]: pgmap v8: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-18T21:15:16.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:16 smithi103 ceph-mon[34827]: Upgrade: Updating mon.smithi103 2024-09-18T21:15:16.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:16 smithi103 ceph-mon[34827]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:16.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:16 smithi103 ceph-mon[34827]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-18T21:15:16.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:16 smithi103 ceph-mon[34827]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-18T21:15:16.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:16 smithi103 ceph-mon[34827]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:15:16.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:16 smithi103 ceph-mon[34827]: Deploying daemon mon.smithi103 on smithi103 2024-09-18T21:15:16.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:16 smithi103 ceph-mon[34827]: pgmap v8: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-18T21:15:17.056 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:16 smithi103 systemd[1]: Stopping Ceph mon.smithi103 for 5a76ec16-7601-11ef-bceb-c7b262605968... 2024-09-18T21:15:17.457 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:17 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-mon-smithi103[34802]: 2024-09-18T21:15:17.054+0000 7feb9734e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi103 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T21:15:17.457 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:17 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-mon-smithi103[34802]: 2024-09-18T21:15:17.054+0000 7feb9734e640 -1 mon.smithi103@1(peon) e2 *** Got Signal Terminated *** 2024-09-18T21:15:17.457 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:17 smithi103 podman[80147]: 2024-09-18 21:15:17.177684649 +0000 UTC m=+0.231215957 container died d6ae2062e5e3156553ab0f61dacdb906474e57996725366caf7bf985d91e2edc (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-mon-smithi103, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=quincy-6e06d1e, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-18T21:15:17.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:17 smithi103 podman[80147]: 2024-09-18 21:15:17.546832898 +0000 UTC m=+0.600364208 container cleanup d6ae2062e5e3156553ab0f61dacdb906474e57996725366caf7bf985d91e2edc (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-mon-smithi103, org.label-schema.schema-version=1.0, RELEASE=quincy-6e06d1e, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True) 2024-09-18T21:15:17.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:17 smithi103 bash[80147]: ceph-5a76ec16-7601-11ef-bceb-c7b262605968-mon-smithi103 2024-09-18T21:15:18.182 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:17 smithi103 podman[80159]: 2024-09-18 21:15:17.831423486 +0000 UTC m=+0.652998294 container remove d6ae2062e5e3156553ab0f61dacdb906474e57996725366caf7bf985d91e2edc (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-mon-smithi103, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=quincy-6e06d1e, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T21:15:18.182 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:17 smithi103 systemd[1]: ceph-5a76ec16-7601-11ef-bceb-c7b262605968@mon.smithi103.service: Deactivated successfully. 2024-09-18T21:15:18.182 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:17 smithi103 systemd[1]: Stopped Ceph mon.smithi103 for 5a76ec16-7601-11ef-bceb-c7b262605968. 2024-09-18T21:15:18.182 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:17 smithi103 systemd[1]: ceph-5a76ec16-7601-11ef-bceb-c7b262605968@mon.smithi103.service: Consumed 5.756s CPU time. 2024-09-18T21:15:18.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 systemd[1]: Starting Ceph mon.smithi103 for 5a76ec16-7601-11ef-bceb-c7b262605968... 2024-09-18T21:15:18.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 podman[80288]: 2024-09-18 21:15:18.293575968 +0000 UTC m=+0.016187423 image pull f79f744f586d6ce8ddb4b06b7cf36a0f23174bbe29ea68264d2be49d8c6d9acd quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a 2024-09-18T21:15:18.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 podman[80288]: 2024-09-18 21:15:18.424794478 +0000 UTC m=+0.147405932 container create dc79edbd960279b741f3006551bc63ca6d3106d4b765ad9eb589290502db3680 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-mon-smithi103, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-release-06b1b1d, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2) 2024-09-18T21:15:19.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 podman[80288]: 2024-09-18 21:15:18.618884288 +0000 UTC m=+0.341495746 container init dc79edbd960279b741f3006551bc63ca6d3106d4b765ad9eb589290502db3680 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-mon-smithi103, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-release-06b1b1d, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-18T21:15:19.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 podman[80288]: 2024-09-18 21:15:18.622063063 +0000 UTC m=+0.344674519 container start dc79edbd960279b741f3006551bc63ca6d3106d4b765ad9eb589290502db3680 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-mon-smithi103, RELEASE=squid-release-06b1b1d, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-18T21:15:19.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: set uid:gid to 167:167 (ceph:ceph) 2024-09-18T21:15:19.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable), process ceph-mon, pid 2 2024-09-18T21:15:19.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: pidfile_write: ignore empty --pid-file 2024-09-18T21:15:19.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: load: jerasure load: lrc 2024-09-18T21:15:19.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: RocksDB version: 7.9.2 2024-09-18T21:15:19.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Git sha 0 2024-09-18T21:15:19.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Compile date 2024-09-18 18:43:21 2024-09-18T21:15:19.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: DB SUMMARY 2024-09-18T21:15:19.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: DB Session ID: 68QUYNDOVP1GNERZQ8F7 2024-09-18T21:15:19.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: CURRENT file: CURRENT 2024-09-18T21:15:19.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: IDENTITY file: IDENTITY 2024-09-18T21:15:19.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: MANIFEST file: MANIFEST-000009 size: 892 Bytes 2024-09-18T21:15:19.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi103/store.db dir, Total Num: 1, files: 000024.sst 2024-09-18T21:15:19.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi103/store.db: 000022.log size: 5827862 ; 2024-09-18T21:15:19.016 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.error_if_exists: 0 2024-09-18T21:15:19.016 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.create_if_missing: 0 2024-09-18T21:15:19.016 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.paranoid_checks: 1 2024-09-18T21:15:19.016 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-18T21:15:19.016 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-18T21:15:19.016 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-18T21:15:19.016 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.env: 0x56331e2a57a0 2024-09-18T21:15:19.016 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.fs: PosixFileSystem 2024-09-18T21:15:19.016 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.info_log: 0x56331f4876e0 2024-09-18T21:15:19.016 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.max_file_opening_threads: 16 2024-09-18T21:15:19.018 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.statistics: (nil) 2024-09-18T21:15:19.018 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.use_fsync: 0 2024-09-18T21:15:19.018 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.max_log_file_size: 0 2024-09-18T21:15:19.018 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-18T21:15:19.019 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-18T21:15:19.019 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.keep_log_file_num: 1000 2024-09-18T21:15:19.019 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.recycle_log_file_num: 0 2024-09-18T21:15:19.019 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.allow_fallocate: 1 2024-09-18T21:15:19.019 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.allow_mmap_reads: 0 2024-09-18T21:15:19.019 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.allow_mmap_writes: 0 2024-09-18T21:15:19.019 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.use_direct_reads: 0 2024-09-18T21:15:19.019 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-18T21:15:19.019 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.create_missing_column_families: 0 2024-09-18T21:15:19.019 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.db_log_dir: 2024-09-18T21:15:19.019 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.wal_dir: 2024-09-18T21:15:19.019 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-18T21:15:19.020 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-18T21:15:19.020 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-18T21:15:19.020 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-18T21:15:19.020 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-18T21:15:19.020 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-18T21:15:19.020 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.advise_random_on_open: 1 2024-09-18T21:15:19.020 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.db_write_buffer_size: 0 2024-09-18T21:15:19.020 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.write_buffer_manager: 0x56331f496dc0 2024-09-18T21:15:19.020 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-18T21:15:19.020 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-18T21:15:19.020 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-18T21:15:19.020 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.rate_limiter: (nil) 2024-09-18T21:15:19.020 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-18T21:15:19.021 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.wal_recovery_mode: 2 2024-09-18T21:15:19.021 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.enable_thread_tracking: 0 2024-09-18T21:15:19.021 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.enable_pipelined_write: 0 2024-09-18T21:15:19.021 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.unordered_write: 0 2024-09-18T21:15:19.021 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-18T21:15:19.021 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-18T21:15:19.021 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-18T21:15:19.021 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-18T21:15:19.021 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.row_cache: None 2024-09-18T21:15:19.021 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.wal_filter: None 2024-09-18T21:15:19.021 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-18T21:15:19.021 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.allow_ingest_behind: 0 2024-09-18T21:15:19.021 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.two_write_queues: 0 2024-09-18T21:15:19.022 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.manual_wal_flush: 0 2024-09-18T21:15:19.022 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.wal_compression: 0 2024-09-18T21:15:19.022 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.atomic_flush: 0 2024-09-18T21:15:19.022 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-18T21:15:19.022 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-18T21:15:19.022 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-18T21:15:19.022 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.log_readahead_size: 0 2024-09-18T21:15:19.022 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-18T21:15:19.022 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.best_efforts_recovery: 0 2024-09-18T21:15:19.022 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-18T21:15:19.022 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-18T21:15:19.022 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.allow_data_in_errors: 0 2024-09-18T21:15:19.022 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.db_host_id: __hostname__ 2024-09-18T21:15:19.022 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-18T21:15:19.023 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.max_background_jobs: 2 2024-09-18T21:15:19.023 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.max_background_compactions: -1 2024-09-18T21:15:19.023 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.max_subcompactions: 1 2024-09-18T21:15:19.023 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-18T21:15:19.023 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-18T21:15:19.023 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-18T21:15:19.023 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.max_total_wal_size: 0 2024-09-18T21:15:19.023 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-18T21:15:19.023 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-18T21:15:19.023 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-18T21:15:19.023 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-18T21:15:19.023 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.max_open_files: -1 2024-09-18T21:15:19.023 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.bytes_per_sync: 0 2024-09-18T21:15:19.023 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-18T21:15:19.023 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-18T21:15:19.024 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.compaction_readahead_size: 0 2024-09-18T21:15:19.024 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.max_background_flushes: -1 2024-09-18T21:15:19.024 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Compression algorithms supported: 2024-09-18T21:15:19.024 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: kZSTD supported: 0 2024-09-18T21:15:19.024 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: kXpressCompression supported: 0 2024-09-18T21:15:19.024 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: kBZip2Compression supported: 0 2024-09-18T21:15:19.024 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-18T21:15:19.024 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: kLZ4Compression supported: 1 2024-09-18T21:15:19.024 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: kZlibCompression supported: 1 2024-09-18T21:15:19.024 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: kLZ4HCCompression supported: 1 2024-09-18T21:15:19.024 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: kSnappyCompression supported: 1 2024-09-18T21:15:19.024 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-18T21:15:19.024 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-18T21:15:19.024 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi103/store.db/MANIFEST-000009 2024-09-18T21:15:19.025 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-18T21:15:19.025 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-18T21:15:19.025 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.merge_operator: 2024-09-18T21:15:19.025 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.compaction_filter: None 2024-09-18T21:15:19.025 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.compaction_filter_factory: None 2024-09-18T21:15:19.025 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.sst_partitioner_factory: None 2024-09-18T21:15:19.025 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-18T21:15:19.025 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-18T21:15:19.025 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56331f487320) 2024-09-18T21:15:19.025 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: cache_index_and_filter_blocks: 1 2024-09-18T21:15:19.025 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-18T21:15:19.025 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-18T21:15:19.025 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: pin_top_level_index_and_filter: 1 2024-09-18T21:15:19.026 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: index_type: 0 2024-09-18T21:15:19.026 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: data_block_index_type: 0 2024-09-18T21:15:19.026 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: index_shortening: 1 2024-09-18T21:15:19.026 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-18T21:15:19.026 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: checksum: 4 2024-09-18T21:15:19.026 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: no_block_cache: 0 2024-09-18T21:15:19.026 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: block_cache: 0x56331f47b090 2024-09-18T21:15:19.026 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: block_cache_name: BinnedLRUCache 2024-09-18T21:15:19.026 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: block_cache_options: 2024-09-18T21:15:19.026 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: capacity : 536870912 2024-09-18T21:15:19.026 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: num_shard_bits : 4 2024-09-18T21:15:19.026 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: strict_capacity_limit : 0 2024-09-18T21:15:19.026 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: high_pri_pool_ratio: 0.000 2024-09-18T21:15:19.026 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: block_cache_compressed: (nil) 2024-09-18T21:15:19.027 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: persistent_cache: (nil) 2024-09-18T21:15:19.027 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: block_size: 4096 2024-09-18T21:15:19.027 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: block_size_deviation: 10 2024-09-18T21:15:19.027 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: block_restart_interval: 16 2024-09-18T21:15:19.027 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: index_block_restart_interval: 1 2024-09-18T21:15:19.027 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: metadata_block_size: 4096 2024-09-18T21:15:19.027 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: partition_filters: 0 2024-09-18T21:15:19.027 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: use_delta_encoding: 1 2024-09-18T21:15:19.027 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: filter_policy: bloomfilter 2024-09-18T21:15:19.027 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: whole_key_filtering: 1 2024-09-18T21:15:19.027 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: verify_compression: 0 2024-09-18T21:15:19.027 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: read_amp_bytes_per_bit: 0 2024-09-18T21:15:19.027 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: format_version: 5 2024-09-18T21:15:19.027 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: enable_index_compression: 1 2024-09-18T21:15:19.028 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: block_align: 0 2024-09-18T21:15:19.028 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: max_auto_readahead_size: 262144 2024-09-18T21:15:19.028 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: prepopulate_block_cache: 0 2024-09-18T21:15:19.028 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: initial_auto_readahead_size: 8192 2024-09-18T21:15:19.028 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: num_file_reads_for_auto_readahead: 2 2024-09-18T21:15:19.028 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.write_buffer_size: 33554432 2024-09-18T21:15:19.028 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.max_write_buffer_number: 2 2024-09-18T21:15:19.028 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.compression: NoCompression 2024-09-18T21:15:19.028 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.bottommost_compression: Disabled 2024-09-18T21:15:19.028 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.prefix_extractor: nullptr 2024-09-18T21:15:19.028 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-18T21:15:19.028 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.num_levels: 7 2024-09-18T21:15:19.028 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-18T21:15:19.028 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-18T21:15:19.028 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-18T21:15:19.029 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-18T21:15:19.029 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-18T21:15:19.029 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-18T21:15:19.029 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-18T21:15:19.029 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-18T21:15:19.029 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-18T21:15:19.029 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-18T21:15:19.029 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-18T21:15:19.029 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-18T21:15:19.029 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-18T21:15:19.029 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.compression_opts.level: 32767 2024-09-18T21:15:19.029 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.compression_opts.strategy: 0 2024-09-18T21:15:19.029 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-18T21:15:19.030 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-18T21:15:19.030 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-18T21:15:19.030 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-18T21:15:19.030 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.compression_opts.enabled: false 2024-09-18T21:15:19.030 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-18T21:15:19.030 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-18T21:15:19.030 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-18T21:15:19.030 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-18T21:15:19.030 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.target_file_size_base: 67108864 2024-09-18T21:15:19.030 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-18T21:15:19.030 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-18T21:15:19.030 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-18T21:15:19.030 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-18T21:15:19.031 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-18T21:15:19.031 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-18T21:15:19.031 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-18T21:15:19.031 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-18T21:15:19.031 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-18T21:15:19.031 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-18T21:15:19.031 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-18T21:15:19.031 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-18T21:15:19.031 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-18T21:15:19.031 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-18T21:15:19.031 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.arena_block_size: 1048576 2024-09-18T21:15:19.031 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-18T21:15:19.031 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-18T21:15:19.031 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.disable_auto_compactions: 0 2024-09-18T21:15:19.032 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-18T21:15:19.032 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-18T21:15:19.032 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-18T21:15:19.032 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-18T21:15:19.032 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-18T21:15:19.032 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-18T21:15:19.032 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-18T21:15:19.032 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-18T21:15:19.032 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-18T21:15:19.032 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-18T21:15:19.032 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-18T21:15:19.032 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.inplace_update_support: 0 2024-09-18T21:15:19.033 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-18T21:15:19.033 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-18T21:15:19.033 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-18T21:15:19.033 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-18T21:15:19.033 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.bloom_locality: 0 2024-09-18T21:15:19.033 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.max_successive_merges: 0 2024-09-18T21:15:19.033 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-18T21:15:19.033 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.paranoid_file_checks: 0 2024-09-18T21:15:19.033 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.force_consistency_checks: 1 2024-09-18T21:15:19.033 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.report_bg_io_stats: 0 2024-09-18T21:15:19.033 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.ttl: 2592000 2024-09-18T21:15:19.033 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-18T21:15:19.033 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-18T21:15:19.033 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-18T21:15:19.034 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.enable_blob_files: false 2024-09-18T21:15:19.034 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.min_blob_size: 0 2024-09-18T21:15:19.034 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.blob_file_size: 268435456 2024-09-18T21:15:19.034 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-18T21:15:19.034 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-18T21:15:19.034 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-18T21:15:19.034 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-18T21:15:19.034 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-18T21:15:19.034 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.blob_file_starting_level: 0 2024-09-18T21:15:19.034 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-18T21:15:19.034 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 24.sst 2024-09-18T21:15:19.034 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-18T21:15:19.035 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi103/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 26, last_sequence is 10192, log_number is 22,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-18T21:15:19.035 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 22 2024-09-18T21:15:19.035 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 787e7e89-89e4-44cc-8448-c3c53107b0e8 2024-09-18T21:15:19.035 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726694118648643, "job": 1, "event": "recovery_started", "wal_files": [22]} 2024-09-18T21:15:19.035 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #22 mode 2 2024-09-18T21:15:19.035 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726694118660851, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 27, "file_size": 3478307, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 10197, "largest_seqno": 11643, "table_properties": {"data_size": 3471487, "index_size": 4239, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1541, "raw_key_size": 14377, "raw_average_key_size": 23, "raw_value_size": 3458189, "raw_average_value_size": 5632, "num_data_blocks": 193, "num_entries": 614, "num_filter_entries": 614, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726694118, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "787e7e89-89e4-44cc-8448-c3c53107b0e8", "db_session_id": "68QUYNDOVP1GNERZQ8F7", "orig_file_number": 27, "seqno_to_time_mapping": "N/A"}} 2024-09-18T21:15:19.035 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726694118660991, "job": 1, "event": "recovery_finished"} 2024-09-18T21:15:19.035 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: [db/version_set.cc:5047] Creating manifest 29 2024-09-18T21:15:19.035 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-18T21:15:19.036 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi103/store.db/000022.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-18T21:15:19.036 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56331f4a8e00 2024-09-18T21:15:19.036 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: DB pointer 0x56331f5a2000 2024-09-18T21:15:19.036 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-18T21:15:19.036 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-18T21:15:19.036 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: ** DB Stats ** 2024-09-18T21:15:19.036 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-18T21:15:19.036 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-18T21:15:19.036 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-18T21:15:19.036 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-18T21:15:19.036 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-18T21:15:19.036 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-18T21:15:19.037 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-18T21:15:19.037 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: 2024-09-18T21:15:19.037 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: ** Compaction Stats [default] ** 2024-09-18T21:15:19.037 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-18T21:15:19.037 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-18T21:15:19.037 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: L0 1/0 3.32 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 724.0 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-09-18T21:15:19.037 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: L6 1/0 5.28 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-18T21:15:19.037 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Sum 2/0 8.60 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 724.0 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-09-18T21:15:19.037 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 724.0 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-09-18T21:15:19.037 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: 2024-09-18T21:15:19.037 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: ** Compaction Stats [default] ** 2024-09-18T21:15:19.037 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-18T21:15:19.038 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-18T21:15:19.038 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 724.0 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-09-18T21:15:19.038 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: 2024-09-18T21:15:19.038 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-18T21:15:19.038 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: 2024-09-18T21:15:19.038 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-18T21:15:19.038 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Flush(GB): cumulative 0.003, interval 0.003 2024-09-18T21:15:19.038 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-18T21:15:19.038 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-18T21:15:19.038 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-18T21:15:19.038 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-18T21:15:19.038 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Cumulative compaction: 0.00 GB write, 166.52 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-18T21:15:19.038 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Interval compaction: 0.00 GB write, 166.52 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-18T21:15:19.038 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-18T21:15:19.039 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Block cache BinnedLRUCache@0x56331f47b090#2 capacity: 512.00 MB usage: 6.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-18T21:15:19.039 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.78 KB,0.000339746%) IndexBlock(1,4.58 KB,0.000873208%) Misc(1,0.00 KB,0%) 2024-09-18T21:15:19.039 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: 2024-09-18T21:15:19.039 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-18T21:15:19.039 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: starting mon.smithi103 rank 1 at public addrs [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] at bind addrs [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi103 fsid 5a76ec16-7601-11ef-bceb-c7b262605968 2024-09-18T21:15:19.039 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: mon.smithi103@-1(???) e2 preinit fsid 5a76ec16-7601-11ef-bceb-c7b262605968 2024-09-18T21:15:19.039 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: mon.smithi103@-1(???).mds e13 new map 2024-09-18T21:15:19.039 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: mon.smithi103@-1(???).mds e13 print_map 2024-09-18T21:15:19.039 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: e13 2024-09-18T21:15:19.039 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-18T21:15:19.039 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T21:15:19.039 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T21:15:19.039 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: legacy client fscid: 1 2024-09-18T21:15:19.039 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: 2024-09-18T21:15:19.040 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Filesystem 'cephfs' (1) 2024-09-18T21:15:19.040 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: fs_name cephfs 2024-09-18T21:15:19.040 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: epoch 13 2024-09-18T21:15:19.040 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T21:15:19.040 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: created 2024-09-18T21:10:17.230179+0000 2024-09-18T21:15:19.040 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: modified 2024-09-18T21:10:33.373241+0000 2024-09-18T21:15:19.040 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: tableserver 0 2024-09-18T21:15:19.040 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: root 0 2024-09-18T21:15:19.040 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: session_timeout 60 2024-09-18T21:15:19.040 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: session_autoclose 300 2024-09-18T21:15:19.040 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: max_file_size 1099511627776 2024-09-18T21:15:19.040 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: max_xattr_size 65536 2024-09-18T21:15:19.040 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: required_client_features {} 2024-09-18T21:15:19.041 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: last_failure 0 2024-09-18T21:15:19.041 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: last_failure_osd_epoch 0 2024-09-18T21:15:19.041 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T21:15:19.041 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: max_mds 1 2024-09-18T21:15:19.041 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: in 0 2024-09-18T21:15:19.041 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: up {0=14446} 2024-09-18T21:15:19.041 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: failed 2024-09-18T21:15:19.041 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: damaged 2024-09-18T21:15:19.041 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: stopped 2024-09-18T21:15:19.041 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: data_pools [3] 2024-09-18T21:15:19.041 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: metadata_pool 2 2024-09-18T21:15:19.041 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: inline_data disabled 2024-09-18T21:15:19.041 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: balancer 2024-09-18T21:15:19.042 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: bal_rank_mask -1 2024-09-18T21:15:19.042 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: standby_count_wanted 1 2024-09-18T21:15:19.042 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: qdb_cluster leader: 0 members: 2024-09-18T21:15:19.042 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: [mds.cephfs.smithi077.vruydi{0:14446} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.77:6826/334039954,v1:172.21.15.77:6827/334039954] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:15:19.042 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: 2024-09-18T21:15:19.042 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: 2024-09-18T21:15:19.042 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: Standby daemons: 2024-09-18T21:15:19.042 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: 2024-09-18T21:15:19.042 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: [mds.cephfs.smithi077.cqfhlw{-1:14458} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.77:6828/862540650,v1:172.21.15.77:6829/862540650] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:15:19.042 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: [mds.cephfs.smithi103.zhdmdg{-1:24255} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.103:6824/2170237078,v1:172.21.15.103:6825/2170237078] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:15:19.042 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout: [mds.cephfs.smithi103.opftmf{-1:24267} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.103:6826/4241818403,v1:172.21.15.103:6827/4241818403] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:15:19.042 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: mon.smithi103@-1(???).osd e46 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-18T21:15:19.042 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: mon.smithi103@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2024-09-18T21:15:19.043 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: mon.smithi103@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2024-09-18T21:15:19.043 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: mon.smithi103@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2024-09-18T21:15:19.043 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 ceph-mon[80307]: mon.smithi103@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2024-09-18T21:15:19.043 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 bash[80288]: dc79edbd960279b741f3006551bc63ca6d3106d4b765ad9eb589290502db3680 2024-09-18T21:15:19.043 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:18 smithi103 systemd[1]: Started Ceph mon.smithi103 for 5a76ec16-7601-11ef-bceb-c7b262605968. 2024-09-18T21:15:20.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:20 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mon metadata", "id": "smithi077"}]: dispatch 2024-09-18T21:15:20.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:20 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mon metadata", "id": "smithi103"}]: dispatch 2024-09-18T21:15:20.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:20 smithi103 ceph-mon[80307]: mon.smithi077 calling monitor election 2024-09-18T21:15:20.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:20 smithi103 ceph-mon[80307]: mon.smithi103 calling monitor election 2024-09-18T21:15:20.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:20 smithi103 ceph-mon[80307]: mon.smithi077 is new leader, mons smithi077,smithi103 in quorum (ranks 0,1) 2024-09-18T21:15:20.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:20 smithi103 ceph-mon[80307]: monmap epoch 3 2024-09-18T21:15:20.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:20 smithi103 ceph-mon[80307]: fsid 5a76ec16-7601-11ef-bceb-c7b262605968 2024-09-18T21:15:20.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:20 smithi103 ceph-mon[80307]: last_changed 2024-09-18T21:15:19.244648+0000 2024-09-18T21:15:20.515 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:20 smithi103 ceph-mon[80307]: created 2024-09-18T21:03:43.159838+0000 2024-09-18T21:15:20.515 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:20 smithi103 ceph-mon[80307]: min_mon_release 19 (squid) 2024-09-18T21:15:20.515 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:20 smithi103 ceph-mon[80307]: election_strategy: 1 2024-09-18T21:15:20.515 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:20 smithi103 ceph-mon[80307]: 0: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.smithi077 2024-09-18T21:15:20.515 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:20 smithi103 ceph-mon[80307]: 1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.smithi103 2024-09-18T21:15:20.515 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:20 smithi103 ceph-mon[80307]: fsmap cephfs:1 {0=cephfs.smithi077.vruydi=up:active} 3 up:standby 2024-09-18T21:15:20.515 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:20 smithi103 ceph-mon[80307]: osdmap e46: 6 total, 6 up, 6 in 2024-09-18T21:15:20.515 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:20 smithi103 ceph-mon[80307]: mgrmap e36: smithi077.utkpjg(active, since 13s), standbys: smithi103.zjztqc 2024-09-18T21:15:20.515 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:20 smithi103 ceph-mon[80307]: overall HEALTH_OK 2024-09-18T21:15:20.515 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:20 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:20.515 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:20 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:20.515 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:20 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:15:20.515 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:20 smithi103 ceph-mon[80307]: pgmap v10: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-18T21:15:20.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:20 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mon metadata", "id": "smithi077"}]: dispatch 2024-09-18T21:15:20.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:20 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mon metadata", "id": "smithi103"}]: dispatch 2024-09-18T21:15:20.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:20 smithi077 ceph-mon[92672]: mon.smithi077 calling monitor election 2024-09-18T21:15:20.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:20 smithi077 ceph-mon[92672]: mon.smithi103 calling monitor election 2024-09-18T21:15:20.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:20 smithi077 ceph-mon[92672]: mon.smithi077 is new leader, mons smithi077,smithi103 in quorum (ranks 0,1) 2024-09-18T21:15:20.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:20 smithi077 ceph-mon[92672]: monmap epoch 3 2024-09-18T21:15:20.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:20 smithi077 ceph-mon[92672]: fsid 5a76ec16-7601-11ef-bceb-c7b262605968 2024-09-18T21:15:20.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:20 smithi077 ceph-mon[92672]: last_changed 2024-09-18T21:15:19.244648+0000 2024-09-18T21:15:20.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:20 smithi077 ceph-mon[92672]: created 2024-09-18T21:03:43.159838+0000 2024-09-18T21:15:20.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:20 smithi077 ceph-mon[92672]: min_mon_release 19 (squid) 2024-09-18T21:15:20.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:20 smithi077 ceph-mon[92672]: election_strategy: 1 2024-09-18T21:15:20.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:20 smithi077 ceph-mon[92672]: 0: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.smithi077 2024-09-18T21:15:20.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:20 smithi077 ceph-mon[92672]: 1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.smithi103 2024-09-18T21:15:20.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:20 smithi077 ceph-mon[92672]: fsmap cephfs:1 {0=cephfs.smithi077.vruydi=up:active} 3 up:standby 2024-09-18T21:15:20.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:20 smithi077 ceph-mon[92672]: osdmap e46: 6 total, 6 up, 6 in 2024-09-18T21:15:20.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:20 smithi077 ceph-mon[92672]: mgrmap e36: smithi077.utkpjg(active, since 13s), standbys: smithi103.zjztqc 2024-09-18T21:15:20.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:20 smithi077 ceph-mon[92672]: overall HEALTH_OK 2024-09-18T21:15:20.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:20 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:20.715 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:20 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:20.715 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:20 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:15:20.715 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:20 smithi077 ceph-mon[92672]: pgmap v10: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-18T21:15:21.568 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:21 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:15:21.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:21 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:15:23.252 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:22 smithi103 ceph-mon[80307]: pgmap v11: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-18T21:15:23.252 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:22 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:23.252 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:22 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:23.252 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:22 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:23.252 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:22 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:23.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:22 smithi077 ceph-mon[92672]: pgmap v11: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-18T21:15:23.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:22 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:23.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:22 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:23.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:22 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:23.464 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:22 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:24.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:24 smithi077 ceph-mon[92672]: pgmap v12: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-18T21:15:25.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:24 smithi103 ceph-mon[80307]: pgmap v12: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-18T21:15:26.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:26 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:26.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:26 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:26.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:26 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:15:26.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:26 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:15:26.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:26 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:26.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:26 smithi077 ceph-mon[92672]: pgmap v13: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:15:26.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:26 smithi077 ceph-mon[92672]: Reconfiguring mon.smithi077 (monmap changed)... 2024-09-18T21:15:26.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:26 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-18T21:15:26.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:26 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-18T21:15:26.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:26 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:15:26.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:26 smithi077 ceph-mon[92672]: Reconfiguring daemon mon.smithi077 on smithi077 2024-09-18T21:15:27.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:26 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:27.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:26 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:27.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:26 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:15:27.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:26 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:15:27.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:26 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:27.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:26 smithi103 ceph-mon[80307]: pgmap v13: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:15:27.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:26 smithi103 ceph-mon[80307]: Reconfiguring mon.smithi077 (monmap changed)... 2024-09-18T21:15:27.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:26 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-18T21:15:27.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:26 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-18T21:15:27.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:26 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:15:27.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:26 smithi103 ceph-mon[80307]: Reconfiguring daemon mon.smithi077 on smithi077 2024-09-18T21:15:28.660 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:28 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:28.660 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:28 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:28.660 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:28 smithi077 ceph-mon[92672]: Reconfiguring mgr.smithi077.utkpjg (monmap changed)... 2024-09-18T21:15:28.661 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:28 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi077.utkpjg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T21:15:28.661 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:28 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T21:15:28.661 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:28 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:15:28.661 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:28 smithi077 ceph-mon[92672]: Reconfiguring daemon mgr.smithi077.utkpjg on smithi077 2024-09-18T21:15:28.661 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:28 smithi077 ceph-mon[92672]: pgmap v14: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:15:28.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:28 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:28.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:28 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:28.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:28 smithi103 ceph-mon[80307]: Reconfiguring mgr.smithi077.utkpjg (monmap changed)... 2024-09-18T21:15:28.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:28 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi077.utkpjg", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T21:15:28.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:28 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T21:15:28.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:28 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:15:28.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:28 smithi103 ceph-mon[80307]: Reconfiguring daemon mgr.smithi077.utkpjg on smithi077 2024-09-18T21:15:28.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:28 smithi103 ceph-mon[80307]: pgmap v14: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:15:30.147 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:29 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:30.147 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:29 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:30.148 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:29 smithi077 ceph-mon[92672]: Reconfiguring crash.smithi077 (monmap changed)... 2024-09-18T21:15:30.148 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:29 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi077", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-18T21:15:30.148 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:29 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:15:30.148 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:29 smithi077 ceph-mon[92672]: Reconfiguring daemon crash.smithi077 on smithi077 2024-09-18T21:15:30.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:29 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:30.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:29 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:30.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:29 smithi103 ceph-mon[80307]: Reconfiguring crash.smithi077 (monmap changed)... 2024-09-18T21:15:30.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:29 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi077", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-18T21:15:30.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:29 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:15:30.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:29 smithi103 ceph-mon[80307]: Reconfiguring daemon crash.smithi077 on smithi077 2024-09-18T21:15:31.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:30 smithi077 ceph-mon[92672]: pgmap v15: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:15:31.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:30 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:31.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:30 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:31.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:30 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-18T21:15:31.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:30 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:15:31.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:30 smithi103 ceph-mon[80307]: pgmap v15: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:15:31.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:30 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:31.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:30 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:31.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:30 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-18T21:15:31.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:30 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:15:32.200 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:31 smithi077 ceph-mon[92672]: Reconfiguring osd.0 (monmap changed)... 2024-09-18T21:15:32.200 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:31 smithi077 ceph-mon[92672]: Reconfiguring daemon osd.0 on smithi077 2024-09-18T21:15:32.200 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:31 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:32.200 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:31 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:32.200 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:31 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-18T21:15:32.200 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:31 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:15:32.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:31 smithi103 ceph-mon[80307]: Reconfiguring osd.0 (monmap changed)... 2024-09-18T21:15:32.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:31 smithi103 ceph-mon[80307]: Reconfiguring daemon osd.0 on smithi077 2024-09-18T21:15:32.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:31 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:32.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:31 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:32.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:31 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-18T21:15:32.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:31 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:15:32.954 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:32 smithi077 ceph-mon[92672]: Reconfiguring osd.1 (monmap changed)... 2024-09-18T21:15:32.954 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:32 smithi077 ceph-mon[92672]: Reconfiguring daemon osd.1 on smithi077 2024-09-18T21:15:32.954 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:32 smithi077 ceph-mon[92672]: pgmap v16: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:15:33.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:32 smithi103 ceph-mon[80307]: Reconfiguring osd.1 (monmap changed)... 2024-09-18T21:15:33.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:32 smithi103 ceph-mon[80307]: Reconfiguring daemon osd.1 on smithi077 2024-09-18T21:15:33.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:32 smithi103 ceph-mon[80307]: pgmap v16: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:15:34.433 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:34 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:34.433 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:34 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:34.433 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:34 smithi077 ceph-mon[92672]: Reconfiguring osd.2 (monmap changed)... 2024-09-18T21:15:34.434 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:34 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-18T21:15:34.434 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:34 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:15:34.434 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:34 smithi077 ceph-mon[92672]: Reconfiguring daemon osd.2 on smithi077 2024-09-18T21:15:34.434 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:34 smithi077 ceph-mon[92672]: pgmap v17: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:15:34.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:34 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:34.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:34 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:34.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:34 smithi103 ceph-mon[80307]: Reconfiguring osd.2 (monmap changed)... 2024-09-18T21:15:34.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:34 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-18T21:15:34.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:34 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:15:34.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:34 smithi103 ceph-mon[80307]: Reconfiguring daemon osd.2 on smithi077 2024-09-18T21:15:34.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:34 smithi103 ceph-mon[80307]: pgmap v17: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:15:35.936 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:35 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:35.936 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:35 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:35.936 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:35 smithi077 ceph-mon[92672]: Reconfiguring mds.cephfs.smithi077.vruydi (monmap changed)... 2024-09-18T21:15:35.936 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:35 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi077.vruydi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-18T21:15:35.936 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:35 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:15:35.936 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:35 smithi077 ceph-mon[92672]: Reconfiguring daemon mds.cephfs.smithi077.vruydi on smithi077 2024-09-18T21:15:36.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:35 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:36.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:35 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:36.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:35 smithi103 ceph-mon[80307]: Reconfiguring mds.cephfs.smithi077.vruydi (monmap changed)... 2024-09-18T21:15:36.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:35 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi077.vruydi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-18T21:15:36.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:35 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:15:36.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:35 smithi103 ceph-mon[80307]: Reconfiguring daemon mds.cephfs.smithi077.vruydi on smithi077 2024-09-18T21:15:36.648 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:36 smithi077 ceph-mon[92672]: pgmap v18: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:15:36.648 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:36 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:15:36.648 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:36 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:36.648 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:36 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:36.648 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:36 smithi077 ceph-mon[92672]: Reconfiguring mds.cephfs.smithi077.cqfhlw (monmap changed)... 2024-09-18T21:15:36.648 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:36 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi077.cqfhlw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-18T21:15:36.648 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:36 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:15:36.649 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:36 smithi077 ceph-mon[92672]: Reconfiguring daemon mds.cephfs.smithi077.cqfhlw on smithi077 2024-09-18T21:15:37.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:36 smithi103 ceph-mon[80307]: pgmap v18: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:15:37.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:36 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:15:37.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:36 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:37.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:36 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:37.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:36 smithi103 ceph-mon[80307]: Reconfiguring mds.cephfs.smithi077.cqfhlw (monmap changed)... 2024-09-18T21:15:37.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:36 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi077.cqfhlw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-18T21:15:37.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:36 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:15:37.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:36 smithi103 ceph-mon[80307]: Reconfiguring daemon mds.cephfs.smithi077.cqfhlw on smithi077 2024-09-18T21:15:38.661 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:38 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:38.661 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:38 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:38.661 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:38 smithi077 ceph-mon[92672]: Reconfiguring crash.smithi103 (monmap changed)... 2024-09-18T21:15:38.661 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:38 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi103", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-18T21:15:38.661 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:38 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:15:38.662 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:38 smithi077 ceph-mon[92672]: Reconfiguring daemon crash.smithi103 on smithi103 2024-09-18T21:15:38.662 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:38 smithi077 ceph-mon[92672]: pgmap v19: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:15:38.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:38.722+0000 7fc114676640 1 -- 172.21.15.77:0/3967522113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc10c0666b0 msgr2=0x7fc10c0ff1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:38.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:38.722+0000 7fc114676640 1 --2- 172.21.15.77:0/3967522113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc10c0666b0 0x7fc10c0ff1c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc1080048d0 tx=0x7fc108009da0 comp rx=0 tx=0).stop 2024-09-18T21:15:38.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:38.722+0000 7fc114676640 1 -- 172.21.15.77:0/3967522113 shutdown_connections 2024-09-18T21:15:38.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:38.722+0000 7fc114676640 1 --2- 172.21.15.77:0/3967522113 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc10c0ff700 0x7fc10c101ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:38.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:38.722+0000 7fc114676640 1 --2- 172.21.15.77:0/3967522113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc10c0666b0 0x7fc10c0ff1c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:38.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:38.722+0000 7fc114676640 1 -- 172.21.15.77:0/3967522113 >> 172.21.15.77:0/3967522113 conn(0x7fc10c0f6c10 msgr2=0x7fc10c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:15:38.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:38.722+0000 7fc114676640 1 -- 172.21.15.77:0/3967522113 shutdown_connections 2024-09-18T21:15:38.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:38.722+0000 7fc114676640 1 -- 172.21.15.77:0/3967522113 wait complete. 2024-09-18T21:15:38.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:38.723+0000 7fc114676640 1 Processor -- start 2024-09-18T21:15:38.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:38.723+0000 7fc114676640 1 -- start start 2024-09-18T21:15:38.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:38.723+0000 7fc114676640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc10c0666b0 0x7fc10c10f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:15:38.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:38.723+0000 7fc114676640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc10c0ff700 0x7fc10c10f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:15:38.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:38.723+0000 7fc114676640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10c10ff40 con 0x7fc10c0ff700 2024-09-18T21:15:38.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:38.723+0000 7fc114676640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10c110710 con 0x7fc10c0666b0 2024-09-18T21:15:38.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:38.723+0000 7fc111c11640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc10c0ff700 0x7fc10c10f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:15:38.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:38.723+0000 7fc111c11640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc10c0ff700 0x7fc10c10f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37102/0 (socket says 172.21.15.77:37102) 2024-09-18T21:15:38.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:38.723+0000 7fc111c11640 1 -- 172.21.15.77:0/1998898218 learned_addr learned my addr 172.21.15.77:0/1998898218 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:15:38.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:38.723+0000 7fc112412640 1 --2- 172.21.15.77:0/1998898218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc10c0666b0 0x7fc10c10f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:15:38.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:38.724+0000 7fc111c11640 1 -- 172.21.15.77:0/1998898218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc10c0666b0 msgr2=0x7fc10c10f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:38.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:38.724+0000 7fc111c11640 1 --2- 172.21.15.77:0/1998898218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc10c0666b0 0x7fc10c10f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:38.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:38.724+0000 7fc111c11640 1 -- 172.21.15.77:0/1998898218 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc108005040 con 0x7fc10c0ff700 2024-09-18T21:15:38.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:38.724+0000 7fc111c11640 1 --2- 172.21.15.77:0/1998898218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc10c0ff700 0x7fc10c10f8f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc10000c810 tx=0x7fc1000043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:15:38.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:38.724+0000 7fc0feffd640 1 -- 172.21.15.77:0/1998898218 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc10000a7a0 con 0x7fc10c0ff700 2024-09-18T21:15:38.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:38.724+0000 7fc114676640 1 -- 172.21.15.77:0/1998898218 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc10c1109a0 con 0x7fc10c0ff700 2024-09-18T21:15:38.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:38.724+0000 7fc0feffd640 1 -- 172.21.15.77:0/1998898218 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc10000ada0 con 0x7fc10c0ff700 2024-09-18T21:15:38.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:38.724+0000 7fc0feffd640 1 -- 172.21.15.77:0/1998898218 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc100011380 con 0x7fc10c0ff700 2024-09-18T21:15:38.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:38.724+0000 7fc114676640 1 -- 172.21.15.77:0/1998898218 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc10c110f40 con 0x7fc10c0ff700 2024-09-18T21:15:38.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:38.725+0000 7fc114676640 1 -- 172.21.15.77:0/1998898218 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc10c0fa8b0 con 0x7fc10c0ff700 2024-09-18T21:15:38.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:38.726+0000 7fc0feffd640 1 -- 172.21.15.77:0/1998898218 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 36) v1 ==== 92305+0+0 (secure 0 0 0) 0x7fc1000127d0 con 0x7fc10c0ff700 2024-09-18T21:15:38.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:38.726+0000 7fc0feffd640 1 --2- 172.21.15.77:0/1998898218 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fc0f806e1e0 0x7fc0f8070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:15:38.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:38.726+0000 7fc0feffd640 1 -- 172.21.15.77:0/1998898218 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fc10008e1c0 con 0x7fc10c0ff700 2024-09-18T21:15:38.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:38.726+0000 7fc112412640 1 --2- 172.21.15.77:0/1998898218 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fc0f806e1e0 0x7fc0f8070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:15:38.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:38.727+0000 7fc112412640 1 --2- 172.21.15.77:0/1998898218 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fc0f806e1e0 0x7fc0f8070690 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc1080048a0 tx=0x7fc108035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:15:38.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:38.731+0000 7fc0feffd640 1 -- 172.21.15.77:0/1998898218 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fc10005afb0 con 0x7fc10c0ff700 2024-09-18T21:15:38.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:38 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:38.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:38 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:38.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:38 smithi103 ceph-mon[80307]: Reconfiguring crash.smithi103 (monmap changed)... 2024-09-18T21:15:38.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:38 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi103", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-18T21:15:38.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:38 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:15:38.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:38 smithi103 ceph-mon[80307]: Reconfiguring daemon crash.smithi103 on smithi103 2024-09-18T21:15:38.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:38 smithi103 ceph-mon[80307]: pgmap v19: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:15:38.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:38.918+0000 7fc114676640 1 -- 172.21.15.77:0/1998898218 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc10c105110 con 0x7fc0f806e1e0 2024-09-18T21:15:38.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:38.919+0000 7fc0feffd640 1 -- 172.21.15.77:0/1998898218 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fc108039040 con 0x7fc0f806e1e0 2024-09-18T21:15:38.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:38.921+0000 7fc114676640 1 -- 172.21.15.77:0/1998898218 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fc0f806e1e0 msgr2=0x7fc0f8070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:38.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:38.921+0000 7fc114676640 1 --2- 172.21.15.77:0/1998898218 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fc0f806e1e0 0x7fc0f8070690 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc1080048a0 tx=0x7fc108035040 comp rx=0 tx=0).stop 2024-09-18T21:15:38.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:38.921+0000 7fc114676640 1 -- 172.21.15.77:0/1998898218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc10c0ff700 msgr2=0x7fc10c10f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:38.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:38.921+0000 7fc114676640 1 --2- 172.21.15.77:0/1998898218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc10c0ff700 0x7fc10c10f8f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc10000c810 tx=0x7fc1000043c0 comp rx=0 tx=0).stop 2024-09-18T21:15:38.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:38.921+0000 7fc114676640 1 -- 172.21.15.77:0/1998898218 shutdown_connections 2024-09-18T21:15:38.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:38.921+0000 7fc114676640 1 --2- 172.21.15.77:0/1998898218 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc10c0ff700 0x7fc10c10f8f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:38.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:38.921+0000 7fc114676640 1 --2- 172.21.15.77:0/1998898218 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fc0f806e1e0 0x7fc0f8070690 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:38.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:38.921+0000 7fc114676640 1 --2- 172.21.15.77:0/1998898218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc10c0666b0 0x7fc10c10f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:38.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:38.921+0000 7fc114676640 1 -- 172.21.15.77:0/1998898218 >> 172.21.15.77:0/1998898218 conn(0x7fc10c0f6c10 msgr2=0x7fc10c0fb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:15:38.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:38.922+0000 7fc114676640 1 -- 172.21.15.77:0/1998898218 shutdown_connections 2024-09-18T21:15:38.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:38.922+0000 7fc114676640 1 -- 172.21.15.77:0/1998898218 wait complete. 2024-09-18T21:15:38.931 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-09-18T21:15:39.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.000+0000 7f3b87a25640 1 -- 172.21.15.77:0/566449795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b800666d0 msgr2=0x7f3b800ff1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:39.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.000+0000 7f3b87a25640 1 --2- 172.21.15.77:0/566449795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b800666d0 0x7f3b800ff1c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3b740048d0 tx=0x7f3b74009da0 comp rx=0 tx=0).stop 2024-09-18T21:15:39.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.000+0000 7f3b87a25640 1 -- 172.21.15.77:0/566449795 shutdown_connections 2024-09-18T21:15:39.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.000+0000 7f3b87a25640 1 --2- 172.21.15.77:0/566449795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b800ff700 0x7f3b80101ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:39.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.000+0000 7f3b87a25640 1 --2- 172.21.15.77:0/566449795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b800666d0 0x7f3b800ff1c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:39.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.000+0000 7f3b87a25640 1 -- 172.21.15.77:0/566449795 >> 172.21.15.77:0/566449795 conn(0x7f3b800f6c10 msgr2=0x7f3b800f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:15:39.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.000+0000 7f3b87a25640 1 -- 172.21.15.77:0/566449795 shutdown_connections 2024-09-18T21:15:39.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.000+0000 7f3b87a25640 1 -- 172.21.15.77:0/566449795 wait complete. 2024-09-18T21:15:39.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.001+0000 7f3b87a25640 1 Processor -- start 2024-09-18T21:15:39.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.001+0000 7f3b87a25640 1 -- start start 2024-09-18T21:15:39.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.001+0000 7f3b87a25640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b800666d0 0x7f3b800fcb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:15:39.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.001+0000 7f3b87a25640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b800ff700 0x7f3b800fb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:15:39.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.001+0000 7f3b87a25640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b800fb600 con 0x7f3b800666d0 2024-09-18T21:15:39.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.001+0000 7f3b87a25640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b800fb770 con 0x7f3b800ff700 2024-09-18T21:15:39.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.001+0000 7f3b857c1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b800666d0 0x7f3b800fcb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:15:39.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.001+0000 7f3b857c1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b800666d0 0x7f3b800fcb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37126/0 (socket says 172.21.15.77:37126) 2024-09-18T21:15:39.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.001+0000 7f3b857c1640 1 -- 172.21.15.77:0/468658592 learned_addr learned my addr 172.21.15.77:0/468658592 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:15:39.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.001+0000 7f3b84fc0640 1 --2- 172.21.15.77:0/468658592 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b800ff700 0x7f3b800fb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:15:39.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.001+0000 7f3b857c1640 1 -- 172.21.15.77:0/468658592 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b800ff700 msgr2=0x7f3b800fb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:39.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.001+0000 7f3b857c1640 1 --2- 172.21.15.77:0/468658592 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b800ff700 0x7f3b800fb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:39.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.001+0000 7f3b857c1640 1 -- 172.21.15.77:0/468658592 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b74005040 con 0x7f3b800666d0 2024-09-18T21:15:39.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.001+0000 7f3b84fc0640 1 --2- 172.21.15.77:0/468658592 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b800ff700 0x7f3b800fb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T21:15:39.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.002+0000 7f3b857c1640 1 --2- 172.21.15.77:0/468658592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b800666d0 0x7f3b800fcb30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3b74000c00 tx=0x7f3b74009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:15:39.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.002+0000 7f3b71ffb640 1 -- 172.21.15.77:0/468658592 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b74038070 con 0x7f3b800666d0 2024-09-18T21:15:39.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.002+0000 7f3b71ffb640 1 -- 172.21.15.77:0/468658592 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3b74032d30 con 0x7f3b800666d0 2024-09-18T21:15:39.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.002+0000 7f3b87a25640 1 -- 172.21.15.77:0/468658592 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b800fb9f0 con 0x7f3b800666d0 2024-09-18T21:15:39.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.002+0000 7f3b71ffb640 1 -- 172.21.15.77:0/468658592 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b7403dba0 con 0x7f3b800666d0 2024-09-18T21:15:39.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.002+0000 7f3b87a25640 1 -- 172.21.15.77:0/468658592 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b800fbeb0 con 0x7f3b800666d0 2024-09-18T21:15:39.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.003+0000 7f3b87a25640 1 -- 172.21.15.77:0/468658592 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b800fa8b0 con 0x7f3b800666d0 2024-09-18T21:15:39.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.004+0000 7f3b71ffb640 1 -- 172.21.15.77:0/468658592 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 36) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f3b74030020 con 0x7f3b800666d0 2024-09-18T21:15:39.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.004+0000 7f3b71ffb640 1 --2- 172.21.15.77:0/468658592 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f3b6c06e1e0 0x7f3b6c070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:15:39.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.004+0000 7f3b71ffb640 1 -- 172.21.15.77:0/468658592 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f3b740ae7a0 con 0x7f3b800666d0 2024-09-18T21:15:39.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.004+0000 7f3b84fc0640 1 --2- 172.21.15.77:0/468658592 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f3b6c06e1e0 0x7f3b6c070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:15:39.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.005+0000 7f3b84fc0640 1 --2- 172.21.15.77:0/468658592 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f3b6c06e1e0 0x7f3b6c070690 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c0092f0 tx=0x7f3b7c009e00 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:15:39.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.009+0000 7f3b71ffb640 1 -- 172.21.15.77:0/468658592 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f3b74077a60 con 0x7f3b800666d0 2024-09-18T21:15:39.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.193+0000 7f3b87a25640 1 -- 172.21.15.77:0/468658592 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b800f8750 con 0x7f3b6c06e1e0 2024-09-18T21:15:39.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.195+0000 7f3b71ffb640 1 -- 172.21.15.77:0/468658592 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f3b800f8750 con 0x7f3b6c06e1e0 2024-09-18T21:15:39.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.197+0000 7f3b87a25640 1 -- 172.21.15.77:0/468658592 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f3b6c06e1e0 msgr2=0x7f3b6c070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:39.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.197+0000 7f3b87a25640 1 --2- 172.21.15.77:0/468658592 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f3b6c06e1e0 0x7f3b6c070690 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c0092f0 tx=0x7f3b7c009e00 comp rx=0 tx=0).stop 2024-09-18T21:15:39.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.197+0000 7f3b87a25640 1 -- 172.21.15.77:0/468658592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b800666d0 msgr2=0x7f3b800fcb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:39.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.197+0000 7f3b87a25640 1 --2- 172.21.15.77:0/468658592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b800666d0 0x7f3b800fcb30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3b74000c00 tx=0x7f3b74009da0 comp rx=0 tx=0).stop 2024-09-18T21:15:39.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.197+0000 7f3b87a25640 1 -- 172.21.15.77:0/468658592 shutdown_connections 2024-09-18T21:15:39.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.197+0000 7f3b87a25640 1 --2- 172.21.15.77:0/468658592 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f3b6c06e1e0 0x7f3b6c070690 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:39.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.197+0000 7f3b87a25640 1 --2- 172.21.15.77:0/468658592 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b800ff700 0x7f3b800fb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:39.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.197+0000 7f3b87a25640 1 --2- 172.21.15.77:0/468658592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b800666d0 0x7f3b800fcb30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:39.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.197+0000 7f3b87a25640 1 -- 172.21.15.77:0/468658592 >> 172.21.15.77:0/468658592 conn(0x7f3b800f6c10 msgr2=0x7f3b800f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:15:39.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.197+0000 7f3b87a25640 1 -- 172.21.15.77:0/468658592 shutdown_connections 2024-09-18T21:15:39.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.197+0000 7f3b87a25640 1 -- 172.21.15.77:0/468658592 wait complete. 2024-09-18T21:15:39.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.275+0000 7f664e764640 1 -- 172.21.15.77:0/4239752624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66480fc520 msgr2=0x7f66480fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:39.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.276+0000 7f664e764640 1 --2- 172.21.15.77:0/4239752624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66480fc520 0x7f66480fc930 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f66380048d0 tx=0x7f6638009da0 comp rx=0 tx=0).stop 2024-09-18T21:15:39.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.276+0000 7f664e764640 1 -- 172.21.15.77:0/4239752624 shutdown_connections 2024-09-18T21:15:39.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.276+0000 7f664e764640 1 --2- 172.21.15.77:0/4239752624 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66480fd7f0 0x7f66480fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:39.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.276+0000 7f664e764640 1 --2- 172.21.15.77:0/4239752624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66480fc520 0x7f66480fc930 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:39.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.276+0000 7f664e764640 1 -- 172.21.15.77:0/4239752624 >> 172.21.15.77:0/4239752624 conn(0x7f66480f7ce0 msgr2=0x7f66480fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:15:39.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.276+0000 7f664e764640 1 -- 172.21.15.77:0/4239752624 shutdown_connections 2024-09-18T21:15:39.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.276+0000 7f664e764640 1 -- 172.21.15.77:0/4239752624 wait complete. 2024-09-18T21:15:39.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.276+0000 7f664e764640 1 Processor -- start 2024-09-18T21:15:39.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.276+0000 7f664e764640 1 -- start start 2024-09-18T21:15:39.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.276+0000 7f664e764640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66480fc520 0x7f664810d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:15:39.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.276+0000 7f664e764640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66480fd7f0 0x7f664810d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:15:39.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.276+0000 7f664e764640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f664810dc40 con 0x7f66480fd7f0 2024-09-18T21:15:39.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.276+0000 7f664e764640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f664810e460 con 0x7f66480fc520 2024-09-18T21:15:39.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.277+0000 7f66477fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66480fd7f0 0x7f664810d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:15:39.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.277+0000 7f66477fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66480fd7f0 0x7f664810d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37146/0 (socket says 172.21.15.77:37146) 2024-09-18T21:15:39.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.277+0000 7f66477fe640 1 -- 172.21.15.77:0/2995895201 learned_addr learned my addr 172.21.15.77:0/2995895201 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:15:39.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.277+0000 7f6647fff640 1 --2- 172.21.15.77:0/2995895201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66480fc520 0x7f664810d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:15:39.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.277+0000 7f66477fe640 1 -- 172.21.15.77:0/2995895201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66480fc520 msgr2=0x7f664810d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:39.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.277+0000 7f66477fe640 1 --2- 172.21.15.77:0/2995895201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66480fc520 0x7f664810d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:39.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.277+0000 7f66477fe640 1 -- 172.21.15.77:0/2995895201 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6638005040 con 0x7f66480fd7f0 2024-09-18T21:15:39.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.277+0000 7f66477fe640 1 --2- 172.21.15.77:0/2995895201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66480fd7f0 0x7f664810d5f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f663000eb70 tx=0x7f663000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:15:39.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.277+0000 7f6644ff9640 1 -- 172.21.15.77:0/2995895201 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6630007c30 con 0x7f66480fd7f0 2024-09-18T21:15:39.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.277+0000 7f664e764640 1 -- 172.21.15.77:0/2995895201 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f664810e690 con 0x7f66480fd7f0 2024-09-18T21:15:39.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.277+0000 7f6644ff9640 1 -- 172.21.15.77:0/2995895201 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f663000f040 con 0x7f66480fd7f0 2024-09-18T21:15:39.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.277+0000 7f6644ff9640 1 -- 172.21.15.77:0/2995895201 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f663000ca60 con 0x7f66480fd7f0 2024-09-18T21:15:39.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.277+0000 7f664e764640 1 -- 172.21.15.77:0/2995895201 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f664810ec30 con 0x7f66480fd7f0 2024-09-18T21:15:39.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.278+0000 7f664e764640 1 -- 172.21.15.77:0/2995895201 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66480fb980 con 0x7f66480fd7f0 2024-09-18T21:15:39.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.279+0000 7f6644ff9640 1 -- 172.21.15.77:0/2995895201 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 36) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f663000cbc0 con 0x7f66480fd7f0 2024-09-18T21:15:39.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.279+0000 7f6644ff9640 1 --2- 172.21.15.77:0/2995895201 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f663406e1e0 0x7f6634070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:15:39.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.279+0000 7f6644ff9640 1 -- 172.21.15.77:0/2995895201 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f663008d990 con 0x7f66480fd7f0 2024-09-18T21:15:39.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.279+0000 7f6647fff640 1 --2- 172.21.15.77:0/2995895201 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f663406e1e0 0x7f6634070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:15:39.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.280+0000 7f6647fff640 1 --2- 172.21.15.77:0/2995895201 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f663406e1e0 0x7f6634070690 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6638004540 tx=0x7f6638035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:15:39.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.284+0000 7f6644ff9640 1 -- 172.21.15.77:0/2995895201 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f6630056bf0 con 0x7f66480fd7f0 2024-09-18T21:15:39.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.458+0000 7f664e764640 1 -- 172.21.15.77:0/2995895201 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f664810ef60 con 0x7f663406e1e0 2024-09-18T21:15:39.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.468+0000 7f6644ff9640 1 -- 172.21.15.77:0/2995895201 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f664810ef60 con 0x7f663406e1e0 2024-09-18T21:15:39.469 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T21:15:39.469 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager.smithi077 smithi077 *:9093,9094 running (2m) 28s ago 10m 16.6M - 0.25.0 c8568f914cd2 b201d325a55b 2024-09-18T21:15:39.469 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi077 smithi077 running (10m) 28s ago 10m 6899k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 0beb64a8c2ea 2024-09-18T21:15:39.469 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi103 smithi103 running (9m) 17s ago 9m 6891k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 04981ca7bf34 2024-09-18T21:15:39.472 INFO:teuthology.orchestra.run.smithi077.stdout:grafana.smithi077 smithi077 *:3000 running (2m) 28s ago 10m 77.7M - 9.4.7 954c08fa6188 d06ef3ab9e66 2024-09-18T21:15:39.472 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.cqfhlw smithi077 running (5m) 28s ago 5m 13.9M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 a7ec3b7701b6 2024-09-18T21:15:39.472 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.vruydi smithi077 running (5m) 28s ago 5m 141M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 affbba097d3b 2024-09-18T21:15:39.472 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi103.opftmf smithi103 running (5m) 17s ago 5m 16.3M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 111f884c5a34 2024-09-18T21:15:39.472 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi103.zhdmdg smithi103 running (5m) 17s ago 5m 15.5M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 50b77d0edda5 2024-09-18T21:15:39.472 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi077.utkpjg smithi077 *:8443,9283,8765 running (106s) 28s ago 11m 473M - 19.1.1-17-g06b1b1de f79f744f586d 99d4b0fd70f6 2024-09-18T21:15:39.472 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi103.zjztqc smithi103 *:8443,9283,8765 running (55s) 17s ago 9m 437M - 19.1.1-17-g06b1b1de f79f744f586d 54589547c4d7 2024-09-18T21:15:39.472 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi077 smithi077 running (41s) 28s ago 11m 28.7M 2048M 19.1.1-17-g06b1b1de f79f744f586d 2d0fbbea1264 2024-09-18T21:15:39.473 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi103 smithi103 running (21s) 17s ago 9m 23.2M 2048M 19.1.1-17-g06b1b1de f79f744f586d dc79edbd9602 2024-09-18T21:15:39.473 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi077 smithi077 *:9100 running (2m) 28s ago 10m 13.3M - 1.5.0 0da6a335fe13 99144245c1af 2024-09-18T21:15:39.473 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi103 smithi103 *:9100 running (2m) 17s ago 9m 16.5M - 1.5.0 0da6a335fe13 e5b51144d997 2024-09-18T21:15:39.473 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (8m) 28s ago 8m 223M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 2e3563c32cf5 2024-09-18T21:15:39.473 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi077 running (8m) 28s ago 8m 235M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 39c2ccbb7603 2024-09-18T21:15:39.473 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi077 running (7m) 28s ago 7m 199M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 2ff2728057e2 2024-09-18T21:15:39.473 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi103 running (7m) 17s ago 7m 275M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 0e72b1bbb8ce 2024-09-18T21:15:39.473 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi103 running (7m) 17s ago 7m 244M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 85f1ce1e8bee 2024-09-18T21:15:39.473 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi103 running (6m) 17s ago 6m 227M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 cf8964b3ac6d 2024-09-18T21:15:39.473 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus.smithi077 smithi077 *:9095 running (60s) 28s ago 10m 47.5M - 2.43.0 a07b618ecd1d 41f3729e3400 2024-09-18T21:15:39.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.470+0000 7f664e764640 1 -- 172.21.15.77:0/2995895201 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f663406e1e0 msgr2=0x7f6634070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:39.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.470+0000 7f664e764640 1 --2- 172.21.15.77:0/2995895201 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f663406e1e0 0x7f6634070690 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6638004540 tx=0x7f6638035040 comp rx=0 tx=0).stop 2024-09-18T21:15:39.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.470+0000 7f664e764640 1 -- 172.21.15.77:0/2995895201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66480fd7f0 msgr2=0x7f664810d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:39.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.470+0000 7f664e764640 1 --2- 172.21.15.77:0/2995895201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66480fd7f0 0x7f664810d5f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f663000eb70 tx=0x7f663000b040 comp rx=0 tx=0).stop 2024-09-18T21:15:39.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.470+0000 7f664e764640 1 -- 172.21.15.77:0/2995895201 shutdown_connections 2024-09-18T21:15:39.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.470+0000 7f664e764640 1 --2- 172.21.15.77:0/2995895201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66480fd7f0 0x7f664810d5f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:39.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.470+0000 7f664e764640 1 --2- 172.21.15.77:0/2995895201 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f663406e1e0 0x7f6634070690 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:39.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.470+0000 7f664e764640 1 --2- 172.21.15.77:0/2995895201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66480fc520 0x7f664810d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:39.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.470+0000 7f664e764640 1 -- 172.21.15.77:0/2995895201 >> 172.21.15.77:0/2995895201 conn(0x7f66480f7ce0 msgr2=0x7f66480f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:15:39.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.470+0000 7f664e764640 1 -- 172.21.15.77:0/2995895201 shutdown_connections 2024-09-18T21:15:39.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.470+0000 7f664e764640 1 -- 172.21.15.77:0/2995895201 wait complete. 2024-09-18T21:15:39.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.546+0000 7ff15a314640 1 -- 172.21.15.77:0/773128585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1540ff720 msgr2=0x7ff154101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:39.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.546+0000 7ff15a314640 1 --2- 172.21.15.77:0/773128585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1540ff720 0x7ff154101b00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff13c0048d0 tx=0x7ff13c009da0 comp rx=0 tx=0).stop 2024-09-18T21:15:39.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.546+0000 7ff15a314640 1 -- 172.21.15.77:0/773128585 shutdown_connections 2024-09-18T21:15:39.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.546+0000 7ff15a314640 1 --2- 172.21.15.77:0/773128585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1540ff720 0x7ff154101b00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:39.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.546+0000 7ff15a314640 1 --2- 172.21.15.77:0/773128585 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1540666b0 0x7ff1540ff1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:39.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.546+0000 7ff15a314640 1 -- 172.21.15.77:0/773128585 >> 172.21.15.77:0/773128585 conn(0x7ff1540f6c10 msgr2=0x7ff1540f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:15:39.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.546+0000 7ff15a314640 1 -- 172.21.15.77:0/773128585 shutdown_connections 2024-09-18T21:15:39.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.547+0000 7ff15a314640 1 -- 172.21.15.77:0/773128585 wait complete. 2024-09-18T21:15:39.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.547+0000 7ff15a314640 1 Processor -- start 2024-09-18T21:15:39.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.547+0000 7ff15a314640 1 -- start start 2024-09-18T21:15:39.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.547+0000 7ff15a314640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1540666b0 0x7ff1540fcbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:15:39.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.547+0000 7ff15a314640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1540ff720 0x7ff1540fb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:15:39.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.547+0000 7ff15a314640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1540fb670 con 0x7ff1540ff720 2024-09-18T21:15:39.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.547+0000 7ff15a314640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1540fb7b0 con 0x7ff1540666b0 2024-09-18T21:15:39.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.547+0000 7ff1537fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1540ff720 0x7ff1540fb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:15:39.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.547+0000 7ff1537fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1540ff720 0x7ff1540fb0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45304/0 (socket says 172.21.15.77:45304) 2024-09-18T21:15:39.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.547+0000 7ff1537fe640 1 -- 172.21.15.77:0/2123089583 learned_addr learned my addr 172.21.15.77:0/2123089583 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:15:39.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.547+0000 7ff153fff640 1 --2- 172.21.15.77:0/2123089583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1540666b0 0x7ff1540fcbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:15:39.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.548+0000 7ff1537fe640 1 -- 172.21.15.77:0/2123089583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1540666b0 msgr2=0x7ff1540fcbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:39.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.548+0000 7ff1537fe640 1 --2- 172.21.15.77:0/2123089583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1540666b0 0x7ff1540fcbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:39.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.548+0000 7ff1537fe640 1 -- 172.21.15.77:0/2123089583 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff13c005040 con 0x7ff1540ff720 2024-09-18T21:15:39.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.548+0000 7ff1537fe640 1 --2- 172.21.15.77:0/2123089583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1540ff720 0x7ff1540fb0e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff13c0048a0 tx=0x7ff13c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:15:39.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.548+0000 7ff150ff9640 1 -- 172.21.15.77:0/2123089583 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff13c038070 con 0x7ff1540ff720 2024-09-18T21:15:39.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.548+0000 7ff150ff9640 1 -- 172.21.15.77:0/2123089583 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff13c02abd0 con 0x7ff1540ff720 2024-09-18T21:15:39.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.548+0000 7ff15a314640 1 -- 172.21.15.77:0/2123089583 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1540fba30 con 0x7ff1540ff720 2024-09-18T21:15:39.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.548+0000 7ff150ff9640 1 -- 172.21.15.77:0/2123089583 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff13c033640 con 0x7ff1540ff720 2024-09-18T21:15:39.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.548+0000 7ff15a314640 1 -- 172.21.15.77:0/2123089583 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff154115130 con 0x7ff1540ff720 2024-09-18T21:15:39.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.549+0000 7ff15a314640 1 -- 172.21.15.77:0/2123089583 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1540fa8b0 con 0x7ff1540ff720 2024-09-18T21:15:39.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.550+0000 7ff150ff9640 1 -- 172.21.15.77:0/2123089583 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 36) v1 ==== 92305+0+0 (secure 0 0 0) 0x7ff13c030020 con 0x7ff1540ff720 2024-09-18T21:15:39.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.550+0000 7ff150ff9640 1 --2- 172.21.15.77:0/2123089583 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7ff14006e1e0 0x7ff140070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:15:39.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.550+0000 7ff150ff9640 1 -- 172.21.15.77:0/2123089583 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6324+0+0 (secure 0 0 0) 0x7ff13c0adeb0 con 0x7ff1540ff720 2024-09-18T21:15:39.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.550+0000 7ff153fff640 1 --2- 172.21.15.77:0/2123089583 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7ff14006e1e0 0x7ff140070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:15:39.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.551+0000 7ff153fff640 1 --2- 172.21.15.77:0/2123089583 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7ff14006e1e0 0x7ff140070690 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff1540fc9a0 tx=0x7ff144009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:15:39.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.555+0000 7ff150ff9640 1 -- 172.21.15.77:0/2123089583 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7ff13c0772a0 con 0x7ff1540ff720 2024-09-18T21:15:39.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.790+0000 7ff15a314640 1 -- 172.21.15.77:0/2123089583 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff15404b720 con 0x7ff1540ff720 2024-09-18T21:15:39.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.790+0000 7ff150ff9640 1 -- 172.21.15.77:0/2123089583 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+742 (secure 0 0 0) 0x7ff13c07a960 con 0x7ff1540ff720 2024-09-18T21:15:39.791 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-18T21:15:39.792 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": { 2024-09-18T21:15:39.792 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 2 2024-09-18T21:15:39.792 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:15:39.792 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": { 2024-09-18T21:15:39.792 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 2 2024-09-18T21:15:39.792 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:15:39.792 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": { 2024-09-18T21:15:39.792 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 6 2024-09-18T21:15:39.792 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:15:39.792 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-09-18T21:15:39.792 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4 2024-09-18T21:15:39.792 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:15:39.792 INFO:teuthology.orchestra.run.smithi077.stdout: "overall": { 2024-09-18T21:15:39.792 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 10, 2024-09-18T21:15:39.793 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 4 2024-09-18T21:15:39.793 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-18T21:15:39.793 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-18T21:15:39.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.792+0000 7ff15a314640 1 -- 172.21.15.77:0/2123089583 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7ff14006e1e0 msgr2=0x7ff140070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:39.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.792+0000 7ff15a314640 1 --2- 172.21.15.77:0/2123089583 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7ff14006e1e0 0x7ff140070690 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff1540fc9a0 tx=0x7ff144009040 comp rx=0 tx=0).stop 2024-09-18T21:15:39.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.792+0000 7ff15a314640 1 -- 172.21.15.77:0/2123089583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1540ff720 msgr2=0x7ff1540fb0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:39.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.792+0000 7ff15a314640 1 --2- 172.21.15.77:0/2123089583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1540ff720 0x7ff1540fb0e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff13c0048a0 tx=0x7ff13c009da0 comp rx=0 tx=0).stop 2024-09-18T21:15:39.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.792+0000 7ff15a314640 1 -- 172.21.15.77:0/2123089583 shutdown_connections 2024-09-18T21:15:39.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.792+0000 7ff15a314640 1 --2- 172.21.15.77:0/2123089583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1540ff720 0x7ff1540fb0e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:39.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.792+0000 7ff15a314640 1 --2- 172.21.15.77:0/2123089583 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7ff14006e1e0 0x7ff140070690 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:39.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.792+0000 7ff15a314640 1 --2- 172.21.15.77:0/2123089583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1540666b0 0x7ff1540fcbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:39.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.792+0000 7ff15a314640 1 -- 172.21.15.77:0/2123089583 >> 172.21.15.77:0/2123089583 conn(0x7ff1540f6c10 msgr2=0x7ff1540f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:15:39.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.793+0000 7ff15a314640 1 -- 172.21.15.77:0/2123089583 shutdown_connections 2024-09-18T21:15:39.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.793+0000 7ff15a314640 1 -- 172.21.15.77:0/2123089583 wait complete. 2024-09-18T21:15:39.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.874+0000 7f591e752640 1 -- 172.21.15.77:0/1363846442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59180ff6a0 msgr2=0x7f5918101a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:39.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.874+0000 7f591e752640 1 --2- 172.21.15.77:0/1363846442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59180ff6a0 0x7f5918101a80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f590c0048d0 tx=0x7f590c009da0 comp rx=0 tx=0).stop 2024-09-18T21:15:39.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.874+0000 7f591e752640 1 -- 172.21.15.77:0/1363846442 shutdown_connections 2024-09-18T21:15:39.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.874+0000 7f591e752640 1 --2- 172.21.15.77:0/1363846442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59180ff6a0 0x7f5918101a80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:39.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.874+0000 7f591e752640 1 --2- 172.21.15.77:0/1363846442 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5918066710 0x7f59180ff160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:39.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.874+0000 7f591e752640 1 -- 172.21.15.77:0/1363846442 >> 172.21.15.77:0/1363846442 conn(0x7f59180f6c10 msgr2=0x7f59180f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:15:39.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.874+0000 7f591e752640 1 -- 172.21.15.77:0/1363846442 shutdown_connections 2024-09-18T21:15:39.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.874+0000 7f591e752640 1 -- 172.21.15.77:0/1363846442 wait complete. 2024-09-18T21:15:39.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.875+0000 7f591e752640 1 Processor -- start 2024-09-18T21:15:39.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.875+0000 7f591e752640 1 -- start start 2024-09-18T21:15:39.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.875+0000 7f591e752640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5918066710 0x7f591810d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:15:39.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.875+0000 7f591e752640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59180ff6a0 0x7f591810d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:15:39.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.875+0000 7f591e752640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f591810e520 con 0x7f5918066710 2024-09-18T21:15:39.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.875+0000 7f591e752640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f591810e690 con 0x7f59180ff6a0 2024-09-18T21:15:39.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.875+0000 7f5917fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5918066710 0x7f591810d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:15:39.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.875+0000 7f5917fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5918066710 0x7f591810d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45328/0 (socket says 172.21.15.77:45328) 2024-09-18T21:15:39.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.875+0000 7f5917fff640 1 -- 172.21.15.77:0/3598981756 learned_addr learned my addr 172.21.15.77:0/3598981756 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:15:39.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.875+0000 7f59177fe640 1 --2- 172.21.15.77:0/3598981756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59180ff6a0 0x7f591810d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:15:39.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.876+0000 7f5917fff640 1 -- 172.21.15.77:0/3598981756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59180ff6a0 msgr2=0x7f591810d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:39.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.876+0000 7f5917fff640 1 --2- 172.21.15.77:0/3598981756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59180ff6a0 0x7f591810d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:39.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.876+0000 7f5917fff640 1 -- 172.21.15.77:0/3598981756 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f590c005040 con 0x7f5918066710 2024-09-18T21:15:39.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.876+0000 7f5917fff640 1 --2- 172.21.15.77:0/3598981756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5918066710 0x7f591810d170 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f590800b580 tx=0x7f59080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:15:39.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.876+0000 7f5914ff9640 1 -- 172.21.15.77:0/3598981756 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f590800f6f0 con 0x7f5918066710 2024-09-18T21:15:39.879 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.876+0000 7f5914ff9640 1 -- 172.21.15.77:0/3598981756 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f590800fcf0 con 0x7f5918066710 2024-09-18T21:15:39.879 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.876+0000 7f591e752640 1 -- 172.21.15.77:0/3598981756 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f591810e970 con 0x7f5918066710 2024-09-18T21:15:39.879 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.876+0000 7f5914ff9640 1 -- 172.21.15.77:0/3598981756 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59080103a0 con 0x7f5918066710 2024-09-18T21:15:39.879 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.876+0000 7f591e752640 1 -- 172.21.15.77:0/3598981756 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f591810ee90 con 0x7f5918066710 2024-09-18T21:15:39.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.877+0000 7f591e752640 1 -- 172.21.15.77:0/3598981756 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5918105800 con 0x7f5918066710 2024-09-18T21:15:39.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.877+0000 7f5914ff9640 1 -- 172.21.15.77:0/3598981756 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 36) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f59080116b0 con 0x7f5918066710 2024-09-18T21:15:39.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.878+0000 7f5914ff9640 1 --2- 172.21.15.77:0/3598981756 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f590006e1e0 0x7f5900070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:15:39.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.878+0000 7f5914ff9640 1 -- 172.21.15.77:0/3598981756 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f590808da30 con 0x7f5918066710 2024-09-18T21:15:39.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.878+0000 7f59177fe640 1 --2- 172.21.15.77:0/3598981756 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f590006e1e0 0x7f5900070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:15:39.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.878+0000 7f59177fe640 1 --2- 172.21.15.77:0/3598981756 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f590006e1e0 0x7f5900070690 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f591810cf20 tx=0x7f590c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:15:39.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:39.882+0000 7f5914ff9640 1 -- 172.21.15.77:0/3598981756 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f5908056e10 con 0x7f5918066710 2024-09-18T21:15:40.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.081+0000 7f591e752640 1 -- 172.21.15.77:0/3598981756 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f591804b720 con 0x7f5918066710 2024-09-18T21:15:40.083 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:39 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:40.083 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:39 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:40.083 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:39 smithi077 ceph-mon[92672]: Reconfiguring mgr.smithi103.zjztqc (monmap changed)... 2024-09-18T21:15:40.083 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:39 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi103.zjztqc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T21:15:40.083 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:39 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T21:15:40.083 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:39 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:15:40.083 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:39 smithi077 ceph-mon[92672]: Reconfiguring daemon mgr.smithi103.zjztqc on smithi103 2024-09-18T21:15:40.083 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:39 smithi077 ceph-mon[92672]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:15:40.084 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:39 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/2123089583' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:15:40.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.082+0000 7f5914ff9640 1 -- 172.21.15.77:0/3598981756 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1915 (secure 0 0 0) 0x7f590805a4d0 con 0x7f5918066710 2024-09-18T21:15:40.084 INFO:teuthology.orchestra.run.smithi077.stdout:e13 2024-09-18T21:15:40.084 INFO:teuthology.orchestra.run.smithi077.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-18T21:15:40.084 INFO:teuthology.orchestra.run.smithi077.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T21:15:40.084 INFO:teuthology.orchestra.run.smithi077.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T21:15:40.085 INFO:teuthology.orchestra.run.smithi077.stdout:legacy client fscid: 1 2024-09-18T21:15:40.085 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:15:40.085 INFO:teuthology.orchestra.run.smithi077.stdout:Filesystem 'cephfs' (1) 2024-09-18T21:15:40.085 INFO:teuthology.orchestra.run.smithi077.stdout:fs_name cephfs 2024-09-18T21:15:40.085 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 13 2024-09-18T21:15:40.085 INFO:teuthology.orchestra.run.smithi077.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T21:15:40.085 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-09-18T21:10:17.230179+0000 2024-09-18T21:15:40.085 INFO:teuthology.orchestra.run.smithi077.stdout:modified 2024-09-18T21:10:33.373241+0000 2024-09-18T21:15:40.085 INFO:teuthology.orchestra.run.smithi077.stdout:tableserver 0 2024-09-18T21:15:40.085 INFO:teuthology.orchestra.run.smithi077.stdout:root 0 2024-09-18T21:15:40.085 INFO:teuthology.orchestra.run.smithi077.stdout:session_timeout 60 2024-09-18T21:15:40.085 INFO:teuthology.orchestra.run.smithi077.stdout:session_autoclose 300 2024-09-18T21:15:40.086 INFO:teuthology.orchestra.run.smithi077.stdout:max_file_size 1099511627776 2024-09-18T21:15:40.086 INFO:teuthology.orchestra.run.smithi077.stdout:max_xattr_size 65536 2024-09-18T21:15:40.086 INFO:teuthology.orchestra.run.smithi077.stdout:required_client_features {} 2024-09-18T21:15:40.086 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure 0 2024-09-18T21:15:40.086 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure_osd_epoch 0 2024-09-18T21:15:40.086 INFO:teuthology.orchestra.run.smithi077.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T21:15:40.086 INFO:teuthology.orchestra.run.smithi077.stdout:max_mds 1 2024-09-18T21:15:40.086 INFO:teuthology.orchestra.run.smithi077.stdout:in 0 2024-09-18T21:15:40.086 INFO:teuthology.orchestra.run.smithi077.stdout:up {0=14446} 2024-09-18T21:15:40.086 INFO:teuthology.orchestra.run.smithi077.stdout:failed 2024-09-18T21:15:40.086 INFO:teuthology.orchestra.run.smithi077.stdout:damaged 2024-09-18T21:15:40.086 INFO:teuthology.orchestra.run.smithi077.stdout:stopped 2024-09-18T21:15:40.086 INFO:teuthology.orchestra.run.smithi077.stdout:data_pools [3] 2024-09-18T21:15:40.086 INFO:teuthology.orchestra.run.smithi077.stdout:metadata_pool 2 2024-09-18T21:15:40.087 INFO:teuthology.orchestra.run.smithi077.stdout:inline_data disabled 2024-09-18T21:15:40.087 INFO:teuthology.orchestra.run.smithi077.stdout:balancer 2024-09-18T21:15:40.087 INFO:teuthology.orchestra.run.smithi077.stdout:bal_rank_mask -1 2024-09-18T21:15:40.087 INFO:teuthology.orchestra.run.smithi077.stdout:standby_count_wanted 1 2024-09-18T21:15:40.087 INFO:teuthology.orchestra.run.smithi077.stdout:qdb_cluster leader: 0 members: 2024-09-18T21:15:40.087 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.vruydi{0:14446} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.77:6826/334039954,v1:172.21.15.77:6827/334039954] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:15:40.087 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:15:40.087 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:15:40.087 INFO:teuthology.orchestra.run.smithi077.stdout:Standby daemons: 2024-09-18T21:15:40.087 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:15:40.087 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.cqfhlw{-1:14458} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.77:6828/862540650,v1:172.21.15.77:6829/862540650] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:15:40.087 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi103.zhdmdg{-1:24255} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.103:6824/2170237078,v1:172.21.15.103:6825/2170237078] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:15:40.087 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi103.opftmf{-1:24267} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.103:6826/4241818403,v1:172.21.15.103:6827/4241818403] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:15:40.088 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 13 2024-09-18T21:15:40.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.084+0000 7f591e752640 1 -- 172.21.15.77:0/3598981756 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f590006e1e0 msgr2=0x7f5900070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:40.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.084+0000 7f591e752640 1 --2- 172.21.15.77:0/3598981756 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f590006e1e0 0x7f5900070690 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f591810cf20 tx=0x7f590c035040 comp rx=0 tx=0).stop 2024-09-18T21:15:40.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.084+0000 7f591e752640 1 -- 172.21.15.77:0/3598981756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5918066710 msgr2=0x7f591810d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:40.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.084+0000 7f591e752640 1 --2- 172.21.15.77:0/3598981756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5918066710 0x7f591810d170 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f590800b580 tx=0x7f59080091a0 comp rx=0 tx=0).stop 2024-09-18T21:15:40.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.084+0000 7f591e752640 1 -- 172.21.15.77:0/3598981756 shutdown_connections 2024-09-18T21:15:40.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.084+0000 7f591e752640 1 --2- 172.21.15.77:0/3598981756 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f590006e1e0 0x7f5900070690 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:40.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.084+0000 7f591e752640 1 --2- 172.21.15.77:0/3598981756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59180ff6a0 0x7f591810d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:40.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.084+0000 7f591e752640 1 --2- 172.21.15.77:0/3598981756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5918066710 0x7f591810d170 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:40.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.084+0000 7f591e752640 1 -- 172.21.15.77:0/3598981756 >> 172.21.15.77:0/3598981756 conn(0x7f59180f6c10 msgr2=0x7f59180f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:15:40.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.085+0000 7f591e752640 1 -- 172.21.15.77:0/3598981756 shutdown_connections 2024-09-18T21:15:40.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.085+0000 7f591e752640 1 -- 172.21.15.77:0/3598981756 wait complete. 2024-09-18T21:15:40.145 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:39 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:40.145 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:39 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:40.145 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:39 smithi103 ceph-mon[80307]: Reconfiguring mgr.smithi103.zjztqc (monmap changed)... 2024-09-18T21:15:40.145 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:39 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi103.zjztqc", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-18T21:15:40.145 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:39 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-18T21:15:40.145 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:39 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:15:40.145 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:39 smithi103 ceph-mon[80307]: Reconfiguring daemon mgr.smithi103.zjztqc on smithi103 2024-09-18T21:15:40.145 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:39 smithi103 ceph-mon[80307]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:15:40.145 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:39 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/2123089583' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:15:40.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.165+0000 7fa913080640 1 -- 172.21.15.77:0/2988107938 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa90c0fc540 msgr2=0x7fa90c0fc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:40.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.165+0000 7fa913080640 1 --2- 172.21.15.77:0/2988107938 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa90c0fc540 0x7fa90c0fc950 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc009c50 tx=0x7fa8fc004d10 comp rx=0 tx=0).stop 2024-09-18T21:15:40.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.165+0000 7fa913080640 1 -- 172.21.15.77:0/2988107938 shutdown_connections 2024-09-18T21:15:40.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.165+0000 7fa913080640 1 --2- 172.21.15.77:0/2988107938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa90c0fd810 0x7fa90c0fdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:40.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.165+0000 7fa913080640 1 --2- 172.21.15.77:0/2988107938 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa90c0fc540 0x7fa90c0fc950 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:40.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.165+0000 7fa913080640 1 -- 172.21.15.77:0/2988107938 >> 172.21.15.77:0/2988107938 conn(0x7fa90c0f7ce0 msgr2=0x7fa90c0fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:15:40.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.165+0000 7fa913080640 1 -- 172.21.15.77:0/2988107938 shutdown_connections 2024-09-18T21:15:40.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.165+0000 7fa913080640 1 -- 172.21.15.77:0/2988107938 wait complete. 2024-09-18T21:15:40.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.166+0000 7fa913080640 1 Processor -- start 2024-09-18T21:15:40.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.166+0000 7fa913080640 1 -- start start 2024-09-18T21:15:40.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.166+0000 7fa913080640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa90c0fc540 0x7fa90c10d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:15:40.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.166+0000 7fa913080640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa90c0fd810 0x7fa90c10d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:15:40.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.166+0000 7fa913080640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa90c10dc30 con 0x7fa90c0fd810 2024-09-18T21:15:40.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.166+0000 7fa913080640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa90c10e450 con 0x7fa90c0fc540 2024-09-18T21:15:40.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.166+0000 7fa90bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa90c0fd810 0x7fa90c10d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:15:40.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.166+0000 7fa90bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa90c0fd810 0x7fa90c10d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45356/0 (socket says 172.21.15.77:45356) 2024-09-18T21:15:40.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.166+0000 7fa90bfff640 1 -- 172.21.15.77:0/1958390282 learned_addr learned my addr 172.21.15.77:0/1958390282 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:15:40.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.166+0000 7fa910e1c640 1 --2- 172.21.15.77:0/1958390282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa90c0fc540 0x7fa90c10d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:15:40.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.167+0000 7fa90bfff640 1 -- 172.21.15.77:0/1958390282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa90c0fc540 msgr2=0x7fa90c10d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:40.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.167+0000 7fa90bfff640 1 --2- 172.21.15.77:0/1958390282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa90c0fc540 0x7fa90c10d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:40.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.167+0000 7fa90bfff640 1 -- 172.21.15.77:0/1958390282 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8fc0098b0 con 0x7fa90c0fd810 2024-09-18T21:15:40.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.167+0000 7fa90bfff640 1 --2- 172.21.15.77:0/1958390282 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa90c0fd810 0x7fa90c10d5e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa900002a50 tx=0x7fa900004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:15:40.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.167+0000 7fa9097fa640 1 -- 172.21.15.77:0/1958390282 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa900007c30 con 0x7fa90c0fd810 2024-09-18T21:15:40.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.167+0000 7fa9097fa640 1 -- 172.21.15.77:0/1958390282 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa90000f040 con 0x7fa90c0fd810 2024-09-18T21:15:40.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.167+0000 7fa913080640 1 -- 172.21.15.77:0/1958390282 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa90c10e6e0 con 0x7fa90c0fd810 2024-09-18T21:15:40.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.167+0000 7fa9097fa640 1 -- 172.21.15.77:0/1958390282 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa90000da90 con 0x7fa90c0fd810 2024-09-18T21:15:40.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.167+0000 7fa913080640 1 -- 172.21.15.77:0/1958390282 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa90c10ec80 con 0x7fa90c0fd810 2024-09-18T21:15:40.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.168+0000 7fa913080640 1 -- 172.21.15.77:0/1958390282 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa90c0fb9a0 con 0x7fa90c0fd810 2024-09-18T21:15:40.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.169+0000 7fa9097fa640 1 -- 172.21.15.77:0/1958390282 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 36) v1 ==== 92305+0+0 (secure 0 0 0) 0x7fa90000dd00 con 0x7fa90c0fd810 2024-09-18T21:15:40.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.169+0000 7fa9097fa640 1 --2- 172.21.15.77:0/1958390282 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fa8f406e1e0 0x7fa8f4070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:15:40.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.169+0000 7fa910e1c640 1 --2- 172.21.15.77:0/1958390282 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fa8f406e1e0 0x7fa8f4070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:15:40.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.169+0000 7fa9097fa640 1 -- 172.21.15.77:0/1958390282 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fa90008d5f0 con 0x7fa90c0fd810 2024-09-18T21:15:40.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.170+0000 7fa910e1c640 1 --2- 172.21.15.77:0/1958390282 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fa8f406e1e0 0x7fa8f4070690 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc000f80 tx=0x7fa8fc004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:15:40.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.174+0000 7fa9097fa640 1 -- 172.21.15.77:0/1958390282 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fa900056850 con 0x7fa90c0fd810 2024-09-18T21:15:40.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.361+0000 7fa913080640 1 -- 172.21.15.77:0/1958390282 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa90c10ef60 con 0x7fa8f406e1e0 2024-09-18T21:15:40.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.363+0000 7fa9097fa640 1 -- 172.21.15.77:0/1958390282 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fa90c10ef60 con 0x7fa8f406e1e0 2024-09-18T21:15:40.364 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-18T21:15:40.364 INFO:teuthology.orchestra.run.smithi077.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a", 2024-09-18T21:15:40.364 INFO:teuthology.orchestra.run.smithi077.stdout: "in_progress": true, 2024-09-18T21:15:40.364 INFO:teuthology.orchestra.run.smithi077.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T21:15:40.364 INFO:teuthology.orchestra.run.smithi077.stdout: "services_complete": [ 2024-09-18T21:15:40.364 INFO:teuthology.orchestra.run.smithi077.stdout: "mon", 2024-09-18T21:15:40.364 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr" 2024-09-18T21:15:40.364 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-18T21:15:40.365 INFO:teuthology.orchestra.run.smithi077.stdout: "progress": "4/21 daemons upgraded", 2024-09-18T21:15:40.365 INFO:teuthology.orchestra.run.smithi077.stdout: "message": "Currently upgrading mon daemons", 2024-09-18T21:15:40.365 INFO:teuthology.orchestra.run.smithi077.stdout: "is_paused": false 2024-09-18T21:15:40.365 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-18T21:15:40.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.365+0000 7fa913080640 1 -- 172.21.15.77:0/1958390282 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fa8f406e1e0 msgr2=0x7fa8f4070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:40.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.365+0000 7fa913080640 1 --2- 172.21.15.77:0/1958390282 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fa8f406e1e0 0x7fa8f4070690 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc000f80 tx=0x7fa8fc004d10 comp rx=0 tx=0).stop 2024-09-18T21:15:40.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.365+0000 7fa913080640 1 -- 172.21.15.77:0/1958390282 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa90c0fd810 msgr2=0x7fa90c10d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:40.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.365+0000 7fa913080640 1 --2- 172.21.15.77:0/1958390282 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa90c0fd810 0x7fa90c10d5e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa900002a50 tx=0x7fa900004600 comp rx=0 tx=0).stop 2024-09-18T21:15:40.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.365+0000 7fa913080640 1 -- 172.21.15.77:0/1958390282 shutdown_connections 2024-09-18T21:15:40.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.365+0000 7fa913080640 1 --2- 172.21.15.77:0/1958390282 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa90c0fd810 0x7fa90c10d5e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:40.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.365+0000 7fa913080640 1 --2- 172.21.15.77:0/1958390282 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fa8f406e1e0 0x7fa8f4070690 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:40.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.365+0000 7fa913080640 1 --2- 172.21.15.77:0/1958390282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa90c0fc540 0x7fa90c10d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:40.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.365+0000 7fa913080640 1 -- 172.21.15.77:0/1958390282 >> 172.21.15.77:0/1958390282 conn(0x7fa90c0f7ce0 msgr2=0x7fa90c0f94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:15:40.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.365+0000 7fa913080640 1 -- 172.21.15.77:0/1958390282 shutdown_connections 2024-09-18T21:15:40.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.365+0000 7fa913080640 1 -- 172.21.15.77:0/1958390282 wait complete. 2024-09-18T21:15:40.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.444+0000 7f42dcedb640 1 -- 172.21.15.77:0/4161614449 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42d80fc700 msgr2=0x7f42d80fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:40.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.444+0000 7f42dcedb640 1 --2- 172.21.15.77:0/4161614449 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42d80fc700 0x7f42d80fcb70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f42c00048d0 tx=0x7f42c0009da0 comp rx=0 tx=0).stop 2024-09-18T21:15:40.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.444+0000 7f42dcedb640 1 -- 172.21.15.77:0/4161614449 shutdown_connections 2024-09-18T21:15:40.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.444+0000 7f42dcedb640 1 --2- 172.21.15.77:0/4161614449 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42d80fc700 0x7f42d80fcb70 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:40.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.444+0000 7f42dcedb640 1 --2- 172.21.15.77:0/4161614449 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42d80fb430 0x7f42d80fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:40.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.444+0000 7f42dcedb640 1 -- 172.21.15.77:0/4161614449 >> 172.21.15.77:0/4161614449 conn(0x7f42d80f6c10 msgr2=0x7f42d80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:15:40.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.444+0000 7f42dcedb640 1 -- 172.21.15.77:0/4161614449 shutdown_connections 2024-09-18T21:15:40.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.444+0000 7f42dcedb640 1 -- 172.21.15.77:0/4161614449 wait complete. 2024-09-18T21:15:40.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.445+0000 7f42dcedb640 1 Processor -- start 2024-09-18T21:15:40.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.445+0000 7f42dcedb640 1 -- start start 2024-09-18T21:15:40.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.445+0000 7f42dcedb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42d80fb430 0x7f42d810d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:15:40.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.445+0000 7f42dcedb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42d80fc700 0x7f42d810d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:15:40.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.445+0000 7f42dcedb640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d810dc20 con 0x7f42d80fb430 2024-09-18T21:15:40.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.445+0000 7f42dcedb640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d810e440 con 0x7f42d80fc700 2024-09-18T21:15:40.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.445+0000 7f42d659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42d80fb430 0x7f42d810d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:15:40.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.445+0000 7f42d659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42d80fb430 0x7f42d810d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45384/0 (socket says 172.21.15.77:45384) 2024-09-18T21:15:40.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.445+0000 7f42d659c640 1 -- 172.21.15.77:0/1214894613 learned_addr learned my addr 172.21.15.77:0/1214894613 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:15:40.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.445+0000 7f42cffff640 1 --2- 172.21.15.77:0/1214894613 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42d80fc700 0x7f42d810d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:15:40.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.446+0000 7f42d659c640 1 -- 172.21.15.77:0/1214894613 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42d80fc700 msgr2=0x7f42d810d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:40.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.446+0000 7f42d659c640 1 --2- 172.21.15.77:0/1214894613 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42d80fc700 0x7f42d810d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:40.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.446+0000 7f42d659c640 1 -- 172.21.15.77:0/1214894613 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c0005040 con 0x7f42d80fb430 2024-09-18T21:15:40.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.446+0000 7f42d659c640 1 --2- 172.21.15.77:0/1214894613 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42d80fb430 0x7f42d810d090 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f42c800eb70 tx=0x7f42c800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:15:40.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.446+0000 7f42ceffd640 1 -- 172.21.15.77:0/1214894613 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42c8007c30 con 0x7f42d80fb430 2024-09-18T21:15:40.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.446+0000 7f42ceffd640 1 -- 172.21.15.77:0/1214894613 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f42c800f040 con 0x7f42d80fb430 2024-09-18T21:15:40.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.446+0000 7f42dcedb640 1 -- 172.21.15.77:0/1214894613 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42d810e670 con 0x7f42d80fb430 2024-09-18T21:15:40.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.446+0000 7f42ceffd640 1 -- 172.21.15.77:0/1214894613 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42c800ca60 con 0x7f42d80fb430 2024-09-18T21:15:40.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.446+0000 7f42dcedb640 1 -- 172.21.15.77:0/1214894613 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d810ec10 con 0x7f42d80fb430 2024-09-18T21:15:40.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.447+0000 7f42dcedb640 1 -- 172.21.15.77:0/1214894613 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42d80fa890 con 0x7f42d80fb430 2024-09-18T21:15:40.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.448+0000 7f42ceffd640 1 -- 172.21.15.77:0/1214894613 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 36) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f42c800cbc0 con 0x7f42d80fb430 2024-09-18T21:15:40.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.448+0000 7f42ceffd640 1 --2- 172.21.15.77:0/1214894613 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f42c406e1e0 0x7f42c4070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:15:40.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.448+0000 7f42ceffd640 1 -- 172.21.15.77:0/1214894613 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f42c808d9e0 con 0x7f42d80fb430 2024-09-18T21:15:40.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.448+0000 7f42cffff640 1 --2- 172.21.15.77:0/1214894613 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f42c406e1e0 0x7f42c4070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:15:40.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.449+0000 7f42cffff640 1 --2- 172.21.15.77:0/1214894613 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f42c406e1e0 0x7f42c4070690 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f42d810ce40 tx=0x7f42c0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:15:40.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.453+0000 7f42ceffd640 1 -- 172.21.15.77:0/1214894613 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f42c8056c40 con 0x7f42d80fb430 2024-09-18T21:15:40.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.692+0000 7f42dcedb640 1 -- 172.21.15.77:0/1214894613 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f42d804b720 con 0x7f42d80fb430 2024-09-18T21:15:40.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.693+0000 7f42ceffd640 1 -- 172.21.15.77:0/1214894613 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f42c805a300 con 0x7f42d80fb430 2024-09-18T21:15:40.694 INFO:teuthology.orchestra.run.smithi077.stdout:HEALTH_OK 2024-09-18T21:15:40.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.695+0000 7f42dcedb640 1 -- 172.21.15.77:0/1214894613 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f42c406e1e0 msgr2=0x7f42c4070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:40.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.695+0000 7f42dcedb640 1 --2- 172.21.15.77:0/1214894613 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f42c406e1e0 0x7f42c4070690 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f42d810ce40 tx=0x7f42c0035040 comp rx=0 tx=0).stop 2024-09-18T21:15:40.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.695+0000 7f42dcedb640 1 -- 172.21.15.77:0/1214894613 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42d80fb430 msgr2=0x7f42d810d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:15:40.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.695+0000 7f42dcedb640 1 --2- 172.21.15.77:0/1214894613 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42d80fb430 0x7f42d810d090 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f42c800eb70 tx=0x7f42c800b040 comp rx=0 tx=0).stop 2024-09-18T21:15:40.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.695+0000 7f42dcedb640 1 -- 172.21.15.77:0/1214894613 shutdown_connections 2024-09-18T21:15:40.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.695+0000 7f42dcedb640 1 --2- 172.21.15.77:0/1214894613 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f42c406e1e0 0x7f42c4070690 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:40.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.695+0000 7f42dcedb640 1 --2- 172.21.15.77:0/1214894613 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42d80fc700 0x7f42d810d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:40.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.695+0000 7f42dcedb640 1 --2- 172.21.15.77:0/1214894613 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42d80fb430 0x7f42d810d090 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:15:40.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.695+0000 7f42dcedb640 1 -- 172.21.15.77:0/1214894613 >> 172.21.15.77:0/1214894613 conn(0x7f42d80f6c10 msgr2=0x7f42d80655b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:15:40.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.696+0000 7f42dcedb640 1 -- 172.21.15.77:0/1214894613 shutdown_connections 2024-09-18T21:15:40.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:15:40.696+0000 7f42dcedb640 1 -- 172.21.15.77:0/1214894613 wait complete. 2024-09-18T21:15:40.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:40 smithi077 ceph-mon[92672]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:15:40.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:40 smithi077 ceph-mon[92672]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:15:40.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:40 smithi077 ceph-mon[92672]: pgmap v20: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:15:40.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:40 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/3598981756' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T21:15:40.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:40 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:40.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:40 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:40.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:40 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-18T21:15:40.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:40 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-18T21:15:40.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:40 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:15:40.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:40 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/1214894613' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T21:15:41.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:40 smithi103 ceph-mon[80307]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:15:41.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:40 smithi103 ceph-mon[80307]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:15:41.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:40 smithi103 ceph-mon[80307]: pgmap v20: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:15:41.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:40 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/3598981756' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T21:15:41.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:40 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:41.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:40 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:41.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:40 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-18T21:15:41.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:40 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-18T21:15:41.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:40 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:15:41.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:40 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/1214894613' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T21:15:42.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:41 smithi103 ceph-mon[80307]: Reconfiguring mon.smithi103 (monmap changed)... 2024-09-18T21:15:42.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:41 smithi103 ceph-mon[80307]: Reconfiguring daemon mon.smithi103 on smithi103 2024-09-18T21:15:42.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:41 smithi103 ceph-mon[80307]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:15:42.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:41 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:42.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:41 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:42.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:41 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-18T21:15:42.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:41 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:15:42.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:41 smithi077 ceph-mon[92672]: Reconfiguring mon.smithi103 (monmap changed)... 2024-09-18T21:15:42.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:41 smithi077 ceph-mon[92672]: Reconfiguring daemon mon.smithi103 on smithi103 2024-09-18T21:15:42.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:41 smithi077 ceph-mon[92672]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:15:42.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:41 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:42.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:41 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:42.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:41 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-18T21:15:42.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:41 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:15:43.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:42 smithi103 ceph-mon[80307]: Reconfiguring osd.3 (monmap changed)... 2024-09-18T21:15:43.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:42 smithi103 ceph-mon[80307]: Reconfiguring daemon osd.3 on smithi103 2024-09-18T21:15:43.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:42 smithi103 ceph-mon[80307]: pgmap v21: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:15:43.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:42 smithi077 ceph-mon[92672]: Reconfiguring osd.3 (monmap changed)... 2024-09-18T21:15:43.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:42 smithi077 ceph-mon[92672]: Reconfiguring daemon osd.3 on smithi103 2024-09-18T21:15:43.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:42 smithi077 ceph-mon[92672]: pgmap v21: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:15:44.348 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:44 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:44.348 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:44 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:44.348 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:44 smithi103 ceph-mon[80307]: Reconfiguring osd.4 (monmap changed)... 2024-09-18T21:15:44.348 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:44 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-18T21:15:44.348 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:44 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:15:44.348 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:44 smithi103 ceph-mon[80307]: Reconfiguring daemon osd.4 on smithi103 2024-09-18T21:15:44.349 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:44 smithi103 ceph-mon[80307]: pgmap v22: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:15:44.455 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:44 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:44.455 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:44 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:44.455 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:44 smithi077 ceph-mon[92672]: Reconfiguring osd.4 (monmap changed)... 2024-09-18T21:15:44.455 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:44 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-18T21:15:44.455 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:44 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:15:44.455 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:44 smithi077 ceph-mon[92672]: Reconfiguring daemon osd.4 on smithi103 2024-09-18T21:15:44.455 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:44 smithi077 ceph-mon[92672]: pgmap v22: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:15:45.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:45 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:45.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:45 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:45.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:45 smithi077 ceph-mon[92672]: Reconfiguring osd.5 (monmap changed)... 2024-09-18T21:15:45.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:45 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-18T21:15:45.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:45 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:15:45.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:45 smithi077 ceph-mon[92672]: Reconfiguring daemon osd.5 on smithi103 2024-09-18T21:15:45.754 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:45 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:45.754 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:45 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:45.754 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:45 smithi103 ceph-mon[80307]: Reconfiguring osd.5 (monmap changed)... 2024-09-18T21:15:45.754 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:45 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-18T21:15:45.754 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:45 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:15:45.754 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:45 smithi103 ceph-mon[80307]: Reconfiguring daemon osd.5 on smithi103 2024-09-18T21:15:47.161 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:46 smithi103 ceph-mon[80307]: pgmap v23: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:15:47.161 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:46 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:47.161 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:46 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:47.162 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:46 smithi103 ceph-mon[80307]: Reconfiguring mds.cephfs.smithi103.zhdmdg (monmap changed)... 2024-09-18T21:15:47.162 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:46 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi103.zhdmdg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-18T21:15:47.162 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:46 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:15:47.162 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:46 smithi103 ceph-mon[80307]: Reconfiguring daemon mds.cephfs.smithi103.zhdmdg on smithi103 2024-09-18T21:15:47.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:46 smithi077 ceph-mon[92672]: pgmap v23: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:15:47.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:46 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:47.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:46 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:47.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:46 smithi077 ceph-mon[92672]: Reconfiguring mds.cephfs.smithi103.zhdmdg (monmap changed)... 2024-09-18T21:15:47.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:46 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi103.zhdmdg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-18T21:15:47.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:46 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:15:47.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:46 smithi077 ceph-mon[92672]: Reconfiguring daemon mds.cephfs.smithi103.zhdmdg on smithi103 2024-09-18T21:15:48.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:48.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:48.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:48 smithi103 ceph-mon[80307]: Reconfiguring mds.cephfs.smithi103.opftmf (monmap changed)... 2024-09-18T21:15:48.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi103.opftmf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-18T21:15:48.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:15:48.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:48 smithi103 ceph-mon[80307]: Reconfiguring daemon mds.cephfs.smithi103.opftmf on smithi103 2024-09-18T21:15:48.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:48 smithi103 ceph-mon[80307]: pgmap v24: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:15:48.660 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:48.660 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:48.660 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:48 smithi077 ceph-mon[92672]: Reconfiguring mds.cephfs.smithi103.opftmf (monmap changed)... 2024-09-18T21:15:48.660 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi103.opftmf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-18T21:15:48.660 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:15:48.660 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:48 smithi077 ceph-mon[92672]: Reconfiguring daemon mds.cephfs.smithi103.opftmf on smithi103 2024-09-18T21:15:48.661 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:48 smithi077 ceph-mon[92672]: pgmap v24: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:15:49.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:49 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:49.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:49 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:49.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:49 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:15:49.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:49 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:15:49.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:49 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:15:49.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:49 smithi077 ceph-mon[92672]: Upgrade: Setting container_image for all mon 2024-09-18T21:15:49.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:49 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:49.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:49 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi077"}]: dispatch 2024-09-18T21:15:49.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:49 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi077"}]': finished 2024-09-18T21:15:49.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:49 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi103"}]: dispatch 2024-09-18T21:15:49.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:49 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi103"}]': finished 2024-09-18T21:15:50.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:49 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:50.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:49 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:50.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:49 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:15:50.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:49 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:15:50.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:49 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:15:50.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:49 smithi103 ceph-mon[80307]: Upgrade: Setting container_image for all mon 2024-09-18T21:15:50.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:49 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:50.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:49 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi077"}]: dispatch 2024-09-18T21:15:50.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:49 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi077"}]': finished 2024-09-18T21:15:50.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:49 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi103"}]: dispatch 2024-09-18T21:15:50.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:49 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi103"}]': finished 2024-09-18T21:15:50.872 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:50 smithi077 ceph-mon[92672]: pgmap v25: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:15:50.873 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:50 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:50.873 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:50 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi077", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-18T21:15:50.873 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:50 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:15:51.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:50 smithi103 ceph-mon[80307]: pgmap v25: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:15:51.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:50 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:51.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:50 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi077", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-18T21:15:51.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:50 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:15:51.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:51 smithi077 ceph-mon[92672]: Upgrade: Updating crash.smithi077 (1/2) 2024-09-18T21:15:51.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:51 smithi077 ceph-mon[92672]: Deploying daemon crash.smithi077 on smithi077 2024-09-18T21:15:51.727 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:51 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:15:52.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:51 smithi103 ceph-mon[80307]: Upgrade: Updating crash.smithi077 (1/2) 2024-09-18T21:15:52.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:51 smithi103 ceph-mon[80307]: Deploying daemon crash.smithi077 on smithi077 2024-09-18T21:15:52.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:51 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:15:52.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:52 smithi077 ceph-mon[92672]: pgmap v26: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:15:53.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:52 smithi103 ceph-mon[80307]: pgmap v26: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:15:55.200 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:54 smithi103 ceph-mon[80307]: pgmap v27: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:15:55.200 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:54 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:55.200 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:54 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:55.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:54 smithi077 ceph-mon[92672]: pgmap v27: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:15:55.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:54 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:55.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:54 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:56.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:56 smithi103 ceph-mon[80307]: Upgrade: Updating crash.smithi103 (2/2) 2024-09-18T21:15:56.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:56 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:56.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:56 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi103", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-18T21:15:56.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:56 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:15:56.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:56 smithi103 ceph-mon[80307]: Deploying daemon crash.smithi103 on smithi103 2024-09-18T21:15:56.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:56 smithi103 ceph-mon[80307]: pgmap v28: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:15:56.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:56 smithi077 ceph-mon[92672]: Upgrade: Updating crash.smithi103 (2/2) 2024-09-18T21:15:56.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:56 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:56.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:56 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi103", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-18T21:15:56.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:56 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:15:56.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:56 smithi077 ceph-mon[92672]: Deploying daemon crash.smithi103 on smithi103 2024-09-18T21:15:56.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:56 smithi077 ceph-mon[92672]: pgmap v28: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:15:58.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:58 smithi077 ceph-mon[92672]: pgmap v29: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:15:58.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:58 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:58.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:58 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:58.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:15:58 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:15:59.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:58 smithi103 ceph-mon[80307]: pgmap v29: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:15:59.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:58 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:59.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:58 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:15:59.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:15:58 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:16:00.326 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:00 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:00.326 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:00 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:00.326 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:00 smithi077 ceph-mon[92672]: pgmap v30: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:16:00.434 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:00 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:00.434 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:00 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:00.434 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:00 smithi103 ceph-mon[80307]: pgmap v30: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:16:02.910 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:02 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:02.910 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:02 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:02.910 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:02 smithi103 ceph-mon[80307]: pgmap v31: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:16:02.911 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:02 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:02.911 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:02 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:02.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:02 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:02.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:02 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:02.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:02 smithi077 ceph-mon[92672]: pgmap v31: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:16:02.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:02 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:02.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:02 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:04.931 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:04 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:04.931 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:04 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:04.931 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:04 smithi103 ceph-mon[80307]: pgmap v32: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:16:04.931 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:04 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:04.931 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:04 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:05.086 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:04 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:05.086 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:04 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:05.087 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:04 smithi077 ceph-mon[92672]: pgmap v32: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:16:05.087 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:04 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:05.087 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:04 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:06.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:06 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:06.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:06 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:06.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:06 smithi077 ceph-mon[92672]: pgmap v33: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:16:06.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:06 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:16:06.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:06 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:06.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:06 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:06.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:06 smithi103 ceph-mon[80307]: pgmap v33: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:16:06.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:06 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:16:08.660 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:08 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:08.660 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:08 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:08.660 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:08 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:16:08.660 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:08 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:16:08.660 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:08 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:08.660 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:08 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:16:08.661 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:08 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:16:08.661 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:08 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:16:08.661 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:08 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:16:08.661 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:08 smithi077 ceph-mon[92672]: Upgrade: Setting container_image for all crash 2024-09-18T21:16:08.661 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:08 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:08.661 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:08 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi077"}]: dispatch 2024-09-18T21:16:08.661 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:08 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi077"}]': finished 2024-09-18T21:16:08.661 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:08 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi103"}]: dispatch 2024-09-18T21:16:08.661 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:08 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi103"}]': finished 2024-09-18T21:16:08.661 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:08 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-18T21:16:08.661 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:08 smithi077 ceph-mon[92672]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-18T21:16:08.661 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:08 smithi077 ceph-mon[92672]: Upgrade: osd.0 is safe to restart 2024-09-18T21:16:08.661 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:08 smithi077 ceph-mon[92672]: pgmap v34: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:16:08.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:08 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:08.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:08 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:08.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:08 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:16:08.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:08 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:16:08.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:08 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:08.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:08 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:16:08.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:08 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:16:08.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:08 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:16:08.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:08 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:16:08.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:08 smithi103 ceph-mon[80307]: Upgrade: Setting container_image for all crash 2024-09-18T21:16:08.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:08 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:08.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:08 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi077"}]: dispatch 2024-09-18T21:16:08.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:08 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi077"}]': finished 2024-09-18T21:16:08.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:08 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi103"}]: dispatch 2024-09-18T21:16:08.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:08 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi103"}]': finished 2024-09-18T21:16:08.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:08 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-18T21:16:08.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:08 smithi103 ceph-mon[80307]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-18T21:16:08.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:08 smithi103 ceph-mon[80307]: Upgrade: osd.0 is safe to restart 2024-09-18T21:16:08.766 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:08 smithi103 ceph-mon[80307]: pgmap v34: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:16:10.101 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:10 smithi103 ceph-mon[80307]: Upgrade: Updating osd.0 2024-09-18T21:16:10.101 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:10 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:10.101 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:10 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-18T21:16:10.101 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:10 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:16:10.101 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:10 smithi103 ceph-mon[80307]: Deploying daemon osd.0 on smithi077 2024-09-18T21:16:10.101 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:10 smithi103 ceph-mon[80307]: pgmap v35: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:16:10.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:10 smithi077 ceph-mon[92672]: Upgrade: Updating osd.0 2024-09-18T21:16:10.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:10 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:10.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:10 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-18T21:16:10.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:10 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:16:10.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:10 smithi077 ceph-mon[92672]: Deploying daemon osd.0 on smithi077 2024-09-18T21:16:10.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:10 smithi077 ceph-mon[92672]: pgmap v35: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:16:10.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:10.780+0000 7f191c15d640 1 -- 172.21.15.77:0/3100086433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19140fb430 msgr2=0x7f19140fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:10.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:10.781+0000 7f191c15d640 1 --2- 172.21.15.77:0/3100086433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19140fb430 0x7f19140fb840 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f19100048d0 tx=0x7f1910009da0 comp rx=0 tx=0).stop 2024-09-18T21:16:10.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:10.781+0000 7f191c15d640 1 -- 172.21.15.77:0/3100086433 shutdown_connections 2024-09-18T21:16:10.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:10.781+0000 7f191c15d640 1 --2- 172.21.15.77:0/3100086433 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19140fc700 0x7f19140fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:10.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:10.781+0000 7f191c15d640 1 --2- 172.21.15.77:0/3100086433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19140fb430 0x7f19140fb840 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:10.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:10.781+0000 7f191c15d640 1 -- 172.21.15.77:0/3100086433 >> 172.21.15.77:0/3100086433 conn(0x7f19140f6c10 msgr2=0x7f19140f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:16:10.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:10.781+0000 7f191c15d640 1 -- 172.21.15.77:0/3100086433 shutdown_connections 2024-09-18T21:16:10.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:10.781+0000 7f191c15d640 1 -- 172.21.15.77:0/3100086433 wait complete. 2024-09-18T21:16:10.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:10.782+0000 7f191c15d640 1 Processor -- start 2024-09-18T21:16:10.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:10.782+0000 7f191c15d640 1 -- start start 2024-09-18T21:16:10.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:10.782+0000 7f191c15d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19140fb430 0x7f191410fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:16:10.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:10.782+0000 7f191c15d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19140fc700 0x7f19141122f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:16:10.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:10.782+0000 7f191c15d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1914065c80 con 0x7f19140fc700 2024-09-18T21:16:10.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:10.782+0000 7f191c15d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1914065df0 con 0x7f19140fb430 2024-09-18T21:16:10.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:10.782+0000 7f19196f8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19140fc700 0x7f19141122f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:16:10.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:10.782+0000 7f19196f8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19140fc700 0x7f19141122f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37074/0 (socket says 172.21.15.77:37074) 2024-09-18T21:16:10.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:10.782+0000 7f19196f8640 1 -- 172.21.15.77:0/989864934 learned_addr learned my addr 172.21.15.77:0/989864934 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:16:10.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:10.782+0000 7f1919ef9640 1 --2- 172.21.15.77:0/989864934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19140fb430 0x7f191410fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:16:10.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:10.782+0000 7f19196f8640 1 -- 172.21.15.77:0/989864934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19140fb430 msgr2=0x7f191410fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:10.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:10.782+0000 7f19196f8640 1 --2- 172.21.15.77:0/989864934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19140fb430 0x7f191410fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:10.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:10.783+0000 7f19196f8640 1 -- 172.21.15.77:0/989864934 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1910005040 con 0x7f19140fc700 2024-09-18T21:16:10.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:10.783+0000 7f19196f8640 1 --2- 172.21.15.77:0/989864934 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19140fc700 0x7f19141122f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1904002a50 tx=0x7f1904004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:16:10.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:10.783+0000 7f190a7fc640 1 -- 172.21.15.77:0/989864934 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1904007c30 con 0x7f19140fc700 2024-09-18T21:16:10.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:10.783+0000 7f190a7fc640 1 -- 172.21.15.77:0/989864934 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f190400f040 con 0x7f19140fc700 2024-09-18T21:16:10.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:10.783+0000 7f191c15d640 1 -- 172.21.15.77:0/989864934 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1914112890 con 0x7f19140fc700 2024-09-18T21:16:10.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:10.783+0000 7f190a7fc640 1 -- 172.21.15.77:0/989864934 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f190400da10 con 0x7f19140fc700 2024-09-18T21:16:10.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:10.783+0000 7f191c15d640 1 -- 172.21.15.77:0/989864934 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1914112e30 con 0x7f19140fc700 2024-09-18T21:16:10.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:10.784+0000 7f191c15d640 1 -- 172.21.15.77:0/989864934 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19140fa890 con 0x7f19140fc700 2024-09-18T21:16:10.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:10.785+0000 7f190a7fc640 1 -- 172.21.15.77:0/989864934 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 36) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f190400dc80 con 0x7f19140fc700 2024-09-18T21:16:10.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:10.785+0000 7f190a7fc640 1 --2- 172.21.15.77:0/989864934 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f190006e1e0 0x7f1900070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:16:10.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:10.785+0000 7f190a7fc640 1 -- 172.21.15.77:0/989864934 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f190408d5d0 con 0x7f19140fc700 2024-09-18T21:16:10.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:10.785+0000 7f1919ef9640 1 --2- 172.21.15.77:0/989864934 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f190006e1e0 0x7f1900070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:16:10.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:10.786+0000 7f1919ef9640 1 --2- 172.21.15.77:0/989864934 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f190006e1e0 0x7f1900070690 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1910000c00 tx=0x7f1910035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:16:10.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:10.794+0000 7f190a7fc640 1 -- 172.21.15.77:0/989864934 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f1904056830 con 0x7f19140fc700 2024-09-18T21:16:10.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:10.988+0000 7f191c15d640 1 -- 172.21.15.77:0/989864934 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1914100b60 con 0x7f190006e1e0 2024-09-18T21:16:10.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:10.990+0000 7f190a7fc640 1 -- 172.21.15.77:0/989864934 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f1914100b60 con 0x7f190006e1e0 2024-09-18T21:16:10.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:10.992+0000 7f191c15d640 1 -- 172.21.15.77:0/989864934 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f190006e1e0 msgr2=0x7f1900070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:10.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:10.992+0000 7f191c15d640 1 --2- 172.21.15.77:0/989864934 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f190006e1e0 0x7f1900070690 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1910000c00 tx=0x7f1910035040 comp rx=0 tx=0).stop 2024-09-18T21:16:10.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:10.992+0000 7f191c15d640 1 -- 172.21.15.77:0/989864934 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19140fc700 msgr2=0x7f19141122f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:10.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:10.992+0000 7f191c15d640 1 --2- 172.21.15.77:0/989864934 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19140fc700 0x7f19141122f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1904002a50 tx=0x7f1904004600 comp rx=0 tx=0).stop 2024-09-18T21:16:10.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:10.992+0000 7f191c15d640 1 -- 172.21.15.77:0/989864934 shutdown_connections 2024-09-18T21:16:10.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:10.992+0000 7f191c15d640 1 --2- 172.21.15.77:0/989864934 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19140fc700 0x7f19141122f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:10.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:10.992+0000 7f191c15d640 1 --2- 172.21.15.77:0/989864934 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f190006e1e0 0x7f1900070690 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:10.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:10.992+0000 7f191c15d640 1 --2- 172.21.15.77:0/989864934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19140fb430 0x7f191410fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:10.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:10.992+0000 7f191c15d640 1 -- 172.21.15.77:0/989864934 >> 172.21.15.77:0/989864934 conn(0x7f19140f6c10 msgr2=0x7f19140f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:16:10.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:10.992+0000 7f191c15d640 1 -- 172.21.15.77:0/989864934 shutdown_connections 2024-09-18T21:16:10.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:10.992+0000 7f191c15d640 1 -- 172.21.15.77:0/989864934 wait complete. 2024-09-18T21:16:11.002 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-09-18T21:16:11.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.075+0000 7f016e434640 1 -- 172.21.15.77:0/1706782603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01680ff720 msgr2=0x7f0168101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:11.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.075+0000 7f016e434640 1 --2- 172.21.15.77:0/1706782603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01680ff720 0x7f0168101b00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f015c0048d0 tx=0x7f015c009da0 comp rx=0 tx=0).stop 2024-09-18T21:16:11.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.075+0000 7f016e434640 1 -- 172.21.15.77:0/1706782603 shutdown_connections 2024-09-18T21:16:11.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.075+0000 7f016e434640 1 --2- 172.21.15.77:0/1706782603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01680ff720 0x7f0168101b00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:11.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.075+0000 7f016e434640 1 --2- 172.21.15.77:0/1706782603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0168065ba0 0x7f01680ff1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:11.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.075+0000 7f016e434640 1 -- 172.21.15.77:0/1706782603 >> 172.21.15.77:0/1706782603 conn(0x7f01680f6c10 msgr2=0x7f01680f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:16:11.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.075+0000 7f016e434640 1 -- 172.21.15.77:0/1706782603 shutdown_connections 2024-09-18T21:16:11.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.075+0000 7f016e434640 1 -- 172.21.15.77:0/1706782603 wait complete. 2024-09-18T21:16:11.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.076+0000 7f016e434640 1 Processor -- start 2024-09-18T21:16:11.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.076+0000 7f016e434640 1 -- start start 2024-09-18T21:16:11.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.076+0000 7f016e434640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0168065ba0 0x7f016810d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:16:11.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.076+0000 7f016e434640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01680ff720 0x7f016810d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:16:11.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.077+0000 7f016e434640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f016810dc30 con 0x7f0168065ba0 2024-09-18T21:16:11.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.077+0000 7f016e434640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f016810e450 con 0x7f01680ff720 2024-09-18T21:16:11.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.077+0000 7f0167fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0168065ba0 0x7f016810d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:16:11.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.077+0000 7f01677fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01680ff720 0x7f016810d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:16:11.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.077+0000 7f01677fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01680ff720 0x7f016810d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:40374/0 (socket says 172.21.15.77:40374) 2024-09-18T21:16:11.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.077+0000 7f01677fe640 1 -- 172.21.15.77:0/1838771259 learned_addr learned my addr 172.21.15.77:0/1838771259 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:16:11.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.077+0000 7f0167fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0168065ba0 0x7f016810d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37098/0 (socket says 172.21.15.77:37098) 2024-09-18T21:16:11.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.077+0000 7f0167fff640 1 -- 172.21.15.77:0/1838771259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01680ff720 msgr2=0x7f016810d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:11.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.077+0000 7f0167fff640 1 --2- 172.21.15.77:0/1838771259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01680ff720 0x7f016810d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:11.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.077+0000 7f0167fff640 1 -- 172.21.15.77:0/1838771259 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f015c005040 con 0x7f0168065ba0 2024-09-18T21:16:11.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.077+0000 7f0167fff640 1 --2- 172.21.15.77:0/1838771259 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0168065ba0 0x7f016810d0a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0158002770 tx=0x7f0158009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:16:11.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.078+0000 7f0164ff9640 1 -- 172.21.15.77:0/1838771259 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0158007a20 con 0x7f0168065ba0 2024-09-18T21:16:11.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.078+0000 7f016e434640 1 -- 172.21.15.77:0/1838771259 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f016810e6e0 con 0x7f0168065ba0 2024-09-18T21:16:11.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.078+0000 7f016e434640 1 -- 172.21.15.77:0/1838771259 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f016810ec80 con 0x7f0168065ba0 2024-09-18T21:16:11.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.078+0000 7f0164ff9640 1 -- 172.21.15.77:0/1838771259 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f015800f040 con 0x7f0168065ba0 2024-09-18T21:16:11.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.078+0000 7f0164ff9640 1 -- 172.21.15.77:0/1838771259 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f015800d940 con 0x7f0168065ba0 2024-09-18T21:16:11.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.079+0000 7f016e434640 1 -- 172.21.15.77:0/1838771259 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0154005240 con 0x7f0168065ba0 2024-09-18T21:16:11.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.080+0000 7f0164ff9640 1 -- 172.21.15.77:0/1838771259 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 36) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f015800dbb0 con 0x7f0168065ba0 2024-09-18T21:16:11.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.080+0000 7f0164ff9640 1 --2- 172.21.15.77:0/1838771259 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f015006e1e0 0x7f0150070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:16:11.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.080+0000 7f0164ff9640 1 -- 172.21.15.77:0/1838771259 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f015808d9e0 con 0x7f0168065ba0 2024-09-18T21:16:11.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.080+0000 7f01677fe640 1 --2- 172.21.15.77:0/1838771259 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f015006e1e0 0x7f0150070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:16:11.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.081+0000 7f01677fe640 1 --2- 172.21.15.77:0/1838771259 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f015006e1e0 0x7f0150070690 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f015c00b020 tx=0x7f015c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:16:11.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.085+0000 7f0164ff9640 1 -- 172.21.15.77:0/1838771259 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f0158056c10 con 0x7f0168065ba0 2024-09-18T21:16:11.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.284+0000 7f016e434640 1 -- 172.21.15.77:0/1838771259 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0154000bf0 con 0x7f015006e1e0 2024-09-18T21:16:11.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.285+0000 7f0164ff9640 1 -- 172.21.15.77:0/1838771259 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f0154000bf0 con 0x7f015006e1e0 2024-09-18T21:16:11.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.287+0000 7f016e434640 1 -- 172.21.15.77:0/1838771259 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f015006e1e0 msgr2=0x7f0150070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:11.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.287+0000 7f016e434640 1 --2- 172.21.15.77:0/1838771259 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f015006e1e0 0x7f0150070690 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f015c00b020 tx=0x7f015c035040 comp rx=0 tx=0).stop 2024-09-18T21:16:11.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.287+0000 7f016e434640 1 -- 172.21.15.77:0/1838771259 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0168065ba0 msgr2=0x7f016810d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:11.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.287+0000 7f016e434640 1 --2- 172.21.15.77:0/1838771259 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0168065ba0 0x7f016810d0a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0158002770 tx=0x7f0158009f30 comp rx=0 tx=0).stop 2024-09-18T21:16:11.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.287+0000 7f016e434640 1 -- 172.21.15.77:0/1838771259 shutdown_connections 2024-09-18T21:16:11.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.287+0000 7f016e434640 1 --2- 172.21.15.77:0/1838771259 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f015006e1e0 0x7f0150070690 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:11.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.287+0000 7f016e434640 1 --2- 172.21.15.77:0/1838771259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01680ff720 0x7f016810d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:11.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.287+0000 7f016e434640 1 --2- 172.21.15.77:0/1838771259 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0168065ba0 0x7f016810d0a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:11.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.287+0000 7f016e434640 1 -- 172.21.15.77:0/1838771259 >> 172.21.15.77:0/1838771259 conn(0x7f01680f6c10 msgr2=0x7f01680f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:16:11.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.288+0000 7f016e434640 1 -- 172.21.15.77:0/1838771259 shutdown_connections 2024-09-18T21:16:11.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.288+0000 7f016e434640 1 -- 172.21.15.77:0/1838771259 wait complete. 2024-09-18T21:16:11.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.367+0000 7fd668d53640 1 -- 172.21.15.77:0/1851538134 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6640fc700 msgr2=0x7fd6640fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:11.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.367+0000 7fd668d53640 1 --2- 172.21.15.77:0/1851538134 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6640fc700 0x7fd6640fcb70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd6580048d0 tx=0x7fd658009da0 comp rx=0 tx=0).stop 2024-09-18T21:16:11.369 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:11 smithi077 ceph-mon[92672]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:16:11.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.367+0000 7fd668d53640 1 -- 172.21.15.77:0/1851538134 shutdown_connections 2024-09-18T21:16:11.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.367+0000 7fd668d53640 1 --2- 172.21.15.77:0/1851538134 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6640fc700 0x7fd6640fcb70 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:11.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.367+0000 7fd668d53640 1 --2- 172.21.15.77:0/1851538134 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd6640fb430 0x7fd6640fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:11.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.367+0000 7fd668d53640 1 -- 172.21.15.77:0/1851538134 >> 172.21.15.77:0/1851538134 conn(0x7fd6640f6c10 msgr2=0x7fd6640f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:16:11.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.367+0000 7fd668d53640 1 -- 172.21.15.77:0/1851538134 shutdown_connections 2024-09-18T21:16:11.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.367+0000 7fd668d53640 1 -- 172.21.15.77:0/1851538134 wait complete. 2024-09-18T21:16:11.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.368+0000 7fd668d53640 1 Processor -- start 2024-09-18T21:16:11.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.368+0000 7fd668d53640 1 -- start start 2024-09-18T21:16:11.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.368+0000 7fd668d53640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6640fb430 0x7fd66410d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:16:11.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.368+0000 7fd668d53640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd6640fc700 0x7fd66410d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:16:11.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.368+0000 7fd668d53640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd66410dc70 con 0x7fd6640fb430 2024-09-18T21:16:11.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.368+0000 7fd668d53640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd66410e440 con 0x7fd6640fc700 2024-09-18T21:16:11.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.369+0000 7fd66259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6640fb430 0x7fd66410d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:16:11.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.369+0000 7fd66259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6640fb430 0x7fd66410d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37112/0 (socket says 172.21.15.77:37112) 2024-09-18T21:16:11.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.369+0000 7fd66259c640 1 -- 172.21.15.77:0/2213292515 learned_addr learned my addr 172.21.15.77:0/2213292515 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:16:11.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.369+0000 7fd661d9b640 1 --2- 172.21.15.77:0/2213292515 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd6640fc700 0x7fd66410d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:16:11.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.369+0000 7fd66259c640 1 -- 172.21.15.77:0/2213292515 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd6640fc700 msgr2=0x7fd66410d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:11.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.369+0000 7fd66259c640 1 --2- 172.21.15.77:0/2213292515 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd6640fc700 0x7fd66410d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:11.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.369+0000 7fd66259c640 1 -- 172.21.15.77:0/2213292515 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd658005040 con 0x7fd6640fb430 2024-09-18T21:16:11.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.369+0000 7fd661d9b640 1 --2- 172.21.15.77:0/2213292515 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd6640fc700 0x7fd66410d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T21:16:11.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.369+0000 7fd66259c640 1 --2- 172.21.15.77:0/2213292515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6640fb430 0x7fd66410d0e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd65400eb70 tx=0x7fd65400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:16:11.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.369+0000 7fd652ffd640 1 -- 172.21.15.77:0/2213292515 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd654007c30 con 0x7fd6640fb430 2024-09-18T21:16:11.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.369+0000 7fd668d53640 1 -- 172.21.15.77:0/2213292515 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd66410e670 con 0x7fd6640fb430 2024-09-18T21:16:11.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.369+0000 7fd652ffd640 1 -- 172.21.15.77:0/2213292515 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd65400f040 con 0x7fd6640fb430 2024-09-18T21:16:11.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.369+0000 7fd668d53640 1 -- 172.21.15.77:0/2213292515 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd66410ec10 con 0x7fd6640fb430 2024-09-18T21:16:11.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.369+0000 7fd652ffd640 1 -- 172.21.15.77:0/2213292515 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6540094e0 con 0x7fd6640fb430 2024-09-18T21:16:11.374 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.370+0000 7fd668d53640 1 -- 172.21.15.77:0/2213292515 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6640fa890 con 0x7fd6640fb430 2024-09-18T21:16:11.374 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.371+0000 7fd652ffd640 1 -- 172.21.15.77:0/2213292515 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 36) v1 ==== 92305+0+0 (secure 0 0 0) 0x7fd654009660 con 0x7fd6640fb430 2024-09-18T21:16:11.374 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.372+0000 7fd652ffd640 1 --2- 172.21.15.77:0/2213292515 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fd64c06e1e0 0x7fd64c070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:16:11.374 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.372+0000 7fd652ffd640 1 -- 172.21.15.77:0/2213292515 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fd65408db10 con 0x7fd6640fb430 2024-09-18T21:16:11.374 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.372+0000 7fd661d9b640 1 --2- 172.21.15.77:0/2213292515 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fd64c06e1e0 0x7fd64c070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:16:11.374 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.373+0000 7fd661d9b640 1 --2- 172.21.15.77:0/2213292515 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fd64c06e1e0 0x7fd64c070690 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd65800b020 tx=0x7fd658009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:16:11.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.376+0000 7fd652ffd640 1 -- 172.21.15.77:0/2213292515 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fd654056cc0 con 0x7fd6640fb430 2024-09-18T21:16:11.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:11 smithi103 ceph-mon[80307]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:16:11.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.557+0000 7fd668d53640 1 -- 172.21.15.77:0/2213292515 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd664103fc0 con 0x7fd64c06e1e0 2024-09-18T21:16:11.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.566+0000 7fd652ffd640 1 -- 172.21.15.77:0/2213292515 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fd664103fc0 con 0x7fd64c06e1e0 2024-09-18T21:16:11.567 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T21:16:11.567 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager.smithi077 smithi077 *:9093,9094 running (2m) 7s ago 10m 24.2M - 0.25.0 c8568f914cd2 b201d325a55b 2024-09-18T21:16:11.567 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi077 smithi077 running (18s) 7s ago 11m 6891k - 19.1.1-17-g06b1b1de f79f744f586d 5872fa24b792 2024-09-18T21:16:11.567 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi103 smithi103 running (13s) 9s ago 10m 6887k - 19.1.1-17-g06b1b1de f79f744f586d cd1604469f34 2024-09-18T21:16:11.567 INFO:teuthology.orchestra.run.smithi077.stdout:grafana.smithi077 smithi077 *:3000 running (2m) 7s ago 10m 77.8M - 9.4.7 954c08fa6188 d06ef3ab9e66 2024-09-18T21:16:11.568 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.cqfhlw smithi077 running (5m) 7s ago 5m 14.4M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 a7ec3b7701b6 2024-09-18T21:16:11.568 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.vruydi smithi077 running (5m) 7s ago 5m 141M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 affbba097d3b 2024-09-18T21:16:11.568 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi103.opftmf smithi103 running (5m) 9s ago 5m 16.5M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 111f884c5a34 2024-09-18T21:16:11.568 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi103.zhdmdg smithi103 running (5m) 9s ago 5m 15.6M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 50b77d0edda5 2024-09-18T21:16:11.568 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi077.utkpjg smithi077 *:8443,9283,8765 running (2m) 7s ago 12m 493M - 19.1.1-17-g06b1b1de f79f744f586d 99d4b0fd70f6 2024-09-18T21:16:11.568 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi103.zjztqc smithi103 *:8443,9283,8765 running (87s) 9s ago 10m 439M - 19.1.1-17-g06b1b1de f79f744f586d 54589547c4d7 2024-09-18T21:16:11.568 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi077 smithi077 running (74s) 7s ago 12m 40.7M 2048M 19.1.1-17-g06b1b1de f79f744f586d 2d0fbbea1264 2024-09-18T21:16:11.568 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi103 smithi103 running (53s) 9s ago 10m 34.6M 2048M 19.1.1-17-g06b1b1de f79f744f586d dc79edbd9602 2024-09-18T21:16:11.568 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi077 smithi077 *:9100 running (3m) 7s ago 11m 15.5M - 1.5.0 0da6a335fe13 99144245c1af 2024-09-18T21:16:11.568 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi103 smithi103 *:9100 running (2m) 9s ago 10m 16.5M - 1.5.0 0da6a335fe13 e5b51144d997 2024-09-18T21:16:11.568 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (9m) 7s ago 9m 223M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 2e3563c32cf5 2024-09-18T21:16:11.568 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi077 running (8m) 7s ago 8m 236M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 39c2ccbb7603 2024-09-18T21:16:11.568 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi077 running (8m) 7s ago 8m 200M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 2ff2728057e2 2024-09-18T21:16:11.568 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi103 running (8m) 9s ago 8m 275M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 0e72b1bbb8ce 2024-09-18T21:16:11.569 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi103 running (7m) 9s ago 7m 244M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 85f1ce1e8bee 2024-09-18T21:16:11.569 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi103 running (7m) 9s ago 7m 228M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 cf8964b3ac6d 2024-09-18T21:16:11.569 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus.smithi077 smithi077 *:9095 running (92s) 7s ago 10m 53.3M - 2.43.0 a07b618ecd1d 41f3729e3400 2024-09-18T21:16:11.570 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.568+0000 7fd668d53640 1 -- 172.21.15.77:0/2213292515 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fd64c06e1e0 msgr2=0x7fd64c070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:11.570 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.568+0000 7fd668d53640 1 --2- 172.21.15.77:0/2213292515 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fd64c06e1e0 0x7fd64c070690 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd65800b020 tx=0x7fd658009da0 comp rx=0 tx=0).stop 2024-09-18T21:16:11.570 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.568+0000 7fd668d53640 1 -- 172.21.15.77:0/2213292515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6640fb430 msgr2=0x7fd66410d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:11.570 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.568+0000 7fd668d53640 1 --2- 172.21.15.77:0/2213292515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6640fb430 0x7fd66410d0e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd65400eb70 tx=0x7fd65400b040 comp rx=0 tx=0).stop 2024-09-18T21:16:11.570 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.568+0000 7fd668d53640 1 -- 172.21.15.77:0/2213292515 shutdown_connections 2024-09-18T21:16:11.570 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.568+0000 7fd668d53640 1 --2- 172.21.15.77:0/2213292515 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fd64c06e1e0 0x7fd64c070690 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:11.570 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.568+0000 7fd668d53640 1 --2- 172.21.15.77:0/2213292515 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd6640fc700 0x7fd66410d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:11.570 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.568+0000 7fd668d53640 1 --2- 172.21.15.77:0/2213292515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6640fb430 0x7fd66410d0e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:11.570 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.568+0000 7fd668d53640 1 -- 172.21.15.77:0/2213292515 >> 172.21.15.77:0/2213292515 conn(0x7fd6640f6c10 msgr2=0x7fd6640655f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:16:11.570 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.568+0000 7fd668d53640 1 -- 172.21.15.77:0/2213292515 shutdown_connections 2024-09-18T21:16:11.570 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.568+0000 7fd668d53640 1 -- 172.21.15.77:0/2213292515 wait complete. 2024-09-18T21:16:11.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.647+0000 7f8635bbb640 1 -- 172.21.15.77:0/864375662 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f86300ff740 msgr2=0x7f8630101b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:11.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.647+0000 7f8635bbb640 1 --2- 172.21.15.77:0/864375662 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f86300ff740 0x7f8630101b20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f86240048d0 tx=0x7f8624009da0 comp rx=0 tx=0).stop 2024-09-18T21:16:11.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.648+0000 7f8635bbb640 1 -- 172.21.15.77:0/864375662 shutdown_connections 2024-09-18T21:16:11.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.648+0000 7f8635bbb640 1 --2- 172.21.15.77:0/864375662 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f86300ff740 0x7f8630101b20 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:11.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.648+0000 7f8635bbb640 1 --2- 172.21.15.77:0/864375662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8630065b80 0x7f86300ff200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:11.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.648+0000 7f8635bbb640 1 -- 172.21.15.77:0/864375662 >> 172.21.15.77:0/864375662 conn(0x7f86300f6c10 msgr2=0x7f86300f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:16:11.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.648+0000 7f8635bbb640 1 -- 172.21.15.77:0/864375662 shutdown_connections 2024-09-18T21:16:11.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.648+0000 7f8635bbb640 1 -- 172.21.15.77:0/864375662 wait complete. 2024-09-18T21:16:11.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.648+0000 7f8635bbb640 1 Processor -- start 2024-09-18T21:16:11.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.648+0000 7f8635bbb640 1 -- start start 2024-09-18T21:16:11.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.648+0000 7f8635bbb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8630065b80 0x7f86300fcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:16:11.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.648+0000 7f8635bbb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86300ff740 0x7f86300fb100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:16:11.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.649+0000 7f8635bbb640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86300fb640 con 0x7f8630065b80 2024-09-18T21:16:11.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.649+0000 7f8635bbb640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86300fb780 con 0x7f86300ff740 2024-09-18T21:16:11.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.649+0000 7f862f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8630065b80 0x7f86300fcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:16:11.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.649+0000 7f862f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8630065b80 0x7f86300fcbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37124/0 (socket says 172.21.15.77:37124) 2024-09-18T21:16:11.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.649+0000 7f862f7fe640 1 -- 172.21.15.77:0/2301768535 learned_addr learned my addr 172.21.15.77:0/2301768535 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:16:11.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.649+0000 7f862effd640 1 --2- 172.21.15.77:0/2301768535 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86300ff740 0x7f86300fb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:16:11.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.649+0000 7f862f7fe640 1 -- 172.21.15.77:0/2301768535 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86300ff740 msgr2=0x7f86300fb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:11.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.649+0000 7f862f7fe640 1 --2- 172.21.15.77:0/2301768535 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86300ff740 0x7f86300fb100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:11.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.649+0000 7f862f7fe640 1 -- 172.21.15.77:0/2301768535 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8624005040 con 0x7f8630065b80 2024-09-18T21:16:11.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.649+0000 7f862f7fe640 1 --2- 172.21.15.77:0/2301768535 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8630065b80 0x7f86300fcbc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f862000c7e0 tx=0x7f86200043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:16:11.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.649+0000 7f8617fff640 1 -- 172.21.15.77:0/2301768535 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f862000a7a0 con 0x7f8630065b80 2024-09-18T21:16:11.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.649+0000 7f8635bbb640 1 -- 172.21.15.77:0/2301768535 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86300fba60 con 0x7f8630065b80 2024-09-18T21:16:11.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.649+0000 7f8617fff640 1 -- 172.21.15.77:0/2301768535 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f862000ada0 con 0x7f8630065b80 2024-09-18T21:16:11.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.649+0000 7f8617fff640 1 -- 172.21.15.77:0/2301768535 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86200113a0 con 0x7f8630065b80 2024-09-18T21:16:11.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.650+0000 7f8635bbb640 1 -- 172.21.15.77:0/2301768535 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8630115120 con 0x7f8630065b80 2024-09-18T21:16:11.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.651+0000 7f8635bbb640 1 -- 172.21.15.77:0/2301768535 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86300fa890 con 0x7f8630065b80 2024-09-18T21:16:11.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.651+0000 7f8617fff640 1 -- 172.21.15.77:0/2301768535 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 36) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f862000a900 con 0x7f8630065b80 2024-09-18T21:16:11.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.652+0000 7f8617fff640 1 --2- 172.21.15.77:0/2301768535 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f861806e1e0 0x7f8618070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:16:11.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.652+0000 7f8617fff640 1 -- 172.21.15.77:0/2301768535 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f862008dcf0 con 0x7f8630065b80 2024-09-18T21:16:11.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.652+0000 7f862effd640 1 --2- 172.21.15.77:0/2301768535 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f861806e1e0 0x7f8618070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:16:11.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.652+0000 7f862effd640 1 --2- 172.21.15.77:0/2301768535 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f861806e1e0 0x7f8618070690 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8624000c00 tx=0x7f8624035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:16:11.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.660+0000 7f8617fff640 1 -- 172.21.15.77:0/2301768535 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f8620057030 con 0x7f8630065b80 2024-09-18T21:16:11.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.903+0000 7f8635bbb640 1 -- 172.21.15.77:0/2301768535 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8630104f50 con 0x7f8630065b80 2024-09-18T21:16:11.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.903+0000 7f8617fff640 1 -- 172.21.15.77:0/2301768535 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+742 (secure 0 0 0) 0x7f862005a6f0 con 0x7f8630065b80 2024-09-18T21:16:11.904 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-18T21:16:11.904 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": { 2024-09-18T21:16:11.904 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 2 2024-09-18T21:16:11.905 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:16:11.905 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": { 2024-09-18T21:16:11.905 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 2 2024-09-18T21:16:11.905 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:16:11.905 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": { 2024-09-18T21:16:11.905 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 6 2024-09-18T21:16:11.905 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:16:11.905 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-09-18T21:16:11.905 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4 2024-09-18T21:16:11.905 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:16:11.905 INFO:teuthology.orchestra.run.smithi077.stdout: "overall": { 2024-09-18T21:16:11.906 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 10, 2024-09-18T21:16:11.906 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 4 2024-09-18T21:16:11.906 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-18T21:16:11.906 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-18T21:16:11.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.906+0000 7f8635bbb640 1 -- 172.21.15.77:0/2301768535 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f861806e1e0 msgr2=0x7f8618070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:11.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.906+0000 7f8635bbb640 1 --2- 172.21.15.77:0/2301768535 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f861806e1e0 0x7f8618070690 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8624000c00 tx=0x7f8624035040 comp rx=0 tx=0).stop 2024-09-18T21:16:11.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.906+0000 7f8635bbb640 1 -- 172.21.15.77:0/2301768535 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8630065b80 msgr2=0x7f86300fcbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:11.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.906+0000 7f8635bbb640 1 --2- 172.21.15.77:0/2301768535 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8630065b80 0x7f86300fcbc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f862000c7e0 tx=0x7f86200043c0 comp rx=0 tx=0).stop 2024-09-18T21:16:11.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.906+0000 7f8635bbb640 1 -- 172.21.15.77:0/2301768535 shutdown_connections 2024-09-18T21:16:11.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.906+0000 7f8635bbb640 1 --2- 172.21.15.77:0/2301768535 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f861806e1e0 0x7f8618070690 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:11.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.906+0000 7f8635bbb640 1 --2- 172.21.15.77:0/2301768535 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f86300ff740 0x7f86300fb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:11.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.906+0000 7f8635bbb640 1 --2- 172.21.15.77:0/2301768535 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8630065b80 0x7f86300fcbc0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:11.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.906+0000 7f8635bbb640 1 -- 172.21.15.77:0/2301768535 >> 172.21.15.77:0/2301768535 conn(0x7f86300f6c10 msgr2=0x7f86300f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:16:11.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.906+0000 7f8635bbb640 1 -- 172.21.15.77:0/2301768535 shutdown_connections 2024-09-18T21:16:11.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.906+0000 7f8635bbb640 1 -- 172.21.15.77:0/2301768535 wait complete. 2024-09-18T21:16:11.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.987+0000 7fe063755640 1 -- 172.21.15.77:0/4099662921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe05c0ff680 msgr2=0x7fe05c101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:11.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.987+0000 7fe063755640 1 --2- 172.21.15.77:0/4099662921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe05c0ff680 0x7fe05c101a60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe04c0048d0 tx=0x7fe04c009da0 comp rx=0 tx=0).stop 2024-09-18T21:16:11.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.987+0000 7fe063755640 1 -- 172.21.15.77:0/4099662921 shutdown_connections 2024-09-18T21:16:11.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.987+0000 7fe063755640 1 --2- 172.21.15.77:0/4099662921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe05c0ff680 0x7fe05c101a60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:11.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.987+0000 7fe063755640 1 --2- 172.21.15.77:0/4099662921 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe05c065c40 0x7fe05c0ff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:11.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.987+0000 7fe063755640 1 -- 172.21.15.77:0/4099662921 >> 172.21.15.77:0/4099662921 conn(0x7fe05c0f6c10 msgr2=0x7fe05c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:16:11.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.987+0000 7fe063755640 1 -- 172.21.15.77:0/4099662921 shutdown_connections 2024-09-18T21:16:11.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.987+0000 7fe063755640 1 -- 172.21.15.77:0/4099662921 wait complete. 2024-09-18T21:16:11.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.988+0000 7fe063755640 1 Processor -- start 2024-09-18T21:16:11.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.988+0000 7fe063755640 1 -- start start 2024-09-18T21:16:11.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.988+0000 7fe063755640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe05c065c40 0x7fe05c0fca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:16:11.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.988+0000 7fe063755640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe05c0ff680 0x7fe05c0fb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:16:11.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.988+0000 7fe063755640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c0fb580 con 0x7fe05c0ff680 2024-09-18T21:16:11.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.988+0000 7fe063755640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c0fb6f0 con 0x7fe05c065c40 2024-09-18T21:16:11.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.988+0000 7fe060cf0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe05c0ff680 0x7fe05c0fb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:16:11.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.988+0000 7fe060cf0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe05c0ff680 0x7fe05c0fb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37132/0 (socket says 172.21.15.77:37132) 2024-09-18T21:16:11.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.988+0000 7fe060cf0640 1 -- 172.21.15.77:0/480071898 learned_addr learned my addr 172.21.15.77:0/480071898 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:16:11.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.988+0000 7fe0614f1640 1 --2- 172.21.15.77:0/480071898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe05c065c40 0x7fe05c0fca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:16:11.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.988+0000 7fe060cf0640 1 -- 172.21.15.77:0/480071898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe05c065c40 msgr2=0x7fe05c0fca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:11.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.988+0000 7fe060cf0640 1 --2- 172.21.15.77:0/480071898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe05c065c40 0x7fe05c0fca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:11.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.988+0000 7fe060cf0640 1 -- 172.21.15.77:0/480071898 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe04c005040 con 0x7fe05c0ff680 2024-09-18T21:16:11.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.989+0000 7fe060cf0640 1 --2- 172.21.15.77:0/480071898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe05c0ff680 0x7fe05c0fb040 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe04c0043d0 tx=0x7fe04c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:16:11.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.989+0000 7fe051ffb640 1 -- 172.21.15.77:0/480071898 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe04c038070 con 0x7fe05c0ff680 2024-09-18T21:16:11.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.989+0000 7fe051ffb640 1 -- 172.21.15.77:0/480071898 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe04c02ae90 con 0x7fe05c0ff680 2024-09-18T21:16:11.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.989+0000 7fe063755640 1 -- 172.21.15.77:0/480071898 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe05c0fb970 con 0x7fe05c0ff680 2024-09-18T21:16:11.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.989+0000 7fe051ffb640 1 -- 172.21.15.77:0/480071898 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe04c03e670 con 0x7fe05c0ff680 2024-09-18T21:16:11.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.989+0000 7fe063755640 1 -- 172.21.15.77:0/480071898 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe05c0fbe90 con 0x7fe05c0ff680 2024-09-18T21:16:11.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.990+0000 7fe063755640 1 -- 172.21.15.77:0/480071898 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe05c0fa890 con 0x7fe05c0ff680 2024-09-18T21:16:11.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.991+0000 7fe051ffb640 1 -- 172.21.15.77:0/480071898 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 36) v1 ==== 92305+0+0 (secure 0 0 0) 0x7fe04c030020 con 0x7fe05c0ff680 2024-09-18T21:16:11.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.991+0000 7fe051ffb640 1 --2- 172.21.15.77:0/480071898 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fe04806e1e0 0x7fe048070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:16:11.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.992+0000 7fe051ffb640 1 -- 172.21.15.77:0/480071898 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fe04c0adf20 con 0x7fe05c0ff680 2024-09-18T21:16:11.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.992+0000 7fe0614f1640 1 --2- 172.21.15.77:0/480071898 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fe04806e1e0 0x7fe048070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:16:11.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.992+0000 7fe0614f1640 1 --2- 172.21.15.77:0/480071898 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fe04806e1e0 0x7fe048070690 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe05c0fc7f0 tx=0x7fe058009ef0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:16:11.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:11.996+0000 7fe051ffb640 1 -- 172.21.15.77:0/480071898 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fe04c0e2df0 con 0x7fe05c0ff680 2024-09-18T21:16:12.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:12 smithi077 ceph-mon[92672]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:16:12.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:12 smithi077 ceph-mon[92672]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:16:12.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:12 smithi077 ceph-mon[92672]: pgmap v36: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:16:12.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:12 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/2301768535' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:16:12.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.222+0000 7fe063755640 1 -- 172.21.15.77:0/480071898 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe05c04b720 con 0x7fe05c0ff680 2024-09-18T21:16:12.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.223+0000 7fe051ffb640 1 -- 172.21.15.77:0/480071898 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1915 (secure 0 0 0) 0x7fe04c0771e0 con 0x7fe05c0ff680 2024-09-18T21:16:12.225 INFO:teuthology.orchestra.run.smithi077.stdout:e13 2024-09-18T21:16:12.225 INFO:teuthology.orchestra.run.smithi077.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-18T21:16:12.225 INFO:teuthology.orchestra.run.smithi077.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T21:16:12.225 INFO:teuthology.orchestra.run.smithi077.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T21:16:12.225 INFO:teuthology.orchestra.run.smithi077.stdout:legacy client fscid: 1 2024-09-18T21:16:12.226 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:16:12.226 INFO:teuthology.orchestra.run.smithi077.stdout:Filesystem 'cephfs' (1) 2024-09-18T21:16:12.226 INFO:teuthology.orchestra.run.smithi077.stdout:fs_name cephfs 2024-09-18T21:16:12.226 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 13 2024-09-18T21:16:12.226 INFO:teuthology.orchestra.run.smithi077.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T21:16:12.226 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-09-18T21:10:17.230179+0000 2024-09-18T21:16:12.227 INFO:teuthology.orchestra.run.smithi077.stdout:modified 2024-09-18T21:10:33.373241+0000 2024-09-18T21:16:12.227 INFO:teuthology.orchestra.run.smithi077.stdout:tableserver 0 2024-09-18T21:16:12.227 INFO:teuthology.orchestra.run.smithi077.stdout:root 0 2024-09-18T21:16:12.227 INFO:teuthology.orchestra.run.smithi077.stdout:session_timeout 60 2024-09-18T21:16:12.227 INFO:teuthology.orchestra.run.smithi077.stdout:session_autoclose 300 2024-09-18T21:16:12.227 INFO:teuthology.orchestra.run.smithi077.stdout:max_file_size 1099511627776 2024-09-18T21:16:12.228 INFO:teuthology.orchestra.run.smithi077.stdout:max_xattr_size 65536 2024-09-18T21:16:12.228 INFO:teuthology.orchestra.run.smithi077.stdout:required_client_features {} 2024-09-18T21:16:12.228 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure 0 2024-09-18T21:16:12.228 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure_osd_epoch 0 2024-09-18T21:16:12.228 INFO:teuthology.orchestra.run.smithi077.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T21:16:12.228 INFO:teuthology.orchestra.run.smithi077.stdout:max_mds 1 2024-09-18T21:16:12.229 INFO:teuthology.orchestra.run.smithi077.stdout:in 0 2024-09-18T21:16:12.229 INFO:teuthology.orchestra.run.smithi077.stdout:up {0=14446} 2024-09-18T21:16:12.229 INFO:teuthology.orchestra.run.smithi077.stdout:failed 2024-09-18T21:16:12.229 INFO:teuthology.orchestra.run.smithi077.stdout:damaged 2024-09-18T21:16:12.229 INFO:teuthology.orchestra.run.smithi077.stdout:stopped 2024-09-18T21:16:12.230 INFO:teuthology.orchestra.run.smithi077.stdout:data_pools [3] 2024-09-18T21:16:12.230 INFO:teuthology.orchestra.run.smithi077.stdout:metadata_pool 2 2024-09-18T21:16:12.230 INFO:teuthology.orchestra.run.smithi077.stdout:inline_data disabled 2024-09-18T21:16:12.230 INFO:teuthology.orchestra.run.smithi077.stdout:balancer 2024-09-18T21:16:12.230 INFO:teuthology.orchestra.run.smithi077.stdout:bal_rank_mask -1 2024-09-18T21:16:12.230 INFO:teuthology.orchestra.run.smithi077.stdout:standby_count_wanted 1 2024-09-18T21:16:12.231 INFO:teuthology.orchestra.run.smithi077.stdout:qdb_cluster leader: 0 members: 2024-09-18T21:16:12.231 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.vruydi{0:14446} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.77:6826/334039954,v1:172.21.15.77:6827/334039954] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:16:12.231 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:16:12.231 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:16:12.231 INFO:teuthology.orchestra.run.smithi077.stdout:Standby daemons: 2024-09-18T21:16:12.231 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:16:12.232 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.cqfhlw{-1:14458} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.77:6828/862540650,v1:172.21.15.77:6829/862540650] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:16:12.232 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi103.zhdmdg{-1:24255} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.103:6824/2170237078,v1:172.21.15.103:6825/2170237078] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:16:12.232 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi103.opftmf{-1:24267} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.103:6826/4241818403,v1:172.21.15.103:6827/4241818403] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:16:12.233 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 13 2024-09-18T21:16:12.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.225+0000 7fe063755640 1 -- 172.21.15.77:0/480071898 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fe04806e1e0 msgr2=0x7fe048070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:12.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.225+0000 7fe063755640 1 --2- 172.21.15.77:0/480071898 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fe04806e1e0 0x7fe048070690 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe05c0fc7f0 tx=0x7fe058009ef0 comp rx=0 tx=0).stop 2024-09-18T21:16:12.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.225+0000 7fe063755640 1 -- 172.21.15.77:0/480071898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe05c0ff680 msgr2=0x7fe05c0fb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:12.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.225+0000 7fe063755640 1 --2- 172.21.15.77:0/480071898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe05c0ff680 0x7fe05c0fb040 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe04c0043d0 tx=0x7fe04c009da0 comp rx=0 tx=0).stop 2024-09-18T21:16:12.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.225+0000 7fe063755640 1 -- 172.21.15.77:0/480071898 shutdown_connections 2024-09-18T21:16:12.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.225+0000 7fe063755640 1 --2- 172.21.15.77:0/480071898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe05c0ff680 0x7fe05c0fb040 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:12.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.225+0000 7fe063755640 1 --2- 172.21.15.77:0/480071898 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fe04806e1e0 0x7fe048070690 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:12.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.225+0000 7fe063755640 1 --2- 172.21.15.77:0/480071898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe05c065c40 0x7fe05c0fca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:12.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.225+0000 7fe063755640 1 -- 172.21.15.77:0/480071898 >> 172.21.15.77:0/480071898 conn(0x7fe05c0f6c10 msgr2=0x7fe05c0f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:16:12.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.225+0000 7fe063755640 1 -- 172.21.15.77:0/480071898 shutdown_connections 2024-09-18T21:16:12.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.225+0000 7fe063755640 1 -- 172.21.15.77:0/480071898 wait complete. 2024-09-18T21:16:12.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.310+0000 7f5abd08e640 1 -- 172.21.15.77:0/2496610464 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ab80fb430 msgr2=0x7f5ab80fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:12.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.310+0000 7f5abd08e640 1 --2- 172.21.15.77:0/2496610464 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ab80fb430 0x7f5ab80fb840 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5aa80048d0 tx=0x7f5aa8009da0 comp rx=0 tx=0).stop 2024-09-18T21:16:12.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.310+0000 7f5abd08e640 1 -- 172.21.15.77:0/2496610464 shutdown_connections 2024-09-18T21:16:12.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.310+0000 7f5abd08e640 1 --2- 172.21.15.77:0/2496610464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ab80fc700 0x7f5ab80fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:12.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.310+0000 7f5abd08e640 1 --2- 172.21.15.77:0/2496610464 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ab80fb430 0x7f5ab80fb840 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:12.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.310+0000 7f5abd08e640 1 -- 172.21.15.77:0/2496610464 >> 172.21.15.77:0/2496610464 conn(0x7f5ab80f6c10 msgr2=0x7f5ab80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:16:12.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.310+0000 7f5abd08e640 1 -- 172.21.15.77:0/2496610464 shutdown_connections 2024-09-18T21:16:12.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.310+0000 7f5abd08e640 1 -- 172.21.15.77:0/2496610464 wait complete. 2024-09-18T21:16:12.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.311+0000 7f5abd08e640 1 Processor -- start 2024-09-18T21:16:12.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.311+0000 7f5abd08e640 1 -- start start 2024-09-18T21:16:12.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.312+0000 7f5abd08e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ab80fb430 0x7f5ab810d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:16:12.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.312+0000 7f5abd08e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ab80fc700 0x7f5ab810d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:16:12.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.312+0000 7f5abd08e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab810dbf0 con 0x7f5ab80fb430 2024-09-18T21:16:12.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.312+0000 7f5abd08e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab810e410 con 0x7f5ab80fc700 2024-09-18T21:16:12.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.312+0000 7f5ab6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ab80fb430 0x7f5ab810d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:16:12.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.312+0000 7f5ab6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ab80fb430 0x7f5ab810d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37140/0 (socket says 172.21.15.77:37140) 2024-09-18T21:16:12.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.312+0000 7f5ab6d9d640 1 -- 172.21.15.77:0/1673738967 learned_addr learned my addr 172.21.15.77:0/1673738967 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:16:12.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.312+0000 7f5aae59c640 1 --2- 172.21.15.77:0/1673738967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ab80fc700 0x7f5ab810d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:16:12.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.312+0000 7f5ab6d9d640 1 -- 172.21.15.77:0/1673738967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ab80fc700 msgr2=0x7f5ab810d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:12.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.312+0000 7f5ab6d9d640 1 --2- 172.21.15.77:0/1673738967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ab80fc700 0x7f5ab810d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:12.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.312+0000 7f5ab6d9d640 1 -- 172.21.15.77:0/1673738967 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa8005040 con 0x7f5ab80fb430 2024-09-18T21:16:12.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.313+0000 7f5ab6d9d640 1 --2- 172.21.15.77:0/1673738967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ab80fb430 0x7f5ab810d060 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5aa80043d0 tx=0x7f5aa8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:16:12.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.313+0000 7f5aaffff640 1 -- 172.21.15.77:0/1673738967 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5aa8038070 con 0x7f5ab80fb430 2024-09-18T21:16:12.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.313+0000 7f5abd08e640 1 -- 172.21.15.77:0/1673738967 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ab810e640 con 0x7f5ab80fb430 2024-09-18T21:16:12.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.313+0000 7f5abd08e640 1 -- 172.21.15.77:0/1673738967 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ab810eb60 con 0x7f5ab80fb430 2024-09-18T21:16:12.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.313+0000 7f5aaffff640 1 -- 172.21.15.77:0/1673738967 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5aa802ae90 con 0x7f5ab80fb430 2024-09-18T21:16:12.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.313+0000 7f5aaffff640 1 -- 172.21.15.77:0/1673738967 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5aa803e670 con 0x7f5ab80fb430 2024-09-18T21:16:12.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.314+0000 7f5abd08e640 1 -- 172.21.15.77:0/1673738967 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a98005240 con 0x7f5ab80fb430 2024-09-18T21:16:12.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.315+0000 7f5aaffff640 1 -- 172.21.15.77:0/1673738967 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 36) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f5aa8030020 con 0x7f5ab80fb430 2024-09-18T21:16:12.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.315+0000 7f5aaffff640 1 --2- 172.21.15.77:0/1673738967 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f5aa406e1e0 0x7f5aa4070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:16:12.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.316+0000 7f5aaffff640 1 -- 172.21.15.77:0/1673738967 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f5aa80adda0 con 0x7f5ab80fb430 2024-09-18T21:16:12.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.316+0000 7f5aae59c640 1 --2- 172.21.15.77:0/1673738967 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f5aa406e1e0 0x7f5aa4070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:16:12.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.316+0000 7f5aae59c640 1 --2- 172.21.15.77:0/1673738967 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f5aa406e1e0 0x7f5aa4070690 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5ab810ce10 tx=0x7f5aa0009ed0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:16:12.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.324+0000 7f5aaffff640 1 -- 172.21.15.77:0/1673738967 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f5aa8077060 con 0x7f5ab80fb430 2024-09-18T21:16:12.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:12 smithi103 ceph-mon[80307]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:16:12.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:12 smithi103 ceph-mon[80307]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:16:12.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:12 smithi103 ceph-mon[80307]: pgmap v36: 65 pgs: 65 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:16:12.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:12 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/2301768535' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:16:12.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.524+0000 7f5abd08e640 1 -- 172.21.15.77:0/1673738967 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5a98000bf0 con 0x7f5aa406e1e0 2024-09-18T21:16:12.525 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:12 smithi077 systemd[1]: Stopping Ceph osd.0 for 5a76ec16-7601-11ef-bceb-c7b262605968... 2024-09-18T21:16:12.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.525+0000 7f5aaffff640 1 -- 172.21.15.77:0/1673738967 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f5a98000bf0 con 0x7f5aa406e1e0 2024-09-18T21:16:12.527 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-18T21:16:12.527 INFO:teuthology.orchestra.run.smithi077.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a", 2024-09-18T21:16:12.527 INFO:teuthology.orchestra.run.smithi077.stdout: "in_progress": true, 2024-09-18T21:16:12.527 INFO:teuthology.orchestra.run.smithi077.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T21:16:12.527 INFO:teuthology.orchestra.run.smithi077.stdout: "services_complete": [ 2024-09-18T21:16:12.527 INFO:teuthology.orchestra.run.smithi077.stdout: "mon", 2024-09-18T21:16:12.528 INFO:teuthology.orchestra.run.smithi077.stdout: "crash", 2024-09-18T21:16:12.528 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr" 2024-09-18T21:16:12.528 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-18T21:16:12.528 INFO:teuthology.orchestra.run.smithi077.stdout: "progress": "6/21 daemons upgraded", 2024-09-18T21:16:12.528 INFO:teuthology.orchestra.run.smithi077.stdout: "message": "Currently upgrading osd daemons", 2024-09-18T21:16:12.528 INFO:teuthology.orchestra.run.smithi077.stdout: "is_paused": false 2024-09-18T21:16:12.529 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-18T21:16:12.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.527+0000 7f5abd08e640 1 -- 172.21.15.77:0/1673738967 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f5aa406e1e0 msgr2=0x7f5aa4070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:12.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.527+0000 7f5abd08e640 1 --2- 172.21.15.77:0/1673738967 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f5aa406e1e0 0x7f5aa4070690 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5ab810ce10 tx=0x7f5aa0009ed0 comp rx=0 tx=0).stop 2024-09-18T21:16:12.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.527+0000 7f5abd08e640 1 -- 172.21.15.77:0/1673738967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ab80fb430 msgr2=0x7f5ab810d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:12.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.527+0000 7f5abd08e640 1 --2- 172.21.15.77:0/1673738967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ab80fb430 0x7f5ab810d060 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5aa80043d0 tx=0x7f5aa8009da0 comp rx=0 tx=0).stop 2024-09-18T21:16:12.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.528+0000 7f5abd08e640 1 -- 172.21.15.77:0/1673738967 shutdown_connections 2024-09-18T21:16:12.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.528+0000 7f5abd08e640 1 --2- 172.21.15.77:0/1673738967 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f5aa406e1e0 0x7f5aa4070690 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:12.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.528+0000 7f5abd08e640 1 --2- 172.21.15.77:0/1673738967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ab80fc700 0x7f5ab810d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:12.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.528+0000 7f5abd08e640 1 --2- 172.21.15.77:0/1673738967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ab80fb430 0x7f5ab810d060 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:12.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.528+0000 7f5abd08e640 1 -- 172.21.15.77:0/1673738967 >> 172.21.15.77:0/1673738967 conn(0x7f5ab80f6c10 msgr2=0x7f5ab80656c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:16:12.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.528+0000 7f5abd08e640 1 -- 172.21.15.77:0/1673738967 shutdown_connections 2024-09-18T21:16:12.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.528+0000 7f5abd08e640 1 -- 172.21.15.77:0/1673738967 wait complete. 2024-09-18T21:16:12.613 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.607+0000 7f17c2fa0640 1 -- 172.21.15.77:0/3981210769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17bc0fd2c0 msgr2=0x7f17bc0ff740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:12.613 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.607+0000 7f17c2fa0640 1 --2- 172.21.15.77:0/3981210769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17bc0fd2c0 0x7f17bc0ff740 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f17ac0048d0 tx=0x7f17ac009da0 comp rx=0 tx=0).stop 2024-09-18T21:16:12.613 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.607+0000 7f17c2fa0640 1 -- 172.21.15.77:0/3981210769 shutdown_connections 2024-09-18T21:16:12.613 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.607+0000 7f17c2fa0640 1 --2- 172.21.15.77:0/3981210769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17bc0fd2c0 0x7f17bc0ff740 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:12.613 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.607+0000 7f17c2fa0640 1 --2- 172.21.15.77:0/3981210769 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17bc066540 0x7f17bc0fcd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:12.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.607+0000 7f17c2fa0640 1 -- 172.21.15.77:0/3981210769 >> 172.21.15.77:0/3981210769 conn(0x7f17bc0f6a60 msgr2=0x7f17bc0f8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:16:12.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.607+0000 7f17c2fa0640 1 -- 172.21.15.77:0/3981210769 shutdown_connections 2024-09-18T21:16:12.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.607+0000 7f17c2fa0640 1 -- 172.21.15.77:0/3981210769 wait complete. 2024-09-18T21:16:12.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.608+0000 7f17c2fa0640 1 Processor -- start 2024-09-18T21:16:12.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.608+0000 7f17c2fa0640 1 -- start start 2024-09-18T21:16:12.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.608+0000 7f17c2fa0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17bc066540 0x7f17bc1134e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:16:12.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.608+0000 7f17c2fa0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17bc0fd2c0 0x7f17bc113a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:16:12.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.608+0000 7f17c2fa0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17bc114070 con 0x7f17bc0fd2c0 2024-09-18T21:16:12.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.608+0000 7f17c2fa0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17bc114840 con 0x7f17bc066540 2024-09-18T21:16:12.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.608+0000 7f17c179d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17bc0fd2c0 0x7f17bc113a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:16:12.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.608+0000 7f17c179d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17bc0fd2c0 0x7f17bc113a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37148/0 (socket says 172.21.15.77:37148) 2024-09-18T21:16:12.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.608+0000 7f17c179d640 1 -- 172.21.15.77:0/1700245331 learned_addr learned my addr 172.21.15.77:0/1700245331 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:16:12.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.608+0000 7f17c179d640 1 -- 172.21.15.77:0/1700245331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17bc066540 msgr2=0x7f17bc1134e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:12.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.608+0000 7f17c1f9e640 1 --2- 172.21.15.77:0/1700245331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17bc066540 0x7f17bc1134e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:16:12.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.608+0000 7f17c179d640 1 --2- 172.21.15.77:0/1700245331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17bc066540 0x7f17bc1134e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:12.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.608+0000 7f17c179d640 1 -- 172.21.15.77:0/1700245331 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17ac005040 con 0x7f17bc0fd2c0 2024-09-18T21:16:12.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.608+0000 7f17c1f9e640 1 --2- 172.21.15.77:0/1700245331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17bc066540 0x7f17bc1134e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T21:16:12.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.609+0000 7f17c179d640 1 --2- 172.21.15.77:0/1700245331 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17bc0fd2c0 0x7f17bc113a20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f17ac003080 tx=0x7f17ac009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:16:12.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.609+0000 7f17b27fc640 1 -- 172.21.15.77:0/1700245331 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17ac038070 con 0x7f17bc0fd2c0 2024-09-18T21:16:12.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.609+0000 7f17b27fc640 1 -- 172.21.15.77:0/1700245331 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f17ac02abd0 con 0x7f17bc0fd2c0 2024-09-18T21:16:12.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.609+0000 7f17c2fa0640 1 -- 172.21.15.77:0/1700245331 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17bc114a70 con 0x7f17bc0fd2c0 2024-09-18T21:16:12.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.609+0000 7f17b27fc640 1 -- 172.21.15.77:0/1700245331 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17ac03e670 con 0x7f17bc0fd2c0 2024-09-18T21:16:12.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.609+0000 7f17c2fa0640 1 -- 172.21.15.77:0/1700245331 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17bc115010 con 0x7f17bc0fd2c0 2024-09-18T21:16:12.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.610+0000 7f17c2fa0640 1 -- 172.21.15.77:0/1700245331 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17bc0fa6e0 con 0x7f17bc0fd2c0 2024-09-18T21:16:12.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.610+0000 7f17b27fc640 1 -- 172.21.15.77:0/1700245331 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 36) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f17ac030020 con 0x7f17bc0fd2c0 2024-09-18T21:16:12.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.611+0000 7f17b27fc640 1 --2- 172.21.15.77:0/1700245331 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f17a806e1e0 0x7f17a8070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:16:12.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.611+0000 7f17b27fc640 1 -- 172.21.15.77:0/1700245331 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f17ac0adff0 con 0x7f17bc0fd2c0 2024-09-18T21:16:12.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.611+0000 7f17c1f9e640 1 --2- 172.21.15.77:0/1700245331 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f17a806e1e0 0x7f17a8070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:16:12.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.611+0000 7f17c1f9e640 1 --2- 172.21.15.77:0/1700245331 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f17a806e1e0 0x7f17a8070690 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f17bc0662a0 tx=0x7f17b8009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:16:12.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.615+0000 7f17b27fc640 1 -- 172.21.15.77:0/1700245331 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f17ac0772f0 con 0x7f17bc0fd2c0 2024-09-18T21:16:12.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.845+0000 7f17c2fa0640 1 -- 172.21.15.77:0/1700245331 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f17bc04b720 con 0x7f17bc0fd2c0 2024-09-18T21:16:12.847 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:12 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-0[46974]: 2024-09-18T21:16:12.535+0000 7f8922723640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T21:16:12.847 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:12 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-0[46974]: 2024-09-18T21:16:12.535+0000 7f8922723640 -1 osd.0 46 *** Got signal Terminated *** 2024-09-18T21:16:12.847 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:12 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-0[46974]: 2024-09-18T21:16:12.535+0000 7f8922723640 -1 osd.0 46 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-18T21:16:12.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.846+0000 7f17b27fc640 1 -- 172.21.15.77:0/1700245331 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f17ac07a9b0 con 0x7f17bc0fd2c0 2024-09-18T21:16:12.848 INFO:teuthology.orchestra.run.smithi077.stdout:HEALTH_OK 2024-09-18T21:16:12.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.848+0000 7f17c2fa0640 1 -- 172.21.15.77:0/1700245331 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f17a806e1e0 msgr2=0x7f17a8070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:12.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.848+0000 7f17c2fa0640 1 --2- 172.21.15.77:0/1700245331 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f17a806e1e0 0x7f17a8070690 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f17bc0662a0 tx=0x7f17b8009040 comp rx=0 tx=0).stop 2024-09-18T21:16:12.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.848+0000 7f17c2fa0640 1 -- 172.21.15.77:0/1700245331 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17bc0fd2c0 msgr2=0x7f17bc113a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:12.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.848+0000 7f17c2fa0640 1 --2- 172.21.15.77:0/1700245331 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17bc0fd2c0 0x7f17bc113a20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f17ac003080 tx=0x7f17ac009da0 comp rx=0 tx=0).stop 2024-09-18T21:16:12.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.848+0000 7f17c2fa0640 1 -- 172.21.15.77:0/1700245331 shutdown_connections 2024-09-18T21:16:12.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.848+0000 7f17c2fa0640 1 --2- 172.21.15.77:0/1700245331 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17bc0fd2c0 0x7f17bc113a20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:12.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.848+0000 7f17c2fa0640 1 --2- 172.21.15.77:0/1700245331 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f17a806e1e0 0x7f17a8070690 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:12.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.848+0000 7f17c2fa0640 1 --2- 172.21.15.77:0/1700245331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17bc066540 0x7f17bc1134e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:12.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.848+0000 7f17c2fa0640 1 -- 172.21.15.77:0/1700245331 >> 172.21.15.77:0/1700245331 conn(0x7f17bc0f6a60 msgr2=0x7f17bc0f6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:16:12.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.848+0000 7f17c2fa0640 1 -- 172.21.15.77:0/1700245331 shutdown_connections 2024-09-18T21:16:12.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:12.848+0000 7f17c2fa0640 1 -- 172.21.15.77:0/1700245331 wait complete. 2024-09-18T21:16:13.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:13 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/480071898' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T21:16:13.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:13 smithi077 ceph-mon[92672]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:16:13.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:13 smithi077 ceph-mon[92672]: osd.0 marked itself down and dead 2024-09-18T21:16:13.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:13 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/1700245331' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T21:16:13.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:13 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/480071898' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T21:16:13.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:13 smithi103 ceph-mon[80307]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:16:13.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:13 smithi103 ceph-mon[80307]: osd.0 marked itself down and dead 2024-09-18T21:16:13.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:13 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/1700245331' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T21:16:13.853 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:13 smithi077 podman[100442]: 2024-09-18 21:16:13.606254392 +0000 UTC m=+1.182784429 container died 2e3563c32cf57e90c5516bdf23d0a54b02066b6dc0285c00cc630cdd4c37f4a4 (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-0, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-6e06d1e, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True) 2024-09-18T21:16:14.124 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:14 smithi077 podman[100442]: 2024-09-18 21:16:14.043363974 +0000 UTC m=+1.619894011 container cleanup 2e3563c32cf57e90c5516bdf23d0a54b02066b6dc0285c00cc630cdd4c37f4a4 (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-0, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=quincy-6e06d1e, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-18T21:16:14.125 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:14 smithi077 bash[100442]: ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-0 2024-09-18T21:16:14.454 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:14 smithi077 podman[100481]: 2024-09-18 21:16:14.236583014 +0000 UTC m=+0.631391041 container remove 2e3563c32cf57e90c5516bdf23d0a54b02066b6dc0285c00cc630cdd4c37f4a4 (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-0, org.label-schema.schema-version=1.0, RELEASE=quincy-6e06d1e, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-18T21:16:14.455 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:14 smithi077 ceph-mon[92672]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-18T21:16:14.455 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:14 smithi077 ceph-mon[92672]: osdmap e47: 6 total, 5 up, 6 in 2024-09-18T21:16:14.455 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:14 smithi077 ceph-mon[92672]: pgmap v38: 65 pgs: 9 stale+active+clean, 56 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:16:14.455 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:14 smithi077 ceph-mon[92672]: osdmap e48: 6 total, 5 up, 6 in 2024-09-18T21:16:14.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:14 smithi103 ceph-mon[80307]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-18T21:16:14.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:14 smithi103 ceph-mon[80307]: osdmap e47: 6 total, 5 up, 6 in 2024-09-18T21:16:14.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:14 smithi103 ceph-mon[80307]: pgmap v38: 65 pgs: 9 stale+active+clean, 56 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:16:14.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:14 smithi103 ceph-mon[80307]: osdmap e48: 6 total, 5 up, 6 in 2024-09-18T21:16:14.712 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:14 smithi077 podman[100573]: 2024-09-18 21:16:14.648290747 +0000 UTC m=+0.111349831 container create 6b81c7fed04ae190b858cd5b7e251571fe816730e2fd9a2ac39abbf5dbdee0b7 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-release-06b1b1d, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-18T21:16:14.713 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:14 smithi077 podman[100573]: 2024-09-18 21:16:14.552818566 +0000 UTC m=+0.015877654 image pull f79f744f586d6ce8ddb4b06b7cf36a0f23174bbe29ea68264d2be49d8c6d9acd quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a 2024-09-18T21:16:15.052 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:14 smithi077 podman[100573]: 2024-09-18 21:16:14.858930823 +0000 UTC m=+0.321989916 container init 6b81c7fed04ae190b858cd5b7e251571fe816730e2fd9a2ac39abbf5dbdee0b7 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-release-06b1b1d, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-18T21:16:15.053 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:14 smithi077 podman[100573]: 2024-09-18 21:16:14.862166833 +0000 UTC m=+0.325225920 container start 6b81c7fed04ae190b858cd5b7e251571fe816730e2fd9a2ac39abbf5dbdee0b7 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-release-06b1b1d, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-18T21:16:15.053 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:14 smithi077 podman[100573]: 2024-09-18 21:16:14.958952179 +0000 UTC m=+0.422011279 container attach 6b81c7fed04ae190b858cd5b7e251571fe816730e2fd9a2ac39abbf5dbdee0b7 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, RELEASE=squid-release-06b1b1d, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-18T21:16:15.397 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:15 smithi077 podman[100573]: 2024-09-18 21:16:15.050867553 +0000 UTC m=+0.513926649 container died 6b81c7fed04ae190b858cd5b7e251571fe816730e2fd9a2ac39abbf5dbdee0b7 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-release-06b1b1d) 2024-09-18T21:16:15.963 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:15 smithi077 podman[100596]: 2024-09-18 21:16:15.662680098 +0000 UTC m=+0.605795172 container remove 6b81c7fed04ae190b858cd5b7e251571fe816730e2fd9a2ac39abbf5dbdee0b7 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-release-06b1b1d, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-18T21:16:15.963 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:15 smithi077 systemd[1]: ceph-5a76ec16-7601-11ef-bceb-c7b262605968@osd.0.service: Deactivated successfully. 2024-09-18T21:16:15.963 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:15 smithi077 systemd[1]: Stopped Ceph osd.0 for 5a76ec16-7601-11ef-bceb-c7b262605968. 2024-09-18T21:16:15.963 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:15 smithi077 systemd[1]: ceph-5a76ec16-7601-11ef-bceb-c7b262605968@osd.0.service: Consumed 57.887s CPU time. 2024-09-18T21:16:15.963 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:15 smithi077 systemd[1]: Starting Ceph osd.0 for 5a76ec16-7601-11ef-bceb-c7b262605968... 2024-09-18T21:16:16.384 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:16 smithi077 podman[100694]: 2024-09-18 21:16:16.005256202 +0000 UTC m=+0.016716507 image pull f79f744f586d6ce8ddb4b06b7cf36a0f23174bbe29ea68264d2be49d8c6d9acd quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a 2024-09-18T21:16:16.384 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:16 smithi077 podman[100694]: 2024-09-18 21:16:16.131010723 +0000 UTC m=+0.142471032 container create eea0217b339a8a696b8cb7bca41260b092dd91b7d4ced1e4314145c1ba808f04 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-release-06b1b1d, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-18T21:16:16.384 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:16 smithi077 podman[100694]: 2024-09-18 21:16:16.383633978 +0000 UTC m=+0.395094283 container init eea0217b339a8a696b8cb7bca41260b092dd91b7d4ced1e4314145c1ba808f04 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-release-06b1b1d, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T21:16:16.713 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:16 smithi077 podman[100694]: 2024-09-18 21:16:16.387290287 +0000 UTC m=+0.398750599 container start eea0217b339a8a696b8cb7bca41260b092dd91b7d4ced1e4314145c1ba808f04 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-0-activate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-release-06b1b1d, io.buildah.version=1.37.2) 2024-09-18T21:16:16.713 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:16 smithi077 podman[100694]: 2024-09-18 21:16:16.475204488 +0000 UTC m=+0.486664796 container attach eea0217b339a8a696b8cb7bca41260b092dd91b7d4ced1e4314145c1ba808f04 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-0-activate, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-release-06b1b1d, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True) 2024-09-18T21:16:16.713 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:16 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-0-activate[100709]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T21:16:16.713 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:16 smithi077 bash[100694]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T21:16:16.713 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:16 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-0-activate[100709]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T21:16:16.713 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:16 smithi077 bash[100694]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T21:16:17.137 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:16 smithi077 ceph-mon[92672]: pgmap v40: 65 pgs: 9 stale+active+clean, 56 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:16:17.138 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:16 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-0-activate[100709]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-18T21:16:17.138 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:16 smithi077 bash[100694]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-18T21:16:17.138 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:16 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-0-activate[100709]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-18T21:16:17.138 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:16 smithi077 bash[100694]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-18T21:16:17.138 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:16 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-0-activate[100709]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-18T21:16:17.138 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:16 smithi077 bash[100694]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-18T21:16:17.138 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:16 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-0-activate[100709]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-18T21:16:17.138 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:16 smithi077 bash[100694]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-18T21:16:17.138 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:16 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-0-activate[100709]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-18T21:16:17.138 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:16 smithi077 bash[100694]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-18T21:16:17.138 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:16 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-0-activate[100709]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-18T21:16:17.138 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:16 smithi077 bash[100694]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-18T21:16:17.138 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:16 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-0-activate[100709]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-18T21:16:17.139 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:16 smithi077 bash[100694]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-18T21:16:17.139 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:16 smithi077 podman[100694]: 2024-09-18 21:16:16.767090211 +0000 UTC m=+0.778550519 container died eea0217b339a8a696b8cb7bca41260b092dd91b7d4ced1e4314145c1ba808f04 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-0-activate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-release-06b1b1d, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-18T21:16:17.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:16 smithi103 ceph-mon[80307]: pgmap v40: 65 pgs: 9 stale+active+clean, 56 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:16:17.713 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:17 smithi077 podman[100850]: 2024-09-18 21:16:17.437706271 +0000 UTC m=+0.664400815 container remove eea0217b339a8a696b8cb7bca41260b092dd91b7d4ced1e4314145c1ba808f04 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-release-06b1b1d, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD) 2024-09-18T21:16:17.713 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:17 smithi077 podman[100910]: 2024-09-18 21:16:17.549982898 +0000 UTC m=+0.015985653 image pull f79f744f586d6ce8ddb4b06b7cf36a0f23174bbe29ea68264d2be49d8c6d9acd quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a 2024-09-18T21:16:17.713 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:17 smithi077 podman[100910]: 2024-09-18 21:16:17.663610014 +0000 UTC m=+0.129612814 container create 8855b4b16e008efcd8b03f80da828493f081533ed5eeaa8f0bbe68ccce98f519 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-0, GIT_CLEAN=True, RELEASE=squid-release-06b1b1d, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-18T21:16:18.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:17 smithi077 ceph-mon[92672]: Health check failed: Degraded data redundancy: 39/222 objects degraded (17.568%), 18 pgs degraded (PG_DEGRADED) 2024-09-18T21:16:18.213 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:17 smithi077 podman[100910]: 2024-09-18 21:16:17.866448534 +0000 UTC m=+0.332451292 container init 8855b4b16e008efcd8b03f80da828493f081533ed5eeaa8f0bbe68ccce98f519 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-0, org.label-schema.vendor=CentOS, RELEASE=squid-release-06b1b1d, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-18T21:16:18.213 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:17 smithi077 podman[100910]: 2024-09-18 21:16:17.869677883 +0000 UTC m=+0.335680640 container start 8855b4b16e008efcd8b03f80da828493f081533ed5eeaa8f0bbe68ccce98f519 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-release-06b1b1d, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-18T21:16:18.213 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:17 smithi077 ceph-osd[100929]: -- 172.21.15.77:0/2559652720 <== mon.0 v2:172.21.15.77:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564dee7ce1e0 con 0x564ded981c00 2024-09-18T21:16:18.213 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:17 smithi077 bash[100910]: 8855b4b16e008efcd8b03f80da828493f081533ed5eeaa8f0bbe68ccce98f519 2024-09-18T21:16:18.213 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:17 smithi077 systemd[1]: Started Ceph osd.0 for 5a76ec16-7601-11ef-bceb-c7b262605968. 2024-09-18T21:16:18.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:17 smithi103 ceph-mon[80307]: Health check failed: Degraded data redundancy: 39/222 objects degraded (17.568%), 18 pgs degraded (PG_DEGRADED) 2024-09-18T21:16:18.707 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:18 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-0[100925]: 2024-09-18T21:16:18.416+0000 7f8406b70640 -1 Falling back to public interface 2024-09-18T21:16:19.439 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:19 smithi077 ceph-mon[92672]: pgmap v41: 65 pgs: 16 active+undersized, 18 active+undersized+degraded, 31 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 39/222 objects degraded (17.568%) 2024-09-18T21:16:19.439 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:19 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:19.440 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:19 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:19.440 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:19 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:16:19.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:19 smithi103 ceph-mon[80307]: pgmap v41: 65 pgs: 16 active+undersized, 18 active+undersized+degraded, 31 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 39/222 objects degraded (17.568%) 2024-09-18T21:16:19.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:19 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:19.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:19 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:19.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:19 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:16:21.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:21 smithi077 ceph-mon[92672]: pgmap v42: 65 pgs: 16 active+undersized, 18 active+undersized+degraded, 31 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 39/222 objects degraded (17.568%) 2024-09-18T21:16:21.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:21 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:21.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:21 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:16:21.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:21 smithi103 ceph-mon[80307]: pgmap v42: 65 pgs: 16 active+undersized, 18 active+undersized+degraded, 31 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 39/222 objects degraded (17.568%) 2024-09-18T21:16:21.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:21 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:21.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:21 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:16:23.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:23 smithi077 ceph-mon[92672]: pgmap v43: 65 pgs: 16 active+undersized, 18 active+undersized+degraded, 31 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 39/222 objects degraded (17.568%) 2024-09-18T21:16:23.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:23 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:23.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:23 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:23.463 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:23 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-0[100925]: 2024-09-18T21:16:23.266+0000 7f8406b70640 -1 osd.0 46 log_to_monitors true 2024-09-18T21:16:23.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:23 smithi103 ceph-mon[80307]: pgmap v43: 65 pgs: 16 active+undersized, 18 active+undersized+degraded, 31 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 39/222 objects degraded (17.568%) 2024-09-18T21:16:23.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:23 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:23.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:23 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:24.276 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:24 smithi077 ceph-mon[92672]: from='osd.0 [v2:172.21.15.77:6802/3633075312,v1:172.21.15.77:6803/3633075312]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-18T21:16:24.276 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:24 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:24.276 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:24 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:24.276 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:16:24 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-0[100925]: 2024-09-18T21:16:24.048+0000 7f83fe90a640 -1 osd.0 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T21:16:24.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:24 smithi103 ceph-mon[80307]: from='osd.0 [v2:172.21.15.77:6802/3633075312,v1:172.21.15.77:6803/3633075312]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-18T21:16:24.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:24 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:24.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:24 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:25.305 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:25 smithi077 ceph-mon[92672]: pgmap v44: 65 pgs: 16 active+undersized, 18 active+undersized+degraded, 31 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 39/222 objects degraded (17.568%) 2024-09-18T21:16:25.305 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:25 smithi077 ceph-mon[92672]: from='osd.0 [v2:172.21.15.77:6802/3633075312,v1:172.21.15.77:6803/3633075312]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-18T21:16:25.305 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:25 smithi077 ceph-mon[92672]: osdmap e49: 6 total, 5 up, 6 in 2024-09-18T21:16:25.305 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:25 smithi077 ceph-mon[92672]: from='osd.0 [v2:172.21.15.77:6802/3633075312,v1:172.21.15.77:6803/3633075312]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-09-18T21:16:25.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:25 smithi103 ceph-mon[80307]: pgmap v44: 65 pgs: 16 active+undersized, 18 active+undersized+degraded, 31 active+clean; 203 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 39/222 objects degraded (17.568%) 2024-09-18T21:16:25.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:25 smithi103 ceph-mon[80307]: from='osd.0 [v2:172.21.15.77:6802/3633075312,v1:172.21.15.77:6803/3633075312]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-18T21:16:25.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:25 smithi103 ceph-mon[80307]: osdmap e49: 6 total, 5 up, 6 in 2024-09-18T21:16:25.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:25 smithi103 ceph-mon[80307]: from='osd.0 [v2:172.21.15.77:6802/3633075312,v1:172.21.15.77:6803/3633075312]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-09-18T21:16:26.389 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:26 smithi077 ceph-mon[92672]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-18T21:16:26.389 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:26 smithi077 ceph-mon[92672]: osd.0 [v2:172.21.15.77:6802/3633075312,v1:172.21.15.77:6803/3633075312] boot 2024-09-18T21:16:26.389 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:26 smithi077 ceph-mon[92672]: osdmap e50: 6 total, 6 up, 6 in 2024-09-18T21:16:26.389 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:26 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T21:16:26.389 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:26 smithi077 ceph-mon[92672]: pgmap v47: 65 pgs: 16 active+undersized, 18 active+undersized+degraded, 31 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 39/222 objects degraded (17.568%) 2024-09-18T21:16:26.389 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:26 smithi077 ceph-mon[92672]: osdmap e51: 6 total, 6 up, 6 in 2024-09-18T21:16:26.415 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:26 smithi103 ceph-mon[80307]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-18T21:16:26.415 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:26 smithi103 ceph-mon[80307]: osd.0 [v2:172.21.15.77:6802/3633075312,v1:172.21.15.77:6803/3633075312] boot 2024-09-18T21:16:26.415 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:26 smithi103 ceph-mon[80307]: osdmap e50: 6 total, 6 up, 6 in 2024-09-18T21:16:26.415 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:26 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-18T21:16:26.415 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:26 smithi103 ceph-mon[80307]: pgmap v47: 65 pgs: 16 active+undersized, 18 active+undersized+degraded, 31 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 39/222 objects degraded (17.568%) 2024-09-18T21:16:26.415 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:26 smithi103 ceph-mon[80307]: osdmap e51: 6 total, 6 up, 6 in 2024-09-18T21:16:28.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:27 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:28.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:27 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:28.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:27 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:16:28.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:27 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:16:28.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:27 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:28.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:27 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:16:28.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:27 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:16:28.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:27 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:16:28.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:27 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:16:28.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:27 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-18T21:16:28.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:27 smithi103 ceph-mon[80307]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-18T21:16:28.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:27 smithi103 ceph-mon[80307]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-18T21:16:28.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:27 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:28.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:27 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:28.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:27 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:16:28.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:27 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:16:28.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:27 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:28.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:27 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:16:28.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:27 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:16:28.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:27 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:16:28.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:27 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:16:28.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:27 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-18T21:16:28.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:27 smithi077 ceph-mon[92672]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-18T21:16:28.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:27 smithi077 ceph-mon[92672]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-18T21:16:28.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:28 smithi077 ceph-mon[92672]: pgmap v49: 65 pgs: 6 active+undersized, 3 active+undersized+degraded, 56 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 6/222 objects degraded (2.703%) 2024-09-18T21:16:28.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:28 smithi077 ceph-mon[92672]: Health check update: Degraded data redundancy: 6/222 objects degraded (2.703%), 3 pgs degraded (PG_DEGRADED) 2024-09-18T21:16:29.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:28 smithi103 ceph-mon[80307]: pgmap v49: 65 pgs: 6 active+undersized, 3 active+undersized+degraded, 56 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 6/222 objects degraded (2.703%) 2024-09-18T21:16:29.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:28 smithi103 ceph-mon[80307]: Health check update: Degraded data redundancy: 6/222 objects degraded (2.703%), 3 pgs degraded (PG_DEGRADED) 2024-09-18T21:16:30.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:29 smithi077 ceph-mon[92672]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/222 objects degraded (2.703%), 3 pgs degraded) 2024-09-18T21:16:30.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:29 smithi077 ceph-mon[92672]: Cluster is now healthy 2024-09-18T21:16:30.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:29 smithi103 ceph-mon[80307]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/222 objects degraded (2.703%), 3 pgs degraded) 2024-09-18T21:16:30.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:29 smithi103 ceph-mon[80307]: Cluster is now healthy 2024-09-18T21:16:31.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:30 smithi077 ceph-mon[92672]: pgmap v50: 65 pgs: 65 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:16:31.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:30 smithi103 ceph-mon[80307]: pgmap v50: 65 pgs: 65 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:16:33.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:32 smithi077 ceph-mon[92672]: pgmap v51: 65 pgs: 65 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:16:33.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:32 smithi103 ceph-mon[80307]: pgmap v51: 65 pgs: 65 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:16:35.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:34 smithi077 ceph-mon[92672]: pgmap v52: 65 pgs: 65 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:16:35.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:34 smithi103 ceph-mon[80307]: pgmap v52: 65 pgs: 65 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:16:37.147 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:36 smithi103 ceph-mon[80307]: pgmap v53: 65 pgs: 65 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:16:37.147 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:36 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:37.147 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:36 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:16:37.147 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:36 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:37.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:36 smithi077 ceph-mon[92672]: pgmap v53: 65 pgs: 65 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:16:37.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:36 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:37.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:36 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:16:37.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:36 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:38.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:38 smithi077 ceph-mon[92672]: pgmap v54: 65 pgs: 65 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 261 B/s wr, 0 op/s 2024-09-18T21:16:38.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:38 smithi077 ceph-mon[92672]: mgrmap e37: smithi077.utkpjg(active, since 92s), standbys: smithi103.zjztqc 2024-09-18T21:16:39.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:38 smithi103 ceph-mon[80307]: pgmap v54: 65 pgs: 65 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 261 B/s wr, 0 op/s 2024-09-18T21:16:39.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:38 smithi103 ceph-mon[80307]: mgrmap e37: smithi077.utkpjg(active, since 92s), standbys: smithi103.zjztqc 2024-09-18T21:16:41.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:40 smithi077 ceph-mon[92672]: pgmap v55: 65 pgs: 65 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-18T21:16:41.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:40 smithi103 ceph-mon[80307]: pgmap v55: 65 pgs: 65 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-18T21:16:42.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:42.927+0000 7fde1d055640 1 -- 172.21.15.77:0/4022755888 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde180fb430 msgr2=0x7fde180fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:42.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:42.927+0000 7fde1d055640 1 --2- 172.21.15.77:0/4022755888 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde180fb430 0x7fde180fb840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fde08009c50 tx=0x7fde08004d10 comp rx=0 tx=0).stop 2024-09-18T21:16:42.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:42.927+0000 7fde1d055640 1 -- 172.21.15.77:0/4022755888 shutdown_connections 2024-09-18T21:16:42.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:42.927+0000 7fde1d055640 1 --2- 172.21.15.77:0/4022755888 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde180fc700 0x7fde180fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:42.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:42.927+0000 7fde1d055640 1 --2- 172.21.15.77:0/4022755888 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde180fb430 0x7fde180fb840 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:42.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:42.927+0000 7fde1d055640 1 -- 172.21.15.77:0/4022755888 >> 172.21.15.77:0/4022755888 conn(0x7fde180f6c10 msgr2=0x7fde180f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:16:42.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:42.927+0000 7fde1d055640 1 -- 172.21.15.77:0/4022755888 shutdown_connections 2024-09-18T21:16:42.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:42.927+0000 7fde1d055640 1 -- 172.21.15.77:0/4022755888 wait complete. 2024-09-18T21:16:42.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:42.928+0000 7fde1d055640 1 Processor -- start 2024-09-18T21:16:42.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:42.928+0000 7fde1d055640 1 -- start start 2024-09-18T21:16:42.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:42.928+0000 7fde1d055640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde180fb430 0x7fde1810fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:16:42.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:42.928+0000 7fde1d055640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde180fc700 0x7fde18112310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:16:42.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:42.928+0000 7fde1d055640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde18065c60 con 0x7fde180fb430 2024-09-18T21:16:42.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:42.928+0000 7fde1d055640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde18065dd0 con 0x7fde180fc700 2024-09-18T21:16:42.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:42.928+0000 7fde16d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde180fb430 0x7fde1810fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:16:42.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:42.928+0000 7fde16d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde180fb430 0x7fde1810fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43056/0 (socket says 172.21.15.77:43056) 2024-09-18T21:16:42.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:42.928+0000 7fde16d9d640 1 -- 172.21.15.77:0/1234738128 learned_addr learned my addr 172.21.15.77:0/1234738128 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:16:42.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:42.929+0000 7fde1659c640 1 --2- 172.21.15.77:0/1234738128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde180fc700 0x7fde18112310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:16:42.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:42.929+0000 7fde16d9d640 1 -- 172.21.15.77:0/1234738128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde180fc700 msgr2=0x7fde18112310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:42.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:42.929+0000 7fde16d9d640 1 --2- 172.21.15.77:0/1234738128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde180fc700 0x7fde18112310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:42.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:42.929+0000 7fde16d9d640 1 -- 172.21.15.77:0/1234738128 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde080098b0 con 0x7fde180fb430 2024-09-18T21:16:42.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:42.929+0000 7fde16d9d640 1 --2- 172.21.15.77:0/1234738128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde180fb430 0x7fde1810fdc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fde08004a30 tx=0x7fde08004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:16:42.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:42.929+0000 7fde0f7fe640 1 -- 172.21.15.77:0/1234738128 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde08009710 con 0x7fde180fb430 2024-09-18T21:16:42.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:42.929+0000 7fde0f7fe640 1 -- 172.21.15.77:0/1234738128 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fde08032b10 con 0x7fde180fb430 2024-09-18T21:16:42.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:42.929+0000 7fde1d055640 1 -- 172.21.15.77:0/1234738128 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde18112850 con 0x7fde180fb430 2024-09-18T21:16:42.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:42.929+0000 7fde0f7fe640 1 -- 172.21.15.77:0/1234738128 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde0803db10 con 0x7fde180fb430 2024-09-18T21:16:42.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:42.929+0000 7fde1d055640 1 -- 172.21.15.77:0/1234738128 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde18112dc0 con 0x7fde180fb430 2024-09-18T21:16:42.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:42.930+0000 7fde1d055640 1 -- 172.21.15.77:0/1234738128 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde180fa890 con 0x7fde180fb430 2024-09-18T21:16:42.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:42.931+0000 7fde0f7fe640 1 -- 172.21.15.77:0/1234738128 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fde0802f030 con 0x7fde180fb430 2024-09-18T21:16:42.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:42.931+0000 7fde0f7fe640 1 --2- 172.21.15.77:0/1234738128 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fde0406e0b0 0x7fde04070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:16:42.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:42.931+0000 7fde0f7fe640 1 -- 172.21.15.77:0/1234738128 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fde080af0b0 con 0x7fde180fb430 2024-09-18T21:16:42.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:42.931+0000 7fde1659c640 1 --2- 172.21.15.77:0/1234738128 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fde0406e0b0 0x7fde04070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:16:42.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:42.932+0000 7fde1659c640 1 --2- 172.21.15.77:0/1234738128 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fde0406e0b0 0x7fde04070560 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fde00004ed0 tx=0x7fde0000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:16:42.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:42.936+0000 7fde0f7fe640 1 -- 172.21.15.77:0/1234738128 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fde080785c0 con 0x7fde180fb430 2024-09-18T21:16:43.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.123+0000 7fde1d055640 1 -- 172.21.15.77:0/1234738128 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fde18100b60 con 0x7fde0406e0b0 2024-09-18T21:16:43.125 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:42 smithi077 ceph-mon[92672]: pgmap v56: 65 pgs: 65 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-18T21:16:43.125 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:42 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-18T21:16:43.125 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:42 smithi077 ceph-mon[92672]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-18T21:16:43.126 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:42 smithi077 ceph-mon[92672]: Upgrade: osd.1 is safe to restart 2024-09-18T21:16:43.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.124+0000 7fde0f7fe640 1 -- 172.21.15.77:0/1234738128 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fde18100b60 con 0x7fde0406e0b0 2024-09-18T21:16:43.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.126+0000 7fde1d055640 1 -- 172.21.15.77:0/1234738128 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fde0406e0b0 msgr2=0x7fde04070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:43.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.126+0000 7fde1d055640 1 --2- 172.21.15.77:0/1234738128 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fde0406e0b0 0x7fde04070560 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fde00004ed0 tx=0x7fde0000b040 comp rx=0 tx=0).stop 2024-09-18T21:16:43.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.126+0000 7fde1d055640 1 -- 172.21.15.77:0/1234738128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde180fb430 msgr2=0x7fde1810fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:43.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.126+0000 7fde1d055640 1 --2- 172.21.15.77:0/1234738128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde180fb430 0x7fde1810fdc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fde08004a30 tx=0x7fde08004d10 comp rx=0 tx=0).stop 2024-09-18T21:16:43.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.126+0000 7fde1d055640 1 -- 172.21.15.77:0/1234738128 shutdown_connections 2024-09-18T21:16:43.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.126+0000 7fde1d055640 1 --2- 172.21.15.77:0/1234738128 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fde0406e0b0 0x7fde04070560 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:43.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.126+0000 7fde1d055640 1 --2- 172.21.15.77:0/1234738128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde180fc700 0x7fde18112310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:43.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.126+0000 7fde1d055640 1 --2- 172.21.15.77:0/1234738128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde180fb430 0x7fde1810fdc0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:43.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.126+0000 7fde1d055640 1 -- 172.21.15.77:0/1234738128 >> 172.21.15.77:0/1234738128 conn(0x7fde180f6c10 msgr2=0x7fde180f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:16:43.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.126+0000 7fde1d055640 1 -- 172.21.15.77:0/1234738128 shutdown_connections 2024-09-18T21:16:43.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.126+0000 7fde1d055640 1 -- 172.21.15.77:0/1234738128 wait complete. 2024-09-18T21:16:43.137 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-09-18T21:16:43.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.206+0000 7f4da523c640 1 -- 172.21.15.77:0/3773796896 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4da00fd7f0 msgr2=0x7f4da00fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:43.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.206+0000 7f4da523c640 1 --2- 172.21.15.77:0/3773796896 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4da00fd7f0 0x7f4da00fdc60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4d940048d0 tx=0x7f4d94009da0 comp rx=0 tx=0).stop 2024-09-18T21:16:43.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.206+0000 7f4da523c640 1 -- 172.21.15.77:0/3773796896 shutdown_connections 2024-09-18T21:16:43.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.206+0000 7f4da523c640 1 --2- 172.21.15.77:0/3773796896 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4da00fd7f0 0x7f4da00fdc60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:43.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.206+0000 7f4da523c640 1 --2- 172.21.15.77:0/3773796896 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4da00fc520 0x7f4da00fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:43.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.206+0000 7f4da523c640 1 -- 172.21.15.77:0/3773796896 >> 172.21.15.77:0/3773796896 conn(0x7f4da00f7ce0 msgr2=0x7f4da00fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:16:43.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.206+0000 7f4da523c640 1 -- 172.21.15.77:0/3773796896 shutdown_connections 2024-09-18T21:16:43.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.206+0000 7f4da523c640 1 -- 172.21.15.77:0/3773796896 wait complete. 2024-09-18T21:16:43.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.206+0000 7f4da523c640 1 Processor -- start 2024-09-18T21:16:43.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.207+0000 7f4da523c640 1 -- start start 2024-09-18T21:16:43.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.207+0000 7f4da523c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4da00fc520 0x7f4da010d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:16:43.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.207+0000 7f4da523c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4da00fd7f0 0x7f4da010d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:16:43.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.207+0000 7f4da523c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da010dbf0 con 0x7f4da00fc520 2024-09-18T21:16:43.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.207+0000 7f4da523c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da010e410 con 0x7f4da00fd7f0 2024-09-18T21:16:43.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.207+0000 7f4d9ed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4da00fc520 0x7f4da010d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:16:43.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.207+0000 7f4d9ed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4da00fc520 0x7f4da010d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43076/0 (socket says 172.21.15.77:43076) 2024-09-18T21:16:43.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.207+0000 7f4d9ed9d640 1 -- 172.21.15.77:0/2076754915 learned_addr learned my addr 172.21.15.77:0/2076754915 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:16:43.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.207+0000 7f4d9e59c640 1 --2- 172.21.15.77:0/2076754915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4da00fd7f0 0x7f4da010d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:16:43.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.207+0000 7f4d9ed9d640 1 -- 172.21.15.77:0/2076754915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4da00fd7f0 msgr2=0x7f4da010d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:43.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.207+0000 7f4d9ed9d640 1 --2- 172.21.15.77:0/2076754915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4da00fd7f0 0x7f4da010d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:43.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.207+0000 7f4d9ed9d640 1 -- 172.21.15.77:0/2076754915 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d94005040 con 0x7f4da00fc520 2024-09-18T21:16:43.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.207+0000 7f4d9ed9d640 1 --2- 172.21.15.77:0/2076754915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4da00fc520 0x7f4da010d060 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4d9000c830 tx=0x7f4d90004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:16:43.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.207+0000 7f4d877fe640 1 -- 172.21.15.77:0/2076754915 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d9000a850 con 0x7f4da00fc520 2024-09-18T21:16:43.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.207+0000 7f4d877fe640 1 -- 172.21.15.77:0/2076754915 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4d9000ae50 con 0x7f4da00fc520 2024-09-18T21:16:43.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.207+0000 7f4da523c640 1 -- 172.21.15.77:0/2076754915 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4da010e6a0 con 0x7f4da00fc520 2024-09-18T21:16:43.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.208+0000 7f4d877fe640 1 -- 172.21.15.77:0/2076754915 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d900113a0 con 0x7f4da00fc520 2024-09-18T21:16:43.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.208+0000 7f4da523c640 1 -- 172.21.15.77:0/2076754915 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4da010ec40 con 0x7f4da00fc520 2024-09-18T21:16:43.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.209+0000 7f4da523c640 1 -- 172.21.15.77:0/2076754915 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4da00fb980 con 0x7f4da00fc520 2024-09-18T21:16:43.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.209+0000 7f4d877fe640 1 -- 172.21.15.77:0/2076754915 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f4d90012400 con 0x7f4da00fc520 2024-09-18T21:16:43.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.209+0000 7f4d877fe640 1 --2- 172.21.15.77:0/2076754915 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f4d8806e0b0 0x7f4d88070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:16:43.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.210+0000 7f4d877fe640 1 -- 172.21.15.77:0/2076754915 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f4d9008dd30 con 0x7f4da00fc520 2024-09-18T21:16:43.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.210+0000 7f4d9e59c640 1 --2- 172.21.15.77:0/2076754915 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f4d8806e0b0 0x7f4d88070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:16:43.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.210+0000 7f4d9e59c640 1 --2- 172.21.15.77:0/2076754915 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f4d8806e0b0 0x7f4d88070560 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4d94000c00 tx=0x7f4d94009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:16:43.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.214+0000 7f4d877fe640 1 -- 172.21.15.77:0/2076754915 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f4d90057180 con 0x7f4da00fc520 2024-09-18T21:16:43.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:42 smithi103 ceph-mon[80307]: pgmap v56: 65 pgs: 65 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-18T21:16:43.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:42 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-18T21:16:43.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:42 smithi103 ceph-mon[80307]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-18T21:16:43.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:42 smithi103 ceph-mon[80307]: Upgrade: osd.1 is safe to restart 2024-09-18T21:16:43.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.397+0000 7f4da523c640 1 -- 172.21.15.77:0/2076754915 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4da010ef90 con 0x7f4d8806e0b0 2024-09-18T21:16:43.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.398+0000 7f4d877fe640 1 -- 172.21.15.77:0/2076754915 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f4da010ef90 con 0x7f4d8806e0b0 2024-09-18T21:16:43.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.400+0000 7f4da523c640 1 -- 172.21.15.77:0/2076754915 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f4d8806e0b0 msgr2=0x7f4d88070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:43.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.400+0000 7f4da523c640 1 --2- 172.21.15.77:0/2076754915 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f4d8806e0b0 0x7f4d88070560 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4d94000c00 tx=0x7f4d94009da0 comp rx=0 tx=0).stop 2024-09-18T21:16:43.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.400+0000 7f4da523c640 1 -- 172.21.15.77:0/2076754915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4da00fc520 msgr2=0x7f4da010d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:43.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.400+0000 7f4da523c640 1 --2- 172.21.15.77:0/2076754915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4da00fc520 0x7f4da010d060 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4d9000c830 tx=0x7f4d90004430 comp rx=0 tx=0).stop 2024-09-18T21:16:43.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.401+0000 7f4da523c640 1 -- 172.21.15.77:0/2076754915 shutdown_connections 2024-09-18T21:16:43.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.401+0000 7f4da523c640 1 --2- 172.21.15.77:0/2076754915 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f4d8806e0b0 0x7f4d88070560 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:43.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.401+0000 7f4da523c640 1 --2- 172.21.15.77:0/2076754915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4da00fd7f0 0x7f4da010d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:43.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.401+0000 7f4da523c640 1 --2- 172.21.15.77:0/2076754915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4da00fc520 0x7f4da010d060 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:43.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.401+0000 7f4da523c640 1 -- 172.21.15.77:0/2076754915 >> 172.21.15.77:0/2076754915 conn(0x7f4da00f7ce0 msgr2=0x7f4da00f94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:16:43.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.401+0000 7f4da523c640 1 -- 172.21.15.77:0/2076754915 shutdown_connections 2024-09-18T21:16:43.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.401+0000 7f4da523c640 1 -- 172.21.15.77:0/2076754915 wait complete. 2024-09-18T21:16:43.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.479+0000 7f99d2f9b640 1 -- 172.21.15.77:0/2673274665 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99cc0fc520 msgr2=0x7f99cc0fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:43.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.479+0000 7f99d2f9b640 1 --2- 172.21.15.77:0/2673274665 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99cc0fc520 0x7f99cc0fc930 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f99c80048d0 tx=0x7f99c8009da0 comp rx=0 tx=0).stop 2024-09-18T21:16:43.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.479+0000 7f99d2f9b640 1 -- 172.21.15.77:0/2673274665 shutdown_connections 2024-09-18T21:16:43.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.479+0000 7f99d2f9b640 1 --2- 172.21.15.77:0/2673274665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99cc0fd7f0 0x7f99cc0fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:43.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.479+0000 7f99d2f9b640 1 --2- 172.21.15.77:0/2673274665 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99cc0fc520 0x7f99cc0fc930 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:43.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.479+0000 7f99d2f9b640 1 -- 172.21.15.77:0/2673274665 >> 172.21.15.77:0/2673274665 conn(0x7f99cc0f7ce0 msgr2=0x7f99cc0fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:16:43.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.479+0000 7f99d2f9b640 1 -- 172.21.15.77:0/2673274665 shutdown_connections 2024-09-18T21:16:43.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.479+0000 7f99d2f9b640 1 -- 172.21.15.77:0/2673274665 wait complete. 2024-09-18T21:16:43.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.480+0000 7f99d2f9b640 1 Processor -- start 2024-09-18T21:16:43.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.480+0000 7f99d2f9b640 1 -- start start 2024-09-18T21:16:43.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.480+0000 7f99d2f9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99cc0fc520 0x7f99cc10d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:16:43.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.480+0000 7f99d2f9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99cc0fd7f0 0x7f99cc10d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:16:43.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.480+0000 7f99d2f9b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc10dc10 con 0x7f99cc0fc520 2024-09-18T21:16:43.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.480+0000 7f99d2f9b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc10e430 con 0x7f99cc0fd7f0 2024-09-18T21:16:43.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.480+0000 7f99d0d37640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99cc0fc520 0x7f99cc10d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:16:43.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.480+0000 7f99d0d37640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99cc0fc520 0x7f99cc10d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43088/0 (socket says 172.21.15.77:43088) 2024-09-18T21:16:43.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.480+0000 7f99d0d37640 1 -- 172.21.15.77:0/2114562735 learned_addr learned my addr 172.21.15.77:0/2114562735 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:16:43.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.480+0000 7f99d0d37640 1 -- 172.21.15.77:0/2114562735 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99cc0fd7f0 msgr2=0x7f99cc10d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:43.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.480+0000 7f99c3fff640 1 --2- 172.21.15.77:0/2114562735 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99cc0fd7f0 0x7f99cc10d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:16:43.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.480+0000 7f99d0d37640 1 --2- 172.21.15.77:0/2114562735 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99cc0fd7f0 0x7f99cc10d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:43.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.480+0000 7f99d0d37640 1 -- 172.21.15.77:0/2114562735 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c8005040 con 0x7f99cc0fc520 2024-09-18T21:16:43.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.481+0000 7f99d0d37640 1 --2- 172.21.15.77:0/2114562735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99cc0fc520 0x7f99cc10d080 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f99c8003080 tx=0x7f99c8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:16:43.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.481+0000 7f99c17fa640 1 -- 172.21.15.77:0/2114562735 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99c8038070 con 0x7f99cc0fc520 2024-09-18T21:16:43.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.481+0000 7f99c17fa640 1 -- 172.21.15.77:0/2114562735 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f99c802abd0 con 0x7f99cc0fc520 2024-09-18T21:16:43.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.481+0000 7f99d2f9b640 1 -- 172.21.15.77:0/2114562735 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99cc10e660 con 0x7f99cc0fc520 2024-09-18T21:16:43.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.481+0000 7f99c17fa640 1 -- 172.21.15.77:0/2114562735 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99c803e670 con 0x7f99cc0fc520 2024-09-18T21:16:43.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.481+0000 7f99d2f9b640 1 -- 172.21.15.77:0/2114562735 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99cc10ec00 con 0x7f99cc0fc520 2024-09-18T21:16:43.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.482+0000 7f99d2f9b640 1 -- 172.21.15.77:0/2114562735 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99cc0fb980 con 0x7f99cc0fc520 2024-09-18T21:16:43.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.482+0000 7f99c17fa640 1 -- 172.21.15.77:0/2114562735 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f99c8030020 con 0x7f99cc0fc520 2024-09-18T21:16:43.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.483+0000 7f99c17fa640 1 --2- 172.21.15.77:0/2114562735 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f99b406e0b0 0x7f99b4070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:16:43.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.483+0000 7f99c17fa640 1 -- 172.21.15.77:0/2114562735 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f99c80adf30 con 0x7f99cc0fc520 2024-09-18T21:16:43.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.483+0000 7f99c3fff640 1 --2- 172.21.15.77:0/2114562735 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f99b406e0b0 0x7f99b4070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:16:43.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.483+0000 7f99c3fff640 1 --2- 172.21.15.77:0/2114562735 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f99b406e0b0 0x7f99b4070560 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f99cc10ce30 tx=0x7f99bc009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:16:43.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.487+0000 7f99c17fa640 1 -- 172.21.15.77:0/2114562735 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f99c80e2df0 con 0x7f99cc0fc520 2024-09-18T21:16:43.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.670+0000 7f99d2f9b640 1 -- 172.21.15.77:0/2114562735 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f99cc10ef10 con 0x7f99b406e0b0 2024-09-18T21:16:43.682 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T21:16:43.682 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager.smithi077 smithi077 *:9093,9094 running (3m) 20s ago 11m 24.2M - 0.25.0 c8568f914cd2 b201d325a55b 2024-09-18T21:16:43.682 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi077 smithi077 running (50s) 20s ago 11m 6891k - 19.1.1-17-g06b1b1de f79f744f586d 5872fa24b792 2024-09-18T21:16:43.682 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi103 smithi103 running (45s) 42s ago 10m 6887k - 19.1.1-17-g06b1b1de f79f744f586d cd1604469f34 2024-09-18T21:16:43.682 INFO:teuthology.orchestra.run.smithi077.stdout:grafana.smithi077 smithi077 *:3000 running (3m) 20s ago 11m 79.9M - 9.4.7 954c08fa6188 d06ef3ab9e66 2024-09-18T21:16:43.682 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.cqfhlw smithi077 running (6m) 20s ago 6m 14.5M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 a7ec3b7701b6 2024-09-18T21:16:43.682 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.vruydi smithi077 running (6m) 20s ago 6m 141M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 affbba097d3b 2024-09-18T21:16:43.682 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi103.opftmf smithi103 running (6m) 42s ago 6m 16.5M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 111f884c5a34 2024-09-18T21:16:43.682 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi103.zhdmdg smithi103 running (6m) 42s ago 6m 15.6M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 50b77d0edda5 2024-09-18T21:16:43.682 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi077.utkpjg smithi077 *:8443,9283,8765 running (2m) 20s ago 12m 495M - 19.1.1-17-g06b1b1de f79f744f586d 99d4b0fd70f6 2024-09-18T21:16:43.682 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi103.zjztqc smithi103 *:8443,9283,8765 running (119s) 42s ago 10m 439M - 19.1.1-17-g06b1b1de f79f744f586d 54589547c4d7 2024-09-18T21:16:43.682 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi077 smithi077 running (106s) 20s ago 12m 41.3M 2048M 19.1.1-17-g06b1b1de f79f744f586d 2d0fbbea1264 2024-09-18T21:16:43.683 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi103 smithi103 running (85s) 42s ago 10m 34.6M 2048M 19.1.1-17-g06b1b1de f79f744f586d dc79edbd9602 2024-09-18T21:16:43.683 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi077 smithi077 *:9100 running (3m) 20s ago 11m 15.3M - 1.5.0 0da6a335fe13 99144245c1af 2024-09-18T21:16:43.683 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi103 smithi103 *:9100 running (3m) 42s ago 10m 16.5M - 1.5.0 0da6a335fe13 e5b51144d997 2024-09-18T21:16:43.683 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (26s) 20s ago 9m 12.1M 1557M 19.1.1-17-g06b1b1de f79f744f586d 8855b4b16e00 2024-09-18T21:16:43.683 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi077 running (9m) 20s ago 9m 235M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 39c2ccbb7603 2024-09-18T21:16:43.683 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi077 running (9m) 20s ago 9m 200M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 2ff2728057e2 2024-09-18T21:16:43.683 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi103 running (8m) 42s ago 8m 275M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 0e72b1bbb8ce 2024-09-18T21:16:43.683 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi103 running (8m) 42s ago 8m 244M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 85f1ce1e8bee 2024-09-18T21:16:43.683 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi103 running (7m) 42s ago 7m 228M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 cf8964b3ac6d 2024-09-18T21:16:43.683 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus.smithi077 smithi077 *:9095 running (2m) 20s ago 11m 53.4M - 2.43.0 a07b618ecd1d 41f3729e3400 2024-09-18T21:16:43.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.679+0000 7f99c17fa640 1 -- 172.21.15.77:0/2114562735 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f99cc10ef10 con 0x7f99b406e0b0 2024-09-18T21:16:43.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.682+0000 7f99d2f9b640 1 -- 172.21.15.77:0/2114562735 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f99b406e0b0 msgr2=0x7f99b4070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:43.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.682+0000 7f99d2f9b640 1 --2- 172.21.15.77:0/2114562735 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f99b406e0b0 0x7f99b4070560 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f99cc10ce30 tx=0x7f99bc009040 comp rx=0 tx=0).stop 2024-09-18T21:16:43.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.682+0000 7f99d2f9b640 1 -- 172.21.15.77:0/2114562735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99cc0fc520 msgr2=0x7f99cc10d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:43.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.682+0000 7f99d2f9b640 1 --2- 172.21.15.77:0/2114562735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99cc0fc520 0x7f99cc10d080 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f99c8003080 tx=0x7f99c8009da0 comp rx=0 tx=0).stop 2024-09-18T21:16:43.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.682+0000 7f99d2f9b640 1 -- 172.21.15.77:0/2114562735 shutdown_connections 2024-09-18T21:16:43.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.682+0000 7f99d2f9b640 1 --2- 172.21.15.77:0/2114562735 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f99b406e0b0 0x7f99b4070560 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:43.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.682+0000 7f99d2f9b640 1 --2- 172.21.15.77:0/2114562735 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99cc0fd7f0 0x7f99cc10d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:43.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.682+0000 7f99d2f9b640 1 --2- 172.21.15.77:0/2114562735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99cc0fc520 0x7f99cc10d080 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:43.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.682+0000 7f99d2f9b640 1 -- 172.21.15.77:0/2114562735 >> 172.21.15.77:0/2114562735 conn(0x7f99cc0f7ce0 msgr2=0x7f99cc0f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:16:43.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.682+0000 7f99d2f9b640 1 -- 172.21.15.77:0/2114562735 shutdown_connections 2024-09-18T21:16:43.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.682+0000 7f99d2f9b640 1 -- 172.21.15.77:0/2114562735 wait complete. 2024-09-18T21:16:43.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.761+0000 7f80c53d7640 1 -- 172.21.15.77:0/816601423 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80c00fc520 msgr2=0x7f80c00fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:43.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.761+0000 7f80c53d7640 1 --2- 172.21.15.77:0/816601423 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80c00fc520 0x7f80c00fc930 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f80b00048d0 tx=0x7f80b0009da0 comp rx=0 tx=0).stop 2024-09-18T21:16:43.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.761+0000 7f80c53d7640 1 -- 172.21.15.77:0/816601423 shutdown_connections 2024-09-18T21:16:43.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.761+0000 7f80c53d7640 1 --2- 172.21.15.77:0/816601423 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80c00fd7f0 0x7f80c00fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:43.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.761+0000 7f80c53d7640 1 --2- 172.21.15.77:0/816601423 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80c00fc520 0x7f80c00fc930 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:43.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.761+0000 7f80c53d7640 1 -- 172.21.15.77:0/816601423 >> 172.21.15.77:0/816601423 conn(0x7f80c00f7ce0 msgr2=0x7f80c00fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:16:43.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.761+0000 7f80c53d7640 1 -- 172.21.15.77:0/816601423 shutdown_connections 2024-09-18T21:16:43.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.761+0000 7f80c53d7640 1 -- 172.21.15.77:0/816601423 wait complete. 2024-09-18T21:16:43.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.762+0000 7f80c53d7640 1 Processor -- start 2024-09-18T21:16:43.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.762+0000 7f80c53d7640 1 -- start start 2024-09-18T21:16:43.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.762+0000 7f80c53d7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80c00fc520 0x7f80c010d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:16:43.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.762+0000 7f80c53d7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80c00fd7f0 0x7f80c010d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:16:43.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.762+0000 7f80c53d7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c010dc10 con 0x7f80c00fd7f0 2024-09-18T21:16:43.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.762+0000 7f80c53d7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c010e430 con 0x7f80c00fc520 2024-09-18T21:16:43.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.762+0000 7f80be7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80c00fd7f0 0x7f80c010d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:16:43.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.762+0000 7f80be7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80c00fd7f0 0x7f80c010d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43108/0 (socket says 172.21.15.77:43108) 2024-09-18T21:16:43.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.762+0000 7f80be7fc640 1 -- 172.21.15.77:0/1760135523 learned_addr learned my addr 172.21.15.77:0/1760135523 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:16:43.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.762+0000 7f80beffd640 1 --2- 172.21.15.77:0/1760135523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80c00fc520 0x7f80c010d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:16:43.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.763+0000 7f80be7fc640 1 -- 172.21.15.77:0/1760135523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80c00fc520 msgr2=0x7f80c010d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:43.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.763+0000 7f80be7fc640 1 --2- 172.21.15.77:0/1760135523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80c00fc520 0x7f80c010d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:43.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.763+0000 7f80be7fc640 1 -- 172.21.15.77:0/1760135523 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b0005040 con 0x7f80c00fd7f0 2024-09-18T21:16:43.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.763+0000 7f80be7fc640 1 --2- 172.21.15.77:0/1760135523 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80c00fd7f0 0x7f80c010d5c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f80b400c830 tx=0x7f80b4004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:16:43.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.763+0000 7f80a77fe640 1 -- 172.21.15.77:0/1760135523 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80b400a7d0 con 0x7f80c00fd7f0 2024-09-18T21:16:43.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.763+0000 7f80c53d7640 1 -- 172.21.15.77:0/1760135523 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80c010e6c0 con 0x7f80c00fd7f0 2024-09-18T21:16:43.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.763+0000 7f80a77fe640 1 -- 172.21.15.77:0/1760135523 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f80b400add0 con 0x7f80c00fd7f0 2024-09-18T21:16:43.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.763+0000 7f80a77fe640 1 -- 172.21.15.77:0/1760135523 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80b40113a0 con 0x7f80c00fd7f0 2024-09-18T21:16:43.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.763+0000 7f80c53d7640 1 -- 172.21.15.77:0/1760135523 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80c010ec60 con 0x7f80c00fd7f0 2024-09-18T21:16:43.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.764+0000 7f80c53d7640 1 -- 172.21.15.77:0/1760135523 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80c00fb980 con 0x7f80c00fd7f0 2024-09-18T21:16:43.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.765+0000 7f80a77fe640 1 -- 172.21.15.77:0/1760135523 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f80b4012400 con 0x7f80c00fd7f0 2024-09-18T21:16:43.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.765+0000 7f80a77fe640 1 --2- 172.21.15.77:0/1760135523 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f80a806e0b0 0x7f80a8070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:16:43.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.765+0000 7f80a77fe640 1 -- 172.21.15.77:0/1760135523 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f80b408dbf0 con 0x7f80c00fd7f0 2024-09-18T21:16:43.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.765+0000 7f80beffd640 1 --2- 172.21.15.77:0/1760135523 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f80a806e0b0 0x7f80a8070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:16:43.769 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.766+0000 7f80beffd640 1 --2- 172.21.15.77:0/1760135523 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f80a806e0b0 0x7f80a8070560 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f80b0000c00 tx=0x7f80b0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:16:43.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:43.774+0000 7f80a77fe640 1 -- 172.21.15.77:0/1760135523 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f80b4057040 con 0x7f80c00fd7f0 2024-09-18T21:16:44.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.021+0000 7f80c53d7640 1 -- 172.21.15.77:0/1760135523 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f80c004b720 con 0x7f80c00fd7f0 2024-09-18T21:16:44.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.022+0000 7f80a77fe640 1 -- 172.21.15.77:0/1760135523 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7f80b405a700 con 0x7f80c00fd7f0 2024-09-18T21:16:44.024 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-18T21:16:44.024 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": { 2024-09-18T21:16:44.024 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 2 2024-09-18T21:16:44.025 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:16:44.025 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": { 2024-09-18T21:16:44.025 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 2 2024-09-18T21:16:44.025 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:16:44.025 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": { 2024-09-18T21:16:44.025 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 5, 2024-09-18T21:16:44.025 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 1 2024-09-18T21:16:44.025 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:16:44.025 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-09-18T21:16:44.025 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4 2024-09-18T21:16:44.025 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:16:44.025 INFO:teuthology.orchestra.run.smithi077.stdout: "overall": { 2024-09-18T21:16:44.025 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 9, 2024-09-18T21:16:44.026 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 5 2024-09-18T21:16:44.026 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-18T21:16:44.026 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-18T21:16:44.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.024+0000 7f80c53d7640 1 -- 172.21.15.77:0/1760135523 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f80a806e0b0 msgr2=0x7f80a8070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:44.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.024+0000 7f80c53d7640 1 --2- 172.21.15.77:0/1760135523 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f80a806e0b0 0x7f80a8070560 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f80b0000c00 tx=0x7f80b0035040 comp rx=0 tx=0).stop 2024-09-18T21:16:44.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.024+0000 7f80c53d7640 1 -- 172.21.15.77:0/1760135523 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80c00fd7f0 msgr2=0x7f80c010d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:44.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.024+0000 7f80c53d7640 1 --2- 172.21.15.77:0/1760135523 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80c00fd7f0 0x7f80c010d5c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f80b400c830 tx=0x7f80b4004430 comp rx=0 tx=0).stop 2024-09-18T21:16:44.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.024+0000 7f80c53d7640 1 -- 172.21.15.77:0/1760135523 shutdown_connections 2024-09-18T21:16:44.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.024+0000 7f80c53d7640 1 --2- 172.21.15.77:0/1760135523 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80c00fd7f0 0x7f80c010d5c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:44.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.024+0000 7f80c53d7640 1 --2- 172.21.15.77:0/1760135523 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f80a806e0b0 0x7f80a8070560 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:44.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.024+0000 7f80c53d7640 1 --2- 172.21.15.77:0/1760135523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f80c00fc520 0x7f80c010d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:44.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.024+0000 7f80c53d7640 1 -- 172.21.15.77:0/1760135523 >> 172.21.15.77:0/1760135523 conn(0x7f80c00f7ce0 msgr2=0x7f80c00f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:16:44.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.024+0000 7f80c53d7640 1 -- 172.21.15.77:0/1760135523 shutdown_connections 2024-09-18T21:16:44.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.024+0000 7f80c53d7640 1 -- 172.21.15.77:0/1760135523 wait complete. 2024-09-18T21:16:44.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.106+0000 7f93ed0d0640 1 -- 172.21.15.77:0/3728217175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93e80fb420 msgr2=0x7f93e80fb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:44.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.106+0000 7f93ed0d0640 1 --2- 172.21.15.77:0/3728217175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93e80fb420 0x7f93e80fb830 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f93d8009c50 tx=0x7f93d8004d10 comp rx=0 tx=0).stop 2024-09-18T21:16:44.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.107+0000 7f93ed0d0640 1 -- 172.21.15.77:0/3728217175 shutdown_connections 2024-09-18T21:16:44.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.107+0000 7f93ed0d0640 1 --2- 172.21.15.77:0/3728217175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93e80fc6f0 0x7f93e80fcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:44.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.107+0000 7f93ed0d0640 1 --2- 172.21.15.77:0/3728217175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93e80fb420 0x7f93e80fb830 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:44.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.107+0000 7f93ed0d0640 1 -- 172.21.15.77:0/3728217175 >> 172.21.15.77:0/3728217175 conn(0x7f93e80f6c00 msgr2=0x7f93e80f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:16:44.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.107+0000 7f93ed0d0640 1 -- 172.21.15.77:0/3728217175 shutdown_connections 2024-09-18T21:16:44.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.107+0000 7f93ed0d0640 1 -- 172.21.15.77:0/3728217175 wait complete. 2024-09-18T21:16:44.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.107+0000 7f93ed0d0640 1 Processor -- start 2024-09-18T21:16:44.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.107+0000 7f93ed0d0640 1 -- start start 2024-09-18T21:16:44.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.107+0000 7f93ed0d0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93e80fb420 0x7f93e810bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:16:44.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.107+0000 7f93ed0d0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93e80fc6f0 0x7f93e810c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:16:44.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.107+0000 7f93ed0d0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e810cb00 con 0x7f93e80fb420 2024-09-18T21:16:44.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.107+0000 7f93ed0d0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e810d320 con 0x7f93e80fc6f0 2024-09-18T21:16:44.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.108+0000 7f93e6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93e80fb420 0x7f93e810bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:16:44.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.108+0000 7f93e6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93e80fb420 0x7f93e810bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43120/0 (socket says 172.21.15.77:43120) 2024-09-18T21:16:44.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.108+0000 7f93e6d9d640 1 -- 172.21.15.77:0/1517219301 learned_addr learned my addr 172.21.15.77:0/1517219301 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:16:44.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.108+0000 7f93e659c640 1 --2- 172.21.15.77:0/1517219301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93e80fc6f0 0x7f93e810c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:16:44.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.108+0000 7f93e6d9d640 1 -- 172.21.15.77:0/1517219301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93e80fc6f0 msgr2=0x7f93e810c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:44.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.108+0000 7f93e6d9d640 1 --2- 172.21.15.77:0/1517219301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93e80fc6f0 0x7f93e810c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:44.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.108+0000 7f93e6d9d640 1 -- 172.21.15.77:0/1517219301 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d80098b0 con 0x7f93e80fb420 2024-09-18T21:16:44.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.108+0000 7f93e6d9d640 1 --2- 172.21.15.77:0/1517219301 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93e80fb420 0x7f93e810bf70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f93d8009c20 tx=0x7f93d8004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:16:44.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.108+0000 7f93cf7fe640 1 -- 172.21.15.77:0/1517219301 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93d8009610 con 0x7f93e80fb420 2024-09-18T21:16:44.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.108+0000 7f93cf7fe640 1 -- 172.21.15.77:0/1517219301 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f93d8032b10 con 0x7f93e80fb420 2024-09-18T21:16:44.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.108+0000 7f93cf7fe640 1 -- 172.21.15.77:0/1517219301 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93d803da80 con 0x7f93e80fb420 2024-09-18T21:16:44.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.108+0000 7f93ed0d0640 1 -- 172.21.15.77:0/1517219301 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93e810d550 con 0x7f93e80fb420 2024-09-18T21:16:44.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.108+0000 7f93ed0d0640 1 -- 172.21.15.77:0/1517219301 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e810daf0 con 0x7f93e80fb420 2024-09-18T21:16:44.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.109+0000 7f93ed0d0640 1 -- 172.21.15.77:0/1517219301 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93e80fa880 con 0x7f93e80fb420 2024-09-18T21:16:44.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.110+0000 7f93cf7fe640 1 -- 172.21.15.77:0/1517219301 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f93d802f030 con 0x7f93e80fb420 2024-09-18T21:16:44.114 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.110+0000 7f93cf7fe640 1 --2- 172.21.15.77:0/1517219301 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f93d006e0b0 0x7f93d0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:16:44.114 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.110+0000 7f93cf7fe640 1 -- 172.21.15.77:0/1517219301 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f93d80af100 con 0x7f93e80fb420 2024-09-18T21:16:44.114 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.110+0000 7f93e659c640 1 --2- 172.21.15.77:0/1517219301 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f93d006e0b0 0x7f93d0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:16:44.114 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.111+0000 7f93e659c640 1 --2- 172.21.15.77:0/1517219301 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f93d006e0b0 0x7f93d0070560 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f93e810bd20 tx=0x7f93dc00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:16:44.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.115+0000 7f93cf7fe640 1 -- 172.21.15.77:0/1517219301 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f93d8078590 con 0x7f93e80fb420 2024-09-18T21:16:44.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.320+0000 7f93ed0d0640 1 -- 172.21.15.77:0/1517219301 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f93e810dd50 con 0x7f93e80fb420 2024-09-18T21:16:44.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.321+0000 7f93cf7fe640 1 -- 172.21.15.77:0/1517219301 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1915 (secure 0 0 0) 0x7f93d8076e60 con 0x7f93e80fb420 2024-09-18T21:16:44.323 INFO:teuthology.orchestra.run.smithi077.stdout:e13 2024-09-18T21:16:44.323 INFO:teuthology.orchestra.run.smithi077.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-18T21:16:44.323 INFO:teuthology.orchestra.run.smithi077.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T21:16:44.323 INFO:teuthology.orchestra.run.smithi077.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T21:16:44.324 INFO:teuthology.orchestra.run.smithi077.stdout:legacy client fscid: 1 2024-09-18T21:16:44.324 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:16:44.324 INFO:teuthology.orchestra.run.smithi077.stdout:Filesystem 'cephfs' (1) 2024-09-18T21:16:44.324 INFO:teuthology.orchestra.run.smithi077.stdout:fs_name cephfs 2024-09-18T21:16:44.324 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 13 2024-09-18T21:16:44.324 INFO:teuthology.orchestra.run.smithi077.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T21:16:44.324 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-09-18T21:10:17.230179+0000 2024-09-18T21:16:44.324 INFO:teuthology.orchestra.run.smithi077.stdout:modified 2024-09-18T21:10:33.373241+0000 2024-09-18T21:16:44.324 INFO:teuthology.orchestra.run.smithi077.stdout:tableserver 0 2024-09-18T21:16:44.324 INFO:teuthology.orchestra.run.smithi077.stdout:root 0 2024-09-18T21:16:44.324 INFO:teuthology.orchestra.run.smithi077.stdout:session_timeout 60 2024-09-18T21:16:44.325 INFO:teuthology.orchestra.run.smithi077.stdout:session_autoclose 300 2024-09-18T21:16:44.325 INFO:teuthology.orchestra.run.smithi077.stdout:max_file_size 1099511627776 2024-09-18T21:16:44.325 INFO:teuthology.orchestra.run.smithi077.stdout:max_xattr_size 65536 2024-09-18T21:16:44.325 INFO:teuthology.orchestra.run.smithi077.stdout:required_client_features {} 2024-09-18T21:16:44.325 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure 0 2024-09-18T21:16:44.325 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure_osd_epoch 0 2024-09-18T21:16:44.325 INFO:teuthology.orchestra.run.smithi077.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T21:16:44.325 INFO:teuthology.orchestra.run.smithi077.stdout:max_mds 1 2024-09-18T21:16:44.325 INFO:teuthology.orchestra.run.smithi077.stdout:in 0 2024-09-18T21:16:44.325 INFO:teuthology.orchestra.run.smithi077.stdout:up {0=14446} 2024-09-18T21:16:44.325 INFO:teuthology.orchestra.run.smithi077.stdout:failed 2024-09-18T21:16:44.325 INFO:teuthology.orchestra.run.smithi077.stdout:damaged 2024-09-18T21:16:44.325 INFO:teuthology.orchestra.run.smithi077.stdout:stopped 2024-09-18T21:16:44.326 INFO:teuthology.orchestra.run.smithi077.stdout:data_pools [3] 2024-09-18T21:16:44.326 INFO:teuthology.orchestra.run.smithi077.stdout:metadata_pool 2 2024-09-18T21:16:44.326 INFO:teuthology.orchestra.run.smithi077.stdout:inline_data disabled 2024-09-18T21:16:44.326 INFO:teuthology.orchestra.run.smithi077.stdout:balancer 2024-09-18T21:16:44.326 INFO:teuthology.orchestra.run.smithi077.stdout:bal_rank_mask -1 2024-09-18T21:16:44.326 INFO:teuthology.orchestra.run.smithi077.stdout:standby_count_wanted 1 2024-09-18T21:16:44.326 INFO:teuthology.orchestra.run.smithi077.stdout:qdb_cluster leader: 0 members: 2024-09-18T21:16:44.326 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.vruydi{0:14446} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.77:6826/334039954,v1:172.21.15.77:6827/334039954] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:16:44.326 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:16:44.326 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:16:44.326 INFO:teuthology.orchestra.run.smithi077.stdout:Standby daemons: 2024-09-18T21:16:44.326 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:16:44.326 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.cqfhlw{-1:14458} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.77:6828/862540650,v1:172.21.15.77:6829/862540650] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:16:44.326 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi103.zhdmdg{-1:24255} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.103:6824/2170237078,v1:172.21.15.103:6825/2170237078] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:16:44.327 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi103.opftmf{-1:24267} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.103:6826/4241818403,v1:172.21.15.103:6827/4241818403] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:16:44.327 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 13 2024-09-18T21:16:44.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.323+0000 7f93ed0d0640 1 -- 172.21.15.77:0/1517219301 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f93d006e0b0 msgr2=0x7f93d0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:44.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.323+0000 7f93ed0d0640 1 --2- 172.21.15.77:0/1517219301 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f93d006e0b0 0x7f93d0070560 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f93e810bd20 tx=0x7f93dc00b040 comp rx=0 tx=0).stop 2024-09-18T21:16:44.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.323+0000 7f93ed0d0640 1 -- 172.21.15.77:0/1517219301 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93e80fb420 msgr2=0x7f93e810bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:44.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.323+0000 7f93ed0d0640 1 --2- 172.21.15.77:0/1517219301 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93e80fb420 0x7f93e810bf70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f93d8009c20 tx=0x7f93d8004d10 comp rx=0 tx=0).stop 2024-09-18T21:16:44.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.323+0000 7f93ed0d0640 1 -- 172.21.15.77:0/1517219301 shutdown_connections 2024-09-18T21:16:44.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.323+0000 7f93ed0d0640 1 --2- 172.21.15.77:0/1517219301 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f93d006e0b0 0x7f93d0070560 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:44.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.323+0000 7f93ed0d0640 1 --2- 172.21.15.77:0/1517219301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f93e80fc6f0 0x7f93e810c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:44.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.323+0000 7f93ed0d0640 1 --2- 172.21.15.77:0/1517219301 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93e80fb420 0x7f93e810bf70 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:44.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.323+0000 7f93ed0d0640 1 -- 172.21.15.77:0/1517219301 >> 172.21.15.77:0/1517219301 conn(0x7f93e80f6c00 msgr2=0x7f93e80f83a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:16:44.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.323+0000 7f93ed0d0640 1 -- 172.21.15.77:0/1517219301 shutdown_connections 2024-09-18T21:16:44.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.323+0000 7f93ed0d0640 1 -- 172.21.15.77:0/1517219301 wait complete. 2024-09-18T21:16:44.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.402+0000 7ffa9e259640 1 -- 172.21.15.77:0/3074468549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa980fd800 msgr2=0x7ffa980fdc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:44.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.402+0000 7ffa9e259640 1 --2- 172.21.15.77:0/3074468549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa980fd800 0x7ffa980fdc70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c0048d0 tx=0x7ffa8c009da0 comp rx=0 tx=0).stop 2024-09-18T21:16:44.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.402+0000 7ffa9e259640 1 -- 172.21.15.77:0/3074468549 shutdown_connections 2024-09-18T21:16:44.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.402+0000 7ffa9e259640 1 --2- 172.21.15.77:0/3074468549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa980fd800 0x7ffa980fdc70 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:44.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.402+0000 7ffa9e259640 1 --2- 172.21.15.77:0/3074468549 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa980fc530 0x7ffa980fc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:44.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.402+0000 7ffa9e259640 1 -- 172.21.15.77:0/3074468549 >> 172.21.15.77:0/3074468549 conn(0x7ffa980f7d10 msgr2=0x7ffa980fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:16:44.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.402+0000 7ffa9e259640 1 -- 172.21.15.77:0/3074468549 shutdown_connections 2024-09-18T21:16:44.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.402+0000 7ffa9e259640 1 -- 172.21.15.77:0/3074468549 wait complete. 2024-09-18T21:16:44.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.403+0000 7ffa9e259640 1 Processor -- start 2024-09-18T21:16:44.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.403+0000 7ffa9e259640 1 -- start start 2024-09-18T21:16:44.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.403+0000 7ffa9e259640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa980fc530 0x7ffa9810d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:16:44.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.403+0000 7ffa9e259640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa980fd800 0x7ffa9810d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:16:44.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.403+0000 7ffa9e259640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9810dc30 con 0x7ffa980fc530 2024-09-18T21:16:44.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.403+0000 7ffa9e259640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9810e450 con 0x7ffa980fd800 2024-09-18T21:16:44.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.403+0000 7ffa977fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa980fc530 0x7ffa9810d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:16:44.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.403+0000 7ffa977fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa980fc530 0x7ffa9810d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43124/0 (socket says 172.21.15.77:43124) 2024-09-18T21:16:44.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.403+0000 7ffa977fe640 1 -- 172.21.15.77:0/1638591678 learned_addr learned my addr 172.21.15.77:0/1638591678 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:16:44.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.403+0000 7ffa96ffd640 1 --2- 172.21.15.77:0/1638591678 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa980fd800 0x7ffa9810d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:16:44.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.403+0000 7ffa977fe640 1 -- 172.21.15.77:0/1638591678 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa980fd800 msgr2=0x7ffa9810d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:44.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.403+0000 7ffa977fe640 1 --2- 172.21.15.77:0/1638591678 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa980fd800 0x7ffa9810d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:44.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.404+0000 7ffa977fe640 1 -- 172.21.15.77:0/1638591678 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa8c005040 con 0x7ffa980fc530 2024-09-18T21:16:44.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.404+0000 7ffa977fe640 1 --2- 172.21.15.77:0/1638591678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa980fc530 0x7ffa9810d0a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ffa8800c790 tx=0x7ffa880043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:16:44.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.404+0000 7ffa7ffff640 1 -- 172.21.15.77:0/1638591678 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa8800a7a0 con 0x7ffa980fc530 2024-09-18T21:16:44.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.404+0000 7ffa7ffff640 1 -- 172.21.15.77:0/1638591678 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ffa8800ada0 con 0x7ffa980fc530 2024-09-18T21:16:44.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.404+0000 7ffa9e259640 1 -- 172.21.15.77:0/1638591678 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa9810e6e0 con 0x7ffa980fc530 2024-09-18T21:16:44.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.404+0000 7ffa7ffff640 1 -- 172.21.15.77:0/1638591678 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa880113a0 con 0x7ffa980fc530 2024-09-18T21:16:44.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.404+0000 7ffa9e259640 1 -- 172.21.15.77:0/1638591678 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa9810ec80 con 0x7ffa980fc530 2024-09-18T21:16:44.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.405+0000 7ffa9e259640 1 -- 172.21.15.77:0/1638591678 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa980fb990 con 0x7ffa980fc530 2024-09-18T21:16:44.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.405+0000 7ffa7ffff640 1 -- 172.21.15.77:0/1638591678 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ffa8800a900 con 0x7ffa980fc530 2024-09-18T21:16:44.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.406+0000 7ffa7ffff640 1 --2- 172.21.15.77:0/1638591678 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7ffa8006e0b0 0x7ffa80070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:16:44.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.406+0000 7ffa7ffff640 1 -- 172.21.15.77:0/1638591678 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6324+0+0 (secure 0 0 0) 0x7ffa8808db70 con 0x7ffa980fc530 2024-09-18T21:16:44.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.406+0000 7ffa96ffd640 1 --2- 172.21.15.77:0/1638591678 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7ffa8006e0b0 0x7ffa80070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:16:44.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.406+0000 7ffa96ffd640 1 --2- 172.21.15.77:0/1638591678 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7ffa8006e0b0 0x7ffa80070560 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c004540 tx=0x7ffa8c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:16:44.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.410+0000 7ffa7ffff640 1 -- 172.21.15.77:0/1638591678 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7ffa88057060 con 0x7ffa980fc530 2024-09-18T21:16:44.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.600+0000 7ffa9e259640 1 -- 172.21.15.77:0/1638591678 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa9810f0c0 con 0x7ffa8006e0b0 2024-09-18T21:16:44.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.601+0000 7ffa7ffff640 1 -- 172.21.15.77:0/1638591678 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7ffa9810f0c0 con 0x7ffa8006e0b0 2024-09-18T21:16:44.603 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-18T21:16:44.604 INFO:teuthology.orchestra.run.smithi077.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a", 2024-09-18T21:16:44.604 INFO:teuthology.orchestra.run.smithi077.stdout: "in_progress": true, 2024-09-18T21:16:44.604 INFO:teuthology.orchestra.run.smithi077.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T21:16:44.604 INFO:teuthology.orchestra.run.smithi077.stdout: "services_complete": [ 2024-09-18T21:16:44.604 INFO:teuthology.orchestra.run.smithi077.stdout: "mon", 2024-09-18T21:16:44.604 INFO:teuthology.orchestra.run.smithi077.stdout: "crash", 2024-09-18T21:16:44.604 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr" 2024-09-18T21:16:44.604 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-18T21:16:44.604 INFO:teuthology.orchestra.run.smithi077.stdout: "progress": "7/21 daemons upgraded", 2024-09-18T21:16:44.604 INFO:teuthology.orchestra.run.smithi077.stdout: "message": "Currently upgrading osd daemons", 2024-09-18T21:16:44.604 INFO:teuthology.orchestra.run.smithi077.stdout: "is_paused": false 2024-09-18T21:16:44.604 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-18T21:16:44.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.604+0000 7ffa9e259640 1 -- 172.21.15.77:0/1638591678 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7ffa8006e0b0 msgr2=0x7ffa80070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:44.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.604+0000 7ffa9e259640 1 --2- 172.21.15.77:0/1638591678 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7ffa8006e0b0 0x7ffa80070560 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c004540 tx=0x7ffa8c009da0 comp rx=0 tx=0).stop 2024-09-18T21:16:44.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.604+0000 7ffa9e259640 1 -- 172.21.15.77:0/1638591678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa980fc530 msgr2=0x7ffa9810d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:44.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.604+0000 7ffa9e259640 1 --2- 172.21.15.77:0/1638591678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa980fc530 0x7ffa9810d0a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ffa8800c790 tx=0x7ffa880043c0 comp rx=0 tx=0).stop 2024-09-18T21:16:44.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.604+0000 7ffa9e259640 1 -- 172.21.15.77:0/1638591678 shutdown_connections 2024-09-18T21:16:44.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.604+0000 7ffa9e259640 1 --2- 172.21.15.77:0/1638591678 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7ffa8006e0b0 0x7ffa80070560 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:44.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.604+0000 7ffa9e259640 1 --2- 172.21.15.77:0/1638591678 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa980fd800 0x7ffa9810d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:44.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.604+0000 7ffa9e259640 1 --2- 172.21.15.77:0/1638591678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa980fc530 0x7ffa9810d0a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:44.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.604+0000 7ffa9e259640 1 -- 172.21.15.77:0/1638591678 >> 172.21.15.77:0/1638591678 conn(0x7ffa980f7d10 msgr2=0x7ffa980f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:16:44.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.604+0000 7ffa9e259640 1 -- 172.21.15.77:0/1638591678 shutdown_connections 2024-09-18T21:16:44.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.604+0000 7ffa9e259640 1 -- 172.21.15.77:0/1638591678 wait complete. 2024-09-18T21:16:44.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.683+0000 7fe4f3fbe640 1 -- 172.21.15.77:0/974856752 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4ec065b80 msgr2=0x7fe4ec0ff200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:44.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.683+0000 7fe4f3fbe640 1 --2- 172.21.15.77:0/974856752 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4ec065b80 0x7fe4ec0ff200 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe4e80048d0 tx=0x7fe4e8009da0 comp rx=0 tx=0).stop 2024-09-18T21:16:44.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.684+0000 7fe4f3fbe640 1 -- 172.21.15.77:0/974856752 shutdown_connections 2024-09-18T21:16:44.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.684+0000 7fe4f3fbe640 1 --2- 172.21.15.77:0/974856752 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4ec0ff740 0x7fe4ec101b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:44.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.684+0000 7fe4f3fbe640 1 --2- 172.21.15.77:0/974856752 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4ec065b80 0x7fe4ec0ff200 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:44.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.684+0000 7fe4f3fbe640 1 -- 172.21.15.77:0/974856752 >> 172.21.15.77:0/974856752 conn(0x7fe4ec0f6c10 msgr2=0x7fe4ec0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:16:44.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.684+0000 7fe4f3fbe640 1 -- 172.21.15.77:0/974856752 shutdown_connections 2024-09-18T21:16:44.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.684+0000 7fe4f3fbe640 1 -- 172.21.15.77:0/974856752 wait complete. 2024-09-18T21:16:44.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.684+0000 7fe4f3fbe640 1 Processor -- start 2024-09-18T21:16:44.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.684+0000 7fe4f3fbe640 1 -- start start 2024-09-18T21:16:44.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.684+0000 7fe4f3fbe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4ec065b80 0x7fe4ec10d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:16:44.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.684+0000 7fe4f3fbe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4ec0ff740 0x7fe4ec10d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:16:44.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.684+0000 7fe4f3fbe640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec10dc40 con 0x7fe4ec0ff740 2024-09-18T21:16:44.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.684+0000 7fe4f3fbe640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec10e410 con 0x7fe4ec065b80 2024-09-18T21:16:44.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.684+0000 7fe4f1559640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4ec0ff740 0x7fe4ec10d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:16:44.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.684+0000 7fe4f1559640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4ec0ff740 0x7fe4ec10d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43132/0 (socket says 172.21.15.77:43132) 2024-09-18T21:16:44.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.684+0000 7fe4f1559640 1 -- 172.21.15.77:0/1407314052 learned_addr learned my addr 172.21.15.77:0/1407314052 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:16:44.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.685+0000 7fe4f1d5a640 1 --2- 172.21.15.77:0/1407314052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4ec065b80 0x7fe4ec10d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:16:44.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.685+0000 7fe4f1559640 1 -- 172.21.15.77:0/1407314052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4ec065b80 msgr2=0x7fe4ec10d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:44.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.685+0000 7fe4f1559640 1 --2- 172.21.15.77:0/1407314052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4ec065b80 0x7fe4ec10d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:44.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.685+0000 7fe4f1559640 1 -- 172.21.15.77:0/1407314052 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e8005040 con 0x7fe4ec0ff740 2024-09-18T21:16:44.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.685+0000 7fe4f1d5a640 1 --2- 172.21.15.77:0/1407314052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4ec065b80 0x7fe4ec10d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T21:16:44.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.685+0000 7fe4f1559640 1 --2- 172.21.15.77:0/1407314052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4ec0ff740 0x7fe4ec10d5f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc002a50 tx=0x7fe4dc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:16:44.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.685+0000 7fe4e27fc640 1 -- 172.21.15.77:0/1407314052 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4dc007c30 con 0x7fe4ec0ff740 2024-09-18T21:16:44.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.685+0000 7fe4e27fc640 1 -- 172.21.15.77:0/1407314052 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe4dc00f040 con 0x7fe4ec0ff740 2024-09-18T21:16:44.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.685+0000 7fe4f3fbe640 1 -- 172.21.15.77:0/1407314052 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4ec10e6a0 con 0x7fe4ec0ff740 2024-09-18T21:16:44.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.685+0000 7fe4e27fc640 1 -- 172.21.15.77:0/1407314052 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4dc00da90 con 0x7fe4ec0ff740 2024-09-18T21:16:44.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.685+0000 7fe4f3fbe640 1 -- 172.21.15.77:0/1407314052 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4ec10ec40 con 0x7fe4ec0ff740 2024-09-18T21:16:44.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.686+0000 7fe4f3fbe640 1 -- 172.21.15.77:0/1407314052 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4ec0fa890 con 0x7fe4ec0ff740 2024-09-18T21:16:44.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.687+0000 7fe4e27fc640 1 -- 172.21.15.77:0/1407314052 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fe4dc00dc30 con 0x7fe4ec0ff740 2024-09-18T21:16:44.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.687+0000 7fe4e27fc640 1 --2- 172.21.15.77:0/1407314052 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fe4d806e0b0 0x7fe4d8070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:16:44.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.688+0000 7fe4f1d5a640 1 --2- 172.21.15.77:0/1407314052 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fe4d806e0b0 0x7fe4d8070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:16:44.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.688+0000 7fe4e27fc640 1 -- 172.21.15.77:0/1407314052 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fe4dc08d340 con 0x7fe4ec0ff740 2024-09-18T21:16:44.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.688+0000 7fe4f1d5a640 1 --2- 172.21.15.77:0/1407314052 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fe4d806e0b0 0x7fe4d8070560 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe4e800b020 tx=0x7fe4e8009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:16:44.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.692+0000 7fe4e27fc640 1 -- 172.21.15.77:0/1407314052 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fe4dc056790 con 0x7fe4ec0ff740 2024-09-18T21:16:44.920 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:44 smithi077 ceph-mon[92672]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:16:44.920 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:44 smithi077 ceph-mon[92672]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:16:44.920 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:44 smithi077 ceph-mon[92672]: Upgrade: Updating osd.1 2024-09-18T21:16:44.920 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:44 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:44.921 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:44 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-18T21:16:44.921 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:44 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:16:44.921 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:44 smithi077 ceph-mon[92672]: Deploying daemon osd.1 on smithi077 2024-09-18T21:16:44.921 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:44 smithi077 ceph-mon[92672]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:16:44.921 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:44 smithi077 ceph-mon[92672]: pgmap v57: 65 pgs: 65 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-18T21:16:44.921 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:44 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/1760135523' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:16:44.921 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:44 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/1517219301' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T21:16:44.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.927+0000 7fe4f3fbe640 1 -- 172.21.15.77:0/1407314052 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe4ec04b720 con 0x7fe4ec0ff740 2024-09-18T21:16:44.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.928+0000 7fe4e27fc640 1 -- 172.21.15.77:0/1407314052 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fe4dc059e50 con 0x7fe4ec0ff740 2024-09-18T21:16:44.931 INFO:teuthology.orchestra.run.smithi077.stdout:HEALTH_OK 2024-09-18T21:16:44.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.930+0000 7fe4f3fbe640 1 -- 172.21.15.77:0/1407314052 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fe4d806e0b0 msgr2=0x7fe4d8070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:44.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.930+0000 7fe4f3fbe640 1 --2- 172.21.15.77:0/1407314052 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fe4d806e0b0 0x7fe4d8070560 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe4e800b020 tx=0x7fe4e8009da0 comp rx=0 tx=0).stop 2024-09-18T21:16:44.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.930+0000 7fe4f3fbe640 1 -- 172.21.15.77:0/1407314052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4ec0ff740 msgr2=0x7fe4ec10d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:16:44.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.930+0000 7fe4f3fbe640 1 --2- 172.21.15.77:0/1407314052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4ec0ff740 0x7fe4ec10d5f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc002a50 tx=0x7fe4dc004600 comp rx=0 tx=0).stop 2024-09-18T21:16:44.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.930+0000 7fe4f3fbe640 1 -- 172.21.15.77:0/1407314052 shutdown_connections 2024-09-18T21:16:44.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.930+0000 7fe4f3fbe640 1 --2- 172.21.15.77:0/1407314052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe4ec0ff740 0x7fe4ec10d5f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:44.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.930+0000 7fe4f3fbe640 1 --2- 172.21.15.77:0/1407314052 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fe4d806e0b0 0x7fe4d8070560 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:44.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.930+0000 7fe4f3fbe640 1 --2- 172.21.15.77:0/1407314052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4ec065b80 0x7fe4ec10d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:16:44.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.930+0000 7fe4f3fbe640 1 -- 172.21.15.77:0/1407314052 >> 172.21.15.77:0/1407314052 conn(0x7fe4ec0f6c10 msgr2=0x7fe4ec0f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:16:44.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.930+0000 7fe4f3fbe640 1 -- 172.21.15.77:0/1407314052 shutdown_connections 2024-09-18T21:16:44.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:16:44.930+0000 7fe4f3fbe640 1 -- 172.21.15.77:0/1407314052 wait complete. 2024-09-18T21:16:45.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:44 smithi103 ceph-mon[80307]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:16:45.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:44 smithi103 ceph-mon[80307]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:16:45.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:44 smithi103 ceph-mon[80307]: Upgrade: Updating osd.1 2024-09-18T21:16:45.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:44 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:45.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:44 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-18T21:16:45.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:44 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:16:45.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:44 smithi103 ceph-mon[80307]: Deploying daemon osd.1 on smithi077 2024-09-18T21:16:45.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:44 smithi103 ceph-mon[80307]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:16:45.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:44 smithi103 ceph-mon[80307]: pgmap v57: 65 pgs: 65 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-18T21:16:45.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:44 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/1760135523' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:16:45.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:44 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/1517219301' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T21:16:45.769 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:45 smithi077 ceph-mon[92672]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:16:45.769 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:45 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/1407314052' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T21:16:46.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:45 smithi103 ceph-mon[80307]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:16:46.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:45 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/1407314052' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T21:16:46.667 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:46 smithi077 ceph-mon[92672]: pgmap v58: 65 pgs: 65 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-18T21:16:46.667 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:46 smithi077 systemd[1]: Stopping Ceph osd.1 for 5a76ec16-7601-11ef-bceb-c7b262605968... 2024-09-18T21:16:46.963 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:46 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1[54168]: 2024-09-18T21:16:46.664+0000 7ff235f8d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T21:16:46.963 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:46 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1[54168]: 2024-09-18T21:16:46.664+0000 7ff235f8d640 -1 osd.1 51 *** Got signal Terminated *** 2024-09-18T21:16:46.963 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:46 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1[54168]: 2024-09-18T21:16:46.664+0000 7ff235f8d640 -1 osd.1 51 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-18T21:16:47.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:46 smithi103 ceph-mon[80307]: pgmap v58: 65 pgs: 65 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-18T21:16:47.962 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:47 smithi077 ceph-mon[92672]: osd.1 marked itself down and dead 2024-09-18T21:16:48.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:47 smithi103 ceph-mon[80307]: osd.1 marked itself down and dead 2024-09-18T21:16:48.425 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:48 smithi077 podman[106199]: 2024-09-18 21:16:48.125811772 +0000 UTC m=+1.578376776 container died 39c2ccbb760324e9d1f5852f04fb3be9389890819d8c073eb4f4cb05b82f76d2 (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=quincy-6e06d1e, io.buildah.version=1.37.2, ceph=True) 2024-09-18T21:16:48.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:48 smithi077 ceph-mon[92672]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-18T21:16:48.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:48 smithi077 ceph-mon[92672]: osdmap e52: 6 total, 5 up, 6 in 2024-09-18T21:16:48.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:48 smithi077 ceph-mon[92672]: pgmap v60: 65 pgs: 12 stale+active+clean, 53 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:16:48.713 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:48 smithi077 podman[106199]: 2024-09-18 21:16:48.515158797 +0000 UTC m=+1.967723793 container cleanup 39c2ccbb760324e9d1f5852f04fb3be9389890819d8c073eb4f4cb05b82f76d2 (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1, GIT_CLEAN=True, RELEASE=quincy-6e06d1e, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-18T21:16:48.713 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:48 smithi077 bash[106199]: ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1 2024-09-18T21:16:49.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:48 smithi103 ceph-mon[80307]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-18T21:16:49.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:48 smithi103 ceph-mon[80307]: osdmap e52: 6 total, 5 up, 6 in 2024-09-18T21:16:49.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:48 smithi103 ceph-mon[80307]: pgmap v60: 65 pgs: 12 stale+active+clean, 53 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-09-18T21:16:49.146 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:48 smithi077 podman[106215]: 2024-09-18 21:16:48.783487311 +0000 UTC m=+0.660255582 container remove 39c2ccbb760324e9d1f5852f04fb3be9389890819d8c073eb4f4cb05b82f76d2 (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=quincy-6e06d1e, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T21:16:49.462 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:49 smithi077 podman[106303]: 2024-09-18 21:16:49.049271628 +0000 UTC m=+0.015959149 image pull f79f744f586d6ce8ddb4b06b7cf36a0f23174bbe29ea68264d2be49d8c6d9acd quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a 2024-09-18T21:16:49.463 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:49 smithi077 podman[106303]: 2024-09-18 21:16:49.15093564 +0000 UTC m=+0.117623155 container create d97b56eabf49c560372009f76b467b324d0bdc37b5e5ccf5650af91c1fbe3273 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-release-06b1b1d, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T21:16:49.463 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:49 smithi077 podman[106303]: 2024-09-18 21:16:49.370935178 +0000 UTC m=+0.337622694 container init d97b56eabf49c560372009f76b467b324d0bdc37b5e5ccf5650af91c1fbe3273 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=squid-release-06b1b1d, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T21:16:49.463 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:49 smithi077 podman[106303]: 2024-09-18 21:16:49.374260787 +0000 UTC m=+0.340948312 container start d97b56eabf49c560372009f76b467b324d0bdc37b5e5ccf5650af91c1fbe3273 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1-deactivate, RELEASE=squid-release-06b1b1d, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-18T21:16:49.883 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:49 smithi077 ceph-mon[92672]: osdmap e53: 6 total, 5 up, 6 in 2024-09-18T21:16:49.883 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:49 smithi077 podman[106303]: 2024-09-18 21:16:49.470106279 +0000 UTC m=+0.436793809 container attach d97b56eabf49c560372009f76b467b324d0bdc37b5e5ccf5650af91c1fbe3273 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-release-06b1b1d, CEPH_POINT_RELEASE=) 2024-09-18T21:16:49.883 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:49 smithi077 podman[106303]: 2024-09-18 21:16:49.570071291 +0000 UTC m=+0.536758806 container died d97b56eabf49c560372009f76b467b324d0bdc37b5e5ccf5650af91c1fbe3273 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-release-06b1b1d, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T21:16:50.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:49 smithi103 ceph-mon[80307]: osdmap e53: 6 total, 5 up, 6 in 2024-09-18T21:16:50.463 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:50 smithi077 podman[106326]: 2024-09-18 21:16:50.165867438 +0000 UTC m=+0.589328607 container remove d97b56eabf49c560372009f76b467b324d0bdc37b5e5ccf5650af91c1fbe3273 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-release-06b1b1d, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-18T21:16:50.463 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:50 smithi077 systemd[1]: ceph-5a76ec16-7601-11ef-bceb-c7b262605968@osd.1.service: Deactivated successfully. 2024-09-18T21:16:50.463 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:50 smithi077 systemd[1]: Stopped Ceph osd.1 for 5a76ec16-7601-11ef-bceb-c7b262605968. 2024-09-18T21:16:50.463 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:50 smithi077 systemd[1]: ceph-5a76ec16-7601-11ef-bceb-c7b262605968@osd.1.service: Consumed 1min 3.524s CPU time. 2024-09-18T21:16:50.463 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:50 smithi077 systemd[1]: Starting Ceph osd.1 for 5a76ec16-7601-11ef-bceb-c7b262605968... 2024-09-18T21:16:50.945 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:50 smithi077 ceph-mon[92672]: pgmap v62: 65 pgs: 4 active+undersized, 9 stale+active+clean, 1 active+undersized+degraded, 51 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1/222 objects degraded (0.450%) 2024-09-18T21:16:50.945 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:50 smithi077 podman[106424]: 2024-09-18 21:16:50.503798494 +0000 UTC m=+0.015914626 image pull f79f744f586d6ce8ddb4b06b7cf36a0f23174bbe29ea68264d2be49d8c6d9acd quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a 2024-09-18T21:16:50.945 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:50 smithi077 podman[106424]: 2024-09-18 21:16:50.625450386 +0000 UTC m=+0.137566501 container create 1a48f4849d2d6c3cf32c722ba665a2b7e7d7c3d317c60c110bebd78fdadcfd24 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=squid-release-06b1b1d, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-18T21:16:50.945 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:50 smithi077 podman[106424]: 2024-09-18 21:16:50.84503909 +0000 UTC m=+0.357155215 container init 1a48f4849d2d6c3cf32c722ba665a2b7e7d7c3d317c60c110bebd78fdadcfd24 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-release-06b1b1d, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True) 2024-09-18T21:16:50.945 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:50 smithi077 podman[106424]: 2024-09-18 21:16:50.848661965 +0000 UTC m=+0.360778085 container start 1a48f4849d2d6c3cf32c722ba665a2b7e7d7c3d317c60c110bebd78fdadcfd24 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-release-06b1b1d, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True) 2024-09-18T21:16:50.945 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:50 smithi077 podman[106424]: 2024-09-18 21:16:50.944557429 +0000 UTC m=+0.456673552 container attach 1a48f4849d2d6c3cf32c722ba665a2b7e7d7c3d317c60c110bebd78fdadcfd24 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1-activate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-release-06b1b1d, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-18T21:16:51.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:50 smithi103 ceph-mon[80307]: pgmap v62: 65 pgs: 4 active+undersized, 9 stale+active+clean, 1 active+undersized+degraded, 51 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1/222 objects degraded (0.450%) 2024-09-18T21:16:51.207 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:50 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1-activate[106438]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T21:16:51.208 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:50 smithi077 bash[106424]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T21:16:51.208 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:50 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1-activate[106438]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T21:16:51.208 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:50 smithi077 bash[106424]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T21:16:51.208 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:51 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1-activate[106438]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-18T21:16:51.208 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:51 smithi077 bash[106424]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-18T21:16:51.208 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:51 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1-activate[106438]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-18T21:16:51.208 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:51 smithi077 bash[106424]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-18T21:16:51.208 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:51 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1-activate[106438]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-18T21:16:51.209 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:51 smithi077 bash[106424]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-18T21:16:51.463 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:51 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1-activate[106438]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-18T21:16:51.464 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:51 smithi077 bash[106424]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-18T21:16:51.464 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:51 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1-activate[106438]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-18T21:16:51.464 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:51 smithi077 bash[106424]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-18T21:16:51.464 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:51 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1-activate[106438]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-18T21:16:51.464 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:51 smithi077 bash[106424]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-18T21:16:51.464 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:51 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1-activate[106438]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-18T21:16:51.464 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:51 smithi077 bash[106424]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-18T21:16:51.464 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:51 smithi077 podman[106424]: 2024-09-18 21:16:51.234201932 +0000 UTC m=+0.746318048 container died 1a48f4849d2d6c3cf32c722ba665a2b7e7d7c3d317c60c110bebd78fdadcfd24 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-release-06b1b1d) 2024-09-18T21:16:51.944 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:51 smithi077 ceph-mon[92672]: Health check failed: Degraded data redundancy: 1/222 objects degraded (0.450%), 1 pg degraded (PG_DEGRADED) 2024-09-18T21:16:51.945 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:51 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:51.945 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:51 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:16:51.945 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:51 smithi077 podman[106580]: 2024-09-18 21:16:51.790170253 +0000 UTC m=+0.549673541 container remove 1a48f4849d2d6c3cf32c722ba665a2b7e7d7c3d317c60c110bebd78fdadcfd24 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1-activate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-release-06b1b1d, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T21:16:52.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:51 smithi103 ceph-mon[80307]: Health check failed: Degraded data redundancy: 1/222 objects degraded (0.450%), 1 pg degraded (PG_DEGRADED) 2024-09-18T21:16:52.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:51 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:52.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:51 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:16:52.213 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:51 smithi077 podman[106638]: 2024-09-18 21:16:51.9828369 +0000 UTC m=+0.102139392 container create 2d8bc9cac96c2b6362d1983b6f6f8d79faaeb6b0200a8258aa5c3bfe16476437 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-release-06b1b1d, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-18T21:16:52.213 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:51 smithi077 podman[106638]: 2024-09-18 21:16:51.89676249 +0000 UTC m=+0.016064986 image pull f79f744f586d6ce8ddb4b06b7cf36a0f23174bbe29ea68264d2be49d8c6d9acd quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a 2024-09-18T21:16:52.530 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:52 smithi077 podman[106638]: 2024-09-18 21:16:52.218357922 +0000 UTC m=+0.337660419 container init 2d8bc9cac96c2b6362d1983b6f6f8d79faaeb6b0200a8258aa5c3bfe16476437 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-release-06b1b1d, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-18T21:16:52.530 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:52 smithi077 podman[106638]: 2024-09-18 21:16:52.221659613 +0000 UTC m=+0.340962111 container start 2d8bc9cac96c2b6362d1983b6f6f8d79faaeb6b0200a8258aa5c3bfe16476437 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-release-06b1b1d, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-18T21:16:52.530 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:52 smithi077 ceph-osd[106657]: -- 172.21.15.77:0/2875774447 <== mon.0 v2:172.21.15.77:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55be92e081e0 con 0x55be92e06000 2024-09-18T21:16:52.530 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:52 smithi077 bash[106638]: 2d8bc9cac96c2b6362d1983b6f6f8d79faaeb6b0200a8258aa5c3bfe16476437 2024-09-18T21:16:52.530 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:52 smithi077 systemd[1]: Started Ceph osd.1 for 5a76ec16-7601-11ef-bceb-c7b262605968. 2024-09-18T21:16:52.957 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:52 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1[106653]: 2024-09-18T21:16:52.762+0000 7ffacbb43640 -1 Falling back to public interface 2024-09-18T21:16:52.958 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:52 smithi077 ceph-mon[92672]: pgmap v63: 65 pgs: 22 active+undersized, 12 active+undersized+degraded, 31 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 27/222 objects degraded (12.162%) 2024-09-18T21:16:52.958 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:52 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:52.958 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:52 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:52.958 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:52 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:16:53.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:52 smithi103 ceph-mon[80307]: pgmap v63: 65 pgs: 22 active+undersized, 12 active+undersized+degraded, 31 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 27/222 objects degraded (12.162%) 2024-09-18T21:16:53.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:52 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:53.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:52 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:53.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:52 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:16:55.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:54 smithi077 ceph-mon[92672]: pgmap v64: 65 pgs: 22 active+undersized, 12 active+undersized+degraded, 31 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 27/222 objects degraded (12.162%) 2024-09-18T21:16:55.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:54 smithi103 ceph-mon[80307]: pgmap v64: 65 pgs: 22 active+undersized, 12 active+undersized+degraded, 31 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 27/222 objects degraded (12.162%) 2024-09-18T21:16:56.997 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:56 smithi077 ceph-mon[92672]: pgmap v65: 65 pgs: 22 active+undersized, 12 active+undersized+degraded, 31 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 27/222 objects degraded (12.162%) 2024-09-18T21:16:57.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:56 smithi103 ceph-mon[80307]: pgmap v65: 65 pgs: 22 active+undersized, 12 active+undersized+degraded, 31 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 27/222 objects degraded (12.162%) 2024-09-18T21:16:58.212 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:57 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1[106653]: 2024-09-18T21:16:57.753+0000 7ffacbb43640 -1 osd.1 51 log_to_monitors true 2024-09-18T21:16:58.593 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:58 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:58.593 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:58 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:58.593 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:58 smithi077 ceph-mon[92672]: from='osd.1 [v2:172.21.15.77:6810/2832235750,v1:172.21.15.77:6811/2832235750]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-18T21:16:58.594 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:58 smithi077 ceph-mon[92672]: pgmap v66: 65 pgs: 22 active+undersized, 12 active+undersized+degraded, 31 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 27/222 objects degraded (12.162%) 2024-09-18T21:16:58.594 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:58 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:58.594 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:58 smithi077 ceph-mon[92672]: Health check update: Degraded data redundancy: 27/222 objects degraded (12.162%), 12 pgs degraded (PG_DEGRADED) 2024-09-18T21:16:58.594 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:58 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:58.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:58 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:58.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:58 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:58.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:58 smithi103 ceph-mon[80307]: from='osd.1 [v2:172.21.15.77:6810/2832235750,v1:172.21.15.77:6811/2832235750]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-18T21:16:58.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:58 smithi103 ceph-mon[80307]: pgmap v66: 65 pgs: 22 active+undersized, 12 active+undersized+degraded, 31 active+clean; 203 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 27/222 objects degraded (12.162%) 2024-09-18T21:16:58.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:58 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:58.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:58 smithi103 ceph-mon[80307]: Health check update: Degraded data redundancy: 27/222 objects degraded (12.162%), 12 pgs degraded (PG_DEGRADED) 2024-09-18T21:16:58.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:58 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:16:59.377 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:16:59 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1[106653]: 2024-09-18T21:16:59.095+0000 7ffabf8d5640 -1 osd.1 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T21:16:59.378 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:59 smithi077 ceph-mon[92672]: from='osd.1 [v2:172.21.15.77:6810/2832235750,v1:172.21.15.77:6811/2832235750]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-18T21:16:59.378 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:59 smithi077 ceph-mon[92672]: osdmap e54: 6 total, 5 up, 6 in 2024-09-18T21:16:59.378 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:59 smithi077 ceph-mon[92672]: from='osd.1 [v2:172.21.15.77:6810/2832235750,v1:172.21.15.77:6811/2832235750]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-09-18T21:16:59.378 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:16:59 smithi077 ceph-mon[92672]: from='osd.1 [v2:172.21.15.77:6810/2832235750,v1:172.21.15.77:6811/2832235750]' entity='osd.1' 2024-09-18T21:16:59.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:59 smithi103 ceph-mon[80307]: from='osd.1 [v2:172.21.15.77:6810/2832235750,v1:172.21.15.77:6811/2832235750]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-18T21:16:59.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:59 smithi103 ceph-mon[80307]: osdmap e54: 6 total, 5 up, 6 in 2024-09-18T21:16:59.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:59 smithi103 ceph-mon[80307]: from='osd.1 [v2:172.21.15.77:6810/2832235750,v1:172.21.15.77:6811/2832235750]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-09-18T21:16:59.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:16:59 smithi103 ceph-mon[80307]: from='osd.1 [v2:172.21.15.77:6810/2832235750,v1:172.21.15.77:6811/2832235750]' entity='osd.1' 2024-09-18T21:17:00.691 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:00 smithi077 ceph-mon[92672]: pgmap v68: 65 pgs: 22 active+undersized, 12 active+undersized+degraded, 31 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 27/222 objects degraded (12.162%) 2024-09-18T21:17:00.691 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:00 smithi077 ceph-mon[92672]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-18T21:17:00.691 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:00 smithi077 ceph-mon[92672]: osd.1 [v2:172.21.15.77:6810/2832235750,v1:172.21.15.77:6811/2832235750] boot 2024-09-18T21:17:00.691 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:00 smithi077 ceph-mon[92672]: osdmap e55: 6 total, 6 up, 6 in 2024-09-18T21:17:00.691 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:00 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T21:17:00.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:00 smithi103 ceph-mon[80307]: pgmap v68: 65 pgs: 22 active+undersized, 12 active+undersized+degraded, 31 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 27/222 objects degraded (12.162%) 2024-09-18T21:17:00.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:00 smithi103 ceph-mon[80307]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-18T21:17:00.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:00 smithi103 ceph-mon[80307]: osd.1 [v2:172.21.15.77:6810/2832235750,v1:172.21.15.77:6811/2832235750] boot 2024-09-18T21:17:00.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:00 smithi103 ceph-mon[80307]: osdmap e55: 6 total, 6 up, 6 in 2024-09-18T21:17:00.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:00 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-18T21:17:02.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:02 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:17:02.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:02 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:17:02.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:02 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:17:02.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:02 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:17:02.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:02 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:17:02.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:02 smithi077 ceph-mon[92672]: osdmap e56: 6 total, 6 up, 6 in 2024-09-18T21:17:02.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:02 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:17:02.464 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:02 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:17:02.464 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:02 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:17:02.464 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:02 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:17:02.464 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:02 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-18T21:17:02.464 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:02 smithi077 ceph-mon[92672]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-18T21:17:02.464 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:02 smithi077 ceph-mon[92672]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-18T21:17:02.464 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:02 smithi077 ceph-mon[92672]: pgmap v71: 65 pgs: 8 active+undersized, 6 active+undersized+degraded, 51 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 14/222 objects degraded (6.306%) 2024-09-18T21:17:02.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:02 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:17:02.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:02 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:17:02.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:02 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:17:02.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:02 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:17:02.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:02 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:17:02.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:02 smithi103 ceph-mon[80307]: osdmap e56: 6 total, 6 up, 6 in 2024-09-18T21:17:02.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:02 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:17:02.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:02 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:17:02.515 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:02 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:17:02.515 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:02 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:17:02.515 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:02 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-18T21:17:02.515 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:02 smithi103 ceph-mon[80307]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-18T21:17:02.515 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:02 smithi103 ceph-mon[80307]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-18T21:17:02.515 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:02 smithi103 ceph-mon[80307]: pgmap v71: 65 pgs: 8 active+undersized, 6 active+undersized+degraded, 51 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 14/222 objects degraded (6.306%) 2024-09-18T21:17:03.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:03 smithi077 ceph-mon[92672]: Health check update: Degraded data redundancy: 14/222 objects degraded (6.306%), 6 pgs degraded (PG_DEGRADED) 2024-09-18T21:17:03.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:03 smithi103 ceph-mon[80307]: Health check update: Degraded data redundancy: 14/222 objects degraded (6.306%), 6 pgs degraded (PG_DEGRADED) 2024-09-18T21:17:04.455 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:04 smithi077 ceph-mon[92672]: pgmap v72: 65 pgs: 2 active+undersized, 63 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:17:04.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:04 smithi103 ceph-mon[80307]: pgmap v72: 65 pgs: 2 active+undersized, 63 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:17:05.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:05 smithi077 ceph-mon[92672]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 14/222 objects degraded (6.306%), 6 pgs degraded) 2024-09-18T21:17:05.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:05 smithi077 ceph-mon[92672]: Cluster is now healthy 2024-09-18T21:17:05.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:05 smithi103 ceph-mon[80307]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 14/222 objects degraded (6.306%), 6 pgs degraded) 2024-09-18T21:17:05.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:05 smithi103 ceph-mon[80307]: Cluster is now healthy 2024-09-18T21:17:07.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:06 smithi077 ceph-mon[92672]: pgmap v73: 65 pgs: 65 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:17:07.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:06 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:17:07.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:06 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:17:07.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:06 smithi103 ceph-mon[80307]: pgmap v73: 65 pgs: 65 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:17:07.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:06 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:17:07.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:06 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:17:08.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:08 smithi077 ceph-mon[92672]: pgmap v74: 65 pgs: 65 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:17:09.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:08 smithi103 ceph-mon[80307]: pgmap v74: 65 pgs: 65 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:17:11.196 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:10 smithi077 ceph-mon[92672]: pgmap v75: 65 pgs: 65 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:17:11.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:10 smithi103 ceph-mon[80307]: pgmap v75: 65 pgs: 65 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:17:12.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:11 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:17:12.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:11 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:17:13.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:12 smithi077 ceph-mon[92672]: pgmap v76: 65 pgs: 65 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:17:13.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:12 smithi103 ceph-mon[80307]: pgmap v76: 65 pgs: 65 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:17:15.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.025+0000 7f5f937c8640 1 -- 172.21.15.77:0/4269529022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f8c0fc550 msgr2=0x7f5f8c0fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:15.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.025+0000 7f5f937c8640 1 --2- 172.21.15.77:0/4269529022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f8c0fc550 0x7f5f8c0fc960 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5f880048d0 tx=0x7f5f88009da0 comp rx=0 tx=0).stop 2024-09-18T21:17:15.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.025+0000 7f5f937c8640 1 -- 172.21.15.77:0/4269529022 shutdown_connections 2024-09-18T21:17:15.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.025+0000 7f5f937c8640 1 --2- 172.21.15.77:0/4269529022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f8c0fd820 0x7f5f8c0fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:15.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.025+0000 7f5f937c8640 1 --2- 172.21.15.77:0/4269529022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f8c0fc550 0x7f5f8c0fc960 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:15.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.025+0000 7f5f937c8640 1 -- 172.21.15.77:0/4269529022 >> 172.21.15.77:0/4269529022 conn(0x7f5f8c0f7d30 msgr2=0x7f5f8c0fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:17:15.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.025+0000 7f5f937c8640 1 -- 172.21.15.77:0/4269529022 shutdown_connections 2024-09-18T21:17:15.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.025+0000 7f5f937c8640 1 -- 172.21.15.77:0/4269529022 wait complete. 2024-09-18T21:17:15.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.025+0000 7f5f937c8640 1 Processor -- start 2024-09-18T21:17:15.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.025+0000 7f5f937c8640 1 -- start start 2024-09-18T21:17:15.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.025+0000 7f5f937c8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f8c0fc550 0x7f5f8c071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:17:15.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.025+0000 7f5f937c8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f8c0fd820 0x7f5f8c06fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:17:15.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.025+0000 7f5f937c8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8c06fff0 con 0x7f5f8c0fc550 2024-09-18T21:17:15.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.025+0000 7f5f937c8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8c070130 con 0x7f5f8c0fd820 2024-09-18T21:17:15.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.026+0000 7f5f91564640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f8c0fc550 0x7f5f8c071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:17:15.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.026+0000 7f5f91564640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f8c0fc550 0x7f5f8c071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58040/0 (socket says 172.21.15.77:58040) 2024-09-18T21:17:15.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.026+0000 7f5f91564640 1 -- 172.21.15.77:0/2099587385 learned_addr learned my addr 172.21.15.77:0/2099587385 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:17:15.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.026+0000 7f5f90d63640 1 --2- 172.21.15.77:0/2099587385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f8c0fd820 0x7f5f8c06fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:17:15.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.026+0000 7f5f91564640 1 -- 172.21.15.77:0/2099587385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f8c0fd820 msgr2=0x7f5f8c06fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:15.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.026+0000 7f5f91564640 1 --2- 172.21.15.77:0/2099587385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f8c0fd820 0x7f5f8c06fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:15.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.026+0000 7f5f91564640 1 -- 172.21.15.77:0/2099587385 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f88005040 con 0x7f5f8c0fc550 2024-09-18T21:17:15.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.026+0000 7f5f90d63640 1 --2- 172.21.15.77:0/2099587385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f8c0fd820 0x7f5f8c06fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T21:17:15.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.026+0000 7f5f91564640 1 --2- 172.21.15.77:0/2099587385 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f8c0fc550 0x7f5f8c071570 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5f880043d0 tx=0x7f5f88009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:17:15.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.026+0000 7f5f81ffb640 1 -- 172.21.15.77:0/2099587385 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f88038070 con 0x7f5f8c0fc550 2024-09-18T21:17:15.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.026+0000 7f5f81ffb640 1 -- 172.21.15.77:0/2099587385 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5f8802ae90 con 0x7f5f8c0fc550 2024-09-18T21:17:15.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.026+0000 7f5f81ffb640 1 -- 172.21.15.77:0/2099587385 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f8803e670 con 0x7f5f8c0fc550 2024-09-18T21:17:15.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.026+0000 7f5f937c8640 1 -- 172.21.15.77:0/2099587385 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f8c0703b0 con 0x7f5f8c0fc550 2024-09-18T21:17:15.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.027+0000 7f5f937c8640 1 -- 172.21.15.77:0/2099587385 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f8c1150d0 con 0x7f5f8c0fc550 2024-09-18T21:17:15.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.028+0000 7f5f937c8640 1 -- 172.21.15.77:0/2099587385 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f8c0fb9b0 con 0x7f5f8c0fc550 2024-09-18T21:17:15.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.028+0000 7f5f81ffb640 1 -- 172.21.15.77:0/2099587385 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5f88030020 con 0x7f5f8c0fc550 2024-09-18T21:17:15.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.029+0000 7f5f81ffb640 1 --2- 172.21.15.77:0/2099587385 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f5f7806e0b0 0x7f5f78070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:17:15.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.029+0000 7f5f81ffb640 1 -- 172.21.15.77:0/2099587385 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f5f880add20 con 0x7f5f8c0fc550 2024-09-18T21:17:15.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.029+0000 7f5f90d63640 1 --2- 172.21.15.77:0/2099587385 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f5f7806e0b0 0x7f5f78070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:17:15.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.029+0000 7f5f90d63640 1 --2- 172.21.15.77:0/2099587385 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f5f7806e0b0 0x7f5f78070560 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c009fd0 tx=0x7f5f7c009e50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:17:15.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.034+0000 7f5f81ffb640 1 -- 172.21.15.77:0/2099587385 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f5f88077170 con 0x7f5f8c0fc550 2024-09-18T21:17:15.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:14 smithi077 ceph-mon[92672]: pgmap v77: 65 pgs: 65 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:17:15.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.217+0000 7f5f937c8640 1 -- 172.21.15.77:0/2099587385 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f8c101c80 con 0x7f5f7806e0b0 2024-09-18T21:17:15.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.218+0000 7f5f81ffb640 1 -- 172.21.15.77:0/2099587385 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f5f8c101c80 con 0x7f5f7806e0b0 2024-09-18T21:17:15.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.220+0000 7f5f937c8640 1 -- 172.21.15.77:0/2099587385 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f5f7806e0b0 msgr2=0x7f5f78070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:15.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.221+0000 7f5f937c8640 1 --2- 172.21.15.77:0/2099587385 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f5f7806e0b0 0x7f5f78070560 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c009fd0 tx=0x7f5f7c009e50 comp rx=0 tx=0).stop 2024-09-18T21:17:15.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.221+0000 7f5f937c8640 1 -- 172.21.15.77:0/2099587385 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f8c0fc550 msgr2=0x7f5f8c071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:15.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.221+0000 7f5f937c8640 1 --2- 172.21.15.77:0/2099587385 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f8c0fc550 0x7f5f8c071570 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5f880043d0 tx=0x7f5f88009da0 comp rx=0 tx=0).stop 2024-09-18T21:17:15.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.221+0000 7f5f937c8640 1 -- 172.21.15.77:0/2099587385 shutdown_connections 2024-09-18T21:17:15.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.221+0000 7f5f937c8640 1 --2- 172.21.15.77:0/2099587385 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f5f7806e0b0 0x7f5f78070560 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:15.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.221+0000 7f5f937c8640 1 --2- 172.21.15.77:0/2099587385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f8c0fd820 0x7f5f8c06fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:15.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.221+0000 7f5f937c8640 1 --2- 172.21.15.77:0/2099587385 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f8c0fc550 0x7f5f8c071570 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:15.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.221+0000 7f5f937c8640 1 -- 172.21.15.77:0/2099587385 >> 172.21.15.77:0/2099587385 conn(0x7f5f8c0f7d30 msgr2=0x7f5f8c0f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:17:15.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.221+0000 7f5f937c8640 1 -- 172.21.15.77:0/2099587385 shutdown_connections 2024-09-18T21:17:15.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.221+0000 7f5f937c8640 1 -- 172.21.15.77:0/2099587385 wait complete. 2024-09-18T21:17:15.230 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-09-18T21:17:15.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:14 smithi103 ceph-mon[80307]: pgmap v77: 65 pgs: 65 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:17:15.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.300+0000 7f0c03634640 1 -- 172.21.15.77:0/3452217903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bfc0fdc50 msgr2=0x7f0bfc0fe060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:15.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.300+0000 7f0c03634640 1 --2- 172.21.15.77:0/3452217903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bfc0fdc50 0x7f0bfc0fe060 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0bf80048d0 tx=0x7f0bf8009da0 comp rx=0 tx=0).stop 2024-09-18T21:17:15.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.300+0000 7f0c03634640 1 -- 172.21.15.77:0/3452217903 shutdown_connections 2024-09-18T21:17:15.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.300+0000 7f0c03634640 1 --2- 172.21.15.77:0/3452217903 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bfc0fe5a0 0x7f0bfc0fa700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:15.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.300+0000 7f0c03634640 1 --2- 172.21.15.77:0/3452217903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bfc0fdc50 0x7f0bfc0fe060 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:15.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.300+0000 7f0c03634640 1 -- 172.21.15.77:0/3452217903 >> 172.21.15.77:0/3452217903 conn(0x7f0bfc0f63b0 msgr2=0x7f0bfc0f87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:17:15.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.300+0000 7f0c03634640 1 -- 172.21.15.77:0/3452217903 shutdown_connections 2024-09-18T21:17:15.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.300+0000 7f0c03634640 1 -- 172.21.15.77:0/3452217903 wait complete. 2024-09-18T21:17:15.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.301+0000 7f0c03634640 1 Processor -- start 2024-09-18T21:17:15.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.301+0000 7f0c03634640 1 -- start start 2024-09-18T21:17:15.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.301+0000 7f0c03634640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bfc0fdc50 0x7f0bfc10d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:17:15.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.301+0000 7f0c03634640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bfc0fe5a0 0x7f0bfc10d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:17:15.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.301+0000 7f0c03634640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bfc10dca0 con 0x7f0bfc0fdc50 2024-09-18T21:17:15.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.301+0000 7f0c03634640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bfc10e470 con 0x7f0bfc0fe5a0 2024-09-18T21:17:15.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.301+0000 7f0c013d0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bfc0fdc50 0x7f0bfc10d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:17:15.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.301+0000 7f0c013d0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bfc0fdc50 0x7f0bfc10d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58062/0 (socket says 172.21.15.77:58062) 2024-09-18T21:17:15.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.301+0000 7f0c013d0640 1 -- 172.21.15.77:0/1228614958 learned_addr learned my addr 172.21.15.77:0/1228614958 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:17:15.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.301+0000 7f0c00bcf640 1 --2- 172.21.15.77:0/1228614958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bfc0fe5a0 0x7f0bfc10d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:17:15.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.301+0000 7f0c013d0640 1 -- 172.21.15.77:0/1228614958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bfc0fe5a0 msgr2=0x7f0bfc10d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:15.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.301+0000 7f0c013d0640 1 --2- 172.21.15.77:0/1228614958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bfc0fe5a0 0x7f0bfc10d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:15.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.301+0000 7f0c013d0640 1 -- 172.21.15.77:0/1228614958 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf8005040 con 0x7f0bfc0fdc50 2024-09-18T21:17:15.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.301+0000 7f0c013d0640 1 --2- 172.21.15.77:0/1228614958 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bfc0fdc50 0x7f0bfc10d110 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0bf80043d0 tx=0x7f0bf8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:17:15.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.302+0000 7f0bf1ffb640 1 -- 172.21.15.77:0/1228614958 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0bf8038070 con 0x7f0bfc0fdc50 2024-09-18T21:17:15.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.302+0000 7f0bf1ffb640 1 -- 172.21.15.77:0/1228614958 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0bf802ae90 con 0x7f0bfc0fdc50 2024-09-18T21:17:15.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.302+0000 7f0c03634640 1 -- 172.21.15.77:0/1228614958 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bfc10e6a0 con 0x7f0bfc0fdc50 2024-09-18T21:17:15.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.302+0000 7f0bf1ffb640 1 -- 172.21.15.77:0/1228614958 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0bf803e670 con 0x7f0bfc0fdc50 2024-09-18T21:17:15.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.302+0000 7f0c03634640 1 -- 172.21.15.77:0/1228614958 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bfc10ec40 con 0x7f0bfc0fdc50 2024-09-18T21:17:15.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.303+0000 7f0c03634640 1 -- 172.21.15.77:0/1228614958 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bfc0fa050 con 0x7f0bfc0fdc50 2024-09-18T21:17:15.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.303+0000 7f0bf1ffb640 1 -- 172.21.15.77:0/1228614958 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f0bf8030020 con 0x7f0bfc0fdc50 2024-09-18T21:17:15.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.304+0000 7f0bf1ffb640 1 --2- 172.21.15.77:0/1228614958 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f0be806e0b0 0x7f0be8070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:17:15.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.304+0000 7f0bf1ffb640 1 -- 172.21.15.77:0/1228614958 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f0bf80adcf0 con 0x7f0bfc0fdc50 2024-09-18T21:17:15.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.304+0000 7f0c00bcf640 1 --2- 172.21.15.77:0/1228614958 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f0be806e0b0 0x7f0be8070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:17:15.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.304+0000 7f0c00bcf640 1 --2- 172.21.15.77:0/1228614958 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f0be806e0b0 0x7f0be8070560 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc10cec0 tx=0x7f0bec00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:17:15.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.308+0000 7f0bf1ffb640 1 -- 172.21.15.77:0/1228614958 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f0bf8077170 con 0x7f0bfc0fdc50 2024-09-18T21:17:15.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.488+0000 7f0c03634640 1 -- 172.21.15.77:0/1228614958 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0bfc10ef70 con 0x7f0be806e0b0 2024-09-18T21:17:15.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.489+0000 7f0bf1ffb640 1 -- 172.21.15.77:0/1228614958 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f0bfc10ef70 con 0x7f0be806e0b0 2024-09-18T21:17:15.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.492+0000 7f0c03634640 1 -- 172.21.15.77:0/1228614958 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f0be806e0b0 msgr2=0x7f0be8070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:15.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.492+0000 7f0c03634640 1 --2- 172.21.15.77:0/1228614958 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f0be806e0b0 0x7f0be8070560 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc10cec0 tx=0x7f0bec00b040 comp rx=0 tx=0).stop 2024-09-18T21:17:15.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.492+0000 7f0c03634640 1 -- 172.21.15.77:0/1228614958 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bfc0fdc50 msgr2=0x7f0bfc10d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:15.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.492+0000 7f0c03634640 1 --2- 172.21.15.77:0/1228614958 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bfc0fdc50 0x7f0bfc10d110 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0bf80043d0 tx=0x7f0bf8009da0 comp rx=0 tx=0).stop 2024-09-18T21:17:15.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.492+0000 7f0c03634640 1 -- 172.21.15.77:0/1228614958 shutdown_connections 2024-09-18T21:17:15.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.492+0000 7f0c03634640 1 --2- 172.21.15.77:0/1228614958 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f0be806e0b0 0x7f0be8070560 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:15.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.492+0000 7f0c03634640 1 --2- 172.21.15.77:0/1228614958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0bfc0fe5a0 0x7f0bfc10d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:15.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.492+0000 7f0c03634640 1 --2- 172.21.15.77:0/1228614958 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bfc0fdc50 0x7f0bfc10d110 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:15.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.492+0000 7f0c03634640 1 -- 172.21.15.77:0/1228614958 >> 172.21.15.77:0/1228614958 conn(0x7f0bfc0f63b0 msgr2=0x7f0bfc0f7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:17:15.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.492+0000 7f0c03634640 1 -- 172.21.15.77:0/1228614958 shutdown_connections 2024-09-18T21:17:15.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.493+0000 7f0c03634640 1 -- 172.21.15.77:0/1228614958 wait complete. 2024-09-18T21:17:15.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.571+0000 7f92ab374640 1 -- 172.21.15.77:0/1188161100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92a40fb450 msgr2=0x7f92a40fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:15.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.571+0000 7f92ab374640 1 --2- 172.21.15.77:0/1188161100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92a40fb450 0x7f92a40fb860 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f929c0048d0 tx=0x7f929c009da0 comp rx=0 tx=0).stop 2024-09-18T21:17:15.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.572+0000 7f92ab374640 1 -- 172.21.15.77:0/1188161100 shutdown_connections 2024-09-18T21:17:15.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.572+0000 7f92ab374640 1 --2- 172.21.15.77:0/1188161100 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92a40fc720 0x7f92a40fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:15.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.572+0000 7f92ab374640 1 --2- 172.21.15.77:0/1188161100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92a40fb450 0x7f92a40fb860 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:15.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.572+0000 7f92ab374640 1 -- 172.21.15.77:0/1188161100 >> 172.21.15.77:0/1188161100 conn(0x7f92a40f6c10 msgr2=0x7f92a40f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:17:15.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.572+0000 7f92ab374640 1 -- 172.21.15.77:0/1188161100 shutdown_connections 2024-09-18T21:17:15.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.572+0000 7f92ab374640 1 -- 172.21.15.77:0/1188161100 wait complete. 2024-09-18T21:17:15.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.572+0000 7f92ab374640 1 Processor -- start 2024-09-18T21:17:15.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.572+0000 7f92ab374640 1 -- start start 2024-09-18T21:17:15.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.572+0000 7f92ab374640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92a40fb450 0x7f92a410fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:17:15.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.572+0000 7f92ab374640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92a40fc720 0x7f92a4112330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:17:15.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.572+0000 7f92ab374640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a4066750 con 0x7f92a40fc720 2024-09-18T21:17:15.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.572+0000 7f92ab374640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a40668c0 con 0x7f92a40fb450 2024-09-18T21:17:15.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.572+0000 7f92a890f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92a40fc720 0x7f92a4112330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:17:15.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.572+0000 7f92a890f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92a40fc720 0x7f92a4112330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58078/0 (socket says 172.21.15.77:58078) 2024-09-18T21:17:15.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.573+0000 7f92a890f640 1 -- 172.21.15.77:0/540034502 learned_addr learned my addr 172.21.15.77:0/540034502 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:17:15.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.573+0000 7f92a9110640 1 --2- 172.21.15.77:0/540034502 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92a40fb450 0x7f92a410fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:17:15.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.573+0000 7f92a890f640 1 -- 172.21.15.77:0/540034502 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92a40fb450 msgr2=0x7f92a410fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:15.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.573+0000 7f92a890f640 1 --2- 172.21.15.77:0/540034502 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92a40fb450 0x7f92a410fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:15.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.573+0000 7f92a890f640 1 -- 172.21.15.77:0/540034502 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f929c005040 con 0x7f92a40fc720 2024-09-18T21:17:15.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.573+0000 7f92a9110640 1 --2- 172.21.15.77:0/540034502 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92a40fb450 0x7f92a410fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T21:17:15.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.573+0000 7f92a890f640 1 --2- 172.21.15.77:0/540034502 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92a40fc720 0x7f92a4112330 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9298002a50 tx=0x7f9298004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:17:15.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.573+0000 7f92a1ffb640 1 -- 172.21.15.77:0/540034502 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9298007c30 con 0x7f92a40fc720 2024-09-18T21:17:15.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.573+0000 7f92a1ffb640 1 -- 172.21.15.77:0/540034502 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f929800f040 con 0x7f92a40fc720 2024-09-18T21:17:15.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.573+0000 7f92ab374640 1 -- 172.21.15.77:0/540034502 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92a41128d0 con 0x7f92a40fc720 2024-09-18T21:17:15.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.573+0000 7f92a1ffb640 1 -- 172.21.15.77:0/540034502 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f929800da90 con 0x7f92a40fc720 2024-09-18T21:17:15.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.573+0000 7f92ab374640 1 -- 172.21.15.77:0/540034502 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92a4112e40 con 0x7f92a40fc720 2024-09-18T21:17:15.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.574+0000 7f92ab374640 1 -- 172.21.15.77:0/540034502 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92a40fa8b0 con 0x7f92a40fc720 2024-09-18T21:17:15.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.575+0000 7f92a1ffb640 1 -- 172.21.15.77:0/540034502 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f929800dd00 con 0x7f92a40fc720 2024-09-18T21:17:15.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.575+0000 7f92a1ffb640 1 --2- 172.21.15.77:0/540034502 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f928c06e0b0 0x7f928c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:17:15.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.575+0000 7f92a1ffb640 1 -- 172.21.15.77:0/540034502 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f929808d3f0 con 0x7f92a40fc720 2024-09-18T21:17:15.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.575+0000 7f92a9110640 1 --2- 172.21.15.77:0/540034502 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f928c06e0b0 0x7f928c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:17:15.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.576+0000 7f92a9110640 1 --2- 172.21.15.77:0/540034502 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f928c06e0b0 0x7f928c070560 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f929c007ac0 tx=0x7f929c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:17:15.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.579+0000 7f92a1ffb640 1 -- 172.21.15.77:0/540034502 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f92980567c0 con 0x7f92a40fc720 2024-09-18T21:17:15.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.751+0000 7f92ab374640 1 -- 172.21.15.77:0/540034502 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f92a4100b30 con 0x7f928c06e0b0 2024-09-18T21:17:15.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.760+0000 7f92a1ffb640 1 -- 172.21.15.77:0/540034502 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f92a4100b30 con 0x7f928c06e0b0 2024-09-18T21:17:15.762 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T21:17:15.762 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager.smithi077 smithi077 *:9093,9094 running (3m) 18s ago 11m 24.2M - 0.25.0 c8568f914cd2 b201d325a55b 2024-09-18T21:17:15.762 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi077 smithi077 running (82s) 18s ago 12m 6891k - 19.1.1-17-g06b1b1de f79f744f586d 5872fa24b792 2024-09-18T21:17:15.762 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi103 smithi103 running (77s) 74s ago 11m 6887k - 19.1.1-17-g06b1b1de f79f744f586d cd1604469f34 2024-09-18T21:17:15.762 INFO:teuthology.orchestra.run.smithi077.stdout:grafana.smithi077 smithi077 *:3000 running (3m) 18s ago 11m 79.5M - 9.4.7 954c08fa6188 d06ef3ab9e66 2024-09-18T21:17:15.762 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.cqfhlw smithi077 running (6m) 18s ago 6m 14.7M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 a7ec3b7701b6 2024-09-18T21:17:15.762 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.vruydi smithi077 running (6m) 18s ago 6m 141M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 affbba097d3b 2024-09-18T21:17:15.762 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi103.opftmf smithi103 running (6m) 74s ago 6m 16.5M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 111f884c5a34 2024-09-18T21:17:15.762 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi103.zhdmdg smithi103 running (6m) 74s ago 6m 15.6M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 50b77d0edda5 2024-09-18T21:17:15.762 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi077.utkpjg smithi077 *:8443,9283,8765 running (3m) 18s ago 13m 497M - 19.1.1-17-g06b1b1de f79f744f586d 99d4b0fd70f6 2024-09-18T21:17:15.762 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi103.zjztqc smithi103 *:8443,9283,8765 running (2m) 74s ago 11m 439M - 19.1.1-17-g06b1b1de f79f744f586d 54589547c4d7 2024-09-18T21:17:15.763 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi077 smithi077 running (2m) 18s ago 13m 43.7M 2048M 19.1.1-17-g06b1b1de f79f744f586d 2d0fbbea1264 2024-09-18T21:17:15.763 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi103 smithi103 running (117s) 74s ago 11m 34.6M 2048M 19.1.1-17-g06b1b1de f79f744f586d dc79edbd9602 2024-09-18T21:17:15.763 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi077 smithi077 *:9100 running (4m) 18s ago 12m 15.5M - 1.5.0 0da6a335fe13 99144245c1af 2024-09-18T21:17:15.763 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi103 smithi103 *:9100 running (3m) 74s ago 11m 16.5M - 1.5.0 0da6a335fe13 e5b51144d997 2024-09-18T21:17:15.763 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (58s) 18s ago 10m 88.8M 1557M 19.1.1-17-g06b1b1de f79f744f586d 8855b4b16e00 2024-09-18T21:17:15.763 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi077 running (23s) 18s ago 10m 11.9M 1557M 19.1.1-17-g06b1b1de f79f744f586d 2d8bc9cac96c 2024-09-18T21:17:15.763 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi077 running (9m) 18s ago 9m 200M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 2ff2728057e2 2024-09-18T21:17:15.763 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi103 running (9m) 74s ago 9m 275M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 0e72b1bbb8ce 2024-09-18T21:17:15.763 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi103 running (8m) 74s ago 8m 244M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 85f1ce1e8bee 2024-09-18T21:17:15.763 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi103 running (8m) 74s ago 8m 228M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 cf8964b3ac6d 2024-09-18T21:17:15.763 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus.smithi077 smithi077 *:9095 running (2m) 18s ago 11m 54.1M - 2.43.0 a07b618ecd1d 41f3729e3400 2024-09-18T21:17:15.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.763+0000 7f92ab374640 1 -- 172.21.15.77:0/540034502 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f928c06e0b0 msgr2=0x7f928c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:15.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.763+0000 7f92ab374640 1 --2- 172.21.15.77:0/540034502 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f928c06e0b0 0x7f928c070560 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f929c007ac0 tx=0x7f929c035040 comp rx=0 tx=0).stop 2024-09-18T21:17:15.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.763+0000 7f92ab374640 1 -- 172.21.15.77:0/540034502 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92a40fc720 msgr2=0x7f92a4112330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:15.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.763+0000 7f92ab374640 1 --2- 172.21.15.77:0/540034502 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92a40fc720 0x7f92a4112330 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9298002a50 tx=0x7f9298004600 comp rx=0 tx=0).stop 2024-09-18T21:17:15.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.763+0000 7f92ab374640 1 -- 172.21.15.77:0/540034502 shutdown_connections 2024-09-18T21:17:15.765 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.763+0000 7f92ab374640 1 --2- 172.21.15.77:0/540034502 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92a40fc720 0x7f92a4112330 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:15.765 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.763+0000 7f92ab374640 1 --2- 172.21.15.77:0/540034502 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f928c06e0b0 0x7f928c070560 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:15.765 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.763+0000 7f92ab374640 1 --2- 172.21.15.77:0/540034502 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92a40fb450 0x7f92a410fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:15.765 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.763+0000 7f92ab374640 1 -- 172.21.15.77:0/540034502 >> 172.21.15.77:0/540034502 conn(0x7f92a40f6c10 msgr2=0x7f92a40f8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:17:15.765 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.763+0000 7f92ab374640 1 -- 172.21.15.77:0/540034502 shutdown_connections 2024-09-18T21:17:15.765 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.763+0000 7f92ab374640 1 -- 172.21.15.77:0/540034502 wait complete. 2024-09-18T21:17:15.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.841+0000 7f1ec5b94640 1 -- 172.21.15.77:0/356547237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ec00fe500 msgr2=0x7f1ec00fa660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:15.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.841+0000 7f1ec5b94640 1 --2- 172.21.15.77:0/356547237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ec00fe500 0x7f1ec00fa660 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1eb40048d0 tx=0x7f1eb4009da0 comp rx=0 tx=0).stop 2024-09-18T21:17:15.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.841+0000 7f1ec5b94640 1 -- 172.21.15.77:0/356547237 shutdown_connections 2024-09-18T21:17:15.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.841+0000 7f1ec5b94640 1 --2- 172.21.15.77:0/356547237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ec00fe500 0x7f1ec00fa660 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:15.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.841+0000 7f1ec5b94640 1 --2- 172.21.15.77:0/356547237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ec00fdbb0 0x7f1ec00fdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:15.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.841+0000 7f1ec5b94640 1 -- 172.21.15.77:0/356547237 >> 172.21.15.77:0/356547237 conn(0x7f1ec00f63b0 msgr2=0x7f1ec00f87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:17:15.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.841+0000 7f1ec5b94640 1 -- 172.21.15.77:0/356547237 shutdown_connections 2024-09-18T21:17:15.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.841+0000 7f1ec5b94640 1 -- 172.21.15.77:0/356547237 wait complete. 2024-09-18T21:17:15.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.842+0000 7f1ec5b94640 1 Processor -- start 2024-09-18T21:17:15.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.842+0000 7f1ec5b94640 1 -- start start 2024-09-18T21:17:15.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.842+0000 7f1ec5b94640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ec00fdbb0 0x7f1ec010d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:17:15.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.842+0000 7f1ec5b94640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ec00fe500 0x7f1ec010d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:17:15.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.842+0000 7f1ec5b94640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec010e4a0 con 0x7f1ec00fe500 2024-09-18T21:17:15.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.842+0000 7f1ec5b94640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec010e610 con 0x7f1ec00fdbb0 2024-09-18T21:17:15.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.842+0000 7f1ebeffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ec00fe500 0x7f1ec010d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:17:15.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.842+0000 7f1ebeffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ec00fe500 0x7f1ec010d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58090/0 (socket says 172.21.15.77:58090) 2024-09-18T21:17:15.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.842+0000 7f1ebeffd640 1 -- 172.21.15.77:0/4146070939 learned_addr learned my addr 172.21.15.77:0/4146070939 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:17:15.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.842+0000 7f1ebeffd640 1 -- 172.21.15.77:0/4146070939 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ec00fdbb0 msgr2=0x7f1ec010d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:15.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.842+0000 7f1ebf7fe640 1 --2- 172.21.15.77:0/4146070939 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ec00fdbb0 0x7f1ec010d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:17:15.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.843+0000 7f1ebeffd640 1 --2- 172.21.15.77:0/4146070939 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ec00fdbb0 0x7f1ec010d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:15.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.843+0000 7f1ebeffd640 1 -- 172.21.15.77:0/4146070939 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb4005040 con 0x7f1ec00fe500 2024-09-18T21:17:15.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.843+0000 7f1ebf7fe640 1 --2- 172.21.15.77:0/4146070939 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ec00fdbb0 0x7f1ec010d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T21:17:15.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.843+0000 7f1ebeffd640 1 --2- 172.21.15.77:0/4146070939 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ec00fe500 0x7f1ec010d680 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1eb40048a0 tx=0x7f1eb4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:17:15.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.843+0000 7f1ea7fff640 1 -- 172.21.15.77:0/4146070939 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1eb4038070 con 0x7f1ec00fe500 2024-09-18T21:17:15.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.843+0000 7f1ea7fff640 1 -- 172.21.15.77:0/4146070939 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1eb402ae90 con 0x7f1ec00fe500 2024-09-18T21:17:15.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.843+0000 7f1ec5b94640 1 -- 172.21.15.77:0/4146070939 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ec010e890 con 0x7f1ec00fe500 2024-09-18T21:17:15.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.843+0000 7f1ea7fff640 1 -- 172.21.15.77:0/4146070939 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1eb402c8b0 con 0x7f1ec00fe500 2024-09-18T21:17:15.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.843+0000 7f1ec5b94640 1 -- 172.21.15.77:0/4146070939 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ec010ed50 con 0x7f1ec00fe500 2024-09-18T21:17:15.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.844+0000 7f1ec5b94640 1 -- 172.21.15.77:0/4146070939 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ec00fa050 con 0x7f1ec00fe500 2024-09-18T21:17:15.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.844+0000 7f1ea7fff640 1 -- 172.21.15.77:0/4146070939 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f1eb4030020 con 0x7f1ec00fe500 2024-09-18T21:17:15.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.845+0000 7f1ea7fff640 1 --2- 172.21.15.77:0/4146070939 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f1ea806e0b0 0x7f1ea8070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:17:15.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.845+0000 7f1ea7fff640 1 -- 172.21.15.77:0/4146070939 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f1eb40ae140 con 0x7f1ec00fe500 2024-09-18T21:17:15.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.845+0000 7f1ebf7fe640 1 --2- 172.21.15.77:0/4146070939 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f1ea806e0b0 0x7f1ea8070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:17:15.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.845+0000 7f1ebf7fe640 1 --2- 172.21.15.77:0/4146070939 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f1ea806e0b0 0x7f1ea8070560 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1eb0006fd0 tx=0x7f1eb0008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:17:15.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:15.849+0000 7f1ea7fff640 1 -- 172.21.15.77:0/4146070939 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f1eb4077590 con 0x7f1ec00fe500 2024-09-18T21:17:16.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.089+0000 7f1ec5b94640 1 -- 172.21.15.77:0/4146070939 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1ec004b720 con 0x7f1ec00fe500 2024-09-18T21:17:16.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.089+0000 7f1ea7fff640 1 -- 172.21.15.77:0/4146070939 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7f1eb4075e60 con 0x7f1ec00fe500 2024-09-18T21:17:16.091 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-18T21:17:16.091 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": { 2024-09-18T21:17:16.091 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 2 2024-09-18T21:17:16.091 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:17:16.091 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": { 2024-09-18T21:17:16.091 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 2 2024-09-18T21:17:16.091 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:17:16.091 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": { 2024-09-18T21:17:16.091 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4, 2024-09-18T21:17:16.091 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 2 2024-09-18T21:17:16.091 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:17:16.091 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-09-18T21:17:16.092 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4 2024-09-18T21:17:16.092 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:17:16.092 INFO:teuthology.orchestra.run.smithi077.stdout: "overall": { 2024-09-18T21:17:16.092 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 8, 2024-09-18T21:17:16.092 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 6 2024-09-18T21:17:16.092 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-18T21:17:16.092 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-18T21:17:16.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.092+0000 7f1ec5b94640 1 -- 172.21.15.77:0/4146070939 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f1ea806e0b0 msgr2=0x7f1ea8070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:16.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.092+0000 7f1ec5b94640 1 --2- 172.21.15.77:0/4146070939 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f1ea806e0b0 0x7f1ea8070560 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1eb0006fd0 tx=0x7f1eb0008040 comp rx=0 tx=0).stop 2024-09-18T21:17:16.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.092+0000 7f1ec5b94640 1 -- 172.21.15.77:0/4146070939 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ec00fe500 msgr2=0x7f1ec010d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:16.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.092+0000 7f1ec5b94640 1 --2- 172.21.15.77:0/4146070939 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ec00fe500 0x7f1ec010d680 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1eb40048a0 tx=0x7f1eb4009da0 comp rx=0 tx=0).stop 2024-09-18T21:17:16.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.092+0000 7f1ec5b94640 1 -- 172.21.15.77:0/4146070939 shutdown_connections 2024-09-18T21:17:16.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.092+0000 7f1ec5b94640 1 --2- 172.21.15.77:0/4146070939 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ec00fe500 0x7f1ec010d680 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:16.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.092+0000 7f1ec5b94640 1 --2- 172.21.15.77:0/4146070939 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f1ea806e0b0 0x7f1ea8070560 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:16.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.092+0000 7f1ec5b94640 1 --2- 172.21.15.77:0/4146070939 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ec00fdbb0 0x7f1ec010d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:16.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.092+0000 7f1ec5b94640 1 -- 172.21.15.77:0/4146070939 >> 172.21.15.77:0/4146070939 conn(0x7f1ec00f63b0 msgr2=0x7f1ec00f7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:17:16.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.092+0000 7f1ec5b94640 1 -- 172.21.15.77:0/4146070939 shutdown_connections 2024-09-18T21:17:16.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.092+0000 7f1ec5b94640 1 -- 172.21.15.77:0/4146070939 wait complete. 2024-09-18T21:17:16.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.171+0000 7f7656682640 1 -- 172.21.15.77:0/3735632921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76500fdba0 msgr2=0x7f76500fdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:16.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.171+0000 7f7656682640 1 --2- 172.21.15.77:0/3735632921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76500fdba0 0x7f76500fdfb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f76400048d0 tx=0x7f7640009da0 comp rx=0 tx=0).stop 2024-09-18T21:17:16.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.172+0000 7f7656682640 1 -- 172.21.15.77:0/3735632921 shutdown_connections 2024-09-18T21:17:16.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.172+0000 7f7656682640 1 --2- 172.21.15.77:0/3735632921 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76500fe4f0 0x7f76500fa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:16.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.172+0000 7f7656682640 1 --2- 172.21.15.77:0/3735632921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76500fdba0 0x7f76500fdfb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:16.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.172+0000 7f7656682640 1 -- 172.21.15.77:0/3735632921 >> 172.21.15.77:0/3735632921 conn(0x7f76500f63a0 msgr2=0x7f76500f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:17:16.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.172+0000 7f7656682640 1 -- 172.21.15.77:0/3735632921 shutdown_connections 2024-09-18T21:17:16.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.172+0000 7f7656682640 1 -- 172.21.15.77:0/3735632921 wait complete. 2024-09-18T21:17:16.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.172+0000 7f7656682640 1 Processor -- start 2024-09-18T21:17:16.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.172+0000 7f7656682640 1 -- start start 2024-09-18T21:17:16.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.172+0000 7f7656682640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76500fdba0 0x7f765010d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:17:16.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.172+0000 7f7656682640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76500fe4f0 0x7f765010d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:17:16.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.172+0000 7f7656682640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765010dc70 con 0x7f76500fe4f0 2024-09-18T21:17:16.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.172+0000 7f7656682640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765010e490 con 0x7f76500fdba0 2024-09-18T21:17:16.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.173+0000 7f764f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76500fe4f0 0x7f765010d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:17:16.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.173+0000 7f764f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76500fe4f0 0x7f765010d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58110/0 (socket says 172.21.15.77:58110) 2024-09-18T21:17:16.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.173+0000 7f764f7fe640 1 -- 172.21.15.77:0/3881177791 learned_addr learned my addr 172.21.15.77:0/3881177791 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:17:16.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.173+0000 7f764ffff640 1 --2- 172.21.15.77:0/3881177791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76500fdba0 0x7f765010d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:17:16.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.173+0000 7f764f7fe640 1 -- 172.21.15.77:0/3881177791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76500fdba0 msgr2=0x7f765010d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:16.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.173+0000 7f764f7fe640 1 --2- 172.21.15.77:0/3881177791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76500fdba0 0x7f765010d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:16.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.173+0000 7f764f7fe640 1 -- 172.21.15.77:0/3881177791 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7640005040 con 0x7f76500fe4f0 2024-09-18T21:17:16.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.173+0000 7f764ffff640 1 --2- 172.21.15.77:0/3881177791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76500fdba0 0x7f765010d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T21:17:16.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.173+0000 7f764f7fe640 1 --2- 172.21.15.77:0/3881177791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76500fe4f0 0x7f765010d620 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7644002f40 tx=0x7f764400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:17:16.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.173+0000 7f764cff9640 1 -- 172.21.15.77:0/3881177791 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7644007c30 con 0x7f76500fe4f0 2024-09-18T21:17:16.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.173+0000 7f764cff9640 1 -- 172.21.15.77:0/3881177791 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f764400f040 con 0x7f76500fe4f0 2024-09-18T21:17:16.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.173+0000 7f7656682640 1 -- 172.21.15.77:0/3881177791 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f765010e6c0 con 0x7f76500fe4f0 2024-09-18T21:17:16.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.173+0000 7f764cff9640 1 -- 172.21.15.77:0/3881177791 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f764400cbe0 con 0x7f76500fe4f0 2024-09-18T21:17:16.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.173+0000 7f7656682640 1 -- 172.21.15.77:0/3881177791 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f765010ec60 con 0x7f76500fe4f0 2024-09-18T21:17:16.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.174+0000 7f7656682640 1 -- 172.21.15.77:0/3881177791 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76500fa040 con 0x7f76500fe4f0 2024-09-18T21:17:16.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.175+0000 7f764cff9640 1 -- 172.21.15.77:0/3881177791 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f764400cd40 con 0x7f76500fe4f0 2024-09-18T21:17:16.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.175+0000 7f764cff9640 1 --2- 172.21.15.77:0/3881177791 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f763806e0b0 0x7f7638070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:17:16.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.175+0000 7f764cff9640 1 -- 172.21.15.77:0/3881177791 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f764408d820 con 0x7f76500fe4f0 2024-09-18T21:17:16.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.175+0000 7f764ffff640 1 --2- 172.21.15.77:0/3881177791 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f763806e0b0 0x7f7638070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:17:16.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.176+0000 7f764ffff640 1 --2- 172.21.15.77:0/3881177791 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f763806e0b0 0x7f7638070560 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7640007ac0 tx=0x7f7640035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:17:16.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.180+0000 7f764cff9640 1 -- 172.21.15.77:0/3881177791 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f7644056bf0 con 0x7f76500fe4f0 2024-09-18T21:17:16.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.387+0000 7f7656682640 1 -- 172.21.15.77:0/3881177791 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f765004b720 con 0x7f76500fe4f0 2024-09-18T21:17:16.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.387+0000 7f764cff9640 1 -- 172.21.15.77:0/3881177791 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1915 (secure 0 0 0) 0x7f764405a2b0 con 0x7f76500fe4f0 2024-09-18T21:17:16.389 INFO:teuthology.orchestra.run.smithi077.stdout:e13 2024-09-18T21:17:16.389 INFO:teuthology.orchestra.run.smithi077.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-18T21:17:16.389 INFO:teuthology.orchestra.run.smithi077.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T21:17:16.389 INFO:teuthology.orchestra.run.smithi077.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T21:17:16.389 INFO:teuthology.orchestra.run.smithi077.stdout:legacy client fscid: 1 2024-09-18T21:17:16.389 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:17:16.389 INFO:teuthology.orchestra.run.smithi077.stdout:Filesystem 'cephfs' (1) 2024-09-18T21:17:16.389 INFO:teuthology.orchestra.run.smithi077.stdout:fs_name cephfs 2024-09-18T21:17:16.389 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 13 2024-09-18T21:17:16.389 INFO:teuthology.orchestra.run.smithi077.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T21:17:16.389 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-09-18T21:10:17.230179+0000 2024-09-18T21:17:16.389 INFO:teuthology.orchestra.run.smithi077.stdout:modified 2024-09-18T21:10:33.373241+0000 2024-09-18T21:17:16.390 INFO:teuthology.orchestra.run.smithi077.stdout:tableserver 0 2024-09-18T21:17:16.390 INFO:teuthology.orchestra.run.smithi077.stdout:root 0 2024-09-18T21:17:16.390 INFO:teuthology.orchestra.run.smithi077.stdout:session_timeout 60 2024-09-18T21:17:16.390 INFO:teuthology.orchestra.run.smithi077.stdout:session_autoclose 300 2024-09-18T21:17:16.390 INFO:teuthology.orchestra.run.smithi077.stdout:max_file_size 1099511627776 2024-09-18T21:17:16.390 INFO:teuthology.orchestra.run.smithi077.stdout:max_xattr_size 65536 2024-09-18T21:17:16.390 INFO:teuthology.orchestra.run.smithi077.stdout:required_client_features {} 2024-09-18T21:17:16.390 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure 0 2024-09-18T21:17:16.390 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure_osd_epoch 0 2024-09-18T21:17:16.390 INFO:teuthology.orchestra.run.smithi077.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T21:17:16.390 INFO:teuthology.orchestra.run.smithi077.stdout:max_mds 1 2024-09-18T21:17:16.390 INFO:teuthology.orchestra.run.smithi077.stdout:in 0 2024-09-18T21:17:16.390 INFO:teuthology.orchestra.run.smithi077.stdout:up {0=14446} 2024-09-18T21:17:16.391 INFO:teuthology.orchestra.run.smithi077.stdout:failed 2024-09-18T21:17:16.391 INFO:teuthology.orchestra.run.smithi077.stdout:damaged 2024-09-18T21:17:16.391 INFO:teuthology.orchestra.run.smithi077.stdout:stopped 2024-09-18T21:17:16.391 INFO:teuthology.orchestra.run.smithi077.stdout:data_pools [3] 2024-09-18T21:17:16.391 INFO:teuthology.orchestra.run.smithi077.stdout:metadata_pool 2 2024-09-18T21:17:16.391 INFO:teuthology.orchestra.run.smithi077.stdout:inline_data disabled 2024-09-18T21:17:16.391 INFO:teuthology.orchestra.run.smithi077.stdout:balancer 2024-09-18T21:17:16.391 INFO:teuthology.orchestra.run.smithi077.stdout:bal_rank_mask -1 2024-09-18T21:17:16.391 INFO:teuthology.orchestra.run.smithi077.stdout:standby_count_wanted 1 2024-09-18T21:17:16.391 INFO:teuthology.orchestra.run.smithi077.stdout:qdb_cluster leader: 0 members: 2024-09-18T21:17:16.391 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.vruydi{0:14446} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.77:6826/334039954,v1:172.21.15.77:6827/334039954] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:17:16.391 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:17:16.391 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:17:16.391 INFO:teuthology.orchestra.run.smithi077.stdout:Standby daemons: 2024-09-18T21:17:16.391 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:17:16.392 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.cqfhlw{-1:14458} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.77:6828/862540650,v1:172.21.15.77:6829/862540650] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:17:16.392 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi103.zhdmdg{-1:24255} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.103:6824/2170237078,v1:172.21.15.103:6825/2170237078] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:17:16.392 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi103.opftmf{-1:24267} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.103:6826/4241818403,v1:172.21.15.103:6827/4241818403] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:17:16.392 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 13 2024-09-18T21:17:16.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.389+0000 7f7656682640 1 -- 172.21.15.77:0/3881177791 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f763806e0b0 msgr2=0x7f7638070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:16.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.389+0000 7f7656682640 1 --2- 172.21.15.77:0/3881177791 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f763806e0b0 0x7f7638070560 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7640007ac0 tx=0x7f7640035040 comp rx=0 tx=0).stop 2024-09-18T21:17:16.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.389+0000 7f7656682640 1 -- 172.21.15.77:0/3881177791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76500fe4f0 msgr2=0x7f765010d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:16.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.389+0000 7f7656682640 1 --2- 172.21.15.77:0/3881177791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76500fe4f0 0x7f765010d620 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7644002f40 tx=0x7f764400b040 comp rx=0 tx=0).stop 2024-09-18T21:17:16.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.389+0000 7f7656682640 1 -- 172.21.15.77:0/3881177791 shutdown_connections 2024-09-18T21:17:16.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.389+0000 7f7656682640 1 --2- 172.21.15.77:0/3881177791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f76500fe4f0 0x7f765010d620 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:16.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.389+0000 7f7656682640 1 --2- 172.21.15.77:0/3881177791 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f763806e0b0 0x7f7638070560 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:16.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.389+0000 7f7656682640 1 --2- 172.21.15.77:0/3881177791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76500fdba0 0x7f765010d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:16.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.389+0000 7f7656682640 1 -- 172.21.15.77:0/3881177791 >> 172.21.15.77:0/3881177791 conn(0x7f76500f63a0 msgr2=0x7f76500f7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:17:16.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.390+0000 7f7656682640 1 -- 172.21.15.77:0/3881177791 shutdown_connections 2024-09-18T21:17:16.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.390+0000 7f7656682640 1 -- 172.21.15.77:0/3881177791 wait complete. 2024-09-18T21:17:16.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.472+0000 7fb68387a640 1 -- 172.21.15.77:0/3173407429 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb67c0fc720 msgr2=0x7fb67c0fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:16.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.472+0000 7fb68387a640 1 --2- 172.21.15.77:0/3173407429 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb67c0fc720 0x7fb67c0fcb90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb66c0048d0 tx=0x7fb66c009da0 comp rx=0 tx=0).stop 2024-09-18T21:17:16.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.472+0000 7fb68387a640 1 -- 172.21.15.77:0/3173407429 shutdown_connections 2024-09-18T21:17:16.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.472+0000 7fb68387a640 1 --2- 172.21.15.77:0/3173407429 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb67c0fc720 0x7fb67c0fcb90 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:16.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.472+0000 7fb68387a640 1 --2- 172.21.15.77:0/3173407429 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb67c0fb450 0x7fb67c0fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:16.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.473+0000 7fb68387a640 1 -- 172.21.15.77:0/3173407429 >> 172.21.15.77:0/3173407429 conn(0x7fb67c0f6c10 msgr2=0x7fb67c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:17:16.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.473+0000 7fb68387a640 1 -- 172.21.15.77:0/3173407429 shutdown_connections 2024-09-18T21:17:16.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.473+0000 7fb68387a640 1 -- 172.21.15.77:0/3173407429 wait complete. 2024-09-18T21:17:16.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.473+0000 7fb68387a640 1 Processor -- start 2024-09-18T21:17:16.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.473+0000 7fb68387a640 1 -- start start 2024-09-18T21:17:16.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.473+0000 7fb68387a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb67c0fb450 0x7fb67c10fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:17:16.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.473+0000 7fb68387a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb67c0fc720 0x7fb67c112310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:17:16.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.473+0000 7fb68387a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c066790 con 0x7fb67c0fc720 2024-09-18T21:17:16.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.473+0000 7fb68387a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c066900 con 0x7fb67c0fb450 2024-09-18T21:17:16.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.474+0000 7fb680e15640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb67c0fc720 0x7fb67c112310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:17:16.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.474+0000 7fb680e15640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb67c0fc720 0x7fb67c112310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58134/0 (socket says 172.21.15.77:58134) 2024-09-18T21:17:16.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.474+0000 7fb680e15640 1 -- 172.21.15.77:0/2865701805 learned_addr learned my addr 172.21.15.77:0/2865701805 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:17:16.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.474+0000 7fb681616640 1 --2- 172.21.15.77:0/2865701805 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb67c0fb450 0x7fb67c10fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:17:16.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.474+0000 7fb680e15640 1 -- 172.21.15.77:0/2865701805 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb67c0fb450 msgr2=0x7fb67c10fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:16.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.474+0000 7fb680e15640 1 --2- 172.21.15.77:0/2865701805 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb67c0fb450 0x7fb67c10fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:16.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.474+0000 7fb680e15640 1 -- 172.21.15.77:0/2865701805 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb66c005040 con 0x7fb67c0fc720 2024-09-18T21:17:16.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.474+0000 7fb680e15640 1 --2- 172.21.15.77:0/2865701805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb67c0fc720 0x7fb67c112310 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb66c003080 tx=0x7fb66c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:17:16.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.474+0000 7fb671ffb640 1 -- 172.21.15.77:0/2865701805 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb66c038070 con 0x7fb67c0fc720 2024-09-18T21:17:16.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.474+0000 7fb68387a640 1 -- 172.21.15.77:0/2865701805 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb67c1128b0 con 0x7fb67c0fc720 2024-09-18T21:17:16.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.474+0000 7fb671ffb640 1 -- 172.21.15.77:0/2865701805 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb66c02ae90 con 0x7fb67c0fc720 2024-09-18T21:17:16.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.474+0000 7fb671ffb640 1 -- 172.21.15.77:0/2865701805 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb66c033660 con 0x7fb67c0fc720 2024-09-18T21:17:16.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.475+0000 7fb68387a640 1 -- 172.21.15.77:0/2865701805 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb67c112e20 con 0x7fb67c0fc720 2024-09-18T21:17:16.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.476+0000 7fb68387a640 1 -- 172.21.15.77:0/2865701805 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb67c0fa8b0 con 0x7fb67c0fc720 2024-09-18T21:17:16.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.476+0000 7fb671ffb640 1 -- 172.21.15.77:0/2865701805 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fb66c030020 con 0x7fb67c0fc720 2024-09-18T21:17:16.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.477+0000 7fb671ffb640 1 --2- 172.21.15.77:0/2865701805 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fb66806e0b0 0x7fb668070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:17:16.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.477+0000 7fb671ffb640 1 -- 172.21.15.77:0/2865701805 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fb66c0adb50 con 0x7fb67c0fc720 2024-09-18T21:17:16.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.477+0000 7fb681616640 1 --2- 172.21.15.77:0/2865701805 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fb66806e0b0 0x7fb668070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:17:16.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.477+0000 7fb681616640 1 --2- 172.21.15.77:0/2865701805 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fb66806e0b0 0x7fb668070560 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb67c066480 tx=0x7fb67800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:17:16.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.485+0000 7fb671ffb640 1 -- 172.21.15.77:0/2865701805 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fb66c077050 con 0x7fb67c0fc720 2024-09-18T21:17:16.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.679+0000 7fb68387a640 1 -- 172.21.15.77:0/2865701805 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb67c100b70 con 0x7fb66806e0b0 2024-09-18T21:17:16.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.680+0000 7fb671ffb640 1 -- 172.21.15.77:0/2865701805 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fb67c100b70 con 0x7fb66806e0b0 2024-09-18T21:17:16.681 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-18T21:17:16.681 INFO:teuthology.orchestra.run.smithi077.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a", 2024-09-18T21:17:16.681 INFO:teuthology.orchestra.run.smithi077.stdout: "in_progress": true, 2024-09-18T21:17:16.682 INFO:teuthology.orchestra.run.smithi077.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T21:17:16.682 INFO:teuthology.orchestra.run.smithi077.stdout: "services_complete": [ 2024-09-18T21:17:16.682 INFO:teuthology.orchestra.run.smithi077.stdout: "mon", 2024-09-18T21:17:16.682 INFO:teuthology.orchestra.run.smithi077.stdout: "crash", 2024-09-18T21:17:16.682 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr" 2024-09-18T21:17:16.682 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-18T21:17:16.682 INFO:teuthology.orchestra.run.smithi077.stdout: "progress": "8/21 daemons upgraded", 2024-09-18T21:17:16.682 INFO:teuthology.orchestra.run.smithi077.stdout: "message": "Currently upgrading osd daemons", 2024-09-18T21:17:16.682 INFO:teuthology.orchestra.run.smithi077.stdout: "is_paused": false 2024-09-18T21:17:16.682 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-18T21:17:16.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.682+0000 7fb68387a640 1 -- 172.21.15.77:0/2865701805 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fb66806e0b0 msgr2=0x7fb668070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:16.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.682+0000 7fb68387a640 1 --2- 172.21.15.77:0/2865701805 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fb66806e0b0 0x7fb668070560 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb67c066480 tx=0x7fb67800b040 comp rx=0 tx=0).stop 2024-09-18T21:17:16.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.682+0000 7fb68387a640 1 -- 172.21.15.77:0/2865701805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb67c0fc720 msgr2=0x7fb67c112310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:16.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.682+0000 7fb68387a640 1 --2- 172.21.15.77:0/2865701805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb67c0fc720 0x7fb67c112310 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb66c003080 tx=0x7fb66c009da0 comp rx=0 tx=0).stop 2024-09-18T21:17:16.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.682+0000 7fb68387a640 1 -- 172.21.15.77:0/2865701805 shutdown_connections 2024-09-18T21:17:16.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.682+0000 7fb68387a640 1 --2- 172.21.15.77:0/2865701805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb67c0fc720 0x7fb67c112310 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:16.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.682+0000 7fb68387a640 1 --2- 172.21.15.77:0/2865701805 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fb66806e0b0 0x7fb668070560 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:16.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.682+0000 7fb68387a640 1 --2- 172.21.15.77:0/2865701805 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb67c0fb450 0x7fb67c10fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:16.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.682+0000 7fb68387a640 1 -- 172.21.15.77:0/2865701805 >> 172.21.15.77:0/2865701805 conn(0x7fb67c0f6c10 msgr2=0x7fb67c0f8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:17:16.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.683+0000 7fb68387a640 1 -- 172.21.15.77:0/2865701805 shutdown_connections 2024-09-18T21:17:16.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.683+0000 7fb68387a640 1 -- 172.21.15.77:0/2865701805 wait complete. 2024-09-18T21:17:16.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.762+0000 7fed2edb4640 1 -- 172.21.15.77:0/3400196026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed280fc520 msgr2=0x7fed280fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:16.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.762+0000 7fed2edb4640 1 --2- 172.21.15.77:0/3400196026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed280fc520 0x7fed280fc930 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fed1c0048d0 tx=0x7fed1c009da0 comp rx=0 tx=0).stop 2024-09-18T21:17:16.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.762+0000 7fed2edb4640 1 -- 172.21.15.77:0/3400196026 shutdown_connections 2024-09-18T21:17:16.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.762+0000 7fed2edb4640 1 --2- 172.21.15.77:0/3400196026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed280fd7f0 0x7fed280fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:16.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.762+0000 7fed2edb4640 1 --2- 172.21.15.77:0/3400196026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed280fc520 0x7fed280fc930 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:16.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.762+0000 7fed2edb4640 1 -- 172.21.15.77:0/3400196026 >> 172.21.15.77:0/3400196026 conn(0x7fed280f7ce0 msgr2=0x7fed280fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:17:16.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.762+0000 7fed2edb4640 1 -- 172.21.15.77:0/3400196026 shutdown_connections 2024-09-18T21:17:16.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.762+0000 7fed2edb4640 1 -- 172.21.15.77:0/3400196026 wait complete. 2024-09-18T21:17:16.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.763+0000 7fed2edb4640 1 Processor -- start 2024-09-18T21:17:16.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.763+0000 7fed2edb4640 1 -- start start 2024-09-18T21:17:16.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.763+0000 7fed2edb4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed280fc520 0x7fed2810d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:17:16.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.763+0000 7fed2edb4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed280fd7f0 0x7fed2810d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:17:16.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.763+0000 7fed2edb4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2810dc40 con 0x7fed280fd7f0 2024-09-18T21:17:16.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.763+0000 7fed2edb4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2810e460 con 0x7fed280fc520 2024-09-18T21:17:16.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.763+0000 7fed27fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed280fd7f0 0x7fed2810d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:17:16.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.763+0000 7fed27fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed280fd7f0 0x7fed2810d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58154/0 (socket says 172.21.15.77:58154) 2024-09-18T21:17:16.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.763+0000 7fed27fff640 1 -- 172.21.15.77:0/3141262469 learned_addr learned my addr 172.21.15.77:0/3141262469 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:17:16.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.764+0000 7fed2cb50640 1 --2- 172.21.15.77:0/3141262469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed280fc520 0x7fed2810d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:17:16.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.764+0000 7fed27fff640 1 -- 172.21.15.77:0/3141262469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed280fc520 msgr2=0x7fed2810d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:16.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.764+0000 7fed27fff640 1 --2- 172.21.15.77:0/3141262469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed280fc520 0x7fed2810d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:16.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.764+0000 7fed27fff640 1 -- 172.21.15.77:0/3141262469 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed1c005040 con 0x7fed280fd7f0 2024-09-18T21:17:16.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.764+0000 7fed27fff640 1 --2- 172.21.15.77:0/3141262469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed280fd7f0 0x7fed2810d5f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fed1400eb70 tx=0x7fed1400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:17:16.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.764+0000 7fed257fa640 1 -- 172.21.15.77:0/3141262469 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed14007c30 con 0x7fed280fd7f0 2024-09-18T21:17:16.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.764+0000 7fed257fa640 1 -- 172.21.15.77:0/3141262469 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fed1400f040 con 0x7fed280fd7f0 2024-09-18T21:17:16.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.764+0000 7fed2edb4640 1 -- 172.21.15.77:0/3141262469 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed2810e690 con 0x7fed280fd7f0 2024-09-18T21:17:16.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.764+0000 7fed257fa640 1 -- 172.21.15.77:0/3141262469 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed140094e0 con 0x7fed280fd7f0 2024-09-18T21:17:16.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.764+0000 7fed2edb4640 1 -- 172.21.15.77:0/3141262469 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed2810ec30 con 0x7fed280fd7f0 2024-09-18T21:17:16.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.765+0000 7fed2edb4640 1 -- 172.21.15.77:0/3141262469 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed280fb980 con 0x7fed280fd7f0 2024-09-18T21:17:16.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.765+0000 7fed257fa640 1 -- 172.21.15.77:0/3141262469 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fed14009660 con 0x7fed280fd7f0 2024-09-18T21:17:16.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.766+0000 7fed257fa640 1 --2- 172.21.15.77:0/3141262469 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fed1806e0b0 0x7fed18070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:17:16.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.766+0000 7fed257fa640 1 -- 172.21.15.77:0/3141262469 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fed1408d890 con 0x7fed280fd7f0 2024-09-18T21:17:16.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.766+0000 7fed2cb50640 1 --2- 172.21.15.77:0/3141262469 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fed1806e0b0 0x7fed18070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:17:16.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.766+0000 7fed2cb50640 1 --2- 172.21.15.77:0/3141262469 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fed1806e0b0 0x7fed18070560 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fed1c007ac0 tx=0x7fed1c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:17:16.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:16.770+0000 7fed257fa640 1 -- 172.21.15.77:0/3141262469 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fed14056c60 con 0x7fed280fd7f0 2024-09-18T21:17:16.892 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:16 smithi077 ceph-mon[92672]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:17:16.892 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:16 smithi077 ceph-mon[92672]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:17:16.892 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:16 smithi077 ceph-mon[92672]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:17:16.892 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:16 smithi077 ceph-mon[92672]: pgmap v78: 65 pgs: 65 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:17:16.892 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:16 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/4146070939' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:17:16.893 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:16 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-18T21:17:16.893 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:16 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/3881177791' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T21:17:17.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:17.014+0000 7fed2edb4640 1 -- 172.21.15.77:0/3141262469 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fed2804b720 con 0x7fed280fd7f0 2024-09-18T21:17:17.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:17.014+0000 7fed257fa640 1 -- 172.21.15.77:0/3141262469 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fed1405a320 con 0x7fed280fd7f0 2024-09-18T21:17:17.016 INFO:teuthology.orchestra.run.smithi077.stdout:HEALTH_OK 2024-09-18T21:17:17.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:17.016+0000 7fed2edb4640 1 -- 172.21.15.77:0/3141262469 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fed1806e0b0 msgr2=0x7fed18070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:17.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:17.016+0000 7fed2edb4640 1 --2- 172.21.15.77:0/3141262469 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fed1806e0b0 0x7fed18070560 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fed1c007ac0 tx=0x7fed1c035040 comp rx=0 tx=0).stop 2024-09-18T21:17:17.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:17.016+0000 7fed2edb4640 1 -- 172.21.15.77:0/3141262469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed280fd7f0 msgr2=0x7fed2810d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:17.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:17.016+0000 7fed2edb4640 1 --2- 172.21.15.77:0/3141262469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed280fd7f0 0x7fed2810d5f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fed1400eb70 tx=0x7fed1400b040 comp rx=0 tx=0).stop 2024-09-18T21:17:17.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:17.016+0000 7fed2edb4640 1 -- 172.21.15.77:0/3141262469 shutdown_connections 2024-09-18T21:17:17.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:17.016+0000 7fed2edb4640 1 --2- 172.21.15.77:0/3141262469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed280fd7f0 0x7fed2810d5f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:17.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:17.016+0000 7fed2edb4640 1 --2- 172.21.15.77:0/3141262469 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fed1806e0b0 0x7fed18070560 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:17.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:17.016+0000 7fed2edb4640 1 --2- 172.21.15.77:0/3141262469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed280fc520 0x7fed2810d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:17.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:17.016+0000 7fed2edb4640 1 -- 172.21.15.77:0/3141262469 >> 172.21.15.77:0/3141262469 conn(0x7fed280f7ce0 msgr2=0x7fed280f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:17:17.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:17.016+0000 7fed2edb4640 1 -- 172.21.15.77:0/3141262469 shutdown_connections 2024-09-18T21:17:17.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:17.016+0000 7fed2edb4640 1 -- 172.21.15.77:0/3141262469 wait complete. 2024-09-18T21:17:17.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:16 smithi103 ceph-mon[80307]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:17:17.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:16 smithi103 ceph-mon[80307]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:17:17.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:16 smithi103 ceph-mon[80307]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:17:17.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:16 smithi103 ceph-mon[80307]: pgmap v78: 65 pgs: 65 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:17:17.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:16 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/4146070939' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:17:17.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:16 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-18T21:17:17.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:16 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/3881177791' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T21:17:18.186 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:17 smithi077 ceph-mon[92672]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-18T21:17:18.186 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:17 smithi077 ceph-mon[92672]: Upgrade: osd.2 is safe to restart 2024-09-18T21:17:18.186 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:17 smithi077 ceph-mon[92672]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:17:18.186 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:17 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/3141262469' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T21:17:18.186 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:17 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:17:18.186 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:17 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-18T21:17:18.186 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:17 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:17:18.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:17 smithi103 ceph-mon[80307]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-18T21:17:18.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:17 smithi103 ceph-mon[80307]: Upgrade: osd.2 is safe to restart 2024-09-18T21:17:18.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:17 smithi103 ceph-mon[80307]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:17:18.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:17 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/3141262469' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T21:17:18.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:17 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:17:18.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:17 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-18T21:17:18.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:17 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:17:18.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:18 smithi077 ceph-mon[92672]: Upgrade: Updating osd.2 2024-09-18T21:17:18.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:18 smithi077 ceph-mon[92672]: Deploying daemon osd.2 on smithi077 2024-09-18T21:17:18.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:18 smithi077 ceph-mon[92672]: pgmap v79: 65 pgs: 65 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:17:19.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:18 smithi103 ceph-mon[80307]: Upgrade: Updating osd.2 2024-09-18T21:17:19.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:18 smithi103 ceph-mon[80307]: Deploying daemon osd.2 on smithi077 2024-09-18T21:17:19.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:18 smithi103 ceph-mon[80307]: pgmap v79: 65 pgs: 65 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:17:20.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:20 smithi077 ceph-mon[92672]: pgmap v80: 65 pgs: 65 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:17:20.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:20 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:17:20.964 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:20 smithi077 systemd[1]: Stopping Ceph osd.2 for 5a76ec16-7601-11ef-bceb-c7b262605968... 2024-09-18T21:17:21.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:20 smithi103 ceph-mon[80307]: pgmap v80: 65 pgs: 65 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:17:21.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:20 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:17:21.463 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:20 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-2[61561]: 2024-09-18T21:17:20.963+0000 7fa22cc45640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T21:17:21.463 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:20 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-2[61561]: 2024-09-18T21:17:20.963+0000 7fa22cc45640 -1 osd.2 56 *** Got signal Terminated *** 2024-09-18T21:17:21.463 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:20 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-2[61561]: 2024-09-18T21:17:20.963+0000 7fa22cc45640 -1 osd.2 56 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-18T21:17:22.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:21 smithi077 ceph-mon[92672]: osd.2 marked itself down and dead 2024-09-18T21:17:22.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:21 smithi103 ceph-mon[80307]: osd.2 marked itself down and dead 2024-09-18T21:17:22.564 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:22 smithi077 podman[111934]: 2024-09-18 21:17:22.26251696 +0000 UTC m=+1.416882062 container died 2ff2728057e2df8d766f2796a7559d7b851dd6f4c1f3a925fde67ca43724202b (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=quincy-6e06d1e, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-18T21:17:22.876 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:22 smithi077 podman[111934]: 2024-09-18 21:17:22.563623144 +0000 UTC m=+1.717988245 container cleanup 2ff2728057e2df8d766f2796a7559d7b851dd6f4c1f3a925fde67ca43724202b (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=quincy-6e06d1e, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-18T21:17:22.876 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:22 smithi077 bash[111934]: ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-2 2024-09-18T21:17:22.876 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:22 smithi077 podman[111950]: 2024-09-18 21:17:22.781493166 +0000 UTC m=+0.518480008 container remove 2ff2728057e2df8d766f2796a7559d7b851dd6f4c1f3a925fde67ca43724202b (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-2, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=quincy-6e06d1e, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-18T21:17:23.199 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:22 smithi077 ceph-mon[92672]: pgmap v81: 65 pgs: 65 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:17:23.199 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:22 smithi077 ceph-mon[92672]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-18T21:17:23.200 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:22 smithi077 ceph-mon[92672]: osdmap e57: 6 total, 5 up, 6 in 2024-09-18T21:17:23.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:22 smithi103 ceph-mon[80307]: pgmap v81: 65 pgs: 65 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:17:23.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:22 smithi103 ceph-mon[80307]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-18T21:17:23.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:22 smithi103 ceph-mon[80307]: osdmap e57: 6 total, 5 up, 6 in 2024-09-18T21:17:23.463 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:23 smithi077 podman[112037]: 2024-09-18 21:17:23.199156967 +0000 UTC m=+0.111088597 container create 4307c23f588ee8f6cf8377b060246473fcdd992faa747bb646d4b7313d667704 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-2-deactivate, RELEASE=squid-release-06b1b1d, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-18T21:17:23.463 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:23 smithi077 podman[112037]: 2024-09-18 21:17:23.10449967 +0000 UTC m=+0.016431272 image pull f79f744f586d6ce8ddb4b06b7cf36a0f23174bbe29ea68264d2be49d8c6d9acd quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a 2024-09-18T21:17:23.463 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:23 smithi077 podman[112037]: 2024-09-18 21:17:23.418682632 +0000 UTC m=+0.330614218 container init 4307c23f588ee8f6cf8377b060246473fcdd992faa747bb646d4b7313d667704 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-release-06b1b1d, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-18T21:17:23.463 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:23 smithi077 podman[112037]: 2024-09-18 21:17:23.422708208 +0000 UTC m=+0.334639795 container start 4307c23f588ee8f6cf8377b060246473fcdd992faa747bb646d4b7313d667704 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-release-06b1b1d, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True) 2024-09-18T21:17:23.889 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:23 smithi077 podman[112037]: 2024-09-18 21:17:23.476614587 +0000 UTC m=+0.388546172 container attach 4307c23f588ee8f6cf8377b060246473fcdd992faa747bb646d4b7313d667704 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-2-deactivate, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-release-06b1b1d, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T21:17:23.889 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:23 smithi077 podman[112037]: 2024-09-18 21:17:23.626810036 +0000 UTC m=+0.538741639 container died 4307c23f588ee8f6cf8377b060246473fcdd992faa747bb646d4b7313d667704 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-release-06b1b1d) 2024-09-18T21:17:24.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:23 smithi077 ceph-mon[92672]: osdmap e58: 6 total, 5 up, 6 in 2024-09-18T21:17:24.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:23 smithi103 ceph-mon[80307]: osdmap e58: 6 total, 5 up, 6 in 2024-09-18T21:17:24.700 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:24 smithi077 podman[112060]: 2024-09-18 21:17:24.280618318 +0000 UTC m=+0.648167861 container remove 4307c23f588ee8f6cf8377b060246473fcdd992faa747bb646d4b7313d667704 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-release-06b1b1d, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T21:17:24.700 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:24 smithi077 systemd[1]: ceph-5a76ec16-7601-11ef-bceb-c7b262605968@osd.2.service: Deactivated successfully. 2024-09-18T21:17:24.700 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:24 smithi077 systemd[1]: Stopped Ceph osd.2 for 5a76ec16-7601-11ef-bceb-c7b262605968. 2024-09-18T21:17:24.700 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:24 smithi077 systemd[1]: ceph-5a76ec16-7601-11ef-bceb-c7b262605968@osd.2.service: Consumed 53.622s CPU time. 2024-09-18T21:17:24.700 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:24 smithi077 systemd[1]: Starting Ceph osd.2 for 5a76ec16-7601-11ef-bceb-c7b262605968... 2024-09-18T21:17:24.952 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:24 smithi077 ceph-mon[92672]: pgmap v84: 65 pgs: 4 active+undersized, 5 stale+active+clean, 3 active+undersized+degraded, 53 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 11/222 objects degraded (4.955%) 2024-09-18T21:17:24.952 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:24 smithi077 ceph-mon[92672]: Health check failed: Degraded data redundancy: 11/222 objects degraded (4.955%), 3 pgs degraded (PG_DEGRADED) 2024-09-18T21:17:24.952 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:24 smithi077 podman[112158]: 2024-09-18 21:17:24.698612397 +0000 UTC m=+0.099255056 container create 14a1fdb5b5edd4e642677b14b169779d629d49cbad82dbb01f398849c0b8b4b3 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-2-activate, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-release-06b1b1d) 2024-09-18T21:17:24.952 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:24 smithi077 podman[112158]: 2024-09-18 21:17:24.615192385 +0000 UTC m=+0.015835058 image pull f79f744f586d6ce8ddb4b06b7cf36a0f23174bbe29ea68264d2be49d8c6d9acd quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a 2024-09-18T21:17:24.952 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:24 smithi077 podman[112158]: 2024-09-18 21:17:24.951670496 +0000 UTC m=+0.352313157 container init 14a1fdb5b5edd4e642677b14b169779d629d49cbad82dbb01f398849c0b8b4b3 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-2-activate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-release-06b1b1d, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T21:17:25.213 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:24 smithi077 podman[112158]: 2024-09-18 21:17:24.955636063 +0000 UTC m=+0.356278728 container start 14a1fdb5b5edd4e642677b14b169779d629d49cbad82dbb01f398849c0b8b4b3 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-2-activate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-release-06b1b1d, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-18T21:17:25.213 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:25 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-2-activate[112173]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T21:17:25.213 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:25 smithi077 podman[112158]: 2024-09-18 21:17:25.092803454 +0000 UTC m=+0.493446123 container attach 14a1fdb5b5edd4e642677b14b169779d629d49cbad82dbb01f398849c0b8b4b3 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-2-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-release-06b1b1d, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-18T21:17:25.213 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:25 smithi077 bash[112158]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T21:17:25.213 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:25 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-2-activate[112173]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T21:17:25.213 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:25 smithi077 bash[112158]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T21:17:25.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:24 smithi103 ceph-mon[80307]: pgmap v84: 65 pgs: 4 active+undersized, 5 stale+active+clean, 3 active+undersized+degraded, 53 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 11/222 objects degraded (4.955%) 2024-09-18T21:17:25.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:24 smithi103 ceph-mon[80307]: Health check failed: Degraded data redundancy: 11/222 objects degraded (4.955%), 3 pgs degraded (PG_DEGRADED) 2024-09-18T21:17:25.552 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:25 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-2-activate[112173]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-18T21:17:25.552 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:25 smithi077 bash[112158]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-18T21:17:25.552 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:25 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-2-activate[112173]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-18T21:17:25.553 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:25 smithi077 bash[112158]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-18T21:17:25.553 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:25 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-2-activate[112173]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-18T21:17:25.553 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:25 smithi077 bash[112158]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-18T21:17:25.553 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:25 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-2-activate[112173]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-18T21:17:25.553 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:25 smithi077 bash[112158]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-18T21:17:25.553 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:25 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-2-activate[112173]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-18T21:17:25.553 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:25 smithi077 bash[112158]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-18T21:17:25.553 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:25 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-2-activate[112173]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-18T21:17:25.553 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:25 smithi077 bash[112158]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-18T21:17:25.553 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:25 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-2-activate[112173]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-18T21:17:25.553 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:25 smithi077 bash[112158]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-18T21:17:25.553 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:25 smithi077 podman[112158]: 2024-09-18 21:17:25.333761735 +0000 UTC m=+0.734404407 container died 14a1fdb5b5edd4e642677b14b169779d629d49cbad82dbb01f398849c0b8b4b3 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-release-06b1b1d, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-18T21:17:26.213 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:25 smithi077 podman[112314]: 2024-09-18 21:17:25.913494579 +0000 UTC m=+0.573900664 container remove 14a1fdb5b5edd4e642677b14b169779d629d49cbad82dbb01f398849c0b8b4b3 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-2-activate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-release-06b1b1d, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-18T21:17:26.213 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:26 smithi077 podman[112377]: 2024-09-18 21:17:26.021454503 +0000 UTC m=+0.015768939 image pull f79f744f586d6ce8ddb4b06b7cf36a0f23174bbe29ea68264d2be49d8c6d9acd quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a 2024-09-18T21:17:26.213 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:26 smithi077 podman[112377]: 2024-09-18 21:17:26.139493833 +0000 UTC m=+0.133808278 container create 93876f1d398d07f10e477c3b8be0a61f99f7c78239e9d443873098711092b1e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-release-06b1b1d) 2024-09-18T21:17:26.713 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:26 smithi077 podman[112377]: 2024-09-18 21:17:26.375343389 +0000 UTC m=+0.369657825 container init 93876f1d398d07f10e477c3b8be0a61f99f7c78239e9d443873098711092b1e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-release-06b1b1d, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-18T21:17:26.713 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:26 smithi077 podman[112377]: 2024-09-18 21:17:26.378593821 +0000 UTC m=+0.372908257 container start 93876f1d398d07f10e477c3b8be0a61f99f7c78239e9d443873098711092b1e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-release-06b1b1d, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T21:17:26.713 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:26 smithi077 ceph-osd[112396]: -- 172.21.15.77:0/3698289213 <== mon.0 v2:172.21.15.77:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5588ec67c1e0 con 0x5588ec614000 2024-09-18T21:17:26.713 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:26 smithi077 bash[112377]: 93876f1d398d07f10e477c3b8be0a61f99f7c78239e9d443873098711092b1e7 2024-09-18T21:17:26.713 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:26 smithi077 systemd[1]: Started Ceph osd.2 for 5a76ec16-7601-11ef-bceb-c7b262605968. 2024-09-18T21:17:27.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:26 smithi077 ceph-mon[92672]: pgmap v85: 65 pgs: 8 active+undersized, 2 stale+active+clean, 7 active+undersized+degraded, 48 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 19/222 objects degraded (8.559%) 2024-09-18T21:17:27.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:26 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:17:27.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:26 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:17:27.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:26 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:17:27.213 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:26 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-2[112392]: 2024-09-18T21:17:26.921+0000 7fee44b76640 -1 Falling back to public interface 2024-09-18T21:17:27.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:26 smithi103 ceph-mon[80307]: pgmap v85: 65 pgs: 8 active+undersized, 2 stale+active+clean, 7 active+undersized+degraded, 48 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 19/222 objects degraded (8.559%) 2024-09-18T21:17:27.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:26 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:17:27.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:26 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:17:27.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:26 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:17:29.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:28 smithi077 ceph-mon[92672]: pgmap v86: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/222 objects degraded (13.063%) 2024-09-18T21:17:29.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:28 smithi103 ceph-mon[80307]: pgmap v86: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/222 objects degraded (13.063%) 2024-09-18T21:17:31.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:30 smithi077 ceph-mon[92672]: pgmap v87: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/222 objects degraded (13.063%) 2024-09-18T21:17:31.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:30 smithi103 ceph-mon[80307]: pgmap v87: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/222 objects degraded (13.063%) 2024-09-18T21:17:31.713 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:31 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-2[112392]: 2024-09-18T21:17:31.228+0000 7fee44b76640 -1 osd.2 56 log_to_monitors true 2024-09-18T21:17:32.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:31 smithi077 ceph-mon[92672]: from='osd.2 [v2:172.21.15.77:6818/627101741,v1:172.21.15.77:6819/627101741]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-18T21:17:32.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:31 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:17:32.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:31 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:17:32.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:31 smithi103 ceph-mon[80307]: from='osd.2 [v2:172.21.15.77:6818/627101741,v1:172.21.15.77:6819/627101741]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-18T21:17:32.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:31 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:17:32.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:31 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:17:32.991 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:17:32 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-2[112392]: 2024-09-18T21:17:32.758+0000 7fee38908640 -1 osd.2 56 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T21:17:32.991 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:32 smithi077 ceph-mon[92672]: pgmap v88: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/222 objects degraded (13.063%) 2024-09-18T21:17:32.991 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:32 smithi077 ceph-mon[92672]: from='osd.2 [v2:172.21.15.77:6818/627101741,v1:172.21.15.77:6819/627101741]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-18T21:17:32.991 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:32 smithi077 ceph-mon[92672]: osdmap e59: 6 total, 5 up, 6 in 2024-09-18T21:17:32.992 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:32 smithi077 ceph-mon[92672]: from='osd.2 [v2:172.21.15.77:6818/627101741,v1:172.21.15.77:6819/627101741]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-09-18T21:17:32.992 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:32 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:17:32.992 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:32 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:17:32.992 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:32 smithi077 ceph-mon[92672]: from='osd.2 [v2:172.21.15.77:6818/627101741,v1:172.21.15.77:6819/627101741]' entity='osd.2' 2024-09-18T21:17:33.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:32 smithi103 ceph-mon[80307]: pgmap v88: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 203 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/222 objects degraded (13.063%) 2024-09-18T21:17:33.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:32 smithi103 ceph-mon[80307]: from='osd.2 [v2:172.21.15.77:6818/627101741,v1:172.21.15.77:6819/627101741]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-18T21:17:33.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:32 smithi103 ceph-mon[80307]: osdmap e59: 6 total, 5 up, 6 in 2024-09-18T21:17:33.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:32 smithi103 ceph-mon[80307]: from='osd.2 [v2:172.21.15.77:6818/627101741,v1:172.21.15.77:6819/627101741]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-09-18T21:17:33.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:32 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:17:33.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:32 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:17:33.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:32 smithi103 ceph-mon[80307]: from='osd.2 [v2:172.21.15.77:6818/627101741,v1:172.21.15.77:6819/627101741]' entity='osd.2' 2024-09-18T21:17:34.150 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:33 smithi077 ceph-mon[92672]: Health check update: Degraded data redundancy: 29/222 objects degraded (13.063%), 12 pgs degraded (PG_DEGRADED) 2024-09-18T21:17:34.151 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:33 smithi077 ceph-mon[92672]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-18T21:17:34.151 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:33 smithi077 ceph-mon[92672]: osd.2 [v2:172.21.15.77:6818/627101741,v1:172.21.15.77:6819/627101741] boot 2024-09-18T21:17:34.151 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:33 smithi077 ceph-mon[92672]: osdmap e60: 6 total, 6 up, 6 in 2024-09-18T21:17:34.151 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:33 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T21:17:34.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:33 smithi103 ceph-mon[80307]: Health check update: Degraded data redundancy: 29/222 objects degraded (13.063%), 12 pgs degraded (PG_DEGRADED) 2024-09-18T21:17:34.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:33 smithi103 ceph-mon[80307]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-18T21:17:34.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:33 smithi103 ceph-mon[80307]: osd.2 [v2:172.21.15.77:6818/627101741,v1:172.21.15.77:6819/627101741] boot 2024-09-18T21:17:34.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:33 smithi103 ceph-mon[80307]: osdmap e60: 6 total, 6 up, 6 in 2024-09-18T21:17:34.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:33 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-18T21:17:35.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:34 smithi077 ceph-mon[92672]: pgmap v91: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 29/222 objects degraded (13.063%) 2024-09-18T21:17:35.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:34 smithi077 ceph-mon[92672]: osdmap e61: 6 total, 6 up, 6 in 2024-09-18T21:17:35.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:34 smithi103 ceph-mon[80307]: pgmap v91: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 29/222 objects degraded (13.063%) 2024-09-18T21:17:35.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:34 smithi103 ceph-mon[80307]: osdmap e61: 6 total, 6 up, 6 in 2024-09-18T21:17:36.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:36 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:17:36.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:36 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:17:36.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:36 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:17:36.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:36 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:17:36.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:36 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:17:36.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:36 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:17:36.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:36 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:17:36.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:36 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:17:36.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:36 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:17:36.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:36 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-18T21:17:36.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:36 smithi077 ceph-mon[92672]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-18T21:17:36.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:36 smithi077 ceph-mon[92672]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-18T21:17:36.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:36 smithi077 ceph-mon[92672]: pgmap v93: 65 pgs: 5 peering, 12 active+undersized, 10 active+undersized+degraded, 38 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 26/222 objects degraded (11.712%) 2024-09-18T21:17:36.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:36 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:17:36.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:36 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:17:37.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:36 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:17:37.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:36 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:17:37.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:36 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:17:37.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:36 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:17:37.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:36 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:17:37.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:36 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:17:37.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:36 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:17:37.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:36 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:17:37.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:36 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:17:37.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:36 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-18T21:17:37.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:36 smithi103 ceph-mon[80307]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-18T21:17:37.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:36 smithi103 ceph-mon[80307]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-18T21:17:37.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:36 smithi103 ceph-mon[80307]: pgmap v93: 65 pgs: 5 peering, 12 active+undersized, 10 active+undersized+degraded, 38 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 26/222 objects degraded (11.712%) 2024-09-18T21:17:37.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:36 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:17:37.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:36 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:17:38.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:38 smithi077 ceph-mon[92672]: pgmap v94: 65 pgs: 5 peering, 2 active+undersized, 1 active+undersized+degraded, 57 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 3/222 objects degraded (1.351%) 2024-09-18T21:17:38.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:38 smithi077 ceph-mon[92672]: Health check update: Degraded data redundancy: 3/222 objects degraded (1.351%), 1 pg degraded (PG_DEGRADED) 2024-09-18T21:17:39.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:38 smithi103 ceph-mon[80307]: pgmap v94: 65 pgs: 5 peering, 2 active+undersized, 1 active+undersized+degraded, 57 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 3/222 objects degraded (1.351%) 2024-09-18T21:17:39.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:38 smithi103 ceph-mon[80307]: Health check update: Degraded data redundancy: 3/222 objects degraded (1.351%), 1 pg degraded (PG_DEGRADED) 2024-09-18T21:17:40.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:39 smithi077 ceph-mon[92672]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3/222 objects degraded (1.351%), 1 pg degraded) 2024-09-18T21:17:40.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:39 smithi077 ceph-mon[92672]: Cluster is now healthy 2024-09-18T21:17:40.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:39 smithi103 ceph-mon[80307]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3/222 objects degraded (1.351%), 1 pg degraded) 2024-09-18T21:17:40.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:39 smithi103 ceph-mon[80307]: Cluster is now healthy 2024-09-18T21:17:41.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:40 smithi077 ceph-mon[92672]: pgmap v95: 65 pgs: 65 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:17:41.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:40 smithi103 ceph-mon[80307]: pgmap v95: 65 pgs: 65 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:17:43.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:42 smithi077 ceph-mon[92672]: pgmap v96: 65 pgs: 65 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:17:43.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:42 smithi103 ceph-mon[80307]: pgmap v96: 65 pgs: 65 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:17:45.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:44 smithi077 ceph-mon[92672]: pgmap v97: 65 pgs: 65 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:17:45.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:44 smithi103 ceph-mon[80307]: pgmap v97: 65 pgs: 65 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:17:47.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.102+0000 7f9c8b3f2640 1 -- 172.21.15.77:0/860619428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c840fd820 msgr2=0x7f9c840fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:47.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.102+0000 7f9c8b3f2640 1 --2- 172.21.15.77:0/860619428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c840fd820 0x7f9c840fdc90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9c740048d0 tx=0x7f9c74009da0 comp rx=0 tx=0).stop 2024-09-18T21:17:47.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.102+0000 7f9c8b3f2640 1 -- 172.21.15.77:0/860619428 shutdown_connections 2024-09-18T21:17:47.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.102+0000 7f9c8b3f2640 1 --2- 172.21.15.77:0/860619428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c840fd820 0x7f9c840fdc90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:47.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.102+0000 7f9c8b3f2640 1 --2- 172.21.15.77:0/860619428 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c840fc550 0x7f9c840fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:47.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.102+0000 7f9c8b3f2640 1 -- 172.21.15.77:0/860619428 >> 172.21.15.77:0/860619428 conn(0x7f9c840f7d30 msgr2=0x7f9c840fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:17:47.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.102+0000 7f9c8b3f2640 1 -- 172.21.15.77:0/860619428 shutdown_connections 2024-09-18T21:17:47.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.102+0000 7f9c8b3f2640 1 -- 172.21.15.77:0/860619428 wait complete. 2024-09-18T21:17:47.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.103+0000 7f9c8b3f2640 1 Processor -- start 2024-09-18T21:17:47.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.103+0000 7f9c8b3f2640 1 -- start start 2024-09-18T21:17:47.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.103+0000 7f9c8b3f2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c840fc550 0x7f9c8410d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:17:47.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.103+0000 7f9c8b3f2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c840fd820 0x7f9c8410d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:17:47.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.103+0000 7f9c8b3f2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8410dc40 con 0x7f9c840fc550 2024-09-18T21:17:47.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.103+0000 7f9c8b3f2640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8410e460 con 0x7f9c840fd820 2024-09-18T21:17:47.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.103+0000 7f9c8918e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c840fc550 0x7f9c8410d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:17:47.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.103+0000 7f9c8918e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c840fc550 0x7f9c8410d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34880/0 (socket says 172.21.15.77:34880) 2024-09-18T21:17:47.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.103+0000 7f9c8918e640 1 -- 172.21.15.77:0/3538222551 learned_addr learned my addr 172.21.15.77:0/3538222551 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:17:47.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.103+0000 7f9c8898d640 1 --2- 172.21.15.77:0/3538222551 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c840fd820 0x7f9c8410d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:17:47.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.103+0000 7f9c8918e640 1 -- 172.21.15.77:0/3538222551 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c840fd820 msgr2=0x7f9c8410d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:47.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.103+0000 7f9c8918e640 1 --2- 172.21.15.77:0/3538222551 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c840fd820 0x7f9c8410d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:47.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.103+0000 7f9c8918e640 1 -- 172.21.15.77:0/3538222551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c74005040 con 0x7f9c840fc550 2024-09-18T21:17:47.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.104+0000 7f9c8918e640 1 --2- 172.21.15.77:0/3538222551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c840fc550 0x7f9c8410d0b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9c8000eb70 tx=0x7f9c8000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:17:47.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.104+0000 7f9c79ffb640 1 -- 172.21.15.77:0/3538222551 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c80007c30 con 0x7f9c840fc550 2024-09-18T21:17:47.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.104+0000 7f9c79ffb640 1 -- 172.21.15.77:0/3538222551 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9c8000f040 con 0x7f9c840fc550 2024-09-18T21:17:47.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.104+0000 7f9c8b3f2640 1 -- 172.21.15.77:0/3538222551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c8410e690 con 0x7f9c840fc550 2024-09-18T21:17:47.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.104+0000 7f9c79ffb640 1 -- 172.21.15.77:0/3538222551 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c800094e0 con 0x7f9c840fc550 2024-09-18T21:17:47.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.104+0000 7f9c8b3f2640 1 -- 172.21.15.77:0/3538222551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c8410ec30 con 0x7f9c840fc550 2024-09-18T21:17:47.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.105+0000 7f9c8b3f2640 1 -- 172.21.15.77:0/3538222551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c840fb9b0 con 0x7f9c840fc550 2024-09-18T21:17:47.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.105+0000 7f9c79ffb640 1 -- 172.21.15.77:0/3538222551 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9c80009640 con 0x7f9c840fc550 2024-09-18T21:17:47.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.106+0000 7f9c79ffb640 1 --2- 172.21.15.77:0/3538222551 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f9c7006e0b0 0x7f9c70070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:17:47.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.106+0000 7f9c79ffb640 1 -- 172.21.15.77:0/3538222551 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f9c8008d790 con 0x7f9c840fc550 2024-09-18T21:17:47.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.106+0000 7f9c8898d640 1 --2- 172.21.15.77:0/3538222551 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f9c7006e0b0 0x7f9c70070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:17:47.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.106+0000 7f9c8898d640 1 --2- 172.21.15.77:0/3538222551 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f9c7006e0b0 0x7f9c70070560 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9c74007ac0 tx=0x7f9c74035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:17:47.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.110+0000 7f9c79ffb640 1 -- 172.21.15.77:0/3538222551 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f9c80056be0 con 0x7f9c840fc550 2024-09-18T21:17:47.112 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:46 smithi077 ceph-mon[92672]: pgmap v98: 65 pgs: 65 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:17:47.112 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:46 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:17:47.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:46 smithi103 ceph-mon[80307]: pgmap v98: 65 pgs: 65 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:17:47.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:46 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:17:47.293 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.292+0000 7f9c8b3f2640 1 -- 172.21.15.77:0/3538222551 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c8410efb0 con 0x7f9c7006e0b0 2024-09-18T21:17:47.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.293+0000 7f9c79ffb640 1 -- 172.21.15.77:0/3538222551 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f9c8410efb0 con 0x7f9c7006e0b0 2024-09-18T21:17:47.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.295+0000 7f9c8b3f2640 1 -- 172.21.15.77:0/3538222551 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f9c7006e0b0 msgr2=0x7f9c70070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:47.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.295+0000 7f9c8b3f2640 1 --2- 172.21.15.77:0/3538222551 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f9c7006e0b0 0x7f9c70070560 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9c74007ac0 tx=0x7f9c74035040 comp rx=0 tx=0).stop 2024-09-18T21:17:47.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.295+0000 7f9c8b3f2640 1 -- 172.21.15.77:0/3538222551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c840fc550 msgr2=0x7f9c8410d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:47.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.295+0000 7f9c8b3f2640 1 --2- 172.21.15.77:0/3538222551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c840fc550 0x7f9c8410d0b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9c8000eb70 tx=0x7f9c8000b040 comp rx=0 tx=0).stop 2024-09-18T21:17:47.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.295+0000 7f9c8b3f2640 1 -- 172.21.15.77:0/3538222551 shutdown_connections 2024-09-18T21:17:47.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.295+0000 7f9c8b3f2640 1 --2- 172.21.15.77:0/3538222551 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f9c7006e0b0 0x7f9c70070560 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:47.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.295+0000 7f9c8b3f2640 1 --2- 172.21.15.77:0/3538222551 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c840fd820 0x7f9c8410d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:47.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.295+0000 7f9c8b3f2640 1 --2- 172.21.15.77:0/3538222551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c840fc550 0x7f9c8410d0b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:47.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.295+0000 7f9c8b3f2640 1 -- 172.21.15.77:0/3538222551 >> 172.21.15.77:0/3538222551 conn(0x7f9c840f7d30 msgr2=0x7f9c840f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:17:47.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.296+0000 7f9c8b3f2640 1 -- 172.21.15.77:0/3538222551 shutdown_connections 2024-09-18T21:17:47.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.296+0000 7f9c8b3f2640 1 -- 172.21.15.77:0/3538222551 wait complete. 2024-09-18T21:17:47.305 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-09-18T21:17:47.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.374+0000 7f2bb2575640 1 -- 172.21.15.77:0/24207068 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bac0fd820 msgr2=0x7f2bac0fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:47.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.374+0000 7f2bb2575640 1 --2- 172.21.15.77:0/24207068 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bac0fd820 0x7f2bac0fdc90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2ba00048d0 tx=0x7f2ba0009da0 comp rx=0 tx=0).stop 2024-09-18T21:17:47.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.374+0000 7f2bb2575640 1 -- 172.21.15.77:0/24207068 shutdown_connections 2024-09-18T21:17:47.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.374+0000 7f2bb2575640 1 --2- 172.21.15.77:0/24207068 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bac0fd820 0x7f2bac0fdc90 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:47.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.374+0000 7f2bb2575640 1 --2- 172.21.15.77:0/24207068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2bac0fc550 0x7f2bac0fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:47.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.374+0000 7f2bb2575640 1 -- 172.21.15.77:0/24207068 >> 172.21.15.77:0/24207068 conn(0x7f2bac0f7d30 msgr2=0x7f2bac0fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:17:47.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.374+0000 7f2bb2575640 1 -- 172.21.15.77:0/24207068 shutdown_connections 2024-09-18T21:17:47.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.375+0000 7f2bb2575640 1 -- 172.21.15.77:0/24207068 wait complete. 2024-09-18T21:17:47.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.375+0000 7f2bb2575640 1 Processor -- start 2024-09-18T21:17:47.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.375+0000 7f2bb2575640 1 -- start start 2024-09-18T21:17:47.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.375+0000 7f2bb2575640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2bac0fc550 0x7f2bac071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:17:47.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.375+0000 7f2bb2575640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bac0fd820 0x7f2bac06fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:17:47.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.375+0000 7f2bb2575640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac06fff0 con 0x7f2bac0fd820 2024-09-18T21:17:47.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.375+0000 7f2bb2575640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac070130 con 0x7f2bac0fc550 2024-09-18T21:17:47.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.376+0000 7f2bab7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bac0fd820 0x7f2bac06fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:17:47.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.376+0000 7f2bab7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bac0fd820 0x7f2bac06fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34906/0 (socket says 172.21.15.77:34906) 2024-09-18T21:17:47.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.376+0000 7f2bab7fe640 1 -- 172.21.15.77:0/454066711 learned_addr learned my addr 172.21.15.77:0/454066711 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:17:47.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.376+0000 7f2babfff640 1 --2- 172.21.15.77:0/454066711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2bac0fc550 0x7f2bac071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:17:47.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.376+0000 7f2bab7fe640 1 -- 172.21.15.77:0/454066711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2bac0fc550 msgr2=0x7f2bac071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:47.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.376+0000 7f2bab7fe640 1 --2- 172.21.15.77:0/454066711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2bac0fc550 0x7f2bac071570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:47.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.376+0000 7f2bab7fe640 1 -- 172.21.15.77:0/454066711 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba0005040 con 0x7f2bac0fd820 2024-09-18T21:17:47.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.376+0000 7f2bab7fe640 1 --2- 172.21.15.77:0/454066711 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bac0fd820 0x7f2bac06fa60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2ba0003080 tx=0x7f2ba0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:17:47.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.376+0000 7f2ba8ff9640 1 -- 172.21.15.77:0/454066711 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ba0038070 con 0x7f2bac0fd820 2024-09-18T21:17:47.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.376+0000 7f2bb2575640 1 -- 172.21.15.77:0/454066711 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bac0703b0 con 0x7f2bac0fd820 2024-09-18T21:17:47.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.376+0000 7f2ba8ff9640 1 -- 172.21.15.77:0/454066711 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2ba002abd0 con 0x7f2bac0fd820 2024-09-18T21:17:47.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.376+0000 7f2ba8ff9640 1 -- 172.21.15.77:0/454066711 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ba003e670 con 0x7f2bac0fd820 2024-09-18T21:17:47.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.376+0000 7f2bb2575640 1 -- 172.21.15.77:0/454066711 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bac115100 con 0x7f2bac0fd820 2024-09-18T21:17:47.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.378+0000 7f2bb2575640 1 -- 172.21.15.77:0/454066711 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bac04b720 con 0x7f2bac0fd820 2024-09-18T21:17:47.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.378+0000 7f2ba8ff9640 1 -- 172.21.15.77:0/454066711 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f2ba0030020 con 0x7f2bac0fd820 2024-09-18T21:17:47.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.378+0000 7f2ba8ff9640 1 --2- 172.21.15.77:0/454066711 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f2b9406e0b0 0x7f2b94070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:17:47.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.379+0000 7f2ba8ff9640 1 -- 172.21.15.77:0/454066711 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f2ba00ade50 con 0x7f2bac0fd820 2024-09-18T21:17:47.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.379+0000 7f2babfff640 1 --2- 172.21.15.77:0/454066711 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f2b9406e0b0 0x7f2b94070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:17:47.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.379+0000 7f2babfff640 1 --2- 172.21.15.77:0/454066711 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f2b9406e0b0 0x7f2b94070560 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c0041d0 tx=0x7f2b9c004330 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:17:47.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.383+0000 7f2ba8ff9640 1 -- 172.21.15.77:0/454066711 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f2ba00772d0 con 0x7f2bac0fd820 2024-09-18T21:17:47.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.562+0000 7f2bb2575640 1 -- 172.21.15.77:0/454066711 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2bac101c40 con 0x7f2b9406e0b0 2024-09-18T21:17:47.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.563+0000 7f2ba8ff9640 1 -- 172.21.15.77:0/454066711 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f2bac101c40 con 0x7f2b9406e0b0 2024-09-18T21:17:47.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.566+0000 7f2bb2575640 1 -- 172.21.15.77:0/454066711 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f2b9406e0b0 msgr2=0x7f2b94070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:47.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.566+0000 7f2bb2575640 1 --2- 172.21.15.77:0/454066711 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f2b9406e0b0 0x7f2b94070560 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c0041d0 tx=0x7f2b9c004330 comp rx=0 tx=0).stop 2024-09-18T21:17:47.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.566+0000 7f2bb2575640 1 -- 172.21.15.77:0/454066711 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bac0fd820 msgr2=0x7f2bac06fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:47.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.566+0000 7f2bb2575640 1 --2- 172.21.15.77:0/454066711 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bac0fd820 0x7f2bac06fa60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2ba0003080 tx=0x7f2ba0009da0 comp rx=0 tx=0).stop 2024-09-18T21:17:47.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.566+0000 7f2bb2575640 1 -- 172.21.15.77:0/454066711 shutdown_connections 2024-09-18T21:17:47.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.566+0000 7f2bb2575640 1 --2- 172.21.15.77:0/454066711 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bac0fd820 0x7f2bac06fa60 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:47.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.566+0000 7f2bb2575640 1 --2- 172.21.15.77:0/454066711 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f2b9406e0b0 0x7f2b94070560 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:47.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.566+0000 7f2bb2575640 1 --2- 172.21.15.77:0/454066711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2bac0fc550 0x7f2bac071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:47.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.566+0000 7f2bb2575640 1 -- 172.21.15.77:0/454066711 >> 172.21.15.77:0/454066711 conn(0x7f2bac0f7d30 msgr2=0x7f2bac0f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:17:47.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.566+0000 7f2bb2575640 1 -- 172.21.15.77:0/454066711 shutdown_connections 2024-09-18T21:17:47.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.566+0000 7f2bb2575640 1 -- 172.21.15.77:0/454066711 wait complete. 2024-09-18T21:17:47.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.644+0000 7f6c5ceb4640 1 -- 172.21.15.77:0/4166936172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c580fc550 msgr2=0x7f6c580fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:47.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.644+0000 7f6c5ceb4640 1 --2- 172.21.15.77:0/4166936172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c580fc550 0x7f6c580fc960 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6c480048d0 tx=0x7f6c48009da0 comp rx=0 tx=0).stop 2024-09-18T21:17:47.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.644+0000 7f6c5ceb4640 1 -- 172.21.15.77:0/4166936172 shutdown_connections 2024-09-18T21:17:47.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.644+0000 7f6c5ceb4640 1 --2- 172.21.15.77:0/4166936172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c580fd820 0x7f6c580fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:47.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.644+0000 7f6c5ceb4640 1 --2- 172.21.15.77:0/4166936172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c580fc550 0x7f6c580fc960 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:47.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.644+0000 7f6c5ceb4640 1 -- 172.21.15.77:0/4166936172 >> 172.21.15.77:0/4166936172 conn(0x7f6c580f7d30 msgr2=0x7f6c580fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:17:47.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.644+0000 7f6c5ceb4640 1 -- 172.21.15.77:0/4166936172 shutdown_connections 2024-09-18T21:17:47.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.644+0000 7f6c5ceb4640 1 -- 172.21.15.77:0/4166936172 wait complete. 2024-09-18T21:17:47.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.645+0000 7f6c5ceb4640 1 Processor -- start 2024-09-18T21:17:47.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.645+0000 7f6c5ceb4640 1 -- start start 2024-09-18T21:17:47.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.645+0000 7f6c5ceb4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c580fc550 0x7f6c5810d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:17:47.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.645+0000 7f6c5ceb4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c580fd820 0x7f6c5810d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:17:47.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.645+0000 7f6c5ceb4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5810dc10 con 0x7f6c580fc550 2024-09-18T21:17:47.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.645+0000 7f6c5ceb4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5810e430 con 0x7f6c580fd820 2024-09-18T21:17:47.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.645+0000 7f6c5659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c580fc550 0x7f6c5810d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:17:47.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.645+0000 7f6c5659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c580fc550 0x7f6c5810d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34922/0 (socket says 172.21.15.77:34922) 2024-09-18T21:17:47.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.645+0000 7f6c5659c640 1 -- 172.21.15.77:0/1547290403 learned_addr learned my addr 172.21.15.77:0/1547290403 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:17:47.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.645+0000 7f6c4ffff640 1 --2- 172.21.15.77:0/1547290403 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c580fd820 0x7f6c5810d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:17:47.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.646+0000 7f6c5659c640 1 -- 172.21.15.77:0/1547290403 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c580fd820 msgr2=0x7f6c5810d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:47.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.646+0000 7f6c5659c640 1 --2- 172.21.15.77:0/1547290403 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c580fd820 0x7f6c5810d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:47.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.646+0000 7f6c5659c640 1 -- 172.21.15.77:0/1547290403 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c48005040 con 0x7f6c580fc550 2024-09-18T21:17:47.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.646+0000 7f6c5659c640 1 --2- 172.21.15.77:0/1547290403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c580fc550 0x7f6c5810d080 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6c480043d0 tx=0x7f6c48009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:17:47.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.646+0000 7f6c4effd640 1 -- 172.21.15.77:0/1547290403 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c48038070 con 0x7f6c580fc550 2024-09-18T21:17:47.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.646+0000 7f6c4effd640 1 -- 172.21.15.77:0/1547290403 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6c4802ae90 con 0x7f6c580fc550 2024-09-18T21:17:47.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.646+0000 7f6c4effd640 1 -- 172.21.15.77:0/1547290403 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c4803e670 con 0x7f6c580fc550 2024-09-18T21:17:47.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.646+0000 7f6c5ceb4640 1 -- 172.21.15.77:0/1547290403 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c5810e660 con 0x7f6c580fc550 2024-09-18T21:17:47.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.646+0000 7f6c5ceb4640 1 -- 172.21.15.77:0/1547290403 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c5810ec00 con 0x7f6c580fc550 2024-09-18T21:17:47.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.647+0000 7f6c5ceb4640 1 -- 172.21.15.77:0/1547290403 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c580fb9b0 con 0x7f6c580fc550 2024-09-18T21:17:47.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.648+0000 7f6c4effd640 1 -- 172.21.15.77:0/1547290403 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f6c48030020 con 0x7f6c580fc550 2024-09-18T21:17:47.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.649+0000 7f6c4effd640 1 --2- 172.21.15.77:0/1547290403 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f6c4406e0b0 0x7f6c44070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:17:47.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.649+0000 7f6c4effd640 1 -- 172.21.15.77:0/1547290403 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f6c480add20 con 0x7f6c580fc550 2024-09-18T21:17:47.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.649+0000 7f6c4ffff640 1 --2- 172.21.15.77:0/1547290403 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f6c4406e0b0 0x7f6c44070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:17:47.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.649+0000 7f6c4ffff640 1 --2- 172.21.15.77:0/1547290403 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f6c4406e0b0 0x7f6c44070560 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6c40007fd0 tx=0x7f6c40009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:17:47.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.653+0000 7f6c4effd640 1 -- 172.21.15.77:0/1547290403 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f6c48077170 con 0x7f6c580fc550 2024-09-18T21:17:47.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.827+0000 7f6c5ceb4640 1 -- 172.21.15.77:0/1547290403 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c5810ef80 con 0x7f6c4406e0b0 2024-09-18T21:17:47.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.836+0000 7f6c4effd640 1 -- 172.21.15.77:0/1547290403 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f6c5810ef80 con 0x7f6c4406e0b0 2024-09-18T21:17:47.837 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T21:17:47.837 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager.smithi077 smithi077 *:9093,9094 running (4m) 16s ago 12m 24.2M - 0.25.0 c8568f914cd2 b201d325a55b 2024-09-18T21:17:47.837 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi077 smithi077 running (114s) 16s ago 12m 6891k - 19.1.1-17-g06b1b1de f79f744f586d 5872fa24b792 2024-09-18T21:17:47.837 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi103 smithi103 running (109s) 106s ago 11m 6887k - 19.1.1-17-g06b1b1de f79f744f586d cd1604469f34 2024-09-18T21:17:47.838 INFO:teuthology.orchestra.run.smithi077.stdout:grafana.smithi077 smithi077 *:3000 running (4m) 16s ago 12m 83.1M - 9.4.7 954c08fa6188 d06ef3ab9e66 2024-09-18T21:17:47.838 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.cqfhlw smithi077 running (7m) 16s ago 7m 14.8M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 a7ec3b7701b6 2024-09-18T21:17:47.838 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.vruydi smithi077 running (7m) 16s ago 7m 141M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 affbba097d3b 2024-09-18T21:17:47.838 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi103.opftmf smithi103 running (7m) 106s ago 7m 16.5M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 111f884c5a34 2024-09-18T21:17:47.838 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi103.zhdmdg smithi103 running (7m) 106s ago 7m 15.6M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 50b77d0edda5 2024-09-18T21:17:47.838 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi077.utkpjg smithi077 *:8443,9283,8765 running (3m) 16s ago 13m 502M - 19.1.1-17-g06b1b1de f79f744f586d 99d4b0fd70f6 2024-09-18T21:17:47.838 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi103.zjztqc smithi103 *:8443,9283,8765 running (3m) 106s ago 11m 439M - 19.1.1-17-g06b1b1de f79f744f586d 54589547c4d7 2024-09-18T21:17:47.838 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi077 smithi077 running (2m) 16s ago 14m 45.3M 2048M 19.1.1-17-g06b1b1de f79f744f586d 2d0fbbea1264 2024-09-18T21:17:47.838 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi103 smithi103 running (2m) 106s ago 11m 34.6M 2048M 19.1.1-17-g06b1b1de f79f744f586d dc79edbd9602 2024-09-18T21:17:47.838 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi077 smithi077 *:9100 running (4m) 16s ago 12m 14.8M - 1.5.0 0da6a335fe13 99144245c1af 2024-09-18T21:17:47.838 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi103 smithi103 *:9100 running (4m) 106s ago 11m 16.5M - 1.5.0 0da6a335fe13 e5b51144d997 2024-09-18T21:17:47.838 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (90s) 16s ago 10m 89.4M 1557M 19.1.1-17-g06b1b1de f79f744f586d 8855b4b16e00 2024-09-18T21:17:47.838 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi077 running (55s) 16s ago 10m 98.9M 1557M 19.1.1-17-g06b1b1de f79f744f586d 2d8bc9cac96c 2024-09-18T21:17:47.839 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi077 running (21s) 16s ago 10m 11.9M 1557M 19.1.1-17-g06b1b1de f79f744f586d 93876f1d398d 2024-09-18T21:17:47.839 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi103 running (9m) 106s ago 9m 275M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 0e72b1bbb8ce 2024-09-18T21:17:47.839 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi103 running (9m) 106s ago 9m 244M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 85f1ce1e8bee 2024-09-18T21:17:47.839 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi103 running (8m) 106s ago 8m 228M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 cf8964b3ac6d 2024-09-18T21:17:47.839 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus.smithi077 smithi077 *:9095 running (3m) 16s ago 12m 58.5M - 2.43.0 a07b618ecd1d 41f3729e3400 2024-09-18T21:17:47.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.838+0000 7f6c5ceb4640 1 -- 172.21.15.77:0/1547290403 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f6c4406e0b0 msgr2=0x7f6c44070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:47.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.838+0000 7f6c5ceb4640 1 --2- 172.21.15.77:0/1547290403 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f6c4406e0b0 0x7f6c44070560 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6c40007fd0 tx=0x7f6c40009e90 comp rx=0 tx=0).stop 2024-09-18T21:17:47.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.838+0000 7f6c5ceb4640 1 -- 172.21.15.77:0/1547290403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c580fc550 msgr2=0x7f6c5810d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:47.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.838+0000 7f6c5ceb4640 1 --2- 172.21.15.77:0/1547290403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c580fc550 0x7f6c5810d080 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6c480043d0 tx=0x7f6c48009da0 comp rx=0 tx=0).stop 2024-09-18T21:17:47.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.838+0000 7f6c5ceb4640 1 -- 172.21.15.77:0/1547290403 shutdown_connections 2024-09-18T21:17:47.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.839+0000 7f6c5ceb4640 1 --2- 172.21.15.77:0/1547290403 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f6c4406e0b0 0x7f6c44070560 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:47.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.839+0000 7f6c5ceb4640 1 --2- 172.21.15.77:0/1547290403 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c580fd820 0x7f6c5810d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:47.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.839+0000 7f6c5ceb4640 1 --2- 172.21.15.77:0/1547290403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c580fc550 0x7f6c5810d080 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:47.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.839+0000 7f6c5ceb4640 1 -- 172.21.15.77:0/1547290403 >> 172.21.15.77:0/1547290403 conn(0x7f6c580f7d30 msgr2=0x7f6c580f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:17:47.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.839+0000 7f6c5ceb4640 1 -- 172.21.15.77:0/1547290403 shutdown_connections 2024-09-18T21:17:47.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.839+0000 7f6c5ceb4640 1 -- 172.21.15.77:0/1547290403 wait complete. 2024-09-18T21:17:47.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.916+0000 7fd0a0ae7640 1 -- 172.21.15.77:0/2182613206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd09c0666b0 msgr2=0x7fd09c0ff1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:47.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.916+0000 7fd0a0ae7640 1 --2- 172.21.15.77:0/2182613206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd09c0666b0 0x7fd09c0ff1e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd08c0048d0 tx=0x7fd08c009da0 comp rx=0 tx=0).stop 2024-09-18T21:17:47.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.916+0000 7fd0a0ae7640 1 -- 172.21.15.77:0/2182613206 shutdown_connections 2024-09-18T21:17:47.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.916+0000 7fd0a0ae7640 1 --2- 172.21.15.77:0/2182613206 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd09c0ff720 0x7fd09c101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:47.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.916+0000 7fd0a0ae7640 1 --2- 172.21.15.77:0/2182613206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd09c0666b0 0x7fd09c0ff1e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:47.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.916+0000 7fd0a0ae7640 1 -- 172.21.15.77:0/2182613206 >> 172.21.15.77:0/2182613206 conn(0x7fd09c0f6c10 msgr2=0x7fd09c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:17:47.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.916+0000 7fd0a0ae7640 1 -- 172.21.15.77:0/2182613206 shutdown_connections 2024-09-18T21:17:47.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.916+0000 7fd0a0ae7640 1 -- 172.21.15.77:0/2182613206 wait complete. 2024-09-18T21:17:47.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.916+0000 7fd0a0ae7640 1 Processor -- start 2024-09-18T21:17:47.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.917+0000 7fd0a0ae7640 1 -- start start 2024-09-18T21:17:47.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.917+0000 7fd0a0ae7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd09c0666b0 0x7fd09c0fcba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:17:47.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.917+0000 7fd0a0ae7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd09c0ff720 0x7fd09c0fb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:17:47.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.917+0000 7fd0a0ae7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c0fb6b0 con 0x7fd09c0666b0 2024-09-18T21:17:47.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.917+0000 7fd0a0ae7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c0fb7f0 con 0x7fd09c0ff720 2024-09-18T21:17:47.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.917+0000 7fd09a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd09c0666b0 0x7fd09c0fcba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:17:47.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.917+0000 7fd09a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd09c0666b0 0x7fd09c0fcba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34952/0 (socket says 172.21.15.77:34952) 2024-09-18T21:17:47.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.917+0000 7fd09a59c640 1 -- 172.21.15.77:0/2773747515 learned_addr learned my addr 172.21.15.77:0/2773747515 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:17:47.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.917+0000 7fd093fff640 1 --2- 172.21.15.77:0/2773747515 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd09c0ff720 0x7fd09c0fb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:17:47.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.917+0000 7fd09a59c640 1 -- 172.21.15.77:0/2773747515 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd09c0ff720 msgr2=0x7fd09c0fb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:47.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.917+0000 7fd09a59c640 1 --2- 172.21.15.77:0/2773747515 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd09c0ff720 0x7fd09c0fb0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:47.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.917+0000 7fd09a59c640 1 -- 172.21.15.77:0/2773747515 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd08c005040 con 0x7fd09c0666b0 2024-09-18T21:17:47.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.917+0000 7fd093fff640 1 --2- 172.21.15.77:0/2773747515 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd09c0ff720 0x7fd09c0fb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T21:17:47.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.917+0000 7fd09a59c640 1 --2- 172.21.15.77:0/2773747515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd09c0666b0 0x7fd09c0fcba0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd08c0048a0 tx=0x7fd08c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:17:47.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.917+0000 7fd092ffd640 1 -- 172.21.15.77:0/2773747515 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd08c038070 con 0x7fd09c0666b0 2024-09-18T21:17:47.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.918+0000 7fd0a0ae7640 1 -- 172.21.15.77:0/2773747515 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd09c0fba70 con 0x7fd09c0666b0 2024-09-18T21:17:47.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.918+0000 7fd092ffd640 1 -- 172.21.15.77:0/2773747515 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd08c02abd0 con 0x7fd09c0666b0 2024-09-18T21:17:47.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.918+0000 7fd092ffd640 1 -- 172.21.15.77:0/2773747515 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd08c033640 con 0x7fd09c0666b0 2024-09-18T21:17:47.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.918+0000 7fd0a0ae7640 1 -- 172.21.15.77:0/2773747515 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd09c115200 con 0x7fd09c0666b0 2024-09-18T21:17:47.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.919+0000 7fd0a0ae7640 1 -- 172.21.15.77:0/2773747515 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd09c0fa8b0 con 0x7fd09c0666b0 2024-09-18T21:17:47.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.919+0000 7fd092ffd640 1 -- 172.21.15.77:0/2773747515 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd08c030020 con 0x7fd09c0666b0 2024-09-18T21:17:47.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.920+0000 7fd092ffd640 1 --2- 172.21.15.77:0/2773747515 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fd08806e0b0 0x7fd088070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:17:47.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.920+0000 7fd092ffd640 1 -- 172.21.15.77:0/2773747515 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fd08c0adea0 con 0x7fd09c0666b0 2024-09-18T21:17:47.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.920+0000 7fd093fff640 1 --2- 172.21.15.77:0/2773747515 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fd08806e0b0 0x7fd088070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:17:47.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.920+0000 7fd093fff640 1 --2- 172.21.15.77:0/2773747515 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fd08806e0b0 0x7fd088070560 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd084006fd0 tx=0x7fd084008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:17:47.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:47.925+0000 7fd092ffd640 1 -- 172.21.15.77:0/2773747515 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fd08c077270 con 0x7fd09c0666b0 2024-09-18T21:17:48.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.156+0000 7fd0a0ae7640 1 -- 172.21.15.77:0/2773747515 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd09c115450 con 0x7fd09c0666b0 2024-09-18T21:17:48.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.157+0000 7fd092ffd640 1 -- 172.21.15.77:0/2773747515 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7fd08c07a930 con 0x7fd09c0666b0 2024-09-18T21:17:48.158 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-18T21:17:48.158 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": { 2024-09-18T21:17:48.158 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 2 2024-09-18T21:17:48.158 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:17:48.158 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": { 2024-09-18T21:17:48.158 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 2 2024-09-18T21:17:48.158 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:17:48.158 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": { 2024-09-18T21:17:48.158 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 3, 2024-09-18T21:17:48.159 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 3 2024-09-18T21:17:48.159 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:17:48.159 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-09-18T21:17:48.159 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4 2024-09-18T21:17:48.159 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:17:48.159 INFO:teuthology.orchestra.run.smithi077.stdout: "overall": { 2024-09-18T21:17:48.159 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 7, 2024-09-18T21:17:48.159 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 7 2024-09-18T21:17:48.159 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-18T21:17:48.159 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-18T21:17:48.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.159+0000 7fd0a0ae7640 1 -- 172.21.15.77:0/2773747515 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fd08806e0b0 msgr2=0x7fd088070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:48.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.159+0000 7fd0a0ae7640 1 --2- 172.21.15.77:0/2773747515 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fd08806e0b0 0x7fd088070560 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd084006fd0 tx=0x7fd084008040 comp rx=0 tx=0).stop 2024-09-18T21:17:48.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.159+0000 7fd0a0ae7640 1 -- 172.21.15.77:0/2773747515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd09c0666b0 msgr2=0x7fd09c0fcba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:48.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.159+0000 7fd0a0ae7640 1 --2- 172.21.15.77:0/2773747515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd09c0666b0 0x7fd09c0fcba0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd08c0048a0 tx=0x7fd08c009da0 comp rx=0 tx=0).stop 2024-09-18T21:17:48.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.159+0000 7fd0a0ae7640 1 -- 172.21.15.77:0/2773747515 shutdown_connections 2024-09-18T21:17:48.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.159+0000 7fd0a0ae7640 1 --2- 172.21.15.77:0/2773747515 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fd08806e0b0 0x7fd088070560 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:48.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.159+0000 7fd0a0ae7640 1 --2- 172.21.15.77:0/2773747515 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd09c0ff720 0x7fd09c0fb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:48.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.159+0000 7fd0a0ae7640 1 --2- 172.21.15.77:0/2773747515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd09c0666b0 0x7fd09c0fcba0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:48.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.159+0000 7fd0a0ae7640 1 -- 172.21.15.77:0/2773747515 >> 172.21.15.77:0/2773747515 conn(0x7fd09c0f6c10 msgr2=0x7fd09c0f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:17:48.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.159+0000 7fd0a0ae7640 1 -- 172.21.15.77:0/2773747515 shutdown_connections 2024-09-18T21:17:48.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.159+0000 7fd0a0ae7640 1 -- 172.21.15.77:0/2773747515 wait complete. 2024-09-18T21:17:48.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.239+0000 7f89ce78b640 1 -- 172.21.15.77:0/344470844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89c80fc700 msgr2=0x7f89c80fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:48.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.239+0000 7f89ce78b640 1 --2- 172.21.15.77:0/344470844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89c80fc700 0x7f89c80fcb70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f89b00048d0 tx=0x7f89b0009da0 comp rx=0 tx=0).stop 2024-09-18T21:17:48.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.239+0000 7f89ce78b640 1 -- 172.21.15.77:0/344470844 shutdown_connections 2024-09-18T21:17:48.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.239+0000 7f89ce78b640 1 --2- 172.21.15.77:0/344470844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89c80fc700 0x7f89c80fcb70 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:48.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.239+0000 7f89ce78b640 1 --2- 172.21.15.77:0/344470844 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89c80fb430 0x7f89c80fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:48.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.239+0000 7f89ce78b640 1 -- 172.21.15.77:0/344470844 >> 172.21.15.77:0/344470844 conn(0x7f89c80f6c10 msgr2=0x7f89c80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:17:48.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.239+0000 7f89ce78b640 1 -- 172.21.15.77:0/344470844 shutdown_connections 2024-09-18T21:17:48.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.240+0000 7f89ce78b640 1 -- 172.21.15.77:0/344470844 wait complete. 2024-09-18T21:17:48.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.240+0000 7f89ce78b640 1 Processor -- start 2024-09-18T21:17:48.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.240+0000 7f89ce78b640 1 -- start start 2024-09-18T21:17:48.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.240+0000 7f89ce78b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89c80fb430 0x7f89c80ff500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:17:48.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.240+0000 7f89ce78b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89c80fc700 0x7f89c80fda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:17:48.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.240+0000 7f89ce78b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c80fdf80 con 0x7f89c80fb430 2024-09-18T21:17:48.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.240+0000 7f89ce78b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c80fe0c0 con 0x7f89c80fc700 2024-09-18T21:17:48.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.240+0000 7f89c7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89c80fb430 0x7f89c80ff500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:17:48.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.240+0000 7f89c7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89c80fb430 0x7f89c80ff500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34968/0 (socket says 172.21.15.77:34968) 2024-09-18T21:17:48.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.240+0000 7f89c7fff640 1 -- 172.21.15.77:0/1098141123 learned_addr learned my addr 172.21.15.77:0/1098141123 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:17:48.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.241+0000 7f89c77fe640 1 --2- 172.21.15.77:0/1098141123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89c80fc700 0x7f89c80fda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:17:48.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.241+0000 7f89c7fff640 1 -- 172.21.15.77:0/1098141123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89c80fc700 msgr2=0x7f89c80fda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:48.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.241+0000 7f89c7fff640 1 --2- 172.21.15.77:0/1098141123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89c80fc700 0x7f89c80fda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:48.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.241+0000 7f89c7fff640 1 -- 172.21.15.77:0/1098141123 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b0005040 con 0x7f89c80fb430 2024-09-18T21:17:48.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.241+0000 7f89c7fff640 1 --2- 172.21.15.77:0/1098141123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89c80fb430 0x7f89c80ff500 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f89b8002a80 tx=0x7f89b8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:17:48.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.241+0000 7f89c4ff9640 1 -- 172.21.15.77:0/1098141123 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89b8007c30 con 0x7f89c80fb430 2024-09-18T21:17:48.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.241+0000 7f89c4ff9640 1 -- 172.21.15.77:0/1098141123 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f89b800f040 con 0x7f89c80fb430 2024-09-18T21:17:48.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.241+0000 7f89ce78b640 1 -- 172.21.15.77:0/1098141123 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89c80fe3a0 con 0x7f89c80fb430 2024-09-18T21:17:48.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.241+0000 7f89c4ff9640 1 -- 172.21.15.77:0/1098141123 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89b8009530 con 0x7f89c80fb430 2024-09-18T21:17:48.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.241+0000 7f89ce78b640 1 -- 172.21.15.77:0/1098141123 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89c80fe8c0 con 0x7f89c80fb430 2024-09-18T21:17:48.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.242+0000 7f89ce78b640 1 -- 172.21.15.77:0/1098141123 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89c80fa890 con 0x7f89c80fb430 2024-09-18T21:17:48.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.242+0000 7f89c4ff9640 1 -- 172.21.15.77:0/1098141123 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f89b8009690 con 0x7f89c80fb430 2024-09-18T21:17:48.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.243+0000 7f89c4ff9640 1 --2- 172.21.15.77:0/1098141123 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f89b406e0b0 0x7f89b4070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:17:48.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.243+0000 7f89c77fe640 1 --2- 172.21.15.77:0/1098141123 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f89b406e0b0 0x7f89b4070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:17:48.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.243+0000 7f89c4ff9640 1 -- 172.21.15.77:0/1098141123 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f89b808d410 con 0x7f89c80fb430 2024-09-18T21:17:48.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.244+0000 7f89c77fe640 1 --2- 172.21.15.77:0/1098141123 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f89b406e0b0 0x7f89b4070560 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f89b0007ac0 tx=0x7f89b0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:17:48.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.248+0000 7f89c4ff9640 1 -- 172.21.15.77:0/1098141123 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f89b8056860 con 0x7f89c80fb430 2024-09-18T21:17:48.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.446+0000 7f89ce78b640 1 -- 172.21.15.77:0/1098141123 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f89c802aa40 con 0x7f89c80fb430 2024-09-18T21:17:48.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.447+0000 7f89c4ff9640 1 -- 172.21.15.77:0/1098141123 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1915 (secure 0 0 0) 0x7f89b8059f20 con 0x7f89c80fb430 2024-09-18T21:17:48.448 INFO:teuthology.orchestra.run.smithi077.stdout:e13 2024-09-18T21:17:48.448 INFO:teuthology.orchestra.run.smithi077.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-18T21:17:48.448 INFO:teuthology.orchestra.run.smithi077.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T21:17:48.448 INFO:teuthology.orchestra.run.smithi077.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T21:17:48.448 INFO:teuthology.orchestra.run.smithi077.stdout:legacy client fscid: 1 2024-09-18T21:17:48.448 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:17:48.448 INFO:teuthology.orchestra.run.smithi077.stdout:Filesystem 'cephfs' (1) 2024-09-18T21:17:48.449 INFO:teuthology.orchestra.run.smithi077.stdout:fs_name cephfs 2024-09-18T21:17:48.449 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 13 2024-09-18T21:17:48.449 INFO:teuthology.orchestra.run.smithi077.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T21:17:48.449 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-09-18T21:10:17.230179+0000 2024-09-18T21:17:48.449 INFO:teuthology.orchestra.run.smithi077.stdout:modified 2024-09-18T21:10:33.373241+0000 2024-09-18T21:17:48.449 INFO:teuthology.orchestra.run.smithi077.stdout:tableserver 0 2024-09-18T21:17:48.449 INFO:teuthology.orchestra.run.smithi077.stdout:root 0 2024-09-18T21:17:48.449 INFO:teuthology.orchestra.run.smithi077.stdout:session_timeout 60 2024-09-18T21:17:48.449 INFO:teuthology.orchestra.run.smithi077.stdout:session_autoclose 300 2024-09-18T21:17:48.449 INFO:teuthology.orchestra.run.smithi077.stdout:max_file_size 1099511627776 2024-09-18T21:17:48.449 INFO:teuthology.orchestra.run.smithi077.stdout:max_xattr_size 65536 2024-09-18T21:17:48.449 INFO:teuthology.orchestra.run.smithi077.stdout:required_client_features {} 2024-09-18T21:17:48.449 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure 0 2024-09-18T21:17:48.450 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure_osd_epoch 0 2024-09-18T21:17:48.450 INFO:teuthology.orchestra.run.smithi077.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T21:17:48.450 INFO:teuthology.orchestra.run.smithi077.stdout:max_mds 1 2024-09-18T21:17:48.450 INFO:teuthology.orchestra.run.smithi077.stdout:in 0 2024-09-18T21:17:48.450 INFO:teuthology.orchestra.run.smithi077.stdout:up {0=14446} 2024-09-18T21:17:48.450 INFO:teuthology.orchestra.run.smithi077.stdout:failed 2024-09-18T21:17:48.450 INFO:teuthology.orchestra.run.smithi077.stdout:damaged 2024-09-18T21:17:48.450 INFO:teuthology.orchestra.run.smithi077.stdout:stopped 2024-09-18T21:17:48.450 INFO:teuthology.orchestra.run.smithi077.stdout:data_pools [3] 2024-09-18T21:17:48.450 INFO:teuthology.orchestra.run.smithi077.stdout:metadata_pool 2 2024-09-18T21:17:48.450 INFO:teuthology.orchestra.run.smithi077.stdout:inline_data disabled 2024-09-18T21:17:48.450 INFO:teuthology.orchestra.run.smithi077.stdout:balancer 2024-09-18T21:17:48.450 INFO:teuthology.orchestra.run.smithi077.stdout:bal_rank_mask -1 2024-09-18T21:17:48.451 INFO:teuthology.orchestra.run.smithi077.stdout:standby_count_wanted 1 2024-09-18T21:17:48.451 INFO:teuthology.orchestra.run.smithi077.stdout:qdb_cluster leader: 0 members: 2024-09-18T21:17:48.451 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.vruydi{0:14446} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.77:6826/334039954,v1:172.21.15.77:6827/334039954] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:17:48.451 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:17:48.451 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:17:48.451 INFO:teuthology.orchestra.run.smithi077.stdout:Standby daemons: 2024-09-18T21:17:48.451 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:17:48.451 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.cqfhlw{-1:14458} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.77:6828/862540650,v1:172.21.15.77:6829/862540650] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:17:48.451 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi103.zhdmdg{-1:24255} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.103:6824/2170237078,v1:172.21.15.103:6825/2170237078] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:17:48.451 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi103.opftmf{-1:24267} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.103:6826/4241818403,v1:172.21.15.103:6827/4241818403] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:17:48.452 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 13 2024-09-18T21:17:48.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.449+0000 7f89ce78b640 1 -- 172.21.15.77:0/1098141123 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f89b406e0b0 msgr2=0x7f89b4070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:48.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.449+0000 7f89ce78b640 1 --2- 172.21.15.77:0/1098141123 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f89b406e0b0 0x7f89b4070560 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f89b0007ac0 tx=0x7f89b0035040 comp rx=0 tx=0).stop 2024-09-18T21:17:48.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.449+0000 7f89ce78b640 1 -- 172.21.15.77:0/1098141123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89c80fb430 msgr2=0x7f89c80ff500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:48.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.449+0000 7f89ce78b640 1 --2- 172.21.15.77:0/1098141123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89c80fb430 0x7f89c80ff500 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f89b8002a80 tx=0x7f89b8004600 comp rx=0 tx=0).stop 2024-09-18T21:17:48.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.449+0000 7f89ce78b640 1 -- 172.21.15.77:0/1098141123 shutdown_connections 2024-09-18T21:17:48.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.449+0000 7f89ce78b640 1 --2- 172.21.15.77:0/1098141123 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f89b406e0b0 0x7f89b4070560 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:48.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.449+0000 7f89ce78b640 1 --2- 172.21.15.77:0/1098141123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89c80fc700 0x7f89c80fda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:48.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.449+0000 7f89ce78b640 1 --2- 172.21.15.77:0/1098141123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89c80fb430 0x7f89c80ff500 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:48.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.449+0000 7f89ce78b640 1 -- 172.21.15.77:0/1098141123 >> 172.21.15.77:0/1098141123 conn(0x7f89c80f6c10 msgr2=0x7f89c8065600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:17:48.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.449+0000 7f89ce78b640 1 -- 172.21.15.77:0/1098141123 shutdown_connections 2024-09-18T21:17:48.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.449+0000 7f89ce78b640 1 -- 172.21.15.77:0/1098141123 wait complete. 2024-09-18T21:17:48.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.529+0000 7ff02a302640 1 -- 172.21.15.77:0/4096345544 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff024065c40 msgr2=0x7ff0240ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:48.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.529+0000 7ff02a302640 1 --2- 172.21.15.77:0/4096345544 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff024065c40 0x7ff0240ff140 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff0140048d0 tx=0x7ff014009da0 comp rx=0 tx=0).stop 2024-09-18T21:17:48.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.529+0000 7ff02a302640 1 -- 172.21.15.77:0/4096345544 shutdown_connections 2024-09-18T21:17:48.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.529+0000 7ff02a302640 1 --2- 172.21.15.77:0/4096345544 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0240ff680 0x7ff024101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:48.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.529+0000 7ff02a302640 1 --2- 172.21.15.77:0/4096345544 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff024065c40 0x7ff0240ff140 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:48.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.529+0000 7ff02a302640 1 -- 172.21.15.77:0/4096345544 >> 172.21.15.77:0/4096345544 conn(0x7ff0240f6c10 msgr2=0x7ff0240f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:17:48.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.530+0000 7ff02a302640 1 -- 172.21.15.77:0/4096345544 shutdown_connections 2024-09-18T21:17:48.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.530+0000 7ff02a302640 1 -- 172.21.15.77:0/4096345544 wait complete. 2024-09-18T21:17:48.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.530+0000 7ff02a302640 1 Processor -- start 2024-09-18T21:17:48.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.530+0000 7ff02a302640 1 -- start start 2024-09-18T21:17:48.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.530+0000 7ff02a302640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff024065c40 0x7ff0240fcb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:17:48.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.531+0000 7ff02a302640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0240ff680 0x7ff0240fb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:17:48.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.531+0000 7ff02a302640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0240fb580 con 0x7ff0240ff680 2024-09-18T21:17:48.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.531+0000 7ff02a302640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0240fb6c0 con 0x7ff024065c40 2024-09-18T21:17:48.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.531+0000 7ff0237fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0240ff680 0x7ff0240fb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:17:48.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.531+0000 7ff0237fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0240ff680 0x7ff0240fb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34972/0 (socket says 172.21.15.77:34972) 2024-09-18T21:17:48.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.531+0000 7ff0237fe640 1 -- 172.21.15.77:0/707580170 learned_addr learned my addr 172.21.15.77:0/707580170 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:17:48.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.531+0000 7ff023fff640 1 --2- 172.21.15.77:0/707580170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff024065c40 0x7ff0240fcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:17:48.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.531+0000 7ff0237fe640 1 -- 172.21.15.77:0/707580170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff024065c40 msgr2=0x7ff0240fcb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:48.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.531+0000 7ff0237fe640 1 --2- 172.21.15.77:0/707580170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff024065c40 0x7ff0240fcb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:48.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.531+0000 7ff0237fe640 1 -- 172.21.15.77:0/707580170 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff014005040 con 0x7ff0240ff680 2024-09-18T21:17:48.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.531+0000 7ff0237fe640 1 --2- 172.21.15.77:0/707580170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0240ff680 0x7ff0240fb040 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff018002a50 tx=0x7ff018004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:17:48.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.531+0000 7ff020ff9640 1 -- 172.21.15.77:0/707580170 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff018007c30 con 0x7ff0240ff680 2024-09-18T21:17:48.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.531+0000 7ff02a302640 1 -- 172.21.15.77:0/707580170 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0240fb9a0 con 0x7ff0240ff680 2024-09-18T21:17:48.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.531+0000 7ff020ff9640 1 -- 172.21.15.77:0/707580170 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff01800f040 con 0x7ff0240ff680 2024-09-18T21:17:48.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.531+0000 7ff020ff9640 1 -- 172.21.15.77:0/707580170 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff01800dad0 con 0x7ff0240ff680 2024-09-18T21:17:48.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.531+0000 7ff02a302640 1 -- 172.21.15.77:0/707580170 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff024115140 con 0x7ff0240ff680 2024-09-18T21:17:48.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.533+0000 7ff02a302640 1 -- 172.21.15.77:0/707580170 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0240fa890 con 0x7ff0240ff680 2024-09-18T21:17:48.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.533+0000 7ff020ff9640 1 -- 172.21.15.77:0/707580170 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff01800dc30 con 0x7ff0240ff680 2024-09-18T21:17:48.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.534+0000 7ff020ff9640 1 --2- 172.21.15.77:0/707580170 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7ff00c06e0b0 0x7ff00c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:17:48.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.534+0000 7ff020ff9640 1 -- 172.21.15.77:0/707580170 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6324+0+0 (secure 0 0 0) 0x7ff01808d990 con 0x7ff0240ff680 2024-09-18T21:17:48.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.534+0000 7ff023fff640 1 --2- 172.21.15.77:0/707580170 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7ff00c06e0b0 0x7ff00c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:17:48.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.534+0000 7ff023fff640 1 --2- 172.21.15.77:0/707580170 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7ff00c06e0b0 0x7ff00c070560 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff0240fc8b0 tx=0x7ff014035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:17:48.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.538+0000 7ff020ff9640 1 -- 172.21.15.77:0/707580170 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7ff018056d60 con 0x7ff0240ff680 2024-09-18T21:17:48.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.719+0000 7ff02a302640 1 -- 172.21.15.77:0/707580170 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff0240f8700 con 0x7ff00c06e0b0 2024-09-18T21:17:48.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.721+0000 7ff020ff9640 1 -- 172.21.15.77:0/707580170 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7ff0240f8700 con 0x7ff00c06e0b0 2024-09-18T21:17:48.722 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-18T21:17:48.722 INFO:teuthology.orchestra.run.smithi077.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a", 2024-09-18T21:17:48.722 INFO:teuthology.orchestra.run.smithi077.stdout: "in_progress": true, 2024-09-18T21:17:48.722 INFO:teuthology.orchestra.run.smithi077.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T21:17:48.722 INFO:teuthology.orchestra.run.smithi077.stdout: "services_complete": [ 2024-09-18T21:17:48.722 INFO:teuthology.orchestra.run.smithi077.stdout: "mon", 2024-09-18T21:17:48.722 INFO:teuthology.orchestra.run.smithi077.stdout: "crash", 2024-09-18T21:17:48.722 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr" 2024-09-18T21:17:48.722 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-18T21:17:48.722 INFO:teuthology.orchestra.run.smithi077.stdout: "progress": "9/21 daemons upgraded", 2024-09-18T21:17:48.722 INFO:teuthology.orchestra.run.smithi077.stdout: "message": "Currently upgrading osd daemons", 2024-09-18T21:17:48.722 INFO:teuthology.orchestra.run.smithi077.stdout: "is_paused": false 2024-09-18T21:17:48.722 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-18T21:17:48.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.723+0000 7ff02a302640 1 -- 172.21.15.77:0/707580170 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7ff00c06e0b0 msgr2=0x7ff00c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:48.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.723+0000 7ff02a302640 1 --2- 172.21.15.77:0/707580170 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7ff00c06e0b0 0x7ff00c070560 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff0240fc8b0 tx=0x7ff014035040 comp rx=0 tx=0).stop 2024-09-18T21:17:48.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.723+0000 7ff02a302640 1 -- 172.21.15.77:0/707580170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0240ff680 msgr2=0x7ff0240fb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:48.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.723+0000 7ff02a302640 1 --2- 172.21.15.77:0/707580170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0240ff680 0x7ff0240fb040 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff018002a50 tx=0x7ff018004600 comp rx=0 tx=0).stop 2024-09-18T21:17:48.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.723+0000 7ff02a302640 1 -- 172.21.15.77:0/707580170 shutdown_connections 2024-09-18T21:17:48.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.723+0000 7ff02a302640 1 --2- 172.21.15.77:0/707580170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0240ff680 0x7ff0240fb040 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:48.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.723+0000 7ff02a302640 1 --2- 172.21.15.77:0/707580170 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7ff00c06e0b0 0x7ff00c070560 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:48.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.723+0000 7ff02a302640 1 --2- 172.21.15.77:0/707580170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff024065c40 0x7ff0240fcb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:48.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.723+0000 7ff02a302640 1 -- 172.21.15.77:0/707580170 >> 172.21.15.77:0/707580170 conn(0x7ff0240f6c10 msgr2=0x7ff0240f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:17:48.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.723+0000 7ff02a302640 1 -- 172.21.15.77:0/707580170 shutdown_connections 2024-09-18T21:17:48.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.723+0000 7ff02a302640 1 -- 172.21.15.77:0/707580170 wait complete. 2024-09-18T21:17:48.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.801+0000 7fa43ed91640 1 -- 172.21.15.77:0/1109521127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4380fdb70 msgr2=0x7fa4380fdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:48.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.801+0000 7fa43ed91640 1 --2- 172.21.15.77:0/1109521127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4380fdb70 0x7fa4380fdf80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa42c0048d0 tx=0x7fa42c009da0 comp rx=0 tx=0).stop 2024-09-18T21:17:48.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.801+0000 7fa43ed91640 1 -- 172.21.15.77:0/1109521127 shutdown_connections 2024-09-18T21:17:48.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.801+0000 7fa43ed91640 1 --2- 172.21.15.77:0/1109521127 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4380fe4c0 0x7fa4380fa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:48.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.801+0000 7fa43ed91640 1 --2- 172.21.15.77:0/1109521127 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4380fdb70 0x7fa4380fdf80 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:48.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.801+0000 7fa43ed91640 1 -- 172.21.15.77:0/1109521127 >> 172.21.15.77:0/1109521127 conn(0x7fa4380f6390 msgr2=0x7fa4380f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:17:48.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.801+0000 7fa43ed91640 1 -- 172.21.15.77:0/1109521127 shutdown_connections 2024-09-18T21:17:48.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.801+0000 7fa43ed91640 1 -- 172.21.15.77:0/1109521127 wait complete. 2024-09-18T21:17:48.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.801+0000 7fa43ed91640 1 Processor -- start 2024-09-18T21:17:48.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.801+0000 7fa43ed91640 1 -- start start 2024-09-18T21:17:48.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.802+0000 7fa43ed91640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4380fdb70 0x7fa43810d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:17:48.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.802+0000 7fa43ed91640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4380fe4c0 0x7fa43810d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:17:48.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.802+0000 7fa43ed91640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43810dc00 con 0x7fa4380fe4c0 2024-09-18T21:17:48.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.802+0000 7fa43ed91640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43810e420 con 0x7fa4380fdb70 2024-09-18T21:17:48.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.802+0000 7fa437fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4380fe4c0 0x7fa43810d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:17:48.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.802+0000 7fa437fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4380fe4c0 0x7fa43810d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34986/0 (socket says 172.21.15.77:34986) 2024-09-18T21:17:48.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.802+0000 7fa437fff640 1 -- 172.21.15.77:0/2347152735 learned_addr learned my addr 172.21.15.77:0/2347152735 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:17:48.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.802+0000 7fa43cb2d640 1 --2- 172.21.15.77:0/2347152735 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4380fdb70 0x7fa43810d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:17:48.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.802+0000 7fa437fff640 1 -- 172.21.15.77:0/2347152735 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4380fdb70 msgr2=0x7fa43810d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:48.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.802+0000 7fa437fff640 1 --2- 172.21.15.77:0/2347152735 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4380fdb70 0x7fa43810d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:48.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.802+0000 7fa437fff640 1 -- 172.21.15.77:0/2347152735 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa42c005040 con 0x7fa4380fe4c0 2024-09-18T21:17:48.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.802+0000 7fa437fff640 1 --2- 172.21.15.77:0/2347152735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4380fe4c0 0x7fa43810d5b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa42400c7e0 tx=0x7fa4240043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:17:48.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.802+0000 7fa4357fa640 1 -- 172.21.15.77:0/2347152735 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa42400a7a0 con 0x7fa4380fe4c0 2024-09-18T21:17:48.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.802+0000 7fa43ed91640 1 -- 172.21.15.77:0/2347152735 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa43810e6b0 con 0x7fa4380fe4c0 2024-09-18T21:17:48.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.802+0000 7fa4357fa640 1 -- 172.21.15.77:0/2347152735 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa42400ada0 con 0x7fa4380fe4c0 2024-09-18T21:17:48.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.802+0000 7fa4357fa640 1 -- 172.21.15.77:0/2347152735 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4240113a0 con 0x7fa4380fe4c0 2024-09-18T21:17:48.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.803+0000 7fa43ed91640 1 -- 172.21.15.77:0/2347152735 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa43810ec50 con 0x7fa4380fe4c0 2024-09-18T21:17:48.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.804+0000 7fa43ed91640 1 -- 172.21.15.77:0/2347152735 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4380fa010 con 0x7fa4380fe4c0 2024-09-18T21:17:48.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.804+0000 7fa4357fa640 1 -- 172.21.15.77:0/2347152735 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fa424012400 con 0x7fa4380fe4c0 2024-09-18T21:17:48.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.805+0000 7fa4357fa640 1 --2- 172.21.15.77:0/2347152735 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fa42806e0b0 0x7fa428070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:17:48.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.805+0000 7fa43cb2d640 1 --2- 172.21.15.77:0/2347152735 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fa42806e0b0 0x7fa428070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:17:48.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.805+0000 7fa4357fa640 1 -- 172.21.15.77:0/2347152735 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fa42408dc60 con 0x7fa4380fe4c0 2024-09-18T21:17:48.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.805+0000 7fa43cb2d640 1 --2- 172.21.15.77:0/2347152735 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fa42806e0b0 0x7fa428070560 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa42c007ac0 tx=0x7fa42c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:17:48.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:48.809+0000 7fa4357fa640 1 -- 172.21.15.77:0/2347152735 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fa4240570b0 con 0x7fa4380fe4c0 2024-09-18T21:17:49.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:49.040+0000 7fa43ed91640 1 -- 172.21.15.77:0/2347152735 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa43804b720 con 0x7fa4380fe4c0 2024-09-18T21:17:49.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:49.041+0000 7fa4357fa640 1 -- 172.21.15.77:0/2347152735 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fa42405a770 con 0x7fa4380fe4c0 2024-09-18T21:17:49.042 INFO:teuthology.orchestra.run.smithi077.stdout:HEALTH_OK 2024-09-18T21:17:49.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:49.043+0000 7fa43ed91640 1 -- 172.21.15.77:0/2347152735 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fa42806e0b0 msgr2=0x7fa428070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:49.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:49.043+0000 7fa43ed91640 1 --2- 172.21.15.77:0/2347152735 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fa42806e0b0 0x7fa428070560 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa42c007ac0 tx=0x7fa42c035040 comp rx=0 tx=0).stop 2024-09-18T21:17:49.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:49.043+0000 7fa43ed91640 1 -- 172.21.15.77:0/2347152735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4380fe4c0 msgr2=0x7fa43810d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:17:49.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:49.043+0000 7fa43ed91640 1 --2- 172.21.15.77:0/2347152735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4380fe4c0 0x7fa43810d5b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa42400c7e0 tx=0x7fa4240043c0 comp rx=0 tx=0).stop 2024-09-18T21:17:49.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:49.043+0000 7fa43ed91640 1 -- 172.21.15.77:0/2347152735 shutdown_connections 2024-09-18T21:17:49.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:49.043+0000 7fa43ed91640 1 --2- 172.21.15.77:0/2347152735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4380fe4c0 0x7fa43810d5b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:49.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:49.043+0000 7fa43ed91640 1 --2- 172.21.15.77:0/2347152735 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fa42806e0b0 0x7fa428070560 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:49.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:49.043+0000 7fa43ed91640 1 --2- 172.21.15.77:0/2347152735 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa4380fdb70 0x7fa43810d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:17:49.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:49.043+0000 7fa43ed91640 1 -- 172.21.15.77:0/2347152735 >> 172.21.15.77:0/2347152735 conn(0x7fa4380f6390 msgr2=0x7fa4380f7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:17:49.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:49.043+0000 7fa43ed91640 1 -- 172.21.15.77:0/2347152735 shutdown_connections 2024-09-18T21:17:49.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:17:49.043+0000 7fa43ed91640 1 -- 172.21.15.77:0/2347152735 wait complete. 2024-09-18T21:17:49.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:48 smithi077 ceph-mon[92672]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:17:49.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:48 smithi077 ceph-mon[92672]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:17:49.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:48 smithi077 ceph-mon[92672]: pgmap v99: 65 pgs: 65 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:17:49.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:48 smithi077 ceph-mon[92672]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:17:49.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:48 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/2773747515' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:17:49.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:48 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/1098141123' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T21:17:49.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:48 smithi103 ceph-mon[80307]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:17:49.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:48 smithi103 ceph-mon[80307]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:17:49.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:48 smithi103 ceph-mon[80307]: pgmap v99: 65 pgs: 65 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:17:49.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:48 smithi103 ceph-mon[80307]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:17:49.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:48 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/2773747515' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:17:49.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:48 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/1098141123' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T21:17:50.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:49 smithi077 ceph-mon[92672]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:17:50.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:49 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/2347152735' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T21:17:50.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:49 smithi103 ceph-mon[80307]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:17:50.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:49 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/2347152735' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T21:17:51.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:50 smithi103 ceph-mon[80307]: pgmap v100: 65 pgs: 65 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:17:51.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:50 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-18T21:17:51.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:50 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:17:51.177 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:50 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:17:51.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:50 smithi077 ceph-mon[92672]: pgmap v100: 65 pgs: 65 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:17:51.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:50 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-18T21:17:51.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:50 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:17:51.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:50 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:17:52.131 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:51 smithi103 ceph-mon[80307]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-18T21:17:52.131 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:51 smithi103 ceph-mon[80307]: Upgrade: osd.3 is safe to restart 2024-09-18T21:17:52.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:51 smithi077 ceph-mon[92672]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-18T21:17:52.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:51 smithi077 ceph-mon[92672]: Upgrade: osd.3 is safe to restart 2024-09-18T21:17:53.192 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:52 smithi103 ceph-mon[80307]: pgmap v101: 65 pgs: 65 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:17:53.192 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:52 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:17:53.192 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:52 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-18T21:17:53.193 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:52 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:17:53.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:52 smithi077 ceph-mon[92672]: pgmap v101: 65 pgs: 65 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:17:53.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:52 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:17:53.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:52 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-18T21:17:53.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:52 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:17:54.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:53 smithi103 ceph-mon[80307]: Upgrade: Updating osd.3 2024-09-18T21:17:54.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:53 smithi103 ceph-mon[80307]: Deploying daemon osd.3 on smithi103 2024-09-18T21:17:54.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:53 smithi077 ceph-mon[92672]: Upgrade: Updating osd.3 2024-09-18T21:17:54.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:53 smithi077 ceph-mon[92672]: Deploying daemon osd.3 on smithi103 2024-09-18T21:17:55.183 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:54 smithi103 ceph-mon[80307]: pgmap v102: 65 pgs: 65 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:17:55.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:54 smithi077 ceph-mon[92672]: pgmap v102: 65 pgs: 65 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:17:55.467 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:17:55 smithi103 systemd[1]: Stopping Ceph osd.3 for 5a76ec16-7601-11ef-bceb-c7b262605968... 2024-09-18T21:17:55.764 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:17:55 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3[40154]: 2024-09-18T21:17:55.466+0000 7f2278db5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T21:17:55.764 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:17:55 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3[40154]: 2024-09-18T21:17:55.466+0000 7f2278db5640 -1 osd.3 61 *** Got signal Terminated *** 2024-09-18T21:17:55.764 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:17:55 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3[40154]: 2024-09-18T21:17:55.466+0000 7f2278db5640 -1 osd.3 61 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-18T21:17:56.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:55 smithi077 ceph-mon[92672]: osd.3 marked itself down and dead 2024-09-18T21:17:56.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:55 smithi103 ceph-mon[80307]: osd.3 marked itself down and dead 2024-09-18T21:17:56.584 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:17:56 smithi103 podman[89203]: 2024-09-18 21:17:56.325170856 +0000 UTC m=+0.981825967 container died 0e72b1bbb8cea85bbfe5b2e560bca0b217a6784ac1342e559077b7a8f116452c (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=quincy-6e06d1e, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T21:17:56.928 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:17:56 smithi103 podman[89203]: 2024-09-18 21:17:56.749474443 +0000 UTC m=+1.406129558 container cleanup 0e72b1bbb8cea85bbfe5b2e560bca0b217a6784ac1342e559077b7a8f116452c (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=quincy-6e06d1e, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-18T21:17:56.928 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:17:56 smithi103 bash[89203]: ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3 2024-09-18T21:17:57.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:56 smithi077 ceph-mon[92672]: pgmap v103: 65 pgs: 65 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:17:57.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:56 smithi077 ceph-mon[92672]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-18T21:17:57.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:56 smithi077 ceph-mon[92672]: osdmap e62: 6 total, 5 up, 6 in 2024-09-18T21:17:57.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:56 smithi103 ceph-mon[80307]: pgmap v103: 65 pgs: 65 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:17:57.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:56 smithi103 ceph-mon[80307]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-18T21:17:57.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:56 smithi103 ceph-mon[80307]: osdmap e62: 6 total, 5 up, 6 in 2024-09-18T21:17:57.264 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:17:56 smithi103 podman[89220]: 2024-09-18 21:17:56.976385501 +0000 UTC m=+0.645253657 container remove 0e72b1bbb8cea85bbfe5b2e560bca0b217a6784ac1342e559077b7a8f116452c (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3, ceph=True, RELEASE=quincy-6e06d1e, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-18T21:17:57.722 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:17:57 smithi103 podman[89307]: 2024-09-18 21:17:57.319622292 +0000 UTC m=+0.015515820 image pull f79f744f586d6ce8ddb4b06b7cf36a0f23174bbe29ea68264d2be49d8c6d9acd quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a 2024-09-18T21:17:57.722 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:17:57 smithi103 podman[89307]: 2024-09-18 21:17:57.427214252 +0000 UTC m=+0.123107767 container create ed2200f93cbe821e151b6698e0a86b82bcd88b991e6d169f65c20fc3e7175293 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-release-06b1b1d) 2024-09-18T21:17:58.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:57 smithi103 ceph-mon[80307]: osdmap e63: 6 total, 5 up, 6 in 2024-09-18T21:17:58.014 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:17:57 smithi103 podman[89307]: 2024-09-18 21:17:57.854647685 +0000 UTC m=+0.550541210 container init ed2200f93cbe821e151b6698e0a86b82bcd88b991e6d169f65c20fc3e7175293 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-release-06b1b1d, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-18T21:17:58.014 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:17:57 smithi103 podman[89307]: 2024-09-18 21:17:57.858305956 +0000 UTC m=+0.554199472 container start ed2200f93cbe821e151b6698e0a86b82bcd88b991e6d169f65c20fc3e7175293 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-release-06b1b1d, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-18T21:17:58.014 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:17:57 smithi103 podman[89307]: 2024-09-18 21:17:57.921267002 +0000 UTC m=+0.617160532 container attach ed2200f93cbe821e151b6698e0a86b82bcd88b991e6d169f65c20fc3e7175293 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, RELEASE=squid-release-06b1b1d, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-18T21:17:58.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:57 smithi077 ceph-mon[92672]: osdmap e63: 6 total, 5 up, 6 in 2024-09-18T21:17:58.350 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:17:58 smithi103 podman[89307]: 2024-09-18 21:17:58.046549265 +0000 UTC m=+0.742442780 container died ed2200f93cbe821e151b6698e0a86b82bcd88b991e6d169f65c20fc3e7175293 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-release-06b1b1d, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T21:17:58.936 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:17:58 smithi103 podman[89330]: 2024-09-18 21:17:58.624768717 +0000 UTC m=+0.572244635 container remove ed2200f93cbe821e151b6698e0a86b82bcd88b991e6d169f65c20fc3e7175293 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-release-06b1b1d, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-18T21:17:58.937 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:17:58 smithi103 systemd[1]: ceph-5a76ec16-7601-11ef-bceb-c7b262605968@osd.3.service: Deactivated successfully. 2024-09-18T21:17:58.937 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:17:58 smithi103 systemd[1]: Stopped Ceph osd.3 for 5a76ec16-7601-11ef-bceb-c7b262605968. 2024-09-18T21:17:58.937 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:17:58 smithi103 systemd[1]: ceph-5a76ec16-7601-11ef-bceb-c7b262605968@osd.3.service: Consumed 1min 14.641s CPU time. 2024-09-18T21:17:58.937 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:17:58 smithi103 systemd[1]: Starting Ceph osd.3 for 5a76ec16-7601-11ef-bceb-c7b262605968... 2024-09-18T21:17:59.187 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:58 smithi103 ceph-mon[80307]: pgmap v106: 65 pgs: 22 peering, 5 stale+active+clean, 38 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:17:59.187 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:58 smithi103 ceph-mon[80307]: Health check failed: Reduced data availability: 11 pgs peering (PG_AVAILABILITY) 2024-09-18T21:17:59.187 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:17:59 smithi103 podman[89430]: 2024-09-18 21:17:58.962935563 +0000 UTC m=+0.016157891 image pull f79f744f586d6ce8ddb4b06b7cf36a0f23174bbe29ea68264d2be49d8c6d9acd quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a 2024-09-18T21:17:59.187 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:17:59 smithi103 podman[89430]: 2024-09-18 21:17:59.067556265 +0000 UTC m=+0.120778581 container create a0069be85f176336add11097e38c79cc4e8e15dd695dfea8dfdbc51bfd1966b6 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-release-06b1b1d, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-18T21:17:59.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:58 smithi077 ceph-mon[92672]: pgmap v106: 65 pgs: 22 peering, 5 stale+active+clean, 38 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:17:59.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:58 smithi077 ceph-mon[92672]: Health check failed: Reduced data availability: 11 pgs peering (PG_AVAILABILITY) 2024-09-18T21:17:59.605 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:17:59 smithi103 podman[89430]: 2024-09-18 21:17:59.27005965 +0000 UTC m=+0.323281979 container init a0069be85f176336add11097e38c79cc4e8e15dd695dfea8dfdbc51bfd1966b6 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3-activate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-release-06b1b1d, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True) 2024-09-18T21:17:59.605 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:17:59 smithi103 podman[89430]: 2024-09-18 21:17:59.273562203 +0000 UTC m=+0.326784525 container start a0069be85f176336add11097e38c79cc4e8e15dd695dfea8dfdbc51bfd1966b6 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.schema-version=1.0, RELEASE=squid-release-06b1b1d, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-18T21:17:59.606 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:17:59 smithi103 podman[89430]: 2024-09-18 21:17:59.353270902 +0000 UTC m=+0.406493231 container attach a0069be85f176336add11097e38c79cc4e8e15dd695dfea8dfdbc51bfd1966b6 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3-activate, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-release-06b1b1d, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-18T21:17:59.606 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:17:59 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3-activate[89446]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T21:17:59.606 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:17:59 smithi103 bash[89430]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T21:17:59.606 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:17:59 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3-activate[89446]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T21:17:59.606 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:17:59 smithi103 bash[89430]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T21:17:59.606 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:17:59 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3-activate[89446]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-18T21:17:59.606 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:17:59 smithi103 bash[89430]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-18T21:17:59.989 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:17:59 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3-activate[89446]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-18T21:17:59.989 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:17:59 smithi103 bash[89430]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-18T21:17:59.989 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:17:59 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3-activate[89446]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-18T21:17:59.989 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:17:59 smithi103 bash[89430]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-18T21:17:59.989 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:17:59 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3-activate[89446]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-18T21:17:59.989 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:17:59 smithi103 bash[89430]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-18T21:17:59.989 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:17:59 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3-activate[89446]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-18T21:17:59.989 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:17:59 smithi103 bash[89430]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-18T21:17:59.989 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:17:59 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3-activate[89446]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-18T21:17:59.989 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:17:59 smithi103 bash[89430]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-18T21:17:59.989 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:17:59 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3-activate[89446]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-18T21:17:59.990 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:17:59 smithi103 bash[89430]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-18T21:17:59.990 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:17:59 smithi103 podman[89430]: 2024-09-18 21:17:59.653555902 +0000 UTC m=+0.706778228 container died a0069be85f176336add11097e38c79cc4e8e15dd695dfea8dfdbc51bfd1966b6 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-release-06b1b1d) 2024-09-18T21:18:00.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:17:59 smithi103 ceph-mon[80307]: Health check failed: Degraded data redundancy: 20/222 objects degraded (9.009%), 8 pgs degraded (PG_DEGRADED) 2024-09-18T21:18:00.264 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:18:00 smithi103 podman[89573]: 2024-09-18 21:18:00.181864508 +0000 UTC m=+0.522556301 container remove a0069be85f176336add11097e38c79cc4e8e15dd695dfea8dfdbc51bfd1966b6 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-release-06b1b1d, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-18T21:18:00.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:17:59 smithi077 ceph-mon[92672]: Health check failed: Degraded data redundancy: 20/222 objects degraded (9.009%), 8 pgs degraded (PG_DEGRADED) 2024-09-18T21:18:00.644 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:18:00 smithi103 podman[89634]: 2024-09-18 21:18:00.291491528 +0000 UTC m=+0.015570547 image pull f79f744f586d6ce8ddb4b06b7cf36a0f23174bbe29ea68264d2be49d8c6d9acd quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a 2024-09-18T21:18:00.644 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:18:00 smithi103 podman[89634]: 2024-09-18 21:18:00.416047395 +0000 UTC m=+0.140126416 container create 2556b257bf1c82dc7742e5adaab6d55d2475f14a4afe2e5f7b9d17020ff0b10f (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-release-06b1b1d, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-18T21:18:00.644 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:18:00 smithi103 podman[89634]: 2024-09-18 21:18:00.643886871 +0000 UTC m=+0.367965899 container init 2556b257bf1c82dc7742e5adaab6d55d2475f14a4afe2e5f7b9d17020ff0b10f (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-release-06b1b1d, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-18T21:18:00.990 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:18:00 smithi103 podman[89634]: 2024-09-18 21:18:00.647136904 +0000 UTC m=+0.371215923 container start 2556b257bf1c82dc7742e5adaab6d55d2475f14a4afe2e5f7b9d17020ff0b10f (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-release-06b1b1d, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-18T21:18:00.990 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:18:00 smithi103 ceph-osd[89653]: -- 172.21.15.103:0/3484486309 <== mon.1 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56187c8341e0 con 0x56187c81e000 2024-09-18T21:18:00.990 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:18:00 smithi103 bash[89634]: 2556b257bf1c82dc7742e5adaab6d55d2475f14a4afe2e5f7b9d17020ff0b10f 2024-09-18T21:18:00.990 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:18:00 smithi103 systemd[1]: Started Ceph osd.3 for 5a76ec16-7601-11ef-bceb-c7b262605968. 2024-09-18T21:18:01.264 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:18:01 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3[89649]: 2024-09-18T21:18:01.189+0000 7fb58eba7640 -1 Falling back to public interface 2024-09-18T21:18:01.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:00 smithi103 ceph-mon[80307]: pgmap v107: 65 pgs: 8 active+undersized, 22 peering, 8 active+undersized+degraded, 27 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 20/222 objects degraded (9.009%) 2024-09-18T21:18:01.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:00 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:01.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:00 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:01.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:00 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:18:01.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:00 smithi077 ceph-mon[92672]: pgmap v107: 65 pgs: 8 active+undersized, 22 peering, 8 active+undersized+degraded, 27 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 20/222 objects degraded (9.009%) 2024-09-18T21:18:01.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:00 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:01.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:00 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:01.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:00 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:18:03.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:02 smithi103 ceph-mon[80307]: pgmap v108: 65 pgs: 18 active+undersized, 4 peering, 16 active+undersized+degraded, 27 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-09-18T21:18:03.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:02 smithi103 ceph-mon[80307]: Health check update: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-18T21:18:03.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:02 smithi077 ceph-mon[92672]: pgmap v108: 65 pgs: 18 active+undersized, 4 peering, 16 active+undersized+degraded, 27 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 49/222 objects degraded (22.072%) 2024-09-18T21:18:03.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:02 smithi077 ceph-mon[92672]: Health check update: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-18T21:18:04.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:04 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:04.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:04 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:04.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:04 smithi077 ceph-mon[92672]: pgmap v109: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 53/222 objects degraded (23.874%) 2024-09-18T21:18:04.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:04 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:04.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:04 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:04.733 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:04 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:04.733 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:04 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:04.733 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:04 smithi103 ceph-mon[80307]: pgmap v109: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 53/222 objects degraded (23.874%) 2024-09-18T21:18:04.733 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:04 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:04.733 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:04 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:05.748 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:05 smithi103 ceph-mon[80307]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-18T21:18:05.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:05 smithi077 ceph-mon[92672]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-18T21:18:06.514 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:18:06 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3[89649]: 2024-09-18T21:18:06.267+0000 7fb58eba7640 -1 osd.3 61 log_to_monitors true 2024-09-18T21:18:07.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:06 smithi103 ceph-mon[80307]: pgmap v110: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 53/222 objects degraded (23.874%) 2024-09-18T21:18:07.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:06 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:07.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:06 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:18:07.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:06 smithi103 ceph-mon[80307]: from='osd.3 [v2:172.21.15.103:6800/4046865432,v1:172.21.15.103:6801/4046865432]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-18T21:18:07.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:06 smithi103 ceph-mon[80307]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-18T21:18:07.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:06 smithi077 ceph-mon[92672]: pgmap v110: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 203 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 53/222 objects degraded (23.874%) 2024-09-18T21:18:07.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:06 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:07.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:06 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:18:07.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:06 smithi077 ceph-mon[92672]: from='osd.3 [v2:172.21.15.103:6800/4046865432,v1:172.21.15.103:6801/4046865432]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-18T21:18:07.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:06 smithi077 ceph-mon[92672]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-18T21:18:07.763 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:18:07 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3[89649]: 2024-09-18T21:18:07.681+0000 7fb582939640 -1 osd.3 61 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T21:18:07.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:07 smithi077 ceph-mon[92672]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-18T21:18:07.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:07 smithi077 ceph-mon[92672]: from='osd.3 [v2:172.21.15.103:6800/4046865432,v1:172.21.15.103:6801/4046865432]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-18T21:18:07.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:07 smithi077 ceph-mon[92672]: osdmap e64: 6 total, 5 up, 6 in 2024-09-18T21:18:07.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:07 smithi077 ceph-mon[92672]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-18T21:18:07.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:07 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:07.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:07 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:07.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:07 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:18:07.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:07 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:18:07.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:07 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:07.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:07 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:18:07.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:07 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:18:07.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:07 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:18:07.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:07 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:18:07.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:07 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-18T21:18:07.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:07 smithi077 ceph-mon[92672]: from='osd.3 ' entity='osd.3' 2024-09-18T21:18:08.103 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:07 smithi103 ceph-mon[80307]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-18T21:18:08.103 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:07 smithi103 ceph-mon[80307]: from='osd.3 [v2:172.21.15.103:6800/4046865432,v1:172.21.15.103:6801/4046865432]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-18T21:18:08.103 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:07 smithi103 ceph-mon[80307]: osdmap e64: 6 total, 5 up, 6 in 2024-09-18T21:18:08.104 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:07 smithi103 ceph-mon[80307]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-18T21:18:08.104 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:07 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:08.104 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:07 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:08.104 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:07 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:18:08.104 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:07 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:18:08.104 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:07 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:08.104 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:07 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:18:08.104 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:07 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:18:08.104 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:07 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:18:08.104 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:07 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:18:08.104 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:07 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-18T21:18:08.104 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:07 smithi103 ceph-mon[80307]: from='osd.3 ' entity='osd.3' 2024-09-18T21:18:08.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:08 smithi077 ceph-mon[92672]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-18T21:18:08.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:08 smithi077 ceph-mon[92672]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-18T21:18:08.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:08 smithi077 ceph-mon[92672]: pgmap v112: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 53/222 objects degraded (23.874%) 2024-09-18T21:18:08.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:08 smithi077 ceph-mon[92672]: Health check update: Degraded data redundancy: 53/222 objects degraded (23.874%), 18 pgs degraded (PG_DEGRADED) 2024-09-18T21:18:08.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:08 smithi077 ceph-mon[92672]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-18T21:18:08.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:08 smithi077 ceph-mon[92672]: osd.3 [v2:172.21.15.103:6800/4046865432,v1:172.21.15.103:6801/4046865432] boot 2024-09-18T21:18:08.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:08 smithi077 ceph-mon[92672]: osdmap e65: 6 total, 6 up, 6 in 2024-09-18T21:18:08.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:08 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T21:18:09.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:08 smithi103 ceph-mon[80307]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-18T21:18:09.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:08 smithi103 ceph-mon[80307]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-18T21:18:09.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:08 smithi103 ceph-mon[80307]: pgmap v112: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 53/222 objects degraded (23.874%) 2024-09-18T21:18:09.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:08 smithi103 ceph-mon[80307]: Health check update: Degraded data redundancy: 53/222 objects degraded (23.874%), 18 pgs degraded (PG_DEGRADED) 2024-09-18T21:18:09.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:08 smithi103 ceph-mon[80307]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-18T21:18:09.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:08 smithi103 ceph-mon[80307]: osd.3 [v2:172.21.15.103:6800/4046865432,v1:172.21.15.103:6801/4046865432] boot 2024-09-18T21:18:09.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:08 smithi103 ceph-mon[80307]: osdmap e65: 6 total, 6 up, 6 in 2024-09-18T21:18:09.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:08 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-18T21:18:10.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:10 smithi077 ceph-mon[92672]: osdmap e66: 6 total, 6 up, 6 in 2024-09-18T21:18:10.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:10 smithi077 ceph-mon[92672]: pgmap v115: 65 pgs: 4 peering, 17 active+undersized, 17 active+undersized+degraded, 27 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 50/222 objects degraded (22.523%) 2024-09-18T21:18:11.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:10 smithi103 ceph-mon[80307]: osdmap e66: 6 total, 6 up, 6 in 2024-09-18T21:18:11.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:10 smithi103 ceph-mon[80307]: pgmap v115: 65 pgs: 4 peering, 17 active+undersized, 17 active+undersized+degraded, 27 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 50/222 objects degraded (22.523%) 2024-09-18T21:18:13.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:12 smithi077 ceph-mon[92672]: pgmap v116: 65 pgs: 4 peering, 11 active+undersized, 15 active+undersized+degraded, 35 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 41/222 objects degraded (18.468%) 2024-09-18T21:18:13.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:12 smithi103 ceph-mon[80307]: pgmap v116: 65 pgs: 4 peering, 11 active+undersized, 15 active+undersized+degraded, 35 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 41/222 objects degraded (18.468%) 2024-09-18T21:18:14.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:13 smithi077 ceph-mon[92672]: Health check update: Degraded data redundancy: 41/222 objects degraded (18.468%), 15 pgs degraded (PG_DEGRADED) 2024-09-18T21:18:14.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:13 smithi103 ceph-mon[80307]: Health check update: Degraded data redundancy: 41/222 objects degraded (18.468%), 15 pgs degraded (PG_DEGRADED) 2024-09-18T21:18:15.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:14 smithi077 ceph-mon[92672]: pgmap v117: 65 pgs: 4 peering, 61 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:18:15.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:14 smithi077 ceph-mon[92672]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 41/222 objects degraded (18.468%), 15 pgs degraded) 2024-09-18T21:18:15.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:14 smithi077 ceph-mon[92672]: Cluster is now healthy 2024-09-18T21:18:15.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:14 smithi103 ceph-mon[80307]: pgmap v117: 65 pgs: 4 peering, 61 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:18:15.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:14 smithi103 ceph-mon[80307]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 41/222 objects degraded (18.468%), 15 pgs degraded) 2024-09-18T21:18:15.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:14 smithi103 ceph-mon[80307]: Cluster is now healthy 2024-09-18T21:18:17.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:16 smithi077 ceph-mon[92672]: pgmap v118: 65 pgs: 65 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:18:17.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:16 smithi103 ceph-mon[80307]: pgmap v118: 65 pgs: 65 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:18:18.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:18 smithi077 ceph-mon[92672]: pgmap v119: 65 pgs: 65 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:18:19.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.133+0000 7fe04993c640 1 -- 172.21.15.77:0/2922189273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0440fc530 msgr2=0x7fe0440fc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:19.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.133+0000 7fe04993c640 1 --2- 172.21.15.77:0/2922189273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0440fc530 0x7fe0440fc940 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe0340048d0 tx=0x7fe034009da0 comp rx=0 tx=0).stop 2024-09-18T21:18:19.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.133+0000 7fe04993c640 1 -- 172.21.15.77:0/2922189273 shutdown_connections 2024-09-18T21:18:19.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.133+0000 7fe04993c640 1 --2- 172.21.15.77:0/2922189273 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0440fd800 0x7fe0440fdc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:19.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.133+0000 7fe04993c640 1 --2- 172.21.15.77:0/2922189273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0440fc530 0x7fe0440fc940 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:19.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.133+0000 7fe04993c640 1 -- 172.21.15.77:0/2922189273 >> 172.21.15.77:0/2922189273 conn(0x7fe0440f7d10 msgr2=0x7fe0440fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:18:19.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.134+0000 7fe04993c640 1 -- 172.21.15.77:0/2922189273 shutdown_connections 2024-09-18T21:18:19.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.134+0000 7fe04993c640 1 -- 172.21.15.77:0/2922189273 wait complete. 2024-09-18T21:18:19.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.134+0000 7fe04993c640 1 Processor -- start 2024-09-18T21:18:19.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.134+0000 7fe04993c640 1 -- start start 2024-09-18T21:18:19.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.134+0000 7fe04993c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0440fc530 0x7fe04410d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:18:19.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.134+0000 7fe04993c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0440fd800 0x7fe04410d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:18:19.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.134+0000 7fe04993c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04410dbf0 con 0x7fe0440fd800 2024-09-18T21:18:19.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.134+0000 7fe04993c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04410e410 con 0x7fe0440fc530 2024-09-18T21:18:19.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.134+0000 7fe03bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0440fd800 0x7fe04410d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:18:19.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.134+0000 7fe03bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0440fd800 0x7fe04410d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48720/0 (socket says 172.21.15.77:48720) 2024-09-18T21:18:19.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.134+0000 7fe03bfff640 1 -- 172.21.15.77:0/3878259012 learned_addr learned my addr 172.21.15.77:0/3878259012 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:18:19.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.135+0000 7fe042ffd640 1 --2- 172.21.15.77:0/3878259012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0440fc530 0x7fe04410d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:18:19.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.135+0000 7fe03bfff640 1 -- 172.21.15.77:0/3878259012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0440fc530 msgr2=0x7fe04410d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:19.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.135+0000 7fe03bfff640 1 --2- 172.21.15.77:0/3878259012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0440fc530 0x7fe04410d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:19.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.135+0000 7fe03bfff640 1 -- 172.21.15.77:0/3878259012 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe034005040 con 0x7fe0440fd800 2024-09-18T21:18:19.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.135+0000 7fe042ffd640 1 --2- 172.21.15.77:0/3878259012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0440fc530 0x7fe04410d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T21:18:19.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.135+0000 7fe03bfff640 1 --2- 172.21.15.77:0/3878259012 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0440fd800 0x7fe04410d5a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe02c00c830 tx=0x7fe02c004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:18:19.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.135+0000 7fe03b7fe640 1 -- 172.21.15.77:0/3878259012 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe02c00a850 con 0x7fe0440fd800 2024-09-18T21:18:19.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.135+0000 7fe03b7fe640 1 -- 172.21.15.77:0/3878259012 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe02c00ae50 con 0x7fe0440fd800 2024-09-18T21:18:19.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.135+0000 7fe03b7fe640 1 -- 172.21.15.77:0/3878259012 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe02c0113a0 con 0x7fe0440fd800 2024-09-18T21:18:19.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.135+0000 7fe04993c640 1 -- 172.21.15.77:0/3878259012 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe04410e6a0 con 0x7fe0440fd800 2024-09-18T21:18:19.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.135+0000 7fe04993c640 1 -- 172.21.15.77:0/3878259012 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe04410ec40 con 0x7fe0440fd800 2024-09-18T21:18:19.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.136+0000 7fe04993c640 1 -- 172.21.15.77:0/3878259012 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0440fb990 con 0x7fe0440fd800 2024-09-18T21:18:19.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.137+0000 7fe03b7fe640 1 -- 172.21.15.77:0/3878259012 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fe02c012400 con 0x7fe0440fd800 2024-09-18T21:18:19.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.137+0000 7fe03b7fe640 1 --2- 172.21.15.77:0/3878259012 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fe03006e0b0 0x7fe030070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:18:19.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.137+0000 7fe03b7fe640 1 -- 172.21.15.77:0/3878259012 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fe02c08dc40 con 0x7fe0440fd800 2024-09-18T21:18:19.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.137+0000 7fe042ffd640 1 --2- 172.21.15.77:0/3878259012 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fe03006e0b0 0x7fe030070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:18:19.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.138+0000 7fe042ffd640 1 --2- 172.21.15.77:0/3878259012 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fe03006e0b0 0x7fe030070560 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe034004540 tx=0x7fe034035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:18:19.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.145+0000 7fe03b7fe640 1 -- 172.21.15.77:0/3878259012 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fe02c057130 con 0x7fe0440fd800 2024-09-18T21:18:19.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:18 smithi103 ceph-mon[80307]: pgmap v119: 65 pgs: 65 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:18:19.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.329+0000 7fe04993c640 1 -- 172.21.15.77:0/3878259012 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe04410efb0 con 0x7fe03006e0b0 2024-09-18T21:18:19.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.331+0000 7fe03b7fe640 1 -- 172.21.15.77:0/3878259012 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fe04410efb0 con 0x7fe03006e0b0 2024-09-18T21:18:19.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.333+0000 7fe04993c640 1 -- 172.21.15.77:0/3878259012 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fe03006e0b0 msgr2=0x7fe030070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:19.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.333+0000 7fe04993c640 1 --2- 172.21.15.77:0/3878259012 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fe03006e0b0 0x7fe030070560 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe034004540 tx=0x7fe034035040 comp rx=0 tx=0).stop 2024-09-18T21:18:19.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.333+0000 7fe04993c640 1 -- 172.21.15.77:0/3878259012 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0440fd800 msgr2=0x7fe04410d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:19.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.333+0000 7fe04993c640 1 --2- 172.21.15.77:0/3878259012 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0440fd800 0x7fe04410d5a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe02c00c830 tx=0x7fe02c004430 comp rx=0 tx=0).stop 2024-09-18T21:18:19.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.333+0000 7fe04993c640 1 -- 172.21.15.77:0/3878259012 shutdown_connections 2024-09-18T21:18:19.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.333+0000 7fe04993c640 1 --2- 172.21.15.77:0/3878259012 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0440fd800 0x7fe04410d5a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:19.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.333+0000 7fe04993c640 1 --2- 172.21.15.77:0/3878259012 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fe03006e0b0 0x7fe030070560 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:19.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.333+0000 7fe04993c640 1 --2- 172.21.15.77:0/3878259012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0440fc530 0x7fe04410d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:19.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.333+0000 7fe04993c640 1 -- 172.21.15.77:0/3878259012 >> 172.21.15.77:0/3878259012 conn(0x7fe0440f7d10 msgr2=0x7fe0440f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:18:19.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.333+0000 7fe04993c640 1 -- 172.21.15.77:0/3878259012 shutdown_connections 2024-09-18T21:18:19.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.333+0000 7fe04993c640 1 -- 172.21.15.77:0/3878259012 wait complete. 2024-09-18T21:18:19.344 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-09-18T21:18:19.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.412+0000 7f11c2ecf640 1 -- 172.21.15.77:0/1804270727 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11bc0fb450 msgr2=0x7f11bc0fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:19.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.412+0000 7f11c2ecf640 1 --2- 172.21.15.77:0/1804270727 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11bc0fb450 0x7f11bc0fb860 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f11b80048d0 tx=0x7f11b8009da0 comp rx=0 tx=0).stop 2024-09-18T21:18:19.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.412+0000 7f11c2ecf640 1 -- 172.21.15.77:0/1804270727 shutdown_connections 2024-09-18T21:18:19.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.412+0000 7f11c2ecf640 1 --2- 172.21.15.77:0/1804270727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11bc0fc720 0x7f11bc0fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:19.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.412+0000 7f11c2ecf640 1 --2- 172.21.15.77:0/1804270727 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11bc0fb450 0x7f11bc0fb860 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:19.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.412+0000 7f11c2ecf640 1 -- 172.21.15.77:0/1804270727 >> 172.21.15.77:0/1804270727 conn(0x7f11bc0f6c10 msgr2=0x7f11bc0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:18:19.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.412+0000 7f11c2ecf640 1 -- 172.21.15.77:0/1804270727 shutdown_connections 2024-09-18T21:18:19.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.412+0000 7f11c2ecf640 1 -- 172.21.15.77:0/1804270727 wait complete. 2024-09-18T21:18:19.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.413+0000 7f11c2ecf640 1 Processor -- start 2024-09-18T21:18:19.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.413+0000 7f11c2ecf640 1 -- start start 2024-09-18T21:18:19.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.413+0000 7f11c2ecf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11bc0fb450 0x7f11bc10d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:18:19.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.413+0000 7f11c2ecf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11bc0fc720 0x7f11bc10d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:18:19.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.413+0000 7f11c2ecf640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11bc10dc10 con 0x7f11bc0fb450 2024-09-18T21:18:19.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.413+0000 7f11c2ecf640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11bc10e430 con 0x7f11bc0fc720 2024-09-18T21:18:19.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.413+0000 7f11c0c6b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11bc0fb450 0x7f11bc10d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:18:19.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.413+0000 7f11c0c6b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11bc0fb450 0x7f11bc10d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58244/0 (socket says 172.21.15.77:58244) 2024-09-18T21:18:19.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.413+0000 7f11c0c6b640 1 -- 172.21.15.77:0/1482286197 learned_addr learned my addr 172.21.15.77:0/1482286197 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:18:19.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.413+0000 7f11b3fff640 1 --2- 172.21.15.77:0/1482286197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11bc0fc720 0x7f11bc10d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:18:19.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.414+0000 7f11c0c6b640 1 -- 172.21.15.77:0/1482286197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11bc0fc720 msgr2=0x7f11bc10d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:19.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.414+0000 7f11c0c6b640 1 --2- 172.21.15.77:0/1482286197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11bc0fc720 0x7f11bc10d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:19.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.414+0000 7f11c0c6b640 1 -- 172.21.15.77:0/1482286197 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b8005040 con 0x7f11bc0fb450 2024-09-18T21:18:19.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.414+0000 7f11c0c6b640 1 --2- 172.21.15.77:0/1482286197 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11bc0fb450 0x7f11bc10d080 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f11b80043d0 tx=0x7f11b8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:18:19.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.414+0000 7f11b17fa640 1 -- 172.21.15.77:0/1482286197 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11b8038070 con 0x7f11bc0fb450 2024-09-18T21:18:19.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.414+0000 7f11b17fa640 1 -- 172.21.15.77:0/1482286197 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f11b802ae90 con 0x7f11bc0fb450 2024-09-18T21:18:19.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.414+0000 7f11c2ecf640 1 -- 172.21.15.77:0/1482286197 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11bc10e660 con 0x7f11bc0fb450 2024-09-18T21:18:19.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.414+0000 7f11b17fa640 1 -- 172.21.15.77:0/1482286197 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11b803e670 con 0x7f11bc0fb450 2024-09-18T21:18:19.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.414+0000 7f11c2ecf640 1 -- 172.21.15.77:0/1482286197 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11bc10ec00 con 0x7f11bc0fb450 2024-09-18T21:18:19.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.415+0000 7f11c2ecf640 1 -- 172.21.15.77:0/1482286197 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11bc0fa8b0 con 0x7f11bc0fb450 2024-09-18T21:18:19.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.415+0000 7f11b17fa640 1 -- 172.21.15.77:0/1482286197 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f11b8030020 con 0x7f11bc0fb450 2024-09-18T21:18:19.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.416+0000 7f11b17fa640 1 --2- 172.21.15.77:0/1482286197 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f11a406e0b0 0x7f11a4070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:18:19.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.416+0000 7f11b17fa640 1 -- 172.21.15.77:0/1482286197 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f11b80addb0 con 0x7f11bc0fb450 2024-09-18T21:18:19.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.416+0000 7f11b3fff640 1 --2- 172.21.15.77:0/1482286197 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f11a406e0b0 0x7f11a4070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:18:19.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.417+0000 7f11b3fff640 1 --2- 172.21.15.77:0/1482286197 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f11a406e0b0 0x7f11a4070560 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f11ac009fd0 tx=0x7f11ac009e50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:18:19.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.420+0000 7f11b17fa640 1 -- 172.21.15.77:0/1482286197 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f11b8077180 con 0x7f11bc0fb450 2024-09-18T21:18:19.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.600+0000 7f11c2ecf640 1 -- 172.21.15.77:0/1482286197 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f11bc104010 con 0x7f11a406e0b0 2024-09-18T21:18:19.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.601+0000 7f11b17fa640 1 -- 172.21.15.77:0/1482286197 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f11bc104010 con 0x7f11a406e0b0 2024-09-18T21:18:19.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.603+0000 7f11c2ecf640 1 -- 172.21.15.77:0/1482286197 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f11a406e0b0 msgr2=0x7f11a4070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:19.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.603+0000 7f11c2ecf640 1 --2- 172.21.15.77:0/1482286197 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f11a406e0b0 0x7f11a4070560 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f11ac009fd0 tx=0x7f11ac009e50 comp rx=0 tx=0).stop 2024-09-18T21:18:19.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.603+0000 7f11c2ecf640 1 -- 172.21.15.77:0/1482286197 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11bc0fb450 msgr2=0x7f11bc10d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:19.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.603+0000 7f11c2ecf640 1 --2- 172.21.15.77:0/1482286197 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11bc0fb450 0x7f11bc10d080 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f11b80043d0 tx=0x7f11b8009da0 comp rx=0 tx=0).stop 2024-09-18T21:18:19.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.603+0000 7f11c2ecf640 1 -- 172.21.15.77:0/1482286197 shutdown_connections 2024-09-18T21:18:19.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.603+0000 7f11c2ecf640 1 --2- 172.21.15.77:0/1482286197 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f11a406e0b0 0x7f11a4070560 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:19.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.603+0000 7f11c2ecf640 1 --2- 172.21.15.77:0/1482286197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11bc0fc720 0x7f11bc10d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:19.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.603+0000 7f11c2ecf640 1 --2- 172.21.15.77:0/1482286197 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11bc0fb450 0x7f11bc10d080 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:19.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.603+0000 7f11c2ecf640 1 -- 172.21.15.77:0/1482286197 >> 172.21.15.77:0/1482286197 conn(0x7f11bc0f6c10 msgr2=0x7f11bc0660f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:18:19.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.603+0000 7f11c2ecf640 1 -- 172.21.15.77:0/1482286197 shutdown_connections 2024-09-18T21:18:19.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.603+0000 7f11c2ecf640 1 -- 172.21.15.77:0/1482286197 wait complete. 2024-09-18T21:18:19.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.681+0000 7fce6ae96640 1 -- 172.21.15.77:0/3682952524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce640fb430 msgr2=0x7fce640fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:19.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.681+0000 7fce6ae96640 1 --2- 172.21.15.77:0/3682952524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce640fb430 0x7fce640fb840 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fce54009c50 tx=0x7fce54004d10 comp rx=0 tx=0).stop 2024-09-18T21:18:19.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.681+0000 7fce6ae96640 1 -- 172.21.15.77:0/3682952524 shutdown_connections 2024-09-18T21:18:19.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.681+0000 7fce6ae96640 1 --2- 172.21.15.77:0/3682952524 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce640fc700 0x7fce640fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:19.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.681+0000 7fce6ae96640 1 --2- 172.21.15.77:0/3682952524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce640fb430 0x7fce640fb840 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:19.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.681+0000 7fce6ae96640 1 -- 172.21.15.77:0/3682952524 >> 172.21.15.77:0/3682952524 conn(0x7fce640f6c10 msgr2=0x7fce640f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:18:19.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.682+0000 7fce6ae96640 1 -- 172.21.15.77:0/3682952524 shutdown_connections 2024-09-18T21:18:19.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.682+0000 7fce6ae96640 1 -- 172.21.15.77:0/3682952524 wait complete. 2024-09-18T21:18:19.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.682+0000 7fce6ae96640 1 Processor -- start 2024-09-18T21:18:19.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.682+0000 7fce6ae96640 1 -- start start 2024-09-18T21:18:19.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.682+0000 7fce6ae96640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce640fb430 0x7fce6410d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:18:19.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.682+0000 7fce6ae96640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce640fc700 0x7fce6410d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:18:19.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.682+0000 7fce6ae96640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce6410e4d0 con 0x7fce640fc700 2024-09-18T21:18:19.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.682+0000 7fce6ae96640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce6410e640 con 0x7fce640fb430 2024-09-18T21:18:19.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.683+0000 7fce63fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce640fc700 0x7fce6410d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:18:19.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.683+0000 7fce63fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce640fc700 0x7fce6410d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58274/0 (socket says 172.21.15.77:58274) 2024-09-18T21:18:19.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.683+0000 7fce63fff640 1 -- 172.21.15.77:0/2655994011 learned_addr learned my addr 172.21.15.77:0/2655994011 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:18:19.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.683+0000 7fce68c32640 1 --2- 172.21.15.77:0/2655994011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce640fb430 0x7fce6410d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:18:19.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.683+0000 7fce63fff640 1 -- 172.21.15.77:0/2655994011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce640fb430 msgr2=0x7fce6410d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:19.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.683+0000 7fce63fff640 1 --2- 172.21.15.77:0/2655994011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce640fb430 0x7fce6410d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:19.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.683+0000 7fce63fff640 1 -- 172.21.15.77:0/2655994011 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce540098b0 con 0x7fce640fc700 2024-09-18T21:18:19.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.683+0000 7fce63fff640 1 --2- 172.21.15.77:0/2655994011 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce640fc700 0x7fce6410d660 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fce4c00b790 tx=0x7fce4c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:18:19.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.683+0000 7fce617fa640 1 -- 172.21.15.77:0/2655994011 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce4c00c700 con 0x7fce640fc700 2024-09-18T21:18:19.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.683+0000 7fce617fa640 1 -- 172.21.15.77:0/2655994011 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fce4c00cd00 con 0x7fce640fc700 2024-09-18T21:18:19.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.683+0000 7fce6ae96640 1 -- 172.21.15.77:0/2655994011 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce6410e920 con 0x7fce640fc700 2024-09-18T21:18:19.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.683+0000 7fce617fa640 1 -- 172.21.15.77:0/2655994011 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce4c015e70 con 0x7fce640fc700 2024-09-18T21:18:19.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.683+0000 7fce6ae96640 1 -- 172.21.15.77:0/2655994011 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce6410ee40 con 0x7fce640fc700 2024-09-18T21:18:19.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.685+0000 7fce6ae96640 1 -- 172.21.15.77:0/2655994011 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce640fa890 con 0x7fce640fc700 2024-09-18T21:18:19.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.685+0000 7fce617fa640 1 -- 172.21.15.77:0/2655994011 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fce4c012070 con 0x7fce640fc700 2024-09-18T21:18:19.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.686+0000 7fce617fa640 1 --2- 172.21.15.77:0/2655994011 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fce5006e0b0 0x7fce50070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:18:19.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.686+0000 7fce68c32640 1 --2- 172.21.15.77:0/2655994011 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fce5006e0b0 0x7fce50070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:18:19.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.686+0000 7fce617fa640 1 -- 172.21.15.77:0/2655994011 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fce4c08d630 con 0x7fce640fc700 2024-09-18T21:18:19.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.686+0000 7fce68c32640 1 --2- 172.21.15.77:0/2655994011 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fce5006e0b0 0x7fce50070560 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fce54000f80 tx=0x7fce54004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:18:19.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.690+0000 7fce617fa640 1 -- 172.21.15.77:0/2655994011 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fce4c056a00 con 0x7fce640fc700 2024-09-18T21:18:19.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.864+0000 7fce6ae96640 1 -- 172.21.15.77:0/2655994011 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fce64103eb0 con 0x7fce5006e0b0 2024-09-18T21:18:19.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.873+0000 7fce617fa640 1 -- 172.21.15.77:0/2655994011 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fce64103eb0 con 0x7fce5006e0b0 2024-09-18T21:18:19.875 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T21:18:19.875 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager.smithi077 smithi077 *:9093,9094 running (5m) 48s ago 13m 24.2M - 0.25.0 c8568f914cd2 b201d325a55b 2024-09-18T21:18:19.875 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi077 smithi077 running (2m) 48s ago 13m 6891k - 19.1.1-17-g06b1b1de f79f744f586d 5872fa24b792 2024-09-18T21:18:19.875 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi103 smithi103 running (2m) 16s ago 12m 6887k - 19.1.1-17-g06b1b1de f79f744f586d cd1604469f34 2024-09-18T21:18:19.876 INFO:teuthology.orchestra.run.smithi077.stdout:grafana.smithi077 smithi077 *:3000 running (4m) 48s ago 12m 83.1M - 9.4.7 954c08fa6188 d06ef3ab9e66 2024-09-18T21:18:19.876 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.cqfhlw smithi077 running (7m) 48s ago 7m 14.8M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 a7ec3b7701b6 2024-09-18T21:18:19.876 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.vruydi smithi077 running (7m) 48s ago 7m 141M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 affbba097d3b 2024-09-18T21:18:19.876 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi103.opftmf smithi103 running (7m) 16s ago 7m 17.0M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 111f884c5a34 2024-09-18T21:18:19.876 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi103.zhdmdg smithi103 running (7m) 16s ago 7m 16.2M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 50b77d0edda5 2024-09-18T21:18:19.876 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi077.utkpjg smithi077 *:8443,9283,8765 running (4m) 48s ago 14m 502M - 19.1.1-17-g06b1b1de f79f744f586d 99d4b0fd70f6 2024-09-18T21:18:19.876 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi103.zjztqc smithi103 *:8443,9283,8765 running (3m) 16s ago 12m 440M - 19.1.1-17-g06b1b1de f79f744f586d 54589547c4d7 2024-09-18T21:18:19.876 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi077 smithi077 running (3m) 48s ago 14m 45.3M 2048M 19.1.1-17-g06b1b1de f79f744f586d 2d0fbbea1264 2024-09-18T21:18:19.876 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi103 smithi103 running (3m) 16s ago 12m 38.3M 2048M 19.1.1-17-g06b1b1de f79f744f586d dc79edbd9602 2024-09-18T21:18:19.876 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi077 smithi077 *:9100 running (5m) 48s ago 13m 14.8M - 1.5.0 0da6a335fe13 99144245c1af 2024-09-18T21:18:19.876 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi103 smithi103 *:9100 running (4m) 16s ago 12m 16.4M - 1.5.0 0da6a335fe13 e5b51144d997 2024-09-18T21:18:19.876 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (2m) 48s ago 11m 89.4M 1557M 19.1.1-17-g06b1b1de f79f744f586d 8855b4b16e00 2024-09-18T21:18:19.876 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi077 running (87s) 48s ago 11m 98.9M 1557M 19.1.1-17-g06b1b1de f79f744f586d 2d8bc9cac96c 2024-09-18T21:18:19.877 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi077 running (53s) 48s ago 10m 11.9M 1557M 19.1.1-17-g06b1b1de f79f744f586d 93876f1d398d 2024-09-18T21:18:19.877 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi103 running (19s) 16s ago 10m 11.8M 2581M 19.1.1-17-g06b1b1de f79f744f586d 2556b257bf1c 2024-09-18T21:18:19.877 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi103 running (9m) 16s ago 9m 245M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 85f1ce1e8bee 2024-09-18T21:18:19.877 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi103 running (9m) 16s ago 9m 226M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 cf8964b3ac6d 2024-09-18T21:18:19.877 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus.smithi077 smithi077 *:9095 running (3m) 48s ago 12m 58.5M - 2.43.0 a07b618ecd1d 41f3729e3400 2024-09-18T21:18:19.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.875+0000 7fce6ae96640 1 -- 172.21.15.77:0/2655994011 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fce5006e0b0 msgr2=0x7fce50070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:19.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.875+0000 7fce6ae96640 1 --2- 172.21.15.77:0/2655994011 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fce5006e0b0 0x7fce50070560 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fce54000f80 tx=0x7fce54004d10 comp rx=0 tx=0).stop 2024-09-18T21:18:19.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.875+0000 7fce6ae96640 1 -- 172.21.15.77:0/2655994011 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce640fc700 msgr2=0x7fce6410d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:19.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.875+0000 7fce6ae96640 1 --2- 172.21.15.77:0/2655994011 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce640fc700 0x7fce6410d660 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fce4c00b790 tx=0x7fce4c0091d0 comp rx=0 tx=0).stop 2024-09-18T21:18:19.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.875+0000 7fce6ae96640 1 -- 172.21.15.77:0/2655994011 shutdown_connections 2024-09-18T21:18:19.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.875+0000 7fce6ae96640 1 --2- 172.21.15.77:0/2655994011 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce640fc700 0x7fce6410d660 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:19.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.875+0000 7fce6ae96640 1 --2- 172.21.15.77:0/2655994011 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fce5006e0b0 0x7fce50070560 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:19.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.875+0000 7fce6ae96640 1 --2- 172.21.15.77:0/2655994011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce640fb430 0x7fce6410d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:19.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.875+0000 7fce6ae96640 1 -- 172.21.15.77:0/2655994011 >> 172.21.15.77:0/2655994011 conn(0x7fce640f6c10 msgr2=0x7fce640656d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:18:19.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.875+0000 7fce6ae96640 1 -- 172.21.15.77:0/2655994011 shutdown_connections 2024-09-18T21:18:19.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.875+0000 7fce6ae96640 1 -- 172.21.15.77:0/2655994011 wait complete. 2024-09-18T21:18:19.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.952+0000 7fed22e80640 1 -- 172.21.15.77:0/1254423566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed1c0fd820 msgr2=0x7fed1c0fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:19.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.952+0000 7fed22e80640 1 --2- 172.21.15.77:0/1254423566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed1c0fd820 0x7fed1c0fdc90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fed0c0048d0 tx=0x7fed0c009da0 comp rx=0 tx=0).stop 2024-09-18T21:18:19.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.952+0000 7fed22e80640 1 -- 172.21.15.77:0/1254423566 shutdown_connections 2024-09-18T21:18:19.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.952+0000 7fed22e80640 1 --2- 172.21.15.77:0/1254423566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed1c0fd820 0x7fed1c0fdc90 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:19.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.952+0000 7fed22e80640 1 --2- 172.21.15.77:0/1254423566 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed1c0fc550 0x7fed1c0fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:19.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.952+0000 7fed22e80640 1 -- 172.21.15.77:0/1254423566 >> 172.21.15.77:0/1254423566 conn(0x7fed1c0f7d30 msgr2=0x7fed1c0fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:18:19.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.952+0000 7fed22e80640 1 -- 172.21.15.77:0/1254423566 shutdown_connections 2024-09-18T21:18:19.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.952+0000 7fed22e80640 1 -- 172.21.15.77:0/1254423566 wait complete. 2024-09-18T21:18:19.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.952+0000 7fed22e80640 1 Processor -- start 2024-09-18T21:18:19.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.952+0000 7fed22e80640 1 -- start start 2024-09-18T21:18:19.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.953+0000 7fed22e80640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed1c0fc550 0x7fed1c071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:18:19.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.953+0000 7fed22e80640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed1c0fd820 0x7fed1c06fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:18:19.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.953+0000 7fed22e80640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1c070080 con 0x7fed1c0fd820 2024-09-18T21:18:19.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.953+0000 7fed22e80640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1c0701c0 con 0x7fed1c0fc550 2024-09-18T21:18:19.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.953+0000 7fed1bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed1c0fd820 0x7fed1c06fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:18:19.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.953+0000 7fed1bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed1c0fd820 0x7fed1c06fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58294/0 (socket says 172.21.15.77:58294) 2024-09-18T21:18:19.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.953+0000 7fed1bfff640 1 -- 172.21.15.77:0/478546543 learned_addr learned my addr 172.21.15.77:0/478546543 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:18:19.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.953+0000 7fed20c1c640 1 --2- 172.21.15.77:0/478546543 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed1c0fc550 0x7fed1c071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:18:19.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.953+0000 7fed1bfff640 1 -- 172.21.15.77:0/478546543 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed1c0fc550 msgr2=0x7fed1c071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:19.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.953+0000 7fed1bfff640 1 --2- 172.21.15.77:0/478546543 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed1c0fc550 0x7fed1c071570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:19.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.953+0000 7fed1bfff640 1 -- 172.21.15.77:0/478546543 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed0c005040 con 0x7fed1c0fd820 2024-09-18T21:18:19.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.953+0000 7fed1bfff640 1 --2- 172.21.15.77:0/478546543 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed1c0fd820 0x7fed1c06fa60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fed0c003080 tx=0x7fed0c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:18:19.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.954+0000 7fed197fa640 1 -- 172.21.15.77:0/478546543 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed0c038070 con 0x7fed1c0fd820 2024-09-18T21:18:19.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.954+0000 7fed197fa640 1 -- 172.21.15.77:0/478546543 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fed0c02abd0 con 0x7fed1c0fd820 2024-09-18T21:18:19.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.954+0000 7fed22e80640 1 -- 172.21.15.77:0/478546543 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed1c070440 con 0x7fed1c0fd820 2024-09-18T21:18:19.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.954+0000 7fed197fa640 1 -- 172.21.15.77:0/478546543 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed0c03e670 con 0x7fed1c0fd820 2024-09-18T21:18:19.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.954+0000 7fed22e80640 1 -- 172.21.15.77:0/478546543 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed1c115130 con 0x7fed1c0fd820 2024-09-18T21:18:19.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.955+0000 7fed22e80640 1 -- 172.21.15.77:0/478546543 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed1c0fb9b0 con 0x7fed1c0fd820 2024-09-18T21:18:19.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.955+0000 7fed197fa640 1 -- 172.21.15.77:0/478546543 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fed0c030020 con 0x7fed1c0fd820 2024-09-18T21:18:19.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.956+0000 7fed197fa640 1 --2- 172.21.15.77:0/478546543 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fed0806e0b0 0x7fed08070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:18:19.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.956+0000 7fed197fa640 1 -- 172.21.15.77:0/478546543 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fed0c0ade80 con 0x7fed1c0fd820 2024-09-18T21:18:19.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.956+0000 7fed20c1c640 1 --2- 172.21.15.77:0/478546543 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fed0806e0b0 0x7fed08070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:18:19.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.956+0000 7fed20c1c640 1 --2- 172.21.15.77:0/478546543 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fed0806e0b0 0x7fed08070560 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fed1c071320 tx=0x7fed04009120 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:18:19.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:19.960+0000 7fed197fa640 1 -- 172.21.15.77:0/478546543 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fed0c077300 con 0x7fed1c0fd820 2024-09-18T21:18:20.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.190+0000 7fed22e80640 1 -- 172.21.15.77:0/478546543 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fed1c04b720 con 0x7fed1c0fd820 2024-09-18T21:18:20.193 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.191+0000 7fed197fa640 1 -- 172.21.15.77:0/478546543 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7fed0c07a9c0 con 0x7fed1c0fd820 2024-09-18T21:18:20.193 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-18T21:18:20.193 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": { 2024-09-18T21:18:20.193 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 2 2024-09-18T21:18:20.193 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:18:20.193 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": { 2024-09-18T21:18:20.193 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 2 2024-09-18T21:18:20.193 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:18:20.194 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": { 2024-09-18T21:18:20.194 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 2, 2024-09-18T21:18:20.194 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 4 2024-09-18T21:18:20.194 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:18:20.194 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-09-18T21:18:20.194 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4 2024-09-18T21:18:20.194 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:18:20.194 INFO:teuthology.orchestra.run.smithi077.stdout: "overall": { 2024-09-18T21:18:20.194 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 6, 2024-09-18T21:18:20.194 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 8 2024-09-18T21:18:20.194 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-18T21:18:20.194 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-18T21:18:20.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.193+0000 7fed22e80640 1 -- 172.21.15.77:0/478546543 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fed0806e0b0 msgr2=0x7fed08070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:20.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.193+0000 7fed22e80640 1 --2- 172.21.15.77:0/478546543 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fed0806e0b0 0x7fed08070560 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fed1c071320 tx=0x7fed04009120 comp rx=0 tx=0).stop 2024-09-18T21:18:20.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.193+0000 7fed22e80640 1 -- 172.21.15.77:0/478546543 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed1c0fd820 msgr2=0x7fed1c06fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:20.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.193+0000 7fed22e80640 1 --2- 172.21.15.77:0/478546543 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed1c0fd820 0x7fed1c06fa60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fed0c003080 tx=0x7fed0c009da0 comp rx=0 tx=0).stop 2024-09-18T21:18:20.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.193+0000 7fed22e80640 1 -- 172.21.15.77:0/478546543 shutdown_connections 2024-09-18T21:18:20.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.193+0000 7fed22e80640 1 --2- 172.21.15.77:0/478546543 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed1c0fd820 0x7fed1c06fa60 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:20.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.193+0000 7fed22e80640 1 --2- 172.21.15.77:0/478546543 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fed0806e0b0 0x7fed08070560 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:20.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.193+0000 7fed22e80640 1 --2- 172.21.15.77:0/478546543 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed1c0fc550 0x7fed1c071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:20.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.193+0000 7fed22e80640 1 -- 172.21.15.77:0/478546543 >> 172.21.15.77:0/478546543 conn(0x7fed1c0f7d30 msgr2=0x7fed1c0f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:18:20.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.193+0000 7fed22e80640 1 -- 172.21.15.77:0/478546543 shutdown_connections 2024-09-18T21:18:20.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.193+0000 7fed22e80640 1 -- 172.21.15.77:0/478546543 wait complete. 2024-09-18T21:18:20.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.272+0000 7fd71b3a3640 1 -- 172.21.15.77:0/2871818625 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7140fd490 msgr2=0x7fd7140ff910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:20.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.272+0000 7fd71b3a3640 1 --2- 172.21.15.77:0/2871818625 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7140fd490 0x7fd7140ff910 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd7040048d0 tx=0x7fd704009da0 comp rx=0 tx=0).stop 2024-09-18T21:18:20.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.272+0000 7fd71b3a3640 1 -- 172.21.15.77:0/2871818625 shutdown_connections 2024-09-18T21:18:20.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.272+0000 7fd71b3a3640 1 --2- 172.21.15.77:0/2871818625 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7140fd490 0x7fd7140ff910 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:20.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.272+0000 7fd71b3a3640 1 --2- 172.21.15.77:0/2871818625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd714066790 0x7fd7140fcf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:20.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.272+0000 7fd71b3a3640 1 -- 172.21.15.77:0/2871818625 >> 172.21.15.77:0/2871818625 conn(0x7fd7140f6c10 msgr2=0x7fd7140f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:18:20.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.272+0000 7fd71b3a3640 1 -- 172.21.15.77:0/2871818625 shutdown_connections 2024-09-18T21:18:20.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.272+0000 7fd71b3a3640 1 -- 172.21.15.77:0/2871818625 wait complete. 2024-09-18T21:18:20.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.273+0000 7fd71b3a3640 1 Processor -- start 2024-09-18T21:18:20.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.273+0000 7fd71b3a3640 1 -- start start 2024-09-18T21:18:20.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.273+0000 7fd71b3a3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd714066790 0x7fd7141136d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:18:20.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.273+0000 7fd71b3a3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7140fd490 0x7fd714113c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:18:20.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.273+0000 7fd71b3a3640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd714114260 con 0x7fd714066790 2024-09-18T21:18:20.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.273+0000 7fd71b3a3640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd714114a30 con 0x7fd7140fd490 2024-09-18T21:18:20.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.273+0000 7fd71913f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd714066790 0x7fd7141136d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:18:20.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.273+0000 7fd71913f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd714066790 0x7fd7141136d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58308/0 (socket says 172.21.15.77:58308) 2024-09-18T21:18:20.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.273+0000 7fd71913f640 1 -- 172.21.15.77:0/989332209 learned_addr learned my addr 172.21.15.77:0/989332209 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:18:20.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.273+0000 7fd71913f640 1 -- 172.21.15.77:0/989332209 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7140fd490 msgr2=0x7fd714113c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:20.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.273+0000 7fd71893e640 1 --2- 172.21.15.77:0/989332209 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7140fd490 0x7fd714113c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:18:20.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.274+0000 7fd71913f640 1 --2- 172.21.15.77:0/989332209 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7140fd490 0x7fd714113c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:20.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.274+0000 7fd71913f640 1 -- 172.21.15.77:0/989332209 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd704005040 con 0x7fd714066790 2024-09-18T21:18:20.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.274+0000 7fd71913f640 1 --2- 172.21.15.77:0/989332209 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd714066790 0x7fd7141136d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd71000c810 tx=0x7fd710004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:18:20.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.274+0000 7fd709ffb640 1 -- 172.21.15.77:0/989332209 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd71000a850 con 0x7fd714066790 2024-09-18T21:18:20.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.274+0000 7fd71b3a3640 1 -- 172.21.15.77:0/989332209 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd714114cc0 con 0x7fd714066790 2024-09-18T21:18:20.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.274+0000 7fd709ffb640 1 -- 172.21.15.77:0/989332209 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd71000ae50 con 0x7fd714066790 2024-09-18T21:18:20.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.274+0000 7fd709ffb640 1 -- 172.21.15.77:0/989332209 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7100113a0 con 0x7fd714066790 2024-09-18T21:18:20.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.274+0000 7fd71b3a3640 1 -- 172.21.15.77:0/989332209 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd714115260 con 0x7fd714066790 2024-09-18T21:18:20.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.275+0000 7fd71b3a3640 1 -- 172.21.15.77:0/989332209 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7140fa8b0 con 0x7fd714066790 2024-09-18T21:18:20.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.276+0000 7fd709ffb640 1 -- 172.21.15.77:0/989332209 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd710012400 con 0x7fd714066790 2024-09-18T21:18:20.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.276+0000 7fd709ffb640 1 --2- 172.21.15.77:0/989332209 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fd70006e0b0 0x7fd700070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:18:20.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.276+0000 7fd709ffb640 1 -- 172.21.15.77:0/989332209 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fd71008dcb0 con 0x7fd714066790 2024-09-18T21:18:20.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.276+0000 7fd71893e640 1 --2- 172.21.15.77:0/989332209 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fd70006e0b0 0x7fd700070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:18:20.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.277+0000 7fd71893e640 1 --2- 172.21.15.77:0/989332209 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fd70006e0b0 0x7fd700070560 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd704000c00 tx=0x7fd704009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:18:20.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.281+0000 7fd709ffb640 1 -- 172.21.15.77:0/989332209 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fd710057100 con 0x7fd714066790 2024-09-18T21:18:20.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.478+0000 7fd71b3a3640 1 -- 172.21.15.77:0/989332209 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd71404b720 con 0x7fd714066790 2024-09-18T21:18:20.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.479+0000 7fd709ffb640 1 -- 172.21.15.77:0/989332209 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1915 (secure 0 0 0) 0x7fd71005a7c0 con 0x7fd714066790 2024-09-18T21:18:20.482 INFO:teuthology.orchestra.run.smithi077.stdout:e13 2024-09-18T21:18:20.482 INFO:teuthology.orchestra.run.smithi077.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-18T21:18:20.482 INFO:teuthology.orchestra.run.smithi077.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T21:18:20.482 INFO:teuthology.orchestra.run.smithi077.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T21:18:20.482 INFO:teuthology.orchestra.run.smithi077.stdout:legacy client fscid: 1 2024-09-18T21:18:20.482 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:18:20.482 INFO:teuthology.orchestra.run.smithi077.stdout:Filesystem 'cephfs' (1) 2024-09-18T21:18:20.482 INFO:teuthology.orchestra.run.smithi077.stdout:fs_name cephfs 2024-09-18T21:18:20.482 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 13 2024-09-18T21:18:20.483 INFO:teuthology.orchestra.run.smithi077.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T21:18:20.483 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-09-18T21:10:17.230179+0000 2024-09-18T21:18:20.483 INFO:teuthology.orchestra.run.smithi077.stdout:modified 2024-09-18T21:10:33.373241+0000 2024-09-18T21:18:20.483 INFO:teuthology.orchestra.run.smithi077.stdout:tableserver 0 2024-09-18T21:18:20.483 INFO:teuthology.orchestra.run.smithi077.stdout:root 0 2024-09-18T21:18:20.483 INFO:teuthology.orchestra.run.smithi077.stdout:session_timeout 60 2024-09-18T21:18:20.483 INFO:teuthology.orchestra.run.smithi077.stdout:session_autoclose 300 2024-09-18T21:18:20.483 INFO:teuthology.orchestra.run.smithi077.stdout:max_file_size 1099511627776 2024-09-18T21:18:20.483 INFO:teuthology.orchestra.run.smithi077.stdout:max_xattr_size 65536 2024-09-18T21:18:20.483 INFO:teuthology.orchestra.run.smithi077.stdout:required_client_features {} 2024-09-18T21:18:20.483 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure 0 2024-09-18T21:18:20.483 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure_osd_epoch 0 2024-09-18T21:18:20.484 INFO:teuthology.orchestra.run.smithi077.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T21:18:20.484 INFO:teuthology.orchestra.run.smithi077.stdout:max_mds 1 2024-09-18T21:18:20.484 INFO:teuthology.orchestra.run.smithi077.stdout:in 0 2024-09-18T21:18:20.484 INFO:teuthology.orchestra.run.smithi077.stdout:up {0=14446} 2024-09-18T21:18:20.484 INFO:teuthology.orchestra.run.smithi077.stdout:failed 2024-09-18T21:18:20.484 INFO:teuthology.orchestra.run.smithi077.stdout:damaged 2024-09-18T21:18:20.484 INFO:teuthology.orchestra.run.smithi077.stdout:stopped 2024-09-18T21:18:20.484 INFO:teuthology.orchestra.run.smithi077.stdout:data_pools [3] 2024-09-18T21:18:20.484 INFO:teuthology.orchestra.run.smithi077.stdout:metadata_pool 2 2024-09-18T21:18:20.484 INFO:teuthology.orchestra.run.smithi077.stdout:inline_data disabled 2024-09-18T21:18:20.484 INFO:teuthology.orchestra.run.smithi077.stdout:balancer 2024-09-18T21:18:20.484 INFO:teuthology.orchestra.run.smithi077.stdout:bal_rank_mask -1 2024-09-18T21:18:20.484 INFO:teuthology.orchestra.run.smithi077.stdout:standby_count_wanted 1 2024-09-18T21:18:20.485 INFO:teuthology.orchestra.run.smithi077.stdout:qdb_cluster leader: 0 members: 2024-09-18T21:18:20.485 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.vruydi{0:14446} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.77:6826/334039954,v1:172.21.15.77:6827/334039954] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:18:20.485 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:18:20.485 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:18:20.485 INFO:teuthology.orchestra.run.smithi077.stdout:Standby daemons: 2024-09-18T21:18:20.485 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:18:20.485 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.cqfhlw{-1:14458} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.77:6828/862540650,v1:172.21.15.77:6829/862540650] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:18:20.485 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi103.zhdmdg{-1:24255} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.103:6824/2170237078,v1:172.21.15.103:6825/2170237078] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:18:20.485 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi103.opftmf{-1:24267} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.103:6826/4241818403,v1:172.21.15.103:6827/4241818403] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:18:20.486 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 13 2024-09-18T21:18:20.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.481+0000 7fd71b3a3640 1 -- 172.21.15.77:0/989332209 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fd70006e0b0 msgr2=0x7fd700070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:20.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.481+0000 7fd71b3a3640 1 --2- 172.21.15.77:0/989332209 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fd70006e0b0 0x7fd700070560 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd704000c00 tx=0x7fd704009da0 comp rx=0 tx=0).stop 2024-09-18T21:18:20.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.481+0000 7fd71b3a3640 1 -- 172.21.15.77:0/989332209 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd714066790 msgr2=0x7fd7141136d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:20.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.481+0000 7fd71b3a3640 1 --2- 172.21.15.77:0/989332209 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd714066790 0x7fd7141136d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd71000c810 tx=0x7fd710004430 comp rx=0 tx=0).stop 2024-09-18T21:18:20.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.481+0000 7fd71b3a3640 1 -- 172.21.15.77:0/989332209 shutdown_connections 2024-09-18T21:18:20.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.481+0000 7fd71b3a3640 1 --2- 172.21.15.77:0/989332209 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fd70006e0b0 0x7fd700070560 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:20.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.481+0000 7fd71b3a3640 1 --2- 172.21.15.77:0/989332209 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7140fd490 0x7fd714113c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:20.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.481+0000 7fd71b3a3640 1 --2- 172.21.15.77:0/989332209 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd714066790 0x7fd7141136d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:20.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.481+0000 7fd71b3a3640 1 -- 172.21.15.77:0/989332209 >> 172.21.15.77:0/989332209 conn(0x7fd7140f6c10 msgr2=0x7fd7140f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:18:20.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.481+0000 7fd71b3a3640 1 -- 172.21.15.77:0/989332209 shutdown_connections 2024-09-18T21:18:20.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.481+0000 7fd71b3a3640 1 -- 172.21.15.77:0/989332209 wait complete. 2024-09-18T21:18:20.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.560+0000 7f78a9051640 1 -- 172.21.15.77:0/1628754355 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78a40fd820 msgr2=0x7f78a40fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:20.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.560+0000 7f78a9051640 1 --2- 172.21.15.77:0/1628754355 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78a40fd820 0x7f78a40fdc90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f788c0048d0 tx=0x7f788c009da0 comp rx=0 tx=0).stop 2024-09-18T21:18:20.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.560+0000 7f78a9051640 1 -- 172.21.15.77:0/1628754355 shutdown_connections 2024-09-18T21:18:20.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.560+0000 7f78a9051640 1 --2- 172.21.15.77:0/1628754355 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78a40fd820 0x7f78a40fdc90 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:20.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.560+0000 7f78a9051640 1 --2- 172.21.15.77:0/1628754355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78a40fc550 0x7f78a40fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:20.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.560+0000 7f78a9051640 1 -- 172.21.15.77:0/1628754355 >> 172.21.15.77:0/1628754355 conn(0x7f78a40f7d30 msgr2=0x7f78a40fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:18:20.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.560+0000 7f78a9051640 1 -- 172.21.15.77:0/1628754355 shutdown_connections 2024-09-18T21:18:20.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.560+0000 7f78a9051640 1 -- 172.21.15.77:0/1628754355 wait complete. 2024-09-18T21:18:20.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.560+0000 7f78a9051640 1 Processor -- start 2024-09-18T21:18:20.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.561+0000 7f78a9051640 1 -- start start 2024-09-18T21:18:20.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.561+0000 7f78a9051640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78a40fc550 0x7f78a4071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:18:20.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.561+0000 7f78a9051640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78a40fd820 0x7f78a406fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:18:20.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.561+0000 7f78a9051640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a406fff0 con 0x7f78a40fd820 2024-09-18T21:18:20.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.561+0000 7f78a9051640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a4070130 con 0x7f78a40fc550 2024-09-18T21:18:20.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.561+0000 7f78a259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78a40fd820 0x7f78a406fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:18:20.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.561+0000 7f78a259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78a40fd820 0x7f78a406fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58322/0 (socket says 172.21.15.77:58322) 2024-09-18T21:18:20.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.561+0000 7f78a259c640 1 -- 172.21.15.77:0/1878360968 learned_addr learned my addr 172.21.15.77:0/1878360968 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:18:20.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.561+0000 7f78a2d9d640 1 --2- 172.21.15.77:0/1878360968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78a40fc550 0x7f78a4071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:18:20.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.561+0000 7f78a259c640 1 -- 172.21.15.77:0/1878360968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78a40fc550 msgr2=0x7f78a4071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:20.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.561+0000 7f78a259c640 1 --2- 172.21.15.77:0/1878360968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78a40fc550 0x7f78a4071570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:20.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.561+0000 7f78a259c640 1 -- 172.21.15.77:0/1878360968 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f788c005040 con 0x7f78a40fd820 2024-09-18T21:18:20.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.561+0000 7f78a259c640 1 --2- 172.21.15.77:0/1878360968 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78a40fd820 0x7f78a406fa60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f788c0043d0 tx=0x7f788c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:18:20.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.562+0000 7f789b7fe640 1 -- 172.21.15.77:0/1878360968 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f788c038070 con 0x7f78a40fd820 2024-09-18T21:18:20.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.562+0000 7f789b7fe640 1 -- 172.21.15.77:0/1878360968 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f788c02ae90 con 0x7f78a40fd820 2024-09-18T21:18:20.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.562+0000 7f78a9051640 1 -- 172.21.15.77:0/1878360968 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78a40703b0 con 0x7f78a40fd820 2024-09-18T21:18:20.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.562+0000 7f789b7fe640 1 -- 172.21.15.77:0/1878360968 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f788c03e670 con 0x7f78a40fd820 2024-09-18T21:18:20.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.562+0000 7f78a9051640 1 -- 172.21.15.77:0/1878360968 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a4115100 con 0x7f78a40fd820 2024-09-18T21:18:20.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.563+0000 7f78a9051640 1 -- 172.21.15.77:0/1878360968 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a404b720 con 0x7f78a40fd820 2024-09-18T21:18:20.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.563+0000 7f789b7fe640 1 -- 172.21.15.77:0/1878360968 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f788c030020 con 0x7f78a40fd820 2024-09-18T21:18:20.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.564+0000 7f789b7fe640 1 --2- 172.21.15.77:0/1878360968 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f789006e0b0 0x7f7890070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:18:20.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.564+0000 7f789b7fe640 1 -- 172.21.15.77:0/1878360968 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f788c0add60 con 0x7f78a40fd820 2024-09-18T21:18:20.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.564+0000 7f78a2d9d640 1 --2- 172.21.15.77:0/1878360968 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f789006e0b0 0x7f7890070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:18:20.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.564+0000 7f78a2d9d640 1 --2- 172.21.15.77:0/1878360968 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f789006e0b0 0x7f7890070560 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7894009fd0 tx=0x7f7894009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:18:20.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.571+0000 7f789b7fe640 1 -- 172.21.15.77:0/1878360968 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f788c077130 con 0x7f78a40fd820 2024-09-18T21:18:20.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.753+0000 7f78a9051640 1 -- 172.21.15.77:0/1878360968 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f78a4101c40 con 0x7f789006e0b0 2024-09-18T21:18:20.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.754+0000 7f789b7fe640 1 -- 172.21.15.77:0/1878360968 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f78a4101c40 con 0x7f789006e0b0 2024-09-18T21:18:20.756 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-18T21:18:20.756 INFO:teuthology.orchestra.run.smithi077.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a", 2024-09-18T21:18:20.756 INFO:teuthology.orchestra.run.smithi077.stdout: "in_progress": true, 2024-09-18T21:18:20.756 INFO:teuthology.orchestra.run.smithi077.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T21:18:20.756 INFO:teuthology.orchestra.run.smithi077.stdout: "services_complete": [ 2024-09-18T21:18:20.756 INFO:teuthology.orchestra.run.smithi077.stdout: "mon", 2024-09-18T21:18:20.757 INFO:teuthology.orchestra.run.smithi077.stdout: "crash", 2024-09-18T21:18:20.757 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr" 2024-09-18T21:18:20.757 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-18T21:18:20.757 INFO:teuthology.orchestra.run.smithi077.stdout: "progress": "10/21 daemons upgraded", 2024-09-18T21:18:20.757 INFO:teuthology.orchestra.run.smithi077.stdout: "message": "Currently upgrading osd daemons", 2024-09-18T21:18:20.757 INFO:teuthology.orchestra.run.smithi077.stdout: "is_paused": false 2024-09-18T21:18:20.757 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-18T21:18:20.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.757+0000 7f78a9051640 1 -- 172.21.15.77:0/1878360968 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f789006e0b0 msgr2=0x7f7890070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:20.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.757+0000 7f78a9051640 1 --2- 172.21.15.77:0/1878360968 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f789006e0b0 0x7f7890070560 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7894009fd0 tx=0x7f7894009e90 comp rx=0 tx=0).stop 2024-09-18T21:18:20.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.757+0000 7f78a9051640 1 -- 172.21.15.77:0/1878360968 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78a40fd820 msgr2=0x7f78a406fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:20.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.757+0000 7f78a9051640 1 --2- 172.21.15.77:0/1878360968 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78a40fd820 0x7f78a406fa60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f788c0043d0 tx=0x7f788c009da0 comp rx=0 tx=0).stop 2024-09-18T21:18:20.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.757+0000 7f78a9051640 1 -- 172.21.15.77:0/1878360968 shutdown_connections 2024-09-18T21:18:20.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.757+0000 7f78a9051640 1 --2- 172.21.15.77:0/1878360968 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78a40fd820 0x7f78a406fa60 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:20.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.757+0000 7f78a9051640 1 --2- 172.21.15.77:0/1878360968 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f789006e0b0 0x7f7890070560 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:20.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.757+0000 7f78a9051640 1 --2- 172.21.15.77:0/1878360968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78a40fc550 0x7f78a4071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:20.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.757+0000 7f78a9051640 1 -- 172.21.15.77:0/1878360968 >> 172.21.15.77:0/1878360968 conn(0x7f78a40f7d30 msgr2=0x7f78a40f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:18:20.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.757+0000 7f78a9051640 1 -- 172.21.15.77:0/1878360968 shutdown_connections 2024-09-18T21:18:20.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.757+0000 7f78a9051640 1 -- 172.21.15.77:0/1878360968 wait complete. 2024-09-18T21:18:20.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.834+0000 7fa2a5ac9640 1 -- 172.21.15.77:0/2921920467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2a0065c40 msgr2=0x7fa2a00ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:20.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.834+0000 7fa2a5ac9640 1 --2- 172.21.15.77:0/2921920467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2a0065c40 0x7fa2a00ff140 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa2900048d0 tx=0x7fa290009da0 comp rx=0 tx=0).stop 2024-09-18T21:18:20.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.834+0000 7fa2a5ac9640 1 -- 172.21.15.77:0/2921920467 shutdown_connections 2024-09-18T21:18:20.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.834+0000 7fa2a5ac9640 1 --2- 172.21.15.77:0/2921920467 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2a00ff680 0x7fa2a0101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:20.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.834+0000 7fa2a5ac9640 1 --2- 172.21.15.77:0/2921920467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2a0065c40 0x7fa2a00ff140 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:20.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.834+0000 7fa2a5ac9640 1 -- 172.21.15.77:0/2921920467 >> 172.21.15.77:0/2921920467 conn(0x7fa2a00f6c10 msgr2=0x7fa2a00f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:18:20.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.834+0000 7fa2a5ac9640 1 -- 172.21.15.77:0/2921920467 shutdown_connections 2024-09-18T21:18:20.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.834+0000 7fa2a5ac9640 1 -- 172.21.15.77:0/2921920467 wait complete. 2024-09-18T21:18:20.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.835+0000 7fa2a5ac9640 1 Processor -- start 2024-09-18T21:18:20.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.835+0000 7fa2a5ac9640 1 -- start start 2024-09-18T21:18:20.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.835+0000 7fa2a5ac9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2a0065c40 0x7fa2a010d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:18:20.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.835+0000 7fa2a5ac9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2a00ff680 0x7fa2a010d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:18:20.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.835+0000 7fa2a5ac9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a010dca0 con 0x7fa2a0065c40 2024-09-18T21:18:20.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.835+0000 7fa2a5ac9640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a010e470 con 0x7fa2a00ff680 2024-09-18T21:18:20.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.835+0000 7fa29f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2a0065c40 0x7fa2a010d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:18:20.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.835+0000 7fa29f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2a0065c40 0x7fa2a010d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58336/0 (socket says 172.21.15.77:58336) 2024-09-18T21:18:20.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.835+0000 7fa29effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2a00ff680 0x7fa2a010d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:18:20.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.835+0000 7fa29f7fe640 1 -- 172.21.15.77:0/1827410611 learned_addr learned my addr 172.21.15.77:0/1827410611 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:18:20.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.836+0000 7fa29effd640 1 -- 172.21.15.77:0/1827410611 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2a0065c40 msgr2=0x7fa2a010d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:20.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.836+0000 7fa29effd640 1 --2- 172.21.15.77:0/1827410611 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2a0065c40 0x7fa2a010d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:20.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.836+0000 7fa29effd640 1 -- 172.21.15.77:0/1827410611 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa290005040 con 0x7fa2a00ff680 2024-09-18T21:18:20.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.836+0000 7fa29f7fe640 1 --2- 172.21.15.77:0/1827410611 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2a0065c40 0x7fa2a010d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T21:18:20.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.836+0000 7fa29effd640 1 --2- 172.21.15.77:0/1827410611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2a00ff680 0x7fa2a010d650 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa29400eb40 tx=0x7fa29400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:18:20.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.836+0000 7fa287fff640 1 -- 172.21.15.77:0/1827410611 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa294007c30 con 0x7fa2a00ff680 2024-09-18T21:18:20.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.836+0000 7fa287fff640 1 -- 172.21.15.77:0/1827410611 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa29400f040 con 0x7fa2a00ff680 2024-09-18T21:18:20.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.836+0000 7fa287fff640 1 -- 172.21.15.77:0/1827410611 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2940094a0 con 0x7fa2a00ff680 2024-09-18T21:18:20.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.836+0000 7fa2a5ac9640 1 -- 172.21.15.77:0/1827410611 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2a010e6a0 con 0x7fa2a00ff680 2024-09-18T21:18:20.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.836+0000 7fa2a5ac9640 1 -- 172.21.15.77:0/1827410611 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2a010ebf0 con 0x7fa2a00ff680 2024-09-18T21:18:20.841 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.837+0000 7fa2a5ac9640 1 -- 172.21.15.77:0/1827410611 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2a00fa890 con 0x7fa2a00ff680 2024-09-18T21:18:20.841 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.838+0000 7fa287fff640 1 -- 172.21.15.77:0/1827410611 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fa294009600 con 0x7fa2a00ff680 2024-09-18T21:18:20.841 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.838+0000 7fa287fff640 1 --2- 172.21.15.77:0/1827410611 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fa28806e0b0 0x7fa288070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:18:20.841 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.838+0000 7fa287fff640 1 -- 172.21.15.77:0/1827410611 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fa29408d7e0 con 0x7fa2a00ff680 2024-09-18T21:18:20.841 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.838+0000 7fa29f7fe640 1 --2- 172.21.15.77:0/1827410611 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fa28806e0b0 0x7fa288070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:18:20.841 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.839+0000 7fa29f7fe640 1 --2- 172.21.15.77:0/1827410611 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fa28806e0b0 0x7fa288070560 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa290000c00 tx=0x7fa290035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:18:20.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:20.843+0000 7fa287fff640 1 -- 172.21.15.77:0/1827410611 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fa294056bc0 con 0x7fa2a00ff680 2024-09-18T21:18:21.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:21.076+0000 7fa2a5ac9640 1 -- 172.21.15.77:0/1827410611 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa2a004b720 con 0x7fa2a00ff680 2024-09-18T21:18:21.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:21.076+0000 7fa287fff640 1 -- 172.21.15.77:0/1827410611 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fa29405a280 con 0x7fa2a00ff680 2024-09-18T21:18:21.078 INFO:teuthology.orchestra.run.smithi077.stdout:HEALTH_OK 2024-09-18T21:18:21.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:21.078+0000 7fa2a5ac9640 1 -- 172.21.15.77:0/1827410611 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fa28806e0b0 msgr2=0x7fa288070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:21.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:21.078+0000 7fa2a5ac9640 1 --2- 172.21.15.77:0/1827410611 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fa28806e0b0 0x7fa288070560 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa290000c00 tx=0x7fa290035040 comp rx=0 tx=0).stop 2024-09-18T21:18:21.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:21.078+0000 7fa2a5ac9640 1 -- 172.21.15.77:0/1827410611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2a00ff680 msgr2=0x7fa2a010d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:21.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:21.078+0000 7fa2a5ac9640 1 --2- 172.21.15.77:0/1827410611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2a00ff680 0x7fa2a010d650 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa29400eb40 tx=0x7fa29400b040 comp rx=0 tx=0).stop 2024-09-18T21:18:21.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:21.078+0000 7fa2a5ac9640 1 -- 172.21.15.77:0/1827410611 shutdown_connections 2024-09-18T21:18:21.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:21.078+0000 7fa2a5ac9640 1 --2- 172.21.15.77:0/1827410611 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fa28806e0b0 0x7fa288070560 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:21.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:21.078+0000 7fa2a5ac9640 1 --2- 172.21.15.77:0/1827410611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2a00ff680 0x7fa2a010d650 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:21.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:21.078+0000 7fa2a5ac9640 1 --2- 172.21.15.77:0/1827410611 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2a0065c40 0x7fa2a010d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:21.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:21.078+0000 7fa2a5ac9640 1 -- 172.21.15.77:0/1827410611 >> 172.21.15.77:0/1827410611 conn(0x7fa2a00f6c10 msgr2=0x7fa2a00f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:18:21.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:21.079+0000 7fa2a5ac9640 1 -- 172.21.15.77:0/1827410611 shutdown_connections 2024-09-18T21:18:21.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:21.079+0000 7fa2a5ac9640 1 -- 172.21.15.77:0/1827410611 wait complete. 2024-09-18T21:18:21.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:20 smithi077 ceph-mon[92672]: from='client.34312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:18:21.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:20 smithi077 ceph-mon[92672]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:18:21.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:20 smithi077 ceph-mon[92672]: pgmap v120: 65 pgs: 65 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:18:21.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:20 smithi077 ceph-mon[92672]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:18:21.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:20 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/478546543' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:18:21.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:20 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/989332209' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T21:18:21.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:20 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:21.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:20 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:18:21.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:20 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:21.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:20 smithi103 ceph-mon[80307]: from='client.34312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:18:21.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:20 smithi103 ceph-mon[80307]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:18:21.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:20 smithi103 ceph-mon[80307]: pgmap v120: 65 pgs: 65 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:18:21.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:20 smithi103 ceph-mon[80307]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:18:21.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:20 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/478546543' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:18:21.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:20 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/989332209' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T21:18:21.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:20 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:21.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:20 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:18:21.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:20 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:22.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:21 smithi077 ceph-mon[92672]: from='client.34332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:18:22.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:21 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/1827410611' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T21:18:22.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:21 smithi103 ceph-mon[80307]: from='client.34332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:18:22.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:21 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/1827410611' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T21:18:23.210 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:22 smithi103 ceph-mon[80307]: pgmap v121: 65 pgs: 65 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:18:23.210 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:22 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-18T21:18:23.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:22 smithi077 ceph-mon[92672]: pgmap v121: 65 pgs: 65 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:18:23.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:22 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-18T21:18:24.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:23 smithi077 ceph-mon[92672]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-18T21:18:24.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:23 smithi077 ceph-mon[92672]: Upgrade: osd.4 is safe to restart 2024-09-18T21:18:24.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:23 smithi103 ceph-mon[80307]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-18T21:18:24.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:23 smithi103 ceph-mon[80307]: Upgrade: osd.4 is safe to restart 2024-09-18T21:18:25.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:24 smithi077 ceph-mon[92672]: pgmap v122: 65 pgs: 65 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:18:25.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:24 smithi077 ceph-mon[92672]: Upgrade: Updating osd.4 2024-09-18T21:18:25.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:24 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:25.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:24 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-18T21:18:25.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:24 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:18:25.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:24 smithi077 ceph-mon[92672]: Deploying daemon osd.4 on smithi103 2024-09-18T21:18:25.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:24 smithi103 ceph-mon[80307]: pgmap v122: 65 pgs: 65 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:18:25.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:24 smithi103 ceph-mon[80307]: Upgrade: Updating osd.4 2024-09-18T21:18:25.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:24 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:25.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:24 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-18T21:18:25.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:24 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:18:25.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:24 smithi103 ceph-mon[80307]: Deploying daemon osd.4 on smithi103 2024-09-18T21:18:27.136 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:26 smithi103 ceph-mon[80307]: pgmap v123: 65 pgs: 65 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:18:27.137 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:26 smithi103 systemd[1]: Stopping Ceph osd.4 for 5a76ec16-7601-11ef-bceb-c7b262605968... 2024-09-18T21:18:27.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:26 smithi077 ceph-mon[92672]: pgmap v123: 65 pgs: 65 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:18:27.514 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:27 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4[46966]: 2024-09-18T21:18:27.138+0000 7fe5d8cb0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T21:18:27.514 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:27 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4[46966]: 2024-09-18T21:18:27.138+0000 7fe5d8cb0640 -1 osd.4 66 *** Got signal Terminated *** 2024-09-18T21:18:27.514 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:27 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4[46966]: 2024-09-18T21:18:27.138+0000 7fe5d8cb0640 -1 osd.4 66 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-18T21:18:28.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:27 smithi077 ceph-mon[92672]: osd.4 marked itself down and dead 2024-09-18T21:18:28.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:27 smithi103 ceph-mon[80307]: osd.4 marked itself down and dead 2024-09-18T21:18:28.724 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:28 smithi103 podman[94439]: 2024-09-18 21:18:28.473498691 +0000 UTC m=+1.439205843 container died 85f1ce1e8bee205b3d43de5585f3243cc2f86a3dd82a7c0a128d7781ffc2ba97 (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=quincy-6e06d1e, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-18T21:18:29.014 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:28 smithi103 podman[94439]: 2024-09-18 21:18:28.814863215 +0000 UTC m=+1.780570365 container cleanup 85f1ce1e8bee205b3d43de5585f3243cc2f86a3dd82a7c0a128d7781ffc2ba97 (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=quincy-6e06d1e, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-18T21:18:29.014 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:28 smithi103 bash[94439]: ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4 2024-09-18T21:18:29.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:28 smithi103 ceph-mon[80307]: pgmap v124: 65 pgs: 65 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:18:29.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:28 smithi103 ceph-mon[80307]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-18T21:18:29.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:28 smithi103 ceph-mon[80307]: osdmap e67: 6 total, 5 up, 6 in 2024-09-18T21:18:29.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:28 smithi077 ceph-mon[92672]: pgmap v124: 65 pgs: 65 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:18:29.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:28 smithi077 ceph-mon[92672]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-18T21:18:29.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:28 smithi077 ceph-mon[92672]: osdmap e67: 6 total, 5 up, 6 in 2024-09-18T21:18:29.426 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:29 smithi103 podman[94468]: 2024-09-18 21:18:29.099842172 +0000 UTC m=+0.628198640 container remove 85f1ce1e8bee205b3d43de5585f3243cc2f86a3dd82a7c0a128d7781ffc2ba97 (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=quincy-6e06d1e, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0) 2024-09-18T21:18:29.712 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:29 smithi103 podman[94554]: 2024-09-18 21:18:29.328340439 +0000 UTC m=+0.015824036 image pull f79f744f586d6ce8ddb4b06b7cf36a0f23174bbe29ea68264d2be49d8c6d9acd quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a 2024-09-18T21:18:29.713 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:29 smithi103 podman[94554]: 2024-09-18 21:18:29.434856757 +0000 UTC m=+0.122340336 container create a1ae611a35f5d9e016ce88d453edb295e4815d35f7b151c536da87c871a03f21 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-release-06b1b1d, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-18T21:18:29.713 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:29 smithi103 podman[94554]: 2024-09-18 21:18:29.645658968 +0000 UTC m=+0.333142567 container init a1ae611a35f5d9e016ce88d453edb295e4815d35f7b151c536da87c871a03f21 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=squid-release-06b1b1d, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS) 2024-09-18T21:18:29.713 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:29 smithi103 podman[94554]: 2024-09-18 21:18:29.649016748 +0000 UTC m=+0.336500337 container start a1ae611a35f5d9e016ce88d453edb295e4815d35f7b151c536da87c871a03f21 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-release-06b1b1d, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-18T21:18:29.713 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:29 smithi103 podman[94554]: 2024-09-18 21:18:29.712195846 +0000 UTC m=+0.399679426 container attach a1ae611a35f5d9e016ce88d453edb295e4815d35f7b151c536da87c871a03f21 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-release-06b1b1d) 2024-09-18T21:18:30.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:29 smithi103 ceph-mon[80307]: osdmap e68: 6 total, 5 up, 6 in 2024-09-18T21:18:30.014 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:29 smithi103 podman[94554]: 2024-09-18 21:18:29.839903875 +0000 UTC m=+0.527387458 container died a1ae611a35f5d9e016ce88d453edb295e4815d35f7b151c536da87c871a03f21 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-release-06b1b1d, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T21:18:30.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:29 smithi077 ceph-mon[92672]: osdmap e68: 6 total, 5 up, 6 in 2024-09-18T21:18:30.960 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:30 smithi103 ceph-mon[80307]: pgmap v127: 65 pgs: 4 active+undersized, 8 peering, 3 stale+active+clean, 4 active+undersized+degraded, 46 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 8/222 objects degraded (3.604%) 2024-09-18T21:18:30.960 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:30 smithi103 ceph-mon[80307]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-18T21:18:30.960 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:30 smithi103 ceph-mon[80307]: Health check failed: Degraded data redundancy: 8/222 objects degraded (3.604%), 4 pgs degraded (PG_DEGRADED) 2024-09-18T21:18:30.960 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:30 smithi103 podman[94578]: 2024-09-18 21:18:30.533034354 +0000 UTC m=+0.683097038 container remove a1ae611a35f5d9e016ce88d453edb295e4815d35f7b151c536da87c871a03f21 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-release-06b1b1d, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True) 2024-09-18T21:18:30.960 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:30 smithi103 systemd[1]: ceph-5a76ec16-7601-11ef-bceb-c7b262605968@osd.4.service: Deactivated successfully. 2024-09-18T21:18:30.961 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:30 smithi103 systemd[1]: Stopped Ceph osd.4 for 5a76ec16-7601-11ef-bceb-c7b262605968. 2024-09-18T21:18:30.961 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:30 smithi103 systemd[1]: ceph-5a76ec16-7601-11ef-bceb-c7b262605968@osd.4.service: Consumed 1min 1.443s CPU time. 2024-09-18T21:18:30.961 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:30 smithi103 systemd[1]: Starting Ceph osd.4 for 5a76ec16-7601-11ef-bceb-c7b262605968... 2024-09-18T21:18:31.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:30 smithi077 ceph-mon[92672]: pgmap v127: 65 pgs: 4 active+undersized, 8 peering, 3 stale+active+clean, 4 active+undersized+degraded, 46 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 8/222 objects degraded (3.604%) 2024-09-18T21:18:31.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:30 smithi077 ceph-mon[92672]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-18T21:18:31.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:30 smithi077 ceph-mon[92672]: Health check failed: Degraded data redundancy: 8/222 objects degraded (3.604%), 4 pgs degraded (PG_DEGRADED) 2024-09-18T21:18:31.220 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:30 smithi103 podman[94676]: 2024-09-18 21:18:30.878076046 +0000 UTC m=+0.015858086 image pull f79f744f586d6ce8ddb4b06b7cf36a0f23174bbe29ea68264d2be49d8c6d9acd quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a 2024-09-18T21:18:31.221 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:30 smithi103 podman[94676]: 2024-09-18 21:18:30.996903373 +0000 UTC m=+0.134685404 container create f9368e80a5a674cb02c6e5db0e10afd5d6960f764e68ad08b3efbe2665e6db43 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-release-06b1b1d) 2024-09-18T21:18:31.221 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:31 smithi103 podman[94676]: 2024-09-18 21:18:31.220643969 +0000 UTC m=+0.358426010 container init f9368e80a5a674cb02c6e5db0e10afd5d6960f764e68ad08b3efbe2665e6db43 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-release-06b1b1d) 2024-09-18T21:18:31.514 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:31 smithi103 podman[94676]: 2024-09-18 21:18:31.223897287 +0000 UTC m=+0.361679325 container start f9368e80a5a674cb02c6e5db0e10afd5d6960f764e68ad08b3efbe2665e6db43 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4-activate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-release-06b1b1d, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-18T21:18:31.514 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:31 smithi103 podman[94676]: 2024-09-18 21:18:31.312590626 +0000 UTC m=+0.450372673 container attach f9368e80a5a674cb02c6e5db0e10afd5d6960f764e68ad08b3efbe2665e6db43 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4-activate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-release-06b1b1d, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-18T21:18:31.514 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:31 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4-activate[94691]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T21:18:31.514 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:31 smithi103 bash[94676]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T21:18:31.514 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:31 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4-activate[94691]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T21:18:31.514 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:31 smithi103 bash[94676]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T21:18:31.908 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:31 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4-activate[94691]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-18T21:18:31.908 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:31 smithi103 bash[94676]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-18T21:18:31.908 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:31 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4-activate[94691]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-18T21:18:31.908 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:31 smithi103 bash[94676]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-18T21:18:31.908 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:31 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4-activate[94691]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-18T21:18:31.908 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:31 smithi103 bash[94676]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-18T21:18:31.908 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:31 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4-activate[94691]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-18T21:18:31.909 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:31 smithi103 bash[94676]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-18T21:18:31.909 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:31 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4-activate[94691]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-18T21:18:31.909 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:31 smithi103 bash[94676]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-18T21:18:31.909 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:31 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4-activate[94691]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-18T21:18:31.909 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:31 smithi103 bash[94676]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-18T21:18:31.909 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:31 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4-activate[94691]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-18T21:18:31.909 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:31 smithi103 bash[94676]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-18T21:18:31.909 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:31 smithi103 podman[94676]: 2024-09-18 21:18:31.601691729 +0000 UTC m=+0.739473770 container died f9368e80a5a674cb02c6e5db0e10afd5d6960f764e68ad08b3efbe2665e6db43 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-release-06b1b1d, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-18T21:18:32.490 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:32 smithi103 podman[94812]: 2024-09-18 21:18:32.175313841 +0000 UTC m=+0.562880817 container remove f9368e80a5a674cb02c6e5db0e10afd5d6960f764e68ad08b3efbe2665e6db43 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-release-06b1b1d, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-18T21:18:32.490 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:32 smithi103 podman[94870]: 2024-09-18 21:18:32.384721945 +0000 UTC m=+0.113098684 container create 2cde7eaf88d8bf2fecdfbb45d5669861c74657b6ab9dfdbbdd0856acbcdca93e (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4, GIT_BRANCH=HEAD, RELEASE=squid-release-06b1b1d, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-18T21:18:32.490 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:32 smithi103 podman[94870]: 2024-09-18 21:18:32.287947548 +0000 UTC m=+0.016324291 image pull f79f744f586d6ce8ddb4b06b7cf36a0f23174bbe29ea68264d2be49d8c6d9acd quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a 2024-09-18T21:18:32.963 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:32 smithi103 podman[94870]: 2024-09-18 21:18:32.586979364 +0000 UTC m=+0.315356106 container init 2cde7eaf88d8bf2fecdfbb45d5669861c74657b6ab9dfdbbdd0856acbcdca93e (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-release-06b1b1d, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-18T21:18:32.963 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:32 smithi103 podman[94870]: 2024-09-18 21:18:32.590062496 +0000 UTC m=+0.318439236 container start 2cde7eaf88d8bf2fecdfbb45d5669861c74657b6ab9dfdbbdd0856acbcdca93e (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-release-06b1b1d, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-18T21:18:32.963 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:32 smithi103 ceph-osd[94889]: -- 172.21.15.103:0/1337857102 <== mon.1 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5595bda501e0 con 0x5595bcc69c00 2024-09-18T21:18:32.963 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:32 smithi103 bash[94870]: 2cde7eaf88d8bf2fecdfbb45d5669861c74657b6ab9dfdbbdd0856acbcdca93e 2024-09-18T21:18:32.963 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:32 smithi103 systemd[1]: Started Ceph osd.4 for 5a76ec16-7601-11ef-bceb-c7b262605968. 2024-09-18T21:18:33.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:32 smithi103 ceph-mon[80307]: pgmap v128: 65 pgs: 7 active+undersized, 8 peering, 2 stale+active+clean, 6 active+undersized+degraded, 42 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 15/222 objects degraded (6.757%) 2024-09-18T21:18:33.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:32 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:33.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:32 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:33.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:32 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:18:33.264 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:33 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4[94885]: 2024-09-18T21:18:33.132+0000 7f887992a640 -1 Falling back to public interface 2024-09-18T21:18:33.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:32 smithi077 ceph-mon[92672]: pgmap v128: 65 pgs: 7 active+undersized, 8 peering, 2 stale+active+clean, 6 active+undersized+degraded, 42 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 15/222 objects degraded (6.757%) 2024-09-18T21:18:33.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:32 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:33.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:32 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:33.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:32 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:18:34.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:34 smithi103 ceph-mon[80307]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-18T21:18:34.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:34 smithi077 ceph-mon[92672]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-18T21:18:35.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:35 smithi103 ceph-mon[80307]: pgmap v129: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 39/222 objects degraded (17.568%) 2024-09-18T21:18:35.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:35 smithi077 ceph-mon[92672]: pgmap v129: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 39/222 objects degraded (17.568%) 2024-09-18T21:18:36.652 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:36 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:36.652 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:36 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:36.652 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:36 smithi103 ceph-mon[80307]: pgmap v130: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 39/222 objects degraded (17.568%) 2024-09-18T21:18:36.652 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:36 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:36.652 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:36 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:18:36.652 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:36 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:36.653 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:36 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:36.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:36 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:36.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:36 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:36.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:36 smithi077 ceph-mon[92672]: pgmap v130: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 39/222 objects degraded (17.568%) 2024-09-18T21:18:36.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:36 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:36.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:36 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:18:36.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:36 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:36.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:36 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:38.513 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:38 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4[94885]: 2024-09-18T21:18:38.288+0000 7f887992a640 -1 osd.4 66 log_to_monitors true 2024-09-18T21:18:39.191 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:18:38 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4[94885]: 2024-09-18T21:18:38.901+0000 7f88716c4640 -1 osd.4 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T21:18:39.191 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:38 smithi103 ceph-mon[80307]: pgmap v131: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 39/222 objects degraded (17.568%) 2024-09-18T21:18:39.192 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:38 smithi103 ceph-mon[80307]: Health check update: Degraded data redundancy: 39/222 objects degraded (17.568%), 15 pgs degraded (PG_DEGRADED) 2024-09-18T21:18:39.192 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:38 smithi103 ceph-mon[80307]: from='osd.4 [v2:172.21.15.103:6808/207044895,v1:172.21.15.103:6809/207044895]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-18T21:18:39.192 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:38 smithi103 ceph-mon[80307]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-18T21:18:39.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:38 smithi077 ceph-mon[92672]: pgmap v131: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 203 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 39/222 objects degraded (17.568%) 2024-09-18T21:18:39.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:38 smithi077 ceph-mon[92672]: Health check update: Degraded data redundancy: 39/222 objects degraded (17.568%), 15 pgs degraded (PG_DEGRADED) 2024-09-18T21:18:39.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:38 smithi077 ceph-mon[92672]: from='osd.4 [v2:172.21.15.103:6808/207044895,v1:172.21.15.103:6809/207044895]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-18T21:18:39.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:38 smithi077 ceph-mon[92672]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-18T21:18:40.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:39 smithi077 ceph-mon[92672]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-18T21:18:40.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:39 smithi077 ceph-mon[92672]: osdmap e69: 6 total, 5 up, 6 in 2024-09-18T21:18:40.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:39 smithi077 ceph-mon[92672]: from='osd.4 [v2:172.21.15.103:6808/207044895,v1:172.21.15.103:6809/207044895]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-18T21:18:40.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:39 smithi077 ceph-mon[92672]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-18T21:18:40.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:39 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:40.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:39 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:40.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:39 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:18:40.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:39 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:18:40.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:39 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:40.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:39 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:18:40.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:39 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:18:40.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:39 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:18:40.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:39 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:18:40.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:39 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-18T21:18:40.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:39 smithi103 ceph-mon[80307]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-18T21:18:40.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:39 smithi103 ceph-mon[80307]: osdmap e69: 6 total, 5 up, 6 in 2024-09-18T21:18:40.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:39 smithi103 ceph-mon[80307]: from='osd.4 [v2:172.21.15.103:6808/207044895,v1:172.21.15.103:6809/207044895]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-18T21:18:40.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:39 smithi103 ceph-mon[80307]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-18T21:18:40.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:39 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:40.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:39 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:40.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:39 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:18:40.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:39 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:18:40.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:39 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:40.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:39 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:18:40.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:39 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:18:40.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:39 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:18:40.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:39 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:18:40.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:39 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-18T21:18:41.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:40 smithi077 ceph-mon[92672]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-18T21:18:41.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:40 smithi077 ceph-mon[92672]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-18T21:18:41.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:40 smithi077 ceph-mon[92672]: pgmap v133: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 39/222 objects degraded (17.568%) 2024-09-18T21:18:41.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:40 smithi077 ceph-mon[92672]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-18T21:18:41.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:40 smithi077 ceph-mon[92672]: osd.4 [v2:172.21.15.103:6808/207044895,v1:172.21.15.103:6809/207044895] boot 2024-09-18T21:18:41.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:40 smithi077 ceph-mon[92672]: osdmap e70: 6 total, 6 up, 6 in 2024-09-18T21:18:41.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:40 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T21:18:41.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:40 smithi077 ceph-mon[92672]: osdmap e71: 6 total, 6 up, 6 in 2024-09-18T21:18:41.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:40 smithi103 ceph-mon[80307]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-18T21:18:41.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:40 smithi103 ceph-mon[80307]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-18T21:18:41.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:40 smithi103 ceph-mon[80307]: pgmap v133: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 39/222 objects degraded (17.568%) 2024-09-18T21:18:41.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:40 smithi103 ceph-mon[80307]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-18T21:18:41.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:40 smithi103 ceph-mon[80307]: osd.4 [v2:172.21.15.103:6808/207044895,v1:172.21.15.103:6809/207044895] boot 2024-09-18T21:18:41.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:40 smithi103 ceph-mon[80307]: osdmap e70: 6 total, 6 up, 6 in 2024-09-18T21:18:41.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:40 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-18T21:18:41.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:40 smithi103 ceph-mon[80307]: osdmap e71: 6 total, 6 up, 6 in 2024-09-18T21:18:43.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:42 smithi077 ceph-mon[92672]: pgmap v136: 65 pgs: 16 active+undersized, 14 active+undersized+degraded, 35 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 34/222 objects degraded (15.315%) 2024-09-18T21:18:43.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:42 smithi103 ceph-mon[80307]: pgmap v136: 65 pgs: 16 active+undersized, 14 active+undersized+degraded, 35 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 34/222 objects degraded (15.315%) 2024-09-18T21:18:44.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:43 smithi077 ceph-mon[92672]: Health check update: Degraded data redundancy: 34/222 objects degraded (15.315%), 14 pgs degraded (PG_DEGRADED) 2024-09-18T21:18:44.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:43 smithi103 ceph-mon[80307]: Health check update: Degraded data redundancy: 34/222 objects degraded (15.315%), 14 pgs degraded (PG_DEGRADED) 2024-09-18T21:18:45.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:44 smithi077 ceph-mon[92672]: pgmap v137: 65 pgs: 7 active+undersized, 5 active+undersized+degraded, 53 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 10/222 objects degraded (4.505%) 2024-09-18T21:18:45.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:44 smithi103 ceph-mon[80307]: pgmap v137: 65 pgs: 7 active+undersized, 5 active+undersized+degraded, 53 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 10/222 objects degraded (4.505%) 2024-09-18T21:18:46.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:45 smithi077 ceph-mon[92672]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 10/222 objects degraded (4.505%), 5 pgs degraded) 2024-09-18T21:18:46.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:45 smithi077 ceph-mon[92672]: Cluster is now healthy 2024-09-18T21:18:46.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:45 smithi103 ceph-mon[80307]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 10/222 objects degraded (4.505%), 5 pgs degraded) 2024-09-18T21:18:46.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:45 smithi103 ceph-mon[80307]: Cluster is now healthy 2024-09-18T21:18:47.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:46 smithi077 ceph-mon[92672]: pgmap v138: 65 pgs: 65 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:18:47.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:46 smithi103 ceph-mon[80307]: pgmap v138: 65 pgs: 65 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:18:49.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:48 smithi103 ceph-mon[80307]: pgmap v139: 65 pgs: 65 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:18:49.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:48 smithi077 ceph-mon[92672]: pgmap v139: 65 pgs: 65 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:18:51.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.171+0000 7fa945d7c640 1 -- 172.21.15.77:0/4238887900 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9400fb430 msgr2=0x7fa9400fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:51.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.171+0000 7fa945d7c640 1 --2- 172.21.15.77:0/4238887900 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9400fb430 0x7fa9400fb840 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa9300048d0 tx=0x7fa930009da0 comp rx=0 tx=0).stop 2024-09-18T21:18:51.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.171+0000 7fa945d7c640 1 -- 172.21.15.77:0/4238887900 shutdown_connections 2024-09-18T21:18:51.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.171+0000 7fa945d7c640 1 --2- 172.21.15.77:0/4238887900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9400fc700 0x7fa9400fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:51.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.171+0000 7fa945d7c640 1 --2- 172.21.15.77:0/4238887900 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9400fb430 0x7fa9400fb840 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:51.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.171+0000 7fa945d7c640 1 -- 172.21.15.77:0/4238887900 >> 172.21.15.77:0/4238887900 conn(0x7fa9400f6c10 msgr2=0x7fa9400f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:18:51.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.171+0000 7fa945d7c640 1 -- 172.21.15.77:0/4238887900 shutdown_connections 2024-09-18T21:18:51.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.171+0000 7fa945d7c640 1 -- 172.21.15.77:0/4238887900 wait complete. 2024-09-18T21:18:51.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.172+0000 7fa945d7c640 1 Processor -- start 2024-09-18T21:18:51.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.172+0000 7fa945d7c640 1 -- start start 2024-09-18T21:18:51.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.172+0000 7fa945d7c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9400fb430 0x7fa94010bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:18:51.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.172+0000 7fa945d7c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9400fc700 0x7fa94010c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:18:51.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.172+0000 7fa945d7c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94010caf0 con 0x7fa9400fb430 2024-09-18T21:18:51.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.172+0000 7fa945d7c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94010d310 con 0x7fa9400fc700 2024-09-18T21:18:51.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.172+0000 7fa93f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9400fb430 0x7fa94010bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:18:51.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.172+0000 7fa93f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9400fb430 0x7fa94010bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58682/0 (socket says 172.21.15.77:58682) 2024-09-18T21:18:51.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.172+0000 7fa93f7fe640 1 -- 172.21.15.77:0/1255353893 learned_addr learned my addr 172.21.15.77:0/1255353893 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:18:51.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.172+0000 7fa937fff640 1 --2- 172.21.15.77:0/1255353893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9400fc700 0x7fa94010c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:18:51.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.173+0000 7fa93f7fe640 1 -- 172.21.15.77:0/1255353893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9400fc700 msgr2=0x7fa94010c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:51.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.173+0000 7fa93f7fe640 1 --2- 172.21.15.77:0/1255353893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9400fc700 0x7fa94010c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:51.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.173+0000 7fa93f7fe640 1 -- 172.21.15.77:0/1255353893 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa930005040 con 0x7fa9400fb430 2024-09-18T21:18:51.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.173+0000 7fa93f7fe640 1 --2- 172.21.15.77:0/1255353893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9400fb430 0x7fa94010bf60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa9300043d0 tx=0x7fa930009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:18:51.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.173+0000 7fa93cff9640 1 -- 172.21.15.77:0/1255353893 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa930038070 con 0x7fa9400fb430 2024-09-18T21:18:51.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.173+0000 7fa93cff9640 1 -- 172.21.15.77:0/1255353893 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa93002ae90 con 0x7fa9400fb430 2024-09-18T21:18:51.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.173+0000 7fa945d7c640 1 -- 172.21.15.77:0/1255353893 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa94010d540 con 0x7fa9400fb430 2024-09-18T21:18:51.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.173+0000 7fa93cff9640 1 -- 172.21.15.77:0/1255353893 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa93003e670 con 0x7fa9400fb430 2024-09-18T21:18:51.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.173+0000 7fa945d7c640 1 -- 172.21.15.77:0/1255353893 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa94010da60 con 0x7fa9400fb430 2024-09-18T21:18:51.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.174+0000 7fa945d7c640 1 -- 172.21.15.77:0/1255353893 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9400fa890 con 0x7fa9400fb430 2024-09-18T21:18:51.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.175+0000 7fa93cff9640 1 -- 172.21.15.77:0/1255353893 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fa930030020 con 0x7fa9400fb430 2024-09-18T21:18:51.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.175+0000 7fa93cff9640 1 --2- 172.21.15.77:0/1255353893 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fa92c06e0b0 0x7fa92c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:18:51.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.175+0000 7fa93cff9640 1 -- 172.21.15.77:0/1255353893 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fa9300adda0 con 0x7fa9400fb430 2024-09-18T21:18:51.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.175+0000 7fa937fff640 1 --2- 172.21.15.77:0/1255353893 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fa92c06e0b0 0x7fa92c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:18:51.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.176+0000 7fa937fff640 1 --2- 172.21.15.77:0/1255353893 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fa92c06e0b0 0x7fa92c070560 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa94010bd10 tx=0x7fa928009ed0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:18:51.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.180+0000 7fa93cff9640 1 -- 172.21.15.77:0/1255353893 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fa930077170 con 0x7fa9400fb430 2024-09-18T21:18:51.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:50 smithi103 ceph-mon[80307]: pgmap v140: 65 pgs: 65 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:18:51.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:50 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:51.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:50 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:18:51.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:50 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:51.365 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.364+0000 7fa945d7c640 1 -- 172.21.15.77:0/1255353893 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa94010dd90 con 0x7fa92c06e0b0 2024-09-18T21:18:51.365 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:50 smithi077 ceph-mon[92672]: pgmap v140: 65 pgs: 65 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:18:51.365 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:50 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:51.366 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:50 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:18:51.366 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:50 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:51.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.365+0000 7fa93cff9640 1 -- 172.21.15.77:0/1255353893 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fa94010dd90 con 0x7fa92c06e0b0 2024-09-18T21:18:51.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.367+0000 7fa945d7c640 1 -- 172.21.15.77:0/1255353893 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fa92c06e0b0 msgr2=0x7fa92c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:51.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.367+0000 7fa945d7c640 1 --2- 172.21.15.77:0/1255353893 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fa92c06e0b0 0x7fa92c070560 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa94010bd10 tx=0x7fa928009ed0 comp rx=0 tx=0).stop 2024-09-18T21:18:51.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.367+0000 7fa945d7c640 1 -- 172.21.15.77:0/1255353893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9400fb430 msgr2=0x7fa94010bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:51.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.367+0000 7fa945d7c640 1 --2- 172.21.15.77:0/1255353893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9400fb430 0x7fa94010bf60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa9300043d0 tx=0x7fa930009da0 comp rx=0 tx=0).stop 2024-09-18T21:18:51.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.367+0000 7fa945d7c640 1 -- 172.21.15.77:0/1255353893 shutdown_connections 2024-09-18T21:18:51.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.367+0000 7fa945d7c640 1 --2- 172.21.15.77:0/1255353893 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fa92c06e0b0 0x7fa92c070560 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:51.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.367+0000 7fa945d7c640 1 --2- 172.21.15.77:0/1255353893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa9400fc700 0x7fa94010c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:51.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.367+0000 7fa945d7c640 1 --2- 172.21.15.77:0/1255353893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9400fb430 0x7fa94010bf60 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:51.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.367+0000 7fa945d7c640 1 -- 172.21.15.77:0/1255353893 >> 172.21.15.77:0/1255353893 conn(0x7fa9400f6c10 msgr2=0x7fa9400f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:18:51.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.367+0000 7fa945d7c640 1 -- 172.21.15.77:0/1255353893 shutdown_connections 2024-09-18T21:18:51.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.367+0000 7fa945d7c640 1 -- 172.21.15.77:0/1255353893 wait complete. 2024-09-18T21:18:51.377 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-09-18T21:18:51.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.446+0000 7f61809c5640 1 -- 172.21.15.77:0/2085712453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f617c0fdc60 msgr2=0x7f617c0fe070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:51.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.446+0000 7f61809c5640 1 --2- 172.21.15.77:0/2085712453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f617c0fdc60 0x7f617c0fe070 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f616c0048d0 tx=0x7f616c009da0 comp rx=0 tx=0).stop 2024-09-18T21:18:51.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.446+0000 7f61809c5640 1 -- 172.21.15.77:0/2085712453 shutdown_connections 2024-09-18T21:18:51.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.446+0000 7f61809c5640 1 --2- 172.21.15.77:0/2085712453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f617c0fe5b0 0x7f617c0fa710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:51.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.446+0000 7f61809c5640 1 --2- 172.21.15.77:0/2085712453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f617c0fdc60 0x7f617c0fe070 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:51.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.446+0000 7f61809c5640 1 -- 172.21.15.77:0/2085712453 >> 172.21.15.77:0/2085712453 conn(0x7f617c0f63a0 msgr2=0x7f617c0f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:18:51.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.446+0000 7f61809c5640 1 -- 172.21.15.77:0/2085712453 shutdown_connections 2024-09-18T21:18:51.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.446+0000 7f61809c5640 1 -- 172.21.15.77:0/2085712453 wait complete. 2024-09-18T21:18:51.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.447+0000 7f61809c5640 1 Processor -- start 2024-09-18T21:18:51.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.447+0000 7f61809c5640 1 -- start start 2024-09-18T21:18:51.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.447+0000 7f61809c5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f617c0fdc60 0x7f617c10d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:18:51.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.447+0000 7f61809c5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f617c0fe5b0 0x7f617c10d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:18:51.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.447+0000 7f61809c5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617c10dc20 con 0x7f617c0fdc60 2024-09-18T21:18:51.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.447+0000 7f61809c5640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617c10e440 con 0x7f617c0fe5b0 2024-09-18T21:18:51.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.447+0000 7f617a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f617c0fdc60 0x7f617c10d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:18:51.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.447+0000 7f617a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f617c0fdc60 0x7f617c10d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58708/0 (socket says 172.21.15.77:58708) 2024-09-18T21:18:51.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.447+0000 7f617a59c640 1 -- 172.21.15.77:0/3780707736 learned_addr learned my addr 172.21.15.77:0/3780707736 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:18:51.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.448+0000 7f6171d9b640 1 --2- 172.21.15.77:0/3780707736 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f617c0fe5b0 0x7f617c10d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:18:51.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.448+0000 7f617a59c640 1 -- 172.21.15.77:0/3780707736 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f617c0fe5b0 msgr2=0x7f617c10d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:51.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.448+0000 7f617a59c640 1 --2- 172.21.15.77:0/3780707736 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f617c0fe5b0 0x7f617c10d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:51.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.448+0000 7f617a59c640 1 -- 172.21.15.77:0/3780707736 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f616c005040 con 0x7f617c0fdc60 2024-09-18T21:18:51.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.448+0000 7f617a59c640 1 --2- 172.21.15.77:0/3780707736 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f617c0fdc60 0x7f617c10d090 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f616c003080 tx=0x7f616c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:18:51.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.448+0000 7f61737fe640 1 -- 172.21.15.77:0/3780707736 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f616c038070 con 0x7f617c0fdc60 2024-09-18T21:18:51.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.448+0000 7f61737fe640 1 -- 172.21.15.77:0/3780707736 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f616c02abd0 con 0x7f617c0fdc60 2024-09-18T21:18:51.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.448+0000 7f61809c5640 1 -- 172.21.15.77:0/3780707736 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f617c10e670 con 0x7f617c0fdc60 2024-09-18T21:18:51.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.448+0000 7f61737fe640 1 -- 172.21.15.77:0/3780707736 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f616c03e670 con 0x7f617c0fdc60 2024-09-18T21:18:51.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.448+0000 7f61809c5640 1 -- 172.21.15.77:0/3780707736 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f617c10ec10 con 0x7f617c0fdc60 2024-09-18T21:18:51.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.449+0000 7f61809c5640 1 -- 172.21.15.77:0/3780707736 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f617c0fa040 con 0x7f617c0fdc60 2024-09-18T21:18:51.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.450+0000 7f61737fe640 1 -- 172.21.15.77:0/3780707736 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f616c030020 con 0x7f617c0fdc60 2024-09-18T21:18:51.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.450+0000 7f61737fe640 1 --2- 172.21.15.77:0/3780707736 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f616806e0b0 0x7f6168070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:18:51.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.450+0000 7f61737fe640 1 -- 172.21.15.77:0/3780707736 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f616c0adee0 con 0x7f617c0fdc60 2024-09-18T21:18:51.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.450+0000 7f6171d9b640 1 --2- 172.21.15.77:0/3780707736 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f616806e0b0 0x7f6168070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:18:51.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.450+0000 7f6171d9b640 1 --2- 172.21.15.77:0/3780707736 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f616806e0b0 0x7f6168070560 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f617c10ce40 tx=0x7f6164009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:18:51.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.454+0000 7f61737fe640 1 -- 172.21.15.77:0/3780707736 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f616c0772b0 con 0x7f617c0fdc60 2024-09-18T21:18:51.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.634+0000 7f61809c5640 1 -- 172.21.15.77:0/3780707736 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f617c10ef20 con 0x7f616806e0b0 2024-09-18T21:18:51.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.636+0000 7f61737fe640 1 -- 172.21.15.77:0/3780707736 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f617c10ef20 con 0x7f616806e0b0 2024-09-18T21:18:51.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.638+0000 7f61809c5640 1 -- 172.21.15.77:0/3780707736 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f616806e0b0 msgr2=0x7f6168070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:51.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.638+0000 7f61809c5640 1 --2- 172.21.15.77:0/3780707736 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f616806e0b0 0x7f6168070560 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f617c10ce40 tx=0x7f6164009040 comp rx=0 tx=0).stop 2024-09-18T21:18:51.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.638+0000 7f61809c5640 1 -- 172.21.15.77:0/3780707736 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f617c0fdc60 msgr2=0x7f617c10d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:51.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.638+0000 7f61809c5640 1 --2- 172.21.15.77:0/3780707736 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f617c0fdc60 0x7f617c10d090 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f616c003080 tx=0x7f616c009da0 comp rx=0 tx=0).stop 2024-09-18T21:18:51.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.639+0000 7f61809c5640 1 -- 172.21.15.77:0/3780707736 shutdown_connections 2024-09-18T21:18:51.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.639+0000 7f61809c5640 1 --2- 172.21.15.77:0/3780707736 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f616806e0b0 0x7f6168070560 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:51.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.639+0000 7f61809c5640 1 --2- 172.21.15.77:0/3780707736 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f617c0fe5b0 0x7f617c10d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:51.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.639+0000 7f61809c5640 1 --2- 172.21.15.77:0/3780707736 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f617c0fdc60 0x7f617c10d090 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:51.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.639+0000 7f61809c5640 1 -- 172.21.15.77:0/3780707736 >> 172.21.15.77:0/3780707736 conn(0x7f617c0f63a0 msgr2=0x7f617c0f7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:18:51.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.639+0000 7f61809c5640 1 -- 172.21.15.77:0/3780707736 shutdown_connections 2024-09-18T21:18:51.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.639+0000 7f61809c5640 1 -- 172.21.15.77:0/3780707736 wait complete. 2024-09-18T21:18:51.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.716+0000 7f5c94f03640 1 -- 172.21.15.77:0/3194938397 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c900fc720 msgr2=0x7f5c900fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:51.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.716+0000 7f5c94f03640 1 --2- 172.21.15.77:0/3194938397 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c900fc720 0x7f5c900fcb90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5c780048d0 tx=0x7f5c78009da0 comp rx=0 tx=0).stop 2024-09-18T21:18:51.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.716+0000 7f5c94f03640 1 -- 172.21.15.77:0/3194938397 shutdown_connections 2024-09-18T21:18:51.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.716+0000 7f5c94f03640 1 --2- 172.21.15.77:0/3194938397 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c900fc720 0x7f5c900fcb90 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:51.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.716+0000 7f5c94f03640 1 --2- 172.21.15.77:0/3194938397 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c900fb450 0x7f5c900fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:51.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.716+0000 7f5c94f03640 1 -- 172.21.15.77:0/3194938397 >> 172.21.15.77:0/3194938397 conn(0x7f5c900f6c10 msgr2=0x7f5c900f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:18:51.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.716+0000 7f5c94f03640 1 -- 172.21.15.77:0/3194938397 shutdown_connections 2024-09-18T21:18:51.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.716+0000 7f5c94f03640 1 -- 172.21.15.77:0/3194938397 wait complete. 2024-09-18T21:18:51.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.717+0000 7f5c94f03640 1 Processor -- start 2024-09-18T21:18:51.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.717+0000 7f5c94f03640 1 -- start start 2024-09-18T21:18:51.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.717+0000 7f5c94f03640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c900fb450 0x7f5c9010bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:18:51.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.717+0000 7f5c94f03640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c900fc720 0x7f5c9010c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:18:51.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.717+0000 7f5c94f03640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9010cb70 con 0x7f5c900fc720 2024-09-18T21:18:51.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.717+0000 7f5c94f03640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9010d390 con 0x7f5c900fb450 2024-09-18T21:18:51.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.717+0000 7f5c87fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c900fc720 0x7f5c9010c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:18:51.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.717+0000 7f5c87fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c900fc720 0x7f5c9010c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58724/0 (socket says 172.21.15.77:58724) 2024-09-18T21:18:51.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.717+0000 7f5c87fff640 1 -- 172.21.15.77:0/1270563034 learned_addr learned my addr 172.21.15.77:0/1270563034 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:18:51.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.717+0000 7f5c8e59c640 1 --2- 172.21.15.77:0/1270563034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c900fb450 0x7f5c9010bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:18:51.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.717+0000 7f5c87fff640 1 -- 172.21.15.77:0/1270563034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c900fb450 msgr2=0x7f5c9010bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:51.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.717+0000 7f5c87fff640 1 --2- 172.21.15.77:0/1270563034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c900fb450 0x7f5c9010bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:51.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.717+0000 7f5c87fff640 1 -- 172.21.15.77:0/1270563034 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c78005040 con 0x7f5c900fc720 2024-09-18T21:18:51.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.718+0000 7f5c87fff640 1 --2- 172.21.15.77:0/1270563034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c900fc720 0x7f5c9010c520 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5c780043d0 tx=0x7f5c78009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:18:51.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.718+0000 7f5c86ffd640 1 -- 172.21.15.77:0/1270563034 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c78038070 con 0x7f5c900fc720 2024-09-18T21:18:51.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.718+0000 7f5c86ffd640 1 -- 172.21.15.77:0/1270563034 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5c7802ae90 con 0x7f5c900fc720 2024-09-18T21:18:51.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.718+0000 7f5c94f03640 1 -- 172.21.15.77:0/1270563034 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c9010d5c0 con 0x7f5c900fc720 2024-09-18T21:18:51.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.718+0000 7f5c86ffd640 1 -- 172.21.15.77:0/1270563034 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c7803e670 con 0x7f5c900fc720 2024-09-18T21:18:51.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.718+0000 7f5c94f03640 1 -- 172.21.15.77:0/1270563034 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c9010db60 con 0x7f5c900fc720 2024-09-18T21:18:51.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.719+0000 7f5c94f03640 1 -- 172.21.15.77:0/1270563034 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c900fa8b0 con 0x7f5c900fc720 2024-09-18T21:18:51.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.719+0000 7f5c86ffd640 1 -- 172.21.15.77:0/1270563034 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5c78030020 con 0x7f5c900fc720 2024-09-18T21:18:51.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.720+0000 7f5c86ffd640 1 --2- 172.21.15.77:0/1270563034 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f5c7c06e0b0 0x7f5c7c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:18:51.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.720+0000 7f5c86ffd640 1 -- 172.21.15.77:0/1270563034 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f5c780adc90 con 0x7f5c900fc720 2024-09-18T21:18:51.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.720+0000 7f5c8e59c640 1 --2- 172.21.15.77:0/1270563034 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f5c7c06e0b0 0x7f5c7c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:18:51.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.720+0000 7f5c8e59c640 1 --2- 172.21.15.77:0/1270563034 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f5c7c06e0b0 0x7f5c7c070560 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5c80004ed0 tx=0x7f5c8000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:18:51.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.724+0000 7f5c86ffd640 1 -- 172.21.15.77:0/1270563034 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f5c78077110 con 0x7f5c900fc720 2024-09-18T21:18:51.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.900+0000 7f5c94f03640 1 -- 172.21.15.77:0/1270563034 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c9010def0 con 0x7f5c7c06e0b0 2024-09-18T21:18:51.910 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.909+0000 7f5c86ffd640 1 -- 172.21.15.77:0/1270563034 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f5c9010def0 con 0x7f5c7c06e0b0 2024-09-18T21:18:51.911 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T21:18:51.911 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager.smithi077 smithi077 *:9093,9094 running (5m) 80s ago 13m 24.2M - 0.25.0 c8568f914cd2 b201d325a55b 2024-09-18T21:18:51.911 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi077 smithi077 running (2m) 80s ago 13m 6891k - 19.1.1-17-g06b1b1de f79f744f586d 5872fa24b792 2024-09-18T21:18:51.911 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi103 smithi103 running (2m) 16s ago 12m 6887k - 19.1.1-17-g06b1b1de f79f744f586d cd1604469f34 2024-09-18T21:18:51.911 INFO:teuthology.orchestra.run.smithi077.stdout:grafana.smithi077 smithi077 *:3000 running (5m) 80s ago 13m 83.1M - 9.4.7 954c08fa6188 d06ef3ab9e66 2024-09-18T21:18:51.911 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.cqfhlw smithi077 running (8m) 80s ago 8m 14.8M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 a7ec3b7701b6 2024-09-18T21:18:51.911 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.vruydi smithi077 running (8m) 80s ago 8m 141M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 affbba097d3b 2024-09-18T21:18:51.911 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi103.opftmf smithi103 running (8m) 16s ago 8m 17.1M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 111f884c5a34 2024-09-18T21:18:51.911 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi103.zhdmdg smithi103 running (8m) 16s ago 8m 16.3M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 50b77d0edda5 2024-09-18T21:18:51.911 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi077.utkpjg smithi077 *:8443,9283,8765 running (4m) 80s ago 14m 502M - 19.1.1-17-g06b1b1de f79f744f586d 99d4b0fd70f6 2024-09-18T21:18:51.911 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi103.zjztqc smithi103 *:8443,9283,8765 running (4m) 16s ago 12m 440M - 19.1.1-17-g06b1b1de f79f744f586d 54589547c4d7 2024-09-18T21:18:51.911 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi077 smithi077 running (3m) 80s ago 15m 45.3M 2048M 19.1.1-17-g06b1b1de f79f744f586d 2d0fbbea1264 2024-09-18T21:18:51.912 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi103 smithi103 running (3m) 16s ago 12m 39.4M 2048M 19.1.1-17-g06b1b1de f79f744f586d dc79edbd9602 2024-09-18T21:18:51.912 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi077 smithi077 *:9100 running (5m) 80s ago 13m 14.8M - 1.5.0 0da6a335fe13 99144245c1af 2024-09-18T21:18:51.912 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi103 smithi103 *:9100 running (5m) 16s ago 12m 16.3M - 1.5.0 0da6a335fe13 e5b51144d997 2024-09-18T21:18:51.912 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (2m) 80s ago 12m 89.4M 1557M 19.1.1-17-g06b1b1de f79f744f586d 8855b4b16e00 2024-09-18T21:18:51.912 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi077 running (2m) 80s ago 11m 98.9M 1557M 19.1.1-17-g06b1b1de f79f744f586d 2d8bc9cac96c 2024-09-18T21:18:51.912 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi077 running (85s) 80s ago 11m 11.9M 1557M 19.1.1-17-g06b1b1de f79f744f586d 93876f1d398d 2024-09-18T21:18:51.912 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi103 running (51s) 16s ago 10m 108M 2581M 19.1.1-17-g06b1b1de f79f744f586d 2556b257bf1c 2024-09-18T21:18:51.912 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi103 running (19s) 16s ago 10m 11.6M 2581M 19.1.1-17-g06b1b1de f79f744f586d 2cde7eaf88d8 2024-09-18T21:18:51.912 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi103 running (9m) 16s ago 9m 227M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 cf8964b3ac6d 2024-09-18T21:18:51.912 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus.smithi077 smithi077 *:9095 running (4m) 80s ago 13m 58.5M - 2.43.0 a07b618ecd1d 41f3729e3400 2024-09-18T21:18:51.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.911+0000 7f5c94f03640 1 -- 172.21.15.77:0/1270563034 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f5c7c06e0b0 msgr2=0x7f5c7c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:51.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.911+0000 7f5c94f03640 1 --2- 172.21.15.77:0/1270563034 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f5c7c06e0b0 0x7f5c7c070560 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5c80004ed0 tx=0x7f5c8000b040 comp rx=0 tx=0).stop 2024-09-18T21:18:51.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.911+0000 7f5c94f03640 1 -- 172.21.15.77:0/1270563034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c900fc720 msgr2=0x7f5c9010c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:51.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.911+0000 7f5c94f03640 1 --2- 172.21.15.77:0/1270563034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c900fc720 0x7f5c9010c520 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5c780043d0 tx=0x7f5c78009da0 comp rx=0 tx=0).stop 2024-09-18T21:18:51.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.911+0000 7f5c94f03640 1 -- 172.21.15.77:0/1270563034 shutdown_connections 2024-09-18T21:18:51.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.911+0000 7f5c94f03640 1 --2- 172.21.15.77:0/1270563034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c900fc720 0x7f5c9010c520 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:51.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.911+0000 7f5c94f03640 1 --2- 172.21.15.77:0/1270563034 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f5c7c06e0b0 0x7f5c7c070560 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:51.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.911+0000 7f5c94f03640 1 --2- 172.21.15.77:0/1270563034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c900fb450 0x7f5c9010bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:51.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.911+0000 7f5c94f03640 1 -- 172.21.15.77:0/1270563034 >> 172.21.15.77:0/1270563034 conn(0x7f5c900f6c10 msgr2=0x7f5c900f8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:18:51.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.912+0000 7f5c94f03640 1 -- 172.21.15.77:0/1270563034 shutdown_connections 2024-09-18T21:18:51.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.912+0000 7f5c94f03640 1 -- 172.21.15.77:0/1270563034 wait complete. 2024-09-18T21:18:51.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.989+0000 7f6696d00640 1 -- 172.21.15.77:0/4182289448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66900fd810 msgr2=0x7f66900fdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:51.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.989+0000 7f6696d00640 1 --2- 172.21.15.77:0/4182289448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66900fd810 0x7f66900fdc80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6684009c50 tx=0x7f6684004d10 comp rx=0 tx=0).stop 2024-09-18T21:18:51.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.989+0000 7f6696d00640 1 -- 172.21.15.77:0/4182289448 shutdown_connections 2024-09-18T21:18:51.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.989+0000 7f6696d00640 1 --2- 172.21.15.77:0/4182289448 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66900fd810 0x7f66900fdc80 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:51.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.989+0000 7f6696d00640 1 --2- 172.21.15.77:0/4182289448 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66900fc540 0x7f66900fc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:51.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.989+0000 7f6696d00640 1 -- 172.21.15.77:0/4182289448 >> 172.21.15.77:0/4182289448 conn(0x7f66900f7ce0 msgr2=0x7f66900fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:18:51.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.989+0000 7f6696d00640 1 -- 172.21.15.77:0/4182289448 shutdown_connections 2024-09-18T21:18:51.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.989+0000 7f6696d00640 1 -- 172.21.15.77:0/4182289448 wait complete. 2024-09-18T21:18:51.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.990+0000 7f6696d00640 1 Processor -- start 2024-09-18T21:18:51.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.990+0000 7f6696d00640 1 -- start start 2024-09-18T21:18:51.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.990+0000 7f6696d00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66900fc540 0x7f669010d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:18:51.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.990+0000 7f6696d00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66900fd810 0x7f669010d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:18:51.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.990+0000 7f6696d00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669010e4a0 con 0x7f66900fc540 2024-09-18T21:18:51.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.990+0000 7f6696d00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669010e610 con 0x7f66900fd810 2024-09-18T21:18:51.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.990+0000 7f6694a9c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66900fc540 0x7f669010d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:18:51.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.990+0000 7f6694a9c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66900fc540 0x7f669010d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58742/0 (socket says 172.21.15.77:58742) 2024-09-18T21:18:51.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.990+0000 7f6694a9c640 1 -- 172.21.15.77:0/3440508673 learned_addr learned my addr 172.21.15.77:0/3440508673 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:18:51.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.990+0000 7f668ffff640 1 --2- 172.21.15.77:0/3440508673 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66900fd810 0x7f669010d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:18:51.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.991+0000 7f6694a9c640 1 -- 172.21.15.77:0/3440508673 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66900fd810 msgr2=0x7f669010d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:51.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.991+0000 7f6694a9c640 1 --2- 172.21.15.77:0/3440508673 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66900fd810 0x7f669010d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:51.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.991+0000 7f6694a9c640 1 -- 172.21.15.77:0/3440508673 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66840098b0 con 0x7f66900fc540 2024-09-18T21:18:51.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.991+0000 7f6694a9c640 1 --2- 172.21.15.77:0/3440508673 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66900fc540 0x7f669010d0f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f668000b790 tx=0x7f66800091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:18:51.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.991+0000 7f668d7fa640 1 -- 172.21.15.77:0/3440508673 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f668000c700 con 0x7f66900fc540 2024-09-18T21:18:51.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.991+0000 7f668d7fa640 1 -- 172.21.15.77:0/3440508673 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f668000cd00 con 0x7f66900fc540 2024-09-18T21:18:51.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.991+0000 7f668d7fa640 1 -- 172.21.15.77:0/3440508673 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6680015e70 con 0x7f66900fc540 2024-09-18T21:18:51.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.991+0000 7f6696d00640 1 -- 172.21.15.77:0/3440508673 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f669010e8f0 con 0x7f66900fc540 2024-09-18T21:18:51.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.991+0000 7f6696d00640 1 -- 172.21.15.77:0/3440508673 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f669010ede0 con 0x7f66900fc540 2024-09-18T21:18:51.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.992+0000 7f6696d00640 1 -- 172.21.15.77:0/3440508673 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f669010dd10 con 0x7f66900fc540 2024-09-18T21:18:51.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.993+0000 7f668d7fa640 1 -- 172.21.15.77:0/3440508673 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f6680012070 con 0x7f66900fc540 2024-09-18T21:18:51.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.993+0000 7f668d7fa640 1 --2- 172.21.15.77:0/3440508673 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f667806e0b0 0x7f6678070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:18:51.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.993+0000 7f668d7fa640 1 -- 172.21.15.77:0/3440508673 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f668008d5e0 con 0x7f66900fc540 2024-09-18T21:18:51.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.993+0000 7f668ffff640 1 --2- 172.21.15.77:0/3440508673 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f667806e0b0 0x7f6678070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:18:51.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.994+0000 7f668ffff640 1 --2- 172.21.15.77:0/3440508673 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f667806e0b0 0x7f6678070560 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6684000f80 tx=0x7f6684004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:18:51.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:51.998+0000 7f668d7fa640 1 -- 172.21.15.77:0/3440508673 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f66800569b0 con 0x7f66900fc540 2024-09-18T21:18:52.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.230+0000 7f6696d00640 1 -- 172.21.15.77:0/3440508673 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f669010f060 con 0x7f66900fc540 2024-09-18T21:18:52.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.231+0000 7f668d7fa640 1 -- 172.21.15.77:0/3440508673 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7f668005a070 con 0x7f66900fc540 2024-09-18T21:18:52.232 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-18T21:18:52.232 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": { 2024-09-18T21:18:52.232 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 2 2024-09-18T21:18:52.232 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:18:52.232 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": { 2024-09-18T21:18:52.232 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 2 2024-09-18T21:18:52.232 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:18:52.233 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": { 2024-09-18T21:18:52.233 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 1, 2024-09-18T21:18:52.233 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 5 2024-09-18T21:18:52.233 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:18:52.233 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-09-18T21:18:52.233 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4 2024-09-18T21:18:52.233 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:18:52.233 INFO:teuthology.orchestra.run.smithi077.stdout: "overall": { 2024-09-18T21:18:52.233 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 5, 2024-09-18T21:18:52.233 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 9 2024-09-18T21:18:52.233 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-18T21:18:52.233 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-18T21:18:52.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.233+0000 7f6696d00640 1 -- 172.21.15.77:0/3440508673 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f667806e0b0 msgr2=0x7f6678070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:52.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.233+0000 7f6696d00640 1 --2- 172.21.15.77:0/3440508673 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f667806e0b0 0x7f6678070560 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6684000f80 tx=0x7f6684004d10 comp rx=0 tx=0).stop 2024-09-18T21:18:52.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.233+0000 7f6696d00640 1 -- 172.21.15.77:0/3440508673 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66900fc540 msgr2=0x7f669010d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:52.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.233+0000 7f6696d00640 1 --2- 172.21.15.77:0/3440508673 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66900fc540 0x7f669010d0f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f668000b790 tx=0x7f66800091d0 comp rx=0 tx=0).stop 2024-09-18T21:18:52.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.233+0000 7f6696d00640 1 -- 172.21.15.77:0/3440508673 shutdown_connections 2024-09-18T21:18:52.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.233+0000 7f6696d00640 1 --2- 172.21.15.77:0/3440508673 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f667806e0b0 0x7f6678070560 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:52.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.233+0000 7f6696d00640 1 --2- 172.21.15.77:0/3440508673 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66900fd810 0x7f669010d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:52.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.233+0000 7f6696d00640 1 --2- 172.21.15.77:0/3440508673 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66900fc540 0x7f669010d0f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:52.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.233+0000 7f6696d00640 1 -- 172.21.15.77:0/3440508673 >> 172.21.15.77:0/3440508673 conn(0x7f66900f7ce0 msgr2=0x7f66900f94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:18:52.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.233+0000 7f6696d00640 1 -- 172.21.15.77:0/3440508673 shutdown_connections 2024-09-18T21:18:52.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.233+0000 7f6696d00640 1 -- 172.21.15.77:0/3440508673 wait complete. 2024-09-18T21:18:52.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.312+0000 7f41858da640 1 -- 172.21.15.77:0/1637490519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41800fb450 msgr2=0x7f41800fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:52.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.312+0000 7f41858da640 1 --2- 172.21.15.77:0/1637490519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41800fb450 0x7f41800fb860 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f41700048d0 tx=0x7f4170009da0 comp rx=0 tx=0).stop 2024-09-18T21:18:52.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.312+0000 7f41858da640 1 -- 172.21.15.77:0/1637490519 shutdown_connections 2024-09-18T21:18:52.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.312+0000 7f41858da640 1 --2- 172.21.15.77:0/1637490519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41800fc720 0x7f41800fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:52.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.312+0000 7f41858da640 1 --2- 172.21.15.77:0/1637490519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41800fb450 0x7f41800fb860 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:52.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.312+0000 7f41858da640 1 -- 172.21.15.77:0/1637490519 >> 172.21.15.77:0/1637490519 conn(0x7f41800f6c10 msgr2=0x7f41800f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:18:52.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.312+0000 7f41858da640 1 -- 172.21.15.77:0/1637490519 shutdown_connections 2024-09-18T21:18:52.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.312+0000 7f41858da640 1 -- 172.21.15.77:0/1637490519 wait complete. 2024-09-18T21:18:52.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.313+0000 7f41858da640 1 Processor -- start 2024-09-18T21:18:52.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.313+0000 7f41858da640 1 -- start start 2024-09-18T21:18:52.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.313+0000 7f41858da640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41800fb450 0x7f418010fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:18:52.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.313+0000 7f41858da640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41800fc720 0x7f4180112360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:18:52.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.313+0000 7f41858da640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4180066750 con 0x7f41800fc720 2024-09-18T21:18:52.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.313+0000 7f41858da640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41800668c0 con 0x7f41800fb450 2024-09-18T21:18:52.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.313+0000 7f417e7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41800fc720 0x7f4180112360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:18:52.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.313+0000 7f417e7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41800fc720 0x7f4180112360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58760/0 (socket says 172.21.15.77:58760) 2024-09-18T21:18:52.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.313+0000 7f417e7fc640 1 -- 172.21.15.77:0/4079458237 learned_addr learned my addr 172.21.15.77:0/4079458237 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:18:52.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.313+0000 7f417effd640 1 --2- 172.21.15.77:0/4079458237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41800fb450 0x7f418010fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:18:52.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.313+0000 7f417e7fc640 1 -- 172.21.15.77:0/4079458237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41800fb450 msgr2=0x7f418010fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:52.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.313+0000 7f417e7fc640 1 --2- 172.21.15.77:0/4079458237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41800fb450 0x7f418010fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:52.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.313+0000 7f417e7fc640 1 -- 172.21.15.77:0/4079458237 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4170005040 con 0x7f41800fc720 2024-09-18T21:18:52.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.314+0000 7f417e7fc640 1 --2- 172.21.15.77:0/4079458237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41800fc720 0x7f4180112360 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4174002a50 tx=0x7f4174004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:18:52.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.314+0000 7f41677fe640 1 -- 172.21.15.77:0/4079458237 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4174007c30 con 0x7f41800fc720 2024-09-18T21:18:52.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.314+0000 7f41677fe640 1 -- 172.21.15.77:0/4079458237 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f417400f040 con 0x7f41800fc720 2024-09-18T21:18:52.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.314+0000 7f41858da640 1 -- 172.21.15.77:0/4079458237 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4180112900 con 0x7f41800fc720 2024-09-18T21:18:52.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.314+0000 7f41677fe640 1 -- 172.21.15.77:0/4079458237 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f417400da90 con 0x7f41800fc720 2024-09-18T21:18:52.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.314+0000 7f41858da640 1 -- 172.21.15.77:0/4079458237 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4180112ea0 con 0x7f41800fc720 2024-09-18T21:18:52.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.315+0000 7f41858da640 1 -- 172.21.15.77:0/4079458237 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41800fa8b0 con 0x7f41800fc720 2024-09-18T21:18:52.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.315+0000 7f41677fe640 1 -- 172.21.15.77:0/4079458237 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f417400dd00 con 0x7f41800fc720 2024-09-18T21:18:52.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.316+0000 7f41677fe640 1 --2- 172.21.15.77:0/4079458237 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f416806e0b0 0x7f4168070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:18:52.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.316+0000 7f41677fe640 1 -- 172.21.15.77:0/4079458237 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f417408d490 con 0x7f41800fc720 2024-09-18T21:18:52.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.316+0000 7f417effd640 1 --2- 172.21.15.77:0/4079458237 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f416806e0b0 0x7f4168070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:18:52.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.316+0000 7f417effd640 1 --2- 172.21.15.77:0/4079458237 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f416806e0b0 0x7f4168070560 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4170007ac0 tx=0x7f4170035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:18:52.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.320+0000 7f41677fe640 1 -- 172.21.15.77:0/4079458237 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f41740567c0 con 0x7f41800fc720 2024-09-18T21:18:52.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.519+0000 7f41858da640 1 -- 172.21.15.77:0/4079458237 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4180113190 con 0x7f41800fc720 2024-09-18T21:18:52.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.520+0000 7f41677fe640 1 -- 172.21.15.77:0/4079458237 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1915 (secure 0 0 0) 0x7f4174059e80 con 0x7f41800fc720 2024-09-18T21:18:52.521 INFO:teuthology.orchestra.run.smithi077.stdout:e13 2024-09-18T21:18:52.521 INFO:teuthology.orchestra.run.smithi077.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-18T21:18:52.521 INFO:teuthology.orchestra.run.smithi077.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T21:18:52.521 INFO:teuthology.orchestra.run.smithi077.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T21:18:52.521 INFO:teuthology.orchestra.run.smithi077.stdout:legacy client fscid: 1 2024-09-18T21:18:52.522 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:18:52.522 INFO:teuthology.orchestra.run.smithi077.stdout:Filesystem 'cephfs' (1) 2024-09-18T21:18:52.522 INFO:teuthology.orchestra.run.smithi077.stdout:fs_name cephfs 2024-09-18T21:18:52.522 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 13 2024-09-18T21:18:52.522 INFO:teuthology.orchestra.run.smithi077.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T21:18:52.522 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-09-18T21:10:17.230179+0000 2024-09-18T21:18:52.522 INFO:teuthology.orchestra.run.smithi077.stdout:modified 2024-09-18T21:10:33.373241+0000 2024-09-18T21:18:52.522 INFO:teuthology.orchestra.run.smithi077.stdout:tableserver 0 2024-09-18T21:18:52.522 INFO:teuthology.orchestra.run.smithi077.stdout:root 0 2024-09-18T21:18:52.522 INFO:teuthology.orchestra.run.smithi077.stdout:session_timeout 60 2024-09-18T21:18:52.522 INFO:teuthology.orchestra.run.smithi077.stdout:session_autoclose 300 2024-09-18T21:18:52.522 INFO:teuthology.orchestra.run.smithi077.stdout:max_file_size 1099511627776 2024-09-18T21:18:52.522 INFO:teuthology.orchestra.run.smithi077.stdout:max_xattr_size 65536 2024-09-18T21:18:52.523 INFO:teuthology.orchestra.run.smithi077.stdout:required_client_features {} 2024-09-18T21:18:52.523 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure 0 2024-09-18T21:18:52.523 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure_osd_epoch 0 2024-09-18T21:18:52.523 INFO:teuthology.orchestra.run.smithi077.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T21:18:52.523 INFO:teuthology.orchestra.run.smithi077.stdout:max_mds 1 2024-09-18T21:18:52.523 INFO:teuthology.orchestra.run.smithi077.stdout:in 0 2024-09-18T21:18:52.523 INFO:teuthology.orchestra.run.smithi077.stdout:up {0=14446} 2024-09-18T21:18:52.523 INFO:teuthology.orchestra.run.smithi077.stdout:failed 2024-09-18T21:18:52.523 INFO:teuthology.orchestra.run.smithi077.stdout:damaged 2024-09-18T21:18:52.523 INFO:teuthology.orchestra.run.smithi077.stdout:stopped 2024-09-18T21:18:52.523 INFO:teuthology.orchestra.run.smithi077.stdout:data_pools [3] 2024-09-18T21:18:52.523 INFO:teuthology.orchestra.run.smithi077.stdout:metadata_pool 2 2024-09-18T21:18:52.523 INFO:teuthology.orchestra.run.smithi077.stdout:inline_data disabled 2024-09-18T21:18:52.523 INFO:teuthology.orchestra.run.smithi077.stdout:balancer 2024-09-18T21:18:52.524 INFO:teuthology.orchestra.run.smithi077.stdout:bal_rank_mask -1 2024-09-18T21:18:52.524 INFO:teuthology.orchestra.run.smithi077.stdout:standby_count_wanted 1 2024-09-18T21:18:52.524 INFO:teuthology.orchestra.run.smithi077.stdout:qdb_cluster leader: 0 members: 2024-09-18T21:18:52.524 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.vruydi{0:14446} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.77:6826/334039954,v1:172.21.15.77:6827/334039954] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:18:52.524 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:18:52.524 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:18:52.524 INFO:teuthology.orchestra.run.smithi077.stdout:Standby daemons: 2024-09-18T21:18:52.524 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:18:52.524 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.cqfhlw{-1:14458} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.77:6828/862540650,v1:172.21.15.77:6829/862540650] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:18:52.524 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi103.zhdmdg{-1:24255} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.103:6824/2170237078,v1:172.21.15.103:6825/2170237078] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:18:52.524 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi103.opftmf{-1:24267} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.103:6826/4241818403,v1:172.21.15.103:6827/4241818403] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:18:52.525 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 13 2024-09-18T21:18:52.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.522+0000 7f41858da640 1 -- 172.21.15.77:0/4079458237 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f416806e0b0 msgr2=0x7f4168070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:52.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.522+0000 7f41858da640 1 --2- 172.21.15.77:0/4079458237 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f416806e0b0 0x7f4168070560 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4170007ac0 tx=0x7f4170035040 comp rx=0 tx=0).stop 2024-09-18T21:18:52.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.522+0000 7f41858da640 1 -- 172.21.15.77:0/4079458237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41800fc720 msgr2=0x7f4180112360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:52.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.522+0000 7f41858da640 1 --2- 172.21.15.77:0/4079458237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41800fc720 0x7f4180112360 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4174002a50 tx=0x7f4174004600 comp rx=0 tx=0).stop 2024-09-18T21:18:52.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.522+0000 7f41858da640 1 -- 172.21.15.77:0/4079458237 shutdown_connections 2024-09-18T21:18:52.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.522+0000 7f41858da640 1 --2- 172.21.15.77:0/4079458237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41800fc720 0x7f4180112360 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:52.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.522+0000 7f41858da640 1 --2- 172.21.15.77:0/4079458237 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f416806e0b0 0x7f4168070560 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:52.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.522+0000 7f41858da640 1 --2- 172.21.15.77:0/4079458237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41800fb450 0x7f418010fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:52.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.522+0000 7f41858da640 1 -- 172.21.15.77:0/4079458237 >> 172.21.15.77:0/4079458237 conn(0x7f41800f6c10 msgr2=0x7f41800f8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:18:52.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.522+0000 7f41858da640 1 -- 172.21.15.77:0/4079458237 shutdown_connections 2024-09-18T21:18:52.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.522+0000 7f41858da640 1 -- 172.21.15.77:0/4079458237 wait complete. 2024-09-18T21:18:52.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.602+0000 7ff70d65c640 1 -- 172.21.15.77:0/1709749580 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7080fd820 msgr2=0x7ff7080fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:52.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.602+0000 7ff70d65c640 1 --2- 172.21.15.77:0/1709749580 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7080fd820 0x7ff7080fdc90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff6f00048d0 tx=0x7ff6f0009da0 comp rx=0 tx=0).stop 2024-09-18T21:18:52.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.602+0000 7ff70d65c640 1 -- 172.21.15.77:0/1709749580 shutdown_connections 2024-09-18T21:18:52.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.602+0000 7ff70d65c640 1 --2- 172.21.15.77:0/1709749580 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7080fd820 0x7ff7080fdc90 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:52.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.602+0000 7ff70d65c640 1 --2- 172.21.15.77:0/1709749580 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7080fc550 0x7ff7080fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:52.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.602+0000 7ff70d65c640 1 -- 172.21.15.77:0/1709749580 >> 172.21.15.77:0/1709749580 conn(0x7ff7080f7d30 msgr2=0x7ff7080fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:18:52.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.602+0000 7ff70d65c640 1 -- 172.21.15.77:0/1709749580 shutdown_connections 2024-09-18T21:18:52.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.602+0000 7ff70d65c640 1 -- 172.21.15.77:0/1709749580 wait complete. 2024-09-18T21:18:52.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.603+0000 7ff70d65c640 1 Processor -- start 2024-09-18T21:18:52.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.603+0000 7ff70d65c640 1 -- start start 2024-09-18T21:18:52.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.603+0000 7ff70d65c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7080fc550 0x7ff70810d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:18:52.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.603+0000 7ff70d65c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7080fd820 0x7ff70810d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:18:52.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.603+0000 7ff70d65c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff70810dc40 con 0x7ff7080fd820 2024-09-18T21:18:52.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.603+0000 7ff70d65c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff70810e460 con 0x7ff7080fc550 2024-09-18T21:18:52.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.603+0000 7ff6fe7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7080fd820 0x7ff70810d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:18:52.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.603+0000 7ff6fe7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7080fd820 0x7ff70810d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58774/0 (socket says 172.21.15.77:58774) 2024-09-18T21:18:52.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.603+0000 7ff6fe7fc640 1 -- 172.21.15.77:0/2151578419 learned_addr learned my addr 172.21.15.77:0/2151578419 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:18:52.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.603+0000 7ff706ffd640 1 --2- 172.21.15.77:0/2151578419 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7080fc550 0x7ff70810d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:18:52.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.604+0000 7ff6fe7fc640 1 -- 172.21.15.77:0/2151578419 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7080fc550 msgr2=0x7ff70810d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:52.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.604+0000 7ff6fe7fc640 1 --2- 172.21.15.77:0/2151578419 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7080fc550 0x7ff70810d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:52.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.604+0000 7ff6fe7fc640 1 -- 172.21.15.77:0/2151578419 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f0005040 con 0x7ff7080fd820 2024-09-18T21:18:52.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.604+0000 7ff6fe7fc640 1 --2- 172.21.15.77:0/2151578419 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7080fd820 0x7ff70810d5f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0003080 tx=0x7ff6f0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:18:52.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.604+0000 7ff6fffff640 1 -- 172.21.15.77:0/2151578419 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6f0038070 con 0x7ff7080fd820 2024-09-18T21:18:52.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.604+0000 7ff70d65c640 1 -- 172.21.15.77:0/2151578419 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff70810e690 con 0x7ff7080fd820 2024-09-18T21:18:52.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.604+0000 7ff6fffff640 1 -- 172.21.15.77:0/2151578419 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff6f002abd0 con 0x7ff7080fd820 2024-09-18T21:18:52.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.604+0000 7ff6fffff640 1 -- 172.21.15.77:0/2151578419 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6f003e670 con 0x7ff7080fd820 2024-09-18T21:18:52.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.604+0000 7ff70d65c640 1 -- 172.21.15.77:0/2151578419 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff70810ec30 con 0x7ff7080fd820 2024-09-18T21:18:52.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.605+0000 7ff70d65c640 1 -- 172.21.15.77:0/2151578419 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7080fb9b0 con 0x7ff7080fd820 2024-09-18T21:18:52.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.606+0000 7ff6fffff640 1 -- 172.21.15.77:0/2151578419 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff6f0030020 con 0x7ff7080fd820 2024-09-18T21:18:52.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.606+0000 7ff6fffff640 1 --2- 172.21.15.77:0/2151578419 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7ff6f406e0b0 0x7ff6f4070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:18:52.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.606+0000 7ff6fffff640 1 -- 172.21.15.77:0/2151578419 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6324+0+0 (secure 0 0 0) 0x7ff6f00ade20 con 0x7ff7080fd820 2024-09-18T21:18:52.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.606+0000 7ff706ffd640 1 --2- 172.21.15.77:0/2151578419 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7ff6f406e0b0 0x7ff6f4070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:18:52.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.607+0000 7ff706ffd640 1 --2- 172.21.15.77:0/2151578419 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7ff6f406e0b0 0x7ff6f4070560 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff6f80041d0 tx=0x7ff6f8009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:18:52.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.611+0000 7ff6fffff640 1 -- 172.21.15.77:0/2151578419 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7ff6f0077270 con 0x7ff7080fd820 2024-09-18T21:18:52.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.791+0000 7ff70d65c640 1 -- 172.21.15.77:0/2151578419 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff70810ef60 con 0x7ff6f406e0b0 2024-09-18T21:18:52.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.792+0000 7ff6fffff640 1 -- 172.21.15.77:0/2151578419 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7ff70810ef60 con 0x7ff6f406e0b0 2024-09-18T21:18:52.793 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-18T21:18:52.793 INFO:teuthology.orchestra.run.smithi077.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a", 2024-09-18T21:18:52.793 INFO:teuthology.orchestra.run.smithi077.stdout: "in_progress": true, 2024-09-18T21:18:52.793 INFO:teuthology.orchestra.run.smithi077.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T21:18:52.793 INFO:teuthology.orchestra.run.smithi077.stdout: "services_complete": [ 2024-09-18T21:18:52.793 INFO:teuthology.orchestra.run.smithi077.stdout: "mon", 2024-09-18T21:18:52.794 INFO:teuthology.orchestra.run.smithi077.stdout: "crash", 2024-09-18T21:18:52.794 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr" 2024-09-18T21:18:52.794 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-18T21:18:52.794 INFO:teuthology.orchestra.run.smithi077.stdout: "progress": "11/21 daemons upgraded", 2024-09-18T21:18:52.794 INFO:teuthology.orchestra.run.smithi077.stdout: "message": "Currently upgrading osd daemons", 2024-09-18T21:18:52.794 INFO:teuthology.orchestra.run.smithi077.stdout: "is_paused": false 2024-09-18T21:18:52.794 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-18T21:18:52.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.794+0000 7ff70d65c640 1 -- 172.21.15.77:0/2151578419 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7ff6f406e0b0 msgr2=0x7ff6f4070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:52.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.794+0000 7ff70d65c640 1 --2- 172.21.15.77:0/2151578419 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7ff6f406e0b0 0x7ff6f4070560 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff6f80041d0 tx=0x7ff6f8009040 comp rx=0 tx=0).stop 2024-09-18T21:18:52.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.794+0000 7ff70d65c640 1 -- 172.21.15.77:0/2151578419 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7080fd820 msgr2=0x7ff70810d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:52.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.794+0000 7ff70d65c640 1 --2- 172.21.15.77:0/2151578419 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7080fd820 0x7ff70810d5f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0003080 tx=0x7ff6f0009da0 comp rx=0 tx=0).stop 2024-09-18T21:18:52.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.794+0000 7ff70d65c640 1 -- 172.21.15.77:0/2151578419 shutdown_connections 2024-09-18T21:18:52.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.794+0000 7ff70d65c640 1 --2- 172.21.15.77:0/2151578419 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7080fd820 0x7ff70810d5f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:52.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.794+0000 7ff70d65c640 1 --2- 172.21.15.77:0/2151578419 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7ff6f406e0b0 0x7ff6f4070560 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:52.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.794+0000 7ff70d65c640 1 --2- 172.21.15.77:0/2151578419 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7080fc550 0x7ff70810d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:52.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.794+0000 7ff70d65c640 1 -- 172.21.15.77:0/2151578419 >> 172.21.15.77:0/2151578419 conn(0x7ff7080f7d30 msgr2=0x7ff7080f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:18:52.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.795+0000 7ff70d65c640 1 -- 172.21.15.77:0/2151578419 shutdown_connections 2024-09-18T21:18:52.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.795+0000 7ff70d65c640 1 -- 172.21.15.77:0/2151578419 wait complete. 2024-09-18T21:18:52.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.874+0000 7f1945c13640 1 -- 172.21.15.77:0/2306581314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19400fd820 msgr2=0x7f19400fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:52.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.874+0000 7f1945c13640 1 --2- 172.21.15.77:0/2306581314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19400fd820 0x7f19400fdc90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f19340048d0 tx=0x7f1934009da0 comp rx=0 tx=0).stop 2024-09-18T21:18:52.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.874+0000 7f1945c13640 1 -- 172.21.15.77:0/2306581314 shutdown_connections 2024-09-18T21:18:52.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.874+0000 7f1945c13640 1 --2- 172.21.15.77:0/2306581314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19400fd820 0x7f19400fdc90 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:52.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.874+0000 7f1945c13640 1 --2- 172.21.15.77:0/2306581314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19400fc550 0x7f19400fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:52.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.874+0000 7f1945c13640 1 -- 172.21.15.77:0/2306581314 >> 172.21.15.77:0/2306581314 conn(0x7f19400f7d30 msgr2=0x7f19400fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:18:52.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.874+0000 7f1945c13640 1 -- 172.21.15.77:0/2306581314 shutdown_connections 2024-09-18T21:18:52.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.874+0000 7f1945c13640 1 -- 172.21.15.77:0/2306581314 wait complete. 2024-09-18T21:18:52.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.874+0000 7f1945c13640 1 Processor -- start 2024-09-18T21:18:52.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.875+0000 7f1945c13640 1 -- start start 2024-09-18T21:18:52.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.875+0000 7f1945c13640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19400fc550 0x7f194010d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:18:52.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.875+0000 7f1945c13640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19400fd820 0x7f194010d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:18:52.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.875+0000 7f1945c13640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194010dc40 con 0x7f19400fc550 2024-09-18T21:18:52.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.875+0000 7f1945c13640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194010e460 con 0x7f19400fd820 2024-09-18T21:18:52.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.875+0000 7f193f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19400fc550 0x7f194010d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:18:52.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.875+0000 7f193f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19400fc550 0x7f194010d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58792/0 (socket says 172.21.15.77:58792) 2024-09-18T21:18:52.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.875+0000 7f193f7fe640 1 -- 172.21.15.77:0/1432794956 learned_addr learned my addr 172.21.15.77:0/1432794956 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:18:52.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.875+0000 7f193effd640 1 --2- 172.21.15.77:0/1432794956 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19400fd820 0x7f194010d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:18:52.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.875+0000 7f193f7fe640 1 -- 172.21.15.77:0/1432794956 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19400fd820 msgr2=0x7f194010d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:52.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.875+0000 7f193f7fe640 1 --2- 172.21.15.77:0/1432794956 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19400fd820 0x7f194010d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:52.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.875+0000 7f193f7fe640 1 -- 172.21.15.77:0/1432794956 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1934005040 con 0x7f19400fc550 2024-09-18T21:18:52.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.875+0000 7f193effd640 1 --2- 172.21.15.77:0/1432794956 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19400fd820 0x7f194010d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T21:18:52.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.875+0000 7f193f7fe640 1 --2- 172.21.15.77:0/1432794956 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19400fc550 0x7f194010d0b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f193000c790 tx=0x7f19300043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:18:52.879 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.875+0000 7f1927fff640 1 -- 172.21.15.77:0/1432794956 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f193000a820 con 0x7f19400fc550 2024-09-18T21:18:52.879 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.875+0000 7f1927fff640 1 -- 172.21.15.77:0/1432794956 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f193000ae20 con 0x7f19400fc550 2024-09-18T21:18:52.879 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.875+0000 7f1945c13640 1 -- 172.21.15.77:0/1432794956 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f194010e6f0 con 0x7f19400fc550 2024-09-18T21:18:52.879 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.875+0000 7f1927fff640 1 -- 172.21.15.77:0/1432794956 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19300113a0 con 0x7f19400fc550 2024-09-18T21:18:52.879 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.876+0000 7f1945c13640 1 -- 172.21.15.77:0/1432794956 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f194010ec90 con 0x7f19400fc550 2024-09-18T21:18:52.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.877+0000 7f1945c13640 1 -- 172.21.15.77:0/1432794956 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19400fb9b0 con 0x7f19400fc550 2024-09-18T21:18:52.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.877+0000 7f1927fff640 1 -- 172.21.15.77:0/1432794956 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f1930012400 con 0x7f19400fc550 2024-09-18T21:18:52.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.877+0000 7f1927fff640 1 --2- 172.21.15.77:0/1432794956 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f192806e0b0 0x7f1928070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:18:52.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.878+0000 7f1927fff640 1 -- 172.21.15.77:0/1432794956 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f193008dca0 con 0x7f19400fc550 2024-09-18T21:18:52.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.878+0000 7f193effd640 1 --2- 172.21.15.77:0/1432794956 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f192806e0b0 0x7f1928070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:18:52.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.878+0000 7f193effd640 1 --2- 172.21.15.77:0/1432794956 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f192806e0b0 0x7f1928070560 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f193400b020 tx=0x7f1934009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:18:52.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:52.882+0000 7f1927fff640 1 -- 172.21.15.77:0/1432794956 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f1930092070 con 0x7f19400fc550 2024-09-18T21:18:53.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:53.115+0000 7f1945c13640 1 -- 172.21.15.77:0/1432794956 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f194004b720 con 0x7f19400fc550 2024-09-18T21:18:53.117 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:52 smithi077 ceph-mon[92672]: from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:18:53.117 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:52 smithi077 ceph-mon[92672]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:18:53.117 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:52 smithi077 ceph-mon[92672]: pgmap v141: 65 pgs: 65 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:18:53.117 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:52 smithi077 ceph-mon[92672]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:18:53.117 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:52 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/3440508673' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:18:53.118 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:52 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/4079458237' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T21:18:53.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:53.116+0000 7f1927fff640 1 -- 172.21.15.77:0/1432794956 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f19300570f0 con 0x7f19400fc550 2024-09-18T21:18:53.118 INFO:teuthology.orchestra.run.smithi077.stdout:HEALTH_OK 2024-09-18T21:18:53.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:53.118+0000 7f1945c13640 1 -- 172.21.15.77:0/1432794956 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f192806e0b0 msgr2=0x7f1928070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:53.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:53.118+0000 7f1945c13640 1 --2- 172.21.15.77:0/1432794956 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f192806e0b0 0x7f1928070560 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f193400b020 tx=0x7f1934009da0 comp rx=0 tx=0).stop 2024-09-18T21:18:53.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:53.118+0000 7f1945c13640 1 -- 172.21.15.77:0/1432794956 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19400fc550 msgr2=0x7f194010d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:18:53.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:53.118+0000 7f1945c13640 1 --2- 172.21.15.77:0/1432794956 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19400fc550 0x7f194010d0b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f193000c790 tx=0x7f19300043c0 comp rx=0 tx=0).stop 2024-09-18T21:18:53.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:53.118+0000 7f1945c13640 1 -- 172.21.15.77:0/1432794956 shutdown_connections 2024-09-18T21:18:53.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:53.118+0000 7f1945c13640 1 --2- 172.21.15.77:0/1432794956 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f192806e0b0 0x7f1928070560 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:53.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:53.118+0000 7f1945c13640 1 --2- 172.21.15.77:0/1432794956 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19400fd820 0x7f194010d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:53.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:53.118+0000 7f1945c13640 1 --2- 172.21.15.77:0/1432794956 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19400fc550 0x7f194010d0b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:18:53.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:53.118+0000 7f1945c13640 1 -- 172.21.15.77:0/1432794956 >> 172.21.15.77:0/1432794956 conn(0x7f19400f7d30 msgr2=0x7f19400f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:18:53.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:53.118+0000 7f1945c13640 1 -- 172.21.15.77:0/1432794956 shutdown_connections 2024-09-18T21:18:53.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:18:53.118+0000 7f1945c13640 1 -- 172.21.15.77:0/1432794956 wait complete. 2024-09-18T21:18:53.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:52 smithi103 ceph-mon[80307]: from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:18:53.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:52 smithi103 ceph-mon[80307]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:18:53.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:52 smithi103 ceph-mon[80307]: pgmap v141: 65 pgs: 65 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:18:53.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:52 smithi103 ceph-mon[80307]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:18:53.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:52 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/3440508673' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:18:53.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:52 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/4079458237' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T21:18:54.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:53 smithi103 ceph-mon[80307]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:18:54.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:53 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/1432794956' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T21:18:54.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:53 smithi077 ceph-mon[92672]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:18:54.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:53 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/1432794956' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T21:18:55.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:54 smithi103 ceph-mon[80307]: pgmap v142: 65 pgs: 65 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:18:55.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:54 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-18T21:18:55.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:54 smithi077 ceph-mon[92672]: pgmap v142: 65 pgs: 65 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:18:55.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:54 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-18T21:18:56.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:55 smithi103 ceph-mon[80307]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-18T21:18:56.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:55 smithi103 ceph-mon[80307]: Upgrade: osd.5 is safe to restart 2024-09-18T21:18:56.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:55 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:56.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:55 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-18T21:18:56.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:55 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:18:56.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:55 smithi077 ceph-mon[92672]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-18T21:18:56.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:55 smithi077 ceph-mon[92672]: Upgrade: osd.5 is safe to restart 2024-09-18T21:18:56.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:55 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:18:56.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:55 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-18T21:18:56.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:55 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:18:57.256 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:56 smithi103 ceph-mon[80307]: Upgrade: Updating osd.5 2024-09-18T21:18:57.256 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:56 smithi103 ceph-mon[80307]: Deploying daemon osd.5 on smithi103 2024-09-18T21:18:57.256 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:56 smithi103 ceph-mon[80307]: pgmap v143: 65 pgs: 65 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:18:57.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:56 smithi077 ceph-mon[92672]: Upgrade: Updating osd.5 2024-09-18T21:18:57.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:56 smithi077 ceph-mon[92672]: Deploying daemon osd.5 on smithi103 2024-09-18T21:18:57.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:56 smithi077 ceph-mon[92672]: pgmap v143: 65 pgs: 65 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:18:58.764 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:18:58 smithi103 systemd[1]: Stopping Ceph osd.5 for 5a76ec16-7601-11ef-bceb-c7b262605968... 2024-09-18T21:18:59.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:58 smithi103 ceph-mon[80307]: pgmap v144: 65 pgs: 65 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:18:59.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:58 smithi103 ceph-mon[80307]: osd.5 marked itself down and dead 2024-09-18T21:18:59.264 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:18:58 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5[53353]: 2024-09-18T21:18:58.957+0000 7f8d18338640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T21:18:59.264 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:18:58 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5[53353]: 2024-09-18T21:18:58.957+0000 7f8d18338640 -1 osd.5 71 *** Got signal Terminated *** 2024-09-18T21:18:59.264 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:18:58 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5[53353]: 2024-09-18T21:18:58.957+0000 7f8d18338640 -1 osd.5 71 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-18T21:18:59.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:58 smithi077 ceph-mon[92672]: pgmap v144: 65 pgs: 65 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:18:59.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:58 smithi077 ceph-mon[92672]: osd.5 marked itself down and dead 2024-09-18T21:18:59.867 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:18:59 smithi103 podman[99227]: 2024-09-18 21:18:59.528337344 +0000 UTC m=+0.691599268 container died cf8964b3ac6d95e374b2a0c28e37eafffde249f986e663d6ec46a3a06bb324d5 (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=quincy-6e06d1e, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-18T21:18:59.867 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:18:59 smithi103 podman[99227]: 2024-09-18 21:18:59.866742109 +0000 UTC m=+1.030004024 container cleanup cf8964b3ac6d95e374b2a0c28e37eafffde249f986e663d6ec46a3a06bb324d5 (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=quincy-6e06d1e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True) 2024-09-18T21:19:00.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:59 smithi103 ceph-mon[80307]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-18T21:19:00.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:59 smithi103 ceph-mon[80307]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-18T21:19:00.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:18:59 smithi103 ceph-mon[80307]: osdmap e72: 6 total, 5 up, 6 in 2024-09-18T21:19:00.264 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:18:59 smithi103 bash[99227]: ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5 2024-09-18T21:19:00.264 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:19:00 smithi103 podman[99252]: 2024-09-18 21:19:00.085173577 +0000 UTC m=+0.557435829 container remove cf8964b3ac6d95e374b2a0c28e37eafffde249f986e663d6ec46a3a06bb324d5 (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=quincy-6e06d1e, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T21:19:00.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:59 smithi077 ceph-mon[92672]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-18T21:19:00.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:59 smithi077 ceph-mon[92672]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-18T21:19:00.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:18:59 smithi077 ceph-mon[92672]: osdmap e72: 6 total, 5 up, 6 in 2024-09-18T21:19:00.764 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:19:00 smithi103 podman[99342]: 2024-09-18 21:19:00.384647772 +0000 UTC m=+0.015886442 image pull f79f744f586d6ce8ddb4b06b7cf36a0f23174bbe29ea68264d2be49d8c6d9acd quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a 2024-09-18T21:19:00.764 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:19:00 smithi103 podman[99342]: 2024-09-18 21:19:00.494492615 +0000 UTC m=+0.125731274 container create bbf3293c72b0fab5cd06a6b76a90d9ea1aeab97fcafa067c73c88197c7f28ba9 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-release-06b1b1d, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-18T21:19:00.764 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:19:00 smithi103 podman[99342]: 2024-09-18 21:19:00.713588226 +0000 UTC m=+0.344826895 container init bbf3293c72b0fab5cd06a6b76a90d9ea1aeab97fcafa067c73c88197c7f28ba9 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-release-06b1b1d) 2024-09-18T21:19:00.764 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:19:00 smithi103 podman[99342]: 2024-09-18 21:19:00.717490357 +0000 UTC m=+0.348729019 container start bbf3293c72b0fab5cd06a6b76a90d9ea1aeab97fcafa067c73c88197c7f28ba9 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-release-06b1b1d, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-18T21:19:01.201 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:00 smithi103 ceph-mon[80307]: pgmap v146: 65 pgs: 3 peering, 11 stale+active+clean, 51 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:19:01.201 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:00 smithi103 ceph-mon[80307]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-18T21:19:01.201 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:00 smithi103 ceph-mon[80307]: osdmap e73: 6 total, 5 up, 6 in 2024-09-18T21:19:01.201 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:19:00 smithi103 podman[99342]: 2024-09-18 21:19:00.813643342 +0000 UTC m=+0.444882005 container attach bbf3293c72b0fab5cd06a6b76a90d9ea1aeab97fcafa067c73c88197c7f28ba9 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, RELEASE=squid-release-06b1b1d, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True) 2024-09-18T21:19:01.201 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:19:00 smithi103 podman[99342]: 2024-09-18 21:19:00.909206967 +0000 UTC m=+0.540445633 container died bbf3293c72b0fab5cd06a6b76a90d9ea1aeab97fcafa067c73c88197c7f28ba9 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, ceph=True, RELEASE=squid-release-06b1b1d, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-18T21:19:01.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:00 smithi077 ceph-mon[92672]: pgmap v146: 65 pgs: 3 peering, 11 stale+active+clean, 51 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:19:01.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:00 smithi077 ceph-mon[92672]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-18T21:19:01.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:00 smithi077 ceph-mon[92672]: osdmap e73: 6 total, 5 up, 6 in 2024-09-18T21:19:01.765 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:19:01 smithi103 podman[99365]: 2024-09-18 21:19:01.48395441 +0000 UTC m=+0.568685888 container remove bbf3293c72b0fab5cd06a6b76a90d9ea1aeab97fcafa067c73c88197c7f28ba9 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, RELEASE=squid-release-06b1b1d, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-18T21:19:01.765 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:19:01 smithi103 systemd[1]: ceph-5a76ec16-7601-11ef-bceb-c7b262605968@osd.5.service: Deactivated successfully. 2024-09-18T21:19:01.765 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:19:01 smithi103 systemd[1]: Stopped Ceph osd.5 for 5a76ec16-7601-11ef-bceb-c7b262605968. 2024-09-18T21:19:01.766 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:19:01 smithi103 systemd[1]: ceph-5a76ec16-7601-11ef-bceb-c7b262605968@osd.5.service: Consumed 1min 2.135s CPU time. 2024-09-18T21:19:01.766 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:19:01 smithi103 systemd[1]: Starting Ceph osd.5 for 5a76ec16-7601-11ef-bceb-c7b262605968... 2024-09-18T21:19:02.238 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:19:01 smithi103 podman[99465]: 2024-09-18 21:19:01.811348471 +0000 UTC m=+0.016021124 image pull f79f744f586d6ce8ddb4b06b7cf36a0f23174bbe29ea68264d2be49d8c6d9acd quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a 2024-09-18T21:19:02.238 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:19:01 smithi103 podman[99465]: 2024-09-18 21:19:01.909919331 +0000 UTC m=+0.114591975 container create ad349c7150497c786c08db16182bc4dd4e32a8c8556d999b7b575b19c56da2e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5-activate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-release-06b1b1d, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-18T21:19:02.238 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:19:02 smithi103 podman[99465]: 2024-09-18 21:19:02.137483205 +0000 UTC m=+0.342155853 container init ad349c7150497c786c08db16182bc4dd4e32a8c8556d999b7b575b19c56da2e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5-activate, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-release-06b1b1d, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-18T21:19:02.238 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:19:02 smithi103 podman[99465]: 2024-09-18 21:19:02.141005971 +0000 UTC m=+0.345678615 container start ad349c7150497c786c08db16182bc4dd4e32a8c8556d999b7b575b19c56da2e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=squid-release-06b1b1d, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-18T21:19:02.238 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:19:02 smithi103 podman[99465]: 2024-09-18 21:19:02.2374069 +0000 UTC m=+0.442079557 container attach ad349c7150497c786c08db16182bc4dd4e32a8c8556d999b7b575b19c56da2e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5-activate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-release-06b1b1d) 2024-09-18T21:19:02.490 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:19:02 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5-activate[99479]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T21:19:02.490 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:19:02 smithi103 bash[99465]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T21:19:02.490 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:19:02 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5-activate[99479]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T21:19:02.490 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:19:02 smithi103 bash[99465]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-18T21:19:02.490 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:19:02 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5-activate[99479]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-18T21:19:02.490 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:19:02 smithi103 bash[99465]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-18T21:19:02.490 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:19:02 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5-activate[99479]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-18T21:19:02.490 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:19:02 smithi103 bash[99465]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-18T21:19:02.490 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:19:02 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5-activate[99479]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-18T21:19:02.490 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:19:02 smithi103 bash[99465]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-18T21:19:02.764 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:19:02 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5-activate[99479]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-18T21:19:02.764 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:19:02 smithi103 bash[99465]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-18T21:19:02.764 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:19:02 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5-activate[99479]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-18T21:19:02.764 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:19:02 smithi103 bash[99465]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-18T21:19:02.764 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:19:02 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5-activate[99479]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-18T21:19:02.764 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:19:02 smithi103 bash[99465]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-18T21:19:02.764 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:19:02 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5-activate[99479]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-18T21:19:02.764 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:19:02 smithi103 bash[99465]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-18T21:19:02.764 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:19:02 smithi103 podman[99465]: 2024-09-18 21:19:02.516578976 +0000 UTC m=+0.721251621 container died ad349c7150497c786c08db16182bc4dd4e32a8c8556d999b7b575b19c56da2e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5-activate, org.label-schema.vendor=CentOS, RELEASE=squid-release-06b1b1d, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-18T21:19:03.100 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:02 smithi103 ceph-mon[80307]: pgmap v148: 65 pgs: 3 peering, 11 stale+active+clean, 51 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:19:03.445 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:19:03 smithi103 podman[99600]: 2024-09-18 21:19:03.099802194 +0000 UTC m=+0.577685629 container remove ad349c7150497c786c08db16182bc4dd4e32a8c8556d999b7b575b19c56da2e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5-activate, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=squid-release-06b1b1d, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-18T21:19:03.445 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:19:03 smithi103 podman[99661]: 2024-09-18 21:19:03.206212617 +0000 UTC m=+0.015679142 image pull f79f744f586d6ce8ddb4b06b7cf36a0f23174bbe29ea68264d2be49d8c6d9acd quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a 2024-09-18T21:19:03.445 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:19:03 smithi103 podman[99661]: 2024-09-18 21:19:03.334035258 +0000 UTC m=+0.143501769 container create e6912ab63ecca23fac6f8983821da4ba1461f8b03c4b33a610d3078f46831e22 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-release-06b1b1d, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-18T21:19:03.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:02 smithi077 ceph-mon[92672]: pgmap v148: 65 pgs: 3 peering, 11 stale+active+clean, 51 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-18T21:19:04.014 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:19:03 smithi103 podman[99661]: 2024-09-18 21:19:03.561370597 +0000 UTC m=+0.370837112 container init e6912ab63ecca23fac6f8983821da4ba1461f8b03c4b33a610d3078f46831e22 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-release-06b1b1d, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-18T21:19:04.014 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:19:03 smithi103 podman[99661]: 2024-09-18 21:19:03.564470621 +0000 UTC m=+0.373937132 container start e6912ab63ecca23fac6f8983821da4ba1461f8b03c4b33a610d3078f46831e22 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-release-06b1b1d, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-18T21:19:04.014 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:19:03 smithi103 ceph-osd[99680]: -- 172.21.15.103:0/3731354790 <== mon.1 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b2897481e0 con 0x55b2896e0000 2024-09-18T21:19:04.014 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:19:03 smithi103 bash[99661]: e6912ab63ecca23fac6f8983821da4ba1461f8b03c4b33a610d3078f46831e22 2024-09-18T21:19:04.014 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:19:03 smithi103 systemd[1]: Started Ceph osd.5 for 5a76ec16-7601-11ef-bceb-c7b262605968. 2024-09-18T21:19:04.446 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:19:04 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5[99676]: 2024-09-18T21:19:04.113+0000 7f6efe693640 -1 Falling back to public interface 2024-09-18T21:19:04.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:04 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:04.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:04 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:04.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:04 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:19:04.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:04 smithi077 ceph-mon[92672]: pgmap v149: 65 pgs: 9 active+undersized, 3 peering, 4 stale+active+clean, 9 active+undersized+degraded, 40 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 26/222 objects degraded (11.712%) 2024-09-18T21:19:04.993 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:04 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:04.993 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:04 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:04.993 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:04 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:19:04.993 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:04 smithi103 ceph-mon[80307]: pgmap v149: 65 pgs: 9 active+undersized, 3 peering, 4 stale+active+clean, 9 active+undersized+degraded, 40 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 26/222 objects degraded (11.712%) 2024-09-18T21:19:05.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:05 smithi077 ceph-mon[92672]: Health check failed: Degraded data redundancy: 26/222 objects degraded (11.712%), 9 pgs degraded (PG_DEGRADED) 2024-09-18T21:19:05.980 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:05 smithi103 ceph-mon[80307]: Health check failed: Degraded data redundancy: 26/222 objects degraded (11.712%), 9 pgs degraded (PG_DEGRADED) 2024-09-18T21:19:07.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:06 smithi077 ceph-mon[92672]: pgmap v150: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 35/222 objects degraded (15.766%) 2024-09-18T21:19:07.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:06 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:07.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:06 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:19:07.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:06 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:07.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:06 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:07.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:06 smithi077 ceph-mon[92672]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-18T21:19:07.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:06 smithi103 ceph-mon[80307]: pgmap v150: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 35/222 objects degraded (15.766%) 2024-09-18T21:19:07.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:06 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:07.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:06 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:19:07.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:06 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:07.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:06 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:07.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:06 smithi103 ceph-mon[80307]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-18T21:19:08.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:08 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:08.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:08 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:08.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:08 smithi103 ceph-mon[80307]: pgmap v151: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 35/222 objects degraded (15.766%) 2024-09-18T21:19:08.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:08 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:08.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:08 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:08.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:08 smithi077 ceph-mon[92672]: pgmap v151: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 203 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 35/222 objects degraded (15.766%) 2024-09-18T21:19:08.858 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:19:08 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5[99676]: 2024-09-18T21:19:08.726+0000 7f6efe693640 -1 osd.5 71 log_to_monitors true 2024-09-18T21:19:09.410 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:09 smithi103 ceph-mon[80307]: from='osd.5 [v2:172.21.15.103:6816/3896015313,v1:172.21.15.103:6817/3896015313]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-18T21:19:09.411 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:09 smithi103 ceph-mon[80307]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-18T21:19:09.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:09 smithi077 ceph-mon[92672]: from='osd.5 [v2:172.21.15.103:6816/3896015313,v1:172.21.15.103:6817/3896015313]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-18T21:19:09.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:09 smithi077 ceph-mon[92672]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-18T21:19:10.014 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:19:09 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5[99676]: 2024-09-18T21:19:09.977+0000 7f6ef2425640 -1 osd.5 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-18T21:19:10.389 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:10 smithi103 ceph-mon[80307]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-18T21:19:10.389 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:10 smithi103 ceph-mon[80307]: osdmap e74: 6 total, 5 up, 6 in 2024-09-18T21:19:10.389 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:10 smithi103 ceph-mon[80307]: from='osd.5 [v2:172.21.15.103:6816/3896015313,v1:172.21.15.103:6817/3896015313]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-18T21:19:10.389 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:10 smithi103 ceph-mon[80307]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-18T21:19:10.389 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:10 smithi103 ceph-mon[80307]: pgmap v153: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 203 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 35/222 objects degraded (15.766%) 2024-09-18T21:19:10.389 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:10 smithi103 ceph-mon[80307]: from='osd.5 ' entity='osd.5' 2024-09-18T21:19:10.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:10 smithi077 ceph-mon[92672]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-18T21:19:10.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:10 smithi077 ceph-mon[92672]: osdmap e74: 6 total, 5 up, 6 in 2024-09-18T21:19:10.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:10 smithi077 ceph-mon[92672]: from='osd.5 [v2:172.21.15.103:6816/3896015313,v1:172.21.15.103:6817/3896015313]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-18T21:19:10.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:10 smithi077 ceph-mon[92672]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-09-18T21:19:10.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:10 smithi077 ceph-mon[92672]: pgmap v153: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 203 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 35/222 objects degraded (15.766%) 2024-09-18T21:19:10.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:10 smithi077 ceph-mon[92672]: from='osd.5 ' entity='osd.5' 2024-09-18T21:19:11.653 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:11 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:11.653 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:11 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:11.653 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:11 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:19:11.653 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:11 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:19:11.653 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:11 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:11.653 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:11 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:19:11.653 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:11 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:19:11.653 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:11 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:19:11.653 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:11 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:19:11.654 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:11 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:19:11.654 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:11 smithi077 ceph-mon[92672]: Upgrade: Setting container_image for all osd 2024-09-18T21:19:11.654 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:11 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:11.654 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:11 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-18T21:19:11.654 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:11 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-18T21:19:11.654 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:11 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-18T21:19:11.654 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:11 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-18T21:19:11.654 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:11 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-18T21:19:11.654 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:11 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-18T21:19:11.654 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:11 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-18T21:19:11.654 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:11 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-18T21:19:11.654 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:11 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-18T21:19:11.654 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:11 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-18T21:19:11.654 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:11 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-18T21:19:11.655 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:11 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-18T21:19:11.655 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:11 smithi077 ceph-mon[92672]: Upgrade: Setting require_osd_release to 19 squid 2024-09-18T21:19:11.655 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:11 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-18T21:19:11.655 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:11 smithi077 ceph-mon[92672]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-18T21:19:11.655 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:11 smithi077 ceph-mon[92672]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-18T21:19:11.655 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:11 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-18T21:19:11.655 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:11 smithi077 ceph-mon[92672]: osd.5 [v2:172.21.15.103:6816/3896015313,v1:172.21.15.103:6817/3896015313] boot 2024-09-18T21:19:11.655 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:11 smithi077 ceph-mon[92672]: osdmap e75: 6 total, 6 up, 6 in 2024-09-18T21:19:11.655 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:11 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T21:19:11.655 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:11 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi077.vruydi"]}]: dispatch 2024-09-18T21:19:11.655 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:11 smithi077 ceph-mon[92672]: Upgrade: It appears safe to stop mds.cephfs.smithi077.vruydi 2024-09-18T21:19:11.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:11 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:11.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:11 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:11.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:11 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:19:11.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:11 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:19:11.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:11 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:11.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:11 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:19:11.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:11 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:19:11.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:11 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:19:11.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:11 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:19:11.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:11 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:19:11.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:11 smithi103 ceph-mon[80307]: Upgrade: Setting container_image for all osd 2024-09-18T21:19:11.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:11 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:11.766 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:11 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-18T21:19:11.766 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:11 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-18T21:19:11.766 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:11 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-18T21:19:11.766 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:11 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-18T21:19:11.766 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:11 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-18T21:19:11.766 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:11 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-18T21:19:11.766 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:11 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-18T21:19:11.766 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:11 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-18T21:19:11.766 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:11 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-18T21:19:11.766 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:11 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-18T21:19:11.766 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:11 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-18T21:19:11.766 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:11 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-18T21:19:11.766 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:11 smithi103 ceph-mon[80307]: Upgrade: Setting require_osd_release to 19 squid 2024-09-18T21:19:11.767 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:11 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-18T21:19:11.767 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:11 smithi103 ceph-mon[80307]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-18T21:19:11.767 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:11 smithi103 ceph-mon[80307]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-18T21:19:11.767 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:11 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-18T21:19:11.767 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:11 smithi103 ceph-mon[80307]: osd.5 [v2:172.21.15.103:6816/3896015313,v1:172.21.15.103:6817/3896015313] boot 2024-09-18T21:19:11.767 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:11 smithi103 ceph-mon[80307]: osdmap e75: 6 total, 6 up, 6 in 2024-09-18T21:19:11.767 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:11 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-18T21:19:11.767 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:11 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi077.vruydi"]}]: dispatch 2024-09-18T21:19:11.767 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:11 smithi103 ceph-mon[80307]: Upgrade: It appears safe to stop mds.cephfs.smithi077.vruydi 2024-09-18T21:19:13.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:12 smithi103 ceph-mon[80307]: pgmap v155: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 203 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 35/222 objects degraded (15.766%) 2024-09-18T21:19:13.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:12 smithi103 ceph-mon[80307]: osdmap e76: 6 total, 6 up, 6 in 2024-09-18T21:19:13.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:12 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:13.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:12 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi077.vruydi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-18T21:19:13.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:12 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:19:13.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:12 smithi077 ceph-mon[92672]: pgmap v155: 65 pgs: 16 active+undersized, 12 active+undersized+degraded, 37 active+clean; 203 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 35/222 objects degraded (15.766%) 2024-09-18T21:19:13.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:12 smithi077 ceph-mon[92672]: osdmap e76: 6 total, 6 up, 6 in 2024-09-18T21:19:13.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:12 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:13.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:12 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi077.vruydi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-18T21:19:13.464 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:12 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:19:14.077 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:13 smithi077 ceph-mon[92672]: Upgrade: Updating mds.cephfs.smithi077.vruydi 2024-09-18T21:19:14.077 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:13 smithi077 ceph-mon[92672]: Deploying daemon mds.cephfs.smithi077.vruydi on smithi077 2024-09-18T21:19:14.077 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:13 smithi077 ceph-mon[92672]: Health check update: Degraded data redundancy: 35/222 objects degraded (15.766%), 12 pgs degraded (PG_DEGRADED) 2024-09-18T21:19:14.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:13 smithi103 ceph-mon[80307]: Upgrade: Updating mds.cephfs.smithi077.vruydi 2024-09-18T21:19:14.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:13 smithi103 ceph-mon[80307]: Deploying daemon mds.cephfs.smithi077.vruydi on smithi077 2024-09-18T21:19:14.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:13 smithi103 ceph-mon[80307]: Health check update: Degraded data redundancy: 35/222 objects degraded (15.766%), 12 pgs degraded (PG_DEGRADED) 2024-09-18T21:19:14.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:14 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-mon-smithi077[92668]: 2024-09-18T21:19:14.341+0000 7fa82685f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-18T21:19:15.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:14 smithi103 ceph-mon[80307]: pgmap v157: 65 pgs: 9 peering, 11 active+undersized, 6 active+undersized+degraded, 39 active+clean; 203 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 15/222 objects degraded (6.757%) 2024-09-18T21:19:15.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:14 smithi103 ceph-mon[80307]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-18T21:19:15.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:14 smithi103 ceph-mon[80307]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-18T21:19:15.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:14 smithi103 ceph-mon[80307]: osdmap e77: 6 total, 6 up, 6 in 2024-09-18T21:19:15.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:14 smithi103 ceph-mon[80307]: Standby daemon mds.cephfs.smithi077.cqfhlw assigned to filesystem cephfs as rank 0 2024-09-18T21:19:15.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:14 smithi103 ceph-mon[80307]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-18T21:19:15.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:14 smithi103 ceph-mon[80307]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-18T21:19:15.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:14 smithi103 ceph-mon[80307]: fsmap cephfs:1/1 {0=cephfs.smithi077.cqfhlw=up:replay} 2 up:standby 2024-09-18T21:19:15.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:14 smithi077 ceph-mon[92672]: pgmap v157: 65 pgs: 9 peering, 11 active+undersized, 6 active+undersized+degraded, 39 active+clean; 203 MiB data, 824 MiB used, 536 GiB / 536 GiB avail; 15/222 objects degraded (6.757%) 2024-09-18T21:19:15.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:14 smithi077 ceph-mon[92672]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-18T21:19:15.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:14 smithi077 ceph-mon[92672]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-18T21:19:15.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:14 smithi077 ceph-mon[92672]: osdmap e77: 6 total, 6 up, 6 in 2024-09-18T21:19:15.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:14 smithi077 ceph-mon[92672]: Standby daemon mds.cephfs.smithi077.cqfhlw assigned to filesystem cephfs as rank 0 2024-09-18T21:19:15.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:14 smithi077 ceph-mon[92672]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-18T21:19:15.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:14 smithi077 ceph-mon[92672]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-18T21:19:15.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:14 smithi077 ceph-mon[92672]: fsmap cephfs:1/1 {0=cephfs.smithi077.cqfhlw=up:replay} 2 up:standby 2024-09-18T21:19:16.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:16 smithi077 ceph-mon[92672]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 15/222 objects degraded (6.757%), 6 pgs degraded) 2024-09-18T21:19:16.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:16 smithi103 ceph-mon[80307]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 15/222 objects degraded (6.757%), 6 pgs degraded) 2024-09-18T21:19:17.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:17 smithi077 ceph-mon[92672]: pgmap v159: 65 pgs: 9 peering, 56 active+clean; 203 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:19:17.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:17 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.vruydi"}]: dispatch 2024-09-18T21:19:17.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:17 smithi103 ceph-mon[80307]: pgmap v159: 65 pgs: 9 peering, 56 active+clean; 203 MiB data, 828 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:19:17.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:17 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.vruydi"}]: dispatch 2024-09-18T21:19:19.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:19 smithi077 ceph-mon[92672]: pgmap v160: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 9.3 MiB/s rd, 3 op/s 2024-09-18T21:19:19.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:19 smithi103 ceph-mon[80307]: pgmap v160: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 9.3 MiB/s rd, 3 op/s 2024-09-18T21:19:21.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:21 smithi077 ceph-mon[92672]: pgmap v161: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 6 op/s 2024-09-18T21:19:21.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:21 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:21.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:21 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:19:21.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:21 smithi103 ceph-mon[80307]: pgmap v161: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 6 op/s 2024-09-18T21:19:21.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:21 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:21.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:21 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:19:23.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.206+0000 7fe96e213640 1 -- 172.21.15.77:0/3551698187 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9680fd7f0 msgr2=0x7fe9680fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:23.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.206+0000 7fe96e213640 1 --2- 172.21.15.77:0/3551698187 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9680fd7f0 0x7fe9680fdc60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe95c0048d0 tx=0x7fe95c009da0 comp rx=0 tx=0).stop 2024-09-18T21:19:23.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.206+0000 7fe96e213640 1 -- 172.21.15.77:0/3551698187 shutdown_connections 2024-09-18T21:19:23.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.206+0000 7fe96e213640 1 --2- 172.21.15.77:0/3551698187 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9680fd7f0 0x7fe9680fdc60 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:23.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.206+0000 7fe96e213640 1 --2- 172.21.15.77:0/3551698187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9680fc520 0x7fe9680fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:23.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.206+0000 7fe96e213640 1 -- 172.21.15.77:0/3551698187 >> 172.21.15.77:0/3551698187 conn(0x7fe9680f7ce0 msgr2=0x7fe9680fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:19:23.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.206+0000 7fe96e213640 1 -- 172.21.15.77:0/3551698187 shutdown_connections 2024-09-18T21:19:23.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.206+0000 7fe96e213640 1 -- 172.21.15.77:0/3551698187 wait complete. 2024-09-18T21:19:23.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.206+0000 7fe96e213640 1 Processor -- start 2024-09-18T21:19:23.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.207+0000 7fe96e213640 1 -- start start 2024-09-18T21:19:23.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.207+0000 7fe96e213640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9680fc520 0x7fe96810d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:19:23.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.207+0000 7fe96e213640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9680fd7f0 0x7fe96810d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:19:23.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.207+0000 7fe96e213640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96810dbf0 con 0x7fe9680fc520 2024-09-18T21:19:23.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.207+0000 7fe96e213640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96810e410 con 0x7fe9680fd7f0 2024-09-18T21:19:23.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.207+0000 7fe9677fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9680fc520 0x7fe96810d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:19:23.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.207+0000 7fe9677fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9680fc520 0x7fe96810d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50564/0 (socket says 172.21.15.77:50564) 2024-09-18T21:19:23.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.207+0000 7fe9677fe640 1 -- 172.21.15.77:0/3518465392 learned_addr learned my addr 172.21.15.77:0/3518465392 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:19:23.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.207+0000 7fe966ffd640 1 --2- 172.21.15.77:0/3518465392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9680fd7f0 0x7fe96810d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:19:23.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.207+0000 7fe9677fe640 1 -- 172.21.15.77:0/3518465392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9680fd7f0 msgr2=0x7fe96810d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:23.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.207+0000 7fe9677fe640 1 --2- 172.21.15.77:0/3518465392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9680fd7f0 0x7fe96810d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:23.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.207+0000 7fe9677fe640 1 -- 172.21.15.77:0/3518465392 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe95c005040 con 0x7fe9680fc520 2024-09-18T21:19:23.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.208+0000 7fe9677fe640 1 --2- 172.21.15.77:0/3518465392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9680fc520 0x7fe96810d060 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe95800cb10 tx=0x7fe958007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:19:23.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.208+0000 7fe94ffff640 1 -- 172.21.15.77:0/3518465392 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe958004200 con 0x7fe9680fc520 2024-09-18T21:19:23.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.208+0000 7fe94ffff640 1 -- 172.21.15.77:0/3518465392 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe95800acc0 con 0x7fe9680fc520 2024-09-18T21:19:23.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.208+0000 7fe96e213640 1 -- 172.21.15.77:0/3518465392 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe96810e6a0 con 0x7fe9680fc520 2024-09-18T21:19:23.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.208+0000 7fe94ffff640 1 -- 172.21.15.77:0/3518465392 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe958003dc0 con 0x7fe9680fc520 2024-09-18T21:19:23.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.208+0000 7fe96e213640 1 -- 172.21.15.77:0/3518465392 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe96810ec40 con 0x7fe9680fc520 2024-09-18T21:19:23.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.209+0000 7fe96e213640 1 -- 172.21.15.77:0/3518465392 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9680fb980 con 0x7fe9680fc520 2024-09-18T21:19:23.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.209+0000 7fe94ffff640 1 -- 172.21.15.77:0/3518465392 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fe95800a820 con 0x7fe9680fc520 2024-09-18T21:19:23.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.210+0000 7fe94ffff640 1 --2- 172.21.15.77:0/3518465392 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fe95006e0b0 0x7fe950070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:19:23.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.210+0000 7fe94ffff640 1 -- 172.21.15.77:0/3518465392 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fe95808e200 con 0x7fe9680fc520 2024-09-18T21:19:23.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.210+0000 7fe966ffd640 1 --2- 172.21.15.77:0/3518465392 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fe95006e0b0 0x7fe950070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:19:23.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.210+0000 7fe966ffd640 1 --2- 172.21.15.77:0/3518465392 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fe95006e0b0 0x7fe950070560 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe95c000c00 tx=0x7fe95c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:19:23.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.214+0000 7fe94ffff640 1 -- 172.21.15.77:0/3518465392 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fe958057600 con 0x7fe9680fc520 2024-09-18T21:19:23.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.396+0000 7fe96e213640 1 -- 172.21.15.77:0/3518465392 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe96810f000 con 0x7fe95006e0b0 2024-09-18T21:19:23.397 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:23 smithi077 ceph-mon[92672]: pgmap v162: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2024-09-18T21:19:23.397 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:23 smithi077 ceph-mon[92672]: reconnect by client.14492 192.168.0.1:0/1125901818 after 0.000999979 2024-09-18T21:19:23.398 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:23 smithi077 ceph-mon[92672]: reconnect by client.24295 192.168.0.1:0/178146206 after 0.000999979 2024-09-18T21:19:23.398 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:23 smithi077 ceph-mon[92672]: mds.? [v2:172.21.15.77:6828/862540650,v1:172.21.15.77:6829/862540650] up:reconnect 2024-09-18T21:19:23.398 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:23 smithi077 ceph-mon[92672]: fsmap cephfs:1/1 {0=cephfs.smithi077.cqfhlw=up:reconnect} 2 up:standby 2024-09-18T21:19:23.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.397+0000 7fe94ffff640 1 -- 172.21.15.77:0/3518465392 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe96810f000 con 0x7fe95006e0b0 2024-09-18T21:19:23.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.399+0000 7fe96e213640 1 -- 172.21.15.77:0/3518465392 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fe95006e0b0 msgr2=0x7fe950070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:23.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.399+0000 7fe96e213640 1 --2- 172.21.15.77:0/3518465392 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fe95006e0b0 0x7fe950070560 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe95c000c00 tx=0x7fe95c009da0 comp rx=0 tx=0).stop 2024-09-18T21:19:23.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.399+0000 7fe96e213640 1 -- 172.21.15.77:0/3518465392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9680fc520 msgr2=0x7fe96810d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:23.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.399+0000 7fe96e213640 1 --2- 172.21.15.77:0/3518465392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9680fc520 0x7fe96810d060 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe95800cb10 tx=0x7fe958007f00 comp rx=0 tx=0).stop 2024-09-18T21:19:23.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.399+0000 7fe96e213640 1 -- 172.21.15.77:0/3518465392 shutdown_connections 2024-09-18T21:19:23.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.399+0000 7fe96e213640 1 --2- 172.21.15.77:0/3518465392 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fe95006e0b0 0x7fe950070560 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:23.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.399+0000 7fe96e213640 1 --2- 172.21.15.77:0/3518465392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe9680fd7f0 0x7fe96810d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:23.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.399+0000 7fe96e213640 1 --2- 172.21.15.77:0/3518465392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9680fc520 0x7fe96810d060 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:23.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.399+0000 7fe96e213640 1 -- 172.21.15.77:0/3518465392 >> 172.21.15.77:0/3518465392 conn(0x7fe9680f7ce0 msgr2=0x7fe9680f94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:19:23.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.399+0000 7fe96e213640 1 -- 172.21.15.77:0/3518465392 shutdown_connections 2024-09-18T21:19:23.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.400+0000 7fe96e213640 1 -- 172.21.15.77:0/3518465392 wait complete. 2024-09-18T21:19:23.409 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-09-18T21:19:23.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.479+0000 7f8b1b43b640 1 -- 172.21.15.77:0/2405956090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b140fb450 msgr2=0x7f8b140fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:23.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.479+0000 7f8b1b43b640 1 --2- 172.21.15.77:0/2405956090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b140fb450 0x7f8b140fb860 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8b040048d0 tx=0x7f8b04009da0 comp rx=0 tx=0).stop 2024-09-18T21:19:23.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.479+0000 7f8b1b43b640 1 -- 172.21.15.77:0/2405956090 shutdown_connections 2024-09-18T21:19:23.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.479+0000 7f8b1b43b640 1 --2- 172.21.15.77:0/2405956090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b140fc720 0x7f8b140fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:23.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.479+0000 7f8b1b43b640 1 --2- 172.21.15.77:0/2405956090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b140fb450 0x7f8b140fb860 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:23.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.479+0000 7f8b1b43b640 1 -- 172.21.15.77:0/2405956090 >> 172.21.15.77:0/2405956090 conn(0x7f8b140f6c10 msgr2=0x7f8b140f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:19:23.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.479+0000 7f8b1b43b640 1 -- 172.21.15.77:0/2405956090 shutdown_connections 2024-09-18T21:19:23.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.479+0000 7f8b1b43b640 1 -- 172.21.15.77:0/2405956090 wait complete. 2024-09-18T21:19:23.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.479+0000 7f8b1b43b640 1 Processor -- start 2024-09-18T21:19:23.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.479+0000 7f8b1b43b640 1 -- start start 2024-09-18T21:19:23.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.480+0000 7f8b1b43b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b140fb450 0x7f8b1410fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:19:23.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.480+0000 7f8b1b43b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b140fc720 0x7f8b14112340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:19:23.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.480+0000 7f8b1b43b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b14066750 con 0x7f8b140fc720 2024-09-18T21:19:23.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.480+0000 7f8b1b43b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b140668c0 con 0x7f8b140fb450 2024-09-18T21:19:23.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.480+0000 7f8b189d6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b140fc720 0x7f8b14112340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:19:23.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.480+0000 7f8b189d6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b140fc720 0x7f8b14112340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50582/0 (socket says 172.21.15.77:50582) 2024-09-18T21:19:23.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.480+0000 7f8b189d6640 1 -- 172.21.15.77:0/2734209316 learned_addr learned my addr 172.21.15.77:0/2734209316 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:19:23.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.480+0000 7f8b189d6640 1 -- 172.21.15.77:0/2734209316 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b140fb450 msgr2=0x7f8b1410fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:23.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.480+0000 7f8b189d6640 1 --2- 172.21.15.77:0/2734209316 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b140fb450 0x7f8b1410fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:23.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.480+0000 7f8b189d6640 1 -- 172.21.15.77:0/2734209316 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b04005040 con 0x7f8b140fc720 2024-09-18T21:19:23.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.480+0000 7f8b189d6640 1 --2- 172.21.15.77:0/2734209316 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b140fc720 0x7f8b14112340 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8b1000c830 tx=0x7f8b10004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:19:23.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.480+0000 7f8b09ffb640 1 -- 172.21.15.77:0/2734209316 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b1000a850 con 0x7f8b140fc720 2024-09-18T21:19:23.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.480+0000 7f8b09ffb640 1 -- 172.21.15.77:0/2734209316 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8b1000ae50 con 0x7f8b140fc720 2024-09-18T21:19:23.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.480+0000 7f8b1b43b640 1 -- 172.21.15.77:0/2734209316 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b141128e0 con 0x7f8b140fc720 2024-09-18T21:19:23.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.480+0000 7f8b09ffb640 1 -- 172.21.15.77:0/2734209316 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b100113a0 con 0x7f8b140fc720 2024-09-18T21:19:23.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.481+0000 7f8b1b43b640 1 -- 172.21.15.77:0/2734209316 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b14112e80 con 0x7f8b140fc720 2024-09-18T21:19:23.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.482+0000 7f8b1b43b640 1 -- 172.21.15.77:0/2734209316 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b140fa8b0 con 0x7f8b140fc720 2024-09-18T21:19:23.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.482+0000 7f8b09ffb640 1 -- 172.21.15.77:0/2734209316 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f8b10012400 con 0x7f8b140fc720 2024-09-18T21:19:23.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.482+0000 7f8b09ffb640 1 --2- 172.21.15.77:0/2734209316 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f8b0006e0b0 0x7f8b00070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:19:23.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.483+0000 7f8b09ffb640 1 -- 172.21.15.77:0/2734209316 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f8b1008dc90 con 0x7f8b140fc720 2024-09-18T21:19:23.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.483+0000 7f8b191d7640 1 --2- 172.21.15.77:0/2734209316 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f8b0006e0b0 0x7f8b00070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:19:23.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.483+0000 7f8b191d7640 1 --2- 172.21.15.77:0/2734209316 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f8b0006e0b0 0x7f8b00070560 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8b0402a530 tx=0x7f8b04009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:19:23.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.487+0000 7f8b09ffb640 1 -- 172.21.15.77:0/2734209316 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f8b10057130 con 0x7f8b140fc720 2024-09-18T21:19:23.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:23 smithi103 ceph-mon[80307]: pgmap v162: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2024-09-18T21:19:23.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:23 smithi103 ceph-mon[80307]: reconnect by client.14492 192.168.0.1:0/1125901818 after 0.000999979 2024-09-18T21:19:23.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:23 smithi103 ceph-mon[80307]: reconnect by client.24295 192.168.0.1:0/178146206 after 0.000999979 2024-09-18T21:19:23.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:23 smithi103 ceph-mon[80307]: mds.? [v2:172.21.15.77:6828/862540650,v1:172.21.15.77:6829/862540650] up:reconnect 2024-09-18T21:19:23.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:23 smithi103 ceph-mon[80307]: fsmap cephfs:1/1 {0=cephfs.smithi077.cqfhlw=up:reconnect} 2 up:standby 2024-09-18T21:19:23.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.670+0000 7f8b1b43b640 1 -- 172.21.15.77:0/2734209316 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b14100bd0 con 0x7f8b0006e0b0 2024-09-18T21:19:23.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.671+0000 7f8b09ffb640 1 -- 172.21.15.77:0/2734209316 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f8b14100bd0 con 0x7f8b0006e0b0 2024-09-18T21:19:23.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.673+0000 7f8b1b43b640 1 -- 172.21.15.77:0/2734209316 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f8b0006e0b0 msgr2=0x7f8b00070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:23.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.673+0000 7f8b1b43b640 1 --2- 172.21.15.77:0/2734209316 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f8b0006e0b0 0x7f8b00070560 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8b0402a530 tx=0x7f8b04009da0 comp rx=0 tx=0).stop 2024-09-18T21:19:23.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.673+0000 7f8b1b43b640 1 -- 172.21.15.77:0/2734209316 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b140fc720 msgr2=0x7f8b14112340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:23.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.673+0000 7f8b1b43b640 1 --2- 172.21.15.77:0/2734209316 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b140fc720 0x7f8b14112340 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8b1000c830 tx=0x7f8b10004430 comp rx=0 tx=0).stop 2024-09-18T21:19:23.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.673+0000 7f8b1b43b640 1 -- 172.21.15.77:0/2734209316 shutdown_connections 2024-09-18T21:19:23.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.673+0000 7f8b1b43b640 1 --2- 172.21.15.77:0/2734209316 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8b140fc720 0x7f8b14112340 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:23.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.673+0000 7f8b1b43b640 1 --2- 172.21.15.77:0/2734209316 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f8b0006e0b0 0x7f8b00070560 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:23.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.673+0000 7f8b1b43b640 1 --2- 172.21.15.77:0/2734209316 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b140fb450 0x7f8b1410fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:23.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.673+0000 7f8b1b43b640 1 -- 172.21.15.77:0/2734209316 >> 172.21.15.77:0/2734209316 conn(0x7f8b140f6c10 msgr2=0x7f8b140f8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:19:23.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.674+0000 7f8b1b43b640 1 -- 172.21.15.77:0/2734209316 shutdown_connections 2024-09-18T21:19:23.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.674+0000 7f8b1b43b640 1 -- 172.21.15.77:0/2734209316 wait complete. 2024-09-18T21:19:23.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.752+0000 7f6bbb4ab640 1 -- 172.21.15.77:0/382516349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6bb40fca50 msgr2=0x7f6bb40fce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:23.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.752+0000 7f6bbb4ab640 1 --2- 172.21.15.77:0/382516349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6bb40fca50 0x7f6bb40fce60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4004930 tx=0x7f6ba4009da0 comp rx=0 tx=0).stop 2024-09-18T21:19:23.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.752+0000 7f6bbb4ab640 1 -- 172.21.15.77:0/382516349 shutdown_connections 2024-09-18T21:19:23.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.752+0000 7f6bbb4ab640 1 --2- 172.21.15.77:0/382516349 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bb40fd3a0 0x7f6bb40fb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:23.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.752+0000 7f6bbb4ab640 1 --2- 172.21.15.77:0/382516349 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6bb40fca50 0x7f6bb40fce60 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:23.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.752+0000 7f6bbb4ab640 1 -- 172.21.15.77:0/382516349 >> 172.21.15.77:0/382516349 conn(0x7f6bb40f63c0 msgr2=0x7f6bb40f87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:19:23.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.752+0000 7f6bbb4ab640 1 -- 172.21.15.77:0/382516349 shutdown_connections 2024-09-18T21:19:23.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.752+0000 7f6bbb4ab640 1 -- 172.21.15.77:0/382516349 wait complete. 2024-09-18T21:19:23.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.752+0000 7f6bbb4ab640 1 Processor -- start 2024-09-18T21:19:23.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.752+0000 7f6bbb4ab640 1 -- start start 2024-09-18T21:19:23.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.753+0000 7f6bbb4ab640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bb40fca50 0x7f6bb410af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:19:23.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.753+0000 7f6bbb4ab640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6bb40fd3a0 0x7f6bb410b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:19:23.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.753+0000 7f6bbb4ab640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb410bae0 con 0x7f6bb40fd3a0 2024-09-18T21:19:23.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.753+0000 7f6bbb4ab640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb410c300 con 0x7f6bb40fca50 2024-09-18T21:19:23.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.753+0000 7f6bb8a46640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6bb40fd3a0 0x7f6bb410b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:19:23.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.753+0000 7f6bb8a46640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6bb40fd3a0 0x7f6bb410b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50594/0 (socket says 172.21.15.77:50594) 2024-09-18T21:19:23.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.753+0000 7f6bb8a46640 1 -- 172.21.15.77:0/3334050552 learned_addr learned my addr 172.21.15.77:0/3334050552 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:19:23.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.753+0000 7f6bb9247640 1 --2- 172.21.15.77:0/3334050552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bb40fca50 0x7f6bb410af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:19:23.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.753+0000 7f6bb8a46640 1 -- 172.21.15.77:0/3334050552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bb40fca50 msgr2=0x7f6bb410af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:23.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.753+0000 7f6bb8a46640 1 --2- 172.21.15.77:0/3334050552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bb40fca50 0x7f6bb410af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:23.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.753+0000 7f6bb8a46640 1 -- 172.21.15.77:0/3334050552 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba4005040 con 0x7f6bb40fd3a0 2024-09-18T21:19:23.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.753+0000 7f6bb8a46640 1 --2- 172.21.15.77:0/3334050552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6bb40fd3a0 0x7f6bb410b490 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0002870 tx=0x7f6bb0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:19:23.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.753+0000 7f6ba9ffb640 1 -- 172.21.15.77:0/3334050552 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bb0007c30 con 0x7f6bb40fd3a0 2024-09-18T21:19:23.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.753+0000 7f6ba9ffb640 1 -- 172.21.15.77:0/3334050552 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6bb000f040 con 0x7f6bb40fd3a0 2024-09-18T21:19:23.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.753+0000 7f6bbb4ab640 1 -- 172.21.15.77:0/3334050552 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb410c590 con 0x7f6bb40fd3a0 2024-09-18T21:19:23.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.753+0000 7f6ba9ffb640 1 -- 172.21.15.77:0/3334050552 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bb000da70 con 0x7f6bb40fd3a0 2024-09-18T21:19:23.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.754+0000 7f6bbb4ab640 1 -- 172.21.15.77:0/3334050552 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb410cb30 con 0x7f6bb40fd3a0 2024-09-18T21:19:23.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.755+0000 7f6bbb4ab640 1 -- 172.21.15.77:0/3334050552 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bb40fa060 con 0x7f6bb40fd3a0 2024-09-18T21:19:23.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.755+0000 7f6ba9ffb640 1 -- 172.21.15.77:0/3334050552 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f6bb000dbd0 con 0x7f6bb40fd3a0 2024-09-18T21:19:23.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.755+0000 7f6ba9ffb640 1 --2- 172.21.15.77:0/3334050552 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f6ba006e0b0 0x7f6ba0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:19:23.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.756+0000 7f6ba9ffb640 1 -- 172.21.15.77:0/3334050552 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f6bb008d260 con 0x7f6bb40fd3a0 2024-09-18T21:19:23.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.756+0000 7f6bb9247640 1 --2- 172.21.15.77:0/3334050552 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f6ba006e0b0 0x7f6ba0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:19:23.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.756+0000 7f6bb9247640 1 --2- 172.21.15.77:0/3334050552 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f6ba006e0b0 0x7f6ba0070560 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4000c00 tx=0x7f6ba4037040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:19:23.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.760+0000 7f6ba9ffb640 1 -- 172.21.15.77:0/3334050552 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f6bb0056690 con 0x7f6bb40fd3a0 2024-09-18T21:19:23.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.936+0000 7f6bbb4ab640 1 -- 172.21.15.77:0/3334050552 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6bb410ce60 con 0x7f6ba006e0b0 2024-09-18T21:19:23.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.945+0000 7f6ba9ffb640 1 -- 172.21.15.77:0/3334050552 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f6bb410ce60 con 0x7f6ba006e0b0 2024-09-18T21:19:23.947 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T21:19:23.947 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager.smithi077 smithi077 *:9093,9094 running (6m) 112s ago 14m 24.2M - 0.25.0 c8568f914cd2 b201d325a55b 2024-09-18T21:19:23.947 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi077 smithi077 running (3m) 112s ago 14m 6891k - 19.1.1-17-g06b1b1de f79f744f586d 5872fa24b792 2024-09-18T21:19:23.947 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi103 smithi103 running (3m) 17s ago 13m 6887k - 19.1.1-17-g06b1b1de f79f744f586d cd1604469f34 2024-09-18T21:19:23.947 INFO:teuthology.orchestra.run.smithi077.stdout:grafana.smithi077 smithi077 *:3000 running (6m) 112s ago 13m 83.1M - 9.4.7 954c08fa6188 d06ef3ab9e66 2024-09-18T21:19:23.947 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.cqfhlw smithi077 running (8m) 112s ago 8m 14.8M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 a7ec3b7701b6 2024-09-18T21:19:23.947 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.vruydi smithi077 running (9m) 112s ago 9m 141M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 affbba097d3b 2024-09-18T21:19:23.947 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi103.opftmf smithi103 running (8m) 17s ago 8m 17.3M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 111f884c5a34 2024-09-18T21:19:23.947 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi103.zhdmdg smithi103 running (9m) 17s ago 9m 16.5M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 50b77d0edda5 2024-09-18T21:19:23.947 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi077.utkpjg smithi077 *:8443,9283,8765 running (5m) 112s ago 15m 502M - 19.1.1-17-g06b1b1de f79f744f586d 99d4b0fd70f6 2024-09-18T21:19:23.947 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi103.zjztqc smithi103 *:8443,9283,8765 running (4m) 17s ago 13m 441M - 19.1.1-17-g06b1b1de f79f744f586d 54589547c4d7 2024-09-18T21:19:23.948 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi077 smithi077 running (4m) 112s ago 15m 45.3M 2048M 19.1.1-17-g06b1b1de f79f744f586d 2d0fbbea1264 2024-09-18T21:19:23.948 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi103 smithi103 running (4m) 17s ago 13m 40.4M 2048M 19.1.1-17-g06b1b1de f79f744f586d dc79edbd9602 2024-09-18T21:19:23.948 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi077 smithi077 *:9100 running (6m) 112s ago 14m 14.8M - 1.5.0 0da6a335fe13 99144245c1af 2024-09-18T21:19:23.948 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi103 smithi103 *:9100 running (5m) 17s ago 13m 16.5M - 1.5.0 0da6a335fe13 e5b51144d997 2024-09-18T21:19:23.948 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (3m) 112s ago 12m 89.4M 1557M 19.1.1-17-g06b1b1de f79f744f586d 8855b4b16e00 2024-09-18T21:19:23.948 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi077 running (2m) 112s ago 12m 98.9M 1557M 19.1.1-17-g06b1b1de f79f744f586d 2d8bc9cac96c 2024-09-18T21:19:23.948 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi077 running (117s) 112s ago 11m 11.9M 1557M 19.1.1-17-g06b1b1de f79f744f586d 93876f1d398d 2024-09-18T21:19:23.948 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi103 running (83s) 17s ago 11m 109M 2581M 19.1.1-17-g06b1b1de f79f744f586d 2556b257bf1c 2024-09-18T21:19:23.948 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi103 running (51s) 17s ago 10m 96.2M 2581M 19.1.1-17-g06b1b1de f79f744f586d 2cde7eaf88d8 2024-09-18T21:19:23.948 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi103 running (20s) 17s ago 10m 11.1M 2581M 19.1.1-17-g06b1b1de f79f744f586d e6912ab63ecc 2024-09-18T21:19:23.948 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus.smithi077 smithi077 *:9095 running (4m) 112s ago 13m 58.5M - 2.43.0 a07b618ecd1d 41f3729e3400 2024-09-18T21:19:23.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.947+0000 7f6bbb4ab640 1 -- 172.21.15.77:0/3334050552 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f6ba006e0b0 msgr2=0x7f6ba0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:23.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.947+0000 7f6bbb4ab640 1 --2- 172.21.15.77:0/3334050552 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f6ba006e0b0 0x7f6ba0070560 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4000c00 tx=0x7f6ba4037040 comp rx=0 tx=0).stop 2024-09-18T21:19:23.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.947+0000 7f6bbb4ab640 1 -- 172.21.15.77:0/3334050552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6bb40fd3a0 msgr2=0x7f6bb410b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:23.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.947+0000 7f6bbb4ab640 1 --2- 172.21.15.77:0/3334050552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6bb40fd3a0 0x7f6bb410b490 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0002870 tx=0x7f6bb0004600 comp rx=0 tx=0).stop 2024-09-18T21:19:23.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.947+0000 7f6bbb4ab640 1 -- 172.21.15.77:0/3334050552 shutdown_connections 2024-09-18T21:19:23.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.947+0000 7f6bbb4ab640 1 --2- 172.21.15.77:0/3334050552 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6bb40fd3a0 0x7f6bb410b490 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:23.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.947+0000 7f6bbb4ab640 1 --2- 172.21.15.77:0/3334050552 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f6ba006e0b0 0x7f6ba0070560 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:23.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.947+0000 7f6bbb4ab640 1 --2- 172.21.15.77:0/3334050552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bb40fca50 0x7f6bb410af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:23.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.947+0000 7f6bbb4ab640 1 -- 172.21.15.77:0/3334050552 >> 172.21.15.77:0/3334050552 conn(0x7f6bb40f63c0 msgr2=0x7f6bb40f7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:19:23.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.947+0000 7f6bbb4ab640 1 -- 172.21.15.77:0/3334050552 shutdown_connections 2024-09-18T21:19:23.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:23.948+0000 7f6bbb4ab640 1 -- 172.21.15.77:0/3334050552 wait complete. 2024-09-18T21:19:24.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.025+0000 7f7094cf2640 1 -- 172.21.15.77:0/3449266901 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70900fb430 msgr2=0x7f70900fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:24.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.025+0000 7f7094cf2640 1 --2- 172.21.15.77:0/3449266901 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70900fb430 0x7f70900fb840 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f70800048d0 tx=0x7f7080009da0 comp rx=0 tx=0).stop 2024-09-18T21:19:24.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.026+0000 7f7094cf2640 1 -- 172.21.15.77:0/3449266901 shutdown_connections 2024-09-18T21:19:24.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.026+0000 7f7094cf2640 1 --2- 172.21.15.77:0/3449266901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70900fc700 0x7f70900fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:24.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.026+0000 7f7094cf2640 1 --2- 172.21.15.77:0/3449266901 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70900fb430 0x7f70900fb840 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:24.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.026+0000 7f7094cf2640 1 -- 172.21.15.77:0/3449266901 >> 172.21.15.77:0/3449266901 conn(0x7f70900f6c10 msgr2=0x7f70900f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:19:24.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.026+0000 7f7094cf2640 1 -- 172.21.15.77:0/3449266901 shutdown_connections 2024-09-18T21:19:24.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.026+0000 7f7094cf2640 1 -- 172.21.15.77:0/3449266901 wait complete. 2024-09-18T21:19:24.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.026+0000 7f7094cf2640 1 Processor -- start 2024-09-18T21:19:24.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.026+0000 7f7094cf2640 1 -- start start 2024-09-18T21:19:24.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.026+0000 7f7094cf2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70900fb430 0x7f709010fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:19:24.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.026+0000 7f7094cf2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70900fc700 0x7f7090112310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:19:24.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.026+0000 7f7094cf2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7090065c60 con 0x7f70900fb430 2024-09-18T21:19:24.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.026+0000 7f7094cf2640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7090065dd0 con 0x7f70900fc700 2024-09-18T21:19:24.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.026+0000 7f708e59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70900fb430 0x7f709010fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:19:24.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.026+0000 7f708e59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70900fb430 0x7f709010fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50620/0 (socket says 172.21.15.77:50620) 2024-09-18T21:19:24.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.026+0000 7f708e59c640 1 -- 172.21.15.77:0/3769070540 learned_addr learned my addr 172.21.15.77:0/3769070540 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:19:24.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.027+0000 7f708dd9b640 1 --2- 172.21.15.77:0/3769070540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70900fc700 0x7f7090112310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:19:24.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.027+0000 7f708e59c640 1 -- 172.21.15.77:0/3769070540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70900fc700 msgr2=0x7f7090112310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:24.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.027+0000 7f708e59c640 1 --2- 172.21.15.77:0/3769070540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70900fc700 0x7f7090112310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:24.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.027+0000 7f708e59c640 1 -- 172.21.15.77:0/3769070540 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7080005040 con 0x7f70900fb430 2024-09-18T21:19:24.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.027+0000 7f708e59c640 1 --2- 172.21.15.77:0/3769070540 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70900fb430 0x7f709010fdc0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f70800043d0 tx=0x7f7080009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:19:24.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.027+0000 7f707effd640 1 -- 172.21.15.77:0/3769070540 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7080038070 con 0x7f70900fb430 2024-09-18T21:19:24.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.027+0000 7f707effd640 1 -- 172.21.15.77:0/3769070540 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f708002ae90 con 0x7f70900fb430 2024-09-18T21:19:24.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.027+0000 7f7094cf2640 1 -- 172.21.15.77:0/3769070540 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7090112850 con 0x7f70900fb430 2024-09-18T21:19:24.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.027+0000 7f707effd640 1 -- 172.21.15.77:0/3769070540 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f708003e670 con 0x7f70900fb430 2024-09-18T21:19:24.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.027+0000 7f7094cf2640 1 -- 172.21.15.77:0/3769070540 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7090112dc0 con 0x7f70900fb430 2024-09-18T21:19:24.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.028+0000 7f7094cf2640 1 -- 172.21.15.77:0/3769070540 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70900fa890 con 0x7f70900fb430 2024-09-18T21:19:24.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.029+0000 7f707effd640 1 -- 172.21.15.77:0/3769070540 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7080030020 con 0x7f70900fb430 2024-09-18T21:19:24.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.029+0000 7f707effd640 1 --2- 172.21.15.77:0/3769070540 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f707806e0b0 0x7f7078070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:19:24.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.029+0000 7f707effd640 1 -- 172.21.15.77:0/3769070540 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f70800add90 con 0x7f70900fb430 2024-09-18T21:19:24.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.029+0000 7f708dd9b640 1 --2- 172.21.15.77:0/3769070540 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f707806e0b0 0x7f7078070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:19:24.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.030+0000 7f708dd9b640 1 --2- 172.21.15.77:0/3769070540 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f707806e0b0 0x7f7078070560 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7084007fd0 tx=0x7f7084009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:19:24.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.033+0000 7f707effd640 1 -- 172.21.15.77:0/3769070540 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f7080077110 con 0x7f70900fb430 2024-09-18T21:19:24.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:24 smithi077 ceph-mon[92672]: mds.? [v2:172.21.15.77:6828/862540650,v1:172.21.15.77:6829/862540650] up:rejoin 2024-09-18T21:19:24.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:24 smithi077 ceph-mon[92672]: fsmap cephfs:1/1 {0=cephfs.smithi077.cqfhlw=up:rejoin} 2 up:standby 2024-09-18T21:19:24.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:24 smithi077 ceph-mon[92672]: daemon mds.cephfs.smithi077.cqfhlw is now active in filesystem cephfs as rank 0 2024-09-18T21:19:24.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.273+0000 7f7094cf2640 1 -- 172.21.15.77:0/3769070540 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f70901130c0 con 0x7f70900fb430 2024-09-18T21:19:24.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.274+0000 7f707effd640 1 -- 172.21.15.77:0/3769070540 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f708007a7d0 con 0x7f70900fb430 2024-09-18T21:19:24.275 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-18T21:19:24.275 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": { 2024-09-18T21:19:24.275 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 2 2024-09-18T21:19:24.275 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:19:24.275 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": { 2024-09-18T21:19:24.275 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 2 2024-09-18T21:19:24.275 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:19:24.275 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": { 2024-09-18T21:19:24.276 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 6 2024-09-18T21:19:24.276 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:19:24.276 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-09-18T21:19:24.276 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 3 2024-09-18T21:19:24.276 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:19:24.276 INFO:teuthology.orchestra.run.smithi077.stdout: "overall": { 2024-09-18T21:19:24.276 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 3, 2024-09-18T21:19:24.276 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 10 2024-09-18T21:19:24.276 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-18T21:19:24.276 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-18T21:19:24.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.276+0000 7f7094cf2640 1 -- 172.21.15.77:0/3769070540 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f707806e0b0 msgr2=0x7f7078070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:24.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.276+0000 7f7094cf2640 1 --2- 172.21.15.77:0/3769070540 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f707806e0b0 0x7f7078070560 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7084007fd0 tx=0x7f7084009e90 comp rx=0 tx=0).stop 2024-09-18T21:19:24.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.276+0000 7f7094cf2640 1 -- 172.21.15.77:0/3769070540 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70900fb430 msgr2=0x7f709010fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:24.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.276+0000 7f7094cf2640 1 --2- 172.21.15.77:0/3769070540 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70900fb430 0x7f709010fdc0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f70800043d0 tx=0x7f7080009da0 comp rx=0 tx=0).stop 2024-09-18T21:19:24.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.276+0000 7f7094cf2640 1 -- 172.21.15.77:0/3769070540 shutdown_connections 2024-09-18T21:19:24.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.276+0000 7f7094cf2640 1 --2- 172.21.15.77:0/3769070540 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f707806e0b0 0x7f7078070560 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:24.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.276+0000 7f7094cf2640 1 --2- 172.21.15.77:0/3769070540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70900fc700 0x7f7090112310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:24.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.276+0000 7f7094cf2640 1 --2- 172.21.15.77:0/3769070540 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70900fb430 0x7f709010fdc0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:24.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.276+0000 7f7094cf2640 1 -- 172.21.15.77:0/3769070540 >> 172.21.15.77:0/3769070540 conn(0x7f70900f6c10 msgr2=0x7f70900f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:19:24.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.276+0000 7f7094cf2640 1 -- 172.21.15.77:0/3769070540 shutdown_connections 2024-09-18T21:19:24.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.277+0000 7f7094cf2640 1 -- 172.21.15.77:0/3769070540 wait complete. 2024-09-18T21:19:24.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.355+0000 7f78cebbc640 1 -- 172.21.15.77:0/1175375477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78c80fd800 msgr2=0x7f78c80fdc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:24.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.355+0000 7f78cebbc640 1 --2- 172.21.15.77:0/1175375477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78c80fd800 0x7f78c80fdc70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f78b80048d0 tx=0x7f78b8009da0 comp rx=0 tx=0).stop 2024-09-18T21:19:24.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.355+0000 7f78cebbc640 1 -- 172.21.15.77:0/1175375477 shutdown_connections 2024-09-18T21:19:24.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.355+0000 7f78cebbc640 1 --2- 172.21.15.77:0/1175375477 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78c80fd800 0x7f78c80fdc70 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:24.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.355+0000 7f78cebbc640 1 --2- 172.21.15.77:0/1175375477 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78c80fc530 0x7f78c80fc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:24.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.355+0000 7f78cebbc640 1 -- 172.21.15.77:0/1175375477 >> 172.21.15.77:0/1175375477 conn(0x7f78c80f7d10 msgr2=0x7f78c80fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:19:24.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.355+0000 7f78cebbc640 1 -- 172.21.15.77:0/1175375477 shutdown_connections 2024-09-18T21:19:24.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.355+0000 7f78cebbc640 1 -- 172.21.15.77:0/1175375477 wait complete. 2024-09-18T21:19:24.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.356+0000 7f78cebbc640 1 Processor -- start 2024-09-18T21:19:24.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.356+0000 7f78cebbc640 1 -- start start 2024-09-18T21:19:24.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.356+0000 7f78cebbc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78c80fc530 0x7f78c810d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:19:24.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.356+0000 7f78cebbc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78c80fd800 0x7f78c810d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:19:24.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.356+0000 7f78cebbc640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c810dc30 con 0x7f78c80fd800 2024-09-18T21:19:24.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.356+0000 7f78cebbc640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c810e450 con 0x7f78c80fc530 2024-09-18T21:19:24.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.356+0000 7f78bffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78c80fd800 0x7f78c810d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:19:24.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.356+0000 7f78bffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78c80fd800 0x7f78c810d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50634/0 (socket says 172.21.15.77:50634) 2024-09-18T21:19:24.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.356+0000 7f78bffff640 1 -- 172.21.15.77:0/522097402 learned_addr learned my addr 172.21.15.77:0/522097402 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:19:24.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.356+0000 7f78bffff640 1 -- 172.21.15.77:0/522097402 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78c80fc530 msgr2=0x7f78c810d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:24.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.356+0000 7f78bffff640 1 --2- 172.21.15.77:0/522097402 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78c80fc530 0x7f78c810d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:24.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.356+0000 7f78bffff640 1 -- 172.21.15.77:0/522097402 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b8005040 con 0x7f78c80fd800 2024-09-18T21:19:24.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.357+0000 7f78bffff640 1 --2- 172.21.15.77:0/522097402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78c80fd800 0x7f78c810d5e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f78b80043d0 tx=0x7f78b8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:19:24.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.357+0000 7f78bd7fa640 1 -- 172.21.15.77:0/522097402 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78b8038070 con 0x7f78c80fd800 2024-09-18T21:19:24.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.357+0000 7f78cebbc640 1 -- 172.21.15.77:0/522097402 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78c810e680 con 0x7f78c80fd800 2024-09-18T21:19:24.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.357+0000 7f78bd7fa640 1 -- 172.21.15.77:0/522097402 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f78b802ae90 con 0x7f78c80fd800 2024-09-18T21:19:24.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.357+0000 7f78bd7fa640 1 -- 172.21.15.77:0/522097402 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78b803e670 con 0x7f78c80fd800 2024-09-18T21:19:24.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.357+0000 7f78cebbc640 1 -- 172.21.15.77:0/522097402 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78c810ec20 con 0x7f78c80fd800 2024-09-18T21:19:24.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.358+0000 7f78cebbc640 1 -- 172.21.15.77:0/522097402 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78c80fb990 con 0x7f78c80fd800 2024-09-18T21:19:24.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.358+0000 7f78bd7fa640 1 -- 172.21.15.77:0/522097402 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f78b8030020 con 0x7f78c80fd800 2024-09-18T21:19:24.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.359+0000 7f78bd7fa640 1 --2- 172.21.15.77:0/522097402 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f78b006e0b0 0x7f78b0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:19:24.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.359+0000 7f78cc958640 1 --2- 172.21.15.77:0/522097402 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f78b006e0b0 0x7f78b0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:19:24.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.359+0000 7f78bd7fa640 1 -- 172.21.15.77:0/522097402 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f78b80add70 con 0x7f78c80fd800 2024-09-18T21:19:24.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.359+0000 7f78cc958640 1 --2- 172.21.15.77:0/522097402 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f78b006e0b0 0x7f78b0070560 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f78c4004c80 tx=0x7f78c4009c50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:19:24.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.363+0000 7f78bd7fa640 1 -- 172.21.15.77:0/522097402 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f78b8077170 con 0x7f78c80fd800 2024-09-18T21:19:24.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:24 smithi103 ceph-mon[80307]: mds.? [v2:172.21.15.77:6828/862540650,v1:172.21.15.77:6829/862540650] up:rejoin 2024-09-18T21:19:24.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:24 smithi103 ceph-mon[80307]: fsmap cephfs:1/1 {0=cephfs.smithi077.cqfhlw=up:rejoin} 2 up:standby 2024-09-18T21:19:24.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:24 smithi103 ceph-mon[80307]: daemon mds.cephfs.smithi077.cqfhlw is now active in filesystem cephfs as rank 0 2024-09-18T21:19:24.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.565+0000 7f78cebbc640 1 -- 172.21.15.77:0/522097402 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f78c8104f60 con 0x7f78c80fd800 2024-09-18T21:19:24.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.566+0000 7f78bd7fa640 1 -- 172.21.15.77:0/522097402 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1753 (secure 0 0 0) 0x7f78b807a830 con 0x7f78c80fd800 2024-09-18T21:19:24.567 INFO:teuthology.orchestra.run.smithi077.stdout:e18 2024-09-18T21:19:24.567 INFO:teuthology.orchestra.run.smithi077.stdout:btime 2024-09-18T21:19:24:054005+0000 2024-09-18T21:19:24.567 INFO:teuthology.orchestra.run.smithi077.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T21:19:24.567 INFO:teuthology.orchestra.run.smithi077.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T21:19:24.567 INFO:teuthology.orchestra.run.smithi077.stdout:legacy client fscid: 1 2024-09-18T21:19:24.567 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:19:24.567 INFO:teuthology.orchestra.run.smithi077.stdout:Filesystem 'cephfs' (1) 2024-09-18T21:19:24.567 INFO:teuthology.orchestra.run.smithi077.stdout:fs_name cephfs 2024-09-18T21:19:24.568 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 18 2024-09-18T21:19:24.568 INFO:teuthology.orchestra.run.smithi077.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T21:19:24.568 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-09-18T21:10:17.230179+0000 2024-09-18T21:19:24.568 INFO:teuthology.orchestra.run.smithi077.stdout:modified 2024-09-18T21:19:24.054002+0000 2024-09-18T21:19:24.568 INFO:teuthology.orchestra.run.smithi077.stdout:tableserver 0 2024-09-18T21:19:24.568 INFO:teuthology.orchestra.run.smithi077.stdout:root 0 2024-09-18T21:19:24.568 INFO:teuthology.orchestra.run.smithi077.stdout:session_timeout 60 2024-09-18T21:19:24.568 INFO:teuthology.orchestra.run.smithi077.stdout:session_autoclose 300 2024-09-18T21:19:24.568 INFO:teuthology.orchestra.run.smithi077.stdout:max_file_size 1099511627776 2024-09-18T21:19:24.568 INFO:teuthology.orchestra.run.smithi077.stdout:max_xattr_size 65536 2024-09-18T21:19:24.568 INFO:teuthology.orchestra.run.smithi077.stdout:required_client_features {} 2024-09-18T21:19:24.568 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure 0 2024-09-18T21:19:24.568 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure_osd_epoch 77 2024-09-18T21:19:24.569 INFO:teuthology.orchestra.run.smithi077.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T21:19:24.569 INFO:teuthology.orchestra.run.smithi077.stdout:max_mds 1 2024-09-18T21:19:24.569 INFO:teuthology.orchestra.run.smithi077.stdout:in 0 2024-09-18T21:19:24.569 INFO:teuthology.orchestra.run.smithi077.stdout:up {0=14458} 2024-09-18T21:19:24.569 INFO:teuthology.orchestra.run.smithi077.stdout:failed 2024-09-18T21:19:24.569 INFO:teuthology.orchestra.run.smithi077.stdout:damaged 2024-09-18T21:19:24.569 INFO:teuthology.orchestra.run.smithi077.stdout:stopped 2024-09-18T21:19:24.569 INFO:teuthology.orchestra.run.smithi077.stdout:data_pools [3] 2024-09-18T21:19:24.569 INFO:teuthology.orchestra.run.smithi077.stdout:metadata_pool 2 2024-09-18T21:19:24.569 INFO:teuthology.orchestra.run.smithi077.stdout:inline_data disabled 2024-09-18T21:19:24.569 INFO:teuthology.orchestra.run.smithi077.stdout:balancer 2024-09-18T21:19:24.569 INFO:teuthology.orchestra.run.smithi077.stdout:bal_rank_mask -1 2024-09-18T21:19:24.569 INFO:teuthology.orchestra.run.smithi077.stdout:standby_count_wanted 1 2024-09-18T21:19:24.569 INFO:teuthology.orchestra.run.smithi077.stdout:qdb_cluster leader: 14458 members: 14458 2024-09-18T21:19:24.570 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.cqfhlw{0:14458} state up:active seq 137 join_fscid=1 addr [v2:172.21.15.77:6828/862540650,v1:172.21.15.77:6829/862540650] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:19:24.570 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:19:24.570 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:19:24.570 INFO:teuthology.orchestra.run.smithi077.stdout:Standby daemons: 2024-09-18T21:19:24.570 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:19:24.570 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi103.zhdmdg{-1:24255} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.103:6824/2170237078,v1:172.21.15.103:6825/2170237078] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:19:24.570 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi103.opftmf{-1:24267} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.103:6826/4241818403,v1:172.21.15.103:6827/4241818403] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:19:24.571 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 18 2024-09-18T21:19:24.571 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.567+0000 7f78cebbc640 1 -- 172.21.15.77:0/522097402 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f78b006e0b0 msgr2=0x7f78b0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:24.571 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.567+0000 7f78cebbc640 1 --2- 172.21.15.77:0/522097402 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f78b006e0b0 0x7f78b0070560 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f78c4004c80 tx=0x7f78c4009c50 comp rx=0 tx=0).stop 2024-09-18T21:19:24.571 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.567+0000 7f78cebbc640 1 -- 172.21.15.77:0/522097402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78c80fd800 msgr2=0x7f78c810d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:24.571 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.567+0000 7f78cebbc640 1 --2- 172.21.15.77:0/522097402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78c80fd800 0x7f78c810d5e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f78b80043d0 tx=0x7f78b8009da0 comp rx=0 tx=0).stop 2024-09-18T21:19:24.571 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.568+0000 7f78cebbc640 1 -- 172.21.15.77:0/522097402 shutdown_connections 2024-09-18T21:19:24.571 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.568+0000 7f78cebbc640 1 --2- 172.21.15.77:0/522097402 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78c80fd800 0x7f78c810d5e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:24.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.568+0000 7f78cebbc640 1 --2- 172.21.15.77:0/522097402 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f78b006e0b0 0x7f78b0070560 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:24.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.568+0000 7f78cebbc640 1 --2- 172.21.15.77:0/522097402 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78c80fc530 0x7f78c810d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:24.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.568+0000 7f78cebbc640 1 -- 172.21.15.77:0/522097402 >> 172.21.15.77:0/522097402 conn(0x7f78c80f7d10 msgr2=0x7f78c80f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:19:24.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.568+0000 7f78cebbc640 1 -- 172.21.15.77:0/522097402 shutdown_connections 2024-09-18T21:19:24.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.568+0000 7f78cebbc640 1 -- 172.21.15.77:0/522097402 wait complete. 2024-09-18T21:19:24.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.646+0000 7f055d900640 1 -- 172.21.15.77:0/1869748015 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05580fd810 msgr2=0x7f05580fdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:24.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.646+0000 7f055d900640 1 --2- 172.21.15.77:0/1869748015 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05580fd810 0x7f05580fdc80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f054c0048d0 tx=0x7f054c009da0 comp rx=0 tx=0).stop 2024-09-18T21:19:24.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.646+0000 7f055d900640 1 -- 172.21.15.77:0/1869748015 shutdown_connections 2024-09-18T21:19:24.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.646+0000 7f055d900640 1 --2- 172.21.15.77:0/1869748015 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05580fd810 0x7f05580fdc80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:24.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.646+0000 7f055d900640 1 --2- 172.21.15.77:0/1869748015 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05580fc540 0x7f05580fc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:24.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.646+0000 7f055d900640 1 -- 172.21.15.77:0/1869748015 >> 172.21.15.77:0/1869748015 conn(0x7f05580f7d00 msgr2=0x7f05580fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:19:24.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.647+0000 7f055d900640 1 -- 172.21.15.77:0/1869748015 shutdown_connections 2024-09-18T21:19:24.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.647+0000 7f055d900640 1 -- 172.21.15.77:0/1869748015 wait complete. 2024-09-18T21:19:24.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.647+0000 7f055d900640 1 Processor -- start 2024-09-18T21:19:24.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.647+0000 7f055d900640 1 -- start start 2024-09-18T21:19:24.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.647+0000 7f055d900640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05580fc540 0x7f0558071520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:19:24.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.647+0000 7f055d900640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05580fd810 0x7f055806fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:19:24.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.647+0000 7f055d900640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055806ffa0 con 0x7f05580fd810 2024-09-18T21:19:24.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.647+0000 7f055d900640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05580700e0 con 0x7f05580fc540 2024-09-18T21:19:24.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.647+0000 7f05567fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05580fd810 0x7f055806fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:19:24.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.648+0000 7f05567fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05580fd810 0x7f055806fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50654/0 (socket says 172.21.15.77:50654) 2024-09-18T21:19:24.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.648+0000 7f05567fc640 1 -- 172.21.15.77:0/66105679 learned_addr learned my addr 172.21.15.77:0/66105679 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:19:24.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.648+0000 7f0556ffd640 1 --2- 172.21.15.77:0/66105679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05580fc540 0x7f0558071520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:19:24.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.648+0000 7f05567fc640 1 -- 172.21.15.77:0/66105679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05580fc540 msgr2=0x7f0558071520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:24.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.648+0000 7f05567fc640 1 --2- 172.21.15.77:0/66105679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05580fc540 0x7f0558071520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:24.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.648+0000 7f05567fc640 1 -- 172.21.15.77:0/66105679 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f054c005040 con 0x7f05580fd810 2024-09-18T21:19:24.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.648+0000 7f05567fc640 1 --2- 172.21.15.77:0/66105679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05580fd810 0x7f055806fa60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f054c0043d0 tx=0x7f054c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:19:24.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.648+0000 7f053f7fe640 1 -- 172.21.15.77:0/66105679 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f054c038070 con 0x7f05580fd810 2024-09-18T21:19:24.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.648+0000 7f053f7fe640 1 -- 172.21.15.77:0/66105679 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f054c02ae90 con 0x7f05580fd810 2024-09-18T21:19:24.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.648+0000 7f055d900640 1 -- 172.21.15.77:0/66105679 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0558070360 con 0x7f05580fd810 2024-09-18T21:19:24.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.648+0000 7f053f7fe640 1 -- 172.21.15.77:0/66105679 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f054c03e670 con 0x7f05580fd810 2024-09-18T21:19:24.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.648+0000 7f055d900640 1 -- 172.21.15.77:0/66105679 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0558115100 con 0x7f05580fd810 2024-09-18T21:19:24.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.649+0000 7f055d900640 1 -- 172.21.15.77:0/66105679 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f055804b720 con 0x7f05580fd810 2024-09-18T21:19:24.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.650+0000 7f053f7fe640 1 -- 172.21.15.77:0/66105679 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f054c030020 con 0x7f05580fd810 2024-09-18T21:19:24.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.650+0000 7f053f7fe640 1 --2- 172.21.15.77:0/66105679 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f054006e0b0 0x7f0540070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:19:24.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.650+0000 7f0556ffd640 1 --2- 172.21.15.77:0/66105679 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f054006e0b0 0x7f0540070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:19:24.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.650+0000 7f053f7fe640 1 -- 172.21.15.77:0/66105679 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f054c0adc50 con 0x7f05580fd810 2024-09-18T21:19:24.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.651+0000 7f0556ffd640 1 --2- 172.21.15.77:0/66105679 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f054006e0b0 0x7f0540070560 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0548004fd0 tx=0x7f0548009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:19:24.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.655+0000 7f053f7fe640 1 -- 172.21.15.77:0/66105679 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f054c077100 con 0x7f05580fd810 2024-09-18T21:19:24.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.839+0000 7f055d900640 1 -- 172.21.15.77:0/66105679 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0558101c10 con 0x7f054006e0b0 2024-09-18T21:19:24.841 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.840+0000 7f053f7fe640 1 -- 172.21.15.77:0/66105679 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f0558101c10 con 0x7f054006e0b0 2024-09-18T21:19:24.841 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-18T21:19:24.841 INFO:teuthology.orchestra.run.smithi077.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a", 2024-09-18T21:19:24.842 INFO:teuthology.orchestra.run.smithi077.stdout: "in_progress": true, 2024-09-18T21:19:24.842 INFO:teuthology.orchestra.run.smithi077.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T21:19:24.842 INFO:teuthology.orchestra.run.smithi077.stdout: "services_complete": [ 2024-09-18T21:19:24.842 INFO:teuthology.orchestra.run.smithi077.stdout: "mon", 2024-09-18T21:19:24.842 INFO:teuthology.orchestra.run.smithi077.stdout: "crash", 2024-09-18T21:19:24.842 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr", 2024-09-18T21:19:24.842 INFO:teuthology.orchestra.run.smithi077.stdout: "osd" 2024-09-18T21:19:24.842 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-18T21:19:24.842 INFO:teuthology.orchestra.run.smithi077.stdout: "progress": "12/21 daemons upgraded", 2024-09-18T21:19:24.842 INFO:teuthology.orchestra.run.smithi077.stdout: "message": "Currently upgrading mds daemons", 2024-09-18T21:19:24.842 INFO:teuthology.orchestra.run.smithi077.stdout: "is_paused": false 2024-09-18T21:19:24.842 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-18T21:19:24.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.842+0000 7f055d900640 1 -- 172.21.15.77:0/66105679 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f054006e0b0 msgr2=0x7f0540070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:24.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.842+0000 7f055d900640 1 --2- 172.21.15.77:0/66105679 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f054006e0b0 0x7f0540070560 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0548004fd0 tx=0x7f0548009040 comp rx=0 tx=0).stop 2024-09-18T21:19:24.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.842+0000 7f055d900640 1 -- 172.21.15.77:0/66105679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05580fd810 msgr2=0x7f055806fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:24.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.842+0000 7f055d900640 1 --2- 172.21.15.77:0/66105679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05580fd810 0x7f055806fa60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f054c0043d0 tx=0x7f054c009da0 comp rx=0 tx=0).stop 2024-09-18T21:19:24.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.842+0000 7f055d900640 1 -- 172.21.15.77:0/66105679 shutdown_connections 2024-09-18T21:19:24.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.842+0000 7f055d900640 1 --2- 172.21.15.77:0/66105679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05580fd810 0x7f055806fa60 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:24.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.842+0000 7f055d900640 1 --2- 172.21.15.77:0/66105679 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f054006e0b0 0x7f0540070560 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:24.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.842+0000 7f055d900640 1 --2- 172.21.15.77:0/66105679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05580fc540 0x7f0558071520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:24.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.842+0000 7f055d900640 1 -- 172.21.15.77:0/66105679 >> 172.21.15.77:0/66105679 conn(0x7f05580f7d00 msgr2=0x7f05580f9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:19:24.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.842+0000 7f055d900640 1 -- 172.21.15.77:0/66105679 shutdown_connections 2024-09-18T21:19:24.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.842+0000 7f055d900640 1 -- 172.21.15.77:0/66105679 wait complete. 2024-09-18T21:19:24.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.921+0000 7f454c9f1640 1 -- 172.21.15.77:0/578150671 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45480fe500 msgr2=0x7f45480fa660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:24.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.921+0000 7f454c9f1640 1 --2- 172.21.15.77:0/578150671 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45480fe500 0x7f45480fa660 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f453c0048d0 tx=0x7f453c009da0 comp rx=0 tx=0).stop 2024-09-18T21:19:24.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.921+0000 7f454c9f1640 1 -- 172.21.15.77:0/578150671 shutdown_connections 2024-09-18T21:19:24.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.921+0000 7f454c9f1640 1 --2- 172.21.15.77:0/578150671 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45480fe500 0x7f45480fa660 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:24.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.921+0000 7f454c9f1640 1 --2- 172.21.15.77:0/578150671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45480fdbb0 0x7f45480fdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:24.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.921+0000 7f454c9f1640 1 -- 172.21.15.77:0/578150671 >> 172.21.15.77:0/578150671 conn(0x7f45480f63b0 msgr2=0x7f45480f87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:19:24.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.921+0000 7f454c9f1640 1 -- 172.21.15.77:0/578150671 shutdown_connections 2024-09-18T21:19:24.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.921+0000 7f454c9f1640 1 -- 172.21.15.77:0/578150671 wait complete. 2024-09-18T21:19:24.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.922+0000 7f454c9f1640 1 Processor -- start 2024-09-18T21:19:24.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.922+0000 7f454c9f1640 1 -- start start 2024-09-18T21:19:24.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.922+0000 7f454c9f1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45480fdbb0 0x7f454810d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:19:24.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.922+0000 7f454c9f1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45480fe500 0x7f454810d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:19:24.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.922+0000 7f454c9f1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454810dc40 con 0x7f45480fdbb0 2024-09-18T21:19:24.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.922+0000 7f454c9f1640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454810e460 con 0x7f45480fe500 2024-09-18T21:19:24.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.922+0000 7f454659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45480fdbb0 0x7f454810d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:19:24.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.922+0000 7f454659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45480fdbb0 0x7f454810d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50674/0 (socket says 172.21.15.77:50674) 2024-09-18T21:19:24.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.922+0000 7f454659c640 1 -- 172.21.15.77:0/1035466003 learned_addr learned my addr 172.21.15.77:0/1035466003 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:19:24.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.922+0000 7f454659c640 1 -- 172.21.15.77:0/1035466003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45480fe500 msgr2=0x7f454810d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:24.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.922+0000 7f454659c640 1 --2- 172.21.15.77:0/1035466003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45480fe500 0x7f454810d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:24.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.922+0000 7f454659c640 1 -- 172.21.15.77:0/1035466003 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f453c005040 con 0x7f45480fdbb0 2024-09-18T21:19:24.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.923+0000 7f454659c640 1 --2- 172.21.15.77:0/1035466003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45480fdbb0 0x7f454810d0b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4538002a50 tx=0x7f4538004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:19:24.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.923+0000 7f4536ffd640 1 -- 172.21.15.77:0/1035466003 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4538007c30 con 0x7f45480fdbb0 2024-09-18T21:19:24.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.923+0000 7f454c9f1640 1 -- 172.21.15.77:0/1035466003 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f454810e6f0 con 0x7f45480fdbb0 2024-09-18T21:19:24.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.923+0000 7f4536ffd640 1 -- 172.21.15.77:0/1035466003 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f453800f040 con 0x7f45480fdbb0 2024-09-18T21:19:24.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.923+0000 7f4536ffd640 1 -- 172.21.15.77:0/1035466003 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f453800da90 con 0x7f45480fdbb0 2024-09-18T21:19:24.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.923+0000 7f454c9f1640 1 -- 172.21.15.77:0/1035466003 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f454810ec90 con 0x7f45480fdbb0 2024-09-18T21:19:24.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.924+0000 7f454c9f1640 1 -- 172.21.15.77:0/1035466003 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45480fa050 con 0x7f45480fdbb0 2024-09-18T21:19:24.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.924+0000 7f4536ffd640 1 -- 172.21.15.77:0/1035466003 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f453800dd00 con 0x7f45480fdbb0 2024-09-18T21:19:24.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.925+0000 7f4536ffd640 1 --2- 172.21.15.77:0/1035466003 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f453006e0b0 0x7f4530070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:19:24.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.925+0000 7f4536ffd640 1 -- 172.21.15.77:0/1035466003 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f453808d440 con 0x7f45480fdbb0 2024-09-18T21:19:24.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.925+0000 7f4545d9b640 1 --2- 172.21.15.77:0/1035466003 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f453006e0b0 0x7f4530070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:19:24.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.925+0000 7f4545d9b640 1 --2- 172.21.15.77:0/1035466003 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f453006e0b0 0x7f4530070560 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f453c02a530 tx=0x7f453c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:19:24.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:24.929+0000 7f4536ffd640 1 -- 172.21.15.77:0/1035466003 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f45380567c0 con 0x7f45480fdbb0 2024-09-18T21:19:25.114 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:25 smithi077 ceph-mon[92672]: from='client.34372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:19:25.115 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:25 smithi077 ceph-mon[92672]: from='client.34376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:19:25.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:25.163+0000 7f454c9f1640 1 -- 172.21.15.77:0/1035466003 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f454804b720 con 0x7f45480fdbb0 2024-09-18T21:19:25.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:25.163+0000 7f4536ffd640 1 -- 172.21.15.77:0/1035466003 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f4538059e80 con 0x7f45480fdbb0 2024-09-18T21:19:25.164 INFO:teuthology.orchestra.run.smithi077.stdout:HEALTH_OK 2024-09-18T21:19:25.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:25.165+0000 7f454c9f1640 1 -- 172.21.15.77:0/1035466003 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f453006e0b0 msgr2=0x7f4530070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:25.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:25.165+0000 7f454c9f1640 1 --2- 172.21.15.77:0/1035466003 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f453006e0b0 0x7f4530070560 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f453c02a530 tx=0x7f453c009da0 comp rx=0 tx=0).stop 2024-09-18T21:19:25.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:25.165+0000 7f454c9f1640 1 -- 172.21.15.77:0/1035466003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45480fdbb0 msgr2=0x7f454810d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:25.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:25.165+0000 7f454c9f1640 1 --2- 172.21.15.77:0/1035466003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45480fdbb0 0x7f454810d0b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4538002a50 tx=0x7f4538004600 comp rx=0 tx=0).stop 2024-09-18T21:19:25.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:25.165+0000 7f454c9f1640 1 -- 172.21.15.77:0/1035466003 shutdown_connections 2024-09-18T21:19:25.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:25.165+0000 7f454c9f1640 1 --2- 172.21.15.77:0/1035466003 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f453006e0b0 0x7f4530070560 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:25.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:25.165+0000 7f454c9f1640 1 --2- 172.21.15.77:0/1035466003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45480fe500 0x7f454810d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:25.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:25.166+0000 7f454c9f1640 1 --2- 172.21.15.77:0/1035466003 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45480fdbb0 0x7f454810d0b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:25.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:25.166+0000 7f454c9f1640 1 -- 172.21.15.77:0/1035466003 >> 172.21.15.77:0/1035466003 conn(0x7f45480f63b0 msgr2=0x7f45480f7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:19:25.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:25.166+0000 7f454c9f1640 1 -- 172.21.15.77:0/1035466003 shutdown_connections 2024-09-18T21:19:25.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:25.166+0000 7f454c9f1640 1 -- 172.21.15.77:0/1035466003 wait complete. 2024-09-18T21:19:25.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:25 smithi077 ceph-mon[92672]: pgmap v163: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-09-18T21:19:25.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:25 smithi077 ceph-mon[92672]: from='client.34380 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:19:25.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:25 smithi077 ceph-mon[92672]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-18T21:19:25.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:25 smithi077 ceph-mon[92672]: Cluster is now healthy 2024-09-18T21:19:25.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:25 smithi077 ceph-mon[92672]: mds.? [v2:172.21.15.77:6828/862540650,v1:172.21.15.77:6829/862540650] up:active 2024-09-18T21:19:25.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:25 smithi077 ceph-mon[92672]: fsmap cephfs:1 {0=cephfs.smithi077.cqfhlw=up:active} 2 up:standby 2024-09-18T21:19:25.464 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:25 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/3769070540' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:19:25.464 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:25 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/522097402' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T21:19:25.464 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:25 smithi077 ceph-mon[92672]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:19:25.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:25 smithi103 ceph-mon[80307]: from='client.34372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:19:25.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:25 smithi103 ceph-mon[80307]: from='client.34376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:19:25.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:25 smithi103 ceph-mon[80307]: pgmap v163: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-09-18T21:19:25.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:25 smithi103 ceph-mon[80307]: from='client.34380 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:19:25.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:25 smithi103 ceph-mon[80307]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-18T21:19:25.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:25 smithi103 ceph-mon[80307]: Cluster is now healthy 2024-09-18T21:19:25.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:25 smithi103 ceph-mon[80307]: mds.? [v2:172.21.15.77:6828/862540650,v1:172.21.15.77:6829/862540650] up:active 2024-09-18T21:19:25.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:25 smithi103 ceph-mon[80307]: fsmap cephfs:1 {0=cephfs.smithi077.cqfhlw=up:active} 2 up:standby 2024-09-18T21:19:25.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:25 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/3769070540' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:19:25.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:25 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/522097402' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T21:19:25.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:25 smithi103 ceph-mon[80307]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:19:26.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:26 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/1035466003' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T21:19:26.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:26 smithi077 ceph-mon[92672]: pgmap v164: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-09-18T21:19:26.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:26 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:26.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:26 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/1035466003' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T21:19:26.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:26 smithi103 ceph-mon[80307]: pgmap v164: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-09-18T21:19:26.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:26 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:29.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:28 smithi077 ceph-mon[92672]: pgmap v165: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 4.3 KiB/s wr, 9 op/s 2024-09-18T21:19:29.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:28 smithi077 ceph-mon[92672]: mds.? [v2:172.21.15.77:6826/1087320436,v1:172.21.15.77:6827/1087320436] up:boot 2024-09-18T21:19:29.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:28 smithi077 ceph-mon[92672]: fsmap cephfs:1 {0=cephfs.smithi077.cqfhlw=up:active} 3 up:standby 2024-09-18T21:19:29.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:28 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.vruydi"}]: dispatch 2024-09-18T21:19:29.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:28 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:29.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:28 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:29.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:28 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:19:29.217 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:28 smithi103 ceph-mon[80307]: pgmap v165: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 4.3 KiB/s wr, 9 op/s 2024-09-18T21:19:29.217 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:28 smithi103 ceph-mon[80307]: mds.? [v2:172.21.15.77:6826/1087320436,v1:172.21.15.77:6827/1087320436] up:boot 2024-09-18T21:19:29.217 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:28 smithi103 ceph-mon[80307]: fsmap cephfs:1 {0=cephfs.smithi077.cqfhlw=up:active} 3 up:standby 2024-09-18T21:19:29.217 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:28 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.vruydi"}]: dispatch 2024-09-18T21:19:29.217 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:28 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:29.217 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:28 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:29.217 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:28 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:19:31.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:30 smithi103 ceph-mon[80307]: pgmap v166: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-09-18T21:19:31.167 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:30 smithi077 ceph-mon[92672]: pgmap v166: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-09-18T21:19:33.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:32 smithi077 ceph-mon[92672]: pgmap v167: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 4.3 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-09-18T21:19:33.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:32 smithi103 ceph-mon[80307]: pgmap v167: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 4.3 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-09-18T21:19:34.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:33 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:34.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:33 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:34.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:33 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:34.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:33 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:34.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:33 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:34.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:33 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:34.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:33 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:34.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:33 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:35.202 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:34 smithi077 ceph-mon[92672]: pgmap v168: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 4.3 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-09-18T21:19:35.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:34 smithi103 ceph-mon[80307]: pgmap v168: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 4.3 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-09-18T21:19:37.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:36 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:37.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:36 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:19:37.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:36 smithi077 ceph-mon[92672]: pgmap v169: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 344 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-09-18T21:19:37.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:36 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:37.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:36 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:37.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:36 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:19:37.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:36 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:19:37.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:36 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:37.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:36 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:37.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:36 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:19:37.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:36 smithi103 ceph-mon[80307]: pgmap v169: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 344 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-09-18T21:19:37.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:36 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:37.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:36 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:37.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:36 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:19:37.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:36 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:19:37.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:36 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:37.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:37 smithi077 ceph-mon[92672]: Detected new or changed devices on smithi077 2024-09-18T21:19:37.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:37 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:19:37.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:37 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:19:37.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:37 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:19:37.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:37 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:19:37.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:37 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:19:37.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:37 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi077.cqfhlw"]}]: dispatch 2024-09-18T21:19:37.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:37 smithi077 ceph-mon[92672]: Upgrade: It appears safe to stop mds.cephfs.smithi077.cqfhlw 2024-09-18T21:19:38.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:37 smithi103 ceph-mon[80307]: Detected new or changed devices on smithi077 2024-09-18T21:19:38.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:37 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:19:38.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:37 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:19:38.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:37 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:19:38.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:37 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:19:38.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:37 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:19:38.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:37 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi077.cqfhlw"]}]: dispatch 2024-09-18T21:19:38.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:37 smithi103 ceph-mon[80307]: Upgrade: It appears safe to stop mds.cephfs.smithi077.cqfhlw 2024-09-18T21:19:39.089 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:38 smithi077 ceph-mon[92672]: pgmap v170: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-09-18T21:19:39.089 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:38 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:39.089 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:38 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi077.cqfhlw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-18T21:19:39.089 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:38 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:19:39.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:38 smithi103 ceph-mon[80307]: pgmap v170: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-09-18T21:19:39.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:38 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:39.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:38 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi077.cqfhlw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-18T21:19:39.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:38 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:19:39.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:39 smithi077 ceph-mon[92672]: Upgrade: Updating mds.cephfs.smithi077.cqfhlw 2024-09-18T21:19:39.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:39 smithi077 ceph-mon[92672]: Deploying daemon mds.cephfs.smithi077.cqfhlw on smithi077 2024-09-18T21:19:40.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:39 smithi103 ceph-mon[80307]: Upgrade: Updating mds.cephfs.smithi077.cqfhlw 2024-09-18T21:19:40.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:39 smithi103 ceph-mon[80307]: Deploying daemon mds.cephfs.smithi077.cqfhlw on smithi077 2024-09-18T21:19:40.334 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:40 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-mon-smithi077[92668]: 2024-09-18T21:19:40.247+0000 7fa82685f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-18T21:19:41.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:40 smithi077 ceph-mon[92672]: pgmap v171: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-18T21:19:41.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:40 smithi077 ceph-mon[92672]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-18T21:19:41.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:40 smithi077 ceph-mon[92672]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-18T21:19:41.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:40 smithi077 ceph-mon[92672]: osdmap e78: 6 total, 6 up, 6 in 2024-09-18T21:19:41.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:40 smithi077 ceph-mon[92672]: Standby daemon mds.cephfs.smithi103.zhdmdg assigned to filesystem cephfs as rank 0 2024-09-18T21:19:41.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:40 smithi077 ceph-mon[92672]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-18T21:19:41.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:40 smithi077 ceph-mon[92672]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-18T21:19:41.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:40 smithi077 ceph-mon[92672]: fsmap cephfs:1/1 {0=cephfs.smithi103.zhdmdg=up:replay} 2 up:standby 2024-09-18T21:19:41.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:40 smithi103 ceph-mon[80307]: pgmap v171: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-09-18T21:19:41.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:40 smithi103 ceph-mon[80307]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-18T21:19:41.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:40 smithi103 ceph-mon[80307]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-18T21:19:41.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:40 smithi103 ceph-mon[80307]: osdmap e78: 6 total, 6 up, 6 in 2024-09-18T21:19:41.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:40 smithi103 ceph-mon[80307]: Standby daemon mds.cephfs.smithi103.zhdmdg assigned to filesystem cephfs as rank 0 2024-09-18T21:19:41.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:40 smithi103 ceph-mon[80307]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-18T21:19:41.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:40 smithi103 ceph-mon[80307]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-18T21:19:41.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:40 smithi103 ceph-mon[80307]: fsmap cephfs:1/1 {0=cephfs.smithi103.zhdmdg=up:replay} 2 up:standby 2024-09-18T21:19:42.115 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:41 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.cqfhlw"}]: dispatch 2024-09-18T21:19:42.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:41 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.cqfhlw"}]: dispatch 2024-09-18T21:19:43.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:42 smithi077 ceph-mon[92672]: pgmap v173: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:19:43.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:42 smithi103 ceph-mon[80307]: pgmap v173: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:19:45.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:44 smithi077 ceph-mon[92672]: pgmap v174: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 7.6 MiB/s rd, 2 op/s 2024-09-18T21:19:45.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:44 smithi103 ceph-mon[80307]: pgmap v174: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 7.6 MiB/s rd, 2 op/s 2024-09-18T21:19:47.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:46 smithi077 ceph-mon[92672]: pgmap v175: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-09-18T21:19:47.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:46 smithi103 ceph-mon[80307]: pgmap v175: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-09-18T21:19:49.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:48 smithi077 ceph-mon[92672]: pgmap v176: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-09-18T21:19:49.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:48 smithi077 ceph-mon[92672]: reconnect by client.24295 192.168.0.1:0/178146206 after 0.00099998 2024-09-18T21:19:49.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:48 smithi077 ceph-mon[92672]: reconnect by client.14492 192.168.0.1:0/1125901818 after 0.00099998 2024-09-18T21:19:49.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:48 smithi077 ceph-mon[92672]: mds.? [v2:172.21.15.103:6824/2170237078,v1:172.21.15.103:6825/2170237078] up:reconnect 2024-09-18T21:19:49.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:48 smithi077 ceph-mon[92672]: fsmap cephfs:1/1 {0=cephfs.smithi103.zhdmdg=up:reconnect} 2 up:standby 2024-09-18T21:19:49.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:48 smithi103 ceph-mon[80307]: pgmap v176: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-09-18T21:19:49.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:48 smithi103 ceph-mon[80307]: reconnect by client.24295 192.168.0.1:0/178146206 after 0.00099998 2024-09-18T21:19:49.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:48 smithi103 ceph-mon[80307]: reconnect by client.14492 192.168.0.1:0/1125901818 after 0.00099998 2024-09-18T21:19:49.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:48 smithi103 ceph-mon[80307]: mds.? [v2:172.21.15.103:6824/2170237078,v1:172.21.15.103:6825/2170237078] up:reconnect 2024-09-18T21:19:49.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:48 smithi103 ceph-mon[80307]: fsmap cephfs:1/1 {0=cephfs.smithi103.zhdmdg=up:reconnect} 2 up:standby 2024-09-18T21:19:50.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:49 smithi077 ceph-mon[92672]: mds.? [v2:172.21.15.103:6824/2170237078,v1:172.21.15.103:6825/2170237078] up:rejoin 2024-09-18T21:19:50.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:49 smithi077 ceph-mon[92672]: fsmap cephfs:1/1 {0=cephfs.smithi103.zhdmdg=up:rejoin} 2 up:standby 2024-09-18T21:19:50.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:49 smithi077 ceph-mon[92672]: daemon mds.cephfs.smithi103.zhdmdg is now active in filesystem cephfs as rank 0 2024-09-18T21:19:50.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:49 smithi103 ceph-mon[80307]: mds.? [v2:172.21.15.103:6824/2170237078,v1:172.21.15.103:6825/2170237078] up:rejoin 2024-09-18T21:19:50.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:49 smithi103 ceph-mon[80307]: fsmap cephfs:1/1 {0=cephfs.smithi103.zhdmdg=up:rejoin} 2 up:standby 2024-09-18T21:19:50.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:49 smithi103 ceph-mon[80307]: daemon mds.cephfs.smithi103.zhdmdg is now active in filesystem cephfs as rank 0 2024-09-18T21:19:51.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:50 smithi077 ceph-mon[92672]: pgmap v177: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-09-18T21:19:51.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:50 smithi077 ceph-mon[92672]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-18T21:19:51.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:50 smithi077 ceph-mon[92672]: Cluster is now healthy 2024-09-18T21:19:51.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:50 smithi077 ceph-mon[92672]: mds.? [v2:172.21.15.103:6824/2170237078,v1:172.21.15.103:6825/2170237078] up:active 2024-09-18T21:19:51.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:50 smithi077 ceph-mon[92672]: fsmap cephfs:1 {0=cephfs.smithi103.zhdmdg=up:active} 2 up:standby 2024-09-18T21:19:51.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:50 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:19:51.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:50 smithi103 ceph-mon[80307]: pgmap v177: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-09-18T21:19:51.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:50 smithi103 ceph-mon[80307]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-18T21:19:51.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:50 smithi103 ceph-mon[80307]: Cluster is now healthy 2024-09-18T21:19:51.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:50 smithi103 ceph-mon[80307]: mds.? [v2:172.21.15.103:6824/2170237078,v1:172.21.15.103:6825/2170237078] up:active 2024-09-18T21:19:51.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:50 smithi103 ceph-mon[80307]: fsmap cephfs:1 {0=cephfs.smithi103.zhdmdg=up:active} 2 up:standby 2024-09-18T21:19:51.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:50 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:19:52.161 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:51 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:52.161 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:51 smithi077 ceph-mon[92672]: mds.? [v2:172.21.15.77:6828/1489733233,v1:172.21.15.77:6829/1489733233] up:boot 2024-09-18T21:19:52.161 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:51 smithi077 ceph-mon[92672]: fsmap cephfs:1 {0=cephfs.smithi103.zhdmdg=up:active} 3 up:standby 2024-09-18T21:19:52.161 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:51 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.cqfhlw"}]: dispatch 2024-09-18T21:19:52.161 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:51 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:52.161 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:51 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:19:52.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:51 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:52.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:51 smithi103 ceph-mon[80307]: mds.? [v2:172.21.15.77:6828/1489733233,v1:172.21.15.77:6829/1489733233] up:boot 2024-09-18T21:19:52.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:51 smithi103 ceph-mon[80307]: fsmap cephfs:1 {0=cephfs.smithi103.zhdmdg=up:active} 3 up:standby 2024-09-18T21:19:52.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:51 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi077.cqfhlw"}]: dispatch 2024-09-18T21:19:52.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:51 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:52.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:51 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:19:53.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:52 smithi077 ceph-mon[92672]: pgmap v178: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-09-18T21:19:53.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:52 smithi103 ceph-mon[80307]: pgmap v178: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-09-18T21:19:55.250 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:54 smithi077 ceph-mon[92672]: pgmap v179: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 170 B/s wr, 7 op/s 2024-09-18T21:19:55.250 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:54 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:55.250 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:54 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:55.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.248+0000 7f7a1e533640 1 -- 172.21.15.77:0/3946626714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a180fb430 msgr2=0x7f7a180fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:55.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.248+0000 7f7a1e533640 1 --2- 172.21.15.77:0/3946626714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a180fb430 0x7f7a180fb840 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7a080048d0 tx=0x7f7a08009da0 comp rx=0 tx=0).stop 2024-09-18T21:19:55.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.248+0000 7f7a1e533640 1 -- 172.21.15.77:0/3946626714 shutdown_connections 2024-09-18T21:19:55.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.248+0000 7f7a1e533640 1 --2- 172.21.15.77:0/3946626714 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a180fc700 0x7f7a180fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:55.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.248+0000 7f7a1e533640 1 --2- 172.21.15.77:0/3946626714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a180fb430 0x7f7a180fb840 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:55.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.248+0000 7f7a1e533640 1 -- 172.21.15.77:0/3946626714 >> 172.21.15.77:0/3946626714 conn(0x7f7a180f6c10 msgr2=0x7f7a180f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:19:55.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.248+0000 7f7a1e533640 1 -- 172.21.15.77:0/3946626714 shutdown_connections 2024-09-18T21:19:55.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.248+0000 7f7a1e533640 1 -- 172.21.15.77:0/3946626714 wait complete. 2024-09-18T21:19:55.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.249+0000 7f7a1e533640 1 Processor -- start 2024-09-18T21:19:55.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.249+0000 7f7a1e533640 1 -- start start 2024-09-18T21:19:55.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.249+0000 7f7a1e533640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a180fb430 0x7f7a1810fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:19:55.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.249+0000 7f7a1e533640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a180fc700 0x7f7a181122f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:19:55.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.249+0000 7f7a1e533640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a18065c80 con 0x7f7a180fc700 2024-09-18T21:19:55.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.249+0000 7f7a1e533640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a18065df0 con 0x7f7a180fb430 2024-09-18T21:19:55.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.249+0000 7f7a177fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a180fc700 0x7f7a181122f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:19:55.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.249+0000 7f7a177fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a180fc700 0x7f7a181122f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53538/0 (socket says 172.21.15.77:53538) 2024-09-18T21:19:55.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.249+0000 7f7a177fe640 1 -- 172.21.15.77:0/1405329764 learned_addr learned my addr 172.21.15.77:0/1405329764 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:19:55.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.249+0000 7f7a17fff640 1 --2- 172.21.15.77:0/1405329764 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a180fb430 0x7f7a1810fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:19:55.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.250+0000 7f7a177fe640 1 -- 172.21.15.77:0/1405329764 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a180fb430 msgr2=0x7f7a1810fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:55.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.250+0000 7f7a177fe640 1 --2- 172.21.15.77:0/1405329764 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a180fb430 0x7f7a1810fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:55.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.250+0000 7f7a177fe640 1 -- 172.21.15.77:0/1405329764 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a08005040 con 0x7f7a180fc700 2024-09-18T21:19:55.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.250+0000 7f7a17fff640 1 --2- 172.21.15.77:0/1405329764 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a180fb430 0x7f7a1810fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T21:19:55.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.250+0000 7f7a177fe640 1 --2- 172.21.15.77:0/1405329764 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a180fc700 0x7f7a181122f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c002a50 tx=0x7f7a0c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:19:55.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.250+0000 7f7a14ff9640 1 -- 172.21.15.77:0/1405329764 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a0c007c30 con 0x7f7a180fc700 2024-09-18T21:19:55.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.250+0000 7f7a14ff9640 1 -- 172.21.15.77:0/1405329764 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7a0c00f040 con 0x7f7a180fc700 2024-09-18T21:19:55.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.250+0000 7f7a14ff9640 1 -- 172.21.15.77:0/1405329764 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a0c00da90 con 0x7f7a180fc700 2024-09-18T21:19:55.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.250+0000 7f7a1e533640 1 -- 172.21.15.77:0/1405329764 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a18112890 con 0x7f7a180fc700 2024-09-18T21:19:55.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.250+0000 7f7a1e533640 1 -- 172.21.15.77:0/1405329764 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a18112e30 con 0x7f7a180fc700 2024-09-18T21:19:55.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.252+0000 7f7a1e533640 1 -- 172.21.15.77:0/1405329764 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a180fa890 con 0x7f7a180fc700 2024-09-18T21:19:55.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.252+0000 7f7a14ff9640 1 -- 172.21.15.77:0/1405329764 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7a0c00dc30 con 0x7f7a180fc700 2024-09-18T21:19:55.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.253+0000 7f7a14ff9640 1 --2- 172.21.15.77:0/1405329764 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f7a0006e0b0 0x7f7a00070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:19:55.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.253+0000 7f7a14ff9640 1 -- 172.21.15.77:0/1405329764 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f7a0c08d420 con 0x7f7a180fc700 2024-09-18T21:19:55.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.253+0000 7f7a17fff640 1 --2- 172.21.15.77:0/1405329764 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f7a0006e0b0 0x7f7a00070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:19:55.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.254+0000 7f7a17fff640 1 --2- 172.21.15.77:0/1405329764 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f7a0006e0b0 0x7f7a00070560 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7a08007ac0 tx=0x7f7a08035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:19:55.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.258+0000 7f7a14ff9640 1 -- 172.21.15.77:0/1405329764 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f7a0c056790 con 0x7f7a180fc700 2024-09-18T21:19:55.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:54 smithi103 ceph-mon[80307]: pgmap v179: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 170 B/s wr, 7 op/s 2024-09-18T21:19:55.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:54 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:55.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:54 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:55.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.459+0000 7f7a1e533640 1 -- 172.21.15.77:0/1405329764 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7a18100b60 con 0x7f7a0006e0b0 2024-09-18T21:19:55.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.461+0000 7f7a14ff9640 1 -- 172.21.15.77:0/1405329764 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f7a18100b60 con 0x7f7a0006e0b0 2024-09-18T21:19:55.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.463+0000 7f7a1e533640 1 -- 172.21.15.77:0/1405329764 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f7a0006e0b0 msgr2=0x7f7a00070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:55.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.463+0000 7f7a1e533640 1 --2- 172.21.15.77:0/1405329764 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f7a0006e0b0 0x7f7a00070560 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7a08007ac0 tx=0x7f7a08035040 comp rx=0 tx=0).stop 2024-09-18T21:19:55.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.463+0000 7f7a1e533640 1 -- 172.21.15.77:0/1405329764 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a180fc700 msgr2=0x7f7a181122f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:55.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.463+0000 7f7a1e533640 1 --2- 172.21.15.77:0/1405329764 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a180fc700 0x7f7a181122f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c002a50 tx=0x7f7a0c004600 comp rx=0 tx=0).stop 2024-09-18T21:19:55.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.463+0000 7f7a1e533640 1 -- 172.21.15.77:0/1405329764 shutdown_connections 2024-09-18T21:19:55.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.463+0000 7f7a1e533640 1 --2- 172.21.15.77:0/1405329764 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a180fc700 0x7f7a181122f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:55.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.463+0000 7f7a1e533640 1 --2- 172.21.15.77:0/1405329764 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f7a0006e0b0 0x7f7a00070560 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:55.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.463+0000 7f7a1e533640 1 --2- 172.21.15.77:0/1405329764 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a180fb430 0x7f7a1810fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:55.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.463+0000 7f7a1e533640 1 -- 172.21.15.77:0/1405329764 >> 172.21.15.77:0/1405329764 conn(0x7f7a180f6c10 msgr2=0x7f7a180f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:19:55.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.463+0000 7f7a1e533640 1 -- 172.21.15.77:0/1405329764 shutdown_connections 2024-09-18T21:19:55.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.463+0000 7f7a1e533640 1 -- 172.21.15.77:0/1405329764 wait complete. 2024-09-18T21:19:55.474 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-09-18T21:19:55.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.550+0000 7fa5d07de640 1 -- 172.21.15.77:0/3990969903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5c8065b80 msgr2=0x7fa5c80ff200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:55.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.550+0000 7fa5d07de640 1 --2- 172.21.15.77:0/3990969903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5c8065b80 0x7fa5c80ff200 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa5c40048d0 tx=0x7fa5c4009da0 comp rx=0 tx=0).stop 2024-09-18T21:19:55.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.551+0000 7fa5d07de640 1 -- 172.21.15.77:0/3990969903 shutdown_connections 2024-09-18T21:19:55.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.551+0000 7fa5d07de640 1 --2- 172.21.15.77:0/3990969903 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5c80ff740 0x7fa5c8101b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:55.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.551+0000 7fa5d07de640 1 --2- 172.21.15.77:0/3990969903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5c8065b80 0x7fa5c80ff200 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:55.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.551+0000 7fa5d07de640 1 -- 172.21.15.77:0/3990969903 >> 172.21.15.77:0/3990969903 conn(0x7fa5c80f6c10 msgr2=0x7fa5c80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:19:55.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.551+0000 7fa5d07de640 1 -- 172.21.15.77:0/3990969903 shutdown_connections 2024-09-18T21:19:55.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.551+0000 7fa5d07de640 1 -- 172.21.15.77:0/3990969903 wait complete. 2024-09-18T21:19:55.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.551+0000 7fa5d07de640 1 Processor -- start 2024-09-18T21:19:55.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.551+0000 7fa5d07de640 1 -- start start 2024-09-18T21:19:55.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.551+0000 7fa5d07de640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5c8065b80 0x7fa5c810d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:19:55.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.551+0000 7fa5d07de640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5c80ff740 0x7fa5c810d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:19:55.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.552+0000 7fa5d07de640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c810e4c0 con 0x7fa5c80ff740 2024-09-18T21:19:55.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.552+0000 7fa5d07de640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c810e630 con 0x7fa5c8065b80 2024-09-18T21:19:55.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.552+0000 7fa5cdd79640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5c80ff740 0x7fa5c810d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:19:55.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.552+0000 7fa5cdd79640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5c80ff740 0x7fa5c810d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53556/0 (socket says 172.21.15.77:53556) 2024-09-18T21:19:55.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.552+0000 7fa5cdd79640 1 -- 172.21.15.77:0/724368467 learned_addr learned my addr 172.21.15.77:0/724368467 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:19:55.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.552+0000 7fa5ce57a640 1 --2- 172.21.15.77:0/724368467 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5c8065b80 0x7fa5c810d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:19:55.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.552+0000 7fa5cdd79640 1 -- 172.21.15.77:0/724368467 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5c8065b80 msgr2=0x7fa5c810d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:55.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.552+0000 7fa5cdd79640 1 --2- 172.21.15.77:0/724368467 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5c8065b80 0x7fa5c810d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:55.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.552+0000 7fa5cdd79640 1 -- 172.21.15.77:0/724368467 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c4005040 con 0x7fa5c80ff740 2024-09-18T21:19:55.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.552+0000 7fa5cdd79640 1 --2- 172.21.15.77:0/724368467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5c80ff740 0x7fa5c810d650 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa5b800b790 tx=0x7fa5b80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:19:55.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.552+0000 7fa5beffd640 1 -- 172.21.15.77:0/724368467 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5b800c700 con 0x7fa5c80ff740 2024-09-18T21:19:55.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.552+0000 7fa5d07de640 1 -- 172.21.15.77:0/724368467 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5c810e910 con 0x7fa5c80ff740 2024-09-18T21:19:55.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.553+0000 7fa5d07de640 1 -- 172.21.15.77:0/724368467 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5c810ee30 con 0x7fa5c80ff740 2024-09-18T21:19:55.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.553+0000 7fa5beffd640 1 -- 172.21.15.77:0/724368467 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa5b800cd00 con 0x7fa5c80ff740 2024-09-18T21:19:55.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.553+0000 7fa5beffd640 1 -- 172.21.15.77:0/724368467 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5b8015e70 con 0x7fa5c80ff740 2024-09-18T21:19:55.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.554+0000 7fa5d07de640 1 -- 172.21.15.77:0/724368467 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5ac005240 con 0x7fa5c80ff740 2024-09-18T21:19:55.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.554+0000 7fa5beffd640 1 -- 172.21.15.77:0/724368467 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fa5b8012070 con 0x7fa5c80ff740 2024-09-18T21:19:55.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.555+0000 7fa5beffd640 1 --2- 172.21.15.77:0/724368467 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fa5b406e0b0 0x7fa5b4070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:19:55.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.555+0000 7fa5beffd640 1 -- 172.21.15.77:0/724368467 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fa5b808d5f0 con 0x7fa5c80ff740 2024-09-18T21:19:55.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.555+0000 7fa5ce57a640 1 --2- 172.21.15.77:0/724368467 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fa5b406e0b0 0x7fa5b4070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:19:55.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.555+0000 7fa5ce57a640 1 --2- 172.21.15.77:0/724368467 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fa5b406e0b0 0x7fa5b4070560 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4007ac0 tx=0x7fa5c4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:19:55.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.559+0000 7fa5beffd640 1 -- 172.21.15.77:0/724368467 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fa5b80569a0 con 0x7fa5c80ff740 2024-09-18T21:19:55.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.758+0000 7fa5d07de640 1 -- 172.21.15.77:0/724368467 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa5ac000bf0 con 0x7fa5b406e0b0 2024-09-18T21:19:55.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.759+0000 7fa5beffd640 1 -- 172.21.15.77:0/724368467 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa5ac000bf0 con 0x7fa5b406e0b0 2024-09-18T21:19:55.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.761+0000 7fa5d07de640 1 -- 172.21.15.77:0/724368467 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fa5b406e0b0 msgr2=0x7fa5b4070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:55.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.762+0000 7fa5d07de640 1 --2- 172.21.15.77:0/724368467 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fa5b406e0b0 0x7fa5b4070560 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4007ac0 tx=0x7fa5c4035040 comp rx=0 tx=0).stop 2024-09-18T21:19:55.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.762+0000 7fa5d07de640 1 -- 172.21.15.77:0/724368467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5c80ff740 msgr2=0x7fa5c810d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:55.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.762+0000 7fa5d07de640 1 --2- 172.21.15.77:0/724368467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5c80ff740 0x7fa5c810d650 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa5b800b790 tx=0x7fa5b80091d0 comp rx=0 tx=0).stop 2024-09-18T21:19:55.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.762+0000 7fa5d07de640 1 -- 172.21.15.77:0/724368467 shutdown_connections 2024-09-18T21:19:55.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.762+0000 7fa5d07de640 1 --2- 172.21.15.77:0/724368467 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5c80ff740 0x7fa5c810d650 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:55.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.762+0000 7fa5d07de640 1 --2- 172.21.15.77:0/724368467 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fa5b406e0b0 0x7fa5b4070560 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:55.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.762+0000 7fa5d07de640 1 --2- 172.21.15.77:0/724368467 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5c8065b80 0x7fa5c810d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:55.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.762+0000 7fa5d07de640 1 -- 172.21.15.77:0/724368467 >> 172.21.15.77:0/724368467 conn(0x7fa5c80f6c10 msgr2=0x7fa5c80f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:19:55.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.762+0000 7fa5d07de640 1 -- 172.21.15.77:0/724368467 shutdown_connections 2024-09-18T21:19:55.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.762+0000 7fa5d07de640 1 -- 172.21.15.77:0/724368467 wait complete. 2024-09-18T21:19:55.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.847+0000 7ff6b7506640 1 -- 172.21.15.77:0/3187140410 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6b00fd480 msgr2=0x7ff6b00ff900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:55.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.847+0000 7ff6b7506640 1 --2- 172.21.15.77:0/3187140410 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6b00fd480 0x7ff6b00ff900 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff6a00048d0 tx=0x7ff6a0009da0 comp rx=0 tx=0).stop 2024-09-18T21:19:55.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.847+0000 7ff6b7506640 1 -- 172.21.15.77:0/3187140410 shutdown_connections 2024-09-18T21:19:55.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.847+0000 7ff6b7506640 1 --2- 172.21.15.77:0/3187140410 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6b00fd480 0x7ff6b00ff900 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:55.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.847+0000 7ff6b7506640 1 --2- 172.21.15.77:0/3187140410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6b00666b0 0x7ff6b00fcf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:55.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.847+0000 7ff6b7506640 1 -- 172.21.15.77:0/3187140410 >> 172.21.15.77:0/3187140410 conn(0x7ff6b00f6c20 msgr2=0x7ff6b00f9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:19:55.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.848+0000 7ff6b7506640 1 -- 172.21.15.77:0/3187140410 shutdown_connections 2024-09-18T21:19:55.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.848+0000 7ff6b7506640 1 -- 172.21.15.77:0/3187140410 wait complete. 2024-09-18T21:19:55.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.848+0000 7ff6b7506640 1 Processor -- start 2024-09-18T21:19:55.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.848+0000 7ff6b7506640 1 -- start start 2024-09-18T21:19:55.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.848+0000 7ff6b7506640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6b00666b0 0x7ff6b0108080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:19:55.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.848+0000 7ff6b7506640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6b00fd480 0x7ff6b01085c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:19:55.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.848+0000 7ff6b7506640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b0109c00 con 0x7ff6b00fd480 2024-09-18T21:19:55.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.848+0000 7ff6b7506640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b0108b30 con 0x7ff6b00666b0 2024-09-18T21:19:55.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.849+0000 7ff6b4aa1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6b00fd480 0x7ff6b01085c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:19:55.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.849+0000 7ff6b52a2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6b00666b0 0x7ff6b0108080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:19:55.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.849+0000 7ff6b4aa1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6b00fd480 0x7ff6b01085c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53572/0 (socket says 172.21.15.77:53572) 2024-09-18T21:19:55.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.849+0000 7ff6b4aa1640 1 -- 172.21.15.77:0/2912930600 learned_addr learned my addr 172.21.15.77:0/2912930600 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:19:55.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.849+0000 7ff6b4aa1640 1 -- 172.21.15.77:0/2912930600 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6b00666b0 msgr2=0x7ff6b0108080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:55.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.849+0000 7ff6b4aa1640 1 --2- 172.21.15.77:0/2912930600 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6b00666b0 0x7ff6b0108080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:55.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.849+0000 7ff6b4aa1640 1 -- 172.21.15.77:0/2912930600 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a0005040 con 0x7ff6b00fd480 2024-09-18T21:19:55.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.849+0000 7ff6b4aa1640 1 --2- 172.21.15.77:0/2912930600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6b00fd480 0x7ff6b01085c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff6a00043d0 tx=0x7ff6a0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:19:55.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.849+0000 7ff6a5ffb640 1 -- 172.21.15.77:0/2912930600 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6a0038070 con 0x7ff6b00fd480 2024-09-18T21:19:55.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.849+0000 7ff6a5ffb640 1 -- 172.21.15.77:0/2912930600 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff6a002ae90 con 0x7ff6b00fd480 2024-09-18T21:19:55.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.849+0000 7ff6b7506640 1 -- 172.21.15.77:0/2912930600 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6b0108db0 con 0x7ff6b00fd480 2024-09-18T21:19:55.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.849+0000 7ff6a5ffb640 1 -- 172.21.15.77:0/2912930600 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6a003e670 con 0x7ff6b00fd480 2024-09-18T21:19:55.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.850+0000 7ff6b7506640 1 -- 172.21.15.77:0/2912930600 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b0121c20 con 0x7ff6b00fd480 2024-09-18T21:19:55.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.851+0000 7ff6b7506640 1 -- 172.21.15.77:0/2912930600 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6b00fa8a0 con 0x7ff6b00fd480 2024-09-18T21:19:55.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.851+0000 7ff6a5ffb640 1 -- 172.21.15.77:0/2912930600 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff6a0030020 con 0x7ff6b00fd480 2024-09-18T21:19:55.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.852+0000 7ff6a5ffb640 1 --2- 172.21.15.77:0/2912930600 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7ff69c06e0b0 0x7ff69c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:19:55.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.852+0000 7ff6a5ffb640 1 -- 172.21.15.77:0/2912930600 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6496+0+0 (secure 0 0 0) 0x7ff6a00adc40 con 0x7ff6b00fd480 2024-09-18T21:19:55.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.853+0000 7ff6b52a2640 1 --2- 172.21.15.77:0/2912930600 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7ff69c06e0b0 0x7ff69c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:19:55.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.853+0000 7ff6b52a2640 1 --2- 172.21.15.77:0/2912930600 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7ff69c06e0b0 0x7ff69c070560 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff6b01098f0 tx=0x7ff6ac00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:19:55.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:55.857+0000 7ff6a5ffb640 1 -- 172.21.15.77:0/2912930600 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7ff6a00b3020 con 0x7ff6b00fd480 2024-09-18T21:19:56.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.040+0000 7ff6b7506640 1 -- 172.21.15.77:0/2912930600 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6b00f8710 con 0x7ff69c06e0b0 2024-09-18T21:19:56.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.050+0000 7ff6a5ffb640 1 -- 172.21.15.77:0/2912930600 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7ff6b00f8710 con 0x7ff69c06e0b0 2024-09-18T21:19:56.051 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T21:19:56.052 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager.smithi077 smithi077 *:9093,9094 running (6m) 1s ago 14m 24.1M - 0.25.0 c8568f914cd2 b201d325a55b 2024-09-18T21:19:56.052 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi077 smithi077 running (4m) 1s ago 14m 6891k - 19.1.1-17-g06b1b1de f79f744f586d 5872fa24b792 2024-09-18T21:19:56.052 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi103 smithi103 running (3m) 49s ago 14m 6887k - 19.1.1-17-g06b1b1de f79f744f586d cd1604469f34 2024-09-18T21:19:56.052 INFO:teuthology.orchestra.run.smithi077.stdout:grafana.smithi077 smithi077 *:3000 running (6m) 1s ago 14m 85.1M - 9.4.7 954c08fa6188 d06ef3ab9e66 2024-09-18T21:19:56.052 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.cqfhlw smithi077 running (5s) 1s ago 9m 13.0M - 19.1.1-17-g06b1b1de f79f744f586d c74ffc2ebb80 2024-09-18T21:19:56.052 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.vruydi smithi077 running (28s) 1s ago 9m 13.2M - 19.1.1-17-g06b1b1de f79f744f586d ce474ff0a948 2024-09-18T21:19:56.052 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi103.opftmf smithi103 running (9m) 49s ago 9m 17.3M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 111f884c5a34 2024-09-18T21:19:56.052 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi103.zhdmdg smithi103 running (9m) 49s ago 9m 16.5M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 50b77d0edda5 2024-09-18T21:19:56.052 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi077.utkpjg smithi077 *:8443,9283,8765 running (6m) 1s ago 15m 506M - 19.1.1-17-g06b1b1de f79f744f586d 99d4b0fd70f6 2024-09-18T21:19:56.052 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi103.zjztqc smithi103 *:8443,9283,8765 running (5m) 49s ago 13m 441M - 19.1.1-17-g06b1b1de f79f744f586d 54589547c4d7 2024-09-18T21:19:56.052 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi077 smithi077 running (4m) 1s ago 16m 51.2M 2048M 19.1.1-17-g06b1b1de f79f744f586d 2d0fbbea1264 2024-09-18T21:19:56.052 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi103 smithi103 running (4m) 49s ago 13m 40.4M 2048M 19.1.1-17-g06b1b1de f79f744f586d dc79edbd9602 2024-09-18T21:19:56.052 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi077 smithi077 *:9100 running (6m) 1s ago 14m 14.9M - 1.5.0 0da6a335fe13 99144245c1af 2024-09-18T21:19:56.053 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi103 smithi103 *:9100 running (6m) 49s ago 13m 16.5M - 1.5.0 0da6a335fe13 e5b51144d997 2024-09-18T21:19:56.053 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (3m) 1s ago 13m 98.0M 1557M 19.1.1-17-g06b1b1de f79f744f586d 8855b4b16e00 2024-09-18T21:19:56.053 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi077 running (3m) 1s ago 12m 111M 1557M 19.1.1-17-g06b1b1de f79f744f586d 2d8bc9cac96c 2024-09-18T21:19:56.053 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi077 running (2m) 1s ago 12m 100M 1557M 19.1.1-17-g06b1b1de f79f744f586d 93876f1d398d 2024-09-18T21:19:56.053 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi103 running (115s) 49s ago 11m 109M 2581M 19.1.1-17-g06b1b1de f79f744f586d 2556b257bf1c 2024-09-18T21:19:56.053 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi103 running (83s) 49s ago 11m 96.2M 2581M 19.1.1-17-g06b1b1de f79f744f586d 2cde7eaf88d8 2024-09-18T21:19:56.053 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi103 running (52s) 49s ago 11m 11.1M 2581M 19.1.1-17-g06b1b1de f79f744f586d e6912ab63ecc 2024-09-18T21:19:56.053 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus.smithi077 smithi077 *:9095 running (5m) 1s ago 14m 65.5M - 2.43.0 a07b618ecd1d 41f3729e3400 2024-09-18T21:19:56.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.052+0000 7ff6b7506640 1 -- 172.21.15.77:0/2912930600 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7ff69c06e0b0 msgr2=0x7ff69c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:56.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.052+0000 7ff6b7506640 1 --2- 172.21.15.77:0/2912930600 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7ff69c06e0b0 0x7ff69c070560 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff6b01098f0 tx=0x7ff6ac00b040 comp rx=0 tx=0).stop 2024-09-18T21:19:56.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.052+0000 7ff6b7506640 1 -- 172.21.15.77:0/2912930600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6b00fd480 msgr2=0x7ff6b01085c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:56.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.052+0000 7ff6b7506640 1 --2- 172.21.15.77:0/2912930600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6b00fd480 0x7ff6b01085c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff6a00043d0 tx=0x7ff6a0009da0 comp rx=0 tx=0).stop 2024-09-18T21:19:56.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.052+0000 7ff6b7506640 1 -- 172.21.15.77:0/2912930600 shutdown_connections 2024-09-18T21:19:56.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.052+0000 7ff6b7506640 1 --2- 172.21.15.77:0/2912930600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff6b00fd480 0x7ff6b01085c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:56.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.052+0000 7ff6b7506640 1 --2- 172.21.15.77:0/2912930600 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7ff69c06e0b0 0x7ff69c070560 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:56.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.052+0000 7ff6b7506640 1 --2- 172.21.15.77:0/2912930600 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6b00666b0 0x7ff6b0108080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:56.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.052+0000 7ff6b7506640 1 -- 172.21.15.77:0/2912930600 >> 172.21.15.77:0/2912930600 conn(0x7ff6b00f6c20 msgr2=0x7ff6b00f6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:19:56.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.052+0000 7ff6b7506640 1 -- 172.21.15.77:0/2912930600 shutdown_connections 2024-09-18T21:19:56.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.052+0000 7ff6b7506640 1 -- 172.21.15.77:0/2912930600 wait complete. 2024-09-18T21:19:56.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.133+0000 7fdc8a556640 1 -- 172.21.15.77:0/1804418370 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc840fc700 msgr2=0x7fdc840fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:56.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.133+0000 7fdc8a556640 1 --2- 172.21.15.77:0/1804418370 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc840fc700 0x7fdc840fcb70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c0048d0 tx=0x7fdc6c009da0 comp rx=0 tx=0).stop 2024-09-18T21:19:56.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.133+0000 7fdc8a556640 1 -- 172.21.15.77:0/1804418370 shutdown_connections 2024-09-18T21:19:56.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.133+0000 7fdc8a556640 1 --2- 172.21.15.77:0/1804418370 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc840fc700 0x7fdc840fcb70 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:56.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.133+0000 7fdc8a556640 1 --2- 172.21.15.77:0/1804418370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc840fb430 0x7fdc840fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:56.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.133+0000 7fdc8a556640 1 -- 172.21.15.77:0/1804418370 >> 172.21.15.77:0/1804418370 conn(0x7fdc840f6c10 msgr2=0x7fdc840f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:19:56.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.133+0000 7fdc8a556640 1 -- 172.21.15.77:0/1804418370 shutdown_connections 2024-09-18T21:19:56.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.133+0000 7fdc8a556640 1 -- 172.21.15.77:0/1804418370 wait complete. 2024-09-18T21:19:56.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.133+0000 7fdc8a556640 1 Processor -- start 2024-09-18T21:19:56.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.133+0000 7fdc8a556640 1 -- start start 2024-09-18T21:19:56.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.134+0000 7fdc8a556640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc840fb430 0x7fdc8410d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:19:56.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.134+0000 7fdc8a556640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc840fc700 0x7fdc8410d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:19:56.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.134+0000 7fdc8a556640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8410dbc0 con 0x7fdc840fc700 2024-09-18T21:19:56.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.134+0000 7fdc8a556640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8410e3e0 con 0x7fdc840fb430 2024-09-18T21:19:56.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.134+0000 7fdc83fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc840fb430 0x7fdc8410d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:19:56.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.134+0000 7fdc83fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc840fb430 0x7fdc8410d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:59416/0 (socket says 172.21.15.77:59416) 2024-09-18T21:19:56.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.134+0000 7fdc83fff640 1 -- 172.21.15.77:0/2565588659 learned_addr learned my addr 172.21.15.77:0/2565588659 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:19:56.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.134+0000 7fdc7bfff640 1 --2- 172.21.15.77:0/2565588659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc840fc700 0x7fdc8410d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:19:56.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.134+0000 7fdc7bfff640 1 -- 172.21.15.77:0/2565588659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc840fb430 msgr2=0x7fdc8410d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:56.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.134+0000 7fdc7bfff640 1 --2- 172.21.15.77:0/2565588659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc840fb430 0x7fdc8410d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:56.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.134+0000 7fdc7bfff640 1 -- 172.21.15.77:0/2565588659 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc6c005040 con 0x7fdc840fc700 2024-09-18T21:19:56.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.134+0000 7fdc83fff640 1 --2- 172.21.15.77:0/2565588659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc840fb430 0x7fdc8410d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T21:19:56.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.134+0000 7fdc7bfff640 1 --2- 172.21.15.77:0/2565588659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc840fc700 0x7fdc8410d570 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c0043d0 tx=0x7fdc6c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:19:56.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.135+0000 7fdc817fa640 1 -- 172.21.15.77:0/2565588659 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc6c038070 con 0x7fdc840fc700 2024-09-18T21:19:56.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.135+0000 7fdc817fa640 1 -- 172.21.15.77:0/2565588659 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdc6c009800 con 0x7fdc840fc700 2024-09-18T21:19:56.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.135+0000 7fdc817fa640 1 -- 172.21.15.77:0/2565588659 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc6c033660 con 0x7fdc840fc700 2024-09-18T21:19:56.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.135+0000 7fdc8a556640 1 -- 172.21.15.77:0/2565588659 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc8410e610 con 0x7fdc840fc700 2024-09-18T21:19:56.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.135+0000 7fdc8a556640 1 -- 172.21.15.77:0/2565588659 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc8410ebb0 con 0x7fdc840fc700 2024-09-18T21:19:56.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.136+0000 7fdc8a556640 1 -- 172.21.15.77:0/2565588659 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc840fa890 con 0x7fdc840fc700 2024-09-18T21:19:56.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.136+0000 7fdc817fa640 1 -- 172.21.15.77:0/2565588659 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fdc6c030020 con 0x7fdc840fc700 2024-09-18T21:19:56.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.137+0000 7fdc817fa640 1 --2- 172.21.15.77:0/2565588659 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fdc7006e0b0 0x7fdc70070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:19:56.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.137+0000 7fdc817fa640 1 -- 172.21.15.77:0/2565588659 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fdc6c0adc10 con 0x7fdc840fc700 2024-09-18T21:19:56.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.137+0000 7fdc83fff640 1 --2- 172.21.15.77:0/2565588659 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fdc7006e0b0 0x7fdc70070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:19:56.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.137+0000 7fdc83fff640 1 --2- 172.21.15.77:0/2565588659 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fdc7006e0b0 0x7fdc70070560 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdc74004fd0 tx=0x7fdc7400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:19:56.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.141+0000 7fdc817fa640 1 -- 172.21.15.77:0/2565588659 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fdc6c076ff0 con 0x7fdc840fc700 2024-09-18T21:19:56.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.379+0000 7fdc8a556640 1 -- 172.21.15.77:0/2565588659 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdc8404b720 con 0x7fdc840fc700 2024-09-18T21:19:56.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.380+0000 7fdc817fa640 1 -- 172.21.15.77:0/2565588659 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+844 (secure 0 0 0) 0x7fdc6c07a6b0 con 0x7fdc840fc700 2024-09-18T21:19:56.382 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-18T21:19:56.382 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": { 2024-09-18T21:19:56.382 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 2 2024-09-18T21:19:56.382 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:19:56.382 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": { 2024-09-18T21:19:56.383 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 2 2024-09-18T21:19:56.383 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:19:56.383 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": { 2024-09-18T21:19:56.383 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 6 2024-09-18T21:19:56.383 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:19:56.383 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-09-18T21:19:56.383 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 2, 2024-09-18T21:19:56.383 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 2 2024-09-18T21:19:56.383 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:19:56.383 INFO:teuthology.orchestra.run.smithi077.stdout: "overall": { 2024-09-18T21:19:56.383 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 2, 2024-09-18T21:19:56.383 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 12 2024-09-18T21:19:56.383 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-18T21:19:56.383 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-18T21:19:56.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.382+0000 7fdc8a556640 1 -- 172.21.15.77:0/2565588659 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fdc7006e0b0 msgr2=0x7fdc70070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:56.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.382+0000 7fdc8a556640 1 --2- 172.21.15.77:0/2565588659 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fdc7006e0b0 0x7fdc70070560 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdc74004fd0 tx=0x7fdc7400b040 comp rx=0 tx=0).stop 2024-09-18T21:19:56.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.382+0000 7fdc8a556640 1 -- 172.21.15.77:0/2565588659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc840fc700 msgr2=0x7fdc8410d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:56.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.382+0000 7fdc8a556640 1 --2- 172.21.15.77:0/2565588659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc840fc700 0x7fdc8410d570 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c0043d0 tx=0x7fdc6c009da0 comp rx=0 tx=0).stop 2024-09-18T21:19:56.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.382+0000 7fdc8a556640 1 -- 172.21.15.77:0/2565588659 shutdown_connections 2024-09-18T21:19:56.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.382+0000 7fdc8a556640 1 --2- 172.21.15.77:0/2565588659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc840fc700 0x7fdc8410d570 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:56.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.382+0000 7fdc8a556640 1 --2- 172.21.15.77:0/2565588659 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fdc7006e0b0 0x7fdc70070560 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:56.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.382+0000 7fdc8a556640 1 --2- 172.21.15.77:0/2565588659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdc840fb430 0x7fdc8410d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:56.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.382+0000 7fdc8a556640 1 -- 172.21.15.77:0/2565588659 >> 172.21.15.77:0/2565588659 conn(0x7fdc840f6c10 msgr2=0x7fdc84065560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:19:56.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.382+0000 7fdc8a556640 1 -- 172.21.15.77:0/2565588659 shutdown_connections 2024-09-18T21:19:56.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.382+0000 7fdc8a556640 1 -- 172.21.15.77:0/2565588659 wait complete. 2024-09-18T21:19:56.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.460+0000 7fb1bb727640 1 -- 172.21.15.77:0/2723576997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1b40fd820 msgr2=0x7fb1b40fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:56.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.460+0000 7fb1bb727640 1 --2- 172.21.15.77:0/2723576997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1b40fd820 0x7fb1b40fdc90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb1a40048d0 tx=0x7fb1a4009da0 comp rx=0 tx=0).stop 2024-09-18T21:19:56.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.461+0000 7fb1bb727640 1 -- 172.21.15.77:0/2723576997 shutdown_connections 2024-09-18T21:19:56.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.461+0000 7fb1bb727640 1 --2- 172.21.15.77:0/2723576997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1b40fd820 0x7fb1b40fdc90 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:56.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.461+0000 7fb1bb727640 1 --2- 172.21.15.77:0/2723576997 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1b40fc550 0x7fb1b40fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:56.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.461+0000 7fb1bb727640 1 -- 172.21.15.77:0/2723576997 >> 172.21.15.77:0/2723576997 conn(0x7fb1b40f7d30 msgr2=0x7fb1b40fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:19:56.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.461+0000 7fb1bb727640 1 -- 172.21.15.77:0/2723576997 shutdown_connections 2024-09-18T21:19:56.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.461+0000 7fb1bb727640 1 -- 172.21.15.77:0/2723576997 wait complete. 2024-09-18T21:19:56.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.461+0000 7fb1bb727640 1 Processor -- start 2024-09-18T21:19:56.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.461+0000 7fb1bb727640 1 -- start start 2024-09-18T21:19:56.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.461+0000 7fb1bb727640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1b40fc550 0x7fb1b410d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:19:56.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.462+0000 7fb1bb727640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1b40fd820 0x7fb1b410d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:19:56.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.462+0000 7fb1bb727640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b410dc20 con 0x7fb1b40fd820 2024-09-18T21:19:56.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.462+0000 7fb1bb727640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b410e440 con 0x7fb1b40fc550 2024-09-18T21:19:56.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.462+0000 7fb1b8cc2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1b40fd820 0x7fb1b410d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:19:56.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.462+0000 7fb1b8cc2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1b40fd820 0x7fb1b410d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53614/0 (socket says 172.21.15.77:53614) 2024-09-18T21:19:56.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.462+0000 7fb1b8cc2640 1 -- 172.21.15.77:0/1085525979 learned_addr learned my addr 172.21.15.77:0/1085525979 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:19:56.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.462+0000 7fb1b94c3640 1 --2- 172.21.15.77:0/1085525979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1b40fc550 0x7fb1b410d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:19:56.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.462+0000 7fb1b8cc2640 1 -- 172.21.15.77:0/1085525979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1b40fc550 msgr2=0x7fb1b410d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:56.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.462+0000 7fb1b8cc2640 1 --2- 172.21.15.77:0/1085525979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1b40fc550 0x7fb1b410d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:56.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.462+0000 7fb1b8cc2640 1 -- 172.21.15.77:0/1085525979 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a4005040 con 0x7fb1b40fd820 2024-09-18T21:19:56.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.462+0000 7fb1b94c3640 1 --2- 172.21.15.77:0/1085525979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1b40fc550 0x7fb1b410d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T21:19:56.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.462+0000 7fb1b8cc2640 1 --2- 172.21.15.77:0/1085525979 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1b40fd820 0x7fb1b410d5d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4003080 tx=0x7fb1a4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:19:56.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.462+0000 7fb1a9ffb640 1 -- 172.21.15.77:0/1085525979 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1a4038070 con 0x7fb1b40fd820 2024-09-18T21:19:56.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.462+0000 7fb1a9ffb640 1 -- 172.21.15.77:0/1085525979 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb1a402abd0 con 0x7fb1b40fd820 2024-09-18T21:19:56.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.462+0000 7fb1bb727640 1 -- 172.21.15.77:0/1085525979 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1b410e670 con 0x7fb1b40fd820 2024-09-18T21:19:56.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.462+0000 7fb1a9ffb640 1 -- 172.21.15.77:0/1085525979 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1a403e670 con 0x7fb1b40fd820 2024-09-18T21:19:56.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.463+0000 7fb1bb727640 1 -- 172.21.15.77:0/1085525979 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b410ec10 con 0x7fb1b40fd820 2024-09-18T21:19:56.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.464+0000 7fb1bb727640 1 -- 172.21.15.77:0/1085525979 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1b40fb9b0 con 0x7fb1b40fd820 2024-09-18T21:19:56.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.464+0000 7fb1a9ffb640 1 -- 172.21.15.77:0/1085525979 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fb1a4030020 con 0x7fb1b40fd820 2024-09-18T21:19:56.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.464+0000 7fb1a9ffb640 1 --2- 172.21.15.77:0/1085525979 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fb1a006e0b0 0x7fb1a0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:19:56.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.464+0000 7fb1a9ffb640 1 -- 172.21.15.77:0/1085525979 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fb1a40adf70 con 0x7fb1b40fd820 2024-09-18T21:19:56.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.464+0000 7fb1b94c3640 1 --2- 172.21.15.77:0/1085525979 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fb1a006e0b0 0x7fb1a0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:19:56.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.466+0000 7fb1b94c3640 1 --2- 172.21.15.77:0/1085525979 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fb1a006e0b0 0x7fb1a0070560 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb1b0004c80 tx=0x7fb1b0009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:19:56.472 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.470+0000 7fb1a9ffb640 1 -- 172.21.15.77:0/1085525979 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fb1a40e2df0 con 0x7fb1b40fd820 2024-09-18T21:19:56.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.676+0000 7fb1bb727640 1 -- 172.21.15.77:0/1085525979 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb1b410ef20 con 0x7fb1b40fd820 2024-09-18T21:19:56.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.677+0000 7fb1a9ffb640 1 -- 172.21.15.77:0/1085525979 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) v1 ==== 76+0+1933 (secure 0 0 0) 0x7fb1a40772a0 con 0x7fb1b40fd820 2024-09-18T21:19:56.678 INFO:teuthology.orchestra.run.smithi077.stdout:e25 2024-09-18T21:19:56.678 INFO:teuthology.orchestra.run.smithi077.stdout:btime 2024-09-18T21:19:50:882837+0000 2024-09-18T21:19:56.679 INFO:teuthology.orchestra.run.smithi077.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T21:19:56.679 INFO:teuthology.orchestra.run.smithi077.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T21:19:56.679 INFO:teuthology.orchestra.run.smithi077.stdout:legacy client fscid: 1 2024-09-18T21:19:56.679 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:19:56.679 INFO:teuthology.orchestra.run.smithi077.stdout:Filesystem 'cephfs' (1) 2024-09-18T21:19:56.679 INFO:teuthology.orchestra.run.smithi077.stdout:fs_name cephfs 2024-09-18T21:19:56.679 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 24 2024-09-18T21:19:56.679 INFO:teuthology.orchestra.run.smithi077.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T21:19:56.679 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-09-18T21:10:17.230179+0000 2024-09-18T21:19:56.679 INFO:teuthology.orchestra.run.smithi077.stdout:modified 2024-09-18T21:19:49.876380+0000 2024-09-18T21:19:56.679 INFO:teuthology.orchestra.run.smithi077.stdout:tableserver 0 2024-09-18T21:19:56.679 INFO:teuthology.orchestra.run.smithi077.stdout:root 0 2024-09-18T21:19:56.680 INFO:teuthology.orchestra.run.smithi077.stdout:session_timeout 60 2024-09-18T21:19:56.680 INFO:teuthology.orchestra.run.smithi077.stdout:session_autoclose 300 2024-09-18T21:19:56.680 INFO:teuthology.orchestra.run.smithi077.stdout:max_file_size 1099511627776 2024-09-18T21:19:56.680 INFO:teuthology.orchestra.run.smithi077.stdout:max_xattr_size 65536 2024-09-18T21:19:56.680 INFO:teuthology.orchestra.run.smithi077.stdout:required_client_features {} 2024-09-18T21:19:56.680 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure 0 2024-09-18T21:19:56.680 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure_osd_epoch 78 2024-09-18T21:19:56.680 INFO:teuthology.orchestra.run.smithi077.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T21:19:56.680 INFO:teuthology.orchestra.run.smithi077.stdout:max_mds 1 2024-09-18T21:19:56.680 INFO:teuthology.orchestra.run.smithi077.stdout:in 0 2024-09-18T21:19:56.681 INFO:teuthology.orchestra.run.smithi077.stdout:up {0=24255} 2024-09-18T21:19:56.681 INFO:teuthology.orchestra.run.smithi077.stdout:failed 2024-09-18T21:19:56.681 INFO:teuthology.orchestra.run.smithi077.stdout:damaged 2024-09-18T21:19:56.681 INFO:teuthology.orchestra.run.smithi077.stdout:stopped 2024-09-18T21:19:56.681 INFO:teuthology.orchestra.run.smithi077.stdout:data_pools [3] 2024-09-18T21:19:56.681 INFO:teuthology.orchestra.run.smithi077.stdout:metadata_pool 2 2024-09-18T21:19:56.681 INFO:teuthology.orchestra.run.smithi077.stdout:inline_data disabled 2024-09-18T21:19:56.681 INFO:teuthology.orchestra.run.smithi077.stdout:balancer 2024-09-18T21:19:56.681 INFO:teuthology.orchestra.run.smithi077.stdout:bal_rank_mask -1 2024-09-18T21:19:56.681 INFO:teuthology.orchestra.run.smithi077.stdout:standby_count_wanted 1 2024-09-18T21:19:56.682 INFO:teuthology.orchestra.run.smithi077.stdout:qdb_cluster leader: 24255 members: 24255 2024-09-18T21:19:56.682 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi103.zhdmdg{0:24255} state up:active seq 144 join_fscid=1 addr [v2:172.21.15.103:6824/2170237078,v1:172.21.15.103:6825/2170237078] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:19:56.682 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:19:56.682 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:19:56.682 INFO:teuthology.orchestra.run.smithi077.stdout:Standby daemons: 2024-09-18T21:19:56.682 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:19:56.682 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi103.opftmf{-1:24267} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.103:6826/4241818403,v1:172.21.15.103:6827/4241818403] compat {c=[1],r=[1],i=[7ff]}] 2024-09-18T21:19:56.682 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.vruydi{-1:34400} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.77:6826/1087320436,v1:172.21.15.77:6827/1087320436] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T21:19:56.682 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.cqfhlw{-1:34404} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.77:6828/1489733233,v1:172.21.15.77:6829/1489733233] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T21:19:56.683 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 25 2024-09-18T21:19:56.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.679+0000 7fb1bb727640 1 -- 172.21.15.77:0/1085525979 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fb1a006e0b0 msgr2=0x7fb1a0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:56.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.679+0000 7fb1bb727640 1 --2- 172.21.15.77:0/1085525979 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fb1a006e0b0 0x7fb1a0070560 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb1b0004c80 tx=0x7fb1b0009040 comp rx=0 tx=0).stop 2024-09-18T21:19:56.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.679+0000 7fb1bb727640 1 -- 172.21.15.77:0/1085525979 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1b40fd820 msgr2=0x7fb1b410d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:56.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.679+0000 7fb1bb727640 1 --2- 172.21.15.77:0/1085525979 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1b40fd820 0x7fb1b410d5d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4003080 tx=0x7fb1a4009da0 comp rx=0 tx=0).stop 2024-09-18T21:19:56.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.680+0000 7fb1bb727640 1 -- 172.21.15.77:0/1085525979 shutdown_connections 2024-09-18T21:19:56.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.680+0000 7fb1bb727640 1 --2- 172.21.15.77:0/1085525979 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1b40fd820 0x7fb1b410d5d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:56.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.680+0000 7fb1bb727640 1 --2- 172.21.15.77:0/1085525979 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fb1a006e0b0 0x7fb1a0070560 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:56.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.680+0000 7fb1bb727640 1 --2- 172.21.15.77:0/1085525979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1b40fc550 0x7fb1b410d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:56.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.680+0000 7fb1bb727640 1 -- 172.21.15.77:0/1085525979 >> 172.21.15.77:0/1085525979 conn(0x7fb1b40f7d30 msgr2=0x7fb1b40f9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:19:56.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.680+0000 7fb1bb727640 1 -- 172.21.15.77:0/1085525979 shutdown_connections 2024-09-18T21:19:56.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.680+0000 7fb1bb727640 1 -- 172.21.15.77:0/1085525979 wait complete. 2024-09-18T21:19:56.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.759+0000 7f90330c0640 1 -- 172.21.15.77:0/2157178825 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f902c0fc720 msgr2=0x7f902c0fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:56.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.759+0000 7f90330c0640 1 --2- 172.21.15.77:0/2157178825 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f902c0fc720 0x7f902c0fcb90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f90180048d0 tx=0x7f9018009da0 comp rx=0 tx=0).stop 2024-09-18T21:19:56.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.759+0000 7f90330c0640 1 -- 172.21.15.77:0/2157178825 shutdown_connections 2024-09-18T21:19:56.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.759+0000 7f90330c0640 1 --2- 172.21.15.77:0/2157178825 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f902c0fc720 0x7f902c0fcb90 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:56.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.759+0000 7f90330c0640 1 --2- 172.21.15.77:0/2157178825 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f902c0fb450 0x7f902c0fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:56.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.759+0000 7f90330c0640 1 -- 172.21.15.77:0/2157178825 >> 172.21.15.77:0/2157178825 conn(0x7f902c0f6c10 msgr2=0x7f902c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:19:56.760 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:56 smithi077 ceph-mon[92672]: from='client.34408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:19:56.761 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:56 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:56.761 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:56 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:56.761 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:56 smithi077 ceph-mon[92672]: from='client.34412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:19:56.761 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:56 smithi077 ceph-mon[92672]: pgmap v180: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 10 MiB/s rd, 170 B/s wr, 5 op/s 2024-09-18T21:19:56.761 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:56 smithi077 ceph-mon[92672]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:19:56.761 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:56 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/2565588659' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:19:56.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.759+0000 7f90330c0640 1 -- 172.21.15.77:0/2157178825 shutdown_connections 2024-09-18T21:19:56.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.759+0000 7f90330c0640 1 -- 172.21.15.77:0/2157178825 wait complete. 2024-09-18T21:19:56.763 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.759+0000 7f90330c0640 1 Processor -- start 2024-09-18T21:19:56.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.759+0000 7f90330c0640 1 -- start start 2024-09-18T21:19:56.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.760+0000 7f90330c0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f902c0fb450 0x7f902c10bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:19:56.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.760+0000 7f90330c0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f902c0fc720 0x7f902c10c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:19:56.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.760+0000 7f90330c0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902c10cae0 con 0x7f902c0fb450 2024-09-18T21:19:56.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.760+0000 7f90330c0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902c10d300 con 0x7f902c0fc720 2024-09-18T21:19:56.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.760+0000 7f9030e5c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f902c0fb450 0x7f902c10bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:19:56.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.760+0000 7f9030e5c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f902c0fb450 0x7f902c10bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53640/0 (socket says 172.21.15.77:53640) 2024-09-18T21:19:56.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.760+0000 7f9030e5c640 1 -- 172.21.15.77:0/3880913007 learned_addr learned my addr 172.21.15.77:0/3880913007 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:19:56.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.760+0000 7f902bfff640 1 --2- 172.21.15.77:0/3880913007 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f902c0fc720 0x7f902c10c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:19:56.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.760+0000 7f9030e5c640 1 -- 172.21.15.77:0/3880913007 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f902c0fc720 msgr2=0x7f902c10c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:56.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.760+0000 7f9030e5c640 1 --2- 172.21.15.77:0/3880913007 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f902c0fc720 0x7f902c10c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:56.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.760+0000 7f9030e5c640 1 -- 172.21.15.77:0/3880913007 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9018005040 con 0x7f902c0fb450 2024-09-18T21:19:56.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.760+0000 7f9030e5c640 1 --2- 172.21.15.77:0/3880913007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f902c0fb450 0x7f902c10bf50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f902000c810 tx=0x7f90200043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:19:56.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.760+0000 7f90297fa640 1 -- 172.21.15.77:0/3880913007 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f902000a820 con 0x7f902c0fb450 2024-09-18T21:19:56.765 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.761+0000 7f90297fa640 1 -- 172.21.15.77:0/3880913007 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f902000ae20 con 0x7f902c0fb450 2024-09-18T21:19:56.765 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.761+0000 7f90330c0640 1 -- 172.21.15.77:0/3880913007 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f902c10d590 con 0x7f902c0fb450 2024-09-18T21:19:56.765 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.761+0000 7f90297fa640 1 -- 172.21.15.77:0/3880913007 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90200115c0 con 0x7f902c0fb450 2024-09-18T21:19:56.765 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.761+0000 7f90330c0640 1 -- 172.21.15.77:0/3880913007 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f902c10db30 con 0x7f902c0fb450 2024-09-18T21:19:56.765 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.762+0000 7f90330c0640 1 -- 172.21.15.77:0/3880913007 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f902c0fa8b0 con 0x7f902c0fb450 2024-09-18T21:19:56.765 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.762+0000 7f90297fa640 1 -- 172.21.15.77:0/3880913007 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9020012840 con 0x7f902c0fb450 2024-09-18T21:19:56.765 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.763+0000 7f90297fa640 1 --2- 172.21.15.77:0/3880913007 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f901c06e0b0 0x7f901c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:19:56.765 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.763+0000 7f90297fa640 1 -- 172.21.15.77:0/3880913007 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f902008e160 con 0x7f902c0fb450 2024-09-18T21:19:56.765 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.763+0000 7f902bfff640 1 --2- 172.21.15.77:0/3880913007 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f901c06e0b0 0x7f901c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:19:56.765 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.763+0000 7f902bfff640 1 --2- 172.21.15.77:0/3880913007 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f901c06e0b0 0x7f901c070560 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9018007ac0 tx=0x7f9018035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:19:56.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.767+0000 7f90297fa640 1 -- 172.21.15.77:0/3880913007 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f902005afc0 con 0x7f902c0fb450 2024-09-18T21:19:56.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.951+0000 7f90330c0640 1 -- 172.21.15.77:0/3880913007 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f902c10df40 con 0x7f901c06e0b0 2024-09-18T21:19:56.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.952+0000 7f90297fa640 1 -- 172.21.15.77:0/3880913007 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f902c10df40 con 0x7f901c06e0b0 2024-09-18T21:19:56.953 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-18T21:19:56.953 INFO:teuthology.orchestra.run.smithi077.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a", 2024-09-18T21:19:56.953 INFO:teuthology.orchestra.run.smithi077.stdout: "in_progress": true, 2024-09-18T21:19:56.953 INFO:teuthology.orchestra.run.smithi077.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T21:19:56.953 INFO:teuthology.orchestra.run.smithi077.stdout: "services_complete": [ 2024-09-18T21:19:56.954 INFO:teuthology.orchestra.run.smithi077.stdout: "mon", 2024-09-18T21:19:56.954 INFO:teuthology.orchestra.run.smithi077.stdout: "crash", 2024-09-18T21:19:56.954 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr", 2024-09-18T21:19:56.954 INFO:teuthology.orchestra.run.smithi077.stdout: "osd" 2024-09-18T21:19:56.954 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-18T21:19:56.954 INFO:teuthology.orchestra.run.smithi077.stdout: "progress": "14/21 daemons upgraded", 2024-09-18T21:19:56.954 INFO:teuthology.orchestra.run.smithi077.stdout: "message": "Currently upgrading mds daemons", 2024-09-18T21:19:56.954 INFO:teuthology.orchestra.run.smithi077.stdout: "is_paused": false 2024-09-18T21:19:56.954 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-18T21:19:56.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.954+0000 7f90330c0640 1 -- 172.21.15.77:0/3880913007 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f901c06e0b0 msgr2=0x7f901c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:56.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.954+0000 7f90330c0640 1 --2- 172.21.15.77:0/3880913007 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f901c06e0b0 0x7f901c070560 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9018007ac0 tx=0x7f9018035040 comp rx=0 tx=0).stop 2024-09-18T21:19:56.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.954+0000 7f90330c0640 1 -- 172.21.15.77:0/3880913007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f902c0fb450 msgr2=0x7f902c10bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:56.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.954+0000 7f90330c0640 1 --2- 172.21.15.77:0/3880913007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f902c0fb450 0x7f902c10bf50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f902000c810 tx=0x7f90200043c0 comp rx=0 tx=0).stop 2024-09-18T21:19:56.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.954+0000 7f90330c0640 1 -- 172.21.15.77:0/3880913007 shutdown_connections 2024-09-18T21:19:56.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.954+0000 7f90330c0640 1 --2- 172.21.15.77:0/3880913007 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f901c06e0b0 0x7f901c070560 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:56.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.954+0000 7f90330c0640 1 --2- 172.21.15.77:0/3880913007 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f902c0fc720 0x7f902c10c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:56.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.954+0000 7f90330c0640 1 --2- 172.21.15.77:0/3880913007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f902c0fb450 0x7f902c10bf50 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:56.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.954+0000 7f90330c0640 1 -- 172.21.15.77:0/3880913007 >> 172.21.15.77:0/3880913007 conn(0x7f902c0f6c10 msgr2=0x7f902c0f8370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:19:56.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.954+0000 7f90330c0640 1 -- 172.21.15.77:0/3880913007 shutdown_connections 2024-09-18T21:19:56.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:56.954+0000 7f90330c0640 1 -- 172.21.15.77:0/3880913007 wait complete. 2024-09-18T21:19:57.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:56 smithi103 ceph-mon[80307]: from='client.34408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:19:57.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:56 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:57.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:56 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:19:57.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:56 smithi103 ceph-mon[80307]: from='client.34412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:19:57.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:56 smithi103 ceph-mon[80307]: pgmap v180: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 10 MiB/s rd, 170 B/s wr, 5 op/s 2024-09-18T21:19:57.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:56 smithi103 ceph-mon[80307]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:19:57.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:56 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/2565588659' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:19:57.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:57.033+0000 7fd844376640 1 -- 172.21.15.77:0/1077016520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd83c0fc700 msgr2=0x7fd83c0fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:57.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:57.033+0000 7fd844376640 1 --2- 172.21.15.77:0/1077016520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd83c0fc700 0x7fd83c0fcb70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd8300048d0 tx=0x7fd830009da0 comp rx=0 tx=0).stop 2024-09-18T21:19:57.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:57.034+0000 7fd844376640 1 -- 172.21.15.77:0/1077016520 shutdown_connections 2024-09-18T21:19:57.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:57.034+0000 7fd844376640 1 --2- 172.21.15.77:0/1077016520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd83c0fc700 0x7fd83c0fcb70 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:57.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:57.034+0000 7fd844376640 1 --2- 172.21.15.77:0/1077016520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd83c0fb430 0x7fd83c0fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:57.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:57.034+0000 7fd844376640 1 -- 172.21.15.77:0/1077016520 >> 172.21.15.77:0/1077016520 conn(0x7fd83c0f6c10 msgr2=0x7fd83c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:19:57.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:57.034+0000 7fd844376640 1 -- 172.21.15.77:0/1077016520 shutdown_connections 2024-09-18T21:19:57.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:57.034+0000 7fd844376640 1 -- 172.21.15.77:0/1077016520 wait complete. 2024-09-18T21:19:57.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:57.034+0000 7fd844376640 1 Processor -- start 2024-09-18T21:19:57.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:57.034+0000 7fd844376640 1 -- start start 2024-09-18T21:19:57.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:57.034+0000 7fd844376640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd83c0fb430 0x7fd83c10fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:19:57.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:57.034+0000 7fd844376640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd83c0fc700 0x7fd83c1122b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:19:57.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:57.034+0000 7fd844376640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83c065c80 con 0x7fd83c0fc700 2024-09-18T21:19:57.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:57.035+0000 7fd844376640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83c065df0 con 0x7fd83c0fb430 2024-09-18T21:19:57.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:57.035+0000 7fd841911640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd83c0fc700 0x7fd83c1122b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:19:57.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:57.035+0000 7fd841911640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd83c0fc700 0x7fd83c1122b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53656/0 (socket says 172.21.15.77:53656) 2024-09-18T21:19:57.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:57.035+0000 7fd841911640 1 -- 172.21.15.77:0/2298540901 learned_addr learned my addr 172.21.15.77:0/2298540901 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:19:57.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:57.035+0000 7fd842112640 1 --2- 172.21.15.77:0/2298540901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd83c0fb430 0x7fd83c10fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:19:57.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:57.035+0000 7fd841911640 1 -- 172.21.15.77:0/2298540901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd83c0fb430 msgr2=0x7fd83c10fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:57.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:57.035+0000 7fd841911640 1 --2- 172.21.15.77:0/2298540901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd83c0fb430 0x7fd83c10fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:57.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:57.035+0000 7fd841911640 1 -- 172.21.15.77:0/2298540901 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd830005040 con 0x7fd83c0fc700 2024-09-18T21:19:57.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:57.035+0000 7fd841911640 1 --2- 172.21.15.77:0/2298540901 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd83c0fc700 0x7fd83c1122b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd830003080 tx=0x7fd830009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:19:57.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:57.035+0000 7fd83affd640 1 -- 172.21.15.77:0/2298540901 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd830038070 con 0x7fd83c0fc700 2024-09-18T21:19:57.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:57.035+0000 7fd83affd640 1 -- 172.21.15.77:0/2298540901 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd830009800 con 0x7fd83c0fc700 2024-09-18T21:19:57.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:57.035+0000 7fd844376640 1 -- 172.21.15.77:0/2298540901 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd83c1127f0 con 0x7fd83c0fc700 2024-09-18T21:19:57.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:57.035+0000 7fd83affd640 1 -- 172.21.15.77:0/2298540901 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd830033660 con 0x7fd83c0fc700 2024-09-18T21:19:57.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:57.035+0000 7fd844376640 1 -- 172.21.15.77:0/2298540901 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd83c112d30 con 0x7fd83c0fc700 2024-09-18T21:19:57.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:57.036+0000 7fd844376640 1 -- 172.21.15.77:0/2298540901 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd83c0fa890 con 0x7fd83c0fc700 2024-09-18T21:19:57.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:57.037+0000 7fd83affd640 1 -- 172.21.15.77:0/2298540901 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd830030020 con 0x7fd83c0fc700 2024-09-18T21:19:57.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:57.037+0000 7fd83affd640 1 --2- 172.21.15.77:0/2298540901 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fd82406e0b0 0x7fd824070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:19:57.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:57.037+0000 7fd83affd640 1 -- 172.21.15.77:0/2298540901 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fd8300add10 con 0x7fd83c0fc700 2024-09-18T21:19:57.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:57.037+0000 7fd842112640 1 --2- 172.21.15.77:0/2298540901 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fd82406e0b0 0x7fd824070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:19:57.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:57.038+0000 7fd842112640 1 --2- 172.21.15.77:0/2298540901 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fd82406e0b0 0x7fd824070560 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd82c007fd0 tx=0x7fd82c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:19:57.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:57.041+0000 7fd83affd640 1 -- 172.21.15.77:0/2298540901 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fd830077040 con 0x7fd83c0fc700 2024-09-18T21:19:57.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:57.287+0000 7fd844376640 1 -- 172.21.15.77:0/2298540901 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd83c04b720 con 0x7fd83c0fc700 2024-09-18T21:19:57.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:57.288+0000 7fd83affd640 1 -- 172.21.15.77:0/2298540901 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fd83007a700 con 0x7fd83c0fc700 2024-09-18T21:19:57.289 INFO:teuthology.orchestra.run.smithi077.stdout:HEALTH_OK 2024-09-18T21:19:57.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:57.290+0000 7fd844376640 1 -- 172.21.15.77:0/2298540901 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fd82406e0b0 msgr2=0x7fd824070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:57.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:57.290+0000 7fd844376640 1 --2- 172.21.15.77:0/2298540901 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fd82406e0b0 0x7fd824070560 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd82c007fd0 tx=0x7fd82c009040 comp rx=0 tx=0).stop 2024-09-18T21:19:57.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:57.290+0000 7fd844376640 1 -- 172.21.15.77:0/2298540901 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd83c0fc700 msgr2=0x7fd83c1122b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:19:57.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:57.290+0000 7fd844376640 1 --2- 172.21.15.77:0/2298540901 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd83c0fc700 0x7fd83c1122b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd830003080 tx=0x7fd830009da0 comp rx=0 tx=0).stop 2024-09-18T21:19:57.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:57.290+0000 7fd844376640 1 -- 172.21.15.77:0/2298540901 shutdown_connections 2024-09-18T21:19:57.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:57.290+0000 7fd844376640 1 --2- 172.21.15.77:0/2298540901 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd83c0fc700 0x7fd83c1122b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:57.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:57.290+0000 7fd844376640 1 --2- 172.21.15.77:0/2298540901 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fd82406e0b0 0x7fd824070560 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:57.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:57.290+0000 7fd844376640 1 --2- 172.21.15.77:0/2298540901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd83c0fb430 0x7fd83c10fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:19:57.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:57.290+0000 7fd844376640 1 -- 172.21.15.77:0/2298540901 >> 172.21.15.77:0/2298540901 conn(0x7fd83c0f6c10 msgr2=0x7fd83c0f83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:19:57.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:57.290+0000 7fd844376640 1 -- 172.21.15.77:0/2298540901 shutdown_connections 2024-09-18T21:19:57.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:19:57.290+0000 7fd844376640 1 -- 172.21.15.77:0/2298540901 wait complete. 2024-09-18T21:19:57.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:57 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/1085525979' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T21:19:57.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:57 smithi077 ceph-mon[92672]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:19:57.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:57 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/2298540901' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T21:19:58.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:57 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/1085525979' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T21:19:58.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:57 smithi103 ceph-mon[80307]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:19:58.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:57 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/2298540901' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T21:19:58.698 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:58 smithi077 ceph-mon[92672]: pgmap v181: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 6.0 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-09-18T21:19:59.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:58 smithi103 ceph-mon[80307]: pgmap v181: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 6.0 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-09-18T21:20:00.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:59 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:00.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:59 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:00.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:59 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:20:00.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:59 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:20:00.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:59 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:00.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:59 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:20:00.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:59 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:00.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:59 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:00.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:59 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:00.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:59 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:00.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:59 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi103.zhdmdg"]}]: dispatch 2024-09-18T21:20:00.015 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:19:59 smithi103 ceph-mon[80307]: Upgrade: It appears safe to stop mds.cephfs.smithi103.zhdmdg 2024-09-18T21:20:00.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:59 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:00.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:59 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:00.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:59 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:20:00.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:59 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:20:00.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:59 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:00.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:59 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:20:00.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:59 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:00.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:59 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:00.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:59 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:00.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:59 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:00.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:59 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi103.zhdmdg"]}]: dispatch 2024-09-18T21:20:00.214 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:19:59 smithi077 ceph-mon[92672]: Upgrade: It appears safe to stop mds.cephfs.smithi103.zhdmdg 2024-09-18T21:20:00.924 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:00 smithi103 ceph-mon[80307]: pgmap v182: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-09-18T21:20:00.924 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:00 smithi103 ceph-mon[80307]: overall HEALTH_OK 2024-09-18T21:20:00.924 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:00 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:00.924 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:00 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi103.zhdmdg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-18T21:20:00.924 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:00 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:20:01.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:00 smithi077 ceph-mon[92672]: pgmap v182: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-09-18T21:20:01.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:00 smithi077 ceph-mon[92672]: overall HEALTH_OK 2024-09-18T21:20:01.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:00 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:01.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:00 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi103.zhdmdg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-18T21:20:01.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:00 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:20:01.829 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:01 smithi103 ceph-mon[80307]: Upgrade: Updating mds.cephfs.smithi103.zhdmdg 2024-09-18T21:20:01.829 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:01 smithi103 ceph-mon[80307]: Deploying daemon mds.cephfs.smithi103.zhdmdg on smithi103 2024-09-18T21:20:02.085 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:01 smithi077 ceph-mon[92672]: Upgrade: Updating mds.cephfs.smithi103.zhdmdg 2024-09-18T21:20:02.085 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:01 smithi077 ceph-mon[92672]: Deploying daemon mds.cephfs.smithi103.zhdmdg on smithi103 2024-09-18T21:20:02.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:02 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-mon-smithi077[92668]: 2024-09-18T21:20:02.082+0000 7fa82685f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-18T21:20:03.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:02 smithi103 ceph-mon[80307]: pgmap v183: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-09-18T21:20:03.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:02 smithi103 ceph-mon[80307]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-18T21:20:03.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:02 smithi103 ceph-mon[80307]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-18T21:20:03.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:02 smithi103 ceph-mon[80307]: osdmap e79: 6 total, 6 up, 6 in 2024-09-18T21:20:03.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:02 smithi103 ceph-mon[80307]: Standby daemon mds.cephfs.smithi103.opftmf assigned to filesystem cephfs as rank 0 2024-09-18T21:20:03.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:02 smithi103 ceph-mon[80307]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-18T21:20:03.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:02 smithi103 ceph-mon[80307]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-18T21:20:03.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:02 smithi103 ceph-mon[80307]: fsmap cephfs:1/1 {0=cephfs.smithi103.opftmf=up:replay} 2 up:standby 2024-09-18T21:20:03.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:02 smithi077 ceph-mon[92672]: pgmap v183: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-09-18T21:20:03.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:02 smithi077 ceph-mon[92672]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-18T21:20:03.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:02 smithi077 ceph-mon[92672]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-18T21:20:03.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:02 smithi077 ceph-mon[92672]: osdmap e79: 6 total, 6 up, 6 in 2024-09-18T21:20:03.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:02 smithi077 ceph-mon[92672]: Standby daemon mds.cephfs.smithi103.opftmf assigned to filesystem cephfs as rank 0 2024-09-18T21:20:03.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:02 smithi077 ceph-mon[92672]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-18T21:20:03.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:02 smithi077 ceph-mon[92672]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-18T21:20:03.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:02 smithi077 ceph-mon[92672]: fsmap cephfs:1/1 {0=cephfs.smithi103.opftmf=up:replay} 2 up:standby 2024-09-18T21:20:05.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:04 smithi077 ceph-mon[92672]: pgmap v185: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 5.0 KiB/s wr, 3 op/s 2024-09-18T21:20:05.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:04 smithi103 ceph-mon[80307]: pgmap v185: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 5.0 KiB/s wr, 3 op/s 2024-09-18T21:20:07.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:06 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:07.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:06 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:20:07.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:06 smithi077 ceph-mon[92672]: pgmap v186: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 4.6 MiB/s rd, 5.0 KiB/s wr, 4 op/s 2024-09-18T21:20:07.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:06 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:07.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:06 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:20:07.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:06 smithi103 ceph-mon[80307]: pgmap v186: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 4.6 MiB/s rd, 5.0 KiB/s wr, 4 op/s 2024-09-18T21:20:09.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:08 smithi077 ceph-mon[92672]: pgmap v187: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 0 B/s wr, 4 op/s 2024-09-18T21:20:09.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:08 smithi103 ceph-mon[80307]: pgmap v187: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 0 B/s wr, 4 op/s 2024-09-18T21:20:11.156 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:10 smithi103 ceph-mon[80307]: pgmap v188: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 5 op/s 2024-09-18T21:20:11.156 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:10 smithi103 ceph-mon[80307]: reconnect by client.24295 192.168.0.1:0/178146206 after 0 2024-09-18T21:20:11.156 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:10 smithi103 ceph-mon[80307]: reconnect by client.14492 192.168.0.1:0/1125901818 after 0.00099998 2024-09-18T21:20:11.156 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:10 smithi103 ceph-mon[80307]: mds.? [v2:172.21.15.103:6826/4241818403,v1:172.21.15.103:6827/4241818403] up:reconnect 2024-09-18T21:20:11.156 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:10 smithi103 ceph-mon[80307]: fsmap cephfs:1/1 {0=cephfs.smithi103.opftmf=up:reconnect} 2 up:standby 2024-09-18T21:20:11.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:10 smithi077 ceph-mon[92672]: pgmap v188: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 5 op/s 2024-09-18T21:20:11.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:10 smithi077 ceph-mon[92672]: reconnect by client.24295 192.168.0.1:0/178146206 after 0 2024-09-18T21:20:11.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:10 smithi077 ceph-mon[92672]: reconnect by client.14492 192.168.0.1:0/1125901818 after 0.00099998 2024-09-18T21:20:11.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:10 smithi077 ceph-mon[92672]: mds.? [v2:172.21.15.103:6826/4241818403,v1:172.21.15.103:6827/4241818403] up:reconnect 2024-09-18T21:20:11.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:10 smithi077 ceph-mon[92672]: fsmap cephfs:1/1 {0=cephfs.smithi103.opftmf=up:reconnect} 2 up:standby 2024-09-18T21:20:12.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:11 smithi077 ceph-mon[92672]: mds.? [v2:172.21.15.103:6826/4241818403,v1:172.21.15.103:6827/4241818403] up:rejoin 2024-09-18T21:20:12.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:11 smithi077 ceph-mon[92672]: fsmap cephfs:1/1 {0=cephfs.smithi103.opftmf=up:rejoin} 2 up:standby 2024-09-18T21:20:12.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:11 smithi077 ceph-mon[92672]: daemon mds.cephfs.smithi103.opftmf is now active in filesystem cephfs as rank 0 2024-09-18T21:20:12.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:11 smithi103 ceph-mon[80307]: mds.? [v2:172.21.15.103:6826/4241818403,v1:172.21.15.103:6827/4241818403] up:rejoin 2024-09-18T21:20:12.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:11 smithi103 ceph-mon[80307]: fsmap cephfs:1/1 {0=cephfs.smithi103.opftmf=up:rejoin} 2 up:standby 2024-09-18T21:20:12.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:11 smithi103 ceph-mon[80307]: daemon mds.cephfs.smithi103.opftmf is now active in filesystem cephfs as rank 0 2024-09-18T21:20:13.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:12 smithi077 ceph-mon[92672]: pgmap v189: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 5 op/s 2024-09-18T21:20:13.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:12 smithi077 ceph-mon[92672]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-18T21:20:13.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:12 smithi077 ceph-mon[92672]: Cluster is now healthy 2024-09-18T21:20:13.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:12 smithi077 ceph-mon[92672]: mds.? [v2:172.21.15.103:6826/4241818403,v1:172.21.15.103:6827/4241818403] up:active 2024-09-18T21:20:13.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:12 smithi077 ceph-mon[92672]: mds.? [v2:172.21.15.103:6824/3296796313,v1:172.21.15.103:6825/3296796313] up:boot 2024-09-18T21:20:13.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:12 smithi077 ceph-mon[92672]: fsmap cephfs:1 {0=cephfs.smithi103.opftmf=up:active} 3 up:standby 2024-09-18T21:20:13.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:12 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi103.zhdmdg"}]: dispatch 2024-09-18T21:20:13.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:12 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:13.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:12 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:13.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:12 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:20:13.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:12 smithi103 ceph-mon[80307]: pgmap v189: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 5 op/s 2024-09-18T21:20:13.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:12 smithi103 ceph-mon[80307]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-18T21:20:13.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:12 smithi103 ceph-mon[80307]: Cluster is now healthy 2024-09-18T21:20:13.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:12 smithi103 ceph-mon[80307]: mds.? [v2:172.21.15.103:6826/4241818403,v1:172.21.15.103:6827/4241818403] up:active 2024-09-18T21:20:13.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:12 smithi103 ceph-mon[80307]: mds.? [v2:172.21.15.103:6824/3296796313,v1:172.21.15.103:6825/3296796313] up:boot 2024-09-18T21:20:13.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:12 smithi103 ceph-mon[80307]: fsmap cephfs:1 {0=cephfs.smithi103.opftmf=up:active} 3 up:standby 2024-09-18T21:20:13.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:12 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi103.zhdmdg"}]: dispatch 2024-09-18T21:20:13.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:12 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:13.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:12 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:13.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:12 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:20:15.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:14 smithi077 ceph-mon[92672]: pgmap v190: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 174 B/s wr, 6 op/s 2024-09-18T21:20:15.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:14 smithi103 ceph-mon[80307]: pgmap v190: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 174 B/s wr, 6 op/s 2024-09-18T21:20:17.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:16 smithi077 ceph-mon[92672]: pgmap v191: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 170 B/s wr, 6 op/s 2024-09-18T21:20:17.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:16 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:17.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:16 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:17.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:16 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:17.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:16 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:17.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:16 smithi103 ceph-mon[80307]: pgmap v191: 65 pgs: 65 active+clean; 203 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 170 B/s wr, 6 op/s 2024-09-18T21:20:17.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:16 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:17.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:16 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:17.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:16 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:17.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:16 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:19.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:18 smithi077 ceph-mon[92672]: pgmap v192: 65 pgs: 65 active+clean; 203 MiB data, 836 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-09-18T21:20:19.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:18 smithi103 ceph-mon[80307]: pgmap v192: 65 pgs: 65 active+clean; 203 MiB data, 836 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-09-18T21:20:21.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:21 smithi103 ceph-mon[80307]: pgmap v193: 65 pgs: 65 active+clean; 203 MiB data, 836 MiB used, 536 GiB / 536 GiB avail; 5.3 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-09-18T21:20:21.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:21 smithi103 ceph-mon[80307]: Detected new or changed devices on smithi103 2024-09-18T21:20:21.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:21 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:21.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:21 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:21.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:21 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:20:21.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:21 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:20:21.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:21 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:21.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:21 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:20:21.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:21 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:21.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:21 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:21.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:21 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:21.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:21 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:21.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:21 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi103.opftmf"]}]: dispatch 2024-09-18T21:20:21.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:21 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:21.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:21 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:20:21.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:21 smithi077 ceph-mon[92672]: pgmap v193: 65 pgs: 65 active+clean; 203 MiB data, 836 MiB used, 536 GiB / 536 GiB avail; 5.3 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-09-18T21:20:21.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:21 smithi077 ceph-mon[92672]: Detected new or changed devices on smithi103 2024-09-18T21:20:21.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:21 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:21.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:21 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:21.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:21 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:20:21.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:21 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:20:21.464 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:21 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:21.464 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:21 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:20:21.464 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:21 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:21.464 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:21 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:21.464 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:21 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:21.464 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:21 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:21.464 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:21 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi103.opftmf"]}]: dispatch 2024-09-18T21:20:21.464 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:21 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:21.464 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:21 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:20:22.077 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:22 smithi103 ceph-mon[80307]: Upgrade: It appears safe to stop mds.cephfs.smithi103.opftmf 2024-09-18T21:20:22.077 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:22 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:22.077 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:22 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi103.opftmf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-18T21:20:22.077 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:22 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:20:22.314 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:22 smithi077 ceph-mon[92672]: Upgrade: It appears safe to stop mds.cephfs.smithi103.opftmf 2024-09-18T21:20:22.314 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:22 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:22.314 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:22 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi103.opftmf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-18T21:20:22.314 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:22 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:20:23.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:23 smithi077 ceph-mon[92672]: Upgrade: Updating mds.cephfs.smithi103.opftmf 2024-09-18T21:20:23.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:23 smithi077 ceph-mon[92672]: Deploying daemon mds.cephfs.smithi103.opftmf on smithi103 2024-09-18T21:20:23.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:23 smithi077 ceph-mon[92672]: pgmap v194: 65 pgs: 65 active+clean; 203 MiB data, 836 MiB used, 536 GiB / 536 GiB avail; 1005 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-09-18T21:20:23.253 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:23 smithi103 ceph-mon[80307]: Upgrade: Updating mds.cephfs.smithi103.opftmf 2024-09-18T21:20:23.253 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:23 smithi103 ceph-mon[80307]: Deploying daemon mds.cephfs.smithi103.opftmf on smithi103 2024-09-18T21:20:23.253 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:23 smithi103 ceph-mon[80307]: pgmap v194: 65 pgs: 65 active+clean; 203 MiB data, 836 MiB used, 536 GiB / 536 GiB avail; 1005 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-09-18T21:20:23.712 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:23 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-mon-smithi077[92668]: 2024-09-18T21:20:23.252+0000 7fa82685f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-18T21:20:24.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:24 smithi077 ceph-mon[92672]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-18T21:20:24.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:24 smithi077 ceph-mon[92672]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-18T21:20:24.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:24 smithi077 ceph-mon[92672]: osdmap e80: 6 total, 6 up, 6 in 2024-09-18T21:20:24.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:24 smithi077 ceph-mon[92672]: Standby daemon mds.cephfs.smithi077.vruydi assigned to filesystem cephfs as rank 0 2024-09-18T21:20:24.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:24 smithi077 ceph-mon[92672]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-18T21:20:24.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:24 smithi077 ceph-mon[92672]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-18T21:20:24.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:24 smithi077 ceph-mon[92672]: fsmap cephfs:1/1 {0=cephfs.smithi077.vruydi=up:replay} 2 up:standby 2024-09-18T21:20:24.496 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:24 smithi103 ceph-mon[80307]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-18T21:20:24.496 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:24 smithi103 ceph-mon[80307]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-18T21:20:24.496 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:24 smithi103 ceph-mon[80307]: osdmap e80: 6 total, 6 up, 6 in 2024-09-18T21:20:24.496 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:24 smithi103 ceph-mon[80307]: Standby daemon mds.cephfs.smithi077.vruydi assigned to filesystem cephfs as rank 0 2024-09-18T21:20:24.496 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:24 smithi103 ceph-mon[80307]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-18T21:20:24.496 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:24 smithi103 ceph-mon[80307]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-18T21:20:24.497 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:24 smithi103 ceph-mon[80307]: fsmap cephfs:1/1 {0=cephfs.smithi077.vruydi=up:replay} 2 up:standby 2024-09-18T21:20:25.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:25 smithi077 ceph-mon[92672]: pgmap v196: 65 pgs: 65 active+clean; 203 MiB data, 836 MiB used, 536 GiB / 536 GiB avail; 822 KiB/s rd, 5.0 KiB/s wr, 5 op/s 2024-09-18T21:20:25.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:25 smithi103 ceph-mon[80307]: pgmap v196: 65 pgs: 65 active+clean; 203 MiB data, 836 MiB used, 536 GiB / 536 GiB avail; 822 KiB/s rd, 5.0 KiB/s wr, 5 op/s 2024-09-18T21:20:27.377 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:27 smithi077 ceph-mon[92672]: pgmap v197: 65 pgs: 65 active+clean; 203 MiB data, 836 MiB used, 536 GiB / 536 GiB avail; 3.4 MiB/s rd, 5.0 KiB/s wr, 5 op/s 2024-09-18T21:20:27.377 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:27 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi103.opftmf"}]: dispatch 2024-09-18T21:20:27.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.373+0000 7f7c89f0e640 1 -- 172.21.15.77:0/2240864876 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c84065c40 msgr2=0x7f7c840ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:20:27.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.373+0000 7f7c89f0e640 1 --2- 172.21.15.77:0/2240864876 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c84065c40 0x7f7c840ff140 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7c740048d0 tx=0x7f7c74009da0 comp rx=0 tx=0).stop 2024-09-18T21:20:27.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.373+0000 7f7c89f0e640 1 -- 172.21.15.77:0/2240864876 shutdown_connections 2024-09-18T21:20:27.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.373+0000 7f7c89f0e640 1 --2- 172.21.15.77:0/2240864876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c840ff680 0x7f7c84101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:27.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.373+0000 7f7c89f0e640 1 --2- 172.21.15.77:0/2240864876 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c84065c40 0x7f7c840ff140 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:27.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.373+0000 7f7c89f0e640 1 -- 172.21.15.77:0/2240864876 >> 172.21.15.77:0/2240864876 conn(0x7f7c840f6c10 msgr2=0x7f7c840f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:20:27.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.373+0000 7f7c89f0e640 1 -- 172.21.15.77:0/2240864876 shutdown_connections 2024-09-18T21:20:27.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.373+0000 7f7c89f0e640 1 -- 172.21.15.77:0/2240864876 wait complete. 2024-09-18T21:20:27.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.374+0000 7f7c89f0e640 1 Processor -- start 2024-09-18T21:20:27.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.374+0000 7f7c89f0e640 1 -- start start 2024-09-18T21:20:27.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.374+0000 7f7c89f0e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c84065c40 0x7f7c8410d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:20:27.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.374+0000 7f7c89f0e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c840ff680 0x7f7c8410d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:20:27.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.374+0000 7f7c89f0e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8410dc80 con 0x7f7c840ff680 2024-09-18T21:20:27.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.374+0000 7f7c89f0e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8410e450 con 0x7f7c84065c40 2024-09-18T21:20:27.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.374+0000 7f7c82ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c840ff680 0x7f7c8410d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:20:27.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.374+0000 7f7c82ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c840ff680 0x7f7c8410d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47912/0 (socket says 172.21.15.77:47912) 2024-09-18T21:20:27.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.374+0000 7f7c82ffd640 1 -- 172.21.15.77:0/2296647774 learned_addr learned my addr 172.21.15.77:0/2296647774 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:20:27.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.375+0000 7f7c837fe640 1 --2- 172.21.15.77:0/2296647774 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c84065c40 0x7f7c8410d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:20:27.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.375+0000 7f7c82ffd640 1 -- 172.21.15.77:0/2296647774 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c84065c40 msgr2=0x7f7c8410d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:20:27.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.375+0000 7f7c82ffd640 1 --2- 172.21.15.77:0/2296647774 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c84065c40 0x7f7c8410d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:27.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.375+0000 7f7c82ffd640 1 -- 172.21.15.77:0/2296647774 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c74005040 con 0x7f7c840ff680 2024-09-18T21:20:27.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.375+0000 7f7c837fe640 1 --2- 172.21.15.77:0/2296647774 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c84065c40 0x7f7c8410d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T21:20:27.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.375+0000 7f7c82ffd640 1 --2- 172.21.15.77:0/2296647774 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c840ff680 0x7f7c8410d630 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7c7800c810 tx=0x7f7c780043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:20:27.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.375+0000 7f7c6bfff640 1 -- 172.21.15.77:0/2296647774 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c7800a820 con 0x7f7c840ff680 2024-09-18T21:20:27.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.375+0000 7f7c6bfff640 1 -- 172.21.15.77:0/2296647774 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7c7800ae20 con 0x7f7c840ff680 2024-09-18T21:20:27.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.375+0000 7f7c89f0e640 1 -- 172.21.15.77:0/2296647774 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c8410e6e0 con 0x7f7c840ff680 2024-09-18T21:20:27.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.375+0000 7f7c6bfff640 1 -- 172.21.15.77:0/2296647774 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c780115c0 con 0x7f7c840ff680 2024-09-18T21:20:27.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.375+0000 7f7c89f0e640 1 -- 172.21.15.77:0/2296647774 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c8410ec80 con 0x7f7c840ff680 2024-09-18T21:20:27.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.376+0000 7f7c89f0e640 1 -- 172.21.15.77:0/2296647774 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c840fa890 con 0x7f7c840ff680 2024-09-18T21:20:27.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.377+0000 7f7c6bfff640 1 -- 172.21.15.77:0/2296647774 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7c78011720 con 0x7f7c840ff680 2024-09-18T21:20:27.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.377+0000 7f7c6bfff640 1 --2- 172.21.15.77:0/2296647774 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f7c6c06e0b0 0x7f7c6c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:20:27.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.377+0000 7f7c6bfff640 1 -- 172.21.15.77:0/2296647774 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f7c7808e130 con 0x7f7c840ff680 2024-09-18T21:20:27.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.377+0000 7f7c837fe640 1 --2- 172.21.15.77:0/2296647774 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f7c6c06e0b0 0x7f7c6c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:20:27.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.378+0000 7f7c837fe640 1 --2- 172.21.15.77:0/2296647774 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f7c6c06e0b0 0x7f7c6c070560 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7c74007ac0 tx=0x7f7c74035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:20:27.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.382+0000 7f7c6bfff640 1 -- 172.21.15.77:0/2296647774 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f7c78057430 con 0x7f7c840ff680 2024-09-18T21:20:27.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:27 smithi103 ceph-mon[80307]: pgmap v197: 65 pgs: 65 active+clean; 203 MiB data, 836 MiB used, 536 GiB / 536 GiB avail; 3.4 MiB/s rd, 5.0 KiB/s wr, 5 op/s 2024-09-18T21:20:27.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:27 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi103.opftmf"}]: dispatch 2024-09-18T21:20:27.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.589+0000 7f7c89f0e640 1 -- 172.21.15.77:0/2296647774 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c8410f050 con 0x7f7c6c06e0b0 2024-09-18T21:20:27.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.590+0000 7f7c6bfff640 1 -- 172.21.15.77:0/2296647774 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f7c8410f050 con 0x7f7c6c06e0b0 2024-09-18T21:20:27.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.592+0000 7f7c89f0e640 1 -- 172.21.15.77:0/2296647774 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f7c6c06e0b0 msgr2=0x7f7c6c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:20:27.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.592+0000 7f7c89f0e640 1 --2- 172.21.15.77:0/2296647774 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f7c6c06e0b0 0x7f7c6c070560 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7c74007ac0 tx=0x7f7c74035040 comp rx=0 tx=0).stop 2024-09-18T21:20:27.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.592+0000 7f7c89f0e640 1 -- 172.21.15.77:0/2296647774 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c840ff680 msgr2=0x7f7c8410d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:20:27.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.592+0000 7f7c89f0e640 1 --2- 172.21.15.77:0/2296647774 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c840ff680 0x7f7c8410d630 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7c7800c810 tx=0x7f7c780043c0 comp rx=0 tx=0).stop 2024-09-18T21:20:27.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.592+0000 7f7c89f0e640 1 -- 172.21.15.77:0/2296647774 shutdown_connections 2024-09-18T21:20:27.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.592+0000 7f7c89f0e640 1 --2- 172.21.15.77:0/2296647774 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c840ff680 0x7f7c8410d630 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:27.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.592+0000 7f7c89f0e640 1 --2- 172.21.15.77:0/2296647774 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f7c6c06e0b0 0x7f7c6c070560 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:27.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.592+0000 7f7c89f0e640 1 --2- 172.21.15.77:0/2296647774 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7c84065c40 0x7f7c8410d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:27.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.592+0000 7f7c89f0e640 1 -- 172.21.15.77:0/2296647774 >> 172.21.15.77:0/2296647774 conn(0x7f7c840f6c10 msgr2=0x7f7c840f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:20:27.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.593+0000 7f7c89f0e640 1 -- 172.21.15.77:0/2296647774 shutdown_connections 2024-09-18T21:20:27.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.593+0000 7f7c89f0e640 1 -- 172.21.15.77:0/2296647774 wait complete. 2024-09-18T21:20:27.602 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-09-18T21:20:27.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.675+0000 7fbd43412640 1 -- 172.21.15.77:0/728503584 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd3c0fc520 msgr2=0x7fbd3c0fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:20:27.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.675+0000 7fbd43412640 1 --2- 172.21.15.77:0/728503584 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd3c0fc520 0x7fbd3c0fc930 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fbd380048d0 tx=0x7fbd38009da0 comp rx=0 tx=0).stop 2024-09-18T21:20:27.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.675+0000 7fbd43412640 1 -- 172.21.15.77:0/728503584 shutdown_connections 2024-09-18T21:20:27.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.675+0000 7fbd43412640 1 --2- 172.21.15.77:0/728503584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd3c0fd7f0 0x7fbd3c0fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:27.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.675+0000 7fbd43412640 1 --2- 172.21.15.77:0/728503584 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd3c0fc520 0x7fbd3c0fc930 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:27.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.675+0000 7fbd43412640 1 -- 172.21.15.77:0/728503584 >> 172.21.15.77:0/728503584 conn(0x7fbd3c0f7ce0 msgr2=0x7fbd3c0fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:20:27.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.675+0000 7fbd43412640 1 -- 172.21.15.77:0/728503584 shutdown_connections 2024-09-18T21:20:27.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.675+0000 7fbd43412640 1 -- 172.21.15.77:0/728503584 wait complete. 2024-09-18T21:20:27.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.675+0000 7fbd43412640 1 Processor -- start 2024-09-18T21:20:27.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.676+0000 7fbd43412640 1 -- start start 2024-09-18T21:20:27.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.676+0000 7fbd43412640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd3c0fc520 0x7fbd3c06dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:20:27.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.676+0000 7fbd43412640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd3c0fd7f0 0x7fbd3c06e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:20:27.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.676+0000 7fbd43412640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3c06f7c0 con 0x7fbd3c0fc520 2024-09-18T21:20:27.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.676+0000 7fbd43412640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3c06e6c0 con 0x7fbd3c0fd7f0 2024-09-18T21:20:27.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.676+0000 7fbd411ae640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd3c0fc520 0x7fbd3c06dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:20:27.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.676+0000 7fbd411ae640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd3c0fc520 0x7fbd3c06dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47936/0 (socket says 172.21.15.77:47936) 2024-09-18T21:20:27.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.676+0000 7fbd411ae640 1 -- 172.21.15.77:0/631880860 learned_addr learned my addr 172.21.15.77:0/631880860 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:20:27.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.676+0000 7fbd409ad640 1 --2- 172.21.15.77:0/631880860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd3c0fd7f0 0x7fbd3c06e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:20:27.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.676+0000 7fbd411ae640 1 -- 172.21.15.77:0/631880860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd3c0fd7f0 msgr2=0x7fbd3c06e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:20:27.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.676+0000 7fbd411ae640 1 --2- 172.21.15.77:0/631880860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd3c0fd7f0 0x7fbd3c06e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:27.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.676+0000 7fbd411ae640 1 -- 172.21.15.77:0/631880860 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd38005040 con 0x7fbd3c0fc520 2024-09-18T21:20:27.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.677+0000 7fbd411ae640 1 --2- 172.21.15.77:0/631880860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd3c0fc520 0x7fbd3c06dc40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbd38003080 tx=0x7fbd38009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:20:27.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.677+0000 7fbd31ffb640 1 -- 172.21.15.77:0/631880860 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd38038070 con 0x7fbd3c0fc520 2024-09-18T21:20:27.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.677+0000 7fbd31ffb640 1 -- 172.21.15.77:0/631880860 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbd3802abd0 con 0x7fbd3c0fc520 2024-09-18T21:20:27.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.677+0000 7fbd43412640 1 -- 172.21.15.77:0/631880860 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd3c06e940 con 0x7fbd3c0fc520 2024-09-18T21:20:27.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.677+0000 7fbd31ffb640 1 -- 172.21.15.77:0/631880860 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd3803e670 con 0x7fbd3c0fc520 2024-09-18T21:20:27.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.677+0000 7fbd43412640 1 -- 172.21.15.77:0/631880860 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd3c11b5e0 con 0x7fbd3c0fc520 2024-09-18T21:20:27.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.678+0000 7fbd43412640 1 -- 172.21.15.77:0/631880860 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd3c0fb980 con 0x7fbd3c0fc520 2024-09-18T21:20:27.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.679+0000 7fbd31ffb640 1 -- 172.21.15.77:0/631880860 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fbd38030020 con 0x7fbd3c0fc520 2024-09-18T21:20:27.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.680+0000 7fbd31ffb640 1 --2- 172.21.15.77:0/631880860 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fbd2806e0b0 0x7fbd28070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:20:27.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.680+0000 7fbd31ffb640 1 -- 172.21.15.77:0/631880860 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fbd380adff0 con 0x7fbd3c0fc520 2024-09-18T21:20:27.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.680+0000 7fbd409ad640 1 --2- 172.21.15.77:0/631880860 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fbd2806e0b0 0x7fbd28070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:20:27.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.681+0000 7fbd409ad640 1 --2- 172.21.15.77:0/631880860 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fbd2806e0b0 0x7fbd28070560 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c004c40 tx=0x7fbd2c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:20:27.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.688+0000 7fbd31ffb640 1 -- 172.21.15.77:0/631880860 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fbd38077270 con 0x7fbd3c0fc520 2024-09-18T21:20:27.879 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.878+0000 7fbd43412640 1 -- 172.21.15.77:0/631880860 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd3c101c30 con 0x7fbd2806e0b0 2024-09-18T21:20:27.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.879+0000 7fbd31ffb640 1 -- 172.21.15.77:0/631880860 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fbd3c101c30 con 0x7fbd2806e0b0 2024-09-18T21:20:27.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.881+0000 7fbd43412640 1 -- 172.21.15.77:0/631880860 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fbd2806e0b0 msgr2=0x7fbd28070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:20:27.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.881+0000 7fbd43412640 1 --2- 172.21.15.77:0/631880860 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fbd2806e0b0 0x7fbd28070560 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c004c40 tx=0x7fbd2c009040 comp rx=0 tx=0).stop 2024-09-18T21:20:27.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.881+0000 7fbd43412640 1 -- 172.21.15.77:0/631880860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd3c0fc520 msgr2=0x7fbd3c06dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:20:27.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.881+0000 7fbd43412640 1 --2- 172.21.15.77:0/631880860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd3c0fc520 0x7fbd3c06dc40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbd38003080 tx=0x7fbd38009da0 comp rx=0 tx=0).stop 2024-09-18T21:20:27.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.882+0000 7fbd43412640 1 -- 172.21.15.77:0/631880860 shutdown_connections 2024-09-18T21:20:27.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.882+0000 7fbd43412640 1 --2- 172.21.15.77:0/631880860 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fbd2806e0b0 0x7fbd28070560 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:27.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.882+0000 7fbd43412640 1 --2- 172.21.15.77:0/631880860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbd3c0fd7f0 0x7fbd3c06e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:27.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.882+0000 7fbd43412640 1 --2- 172.21.15.77:0/631880860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd3c0fc520 0x7fbd3c06dc40 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:27.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.882+0000 7fbd43412640 1 -- 172.21.15.77:0/631880860 >> 172.21.15.77:0/631880860 conn(0x7fbd3c0f7ce0 msgr2=0x7fbd3c0f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:20:27.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.882+0000 7fbd43412640 1 -- 172.21.15.77:0/631880860 shutdown_connections 2024-09-18T21:20:27.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.882+0000 7fbd43412640 1 -- 172.21.15.77:0/631880860 wait complete. 2024-09-18T21:20:27.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.962+0000 7f9f01c4b640 1 -- 172.21.15.77:0/2433853133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9efc0fc700 msgr2=0x7f9efc0fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:20:27.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.962+0000 7f9f01c4b640 1 --2- 172.21.15.77:0/2433853133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9efc0fc700 0x7f9efc0fcb70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9ef00048d0 tx=0x7f9ef0009da0 comp rx=0 tx=0).stop 2024-09-18T21:20:27.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.962+0000 7f9f01c4b640 1 -- 172.21.15.77:0/2433853133 shutdown_connections 2024-09-18T21:20:27.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.962+0000 7f9f01c4b640 1 --2- 172.21.15.77:0/2433853133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9efc0fc700 0x7f9efc0fcb70 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:27.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.962+0000 7f9f01c4b640 1 --2- 172.21.15.77:0/2433853133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9efc0fb430 0x7f9efc0fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:27.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.962+0000 7f9f01c4b640 1 -- 172.21.15.77:0/2433853133 >> 172.21.15.77:0/2433853133 conn(0x7f9efc0f6c10 msgr2=0x7f9efc0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:20:27.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.962+0000 7f9f01c4b640 1 -- 172.21.15.77:0/2433853133 shutdown_connections 2024-09-18T21:20:27.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.962+0000 7f9f01c4b640 1 -- 172.21.15.77:0/2433853133 wait complete. 2024-09-18T21:20:27.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.963+0000 7f9f01c4b640 1 Processor -- start 2024-09-18T21:20:27.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.963+0000 7f9f01c4b640 1 -- start start 2024-09-18T21:20:27.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.963+0000 7f9f01c4b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9efc0fb430 0x7f9efc10fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:20:27.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.963+0000 7f9f01c4b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9efc0fc700 0x7f9efc1122b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:20:27.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.963+0000 7f9f01c4b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9efc065cc0 con 0x7f9efc0fb430 2024-09-18T21:20:27.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.963+0000 7f9f01c4b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9efc065e30 con 0x7f9efc0fc700 2024-09-18T21:20:27.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.963+0000 7f9efb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9efc0fb430 0x7f9efc10fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:20:27.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.963+0000 7f9efb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9efc0fb430 0x7f9efc10fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47954/0 (socket says 172.21.15.77:47954) 2024-09-18T21:20:27.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.964+0000 7f9efb7fe640 1 -- 172.21.15.77:0/4174395352 learned_addr learned my addr 172.21.15.77:0/4174395352 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:20:27.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.964+0000 7f9efaffd640 1 --2- 172.21.15.77:0/4174395352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9efc0fc700 0x7f9efc1122b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:20:27.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.964+0000 7f9efb7fe640 1 -- 172.21.15.77:0/4174395352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9efc0fc700 msgr2=0x7f9efc1122b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:20:27.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.964+0000 7f9efb7fe640 1 --2- 172.21.15.77:0/4174395352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9efc0fc700 0x7f9efc1122b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:27.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.964+0000 7f9efb7fe640 1 -- 172.21.15.77:0/4174395352 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef0005040 con 0x7f9efc0fb430 2024-09-18T21:20:27.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.964+0000 7f9efb7fe640 1 --2- 172.21.15.77:0/4174395352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9efc0fb430 0x7f9efc10fd60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9eec00c790 tx=0x7f9eec0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:20:27.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.964+0000 7f9ee3fff640 1 -- 172.21.15.77:0/4174395352 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9eec00a820 con 0x7f9efc0fb430 2024-09-18T21:20:27.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.964+0000 7f9ee3fff640 1 -- 172.21.15.77:0/4174395352 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9eec00ae20 con 0x7f9efc0fb430 2024-09-18T21:20:27.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.965+0000 7f9f01c4b640 1 -- 172.21.15.77:0/4174395352 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9efc1128b0 con 0x7f9efc0fb430 2024-09-18T21:20:27.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.965+0000 7f9f01c4b640 1 -- 172.21.15.77:0/4174395352 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9efc112e20 con 0x7f9efc0fb430 2024-09-18T21:20:27.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.965+0000 7f9ee3fff640 1 -- 172.21.15.77:0/4174395352 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9eec00a980 con 0x7f9efc0fb430 2024-09-18T21:20:27.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.967+0000 7f9f01c4b640 1 -- 172.21.15.77:0/4174395352 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9efc0fa890 con 0x7f9efc0fb430 2024-09-18T21:20:27.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.967+0000 7f9ee3fff640 1 -- 172.21.15.77:0/4174395352 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9eec01b430 con 0x7f9efc0fb430 2024-09-18T21:20:27.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.968+0000 7f9ee3fff640 1 --2- 172.21.15.77:0/4174395352 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f9ee406e120 0x7f9ee40705d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:20:27.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.968+0000 7f9ee3fff640 1 -- 172.21.15.77:0/4174395352 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f9eec08e050 con 0x7f9efc0fb430 2024-09-18T21:20:27.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.968+0000 7f9efaffd640 1 --2- 172.21.15.77:0/4174395352 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f9ee406e120 0x7f9ee40705d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:20:27.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.969+0000 7f9efaffd640 1 --2- 172.21.15.77:0/4174395352 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f9ee406e120 0x7f9ee40705d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0000c00 tx=0x7f9ef0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:20:27.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:27.976+0000 7f9ee3fff640 1 -- 172.21.15.77:0/4174395352 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f9eec0574a0 con 0x7f9efc0fb430 2024-09-18T21:20:28.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.159+0000 7f9f01c4b640 1 -- 172.21.15.77:0/4174395352 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9efc100b10 con 0x7f9ee406e120 2024-09-18T21:20:28.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.168+0000 7f9ee3fff640 1 -- 172.21.15.77:0/4174395352 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f9efc100b10 con 0x7f9ee406e120 2024-09-18T21:20:28.169 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T21:20:28.169 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager.smithi077 smithi077 *:9093,9094 running (7m) 33s ago 15m 24.1M - 0.25.0 c8568f914cd2 b201d325a55b 2024-09-18T21:20:28.169 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi077 smithi077 running (4m) 33s ago 15m 6891k - 19.1.1-17-g06b1b1de f79f744f586d 5872fa24b792 2024-09-18T21:20:28.169 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi103 smithi103 running (4m) 11s ago 14m 6887k - 19.1.1-17-g06b1b1de f79f744f586d cd1604469f34 2024-09-18T21:20:28.169 INFO:teuthology.orchestra.run.smithi077.stdout:grafana.smithi077 smithi077 *:3000 running (7m) 33s ago 14m 85.1M - 9.4.7 954c08fa6188 d06ef3ab9e66 2024-09-18T21:20:28.169 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.cqfhlw smithi077 running (37s) 33s ago 10m 13.0M - 19.1.1-17-g06b1b1de f79f744f586d c74ffc2ebb80 2024-09-18T21:20:28.169 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.vruydi smithi077 running (60s) 33s ago 10m 13.2M - 19.1.1-17-g06b1b1de f79f744f586d ce474ff0a948 2024-09-18T21:20:28.169 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi103.opftmf smithi103 running (9m) 11s ago 9m 85.8M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 111f884c5a34 2024-09-18T21:20:28.170 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi103.zhdmdg smithi103 running (16s) 11s ago 10m 12.2M - 19.1.1-17-g06b1b1de f79f744f586d 84d9d5a98395 2024-09-18T21:20:28.170 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi077.utkpjg smithi077 *:8443,9283,8765 running (6m) 33s ago 16m 506M - 19.1.1-17-g06b1b1de f79f744f586d 99d4b0fd70f6 2024-09-18T21:20:28.170 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi103.zjztqc smithi103 *:8443,9283,8765 running (5m) 11s ago 14m 441M - 19.1.1-17-g06b1b1de f79f744f586d 54589547c4d7 2024-09-18T21:20:28.170 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi077 smithi077 running (5m) 33s ago 16m 51.2M 2048M 19.1.1-17-g06b1b1de f79f744f586d 2d0fbbea1264 2024-09-18T21:20:28.170 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi103 smithi103 running (5m) 11s ago 14m 38.9M 2048M 19.1.1-17-g06b1b1de f79f744f586d dc79edbd9602 2024-09-18T21:20:28.170 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi077 smithi077 *:9100 running (7m) 33s ago 15m 14.9M - 1.5.0 0da6a335fe13 99144245c1af 2024-09-18T21:20:28.170 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi103 smithi103 *:9100 running (6m) 11s ago 14m 16.3M - 1.5.0 0da6a335fe13 e5b51144d997 2024-09-18T21:20:28.170 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (4m) 33s ago 13m 98.0M 1557M 19.1.1-17-g06b1b1de f79f744f586d 8855b4b16e00 2024-09-18T21:20:28.170 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi077 running (3m) 33s ago 13m 111M 1557M 19.1.1-17-g06b1b1de f79f744f586d 2d8bc9cac96c 2024-09-18T21:20:28.170 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi077 running (3m) 33s ago 12m 100M 1557M 19.1.1-17-g06b1b1de f79f744f586d 93876f1d398d 2024-09-18T21:20:28.170 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi103 running (2m) 11s ago 12m 120M 2581M 19.1.1-17-g06b1b1de f79f744f586d 2556b257bf1c 2024-09-18T21:20:28.170 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi103 running (115s) 11s ago 11m 98.8M 2581M 19.1.1-17-g06b1b1de f79f744f586d 2cde7eaf88d8 2024-09-18T21:20:28.170 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi103 running (84s) 11s ago 11m 100M 2581M 19.1.1-17-g06b1b1de f79f744f586d e6912ab63ecc 2024-09-18T21:20:28.170 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus.smithi077 smithi077 *:9095 running (5m) 33s ago 14m 65.5M - 2.43.0 a07b618ecd1d 41f3729e3400 2024-09-18T21:20:28.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.171+0000 7f9f01c4b640 1 -- 172.21.15.77:0/4174395352 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f9ee406e120 msgr2=0x7f9ee40705d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:20:28.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.171+0000 7f9f01c4b640 1 --2- 172.21.15.77:0/4174395352 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f9ee406e120 0x7f9ee40705d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0000c00 tx=0x7f9ef0035040 comp rx=0 tx=0).stop 2024-09-18T21:20:28.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.171+0000 7f9f01c4b640 1 -- 172.21.15.77:0/4174395352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9efc0fb430 msgr2=0x7f9efc10fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:20:28.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.171+0000 7f9f01c4b640 1 --2- 172.21.15.77:0/4174395352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9efc0fb430 0x7f9efc10fd60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9eec00c790 tx=0x7f9eec0043c0 comp rx=0 tx=0).stop 2024-09-18T21:20:28.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.171+0000 7f9f01c4b640 1 -- 172.21.15.77:0/4174395352 shutdown_connections 2024-09-18T21:20:28.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.171+0000 7f9f01c4b640 1 --2- 172.21.15.77:0/4174395352 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f9ee406e120 0x7f9ee40705d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:28.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.171+0000 7f9f01c4b640 1 --2- 172.21.15.77:0/4174395352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9efc0fc700 0x7f9efc1122b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:28.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.171+0000 7f9f01c4b640 1 --2- 172.21.15.77:0/4174395352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9efc0fb430 0x7f9efc10fd60 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:28.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.171+0000 7f9f01c4b640 1 -- 172.21.15.77:0/4174395352 >> 172.21.15.77:0/4174395352 conn(0x7f9efc0f6c10 msgr2=0x7f9efc0f83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:20:28.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.172+0000 7f9f01c4b640 1 -- 172.21.15.77:0/4174395352 shutdown_connections 2024-09-18T21:20:28.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.172+0000 7f9f01c4b640 1 -- 172.21.15.77:0/4174395352 wait complete. 2024-09-18T21:20:28.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.263+0000 7f4da7438640 1 -- 172.21.15.77:0/2519981052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4da0065b80 msgr2=0x7f4da00ff200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:20:28.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.263+0000 7f4da7438640 1 --2- 172.21.15.77:0/2519981052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4da0065b80 0x7f4da00ff200 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c0048d0 tx=0x7f4d9c009da0 comp rx=0 tx=0).stop 2024-09-18T21:20:28.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.263+0000 7f4da7438640 1 -- 172.21.15.77:0/2519981052 shutdown_connections 2024-09-18T21:20:28.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.263+0000 7f4da7438640 1 --2- 172.21.15.77:0/2519981052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4da00ff740 0x7f4da0101b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:28.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.263+0000 7f4da7438640 1 --2- 172.21.15.77:0/2519981052 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4da0065b80 0x7f4da00ff200 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:28.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.263+0000 7f4da7438640 1 -- 172.21.15.77:0/2519981052 >> 172.21.15.77:0/2519981052 conn(0x7f4da00f6c10 msgr2=0x7f4da00f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:20:28.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.263+0000 7f4da7438640 1 -- 172.21.15.77:0/2519981052 shutdown_connections 2024-09-18T21:20:28.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.263+0000 7f4da7438640 1 -- 172.21.15.77:0/2519981052 wait complete. 2024-09-18T21:20:28.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.264+0000 7f4da7438640 1 Processor -- start 2024-09-18T21:20:28.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.264+0000 7f4da7438640 1 -- start start 2024-09-18T21:20:28.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.264+0000 7f4da7438640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4da0065b80 0x7f4da010f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:20:28.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.264+0000 7f4da7438640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4da00ff740 0x7f4da010f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:20:28.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.264+0000 7f4da7438640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da01106e0 con 0x7f4da00ff740 2024-09-18T21:20:28.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.264+0000 7f4da7438640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da0110850 con 0x7f4da0065b80 2024-09-18T21:20:28.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.264+0000 7f4da49d3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4da00ff740 0x7f4da010f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:20:28.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.264+0000 7f4da49d3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4da00ff740 0x7f4da010f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47972/0 (socket says 172.21.15.77:47972) 2024-09-18T21:20:28.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.264+0000 7f4da49d3640 1 -- 172.21.15.77:0/2503505439 learned_addr learned my addr 172.21.15.77:0/2503505439 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:20:28.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.265+0000 7f4da51d4640 1 --2- 172.21.15.77:0/2503505439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4da0065b80 0x7f4da010f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:20:28.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.265+0000 7f4da49d3640 1 -- 172.21.15.77:0/2503505439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4da0065b80 msgr2=0x7f4da010f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:20:28.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.265+0000 7f4da49d3640 1 --2- 172.21.15.77:0/2503505439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4da0065b80 0x7f4da010f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:28.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.265+0000 7f4da49d3640 1 -- 172.21.15.77:0/2503505439 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d9c005040 con 0x7f4da00ff740 2024-09-18T21:20:28.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.265+0000 7f4da51d4640 1 --2- 172.21.15.77:0/2503505439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4da0065b80 0x7f4da010f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T21:20:28.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.265+0000 7f4da49d3640 1 --2- 172.21.15.77:0/2503505439 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4da00ff740 0x7f4da010f870 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4d9000b790 tx=0x7f4d900091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:20:28.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.265+0000 7f4d95ffb640 1 -- 172.21.15.77:0/2503505439 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d9000c700 con 0x7f4da00ff740 2024-09-18T21:20:28.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.265+0000 7f4da7438640 1 -- 172.21.15.77:0/2503505439 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4da0110b30 con 0x7f4da00ff740 2024-09-18T21:20:28.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.265+0000 7f4d95ffb640 1 -- 172.21.15.77:0/2503505439 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4d9000cd00 con 0x7f4da00ff740 2024-09-18T21:20:28.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.265+0000 7f4d95ffb640 1 -- 172.21.15.77:0/2503505439 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d90015e70 con 0x7f4da00ff740 2024-09-18T21:20:28.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.265+0000 7f4da7438640 1 -- 172.21.15.77:0/2503505439 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4da0111050 con 0x7f4da00ff740 2024-09-18T21:20:28.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.267+0000 7f4da7438640 1 -- 172.21.15.77:0/2503505439 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4da00fa890 con 0x7f4da00ff740 2024-09-18T21:20:28.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.267+0000 7f4d95ffb640 1 -- 172.21.15.77:0/2503505439 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f4d90012070 con 0x7f4da00ff740 2024-09-18T21:20:28.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.267+0000 7f4d95ffb640 1 --2- 172.21.15.77:0/2503505439 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f4d8c06e0b0 0x7f4d8c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:20:28.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.267+0000 7f4d95ffb640 1 -- 172.21.15.77:0/2503505439 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f4d9008d780 con 0x7f4da00ff740 2024-09-18T21:20:28.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.268+0000 7f4da51d4640 1 --2- 172.21.15.77:0/2503505439 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f4d8c06e0b0 0x7f4d8c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:20:28.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.268+0000 7f4da51d4640 1 --2- 172.21.15.77:0/2503505439 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f4d8c06e0b0 0x7f4d8c070560 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c007ac0 tx=0x7f4d9c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:20:28.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.272+0000 7f4d95ffb640 1 -- 172.21.15.77:0/2503505439 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f4d90056a80 con 0x7f4da00ff740 2024-09-18T21:20:28.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.514+0000 7f4da7438640 1 -- 172.21.15.77:0/2503505439 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4da0104fb0 con 0x7f4da00ff740 2024-09-18T21:20:28.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.515+0000 7f4d95ffb640 1 -- 172.21.15.77:0/2503505439 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f4d9005a140 con 0x7f4da00ff740 2024-09-18T21:20:28.516 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-18T21:20:28.516 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": { 2024-09-18T21:20:28.517 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 2 2024-09-18T21:20:28.517 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:20:28.517 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": { 2024-09-18T21:20:28.517 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 2 2024-09-18T21:20:28.517 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:20:28.517 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": { 2024-09-18T21:20:28.517 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 6 2024-09-18T21:20:28.517 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:20:28.517 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-09-18T21:20:28.517 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 3 2024-09-18T21:20:28.518 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:20:28.518 INFO:teuthology.orchestra.run.smithi077.stdout: "overall": { 2024-09-18T21:20:28.518 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 13 2024-09-18T21:20:28.518 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-18T21:20:28.518 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-18T21:20:28.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.517+0000 7f4da7438640 1 -- 172.21.15.77:0/2503505439 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f4d8c06e0b0 msgr2=0x7f4d8c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:20:28.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.517+0000 7f4da7438640 1 --2- 172.21.15.77:0/2503505439 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f4d8c06e0b0 0x7f4d8c070560 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c007ac0 tx=0x7f4d9c035040 comp rx=0 tx=0).stop 2024-09-18T21:20:28.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.517+0000 7f4da7438640 1 -- 172.21.15.77:0/2503505439 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4da00ff740 msgr2=0x7f4da010f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:20:28.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.517+0000 7f4da7438640 1 --2- 172.21.15.77:0/2503505439 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4da00ff740 0x7f4da010f870 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4d9000b790 tx=0x7f4d900091d0 comp rx=0 tx=0).stop 2024-09-18T21:20:28.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.518+0000 7f4da7438640 1 -- 172.21.15.77:0/2503505439 shutdown_connections 2024-09-18T21:20:28.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.518+0000 7f4da7438640 1 --2- 172.21.15.77:0/2503505439 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4da00ff740 0x7f4da010f870 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:28.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.518+0000 7f4da7438640 1 --2- 172.21.15.77:0/2503505439 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f4d8c06e0b0 0x7f4d8c070560 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:28.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.518+0000 7f4da7438640 1 --2- 172.21.15.77:0/2503505439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4da0065b80 0x7f4da010f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:28.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.518+0000 7f4da7438640 1 -- 172.21.15.77:0/2503505439 >> 172.21.15.77:0/2503505439 conn(0x7f4da00f6c10 msgr2=0x7f4da00fb440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:20:28.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.518+0000 7f4da7438640 1 -- 172.21.15.77:0/2503505439 shutdown_connections 2024-09-18T21:20:28.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.518+0000 7f4da7438640 1 -- 172.21.15.77:0/2503505439 wait complete. 2024-09-18T21:20:28.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.596+0000 7f66182d6640 1 -- 172.21.15.77:0/1018565033 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6610065ba0 msgr2=0x7f66100ff1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:20:28.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.596+0000 7f66182d6640 1 --2- 172.21.15.77:0/1018565033 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6610065ba0 0x7f66100ff1e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f660c0048d0 tx=0x7f660c009da0 comp rx=0 tx=0).stop 2024-09-18T21:20:28.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.596+0000 7f66182d6640 1 -- 172.21.15.77:0/1018565033 shutdown_connections 2024-09-18T21:20:28.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.596+0000 7f66182d6640 1 --2- 172.21.15.77:0/1018565033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66100ff720 0x7f6610101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:28.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.596+0000 7f66182d6640 1 --2- 172.21.15.77:0/1018565033 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6610065ba0 0x7f66100ff1e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:28.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.596+0000 7f66182d6640 1 -- 172.21.15.77:0/1018565033 >> 172.21.15.77:0/1018565033 conn(0x7f66100f6c10 msgr2=0x7f66100f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:20:28.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.596+0000 7f66182d6640 1 -- 172.21.15.77:0/1018565033 shutdown_connections 2024-09-18T21:20:28.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.596+0000 7f66182d6640 1 -- 172.21.15.77:0/1018565033 wait complete. 2024-09-18T21:20:28.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.597+0000 7f66182d6640 1 Processor -- start 2024-09-18T21:20:28.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.597+0000 7f66182d6640 1 -- start start 2024-09-18T21:20:28.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.597+0000 7f66182d6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6610065ba0 0x7f661010d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:20:28.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.597+0000 7f66182d6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66100ff720 0x7f661010d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:20:28.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.597+0000 7f66182d6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f661010e500 con 0x7f66100ff720 2024-09-18T21:20:28.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.597+0000 7f66182d6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f661010e670 con 0x7f6610065ba0 2024-09-18T21:20:28.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.598+0000 7f6615871640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66100ff720 0x7f661010d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:20:28.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.598+0000 7f6615871640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66100ff720 0x7f661010d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47984/0 (socket says 172.21.15.77:47984) 2024-09-18T21:20:28.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.598+0000 7f6615871640 1 -- 172.21.15.77:0/817131336 learned_addr learned my addr 172.21.15.77:0/817131336 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:20:28.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.598+0000 7f6616072640 1 --2- 172.21.15.77:0/817131336 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6610065ba0 0x7f661010d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:20:28.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.598+0000 7f6615871640 1 -- 172.21.15.77:0/817131336 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6610065ba0 msgr2=0x7f661010d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:20:28.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.598+0000 7f6615871640 1 --2- 172.21.15.77:0/817131336 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6610065ba0 0x7f661010d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:28.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.598+0000 7f6615871640 1 -- 172.21.15.77:0/817131336 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f660c005040 con 0x7f66100ff720 2024-09-18T21:20:28.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.598+0000 7f6615871640 1 --2- 172.21.15.77:0/817131336 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66100ff720 0x7f661010d6e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f660000b580 tx=0x7f66000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:20:28.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.598+0000 7f6606ffd640 1 -- 172.21.15.77:0/817131336 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f660000f6f0 con 0x7f66100ff720 2024-09-18T21:20:28.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.598+0000 7f66182d6640 1 -- 172.21.15.77:0/817131336 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f661010e950 con 0x7f66100ff720 2024-09-18T21:20:28.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.598+0000 7f6606ffd640 1 -- 172.21.15.77:0/817131336 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f660000fcf0 con 0x7f66100ff720 2024-09-18T21:20:28.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.598+0000 7f6606ffd640 1 -- 172.21.15.77:0/817131336 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66000103a0 con 0x7f66100ff720 2024-09-18T21:20:28.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.599+0000 7f66182d6640 1 -- 172.21.15.77:0/817131336 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f661010ee70 con 0x7f66100ff720 2024-09-18T21:20:28.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.600+0000 7f66182d6640 1 -- 172.21.15.77:0/817131336 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66100fa890 con 0x7f66100ff720 2024-09-18T21:20:28.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.600+0000 7f6606ffd640 1 -- 172.21.15.77:0/817131336 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f6600010500 con 0x7f66100ff720 2024-09-18T21:20:28.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.601+0000 7f6606ffd640 1 --2- 172.21.15.77:0/817131336 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f65fc06e0b0 0x7f65fc070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:20:28.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.601+0000 7f6606ffd640 1 -- 172.21.15.77:0/817131336 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f660008d9d0 con 0x7f66100ff720 2024-09-18T21:20:28.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.601+0000 7f6616072640 1 --2- 172.21.15.77:0/817131336 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f65fc06e0b0 0x7f65fc070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:20:28.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.601+0000 7f6616072640 1 --2- 172.21.15.77:0/817131336 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f65fc06e0b0 0x7f65fc070560 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f660c000c00 tx=0x7f660c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:20:28.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.608+0000 7f6606ffd640 1 -- 172.21.15.77:0/817131336 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f6600056de0 con 0x7f66100ff720 2024-09-18T21:20:28.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.817+0000 7f66182d6640 1 -- 172.21.15.77:0/817131336 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f661004b720 con 0x7f66100ff720 2024-09-18T21:20:28.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.818+0000 7f6606ffd640 1 -- 172.21.15.77:0/817131336 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 32 v32) v1 ==== 76+0+1789 (secure 0 0 0) 0x7f660000fe60 con 0x7f66100ff720 2024-09-18T21:20:28.819 INFO:teuthology.orchestra.run.smithi077.stdout:e32 2024-09-18T21:20:28.819 INFO:teuthology.orchestra.run.smithi077.stdout:btime 2024-09-18T21:20:23:257856+0000 2024-09-18T21:20:28.819 INFO:teuthology.orchestra.run.smithi077.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T21:20:28.820 INFO:teuthology.orchestra.run.smithi077.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T21:20:28.820 INFO:teuthology.orchestra.run.smithi077.stdout:legacy client fscid: 1 2024-09-18T21:20:28.820 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:20:28.820 INFO:teuthology.orchestra.run.smithi077.stdout:Filesystem 'cephfs' (1) 2024-09-18T21:20:28.820 INFO:teuthology.orchestra.run.smithi077.stdout:fs_name cephfs 2024-09-18T21:20:28.820 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 32 2024-09-18T21:20:28.820 INFO:teuthology.orchestra.run.smithi077.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T21:20:28.820 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-09-18T21:10:17.230179+0000 2024-09-18T21:20:28.820 INFO:teuthology.orchestra.run.smithi077.stdout:modified 2024-09-18T21:20:23.257845+0000 2024-09-18T21:20:28.820 INFO:teuthology.orchestra.run.smithi077.stdout:tableserver 0 2024-09-18T21:20:28.820 INFO:teuthology.orchestra.run.smithi077.stdout:root 0 2024-09-18T21:20:28.820 INFO:teuthology.orchestra.run.smithi077.stdout:session_timeout 60 2024-09-18T21:20:28.821 INFO:teuthology.orchestra.run.smithi077.stdout:session_autoclose 300 2024-09-18T21:20:28.821 INFO:teuthology.orchestra.run.smithi077.stdout:max_file_size 1099511627776 2024-09-18T21:20:28.821 INFO:teuthology.orchestra.run.smithi077.stdout:max_xattr_size 65536 2024-09-18T21:20:28.821 INFO:teuthology.orchestra.run.smithi077.stdout:required_client_features {} 2024-09-18T21:20:28.821 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure 0 2024-09-18T21:20:28.821 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure_osd_epoch 80 2024-09-18T21:20:28.821 INFO:teuthology.orchestra.run.smithi077.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T21:20:28.821 INFO:teuthology.orchestra.run.smithi077.stdout:max_mds 1 2024-09-18T21:20:28.821 INFO:teuthology.orchestra.run.smithi077.stdout:in 0 2024-09-18T21:20:28.821 INFO:teuthology.orchestra.run.smithi077.stdout:up {0=34400} 2024-09-18T21:20:28.821 INFO:teuthology.orchestra.run.smithi077.stdout:failed 2024-09-18T21:20:28.821 INFO:teuthology.orchestra.run.smithi077.stdout:damaged 2024-09-18T21:20:28.822 INFO:teuthology.orchestra.run.smithi077.stdout:stopped 2024-09-18T21:20:28.822 INFO:teuthology.orchestra.run.smithi077.stdout:data_pools [3] 2024-09-18T21:20:28.822 INFO:teuthology.orchestra.run.smithi077.stdout:metadata_pool 2 2024-09-18T21:20:28.822 INFO:teuthology.orchestra.run.smithi077.stdout:inline_data disabled 2024-09-18T21:20:28.822 INFO:teuthology.orchestra.run.smithi077.stdout:balancer 2024-09-18T21:20:28.822 INFO:teuthology.orchestra.run.smithi077.stdout:bal_rank_mask -1 2024-09-18T21:20:28.822 INFO:teuthology.orchestra.run.smithi077.stdout:standby_count_wanted 1 2024-09-18T21:20:28.822 INFO:teuthology.orchestra.run.smithi077.stdout:qdb_cluster leader: 0 members: 2024-09-18T21:20:28.822 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.vruydi{0:34400} state up:replay seq 1 join_fscid=1 addr [v2:172.21.15.77:6826/1087320436,v1:172.21.15.77:6827/1087320436] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T21:20:28.822 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:20:28.822 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:20:28.822 INFO:teuthology.orchestra.run.smithi077.stdout:Standby daemons: 2024-09-18T21:20:28.823 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:20:28.823 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.cqfhlw{-1:34404} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.77:6828/1489733233,v1:172.21.15.77:6829/1489733233] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T21:20:28.823 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi103.zhdmdg{-1:44287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.103:6824/3296796313,v1:172.21.15.103:6825/3296796313] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T21:20:28.823 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 32 2024-09-18T21:20:28.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.820+0000 7f66182d6640 1 -- 172.21.15.77:0/817131336 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f65fc06e0b0 msgr2=0x7f65fc070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:20:28.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.820+0000 7f66182d6640 1 --2- 172.21.15.77:0/817131336 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f65fc06e0b0 0x7f65fc070560 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f660c000c00 tx=0x7f660c035040 comp rx=0 tx=0).stop 2024-09-18T21:20:28.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.820+0000 7f66182d6640 1 -- 172.21.15.77:0/817131336 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66100ff720 msgr2=0x7f661010d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:20:28.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.820+0000 7f66182d6640 1 --2- 172.21.15.77:0/817131336 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66100ff720 0x7f661010d6e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f660000b580 tx=0x7f66000091a0 comp rx=0 tx=0).stop 2024-09-18T21:20:28.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.820+0000 7f66182d6640 1 -- 172.21.15.77:0/817131336 shutdown_connections 2024-09-18T21:20:28.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.820+0000 7f66182d6640 1 --2- 172.21.15.77:0/817131336 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66100ff720 0x7f661010d6e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:28.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.820+0000 7f66182d6640 1 --2- 172.21.15.77:0/817131336 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f65fc06e0b0 0x7f65fc070560 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:28.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.820+0000 7f66182d6640 1 --2- 172.21.15.77:0/817131336 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6610065ba0 0x7f661010d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:28.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.820+0000 7f66182d6640 1 -- 172.21.15.77:0/817131336 >> 172.21.15.77:0/817131336 conn(0x7f66100f6c10 msgr2=0x7f66100f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:20:28.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.820+0000 7f66182d6640 1 -- 172.21.15.77:0/817131336 shutdown_connections 2024-09-18T21:20:28.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.820+0000 7f66182d6640 1 -- 172.21.15.77:0/817131336 wait complete. 2024-09-18T21:20:28.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.901+0000 7f580bb92640 1 -- 172.21.15.77:0/3090806415 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5804101ae0 msgr2=0x7f5804103ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:20:28.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.901+0000 7f580bb92640 1 --2- 172.21.15.77:0/3090806415 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5804101ae0 0x7f5804103ec0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f57f40048d0 tx=0x7f57f4009da0 comp rx=0 tx=0).stop 2024-09-18T21:20:28.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.901+0000 7f580bb92640 1 -- 172.21.15.77:0/3090806415 shutdown_connections 2024-09-18T21:20:28.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.901+0000 7f580bb92640 1 --2- 172.21.15.77:0/3090806415 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5804101ae0 0x7f5804103ec0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:28.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.901+0000 7f580bb92640 1 --2- 172.21.15.77:0/3090806415 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5804065be0 0x7f58041015a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:28.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.901+0000 7f580bb92640 1 -- 172.21.15.77:0/3090806415 >> 172.21.15.77:0/3090806415 conn(0x7f58040f6c10 msgr2=0x7f58040f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:20:28.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.901+0000 7f580bb92640 1 -- 172.21.15.77:0/3090806415 shutdown_connections 2024-09-18T21:20:28.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.901+0000 7f580bb92640 1 -- 172.21.15.77:0/3090806415 wait complete. 2024-09-18T21:20:28.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.902+0000 7f580bb92640 1 Processor -- start 2024-09-18T21:20:28.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.902+0000 7f580bb92640 1 -- start start 2024-09-18T21:20:28.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.902+0000 7f580bb92640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5804065be0 0x7f580410f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:20:28.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.902+0000 7f580bb92640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5804101ae0 0x7f580410f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:20:28.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.902+0000 7f580bb92640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f580410fe70 con 0x7f5804065be0 2024-09-18T21:20:28.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.902+0000 7f580bb92640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5804110640 con 0x7f5804101ae0 2024-09-18T21:20:28.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.902+0000 7f580992e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5804065be0 0x7f580410f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:20:28.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.902+0000 7f580992e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5804065be0 0x7f580410f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48002/0 (socket says 172.21.15.77:48002) 2024-09-18T21:20:28.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.902+0000 7f580992e640 1 -- 172.21.15.77:0/1009480686 learned_addr learned my addr 172.21.15.77:0/1009480686 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:20:28.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.902+0000 7f580912d640 1 --2- 172.21.15.77:0/1009480686 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5804101ae0 0x7f580410f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:20:28.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.902+0000 7f580992e640 1 -- 172.21.15.77:0/1009480686 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5804101ae0 msgr2=0x7f580410f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:20:28.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.902+0000 7f580992e640 1 --2- 172.21.15.77:0/1009480686 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5804101ae0 0x7f580410f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:28.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.902+0000 7f580992e640 1 -- 172.21.15.77:0/1009480686 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f4005040 con 0x7f5804065be0 2024-09-18T21:20:28.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.903+0000 7f580992e640 1 --2- 172.21.15.77:0/1009480686 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5804065be0 0x7f580410f2e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5800002840 tx=0x7f5800004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:20:28.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.903+0000 7f57fa7fc640 1 -- 172.21.15.77:0/1009480686 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5800007c30 con 0x7f5804065be0 2024-09-18T21:20:28.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.903+0000 7f580bb92640 1 -- 172.21.15.77:0/1009480686 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58041108d0 con 0x7f5804065be0 2024-09-18T21:20:28.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.903+0000 7f580bb92640 1 -- 172.21.15.77:0/1009480686 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5804110e70 con 0x7f5804065be0 2024-09-18T21:20:28.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.903+0000 7f57fa7fc640 1 -- 172.21.15.77:0/1009480686 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f580000f040 con 0x7f5804065be0 2024-09-18T21:20:28.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.903+0000 7f57fa7fc640 1 -- 172.21.15.77:0/1009480686 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5800009380 con 0x7f5804065be0 2024-09-18T21:20:28.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.904+0000 7f580bb92640 1 -- 172.21.15.77:0/1009480686 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57e8005240 con 0x7f5804065be0 2024-09-18T21:20:28.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.905+0000 7f57fa7fc640 1 -- 172.21.15.77:0/1009480686 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f580000db60 con 0x7f5804065be0 2024-09-18T21:20:28.908 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.905+0000 7f57fa7fc640 1 --2- 172.21.15.77:0/1009480686 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f57f006e0b0 0x7f57f0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:20:28.908 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.905+0000 7f57fa7fc640 1 -- 172.21.15.77:0/1009480686 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f580008da30 con 0x7f5804065be0 2024-09-18T21:20:28.908 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.905+0000 7f580912d640 1 --2- 172.21.15.77:0/1009480686 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f57f006e0b0 0x7f57f0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:20:28.908 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.906+0000 7f580912d640 1 --2- 172.21.15.77:0/1009480686 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f57f006e0b0 0x7f57f0070560 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f580410f090 tx=0x7f57f4009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:20:28.910 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:28.910+0000 7f57fa7fc640 1 -- 172.21.15.77:0/1009480686 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f5800056d30 con 0x7f5804065be0 2024-09-18T21:20:29.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.099+0000 7f580bb92640 1 -- 172.21.15.77:0/1009480686 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f57e8000bf0 con 0x7f57f006e0b0 2024-09-18T21:20:29.101 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:29 smithi077 ceph-mon[92672]: from='client.34438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:20:29.101 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:29 smithi077 ceph-mon[92672]: pgmap v198: 65 pgs: 65 active+clean; 203 MiB data, 836 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 0 B/s wr, 4 op/s 2024-09-18T21:20:29.101 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:29 smithi077 ceph-mon[92672]: from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:20:29.101 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:29 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/2503505439' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:29.101 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:29 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/817131336' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T21:20:29.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.100+0000 7f57fa7fc640 1 -- 172.21.15.77:0/1009480686 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f57e8000bf0 con 0x7f57f006e0b0 2024-09-18T21:20:29.102 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-18T21:20:29.102 INFO:teuthology.orchestra.run.smithi077.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a", 2024-09-18T21:20:29.102 INFO:teuthology.orchestra.run.smithi077.stdout: "in_progress": true, 2024-09-18T21:20:29.102 INFO:teuthology.orchestra.run.smithi077.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T21:20:29.102 INFO:teuthology.orchestra.run.smithi077.stdout: "services_complete": [ 2024-09-18T21:20:29.102 INFO:teuthology.orchestra.run.smithi077.stdout: "mon", 2024-09-18T21:20:29.102 INFO:teuthology.orchestra.run.smithi077.stdout: "crash", 2024-09-18T21:20:29.102 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr", 2024-09-18T21:20:29.102 INFO:teuthology.orchestra.run.smithi077.stdout: "osd" 2024-09-18T21:20:29.102 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-18T21:20:29.102 INFO:teuthology.orchestra.run.smithi077.stdout: "progress": "15/21 daemons upgraded", 2024-09-18T21:20:29.103 INFO:teuthology.orchestra.run.smithi077.stdout: "message": "Currently upgrading mds daemons", 2024-09-18T21:20:29.103 INFO:teuthology.orchestra.run.smithi077.stdout: "is_paused": false 2024-09-18T21:20:29.103 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-18T21:20:29.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.102+0000 7f580bb92640 1 -- 172.21.15.77:0/1009480686 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f57f006e0b0 msgr2=0x7f57f0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:20:29.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.102+0000 7f580bb92640 1 --2- 172.21.15.77:0/1009480686 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f57f006e0b0 0x7f57f0070560 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f580410f090 tx=0x7f57f4009da0 comp rx=0 tx=0).stop 2024-09-18T21:20:29.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.102+0000 7f580bb92640 1 -- 172.21.15.77:0/1009480686 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5804065be0 msgr2=0x7f580410f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:20:29.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.102+0000 7f580bb92640 1 --2- 172.21.15.77:0/1009480686 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5804065be0 0x7f580410f2e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5800002840 tx=0x7f5800004570 comp rx=0 tx=0).stop 2024-09-18T21:20:29.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.102+0000 7f580bb92640 1 -- 172.21.15.77:0/1009480686 shutdown_connections 2024-09-18T21:20:29.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.102+0000 7f580bb92640 1 --2- 172.21.15.77:0/1009480686 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f57f006e0b0 0x7f57f0070560 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:29.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.102+0000 7f580bb92640 1 --2- 172.21.15.77:0/1009480686 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5804101ae0 0x7f580410f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:29.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.102+0000 7f580bb92640 1 --2- 172.21.15.77:0/1009480686 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5804065be0 0x7f580410f2e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:29.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.103+0000 7f580bb92640 1 -- 172.21.15.77:0/1009480686 >> 172.21.15.77:0/1009480686 conn(0x7f58040f6c10 msgr2=0x7f58040f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:20:29.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.103+0000 7f580bb92640 1 -- 172.21.15.77:0/1009480686 shutdown_connections 2024-09-18T21:20:29.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.103+0000 7f580bb92640 1 -- 172.21.15.77:0/1009480686 wait complete. 2024-09-18T21:20:29.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.182+0000 7fa413812640 1 -- 172.21.15.77:0/329182006 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa40c0fc520 msgr2=0x7fa40c0fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:20:29.184 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.182+0000 7fa413812640 1 --2- 172.21.15.77:0/329182006 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa40c0fc520 0x7fa40c0fc930 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa4080048d0 tx=0x7fa408009da0 comp rx=0 tx=0).stop 2024-09-18T21:20:29.184 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.182+0000 7fa413812640 1 -- 172.21.15.77:0/329182006 shutdown_connections 2024-09-18T21:20:29.184 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.182+0000 7fa413812640 1 --2- 172.21.15.77:0/329182006 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa40c0fd7f0 0x7fa40c0fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:29.184 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.182+0000 7fa413812640 1 --2- 172.21.15.77:0/329182006 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa40c0fc520 0x7fa40c0fc930 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:29.184 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.182+0000 7fa413812640 1 -- 172.21.15.77:0/329182006 >> 172.21.15.77:0/329182006 conn(0x7fa40c0f7ce0 msgr2=0x7fa40c0fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:20:29.184 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.182+0000 7fa413812640 1 -- 172.21.15.77:0/329182006 shutdown_connections 2024-09-18T21:20:29.184 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.182+0000 7fa413812640 1 -- 172.21.15.77:0/329182006 wait complete. 2024-09-18T21:20:29.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.183+0000 7fa413812640 1 Processor -- start 2024-09-18T21:20:29.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.183+0000 7fa413812640 1 -- start start 2024-09-18T21:20:29.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.183+0000 7fa413812640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa40c0fc520 0x7fa40c071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:20:29.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.183+0000 7fa413812640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa40c0fd7f0 0x7fa40c06fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:20:29.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.183+0000 7fa413812640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c06fff0 con 0x7fa40c0fc520 2024-09-18T21:20:29.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.183+0000 7fa413812640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c070130 con 0x7fa40c0fd7f0 2024-09-18T21:20:29.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.184+0000 7fa4115ae640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa40c0fc520 0x7fa40c071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:20:29.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.184+0000 7fa4115ae640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa40c0fc520 0x7fa40c071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48024/0 (socket says 172.21.15.77:48024) 2024-09-18T21:20:29.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.184+0000 7fa4115ae640 1 -- 172.21.15.77:0/3755781501 learned_addr learned my addr 172.21.15.77:0/3755781501 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:20:29.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.184+0000 7fa410dad640 1 --2- 172.21.15.77:0/3755781501 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa40c0fd7f0 0x7fa40c06fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:20:29.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.184+0000 7fa4115ae640 1 -- 172.21.15.77:0/3755781501 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa40c0fd7f0 msgr2=0x7fa40c06fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:20:29.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.184+0000 7fa4115ae640 1 --2- 172.21.15.77:0/3755781501 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa40c0fd7f0 0x7fa40c06fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:29.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.184+0000 7fa4115ae640 1 -- 172.21.15.77:0/3755781501 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa408005040 con 0x7fa40c0fc520 2024-09-18T21:20:29.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.184+0000 7fa4115ae640 1 --2- 172.21.15.77:0/3755781501 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa40c0fc520 0x7fa40c071570 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa408003080 tx=0x7fa408009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:20:29.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.184+0000 7fa401ffb640 1 -- 172.21.15.77:0/3755781501 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa408038070 con 0x7fa40c0fc520 2024-09-18T21:20:29.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.184+0000 7fa401ffb640 1 -- 172.21.15.77:0/3755781501 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa40802abd0 con 0x7fa40c0fc520 2024-09-18T21:20:29.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.185+0000 7fa401ffb640 1 -- 172.21.15.77:0/3755781501 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa40803e670 con 0x7fa40c0fc520 2024-09-18T21:20:29.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.185+0000 7fa413812640 1 -- 172.21.15.77:0/3755781501 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa40c0703b0 con 0x7fa40c0fc520 2024-09-18T21:20:29.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.185+0000 7fa413812640 1 -- 172.21.15.77:0/3755781501 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa40c115100 con 0x7fa40c0fc520 2024-09-18T21:20:29.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.186+0000 7fa401ffb640 1 -- 172.21.15.77:0/3755781501 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fa408030020 con 0x7fa40c0fc520 2024-09-18T21:20:29.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.186+0000 7fa413812640 1 -- 172.21.15.77:0/3755781501 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa40c0fb980 con 0x7fa40c0fc520 2024-09-18T21:20:29.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.187+0000 7fa401ffb640 1 --2- 172.21.15.77:0/3755781501 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fa3f806e0b0 0x7fa3f8070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:20:29.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.187+0000 7fa401ffb640 1 -- 172.21.15.77:0/3755781501 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fa4080adc10 con 0x7fa40c0fc520 2024-09-18T21:20:29.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.187+0000 7fa410dad640 1 --2- 172.21.15.77:0/3755781501 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fa3f806e0b0 0x7fa3f8070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:20:29.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.187+0000 7fa410dad640 1 --2- 172.21.15.77:0/3755781501 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fa3f806e0b0 0x7fa3f8070560 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc0041d0 tx=0x7fa3fc004330 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:20:29.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.191+0000 7fa401ffb640 1 -- 172.21.15.77:0/3755781501 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fa408076f60 con 0x7fa40c0fc520 2024-09-18T21:20:29.316 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:29 smithi103 ceph-mon[80307]: from='client.34438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:20:29.316 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:29 smithi103 ceph-mon[80307]: pgmap v198: 65 pgs: 65 active+clean; 203 MiB data, 836 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 0 B/s wr, 4 op/s 2024-09-18T21:20:29.316 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:29 smithi103 ceph-mon[80307]: from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:20:29.316 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:29 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/2503505439' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:29.316 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:29 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/817131336' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T21:20:29.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.446+0000 7fa413812640 1 -- 172.21.15.77:0/3755781501 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa40c04b720 con 0x7fa40c0fc520 2024-09-18T21:20:29.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.446+0000 7fa401ffb640 1 -- 172.21.15.77:0/3755781501 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+107 (secure 0 0 0) 0x7fa40807a620 con 0x7fa40c0fc520 2024-09-18T21:20:29.447 INFO:teuthology.orchestra.run.smithi077.stdout:HEALTH_WARN 1 filesystem is degraded 2024-09-18T21:20:29.448 INFO:teuthology.orchestra.run.smithi077.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-18T21:20:29.448 INFO:teuthology.orchestra.run.smithi077.stdout: fs cephfs is degraded 2024-09-18T21:20:29.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.449+0000 7fa413812640 1 -- 172.21.15.77:0/3755781501 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fa3f806e0b0 msgr2=0x7fa3f8070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:20:29.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.449+0000 7fa413812640 1 --2- 172.21.15.77:0/3755781501 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fa3f806e0b0 0x7fa3f8070560 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc0041d0 tx=0x7fa3fc004330 comp rx=0 tx=0).stop 2024-09-18T21:20:29.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.449+0000 7fa413812640 1 -- 172.21.15.77:0/3755781501 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa40c0fc520 msgr2=0x7fa40c071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:20:29.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.449+0000 7fa413812640 1 --2- 172.21.15.77:0/3755781501 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa40c0fc520 0x7fa40c071570 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa408003080 tx=0x7fa408009da0 comp rx=0 tx=0).stop 2024-09-18T21:20:29.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.449+0000 7fa413812640 1 -- 172.21.15.77:0/3755781501 shutdown_connections 2024-09-18T21:20:29.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.449+0000 7fa413812640 1 --2- 172.21.15.77:0/3755781501 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fa3f806e0b0 0x7fa3f8070560 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:29.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.449+0000 7fa413812640 1 --2- 172.21.15.77:0/3755781501 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa40c0fd7f0 0x7fa40c06fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:29.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.449+0000 7fa413812640 1 --2- 172.21.15.77:0/3755781501 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa40c0fc520 0x7fa40c071570 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:29.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.449+0000 7fa413812640 1 -- 172.21.15.77:0/3755781501 >> 172.21.15.77:0/3755781501 conn(0x7fa40c0f7ce0 msgr2=0x7fa40c0f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:20:29.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.450+0000 7fa413812640 1 -- 172.21.15.77:0/3755781501 shutdown_connections 2024-09-18T21:20:29.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:29.450+0000 7fa413812640 1 -- 172.21.15.77:0/3755781501 wait complete. 2024-09-18T21:20:30.465 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:30 smithi077 ceph-mon[92672]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:20:30.465 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:30 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/3755781501' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T21:20:30.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:30 smithi103 ceph-mon[80307]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:20:30.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:30 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/3755781501' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T21:20:31.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:31 smithi077 ceph-mon[92672]: from='client.34458 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:20:31.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:31 smithi077 ceph-mon[92672]: pgmap v199: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-09-18T21:20:31.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:31 smithi103 ceph-mon[80307]: from='client.34458 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:20:31.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:31 smithi103 ceph-mon[80307]: pgmap v199: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-09-18T21:20:32.314 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:32 smithi077 ceph-mon[92672]: reconnect by client.14492 192.168.0.1:0/1125901818 after 0 2024-09-18T21:20:32.314 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:32 smithi077 ceph-mon[92672]: reconnect by client.24295 192.168.0.1:0/178146206 after 0 2024-09-18T21:20:32.314 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:32 smithi077 ceph-mon[92672]: mds.? [v2:172.21.15.77:6826/1087320436,v1:172.21.15.77:6827/1087320436] up:reconnect 2024-09-18T21:20:32.315 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:32 smithi077 ceph-mon[92672]: fsmap cephfs:1/1 {0=cephfs.smithi077.vruydi=up:reconnect} 2 up:standby 2024-09-18T21:20:32.411 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:32 smithi103 ceph-mon[80307]: reconnect by client.14492 192.168.0.1:0/1125901818 after 0 2024-09-18T21:20:32.411 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:32 smithi103 ceph-mon[80307]: reconnect by client.24295 192.168.0.1:0/178146206 after 0 2024-09-18T21:20:32.411 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:32 smithi103 ceph-mon[80307]: mds.? [v2:172.21.15.77:6826/1087320436,v1:172.21.15.77:6827/1087320436] up:reconnect 2024-09-18T21:20:32.411 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:32 smithi103 ceph-mon[80307]: fsmap cephfs:1/1 {0=cephfs.smithi077.vruydi=up:reconnect} 2 up:standby 2024-09-18T21:20:33.062 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:33 smithi103 ceph-mon[80307]: pgmap v200: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-09-18T21:20:33.062 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:33 smithi103 ceph-mon[80307]: mds.? [v2:172.21.15.77:6826/1087320436,v1:172.21.15.77:6827/1087320436] up:rejoin 2024-09-18T21:20:33.062 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:33 smithi103 ceph-mon[80307]: fsmap cephfs:1/1 {0=cephfs.smithi077.vruydi=up:rejoin} 2 up:standby 2024-09-18T21:20:33.425 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:33 smithi103 ceph-mon[80307]: daemon mds.cephfs.smithi077.vruydi is now active in filesystem cephfs as rank 0 2024-09-18T21:20:33.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:33 smithi077 ceph-mon[92672]: pgmap v200: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-09-18T21:20:33.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:33 smithi077 ceph-mon[92672]: mds.? [v2:172.21.15.77:6826/1087320436,v1:172.21.15.77:6827/1087320436] up:rejoin 2024-09-18T21:20:33.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:33 smithi077 ceph-mon[92672]: fsmap cephfs:1/1 {0=cephfs.smithi077.vruydi=up:rejoin} 2 up:standby 2024-09-18T21:20:33.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:33 smithi077 ceph-mon[92672]: daemon mds.cephfs.smithi077.vruydi is now active in filesystem cephfs as rank 0 2024-09-18T21:20:34.445 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:34 smithi103 ceph-mon[80307]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-18T21:20:34.445 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:34 smithi103 ceph-mon[80307]: Cluster is now healthy 2024-09-18T21:20:34.445 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:34 smithi103 ceph-mon[80307]: mds.? [v2:172.21.15.77:6826/1087320436,v1:172.21.15.77:6827/1087320436] up:active 2024-09-18T21:20:34.445 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:34 smithi103 ceph-mon[80307]: fsmap cephfs:1 {0=cephfs.smithi077.vruydi=up:active} 2 up:standby 2024-09-18T21:20:34.445 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:34 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:34.445 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:34 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:34.445 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:34 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:20:34.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:34 smithi077 ceph-mon[92672]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-18T21:20:34.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:34 smithi077 ceph-mon[92672]: Cluster is now healthy 2024-09-18T21:20:34.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:34 smithi077 ceph-mon[92672]: mds.? [v2:172.21.15.77:6826/1087320436,v1:172.21.15.77:6827/1087320436] up:active 2024-09-18T21:20:34.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:34 smithi077 ceph-mon[92672]: fsmap cephfs:1 {0=cephfs.smithi077.vruydi=up:active} 2 up:standby 2024-09-18T21:20:34.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:34 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:34.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:34 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:34.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:34 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:20:35.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:35 smithi103 ceph-mon[80307]: pgmap v201: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 0 B/s wr, 6 op/s 2024-09-18T21:20:35.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:35 smithi103 ceph-mon[80307]: mds.? [v2:172.21.15.103:6826/3688450345,v1:172.21.15.103:6827/3688450345] up:boot 2024-09-18T21:20:35.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:35 smithi103 ceph-mon[80307]: fsmap cephfs:1 {0=cephfs.smithi077.vruydi=up:active} 3 up:standby 2024-09-18T21:20:35.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:35 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi103.opftmf"}]: dispatch 2024-09-18T21:20:35.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:35 smithi077 ceph-mon[92672]: pgmap v201: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 0 B/s wr, 6 op/s 2024-09-18T21:20:35.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:35 smithi077 ceph-mon[92672]: mds.? [v2:172.21.15.103:6826/3688450345,v1:172.21.15.103:6827/3688450345] up:boot 2024-09-18T21:20:35.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:35 smithi077 ceph-mon[92672]: fsmap cephfs:1 {0=cephfs.smithi077.vruydi=up:active} 3 up:standby 2024-09-18T21:20:35.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:35 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi103.opftmf"}]: dispatch 2024-09-18T21:20:36.968 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:36 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:36.969 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:36 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:36.969 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:36 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:20:36.969 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:36 smithi103 ceph-mon[80307]: pgmap v202: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 0 B/s wr, 5 op/s 2024-09-18T21:20:36.969 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:36 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:36.969 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:36 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:37.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:36 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:37.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:36 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:37.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:36 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:20:37.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:36 smithi077 ceph-mon[92672]: pgmap v202: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 0 B/s wr, 5 op/s 2024-09-18T21:20:37.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:36 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:37.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:36 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:39.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:38 smithi103 ceph-mon[80307]: pgmap v203: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 7 op/s 2024-09-18T21:20:39.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:38 smithi077 ceph-mon[92672]: pgmap v203: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 7 op/s 2024-09-18T21:20:40.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:40 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:40.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:40 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:40.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:40 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:20:40.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:40 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:20:40.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:40 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:40.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:40 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:20:40.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:40 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:40.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:40 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:40.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:40 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:40.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:40 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:40.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:40 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:40.715 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:40 smithi077 ceph-mon[92672]: Upgrade: Setting container_image for all mds 2024-09-18T21:20:40.715 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:40 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:40.715 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:40 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi077.cqfhlw"}]: dispatch 2024-09-18T21:20:40.715 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:40 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi077.cqfhlw"}]': finished 2024-09-18T21:20:40.715 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:40 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi077.vruydi"}]: dispatch 2024-09-18T21:20:40.715 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:40 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi077.vruydi"}]': finished 2024-09-18T21:20:40.715 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:40 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi103.opftmf"}]: dispatch 2024-09-18T21:20:40.715 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:40 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi103.opftmf"}]': finished 2024-09-18T21:20:40.715 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:40 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi103.zhdmdg"}]: dispatch 2024-09-18T21:20:40.715 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:40 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi103.zhdmdg"}]': finished 2024-09-18T21:20:40.715 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:40 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:40.715 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:40 smithi077 ceph-mon[92672]: Upgrade: Setting container_image for all rgw 2024-09-18T21:20:40.715 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:40 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:40.715 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:40 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:40.716 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:40 smithi077 ceph-mon[92672]: Upgrade: Setting container_image for all rbd-mirror 2024-09-18T21:20:40.716 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:40 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:40.716 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:40 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:40.716 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:40 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:40.716 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:40 smithi077 ceph-mon[92672]: Upgrade: Setting container_image for all ceph-exporter 2024-09-18T21:20:40.716 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:40 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:40.716 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:40 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:40.716 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:40 smithi077 ceph-mon[92672]: Upgrade: Setting container_image for all iscsi 2024-09-18T21:20:40.716 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:40 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:40.716 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:40 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:40.716 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:40 smithi077 ceph-mon[92672]: Upgrade: Setting container_image for all nfs 2024-09-18T21:20:40.716 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:40 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:40.716 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:40 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:40.717 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:40 smithi077 ceph-mon[92672]: Upgrade: Setting container_image for all nvmeof 2024-09-18T21:20:40.717 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:40 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:40.717 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:40 smithi077 ceph-mon[92672]: pgmap v204: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 7.0 MiB/s rd, 170 B/s wr, 4 op/s 2024-09-18T21:20:40.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:40 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:40.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:40 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:40.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:40 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:20:40.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:40 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:20:40.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:40 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:40.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:40 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:20:40.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:40 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:40.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:40 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:40.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:40 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:40.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:40 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:40.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:40 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:40.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:40 smithi103 ceph-mon[80307]: Upgrade: Setting container_image for all mds 2024-09-18T21:20:40.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:40 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:40.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:40 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi077.cqfhlw"}]: dispatch 2024-09-18T21:20:40.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:40 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi077.cqfhlw"}]': finished 2024-09-18T21:20:40.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:40 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi077.vruydi"}]: dispatch 2024-09-18T21:20:40.766 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:40 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi077.vruydi"}]': finished 2024-09-18T21:20:40.766 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:40 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi103.opftmf"}]: dispatch 2024-09-18T21:20:40.766 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:40 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi103.opftmf"}]': finished 2024-09-18T21:20:40.766 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:40 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi103.zhdmdg"}]: dispatch 2024-09-18T21:20:40.766 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:40 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi103.zhdmdg"}]': finished 2024-09-18T21:20:40.766 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:40 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:40.766 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:40 smithi103 ceph-mon[80307]: Upgrade: Setting container_image for all rgw 2024-09-18T21:20:40.766 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:40 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:40.766 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:40 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:40.766 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:40 smithi103 ceph-mon[80307]: Upgrade: Setting container_image for all rbd-mirror 2024-09-18T21:20:40.766 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:40 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:40.766 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:40 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:40.767 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:40 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:40.767 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:40 smithi103 ceph-mon[80307]: Upgrade: Setting container_image for all ceph-exporter 2024-09-18T21:20:40.767 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:40 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:40.767 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:40 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:40.767 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:40 smithi103 ceph-mon[80307]: Upgrade: Setting container_image for all iscsi 2024-09-18T21:20:40.767 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:40 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:40.767 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:40 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:40.767 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:40 smithi103 ceph-mon[80307]: Upgrade: Setting container_image for all nfs 2024-09-18T21:20:40.767 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:40 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:40.767 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:40 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:40.767 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:40 smithi103 ceph-mon[80307]: Upgrade: Setting container_image for all nvmeof 2024-09-18T21:20:40.767 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:40 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:40.767 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:40 smithi103 ceph-mon[80307]: pgmap v204: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 7.0 MiB/s rd, 170 B/s wr, 4 op/s 2024-09-18T21:20:43.072 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:42 smithi077 ceph-mon[92672]: Upgrade: Updating node-exporter.smithi077 (1/2) 2024-09-18T21:20:43.072 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:42 smithi077 ceph-mon[92672]: Deploying daemon node-exporter.smithi077 on smithi077 2024-09-18T21:20:43.072 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:42 smithi077 ceph-mon[92672]: pgmap v205: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 170 B/s wr, 3 op/s 2024-09-18T21:20:43.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:42 smithi103 ceph-mon[80307]: Upgrade: Updating node-exporter.smithi077 (1/2) 2024-09-18T21:20:43.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:42 smithi103 ceph-mon[80307]: Deploying daemon node-exporter.smithi077 on smithi077 2024-09-18T21:20:43.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:42 smithi103 ceph-mon[80307]: pgmap v205: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 170 B/s wr, 3 op/s 2024-09-18T21:20:44.899 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:44 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:44.899 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:44 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:44.899 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:44 smithi077 ceph-mon[92672]: pgmap v206: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-09-18T21:20:45.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:44 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:45.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:44 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:45.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:44 smithi103 ceph-mon[80307]: pgmap v206: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-09-18T21:20:47.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:46 smithi077 ceph-mon[92672]: Upgrade: Updating node-exporter.smithi103 (2/2) 2024-09-18T21:20:47.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:46 smithi077 ceph-mon[92672]: Deploying daemon node-exporter.smithi103 on smithi103 2024-09-18T21:20:47.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:46 smithi077 ceph-mon[92672]: pgmap v207: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 3.0 KiB/s rd, 4.3 KiB/s wr, 4 op/s 2024-09-18T21:20:47.258 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:46 smithi103 ceph-mon[80307]: Upgrade: Updating node-exporter.smithi103 (2/2) 2024-09-18T21:20:47.258 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:46 smithi103 ceph-mon[80307]: Deploying daemon node-exporter.smithi103 on smithi103 2024-09-18T21:20:47.258 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:46 smithi103 ceph-mon[80307]: pgmap v207: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 3.0 KiB/s rd, 4.3 KiB/s wr, 4 op/s 2024-09-18T21:20:48.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:48.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:48.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:20:48.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:48 smithi103 ceph-mon[80307]: pgmap v208: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4.3 KiB/s wr, 4 op/s 2024-09-18T21:20:48.898 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:48.898 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:48.899 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:20:48.899 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:48 smithi077 ceph-mon[92672]: pgmap v208: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4.3 KiB/s wr, 4 op/s 2024-09-18T21:20:50.991 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:50 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:50.991 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:50 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:50.991 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:50 smithi103 ceph-mon[80307]: pgmap v209: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-09-18T21:20:50.991 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:50 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:50.991 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:50 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:50.992 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:50 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:50.992 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:50 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:50.992 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:50 smithi077 ceph-mon[92672]: pgmap v209: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-09-18T21:20:50.992 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:50 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:50.992 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:50 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:52.007 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:51 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:20:52.007 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:51 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:52.007 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:51 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:52.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:51 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:20:52.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:51 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:52.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:51 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:52.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:52 smithi077 ceph-mon[92672]: pgmap v210: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-09-18T21:20:52.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:52 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:52.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:52 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:53.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:52 smithi103 ceph-mon[80307]: pgmap v210: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-09-18T21:20:53.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:52 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:53.014 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:52 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:54.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:54 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:54.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:54 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:54.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:54 smithi077 ceph-mon[92672]: pgmap v211: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-09-18T21:20:54.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:54 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:54.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:54 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:54.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:54 smithi103 ceph-mon[80307]: pgmap v211: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-09-18T21:20:56.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:56 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:56.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:56 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:56.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:56 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:20:56.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:56 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:20:56.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:56 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:56.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:56 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:20:56.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:56 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:56.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:56 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:56.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:56 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:56.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:56 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:56.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:56 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:56.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:56 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:56.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:56 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:56.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:56 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:56.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:56 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:56.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:56 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:56.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:56 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:56.714 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:56 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:56.715 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:56 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:56.715 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:56 smithi077 ceph-mon[92672]: pgmap v212: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:20:56.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:56 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:56.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:56 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:56.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:56 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:20:56.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:56 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:20:56.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:56 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:20:56.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:56 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:20:56.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:56 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:56.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:56 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:56.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:56 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:56.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:56 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:56.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:56 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:56.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:56 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:56.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:56 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:56.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:56 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:56.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:56 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:56.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:56 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:56.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:56 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:56.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:56 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:56.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:56 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:20:56.765 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:56 smithi103 ceph-mon[80307]: pgmap v212: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:20:57.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:57 smithi103 ceph-mon[80307]: Upgrade: Updating prometheus.smithi077 2024-09-18T21:20:57.780 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:57 smithi077 ceph-mon[92672]: Upgrade: Updating prometheus.smithi077 2024-09-18T21:20:58.629 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:58 smithi077 ceph-mon[92672]: Deploying daemon prometheus.smithi077 on smithi077 2024-09-18T21:20:58.629 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:20:58 smithi077 ceph-mon[92672]: pgmap v213: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:20:58.763 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:58 smithi103 ceph-mon[80307]: Deploying daemon prometheus.smithi077 on smithi077 2024-09-18T21:20:58.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:20:58 smithi103 ceph-mon[80307]: pgmap v213: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:20:59.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.546+0000 7f9b9ca6a640 1 -- 172.21.15.77:0/3944525054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b980ff680 msgr2=0x7f9b98101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:20:59.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.546+0000 7f9b9ca6a640 1 --2- 172.21.15.77:0/3944525054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b980ff680 0x7f9b98101a60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c0048d0 tx=0x7f9b8c009da0 comp rx=0 tx=0).stop 2024-09-18T21:20:59.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.546+0000 7f9b9ca6a640 1 -- 172.21.15.77:0/3944525054 shutdown_connections 2024-09-18T21:20:59.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.546+0000 7f9b9ca6a640 1 --2- 172.21.15.77:0/3944525054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b980ff680 0x7f9b98101a60 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:59.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.546+0000 7f9b9ca6a640 1 --2- 172.21.15.77:0/3944525054 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b98065c40 0x7f9b980ff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:59.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.546+0000 7f9b9ca6a640 1 -- 172.21.15.77:0/3944525054 >> 172.21.15.77:0/3944525054 conn(0x7f9b980f6c10 msgr2=0x7f9b980f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:20:59.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.546+0000 7f9b9ca6a640 1 -- 172.21.15.77:0/3944525054 shutdown_connections 2024-09-18T21:20:59.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.546+0000 7f9b9ca6a640 1 -- 172.21.15.77:0/3944525054 wait complete. 2024-09-18T21:20:59.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.547+0000 7f9b9ca6a640 1 Processor -- start 2024-09-18T21:20:59.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.547+0000 7f9b9ca6a640 1 -- start start 2024-09-18T21:20:59.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.547+0000 7f9b9ca6a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b98065c40 0x7f9b9810d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:20:59.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.547+0000 7f9b9ca6a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b980ff680 0x7f9b9810d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:20:59.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.547+0000 7f9b9ca6a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9810dc00 con 0x7f9b980ff680 2024-09-18T21:20:59.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.547+0000 7f9b9ca6a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9810e420 con 0x7f9b98065c40 2024-09-18T21:20:59.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.547+0000 7f9b95d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b980ff680 0x7f9b9810d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:20:59.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.547+0000 7f9b95d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b980ff680 0x7f9b9810d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46828/0 (socket says 172.21.15.77:46828) 2024-09-18T21:20:59.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.547+0000 7f9b95d9b640 1 -- 172.21.15.77:0/2147421385 learned_addr learned my addr 172.21.15.77:0/2147421385 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:20:59.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.547+0000 7f9b9659c640 1 --2- 172.21.15.77:0/2147421385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b98065c40 0x7f9b9810d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:20:59.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.547+0000 7f9b95d9b640 1 -- 172.21.15.77:0/2147421385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b98065c40 msgr2=0x7f9b9810d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:20:59.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.547+0000 7f9b95d9b640 1 --2- 172.21.15.77:0/2147421385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b98065c40 0x7f9b9810d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:59.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.547+0000 7f9b95d9b640 1 -- 172.21.15.77:0/2147421385 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b8c005040 con 0x7f9b980ff680 2024-09-18T21:20:59.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.548+0000 7f9b95d9b640 1 --2- 172.21.15.77:0/2147421385 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b980ff680 0x7f9b9810d5b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c0048a0 tx=0x7f9b8c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:20:59.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.548+0000 7f9b86ffd640 1 -- 172.21.15.77:0/2147421385 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b8c038070 con 0x7f9b980ff680 2024-09-18T21:20:59.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.548+0000 7f9b86ffd640 1 -- 172.21.15.77:0/2147421385 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9b8c009800 con 0x7f9b980ff680 2024-09-18T21:20:59.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.548+0000 7f9b9ca6a640 1 -- 172.21.15.77:0/2147421385 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b9810e650 con 0x7f9b980ff680 2024-09-18T21:20:59.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.548+0000 7f9b86ffd640 1 -- 172.21.15.77:0/2147421385 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b8c03e670 con 0x7f9b980ff680 2024-09-18T21:20:59.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.548+0000 7f9b9ca6a640 1 -- 172.21.15.77:0/2147421385 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b9810ebf0 con 0x7f9b980ff680 2024-09-18T21:20:59.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.549+0000 7f9b9ca6a640 1 -- 172.21.15.77:0/2147421385 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b980fa890 con 0x7f9b980ff680 2024-09-18T21:20:59.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.549+0000 7f9b86ffd640 1 -- 172.21.15.77:0/2147421385 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9b8c030020 con 0x7f9b980ff680 2024-09-18T21:20:59.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.550+0000 7f9b86ffd640 1 --2- 172.21.15.77:0/2147421385 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f9b8006e0b0 0x7f9b80070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:20:59.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.550+0000 7f9b9659c640 1 --2- 172.21.15.77:0/2147421385 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f9b8006e0b0 0x7f9b80070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:20:59.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.550+0000 7f9b86ffd640 1 -- 172.21.15.77:0/2147421385 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f9b8c0add70 con 0x7f9b980ff680 2024-09-18T21:20:59.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.551+0000 7f9b9659c640 1 --2- 172.21.15.77:0/2147421385 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f9b8006e0b0 0x7f9b80070560 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9b88004fd0 tx=0x7f9b8800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:20:59.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.555+0000 7f9b86ffd640 1 -- 172.21.15.77:0/2147421385 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f9b8c076ff0 con 0x7f9b980ff680 2024-09-18T21:20:59.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.741+0000 7f9b9ca6a640 1 -- 172.21.15.77:0/2147421385 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b9810eed0 con 0x7f9b8006e0b0 2024-09-18T21:20:59.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.742+0000 7f9b86ffd640 1 -- 172.21.15.77:0/2147421385 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+438 (secure 0 0 0) 0x7f9b9810eed0 con 0x7f9b8006e0b0 2024-09-18T21:20:59.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.744+0000 7f9b9ca6a640 1 -- 172.21.15.77:0/2147421385 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f9b8006e0b0 msgr2=0x7f9b80070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:20:59.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.744+0000 7f9b9ca6a640 1 --2- 172.21.15.77:0/2147421385 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f9b8006e0b0 0x7f9b80070560 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9b88004fd0 tx=0x7f9b8800b040 comp rx=0 tx=0).stop 2024-09-18T21:20:59.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.744+0000 7f9b9ca6a640 1 -- 172.21.15.77:0/2147421385 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b980ff680 msgr2=0x7f9b9810d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:20:59.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.744+0000 7f9b9ca6a640 1 --2- 172.21.15.77:0/2147421385 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b980ff680 0x7f9b9810d5b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c0048a0 tx=0x7f9b8c009da0 comp rx=0 tx=0).stop 2024-09-18T21:20:59.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.744+0000 7f9b9ca6a640 1 -- 172.21.15.77:0/2147421385 shutdown_connections 2024-09-18T21:20:59.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.744+0000 7f9b9ca6a640 1 --2- 172.21.15.77:0/2147421385 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9b980ff680 0x7f9b9810d5b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:59.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.744+0000 7f9b9ca6a640 1 --2- 172.21.15.77:0/2147421385 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f9b8006e0b0 0x7f9b80070560 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:59.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.744+0000 7f9b9ca6a640 1 --2- 172.21.15.77:0/2147421385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b98065c40 0x7f9b9810d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:59.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.744+0000 7f9b9ca6a640 1 -- 172.21.15.77:0/2147421385 >> 172.21.15.77:0/2147421385 conn(0x7f9b980f6c10 msgr2=0x7f9b980f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:20:59.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.744+0000 7f9b9ca6a640 1 -- 172.21.15.77:0/2147421385 shutdown_connections 2024-09-18T21:20:59.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.744+0000 7f9b9ca6a640 1 -- 172.21.15.77:0/2147421385 wait complete. 2024-09-18T21:20:59.754 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-09-18T21:20:59.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.825+0000 7f0f50e40640 1 -- 172.21.15.77:0/822061928 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f4c0fb450 msgr2=0x7f0f4c0fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:20:59.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.825+0000 7f0f50e40640 1 --2- 172.21.15.77:0/822061928 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f4c0fb450 0x7f0f4c0fb860 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c0048d0 tx=0x7f0f3c009da0 comp rx=0 tx=0).stop 2024-09-18T21:20:59.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.825+0000 7f0f50e40640 1 -- 172.21.15.77:0/822061928 shutdown_connections 2024-09-18T21:20:59.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.825+0000 7f0f50e40640 1 --2- 172.21.15.77:0/822061928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f4c0fc720 0x7f0f4c0fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:59.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.825+0000 7f0f50e40640 1 --2- 172.21.15.77:0/822061928 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f4c0fb450 0x7f0f4c0fb860 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:59.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.825+0000 7f0f50e40640 1 -- 172.21.15.77:0/822061928 >> 172.21.15.77:0/822061928 conn(0x7f0f4c0f6c10 msgr2=0x7f0f4c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:20:59.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.825+0000 7f0f50e40640 1 -- 172.21.15.77:0/822061928 shutdown_connections 2024-09-18T21:20:59.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.825+0000 7f0f50e40640 1 -- 172.21.15.77:0/822061928 wait complete. 2024-09-18T21:20:59.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.826+0000 7f0f50e40640 1 Processor -- start 2024-09-18T21:20:59.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.826+0000 7f0f50e40640 1 -- start start 2024-09-18T21:20:59.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.826+0000 7f0f50e40640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f4c0fb450 0x7f0f4c10d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:20:59.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.826+0000 7f0f50e40640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f4c0fc720 0x7f0f4c10d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:20:59.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.826+0000 7f0f50e40640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4c10dc80 con 0x7f0f4c0fb450 2024-09-18T21:20:59.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.826+0000 7f0f50e40640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4c10e430 con 0x7f0f4c0fc720 2024-09-18T21:20:59.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.826+0000 7f0f4a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f4c0fb450 0x7f0f4c10d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:20:59.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.826+0000 7f0f4a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f4c0fb450 0x7f0f4c10d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46852/0 (socket says 172.21.15.77:46852) 2024-09-18T21:20:59.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.826+0000 7f0f4a59c640 1 -- 172.21.15.77:0/3084446815 learned_addr learned my addr 172.21.15.77:0/3084446815 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:20:59.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.826+0000 7f0f49d9b640 1 --2- 172.21.15.77:0/3084446815 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f4c0fc720 0x7f0f4c10d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:20:59.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.826+0000 7f0f4a59c640 1 -- 172.21.15.77:0/3084446815 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f4c0fc720 msgr2=0x7f0f4c10d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:20:59.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.826+0000 7f0f4a59c640 1 --2- 172.21.15.77:0/3084446815 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f4c0fc720 0x7f0f4c10d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:20:59.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.826+0000 7f0f4a59c640 1 -- 172.21.15.77:0/3084446815 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f3c005040 con 0x7f0f4c0fb450 2024-09-18T21:20:59.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.827+0000 7f0f4a59c640 1 --2- 172.21.15.77:0/3084446815 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f4c0fb450 0x7f0f4c10d0f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c0043d0 tx=0x7f0f3c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:20:59.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.827+0000 7f0f3affd640 1 -- 172.21.15.77:0/3084446815 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f3c038070 con 0x7f0f4c0fb450 2024-09-18T21:20:59.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.827+0000 7f0f3affd640 1 -- 172.21.15.77:0/3084446815 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0f3c02ae90 con 0x7f0f4c0fb450 2024-09-18T21:20:59.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.827+0000 7f0f3affd640 1 -- 172.21.15.77:0/3084446815 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f3c03e670 con 0x7f0f4c0fb450 2024-09-18T21:20:59.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.827+0000 7f0f50e40640 1 -- 172.21.15.77:0/3084446815 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f4c10e660 con 0x7f0f4c0fb450 2024-09-18T21:20:59.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.827+0000 7f0f50e40640 1 -- 172.21.15.77:0/3084446815 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f4c10ec00 con 0x7f0f4c0fb450 2024-09-18T21:20:59.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.828+0000 7f0f50e40640 1 -- 172.21.15.77:0/3084446815 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f4c0fa8b0 con 0x7f0f4c0fb450 2024-09-18T21:20:59.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.828+0000 7f0f3affd640 1 -- 172.21.15.77:0/3084446815 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f0f3c030020 con 0x7f0f4c0fb450 2024-09-18T21:20:59.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.829+0000 7f0f3affd640 1 --2- 172.21.15.77:0/3084446815 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f0f3406e0b0 0x7f0f34070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:20:59.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.829+0000 7f0f3affd640 1 -- 172.21.15.77:0/3084446815 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f0f3c0adde0 con 0x7f0f4c0fb450 2024-09-18T21:20:59.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.829+0000 7f0f49d9b640 1 --2- 172.21.15.77:0/3084446815 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f0f3406e0b0 0x7f0f34070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:20:59.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.829+0000 7f0f49d9b640 1 --2- 172.21.15.77:0/3084446815 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f0f3406e0b0 0x7f0f34070560 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c10cea0 tx=0x7f0f4000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:20:59.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:20:59.833+0000 7f0f3affd640 1 -- 172.21.15.77:0/3084446815 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f0f3c077110 con 0x7f0f4c0fb450 2024-09-18T21:21:00.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.015+0000 7f0f50e40640 1 -- 172.21.15.77:0/3084446815 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0f4c103fe0 con 0x7f0f3406e0b0 2024-09-18T21:21:00.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.016+0000 7f0f3affd640 1 -- 172.21.15.77:0/3084446815 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+438 (secure 0 0 0) 0x7f0f4c103fe0 con 0x7f0f3406e0b0 2024-09-18T21:21:00.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.018+0000 7f0f50e40640 1 -- 172.21.15.77:0/3084446815 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f0f3406e0b0 msgr2=0x7f0f34070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:00.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.018+0000 7f0f50e40640 1 --2- 172.21.15.77:0/3084446815 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f0f3406e0b0 0x7f0f34070560 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c10cea0 tx=0x7f0f4000b040 comp rx=0 tx=0).stop 2024-09-18T21:21:00.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.018+0000 7f0f50e40640 1 -- 172.21.15.77:0/3084446815 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f4c0fb450 msgr2=0x7f0f4c10d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:00.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.018+0000 7f0f50e40640 1 --2- 172.21.15.77:0/3084446815 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f4c0fb450 0x7f0f4c10d0f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c0043d0 tx=0x7f0f3c009da0 comp rx=0 tx=0).stop 2024-09-18T21:21:00.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.019+0000 7f0f50e40640 1 -- 172.21.15.77:0/3084446815 shutdown_connections 2024-09-18T21:21:00.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.019+0000 7f0f50e40640 1 --2- 172.21.15.77:0/3084446815 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f0f3406e0b0 0x7f0f34070560 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:00.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.019+0000 7f0f50e40640 1 --2- 172.21.15.77:0/3084446815 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0f4c0fc720 0x7f0f4c10d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:00.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.019+0000 7f0f50e40640 1 --2- 172.21.15.77:0/3084446815 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0f4c0fb450 0x7f0f4c10d0f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:00.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.019+0000 7f0f50e40640 1 -- 172.21.15.77:0/3084446815 >> 172.21.15.77:0/3084446815 conn(0x7f0f4c0f6c10 msgr2=0x7f0f4c0660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:21:00.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.019+0000 7f0f50e40640 1 -- 172.21.15.77:0/3084446815 shutdown_connections 2024-09-18T21:21:00.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.019+0000 7f0f50e40640 1 -- 172.21.15.77:0/3084446815 wait complete. 2024-09-18T21:21:00.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.098+0000 7f5e6eb6f640 1 -- 172.21.15.77:0/2138510265 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e680fc720 msgr2=0x7f5e680fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:00.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.098+0000 7f5e6eb6f640 1 --2- 172.21.15.77:0/2138510265 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e680fc720 0x7f5e680fcb90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5e540048d0 tx=0x7f5e54009da0 comp rx=0 tx=0).stop 2024-09-18T21:21:00.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.098+0000 7f5e6eb6f640 1 -- 172.21.15.77:0/2138510265 shutdown_connections 2024-09-18T21:21:00.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.098+0000 7f5e6eb6f640 1 --2- 172.21.15.77:0/2138510265 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e680fc720 0x7f5e680fcb90 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:00.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.098+0000 7f5e6eb6f640 1 --2- 172.21.15.77:0/2138510265 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e680fb450 0x7f5e680fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:00.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.098+0000 7f5e6eb6f640 1 -- 172.21.15.77:0/2138510265 >> 172.21.15.77:0/2138510265 conn(0x7f5e680f6c30 msgr2=0x7f5e680f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:21:00.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.098+0000 7f5e6eb6f640 1 -- 172.21.15.77:0/2138510265 shutdown_connections 2024-09-18T21:21:00.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.098+0000 7f5e6eb6f640 1 -- 172.21.15.77:0/2138510265 wait complete. 2024-09-18T21:21:00.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.099+0000 7f5e6eb6f640 1 Processor -- start 2024-09-18T21:21:00.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.099+0000 7f5e6eb6f640 1 -- start start 2024-09-18T21:21:00.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.099+0000 7f5e6eb6f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e680fb450 0x7f5e6810f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:21:00.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.099+0000 7f5e6eb6f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e680fc720 0x7f5e6810f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:21:00.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.099+0000 7f5e6eb6f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6810fdf0 con 0x7f5e680fc720 2024-09-18T21:21:00.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.099+0000 7f5e6eb6f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e68110610 con 0x7f5e680fb450 2024-09-18T21:21:00.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.100+0000 7f5e67fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e680fc720 0x7f5e6810f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:21:00.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.100+0000 7f5e6c90b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e680fb450 0x7f5e6810f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:21:00.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.100+0000 7f5e6c90b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e680fb450 0x7f5e6810f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:52002/0 (socket says 172.21.15.77:52002) 2024-09-18T21:21:00.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.100+0000 7f5e6c90b640 1 -- 172.21.15.77:0/3202010530 learned_addr learned my addr 172.21.15.77:0/3202010530 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:21:00.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.100+0000 7f5e67fff640 1 --2- 172.21.15.77:0/3202010530 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e680fc720 0x7f5e6810f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46882/0 (socket says 172.21.15.77:46882) 2024-09-18T21:21:00.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.100+0000 7f5e6c90b640 1 -- 172.21.15.77:0/3202010530 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e680fc720 msgr2=0x7f5e6810f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:00.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.100+0000 7f5e6c90b640 1 --2- 172.21.15.77:0/3202010530 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e680fc720 0x7f5e6810f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:00.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.100+0000 7f5e6c90b640 1 -- 172.21.15.77:0/3202010530 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e54005040 con 0x7f5e680fb450 2024-09-18T21:21:00.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.100+0000 7f5e6c90b640 1 --2- 172.21.15.77:0/3202010530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e680fb450 0x7f5e6810f260 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c002a80 tx=0x7f5e5c004600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:21:00.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.100+0000 7f5e657fa640 1 -- 172.21.15.77:0/3202010530 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e5c007c30 con 0x7f5e680fb450 2024-09-18T21:21:00.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.100+0000 7f5e657fa640 1 -- 172.21.15.77:0/3202010530 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5e5c00f040 con 0x7f5e680fb450 2024-09-18T21:21:00.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.100+0000 7f5e6eb6f640 1 -- 172.21.15.77:0/3202010530 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e681108a0 con 0x7f5e680fb450 2024-09-18T21:21:00.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.100+0000 7f5e657fa640 1 -- 172.21.15.77:0/3202010530 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e5c00dab0 con 0x7f5e680fb450 2024-09-18T21:21:00.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.100+0000 7f5e6eb6f640 1 -- 172.21.15.77:0/3202010530 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e68110dc0 con 0x7f5e680fb450 2024-09-18T21:21:00.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.101+0000 7f5e6eb6f640 1 -- 172.21.15.77:0/3202010530 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e680fa8b0 con 0x7f5e680fb450 2024-09-18T21:21:00.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.102+0000 7f5e657fa640 1 -- 172.21.15.77:0/3202010530 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5e5c00dc10 con 0x7f5e680fb450 2024-09-18T21:21:00.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.102+0000 7f5e657fa640 1 --2- 172.21.15.77:0/3202010530 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f5e5806e0b0 0x7f5e58070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:21:00.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.102+0000 7f5e657fa640 1 -- 172.21.15.77:0/3202010530 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f5e5c08d520 con 0x7f5e680fb450 2024-09-18T21:21:00.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.102+0000 7f5e67fff640 1 --2- 172.21.15.77:0/3202010530 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f5e5806e0b0 0x7f5e58070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:21:00.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.103+0000 7f5e67fff640 1 --2- 172.21.15.77:0/3202010530 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f5e5806e0b0 0x7f5e58070560 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5e6810f010 tx=0x7f5e54035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:21:00.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.107+0000 7f5e657fa640 1 -- 172.21.15.77:0/3202010530 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f5e5c0567f0 con 0x7f5e680fb450 2024-09-18T21:21:00.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.299+0000 7f5e6eb6f640 1 -- 172.21.15.77:0/3202010530 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5e68110fe0 con 0x7f5e5806e0b0 2024-09-18T21:21:00.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.308+0000 7f5e657fa640 1 -- 172.21.15.77:0/3202010530 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f5e68110fe0 con 0x7f5e5806e0b0 2024-09-18T21:21:00.309 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T21:21:00.309 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager.smithi077 smithi077 *:9093,9094 running (7m) 8s ago 15m 24.1M - 0.25.0 c8568f914cd2 b201d325a55b 2024-09-18T21:21:00.309 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi077 smithi077 running (5m) 8s ago 15m 6891k - 19.1.1-17-g06b1b1de f79f744f586d 5872fa24b792 2024-09-18T21:21:00.309 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi103 smithi103 running (5m) 10s ago 15m 6887k - 19.1.1-17-g06b1b1de f79f744f586d cd1604469f34 2024-09-18T21:21:00.310 INFO:teuthology.orchestra.run.smithi077.stdout:grafana.smithi077 smithi077 *:3000 running (7m) 8s ago 15m 85.4M - 9.4.7 954c08fa6188 d06ef3ab9e66 2024-09-18T21:21:00.310 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.cqfhlw smithi077 running (69s) 8s ago 10m 13.3M - 19.1.1-17-g06b1b1de f79f744f586d c74ffc2ebb80 2024-09-18T21:21:00.310 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.vruydi smithi077 running (92s) 8s ago 10m 84.8M - 19.1.1-17-g06b1b1de f79f744f586d ce474ff0a948 2024-09-18T21:21:00.310 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi103.opftmf smithi103 running (27s) 10s ago 10m 13.1M - 19.1.1-17-g06b1b1de f79f744f586d 02c8e0b7ba0a 2024-09-18T21:21:00.310 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi103.zhdmdg smithi103 running (49s) 10s ago 10m 12.4M - 19.1.1-17-g06b1b1de f79f744f586d 84d9d5a98395 2024-09-18T21:21:00.310 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi077.utkpjg smithi077 *:8443,9283,8765 running (7m) 8s ago 16m 508M - 19.1.1-17-g06b1b1de f79f744f586d 99d4b0fd70f6 2024-09-18T21:21:00.310 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi103.zjztqc smithi103 *:8443,9283,8765 running (6m) 10s ago 14m 442M - 19.1.1-17-g06b1b1de f79f744f586d 54589547c4d7 2024-09-18T21:21:00.310 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi077 smithi077 running (6m) 8s ago 17m 51.7M 2048M 19.1.1-17-g06b1b1de f79f744f586d 2d0fbbea1264 2024-09-18T21:21:00.310 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi103 smithi103 running (5m) 10s ago 14m 39.5M 2048M 19.1.1-17-g06b1b1de f79f744f586d dc79edbd9602 2024-09-18T21:21:00.310 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi077 smithi077 *:9100 running (17s) 8s ago 15m 5767k - 1.5.0 0da6a335fe13 f880828c375d 2024-09-18T21:21:00.310 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi103 smithi103 *:9100 running (13s) 10s ago 15m 5473k - 1.5.0 0da6a335fe13 33e42737d4e1 2024-09-18T21:21:00.310 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (4m) 8s ago 14m 101M 1557M 19.1.1-17-g06b1b1de f79f744f586d 8855b4b16e00 2024-09-18T21:21:00.310 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi077 running (4m) 8s ago 13m 115M 1557M 19.1.1-17-g06b1b1de f79f744f586d 2d8bc9cac96c 2024-09-18T21:21:00.310 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi077 running (3m) 8s ago 13m 103M 1557M 19.1.1-17-g06b1b1de f79f744f586d 93876f1d398d 2024-09-18T21:21:00.310 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi103 running (3m) 10s ago 12m 121M 2581M 19.1.1-17-g06b1b1de f79f744f586d 2556b257bf1c 2024-09-18T21:21:00.311 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi103 running (2m) 10s ago 12m 99.2M 2581M 19.1.1-17-g06b1b1de f79f744f586d 2cde7eaf88d8 2024-09-18T21:21:00.311 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi103 running (117s) 10s ago 12m 100M 2581M 19.1.1-17-g06b1b1de f79f744f586d e6912ab63ecc 2024-09-18T21:21:00.311 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus.smithi077 smithi077 *:9095 running (6m) 8s ago 15m 65.6M - 2.43.0 a07b618ecd1d 41f3729e3400 2024-09-18T21:21:00.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.310+0000 7f5e6eb6f640 1 -- 172.21.15.77:0/3202010530 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f5e5806e0b0 msgr2=0x7f5e58070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:00.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.310+0000 7f5e6eb6f640 1 --2- 172.21.15.77:0/3202010530 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f5e5806e0b0 0x7f5e58070560 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5e6810f010 tx=0x7f5e54035040 comp rx=0 tx=0).stop 2024-09-18T21:21:00.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.310+0000 7f5e6eb6f640 1 -- 172.21.15.77:0/3202010530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e680fb450 msgr2=0x7f5e6810f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:00.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.310+0000 7f5e6eb6f640 1 --2- 172.21.15.77:0/3202010530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e680fb450 0x7f5e6810f260 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c002a80 tx=0x7f5e5c004600 comp rx=0 tx=0).stop 2024-09-18T21:21:00.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.310+0000 7f5e6eb6f640 1 -- 172.21.15.77:0/3202010530 shutdown_connections 2024-09-18T21:21:00.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.310+0000 7f5e6eb6f640 1 --2- 172.21.15.77:0/3202010530 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e680fc720 0x7f5e6810f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:00.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.310+0000 7f5e6eb6f640 1 --2- 172.21.15.77:0/3202010530 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f5e5806e0b0 0x7f5e58070560 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:00.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.310+0000 7f5e6eb6f640 1 --2- 172.21.15.77:0/3202010530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e680fb450 0x7f5e6810f260 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:00.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.310+0000 7f5e6eb6f640 1 -- 172.21.15.77:0/3202010530 >> 172.21.15.77:0/3202010530 conn(0x7f5e680f6c30 msgr2=0x7f5e68066160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:21:00.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.310+0000 7f5e6eb6f640 1 -- 172.21.15.77:0/3202010530 shutdown_connections 2024-09-18T21:21:00.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.310+0000 7f5e6eb6f640 1 -- 172.21.15.77:0/3202010530 wait complete. 2024-09-18T21:21:00.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.396+0000 7fc13e81f640 1 -- 172.21.15.77:0/327155281 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1380fd7f0 msgr2=0x7fc1380fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:00.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.396+0000 7fc13e81f640 1 --2- 172.21.15.77:0/327155281 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1380fd7f0 0x7fc1380fdc60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc1200048d0 tx=0x7fc120009da0 comp rx=0 tx=0).stop 2024-09-18T21:21:00.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.396+0000 7fc13e81f640 1 -- 172.21.15.77:0/327155281 shutdown_connections 2024-09-18T21:21:00.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.396+0000 7fc13e81f640 1 --2- 172.21.15.77:0/327155281 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1380fd7f0 0x7fc1380fdc60 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:00.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.396+0000 7fc13e81f640 1 --2- 172.21.15.77:0/327155281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1380fc520 0x7fc1380fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:00.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.396+0000 7fc13e81f640 1 -- 172.21.15.77:0/327155281 >> 172.21.15.77:0/327155281 conn(0x7fc1380f7ce0 msgr2=0x7fc1380fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:21:00.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.396+0000 7fc13e81f640 1 -- 172.21.15.77:0/327155281 shutdown_connections 2024-09-18T21:21:00.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.396+0000 7fc13e81f640 1 -- 172.21.15.77:0/327155281 wait complete. 2024-09-18T21:21:00.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.397+0000 7fc13e81f640 1 Processor -- start 2024-09-18T21:21:00.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.397+0000 7fc13e81f640 1 -- start start 2024-09-18T21:21:00.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.397+0000 7fc13e81f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1380fc520 0x7fc13810d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:21:00.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.397+0000 7fc13e81f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1380fd7f0 0x7fc13810d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:21:00.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.397+0000 7fc13e81f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc13810dbd0 con 0x7fc1380fc520 2024-09-18T21:21:00.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.397+0000 7fc13e81f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc13810e3f0 con 0x7fc1380fd7f0 2024-09-18T21:21:00.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.397+0000 7fc137fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1380fc520 0x7fc13810d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:21:00.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.397+0000 7fc137fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1380fc520 0x7fc13810d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46900/0 (socket says 172.21.15.77:46900) 2024-09-18T21:21:00.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.397+0000 7fc137fff640 1 -- 172.21.15.77:0/3874985236 learned_addr learned my addr 172.21.15.77:0/3874985236 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:21:00.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.397+0000 7fc12ffff640 1 --2- 172.21.15.77:0/3874985236 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1380fd7f0 0x7fc13810d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:21:00.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.397+0000 7fc137fff640 1 -- 172.21.15.77:0/3874985236 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1380fd7f0 msgr2=0x7fc13810d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:00.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.397+0000 7fc137fff640 1 --2- 172.21.15.77:0/3874985236 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1380fd7f0 0x7fc13810d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:00.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.397+0000 7fc137fff640 1 -- 172.21.15.77:0/3874985236 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc128005040 con 0x7fc1380fc520 2024-09-18T21:21:00.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.398+0000 7fc137fff640 1 --2- 172.21.15.77:0/3874985236 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1380fc520 0x7fc13810d040 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc128009700 tx=0x7fc128009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:21:00.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.398+0000 7fc1357fa640 1 -- 172.21.15.77:0/3874985236 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc12800e8b0 con 0x7fc1380fc520 2024-09-18T21:21:00.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.398+0000 7fc1357fa640 1 -- 172.21.15.77:0/3874985236 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc12800f040 con 0x7fc1380fc520 2024-09-18T21:21:00.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.398+0000 7fc1357fa640 1 -- 172.21.15.77:0/3874985236 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc128013d70 con 0x7fc1380fc520 2024-09-18T21:21:00.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.398+0000 7fc13e81f640 1 -- 172.21.15.77:0/3874985236 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc120005040 con 0x7fc1380fc520 2024-09-18T21:21:00.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.398+0000 7fc13e81f640 1 -- 172.21.15.77:0/3874985236 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc13810e970 con 0x7fc1380fc520 2024-09-18T21:21:00.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.399+0000 7fc13e81f640 1 -- 172.21.15.77:0/3874985236 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc138105740 con 0x7fc1380fc520 2024-09-18T21:21:00.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.400+0000 7fc1357fa640 1 -- 172.21.15.77:0/3874985236 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fc12800ea10 con 0x7fc1380fc520 2024-09-18T21:21:00.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.400+0000 7fc1357fa640 1 --2- 172.21.15.77:0/3874985236 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fc12406e0b0 0x7fc124070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:21:00.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.400+0000 7fc1357fa640 1 -- 172.21.15.77:0/3874985236 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fc12808da40 con 0x7fc1380fc520 2024-09-18T21:21:00.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.400+0000 7fc12ffff640 1 --2- 172.21.15.77:0/3874985236 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fc12406e0b0 0x7fc124070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:21:00.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.401+0000 7fc12ffff640 1 --2- 172.21.15.77:0/3874985236 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fc12406e0b0 0x7fc124070560 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc120007ac0 tx=0x7fc120035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:21:00.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.405+0000 7fc1357fa640 1 -- 172.21.15.77:0/3874985236 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fc128056d40 con 0x7fc1380fc520 2024-09-18T21:21:00.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.646+0000 7fc13e81f640 1 -- 172.21.15.77:0/3874985236 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc13804b7a0 con 0x7fc1380fc520 2024-09-18T21:21:00.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.646+0000 7fc1357fa640 1 -- 172.21.15.77:0/3874985236 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7fc13804b7a0 con 0x7fc1380fc520 2024-09-18T21:21:00.647 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-18T21:21:00.647 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": { 2024-09-18T21:21:00.648 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 2 2024-09-18T21:21:00.648 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:21:00.648 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": { 2024-09-18T21:21:00.648 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 2 2024-09-18T21:21:00.648 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:21:00.648 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": { 2024-09-18T21:21:00.648 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 6 2024-09-18T21:21:00.648 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:21:00.648 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-09-18T21:21:00.648 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 4 2024-09-18T21:21:00.648 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:21:00.648 INFO:teuthology.orchestra.run.smithi077.stdout: "overall": { 2024-09-18T21:21:00.648 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 14 2024-09-18T21:21:00.648 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-18T21:21:00.649 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-18T21:21:00.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.649+0000 7fc13e81f640 1 -- 172.21.15.77:0/3874985236 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fc12406e0b0 msgr2=0x7fc124070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:00.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.649+0000 7fc13e81f640 1 --2- 172.21.15.77:0/3874985236 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fc12406e0b0 0x7fc124070560 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc120007ac0 tx=0x7fc120035040 comp rx=0 tx=0).stop 2024-09-18T21:21:00.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.649+0000 7fc13e81f640 1 -- 172.21.15.77:0/3874985236 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1380fc520 msgr2=0x7fc13810d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:00.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.649+0000 7fc13e81f640 1 --2- 172.21.15.77:0/3874985236 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1380fc520 0x7fc13810d040 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc128009700 tx=0x7fc128009da0 comp rx=0 tx=0).stop 2024-09-18T21:21:00.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.649+0000 7fc13e81f640 1 -- 172.21.15.77:0/3874985236 shutdown_connections 2024-09-18T21:21:00.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.649+0000 7fc13e81f640 1 --2- 172.21.15.77:0/3874985236 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fc12406e0b0 0x7fc124070560 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:00.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.649+0000 7fc13e81f640 1 --2- 172.21.15.77:0/3874985236 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc1380fd7f0 0x7fc13810d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:00.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.649+0000 7fc13e81f640 1 --2- 172.21.15.77:0/3874985236 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1380fc520 0x7fc13810d040 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:00.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.649+0000 7fc13e81f640 1 -- 172.21.15.77:0/3874985236 >> 172.21.15.77:0/3874985236 conn(0x7fc1380f7ce0 msgr2=0x7fc1380f9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:21:00.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.649+0000 7fc13e81f640 1 -- 172.21.15.77:0/3874985236 shutdown_connections 2024-09-18T21:21:00.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.649+0000 7fc13e81f640 1 -- 172.21.15.77:0/3874985236 wait complete. 2024-09-18T21:21:00.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.727+0000 7fcee9f8f640 1 -- 172.21.15.77:0/3555110195 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcee40fdba0 msgr2=0x7fcee40fdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:00.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.727+0000 7fcee9f8f640 1 --2- 172.21.15.77:0/3555110195 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcee40fdba0 0x7fcee40fdfb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fced40048d0 tx=0x7fced4009da0 comp rx=0 tx=0).stop 2024-09-18T21:21:00.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.727+0000 7fcee9f8f640 1 -- 172.21.15.77:0/3555110195 shutdown_connections 2024-09-18T21:21:00.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.727+0000 7fcee9f8f640 1 --2- 172.21.15.77:0/3555110195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcee40fe4f0 0x7fcee40fa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:00.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.727+0000 7fcee9f8f640 1 --2- 172.21.15.77:0/3555110195 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcee40fdba0 0x7fcee40fdfb0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:00.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.727+0000 7fcee9f8f640 1 -- 172.21.15.77:0/3555110195 >> 172.21.15.77:0/3555110195 conn(0x7fcee40f63a0 msgr2=0x7fcee40f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:21:00.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.727+0000 7fcee9f8f640 1 -- 172.21.15.77:0/3555110195 shutdown_connections 2024-09-18T21:21:00.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.727+0000 7fcee9f8f640 1 -- 172.21.15.77:0/3555110195 wait complete. 2024-09-18T21:21:00.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.728+0000 7fcee9f8f640 1 Processor -- start 2024-09-18T21:21:00.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.728+0000 7fcee9f8f640 1 -- start start 2024-09-18T21:21:00.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.728+0000 7fcee9f8f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcee40fdba0 0x7fcee410d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:21:00.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.728+0000 7fcee9f8f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcee40fe4f0 0x7fcee410d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:21:00.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.728+0000 7fcee9f8f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee410dc70 con 0x7fcee40fdba0 2024-09-18T21:21:00.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.728+0000 7fcee9f8f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee410e490 con 0x7fcee40fe4f0 2024-09-18T21:21:00.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.728+0000 7fcee37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcee40fdba0 0x7fcee410d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:21:00.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.728+0000 7fcee37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcee40fdba0 0x7fcee410d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46922/0 (socket says 172.21.15.77:46922) 2024-09-18T21:21:00.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.728+0000 7fcee37fe640 1 -- 172.21.15.77:0/2811917498 learned_addr learned my addr 172.21.15.77:0/2811917498 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:21:00.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.728+0000 7fcee2ffd640 1 --2- 172.21.15.77:0/2811917498 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcee40fe4f0 0x7fcee410d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:21:00.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.729+0000 7fcee37fe640 1 -- 172.21.15.77:0/2811917498 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcee40fe4f0 msgr2=0x7fcee410d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:00.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.729+0000 7fcee37fe640 1 --2- 172.21.15.77:0/2811917498 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcee40fe4f0 0x7fcee410d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:00.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.729+0000 7fcee37fe640 1 -- 172.21.15.77:0/2811917498 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced4005040 con 0x7fcee40fdba0 2024-09-18T21:21:00.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.729+0000 7fcee37fe640 1 --2- 172.21.15.77:0/2811917498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcee40fdba0 0x7fcee410d0e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fced40043d0 tx=0x7fced4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:21:00.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.729+0000 7fcecbfff640 1 -- 172.21.15.77:0/2811917498 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fced4038070 con 0x7fcee40fdba0 2024-09-18T21:21:00.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.729+0000 7fcecbfff640 1 -- 172.21.15.77:0/2811917498 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fced402ae90 con 0x7fcee40fdba0 2024-09-18T21:21:00.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.729+0000 7fcee9f8f640 1 -- 172.21.15.77:0/2811917498 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcee410e6c0 con 0x7fcee40fdba0 2024-09-18T21:21:00.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.729+0000 7fcecbfff640 1 -- 172.21.15.77:0/2811917498 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fced403e670 con 0x7fcee40fdba0 2024-09-18T21:21:00.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.729+0000 7fcee9f8f640 1 -- 172.21.15.77:0/2811917498 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcee410ec60 con 0x7fcee40fdba0 2024-09-18T21:21:00.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.730+0000 7fcee9f8f640 1 -- 172.21.15.77:0/2811917498 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcee40fa040 con 0x7fcee40fdba0 2024-09-18T21:21:00.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.731+0000 7fcecbfff640 1 -- 172.21.15.77:0/2811917498 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fced4030020 con 0x7fcee40fdba0 2024-09-18T21:21:00.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.731+0000 7fcecbfff640 1 --2- 172.21.15.77:0/2811917498 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fcecc06e0b0 0x7fcecc070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:21:00.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.731+0000 7fcecbfff640 1 -- 172.21.15.77:0/2811917498 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fced40ade00 con 0x7fcee40fdba0 2024-09-18T21:21:00.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.731+0000 7fcee2ffd640 1 --2- 172.21.15.77:0/2811917498 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fcecc06e0b0 0x7fcecc070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:21:00.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.732+0000 7fcee2ffd640 1 --2- 172.21.15.77:0/2811917498 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fcecc06e0b0 0x7fcecc070560 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcee410ce90 tx=0x7fced800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:21:00.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.735+0000 7fcecbfff640 1 -- 172.21.15.77:0/2811917498 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fced4077130 con 0x7fcee40fdba0 2024-09-18T21:21:00.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.944+0000 7fcee9f8f640 1 -- 172.21.15.77:0/2811917498 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcee410ef40 con 0x7fcee40fdba0 2024-09-18T21:21:00.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.944+0000 7fcecbfff640 1 -- 172.21.15.77:0/2811917498 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 36 v36) v1 ==== 76+0+1978 (secure 0 0 0) 0x7fced407a7f0 con 0x7fcee40fdba0 2024-09-18T21:21:00.946 INFO:teuthology.orchestra.run.smithi077.stdout:e36 2024-09-18T21:21:00.946 INFO:teuthology.orchestra.run.smithi077.stdout:btime 2024-09-18T21:20:34:069185+0000 2024-09-18T21:21:00.946 INFO:teuthology.orchestra.run.smithi077.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T21:21:00.946 INFO:teuthology.orchestra.run.smithi077.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T21:21:00.946 INFO:teuthology.orchestra.run.smithi077.stdout:legacy client fscid: 1 2024-09-18T21:21:00.946 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:21:00.946 INFO:teuthology.orchestra.run.smithi077.stdout:Filesystem 'cephfs' (1) 2024-09-18T21:21:00.946 INFO:teuthology.orchestra.run.smithi077.stdout:fs_name cephfs 2024-09-18T21:21:00.946 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 35 2024-09-18T21:21:00.946 INFO:teuthology.orchestra.run.smithi077.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T21:21:00.946 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-09-18T21:10:17.230179+0000 2024-09-18T21:21:00.946 INFO:teuthology.orchestra.run.smithi077.stdout:modified 2024-09-18T21:20:33.060016+0000 2024-09-18T21:21:00.947 INFO:teuthology.orchestra.run.smithi077.stdout:tableserver 0 2024-09-18T21:21:00.947 INFO:teuthology.orchestra.run.smithi077.stdout:root 0 2024-09-18T21:21:00.947 INFO:teuthology.orchestra.run.smithi077.stdout:session_timeout 60 2024-09-18T21:21:00.947 INFO:teuthology.orchestra.run.smithi077.stdout:session_autoclose 300 2024-09-18T21:21:00.947 INFO:teuthology.orchestra.run.smithi077.stdout:max_file_size 1099511627776 2024-09-18T21:21:00.947 INFO:teuthology.orchestra.run.smithi077.stdout:max_xattr_size 65536 2024-09-18T21:21:00.947 INFO:teuthology.orchestra.run.smithi077.stdout:required_client_features {} 2024-09-18T21:21:00.947 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure 0 2024-09-18T21:21:00.947 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure_osd_epoch 80 2024-09-18T21:21:00.947 INFO:teuthology.orchestra.run.smithi077.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T21:21:00.948 INFO:teuthology.orchestra.run.smithi077.stdout:max_mds 1 2024-09-18T21:21:00.948 INFO:teuthology.orchestra.run.smithi077.stdout:in 0 2024-09-18T21:21:00.948 INFO:teuthology.orchestra.run.smithi077.stdout:up {0=34400} 2024-09-18T21:21:00.948 INFO:teuthology.orchestra.run.smithi077.stdout:failed 2024-09-18T21:21:00.948 INFO:teuthology.orchestra.run.smithi077.stdout:damaged 2024-09-18T21:21:00.948 INFO:teuthology.orchestra.run.smithi077.stdout:stopped 2024-09-18T21:21:00.948 INFO:teuthology.orchestra.run.smithi077.stdout:data_pools [3] 2024-09-18T21:21:00.948 INFO:teuthology.orchestra.run.smithi077.stdout:metadata_pool 2 2024-09-18T21:21:00.948 INFO:teuthology.orchestra.run.smithi077.stdout:inline_data disabled 2024-09-18T21:21:00.948 INFO:teuthology.orchestra.run.smithi077.stdout:balancer 2024-09-18T21:21:00.949 INFO:teuthology.orchestra.run.smithi077.stdout:bal_rank_mask -1 2024-09-18T21:21:00.949 INFO:teuthology.orchestra.run.smithi077.stdout:standby_count_wanted 1 2024-09-18T21:21:00.949 INFO:teuthology.orchestra.run.smithi077.stdout:qdb_cluster leader: 34400 members: 34400 2024-09-18T21:21:00.949 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.vruydi{0:34400} state up:active seq 19 join_fscid=1 addr [v2:172.21.15.77:6826/1087320436,v1:172.21.15.77:6827/1087320436] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T21:21:00.949 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:21:00.949 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:21:00.949 INFO:teuthology.orchestra.run.smithi077.stdout:Standby daemons: 2024-09-18T21:21:00.949 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:21:00.949 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.cqfhlw{-1:34404} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.77:6828/1489733233,v1:172.21.15.77:6829/1489733233] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T21:21:00.949 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi103.zhdmdg{-1:44287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.103:6824/3296796313,v1:172.21.15.103:6825/3296796313] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T21:21:00.949 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi103.opftmf{-1:44307} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.103:6826/3688450345,v1:172.21.15.103:6827/3688450345] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T21:21:00.950 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 36 2024-09-18T21:21:00.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.946+0000 7fcee9f8f640 1 -- 172.21.15.77:0/2811917498 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fcecc06e0b0 msgr2=0x7fcecc070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:00.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.946+0000 7fcee9f8f640 1 --2- 172.21.15.77:0/2811917498 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fcecc06e0b0 0x7fcecc070560 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcee410ce90 tx=0x7fced800b040 comp rx=0 tx=0).stop 2024-09-18T21:21:00.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.946+0000 7fcee9f8f640 1 -- 172.21.15.77:0/2811917498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcee40fdba0 msgr2=0x7fcee410d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:00.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.946+0000 7fcee9f8f640 1 --2- 172.21.15.77:0/2811917498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcee40fdba0 0x7fcee410d0e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fced40043d0 tx=0x7fced4009da0 comp rx=0 tx=0).stop 2024-09-18T21:21:00.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.946+0000 7fcee9f8f640 1 -- 172.21.15.77:0/2811917498 shutdown_connections 2024-09-18T21:21:00.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.946+0000 7fcee9f8f640 1 --2- 172.21.15.77:0/2811917498 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fcecc06e0b0 0x7fcecc070560 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:00.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.946+0000 7fcee9f8f640 1 --2- 172.21.15.77:0/2811917498 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcee40fe4f0 0x7fcee410d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:00.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.946+0000 7fcee9f8f640 1 --2- 172.21.15.77:0/2811917498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcee40fdba0 0x7fcee410d0e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:00.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.946+0000 7fcee9f8f640 1 -- 172.21.15.77:0/2811917498 >> 172.21.15.77:0/2811917498 conn(0x7fcee40f63a0 msgr2=0x7fcee40f7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:21:00.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.947+0000 7fcee9f8f640 1 -- 172.21.15.77:0/2811917498 shutdown_connections 2024-09-18T21:21:00.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:00.947+0000 7fcee9f8f640 1 -- 172.21.15.77:0/2811917498 wait complete. 2024-09-18T21:21:01.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.026+0000 7f6e72451640 1 -- 172.21.15.77:0/2431778214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e6c0666b0 msgr2=0x7f6e6c0ff1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:01.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.026+0000 7f6e72451640 1 --2- 172.21.15.77:0/2431778214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e6c0666b0 0x7f6e6c0ff1e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c0048d0 tx=0x7f6e5c009da0 comp rx=0 tx=0).stop 2024-09-18T21:21:01.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.026+0000 7f6e72451640 1 -- 172.21.15.77:0/2431778214 shutdown_connections 2024-09-18T21:21:01.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.026+0000 7f6e72451640 1 --2- 172.21.15.77:0/2431778214 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e6c0ff720 0x7f6e6c101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:01.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.026+0000 7f6e72451640 1 --2- 172.21.15.77:0/2431778214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e6c0666b0 0x7f6e6c0ff1e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:01.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.026+0000 7f6e72451640 1 -- 172.21.15.77:0/2431778214 >> 172.21.15.77:0/2431778214 conn(0x7f6e6c0f6c10 msgr2=0x7f6e6c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:21:01.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.026+0000 7f6e72451640 1 -- 172.21.15.77:0/2431778214 shutdown_connections 2024-09-18T21:21:01.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.026+0000 7f6e72451640 1 -- 172.21.15.77:0/2431778214 wait complete. 2024-09-18T21:21:01.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.026+0000 7f6e72451640 1 Processor -- start 2024-09-18T21:21:01.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.026+0000 7f6e72451640 1 -- start start 2024-09-18T21:21:01.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.027+0000 7f6e72451640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e6c0666b0 0x7f6e6c10d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:21:01.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.027+0000 7f6e72451640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e6c0ff720 0x7f6e6c10d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:21:01.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.027+0000 7f6e72451640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6c10dcd0 con 0x7f6e6c0666b0 2024-09-18T21:21:01.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.027+0000 7f6e72451640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6c10e4a0 con 0x7f6e6c0ff720 2024-09-18T21:21:01.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.027+0000 7f6e6bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e6c0666b0 0x7f6e6c10d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:21:01.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.027+0000 7f6e6bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e6c0666b0 0x7f6e6c10d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46942/0 (socket says 172.21.15.77:46942) 2024-09-18T21:21:01.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.027+0000 7f6e6bfff640 1 -- 172.21.15.77:0/827042810 learned_addr learned my addr 172.21.15.77:0/827042810 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:21:01.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.027+0000 7f6e6b7fe640 1 --2- 172.21.15.77:0/827042810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e6c0ff720 0x7f6e6c10d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:21:01.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.027+0000 7f6e6bfff640 1 -- 172.21.15.77:0/827042810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e6c0ff720 msgr2=0x7f6e6c10d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:01.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.027+0000 7f6e6bfff640 1 --2- 172.21.15.77:0/827042810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e6c0ff720 0x7f6e6c10d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:01.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.027+0000 7f6e6bfff640 1 -- 172.21.15.77:0/827042810 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e5c005040 con 0x7f6e6c0666b0 2024-09-18T21:21:01.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.027+0000 7f6e6bfff640 1 --2- 172.21.15.77:0/827042810 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e6c0666b0 0x7f6e6c10d140 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c0043d0 tx=0x7f6e5c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:21:01.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.027+0000 7f6e68ff9640 1 -- 172.21.15.77:0/827042810 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e5c038070 con 0x7f6e6c0666b0 2024-09-18T21:21:01.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.027+0000 7f6e68ff9640 1 -- 172.21.15.77:0/827042810 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6e5c02ae90 con 0x7f6e6c0666b0 2024-09-18T21:21:01.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.027+0000 7f6e72451640 1 -- 172.21.15.77:0/827042810 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e6c10e6d0 con 0x7f6e6c0666b0 2024-09-18T21:21:01.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.027+0000 7f6e68ff9640 1 -- 172.21.15.77:0/827042810 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e5c03e670 con 0x7f6e6c0666b0 2024-09-18T21:21:01.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.027+0000 7f6e72451640 1 -- 172.21.15.77:0/827042810 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e6c10ebf0 con 0x7f6e6c0666b0 2024-09-18T21:21:01.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.028+0000 7f6e72451640 1 -- 172.21.15.77:0/827042810 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e6c0fa8b0 con 0x7f6e6c0666b0 2024-09-18T21:21:01.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.029+0000 7f6e68ff9640 1 -- 172.21.15.77:0/827042810 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f6e5c030020 con 0x7f6e6c0666b0 2024-09-18T21:21:01.032 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.029+0000 7f6e68ff9640 1 --2- 172.21.15.77:0/827042810 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f6e5806e0b0 0x7f6e58070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:21:01.032 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.029+0000 7f6e68ff9640 1 -- 172.21.15.77:0/827042810 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f6e5c0add60 con 0x7f6e6c0666b0 2024-09-18T21:21:01.032 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.029+0000 7f6e6b7fe640 1 --2- 172.21.15.77:0/827042810 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f6e5806e0b0 0x7f6e58070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:21:01.032 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.030+0000 7f6e6b7fe640 1 --2- 172.21.15.77:0/827042810 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f6e5806e0b0 0x7f6e58070560 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c10cef0 tx=0x7f6e5400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:21:01.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.034+0000 7f6e68ff9640 1 -- 172.21.15.77:0/827042810 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f6e5c077090 con 0x7f6e6c0666b0 2024-09-18T21:21:01.164 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:00 smithi077 ceph-mon[92672]: from='client.34466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:21:01.164 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:00 smithi077 ceph-mon[92672]: pgmap v214: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:01.164 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:00 smithi077 ceph-mon[92672]: from='client.34470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:21:01.164 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:00 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/3874985236' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:01.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.233+0000 7f6e72451640 1 -- 172.21.15.77:0/827042810 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e6c10efd0 con 0x7f6e5806e0b0 2024-09-18T21:21:01.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.234+0000 7f6e68ff9640 1 -- 172.21.15.77:0/827042810 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+438 (secure 0 0 0) 0x7f6e6c10efd0 con 0x7f6e5806e0b0 2024-09-18T21:21:01.235 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-18T21:21:01.235 INFO:teuthology.orchestra.run.smithi077.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a", 2024-09-18T21:21:01.235 INFO:teuthology.orchestra.run.smithi077.stdout: "in_progress": true, 2024-09-18T21:21:01.236 INFO:teuthology.orchestra.run.smithi077.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T21:21:01.236 INFO:teuthology.orchestra.run.smithi077.stdout: "services_complete": [ 2024-09-18T21:21:01.236 INFO:teuthology.orchestra.run.smithi077.stdout: "mon", 2024-09-18T21:21:01.236 INFO:teuthology.orchestra.run.smithi077.stdout: "crash", 2024-09-18T21:21:01.236 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr", 2024-09-18T21:21:01.236 INFO:teuthology.orchestra.run.smithi077.stdout: "osd", 2024-09-18T21:21:01.236 INFO:teuthology.orchestra.run.smithi077.stdout: "mds" 2024-09-18T21:21:01.236 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-18T21:21:01.236 INFO:teuthology.orchestra.run.smithi077.stdout: "progress": "16/21 daemons upgraded", 2024-09-18T21:21:01.236 INFO:teuthology.orchestra.run.smithi077.stdout: "message": "Currently upgrading prometheus daemons", 2024-09-18T21:21:01.236 INFO:teuthology.orchestra.run.smithi077.stdout: "is_paused": false 2024-09-18T21:21:01.236 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-18T21:21:01.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.237+0000 7f6e72451640 1 -- 172.21.15.77:0/827042810 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f6e5806e0b0 msgr2=0x7f6e58070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:01.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.237+0000 7f6e72451640 1 --2- 172.21.15.77:0/827042810 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f6e5806e0b0 0x7f6e58070560 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c10cef0 tx=0x7f6e5400b040 comp rx=0 tx=0).stop 2024-09-18T21:21:01.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.237+0000 7f6e72451640 1 -- 172.21.15.77:0/827042810 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e6c0666b0 msgr2=0x7f6e6c10d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:01.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.237+0000 7f6e72451640 1 --2- 172.21.15.77:0/827042810 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e6c0666b0 0x7f6e6c10d140 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c0043d0 tx=0x7f6e5c009da0 comp rx=0 tx=0).stop 2024-09-18T21:21:01.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.237+0000 7f6e72451640 1 -- 172.21.15.77:0/827042810 shutdown_connections 2024-09-18T21:21:01.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.237+0000 7f6e72451640 1 --2- 172.21.15.77:0/827042810 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f6e5806e0b0 0x7f6e58070560 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:01.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.237+0000 7f6e72451640 1 --2- 172.21.15.77:0/827042810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e6c0ff720 0x7f6e6c10d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:01.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.237+0000 7f6e72451640 1 --2- 172.21.15.77:0/827042810 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6e6c0666b0 0x7f6e6c10d140 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:01.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.237+0000 7f6e72451640 1 -- 172.21.15.77:0/827042810 >> 172.21.15.77:0/827042810 conn(0x7f6e6c0f6c10 msgr2=0x7f6e6c0f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:21:01.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.237+0000 7f6e72451640 1 -- 172.21.15.77:0/827042810 shutdown_connections 2024-09-18T21:21:01.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.237+0000 7f6e72451640 1 -- 172.21.15.77:0/827042810 wait complete. 2024-09-18T21:21:01.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:00 smithi103 ceph-mon[80307]: from='client.34466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:21:01.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:00 smithi103 ceph-mon[80307]: pgmap v214: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:01.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:00 smithi103 ceph-mon[80307]: from='client.34470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:21:01.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:00 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/3874985236' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:01.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.317+0000 7fc454c43640 1 -- 172.21.15.77:0/1736440317 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4500666d0 msgr2=0x7fc4501015c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:01.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.317+0000 7fc454c43640 1 --2- 172.21.15.77:0/1736440317 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4500666d0 0x7fc4501015c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc4380048d0 tx=0x7fc438009da0 comp rx=0 tx=0).stop 2024-09-18T21:21:01.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.317+0000 7fc454c43640 1 -- 172.21.15.77:0/1736440317 shutdown_connections 2024-09-18T21:21:01.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.317+0000 7fc454c43640 1 --2- 172.21.15.77:0/1736440317 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc450101b00 0x7fc450103ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:01.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.317+0000 7fc454c43640 1 --2- 172.21.15.77:0/1736440317 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4500666d0 0x7fc4501015c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:01.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.317+0000 7fc454c43640 1 -- 172.21.15.77:0/1736440317 >> 172.21.15.77:0/1736440317 conn(0x7fc4500f6c10 msgr2=0x7fc4500f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:21:01.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.317+0000 7fc454c43640 1 -- 172.21.15.77:0/1736440317 shutdown_connections 2024-09-18T21:21:01.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.317+0000 7fc454c43640 1 -- 172.21.15.77:0/1736440317 wait complete. 2024-09-18T21:21:01.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.317+0000 7fc454c43640 1 Processor -- start 2024-09-18T21:21:01.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.317+0000 7fc454c43640 1 -- start start 2024-09-18T21:21:01.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.317+0000 7fc454c43640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4500666d0 0x7fc45010f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:21:01.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.317+0000 7fc454c43640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc450101b00 0x7fc45010f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:21:01.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.317+0000 7fc454c43640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc45010fe70 con 0x7fc450101b00 2024-09-18T21:21:01.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.317+0000 7fc454c43640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc450110690 con 0x7fc4500666d0 2024-09-18T21:21:01.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.318+0000 7fc44dd9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc450101b00 0x7fc45010f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:21:01.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.318+0000 7fc44dd9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc450101b00 0x7fc45010f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46970/0 (socket says 172.21.15.77:46970) 2024-09-18T21:21:01.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.318+0000 7fc44dd9b640 1 -- 172.21.15.77:0/1906046560 learned_addr learned my addr 172.21.15.77:0/1906046560 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:21:01.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.318+0000 7fc44e59c640 1 --2- 172.21.15.77:0/1906046560 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4500666d0 0x7fc45010f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:21:01.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.318+0000 7fc44dd9b640 1 -- 172.21.15.77:0/1906046560 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4500666d0 msgr2=0x7fc45010f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:01.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.318+0000 7fc44dd9b640 1 --2- 172.21.15.77:0/1906046560 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4500666d0 0x7fc45010f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:01.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.318+0000 7fc44dd9b640 1 -- 172.21.15.77:0/1906046560 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc438005040 con 0x7fc450101b00 2024-09-18T21:21:01.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.318+0000 7fc44e59c640 1 --2- 172.21.15.77:0/1906046560 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4500666d0 0x7fc45010f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T21:21:01.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.318+0000 7fc44dd9b640 1 --2- 172.21.15.77:0/1906046560 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc450101b00 0x7fc45010f820 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc440002a80 tx=0x7fc440004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:21:01.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.318+0000 7fc446ffd640 1 -- 172.21.15.77:0/1906046560 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc440007c30 con 0x7fc450101b00 2024-09-18T21:21:01.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.318+0000 7fc446ffd640 1 -- 172.21.15.77:0/1906046560 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc44000f040 con 0x7fc450101b00 2024-09-18T21:21:01.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.318+0000 7fc454c43640 1 -- 172.21.15.77:0/1906046560 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc450110920 con 0x7fc450101b00 2024-09-18T21:21:01.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.318+0000 7fc446ffd640 1 -- 172.21.15.77:0/1906046560 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc440009530 con 0x7fc450101b00 2024-09-18T21:21:01.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.318+0000 7fc454c43640 1 -- 172.21.15.77:0/1906046560 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc450110e40 con 0x7fc450101b00 2024-09-18T21:21:01.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.319+0000 7fc454c43640 1 -- 172.21.15.77:0/1906046560 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4500fa8b0 con 0x7fc450101b00 2024-09-18T21:21:01.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.320+0000 7fc446ffd640 1 -- 172.21.15.77:0/1906046560 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fc4400096b0 con 0x7fc450101b00 2024-09-18T21:21:01.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.320+0000 7fc446ffd640 1 --2- 172.21.15.77:0/1906046560 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fc43c06e0b0 0x7fc43c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:21:01.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.320+0000 7fc446ffd640 1 -- 172.21.15.77:0/1906046560 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fc44008d570 con 0x7fc450101b00 2024-09-18T21:21:01.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.321+0000 7fc44e59c640 1 --2- 172.21.15.77:0/1906046560 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fc43c06e0b0 0x7fc43c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:21:01.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.321+0000 7fc44e59c640 1 --2- 172.21.15.77:0/1906046560 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fc43c06e0b0 0x7fc43c070560 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc4380048a0 tx=0x7fc438009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:21:01.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.325+0000 7fc446ffd640 1 -- 172.21.15.77:0/1906046560 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fc440056870 con 0x7fc450101b00 2024-09-18T21:21:01.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.574+0000 7fc454c43640 1 -- 172.21.15.77:0/1906046560 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc45004b720 con 0x7fc450101b00 2024-09-18T21:21:01.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.575+0000 7fc446ffd640 1 -- 172.21.15.77:0/1906046560 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fc440059f30 con 0x7fc450101b00 2024-09-18T21:21:01.576 INFO:teuthology.orchestra.run.smithi077.stdout:HEALTH_OK 2024-09-18T21:21:01.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.578+0000 7fc454c43640 1 -- 172.21.15.77:0/1906046560 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fc43c06e0b0 msgr2=0x7fc43c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:01.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.578+0000 7fc454c43640 1 --2- 172.21.15.77:0/1906046560 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fc43c06e0b0 0x7fc43c070560 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc4380048a0 tx=0x7fc438009da0 comp rx=0 tx=0).stop 2024-09-18T21:21:01.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.578+0000 7fc454c43640 1 -- 172.21.15.77:0/1906046560 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc450101b00 msgr2=0x7fc45010f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:01.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.578+0000 7fc454c43640 1 --2- 172.21.15.77:0/1906046560 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc450101b00 0x7fc45010f820 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc440002a80 tx=0x7fc440004600 comp rx=0 tx=0).stop 2024-09-18T21:21:01.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.578+0000 7fc454c43640 1 -- 172.21.15.77:0/1906046560 shutdown_connections 2024-09-18T21:21:01.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.578+0000 7fc454c43640 1 --2- 172.21.15.77:0/1906046560 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc450101b00 0x7fc45010f820 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:01.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.578+0000 7fc454c43640 1 --2- 172.21.15.77:0/1906046560 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fc43c06e0b0 0x7fc43c070560 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:01.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.578+0000 7fc454c43640 1 --2- 172.21.15.77:0/1906046560 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4500666d0 0x7fc45010f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:01.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.578+0000 7fc454c43640 1 -- 172.21.15.77:0/1906046560 >> 172.21.15.77:0/1906046560 conn(0x7fc4500f6c10 msgr2=0x7fc4500f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:21:01.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.578+0000 7fc454c43640 1 -- 172.21.15.77:0/1906046560 shutdown_connections 2024-09-18T21:21:01.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:01.578+0000 7fc454c43640 1 -- 172.21.15.77:0/1906046560 wait complete. 2024-09-18T21:21:02.183 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:01 smithi077 ceph-mon[92672]: from='client.44319 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:21:02.183 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:01 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/2811917498' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T21:21:02.183 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:01 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/1906046560' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T21:21:02.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:01 smithi103 ceph-mon[80307]: from='client.44319 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:21:02.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:01 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/2811917498' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T21:21:02.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:01 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/1906046560' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T21:21:03.180 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:02 smithi077 ceph-mon[92672]: from='client.34486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:21:03.180 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:02 smithi077 ceph-mon[92672]: pgmap v215: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:03.180 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:02 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:03.180 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:02 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:03.180 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:02 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:21:03.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:02 smithi103 ceph-mon[80307]: from='client.34486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:21:03.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:02 smithi103 ceph-mon[80307]: pgmap v215: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:03.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:02 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:03.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:02 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:03.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:02 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:21:05.198 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:04 smithi077 ceph-mon[92672]: pgmap v216: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:05.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:04 smithi103 ceph-mon[80307]: pgmap v216: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:06.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:05 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:21:06.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:05 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:21:07.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:06 smithi077 ceph-mon[92672]: pgmap v217: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:07.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:06 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:07.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:06 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:07.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:06 smithi103 ceph-mon[80307]: pgmap v217: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:07.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:06 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:07.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:06 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:08.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:08 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:08.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:08 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:08.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:08 smithi077 ceph-mon[92672]: pgmap v218: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:08.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:08 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:08.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:08 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:08.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:08 smithi103 ceph-mon[80307]: pgmap v218: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:11.184 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:10 smithi077 ceph-mon[92672]: pgmap v219: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:11.184 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:10 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:11.184 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:10 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:11.184 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:10 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:21:11.184 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:10 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:21:11.184 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:10 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:11.184 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:10 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T21:21:11.184 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:10 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:21:11.185 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:10 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:11.185 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:10 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:11.185 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:10 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:11.185 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:10 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:11.185 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:10 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:11.185 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:10 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:11.185 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:10 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:11.185 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:10 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:11.185 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:10 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:11.185 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:10 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:11.185 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:10 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:11.185 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:10 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:11.185 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:10 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:11.186 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:10 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:11.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:10 smithi103 ceph-mon[80307]: pgmap v219: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:11.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:10 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:11.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:10 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:11.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:10 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:21:11.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:10 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:21:11.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:10 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:11.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:10 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T21:21:11.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:10 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:21:11.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:10 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:11.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:10 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:11.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:10 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:11.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:10 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:11.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:10 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:11.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:10 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:11.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:10 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:11.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:10 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:11.266 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:10 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:11.266 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:10 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:11.266 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:10 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:11.266 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:10 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:11.266 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:10 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:11.266 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:10 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:12.187 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:11 smithi077 ceph-mon[92672]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T21:21:12.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:11 smithi103 ceph-mon[80307]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-18T21:21:13.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:12 smithi077 ceph-mon[92672]: pgmap v220: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:13.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:12 smithi103 ceph-mon[80307]: pgmap v220: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:14.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:13 smithi077 ceph-mon[92672]: Upgrade: Updating alertmanager.smithi077 2024-09-18T21:21:14.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:13 smithi077 ceph-mon[92672]: Deploying daemon alertmanager.smithi077 on smithi077 2024-09-18T21:21:14.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:13 smithi103 ceph-mon[80307]: Upgrade: Updating alertmanager.smithi077 2024-09-18T21:21:14.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:13 smithi103 ceph-mon[80307]: Deploying daemon alertmanager.smithi077 on smithi077 2024-09-18T21:21:15.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:14 smithi077 ceph-mon[92672]: pgmap v221: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:15.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:14 smithi103 ceph-mon[80307]: pgmap v221: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:17.152 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:16 smithi077 ceph-mon[92672]: pgmap v222: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:17.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:16 smithi103 ceph-mon[80307]: pgmap v222: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:19.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:18 smithi077 ceph-mon[92672]: pgmap v223: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:19.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:18 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:19.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:18 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:19.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:18 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:21:19.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:18 smithi103 ceph-mon[80307]: pgmap v223: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:19.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:18 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:19.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:18 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:19.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:18 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:21:21.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:20 smithi077 ceph-mon[92672]: pgmap v224: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:21.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:20 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:21:21.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:20 smithi103 ceph-mon[80307]: pgmap v224: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:21.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:20 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:21:23.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:22 smithi077 ceph-mon[92672]: pgmap v225: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:23.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:22 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:23.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:22 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:23.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:22 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:23.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:22 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:23.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:22 smithi103 ceph-mon[80307]: pgmap v225: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:23.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:22 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:23.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:22 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:23.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:22 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:23.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:22 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:25.194 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:24 smithi077 ceph-mon[92672]: pgmap v226: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:25.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:24 smithi103 ceph-mon[80307]: pgmap v226: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:26.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:26 smithi077 ceph-mon[92672]: pgmap v227: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:26.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:26 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:26.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:26 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:26.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:26 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:21:26.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:26 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:21:26.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:26 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:26.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:26 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-18T21:21:26.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:26 smithi077 ceph-mon[92672]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-18T21:21:26.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:26 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:21:26.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:26 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:26.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:26 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:26.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:26 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:26.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:26 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:26.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:26 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:26.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:26 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:26.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:26 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:26.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:26 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:26.964 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:26 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:26.965 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:26 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:26.965 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:26 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:26.965 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:26 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:26.965 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:26 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:26.965 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:26 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:26.965 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:26 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:27.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:26 smithi103 ceph-mon[80307]: pgmap v227: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:27.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:26 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:27.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:26 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:27.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:26 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:21:27.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:26 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:21:27.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:26 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:27.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:26 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-18T21:21:27.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:26 smithi103 ceph-mon[80307]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-18T21:21:27.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:26 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:21:27.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:26 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:27.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:26 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:27.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:26 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:27.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:26 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:27.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:26 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:27.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:26 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:27.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:26 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:27.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:26 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:27.265 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:26 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:27.266 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:26 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:27.266 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:26 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:27.266 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:26 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:27.266 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:26 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:27.266 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:26 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:27.266 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:26 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:29.211 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:28 smithi077 ceph-mon[92672]: Upgrade: Updating grafana.smithi077 2024-09-18T21:21:29.211 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:28 smithi077 ceph-mon[92672]: Deploying daemon grafana.smithi077 on smithi077 2024-09-18T21:21:29.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:28 smithi077 ceph-mon[92672]: pgmap v228: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:29.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:28 smithi103 ceph-mon[80307]: Upgrade: Updating grafana.smithi077 2024-09-18T21:21:29.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:28 smithi103 ceph-mon[80307]: Deploying daemon grafana.smithi077 on smithi077 2024-09-18T21:21:29.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:28 smithi103 ceph-mon[80307]: pgmap v228: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:31.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:30 smithi077 ceph-mon[92672]: pgmap v229: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:31.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:30 smithi103 ceph-mon[80307]: pgmap v229: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:31.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.661+0000 7f0e4f6bc640 1 -- 172.21.15.77:0/2339020063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e480fdba0 msgr2=0x7f0e480fdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:31.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.661+0000 7f0e4f6bc640 1 --2- 172.21.15.77:0/2339020063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e480fdba0 0x7f0e480fdfb0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0e440048d0 tx=0x7f0e44009da0 comp rx=0 tx=0).stop 2024-09-18T21:21:31.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.661+0000 7f0e4f6bc640 1 -- 172.21.15.77:0/2339020063 shutdown_connections 2024-09-18T21:21:31.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.661+0000 7f0e4f6bc640 1 --2- 172.21.15.77:0/2339020063 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e480fe4f0 0x7f0e480fa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:31.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.661+0000 7f0e4f6bc640 1 --2- 172.21.15.77:0/2339020063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e480fdba0 0x7f0e480fdfb0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:31.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.661+0000 7f0e4f6bc640 1 -- 172.21.15.77:0/2339020063 >> 172.21.15.77:0/2339020063 conn(0x7f0e480f63a0 msgr2=0x7f0e480f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:21:31.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.661+0000 7f0e4f6bc640 1 -- 172.21.15.77:0/2339020063 shutdown_connections 2024-09-18T21:21:31.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.661+0000 7f0e4f6bc640 1 -- 172.21.15.77:0/2339020063 wait complete. 2024-09-18T21:21:31.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.662+0000 7f0e4f6bc640 1 Processor -- start 2024-09-18T21:21:31.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.662+0000 7f0e4f6bc640 1 -- start start 2024-09-18T21:21:31.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.662+0000 7f0e4f6bc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e480fdba0 0x7f0e480fd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:21:31.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.662+0000 7f0e4f6bc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e480fe4f0 0x7f0e480fb880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:21:31.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.662+0000 7f0e4f6bc640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e480fbe10 con 0x7f0e480fdba0 2024-09-18T21:21:31.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.662+0000 7f0e4f6bc640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e480fbf50 con 0x7f0e480fe4f0 2024-09-18T21:21:31.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.662+0000 7f0e4d458640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e480fdba0 0x7f0e480fd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:21:31.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.662+0000 7f0e4d458640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e480fdba0 0x7f0e480fd390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35470/0 (socket says 172.21.15.77:35470) 2024-09-18T21:21:31.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.662+0000 7f0e4d458640 1 -- 172.21.15.77:0/3796125519 learned_addr learned my addr 172.21.15.77:0/3796125519 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:21:31.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.662+0000 7f0e4cc57640 1 --2- 172.21.15.77:0/3796125519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e480fe4f0 0x7f0e480fb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:21:31.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.663+0000 7f0e4d458640 1 -- 172.21.15.77:0/3796125519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e480fe4f0 msgr2=0x7f0e480fb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:31.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.663+0000 7f0e4d458640 1 --2- 172.21.15.77:0/3796125519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e480fe4f0 0x7f0e480fb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:31.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.663+0000 7f0e4d458640 1 -- 172.21.15.77:0/3796125519 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e44005040 con 0x7f0e480fdba0 2024-09-18T21:21:31.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.663+0000 7f0e4d458640 1 --2- 172.21.15.77:0/3796125519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e480fdba0 0x7f0e480fd390 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0e440048a0 tx=0x7f0e44009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:21:31.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.663+0000 7f0e3dffb640 1 -- 172.21.15.77:0/3796125519 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e44038070 con 0x7f0e480fdba0 2024-09-18T21:21:31.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.663+0000 7f0e3dffb640 1 -- 172.21.15.77:0/3796125519 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0e44004290 con 0x7f0e480fdba0 2024-09-18T21:21:31.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.663+0000 7f0e3dffb640 1 -- 172.21.15.77:0/3796125519 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e44033660 con 0x7f0e480fdba0 2024-09-18T21:21:31.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.663+0000 7f0e4f6bc640 1 -- 172.21.15.77:0/3796125519 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e480fc1d0 con 0x7f0e480fdba0 2024-09-18T21:21:31.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.663+0000 7f0e4f6bc640 1 -- 172.21.15.77:0/3796125519 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e481150e0 con 0x7f0e480fdba0 2024-09-18T21:21:31.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.664+0000 7f0e4f6bc640 1 -- 172.21.15.77:0/3796125519 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e480fa040 con 0x7f0e480fdba0 2024-09-18T21:21:31.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.665+0000 7f0e3dffb640 1 -- 172.21.15.77:0/3796125519 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f0e44030020 con 0x7f0e480fdba0 2024-09-18T21:21:31.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.665+0000 7f0e3dffb640 1 --2- 172.21.15.77:0/3796125519 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f0e3406e0b0 0x7f0e34070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:21:31.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.665+0000 7f0e3dffb640 1 -- 172.21.15.77:0/3796125519 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f0e440adcd0 con 0x7f0e480fdba0 2024-09-18T21:21:31.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.665+0000 7f0e4cc57640 1 --2- 172.21.15.77:0/3796125519 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f0e3406e0b0 0x7f0e34070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:21:31.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.666+0000 7f0e4cc57640 1 --2- 172.21.15.77:0/3796125519 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f0e3406e0b0 0x7f0e34070560 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0e38009af0 tx=0x7f0e3800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:21:31.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.670+0000 7f0e3dffb640 1 -- 172.21.15.77:0/3796125519 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f0e44077080 con 0x7f0e480fdba0 2024-09-18T21:21:31.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.865+0000 7f0e4f6bc640 1 -- 172.21.15.77:0/3796125519 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e48101d80 con 0x7f0e3406e0b0 2024-09-18T21:21:31.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.866+0000 7f0e3dffb640 1 -- 172.21.15.77:0/3796125519 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7f0e48101d80 con 0x7f0e3406e0b0 2024-09-18T21:21:31.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.870+0000 7f0e4f6bc640 1 -- 172.21.15.77:0/3796125519 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f0e3406e0b0 msgr2=0x7f0e34070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:31.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.870+0000 7f0e4f6bc640 1 --2- 172.21.15.77:0/3796125519 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f0e3406e0b0 0x7f0e34070560 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0e38009af0 tx=0x7f0e3800b040 comp rx=0 tx=0).stop 2024-09-18T21:21:31.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.870+0000 7f0e4f6bc640 1 -- 172.21.15.77:0/3796125519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e480fdba0 msgr2=0x7f0e480fd390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:31.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.870+0000 7f0e4f6bc640 1 --2- 172.21.15.77:0/3796125519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e480fdba0 0x7f0e480fd390 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0e440048a0 tx=0x7f0e44009da0 comp rx=0 tx=0).stop 2024-09-18T21:21:31.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.870+0000 7f0e4f6bc640 1 -- 172.21.15.77:0/3796125519 shutdown_connections 2024-09-18T21:21:31.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.870+0000 7f0e4f6bc640 1 --2- 172.21.15.77:0/3796125519 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f0e3406e0b0 0x7f0e34070560 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:31.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.870+0000 7f0e4f6bc640 1 --2- 172.21.15.77:0/3796125519 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e480fe4f0 0x7f0e480fb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:31.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.870+0000 7f0e4f6bc640 1 --2- 172.21.15.77:0/3796125519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e480fdba0 0x7f0e480fd390 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:31.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.870+0000 7f0e4f6bc640 1 -- 172.21.15.77:0/3796125519 >> 172.21.15.77:0/3796125519 conn(0x7f0e480f63a0 msgr2=0x7f0e480f7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:21:31.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.870+0000 7f0e4f6bc640 1 -- 172.21.15.77:0/3796125519 shutdown_connections 2024-09-18T21:21:31.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.870+0000 7f0e4f6bc640 1 -- 172.21.15.77:0/3796125519 wait complete. 2024-09-18T21:21:31.883 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-09-18T21:21:31.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.954+0000 7efe9e4fe640 1 -- 172.21.15.77:0/668850042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe980fc700 msgr2=0x7efe980fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:31.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.954+0000 7efe9e4fe640 1 --2- 172.21.15.77:0/668850042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe980fc700 0x7efe980fcb70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efe800048d0 tx=0x7efe80009da0 comp rx=0 tx=0).stop 2024-09-18T21:21:31.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.954+0000 7efe9e4fe640 1 -- 172.21.15.77:0/668850042 shutdown_connections 2024-09-18T21:21:31.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.955+0000 7efe9e4fe640 1 --2- 172.21.15.77:0/668850042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe980fc700 0x7efe980fcb70 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:31.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.955+0000 7efe9e4fe640 1 --2- 172.21.15.77:0/668850042 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe980fb430 0x7efe980fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:31.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.955+0000 7efe9e4fe640 1 -- 172.21.15.77:0/668850042 >> 172.21.15.77:0/668850042 conn(0x7efe980f6c10 msgr2=0x7efe980f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:21:31.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.955+0000 7efe9e4fe640 1 -- 172.21.15.77:0/668850042 shutdown_connections 2024-09-18T21:21:31.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.955+0000 7efe9e4fe640 1 -- 172.21.15.77:0/668850042 wait complete. 2024-09-18T21:21:31.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.955+0000 7efe9e4fe640 1 Processor -- start 2024-09-18T21:21:31.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.955+0000 7efe9e4fe640 1 -- start start 2024-09-18T21:21:31.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.955+0000 7efe9e4fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe980fb430 0x7efe9810fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:21:31.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.955+0000 7efe9e4fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe980fc700 0x7efe981122b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:21:31.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.955+0000 7efe9e4fe640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe98065c50 con 0x7efe980fb430 2024-09-18T21:21:31.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.955+0000 7efe9e4fe640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe98065dc0 con 0x7efe980fc700 2024-09-18T21:21:31.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.955+0000 7efe97fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe980fb430 0x7efe9810fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:21:31.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.956+0000 7efe97fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe980fb430 0x7efe9810fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35486/0 (socket says 172.21.15.77:35486) 2024-09-18T21:21:31.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.956+0000 7efe97fff640 1 -- 172.21.15.77:0/1471291755 learned_addr learned my addr 172.21.15.77:0/1471291755 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:21:31.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.956+0000 7efe8ffff640 1 --2- 172.21.15.77:0/1471291755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe980fc700 0x7efe981122b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:21:31.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.956+0000 7efe97fff640 1 -- 172.21.15.77:0/1471291755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe980fc700 msgr2=0x7efe981122b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:31.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.956+0000 7efe97fff640 1 --2- 172.21.15.77:0/1471291755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe980fc700 0x7efe981122b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:31.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.956+0000 7efe97fff640 1 -- 172.21.15.77:0/1471291755 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe80005040 con 0x7efe980fb430 2024-09-18T21:21:31.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.956+0000 7efe97fff640 1 --2- 172.21.15.77:0/1471291755 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe980fb430 0x7efe9810fd60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efe8800c790 tx=0x7efe880043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:21:31.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.956+0000 7efe957fa640 1 -- 172.21.15.77:0/1471291755 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe8800a7a0 con 0x7efe980fb430 2024-09-18T21:21:31.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.956+0000 7efe9e4fe640 1 -- 172.21.15.77:0/1471291755 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe98112850 con 0x7efe980fb430 2024-09-18T21:21:31.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.956+0000 7efe957fa640 1 -- 172.21.15.77:0/1471291755 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7efe8800ada0 con 0x7efe980fb430 2024-09-18T21:21:31.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.956+0000 7efe957fa640 1 -- 172.21.15.77:0/1471291755 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe880113a0 con 0x7efe980fb430 2024-09-18T21:21:31.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.956+0000 7efe9e4fe640 1 -- 172.21.15.77:0/1471291755 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe98112da0 con 0x7efe980fb430 2024-09-18T21:21:31.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.957+0000 7efe9e4fe640 1 -- 172.21.15.77:0/1471291755 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe980fa890 con 0x7efe980fb430 2024-09-18T21:21:31.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.958+0000 7efe957fa640 1 -- 172.21.15.77:0/1471291755 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7efe8800a900 con 0x7efe980fb430 2024-09-18T21:21:31.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.958+0000 7efe957fa640 1 --2- 172.21.15.77:0/1471291755 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7efe8406e0b0 0x7efe84070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:21:31.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.958+0000 7efe957fa640 1 -- 172.21.15.77:0/1471291755 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7efe8808dd50 con 0x7efe980fb430 2024-09-18T21:21:31.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.958+0000 7efe8ffff640 1 --2- 172.21.15.77:0/1471291755 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7efe8406e0b0 0x7efe84070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:21:31.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.959+0000 7efe8ffff640 1 --2- 172.21.15.77:0/1471291755 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7efe8406e0b0 0x7efe84070560 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7efe80000c00 tx=0x7efe80035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:21:31.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:31.963+0000 7efe957fa640 1 -- 172.21.15.77:0/1471291755 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7efe88057050 con 0x7efe980fb430 2024-09-18T21:21:32.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.151+0000 7efe9e4fe640 1 -- 172.21.15.77:0/1471291755 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efe98100b10 con 0x7efe8406e0b0 2024-09-18T21:21:32.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.152+0000 7efe957fa640 1 -- 172.21.15.77:0/1471291755 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7efe98100b10 con 0x7efe8406e0b0 2024-09-18T21:21:32.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.155+0000 7efe9e4fe640 1 -- 172.21.15.77:0/1471291755 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7efe8406e0b0 msgr2=0x7efe84070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:32.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.155+0000 7efe9e4fe640 1 --2- 172.21.15.77:0/1471291755 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7efe8406e0b0 0x7efe84070560 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7efe80000c00 tx=0x7efe80035040 comp rx=0 tx=0).stop 2024-09-18T21:21:32.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.155+0000 7efe9e4fe640 1 -- 172.21.15.77:0/1471291755 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe980fb430 msgr2=0x7efe9810fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:32.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.155+0000 7efe9e4fe640 1 --2- 172.21.15.77:0/1471291755 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe980fb430 0x7efe9810fd60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efe8800c790 tx=0x7efe880043c0 comp rx=0 tx=0).stop 2024-09-18T21:21:32.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.155+0000 7efe9e4fe640 1 -- 172.21.15.77:0/1471291755 shutdown_connections 2024-09-18T21:21:32.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.155+0000 7efe9e4fe640 1 --2- 172.21.15.77:0/1471291755 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7efe8406e0b0 0x7efe84070560 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:32.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.155+0000 7efe9e4fe640 1 --2- 172.21.15.77:0/1471291755 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efe980fc700 0x7efe981122b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:32.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.155+0000 7efe9e4fe640 1 --2- 172.21.15.77:0/1471291755 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe980fb430 0x7efe9810fd60 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:32.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.155+0000 7efe9e4fe640 1 -- 172.21.15.77:0/1471291755 >> 172.21.15.77:0/1471291755 conn(0x7efe980f6c10 msgr2=0x7efe980f83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:21:32.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.156+0000 7efe9e4fe640 1 -- 172.21.15.77:0/1471291755 shutdown_connections 2024-09-18T21:21:32.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.156+0000 7efe9e4fe640 1 -- 172.21.15.77:0/1471291755 wait complete. 2024-09-18T21:21:32.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.246+0000 7f6402d7a640 1 -- 172.21.15.77:0/2363144117 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63fc0fd7f0 msgr2=0x7f63fc0fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:32.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.246+0000 7f6402d7a640 1 --2- 172.21.15.77:0/2363144117 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63fc0fd7f0 0x7f63fc0fdc60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f63e80048d0 tx=0x7f63e8009da0 comp rx=0 tx=0).stop 2024-09-18T21:21:32.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.246+0000 7f6402d7a640 1 -- 172.21.15.77:0/2363144117 shutdown_connections 2024-09-18T21:21:32.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.246+0000 7f6402d7a640 1 --2- 172.21.15.77:0/2363144117 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63fc0fd7f0 0x7f63fc0fdc60 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:32.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.246+0000 7f6402d7a640 1 --2- 172.21.15.77:0/2363144117 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63fc0fc520 0x7f63fc0fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:32.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.246+0000 7f6402d7a640 1 -- 172.21.15.77:0/2363144117 >> 172.21.15.77:0/2363144117 conn(0x7f63fc0f7ce0 msgr2=0x7f63fc0fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:21:32.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.246+0000 7f6402d7a640 1 -- 172.21.15.77:0/2363144117 shutdown_connections 2024-09-18T21:21:32.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.246+0000 7f6402d7a640 1 -- 172.21.15.77:0/2363144117 wait complete. 2024-09-18T21:21:32.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.246+0000 7f6402d7a640 1 Processor -- start 2024-09-18T21:21:32.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.246+0000 7f6402d7a640 1 -- start start 2024-09-18T21:21:32.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.247+0000 7f6402d7a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63fc0fc520 0x7f63fc10d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:21:32.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.247+0000 7f6402d7a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63fc0fd7f0 0x7f63fc10d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:21:32.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.247+0000 7f6402d7a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63fc10dc10 con 0x7f63fc0fc520 2024-09-18T21:21:32.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.247+0000 7f6402d7a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63fc10e430 con 0x7f63fc0fd7f0 2024-09-18T21:21:32.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.247+0000 7f6400b16640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63fc0fc520 0x7f63fc10d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:21:32.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.247+0000 7f6400b16640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63fc0fc520 0x7f63fc10d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35496/0 (socket says 172.21.15.77:35496) 2024-09-18T21:21:32.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.247+0000 7f6400b16640 1 -- 172.21.15.77:0/827748356 learned_addr learned my addr 172.21.15.77:0/827748356 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:21:32.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.247+0000 7f63fbfff640 1 --2- 172.21.15.77:0/827748356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63fc0fd7f0 0x7f63fc10d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:21:32.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.247+0000 7f6400b16640 1 -- 172.21.15.77:0/827748356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63fc0fd7f0 msgr2=0x7f63fc10d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:32.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.247+0000 7f6400b16640 1 --2- 172.21.15.77:0/827748356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63fc0fd7f0 0x7f63fc10d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:32.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.248+0000 7f6400b16640 1 -- 172.21.15.77:0/827748356 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e8005040 con 0x7f63fc0fc520 2024-09-18T21:21:32.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.248+0000 7f63fbfff640 1 --2- 172.21.15.77:0/827748356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63fc0fd7f0 0x7f63fc10d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T21:21:32.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.248+0000 7f6400b16640 1 --2- 172.21.15.77:0/827748356 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63fc0fc520 0x7f63fc10d080 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f63f000eb70 tx=0x7f63f000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:21:32.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.248+0000 7f63f97fa640 1 -- 172.21.15.77:0/827748356 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63f0007c30 con 0x7f63fc0fc520 2024-09-18T21:21:32.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.248+0000 7f63f97fa640 1 -- 172.21.15.77:0/827748356 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f63f000f040 con 0x7f63fc0fc520 2024-09-18T21:21:32.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.248+0000 7f6402d7a640 1 -- 172.21.15.77:0/827748356 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63fc10e660 con 0x7f63fc0fc520 2024-09-18T21:21:32.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.248+0000 7f63f97fa640 1 -- 172.21.15.77:0/827748356 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63f0009470 con 0x7f63fc0fc520 2024-09-18T21:21:32.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.248+0000 7f6402d7a640 1 -- 172.21.15.77:0/827748356 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63fc10ec00 con 0x7f63fc0fc520 2024-09-18T21:21:32.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.249+0000 7f6402d7a640 1 -- 172.21.15.77:0/827748356 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63fc0fb980 con 0x7f63fc0fc520 2024-09-18T21:21:32.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.250+0000 7f63f97fa640 1 -- 172.21.15.77:0/827748356 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f63f00096e0 con 0x7f63fc0fc520 2024-09-18T21:21:32.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.250+0000 7f63f97fa640 1 --2- 172.21.15.77:0/827748356 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f63ec06e0b0 0x7f63ec070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:21:32.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.250+0000 7f63f97fa640 1 -- 172.21.15.77:0/827748356 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f63f008d8c0 con 0x7f63fc0fc520 2024-09-18T21:21:32.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.250+0000 7f63fbfff640 1 --2- 172.21.15.77:0/827748356 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f63ec06e0b0 0x7f63ec070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:21:32.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.251+0000 7f63fbfff640 1 --2- 172.21.15.77:0/827748356 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f63ec06e0b0 0x7f63ec070560 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f63fc10ce30 tx=0x7f63e8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:21:32.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.256+0000 7f63f97fa640 1 -- 172.21.15.77:0/827748356 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f63f0056bf0 con 0x7f63fc0fc520 2024-09-18T21:21:32.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.484+0000 7f6402d7a640 1 -- 172.21.15.77:0/827748356 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f63fc10ef30 con 0x7f63ec06e0b0 2024-09-18T21:21:32.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.494+0000 7f63f97fa640 1 -- 172.21.15.77:0/827748356 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f63fc10ef30 con 0x7f63ec06e0b0 2024-09-18T21:21:32.495 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T21:21:32.495 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager.smithi077 smithi077 *:9093,9094 running (14s) 10s ago 16m 15.4M - 0.25.0 c8568f914cd2 d3072897529c 2024-09-18T21:21:32.495 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi077 smithi077 running (5m) 10s ago 16m 6891k - 19.1.1-17-g06b1b1de f79f744f586d 5872fa24b792 2024-09-18T21:21:32.495 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi103 smithi103 running (5m) 42s ago 15m 6887k - 19.1.1-17-g06b1b1de f79f744f586d cd1604469f34 2024-09-18T21:21:32.496 INFO:teuthology.orchestra.run.smithi077.stdout:grafana.smithi077 smithi077 *:3000 running (8m) 10s ago 16m 83.5M - 9.4.7 954c08fa6188 d06ef3ab9e66 2024-09-18T21:21:32.496 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.cqfhlw smithi077 running (102s) 10s ago 11m 13.5M - 19.1.1-17-g06b1b1de f79f744f586d c74ffc2ebb80 2024-09-18T21:21:32.496 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.vruydi smithi077 running (2m) 10s ago 11m 84.8M - 19.1.1-17-g06b1b1de f79f744f586d ce474ff0a948 2024-09-18T21:21:32.496 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi103.opftmf smithi103 running (59s) 42s ago 11m 13.1M - 19.1.1-17-g06b1b1de f79f744f586d 02c8e0b7ba0a 2024-09-18T21:21:32.496 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi103.zhdmdg smithi103 running (81s) 42s ago 11m 12.4M - 19.1.1-17-g06b1b1de f79f744f586d 84d9d5a98395 2024-09-18T21:21:32.496 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi077.utkpjg smithi077 *:8443,9283,8765 running (7m) 10s ago 17m 511M - 19.1.1-17-g06b1b1de f79f744f586d 99d4b0fd70f6 2024-09-18T21:21:32.496 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi103.zjztqc smithi103 *:8443,9283,8765 running (6m) 42s ago 15m 442M - 19.1.1-17-g06b1b1de f79f744f586d 54589547c4d7 2024-09-18T21:21:32.496 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi077 smithi077 running (6m) 10s ago 17m 52.4M 2048M 19.1.1-17-g06b1b1de f79f744f586d 2d0fbbea1264 2024-09-18T21:21:32.496 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi103 smithi103 running (6m) 42s ago 15m 39.5M 2048M 19.1.1-17-g06b1b1de f79f744f586d dc79edbd9602 2024-09-18T21:21:32.496 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi077 smithi077 *:9100 running (49s) 10s ago 16m 9973k - 1.5.0 0da6a335fe13 f880828c375d 2024-09-18T21:21:32.496 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi103 smithi103 *:9100 running (45s) 42s ago 15m 5473k - 1.5.0 0da6a335fe13 33e42737d4e1 2024-09-18T21:21:32.496 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (5m) 10s ago 14m 101M 1557M 19.1.1-17-g06b1b1de f79f744f586d 8855b4b16e00 2024-09-18T21:21:32.496 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi077 running (4m) 10s ago 14m 115M 1557M 19.1.1-17-g06b1b1de f79f744f586d 2d8bc9cac96c 2024-09-18T21:21:32.496 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi077 running (4m) 10s ago 13m 103M 1557M 19.1.1-17-g06b1b1de f79f744f586d 93876f1d398d 2024-09-18T21:21:32.497 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi103 running (3m) 42s ago 13m 121M 2581M 19.1.1-17-g06b1b1de f79f744f586d 2556b257bf1c 2024-09-18T21:21:32.497 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi103 running (3m) 42s ago 13m 99.2M 2581M 19.1.1-17-g06b1b1de f79f744f586d 2cde7eaf88d8 2024-09-18T21:21:32.497 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi103 running (2m) 42s ago 12m 100M 2581M 19.1.1-17-g06b1b1de f79f744f586d e6912ab63ecc 2024-09-18T21:21:32.497 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus.smithi077 smithi077 *:9095 running (30s) 10s ago 15m 44.6M - 2.43.0 a07b618ecd1d d877a4113362 2024-09-18T21:21:32.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.497+0000 7f6402d7a640 1 -- 172.21.15.77:0/827748356 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f63ec06e0b0 msgr2=0x7f63ec070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:32.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.497+0000 7f6402d7a640 1 --2- 172.21.15.77:0/827748356 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f63ec06e0b0 0x7f63ec070560 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f63fc10ce30 tx=0x7f63e8035040 comp rx=0 tx=0).stop 2024-09-18T21:21:32.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.497+0000 7f6402d7a640 1 -- 172.21.15.77:0/827748356 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63fc0fc520 msgr2=0x7f63fc10d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:32.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.497+0000 7f6402d7a640 1 --2- 172.21.15.77:0/827748356 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63fc0fc520 0x7f63fc10d080 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f63f000eb70 tx=0x7f63f000b040 comp rx=0 tx=0).stop 2024-09-18T21:21:32.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.497+0000 7f6402d7a640 1 -- 172.21.15.77:0/827748356 shutdown_connections 2024-09-18T21:21:32.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.497+0000 7f6402d7a640 1 --2- 172.21.15.77:0/827748356 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f63ec06e0b0 0x7f63ec070560 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:32.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.497+0000 7f6402d7a640 1 --2- 172.21.15.77:0/827748356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63fc0fd7f0 0x7f63fc10d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:32.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.497+0000 7f6402d7a640 1 --2- 172.21.15.77:0/827748356 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63fc0fc520 0x7f63fc10d080 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:32.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.497+0000 7f6402d7a640 1 -- 172.21.15.77:0/827748356 >> 172.21.15.77:0/827748356 conn(0x7f63fc0f7ce0 msgr2=0x7f63fc0f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:21:32.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.497+0000 7f6402d7a640 1 -- 172.21.15.77:0/827748356 shutdown_connections 2024-09-18T21:21:32.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.497+0000 7f6402d7a640 1 -- 172.21.15.77:0/827748356 wait complete. 2024-09-18T21:21:32.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.594+0000 7ffa57f4d640 1 -- 172.21.15.77:0/826885113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa500ff6e0 msgr2=0x7ffa50101ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:32.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.594+0000 7ffa57f4d640 1 --2- 172.21.15.77:0/826885113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa500ff6e0 0x7ffa50101ac0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ffa400048d0 tx=0x7ffa40009da0 comp rx=0 tx=0).stop 2024-09-18T21:21:32.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.594+0000 7ffa57f4d640 1 -- 172.21.15.77:0/826885113 shutdown_connections 2024-09-18T21:21:32.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.594+0000 7ffa57f4d640 1 --2- 172.21.15.77:0/826885113 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa500ff6e0 0x7ffa50101ac0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:32.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.594+0000 7ffa57f4d640 1 --2- 172.21.15.77:0/826885113 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa50065be0 0x7ffa500ff1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:32.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.594+0000 7ffa57f4d640 1 -- 172.21.15.77:0/826885113 >> 172.21.15.77:0/826885113 conn(0x7ffa500f6c10 msgr2=0x7ffa500f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:21:32.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.594+0000 7ffa57f4d640 1 -- 172.21.15.77:0/826885113 shutdown_connections 2024-09-18T21:21:32.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.594+0000 7ffa57f4d640 1 -- 172.21.15.77:0/826885113 wait complete. 2024-09-18T21:21:32.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.595+0000 7ffa57f4d640 1 Processor -- start 2024-09-18T21:21:32.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.595+0000 7ffa57f4d640 1 -- start start 2024-09-18T21:21:32.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.595+0000 7ffa57f4d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa50065be0 0x7ffa5010d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:21:32.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.595+0000 7ffa57f4d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa500ff6e0 0x7ffa5010d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:21:32.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.595+0000 7ffa57f4d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5010dbe0 con 0x7ffa500ff6e0 2024-09-18T21:21:32.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.595+0000 7ffa57f4d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5010e400 con 0x7ffa50065be0 2024-09-18T21:21:32.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.595+0000 7ffa554e8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa500ff6e0 0x7ffa5010d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:21:32.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.595+0000 7ffa554e8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa500ff6e0 0x7ffa5010d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35512/0 (socket says 172.21.15.77:35512) 2024-09-18T21:21:32.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.595+0000 7ffa554e8640 1 -- 172.21.15.77:0/525542732 learned_addr learned my addr 172.21.15.77:0/525542732 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:21:32.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.595+0000 7ffa55ce9640 1 --2- 172.21.15.77:0/525542732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa50065be0 0x7ffa5010d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:21:32.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.596+0000 7ffa554e8640 1 -- 172.21.15.77:0/525542732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa50065be0 msgr2=0x7ffa5010d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:32.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.596+0000 7ffa554e8640 1 --2- 172.21.15.77:0/525542732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa50065be0 0x7ffa5010d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:32.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.596+0000 7ffa554e8640 1 -- 172.21.15.77:0/525542732 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa40005040 con 0x7ffa500ff6e0 2024-09-18T21:21:32.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.596+0000 7ffa55ce9640 1 --2- 172.21.15.77:0/525542732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa50065be0 0x7ffa5010d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T21:21:32.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.596+0000 7ffa554e8640 1 --2- 172.21.15.77:0/525542732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa500ff6e0 0x7ffa5010d590 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ffa400048a0 tx=0x7ffa40009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:21:32.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.596+0000 7ffa467fc640 1 -- 172.21.15.77:0/525542732 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa40038070 con 0x7ffa500ff6e0 2024-09-18T21:21:32.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.596+0000 7ffa467fc640 1 -- 172.21.15.77:0/525542732 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ffa40032d30 con 0x7ffa500ff6e0 2024-09-18T21:21:32.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.596+0000 7ffa57f4d640 1 -- 172.21.15.77:0/525542732 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa5010e630 con 0x7ffa500ff6e0 2024-09-18T21:21:32.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.596+0000 7ffa57f4d640 1 -- 172.21.15.77:0/525542732 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa5010ebd0 con 0x7ffa500ff6e0 2024-09-18T21:21:32.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.596+0000 7ffa467fc640 1 -- 172.21.15.77:0/525542732 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa40033ac0 con 0x7ffa500ff6e0 2024-09-18T21:21:32.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.597+0000 7ffa57f4d640 1 -- 172.21.15.77:0/525542732 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa34005240 con 0x7ffa500ff6e0 2024-09-18T21:21:32.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.597+0000 7ffa467fc640 1 -- 172.21.15.77:0/525542732 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ffa40030020 con 0x7ffa500ff6e0 2024-09-18T21:21:32.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.598+0000 7ffa467fc640 1 --2- 172.21.15.77:0/525542732 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7ffa3c06e0b0 0x7ffa3c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:21:32.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.598+0000 7ffa467fc640 1 -- 172.21.15.77:0/525542732 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7ffa400ae180 con 0x7ffa500ff6e0 2024-09-18T21:21:32.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.598+0000 7ffa55ce9640 1 --2- 172.21.15.77:0/525542732 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7ffa3c06e0b0 0x7ffa3c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:21:32.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.598+0000 7ffa55ce9640 1 --2- 172.21.15.77:0/525542732 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7ffa3c06e0b0 0x7ffa3c070560 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ffa50065940 tx=0x7ffa4c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:21:32.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.602+0000 7ffa467fc640 1 -- 172.21.15.77:0/525542732 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7ffa40077400 con 0x7ffa500ff6e0 2024-09-18T21:21:32.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.870+0000 7ffa57f4d640 1 -- 172.21.15.77:0/525542732 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ffa34005d00 con 0x7ffa500ff6e0 2024-09-18T21:21:32.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.871+0000 7ffa467fc640 1 -- 172.21.15.77:0/525542732 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7ffa4007aac0 con 0x7ffa500ff6e0 2024-09-18T21:21:32.872 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-18T21:21:32.872 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": { 2024-09-18T21:21:32.873 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 2 2024-09-18T21:21:32.873 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:21:32.873 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": { 2024-09-18T21:21:32.873 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 2 2024-09-18T21:21:32.873 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:21:32.873 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": { 2024-09-18T21:21:32.873 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 6 2024-09-18T21:21:32.873 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:21:32.873 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-09-18T21:21:32.873 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 4 2024-09-18T21:21:32.873 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:21:32.873 INFO:teuthology.orchestra.run.smithi077.stdout: "overall": { 2024-09-18T21:21:32.874 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 14 2024-09-18T21:21:32.874 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-18T21:21:32.874 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-18T21:21:32.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.874+0000 7ffa57f4d640 1 -- 172.21.15.77:0/525542732 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7ffa3c06e0b0 msgr2=0x7ffa3c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:32.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.874+0000 7ffa57f4d640 1 --2- 172.21.15.77:0/525542732 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7ffa3c06e0b0 0x7ffa3c070560 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ffa50065940 tx=0x7ffa4c00b040 comp rx=0 tx=0).stop 2024-09-18T21:21:32.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.874+0000 7ffa57f4d640 1 -- 172.21.15.77:0/525542732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa500ff6e0 msgr2=0x7ffa5010d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:32.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.874+0000 7ffa57f4d640 1 --2- 172.21.15.77:0/525542732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa500ff6e0 0x7ffa5010d590 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ffa400048a0 tx=0x7ffa40009da0 comp rx=0 tx=0).stop 2024-09-18T21:21:32.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.874+0000 7ffa57f4d640 1 -- 172.21.15.77:0/525542732 shutdown_connections 2024-09-18T21:21:32.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.874+0000 7ffa57f4d640 1 --2- 172.21.15.77:0/525542732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa500ff6e0 0x7ffa5010d590 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:32.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.874+0000 7ffa57f4d640 1 --2- 172.21.15.77:0/525542732 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7ffa3c06e0b0 0x7ffa3c070560 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:32.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.874+0000 7ffa57f4d640 1 --2- 172.21.15.77:0/525542732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa50065be0 0x7ffa5010d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:32.875 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.874+0000 7ffa57f4d640 1 -- 172.21.15.77:0/525542732 >> 172.21.15.77:0/525542732 conn(0x7ffa500f6c10 msgr2=0x7ffa500f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:21:32.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.874+0000 7ffa57f4d640 1 -- 172.21.15.77:0/525542732 shutdown_connections 2024-09-18T21:21:32.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.874+0000 7ffa57f4d640 1 -- 172.21.15.77:0/525542732 wait complete. 2024-09-18T21:21:32.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.972+0000 7f6f1ea29640 1 -- 172.21.15.77:0/2416331216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f180fc6f0 msgr2=0x7f6f180fcb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:32.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.972+0000 7f6f1ea29640 1 --2- 172.21.15.77:0/2416331216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f180fc6f0 0x7f6f180fcb60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c0048d0 tx=0x7f6f0c009da0 comp rx=0 tx=0).stop 2024-09-18T21:21:32.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.973+0000 7f6f1ea29640 1 -- 172.21.15.77:0/2416331216 shutdown_connections 2024-09-18T21:21:32.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.973+0000 7f6f1ea29640 1 --2- 172.21.15.77:0/2416331216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f180fc6f0 0x7f6f180fcb60 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:32.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.973+0000 7f6f1ea29640 1 --2- 172.21.15.77:0/2416331216 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f180fb420 0x7f6f180fb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:32.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.973+0000 7f6f1ea29640 1 -- 172.21.15.77:0/2416331216 >> 172.21.15.77:0/2416331216 conn(0x7f6f180f6c00 msgr2=0x7f6f180f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:21:32.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.973+0000 7f6f1ea29640 1 -- 172.21.15.77:0/2416331216 shutdown_connections 2024-09-18T21:21:32.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.973+0000 7f6f1ea29640 1 -- 172.21.15.77:0/2416331216 wait complete. 2024-09-18T21:21:32.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.973+0000 7f6f1ea29640 1 Processor -- start 2024-09-18T21:21:32.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.973+0000 7f6f1ea29640 1 -- start start 2024-09-18T21:21:32.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.974+0000 7f6f1ea29640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f180fb420 0x7f6f1810fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:21:32.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.974+0000 7f6f1ea29640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f180fc6f0 0x7f6f181122e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:21:32.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.974+0000 7f6f1ea29640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f18066510 con 0x7f6f180fc6f0 2024-09-18T21:21:32.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.974+0000 7f6f1ea29640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f18066680 con 0x7f6f180fb420 2024-09-18T21:21:32.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.974+0000 7f6f177fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f180fc6f0 0x7f6f181122e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:21:32.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.974+0000 7f6f177fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f180fc6f0 0x7f6f181122e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35524/0 (socket says 172.21.15.77:35524) 2024-09-18T21:21:32.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.974+0000 7f6f177fe640 1 -- 172.21.15.77:0/1565044123 learned_addr learned my addr 172.21.15.77:0/1565044123 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:21:32.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.974+0000 7f6f17fff640 1 --2- 172.21.15.77:0/1565044123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f180fb420 0x7f6f1810fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:21:32.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.974+0000 7f6f17fff640 1 -- 172.21.15.77:0/1565044123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f180fc6f0 msgr2=0x7f6f181122e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:32.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.974+0000 7f6f17fff640 1 --2- 172.21.15.77:0/1565044123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f180fc6f0 0x7f6f181122e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:32.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.974+0000 7f6f17fff640 1 -- 172.21.15.77:0/1565044123 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f0c005040 con 0x7f6f180fb420 2024-09-18T21:21:32.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.974+0000 7f6f177fe640 1 --2- 172.21.15.77:0/1565044123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f180fc6f0 0x7f6f181122e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-18T21:21:32.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.975+0000 7f6f17fff640 1 --2- 172.21.15.77:0/1565044123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f180fb420 0x7f6f1810fd90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6f0800eb40 tx=0x7f6f0800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:21:32.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.975+0000 7f6f14ff9640 1 -- 172.21.15.77:0/1565044123 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f08007c30 con 0x7f6f180fb420 2024-09-18T21:21:32.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.975+0000 7f6f1ea29640 1 -- 172.21.15.77:0/1565044123 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f18112820 con 0x7f6f180fb420 2024-09-18T21:21:32.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.975+0000 7f6f1ea29640 1 -- 172.21.15.77:0/1565044123 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f18112dc0 con 0x7f6f180fb420 2024-09-18T21:21:32.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.975+0000 7f6f14ff9640 1 -- 172.21.15.77:0/1565044123 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6f0800f040 con 0x7f6f180fb420 2024-09-18T21:21:32.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.975+0000 7f6f14ff9640 1 -- 172.21.15.77:0/1565044123 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f0800cac0 con 0x7f6f180fb420 2024-09-18T21:21:32.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.976+0000 7f6f1ea29640 1 -- 172.21.15.77:0/1565044123 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f180fa880 con 0x7f6f180fb420 2024-09-18T21:21:32.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.977+0000 7f6f14ff9640 1 -- 172.21.15.77:0/1565044123 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f6f0800cc20 con 0x7f6f180fb420 2024-09-18T21:21:32.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.978+0000 7f6f14ff9640 1 --2- 172.21.15.77:0/1565044123 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f6f0006e0b0 0x7f6f00070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:21:32.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.978+0000 7f6f14ff9640 1 -- 172.21.15.77:0/1565044123 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f6f0808d820 con 0x7f6f180fb420 2024-09-18T21:21:32.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.978+0000 7f6f177fe640 1 --2- 172.21.15.77:0/1565044123 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f6f0006e0b0 0x7f6f00070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:21:32.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.978+0000 7f6f177fe640 1 --2- 172.21.15.77:0/1565044123 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f6f0006e0b0 0x7f6f00070560 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c000c00 tx=0x7f6f0c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:21:32.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:32.982+0000 7f6f14ff9640 1 -- 172.21.15.77:0/1565044123 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f6f08056bd0 con 0x7f6f180fb420 2024-09-18T21:21:33.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:32 smithi077 ceph-mon[92672]: from='client.34494 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:21:33.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:32 smithi077 ceph-mon[92672]: pgmap v230: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:33.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:32 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/525542732' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:33.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:32 smithi103 ceph-mon[80307]: from='client.34494 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:21:33.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:32 smithi103 ceph-mon[80307]: pgmap v230: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:33.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:32 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/525542732' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:33.293 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.292+0000 7f6f1ea29640 1 -- 172.21.15.77:0/1565044123 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6f18113160 con 0x7f6f180fb420 2024-09-18T21:21:33.293 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.293+0000 7f6f14ff9640 1 -- 172.21.15.77:0/1565044123 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 36 v36) v1 ==== 76+0+1978 (secure 0 0 0) 0x7f6f08009700 con 0x7f6f180fb420 2024-09-18T21:21:33.294 INFO:teuthology.orchestra.run.smithi077.stdout:e36 2024-09-18T21:21:33.294 INFO:teuthology.orchestra.run.smithi077.stdout:btime 2024-09-18T21:20:34:069185+0000 2024-09-18T21:21:33.294 INFO:teuthology.orchestra.run.smithi077.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T21:21:33.294 INFO:teuthology.orchestra.run.smithi077.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T21:21:33.294 INFO:teuthology.orchestra.run.smithi077.stdout:legacy client fscid: 1 2024-09-18T21:21:33.294 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:21:33.294 INFO:teuthology.orchestra.run.smithi077.stdout:Filesystem 'cephfs' (1) 2024-09-18T21:21:33.294 INFO:teuthology.orchestra.run.smithi077.stdout:fs_name cephfs 2024-09-18T21:21:33.294 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 35 2024-09-18T21:21:33.294 INFO:teuthology.orchestra.run.smithi077.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T21:21:33.294 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-09-18T21:10:17.230179+0000 2024-09-18T21:21:33.295 INFO:teuthology.orchestra.run.smithi077.stdout:modified 2024-09-18T21:20:33.060016+0000 2024-09-18T21:21:33.295 INFO:teuthology.orchestra.run.smithi077.stdout:tableserver 0 2024-09-18T21:21:33.295 INFO:teuthology.orchestra.run.smithi077.stdout:root 0 2024-09-18T21:21:33.295 INFO:teuthology.orchestra.run.smithi077.stdout:session_timeout 60 2024-09-18T21:21:33.295 INFO:teuthology.orchestra.run.smithi077.stdout:session_autoclose 300 2024-09-18T21:21:33.295 INFO:teuthology.orchestra.run.smithi077.stdout:max_file_size 1099511627776 2024-09-18T21:21:33.295 INFO:teuthology.orchestra.run.smithi077.stdout:max_xattr_size 65536 2024-09-18T21:21:33.295 INFO:teuthology.orchestra.run.smithi077.stdout:required_client_features {} 2024-09-18T21:21:33.295 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure 0 2024-09-18T21:21:33.295 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure_osd_epoch 80 2024-09-18T21:21:33.295 INFO:teuthology.orchestra.run.smithi077.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T21:21:33.295 INFO:teuthology.orchestra.run.smithi077.stdout:max_mds 1 2024-09-18T21:21:33.295 INFO:teuthology.orchestra.run.smithi077.stdout:in 0 2024-09-18T21:21:33.295 INFO:teuthology.orchestra.run.smithi077.stdout:up {0=34400} 2024-09-18T21:21:33.295 INFO:teuthology.orchestra.run.smithi077.stdout:failed 2024-09-18T21:21:33.296 INFO:teuthology.orchestra.run.smithi077.stdout:damaged 2024-09-18T21:21:33.296 INFO:teuthology.orchestra.run.smithi077.stdout:stopped 2024-09-18T21:21:33.296 INFO:teuthology.orchestra.run.smithi077.stdout:data_pools [3] 2024-09-18T21:21:33.296 INFO:teuthology.orchestra.run.smithi077.stdout:metadata_pool 2 2024-09-18T21:21:33.296 INFO:teuthology.orchestra.run.smithi077.stdout:inline_data disabled 2024-09-18T21:21:33.296 INFO:teuthology.orchestra.run.smithi077.stdout:balancer 2024-09-18T21:21:33.296 INFO:teuthology.orchestra.run.smithi077.stdout:bal_rank_mask -1 2024-09-18T21:21:33.296 INFO:teuthology.orchestra.run.smithi077.stdout:standby_count_wanted 1 2024-09-18T21:21:33.296 INFO:teuthology.orchestra.run.smithi077.stdout:qdb_cluster leader: 34400 members: 34400 2024-09-18T21:21:33.296 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.vruydi{0:34400} state up:active seq 19 join_fscid=1 addr [v2:172.21.15.77:6826/1087320436,v1:172.21.15.77:6827/1087320436] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T21:21:33.296 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:21:33.296 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:21:33.296 INFO:teuthology.orchestra.run.smithi077.stdout:Standby daemons: 2024-09-18T21:21:33.296 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:21:33.297 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.cqfhlw{-1:34404} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.77:6828/1489733233,v1:172.21.15.77:6829/1489733233] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T21:21:33.297 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi103.zhdmdg{-1:44287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.103:6824/3296796313,v1:172.21.15.103:6825/3296796313] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T21:21:33.297 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi103.opftmf{-1:44307} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.103:6826/3688450345,v1:172.21.15.103:6827/3688450345] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T21:21:33.297 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 36 2024-09-18T21:21:33.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.295+0000 7f6f1ea29640 1 -- 172.21.15.77:0/1565044123 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f6f0006e0b0 msgr2=0x7f6f00070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:33.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.295+0000 7f6f1ea29640 1 --2- 172.21.15.77:0/1565044123 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f6f0006e0b0 0x7f6f00070560 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c000c00 tx=0x7f6f0c035040 comp rx=0 tx=0).stop 2024-09-18T21:21:33.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.295+0000 7f6f1ea29640 1 -- 172.21.15.77:0/1565044123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f180fb420 msgr2=0x7f6f1810fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:33.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.295+0000 7f6f1ea29640 1 --2- 172.21.15.77:0/1565044123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f180fb420 0x7f6f1810fd90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6f0800eb40 tx=0x7f6f0800b040 comp rx=0 tx=0).stop 2024-09-18T21:21:33.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.295+0000 7f6f1ea29640 1 -- 172.21.15.77:0/1565044123 shutdown_connections 2024-09-18T21:21:33.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.295+0000 7f6f1ea29640 1 --2- 172.21.15.77:0/1565044123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f180fc6f0 0x7f6f181122e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:33.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.295+0000 7f6f1ea29640 1 --2- 172.21.15.77:0/1565044123 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f6f0006e0b0 0x7f6f00070560 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:33.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.295+0000 7f6f1ea29640 1 --2- 172.21.15.77:0/1565044123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f180fb420 0x7f6f1810fd90 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:33.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.295+0000 7f6f1ea29640 1 -- 172.21.15.77:0/1565044123 >> 172.21.15.77:0/1565044123 conn(0x7f6f180f6c00 msgr2=0x7f6f180f83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:21:33.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.295+0000 7f6f1ea29640 1 -- 172.21.15.77:0/1565044123 shutdown_connections 2024-09-18T21:21:33.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.296+0000 7f6f1ea29640 1 -- 172.21.15.77:0/1565044123 wait complete. 2024-09-18T21:21:33.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.392+0000 7fc7e961e640 1 -- 172.21.15.77:0/765835099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7e40fdba0 msgr2=0x7fc7e40fdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:33.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.392+0000 7fc7e961e640 1 --2- 172.21.15.77:0/765835099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7e40fdba0 0x7fc7e40fdfb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc7d40048d0 tx=0x7fc7d4009da0 comp rx=0 tx=0).stop 2024-09-18T21:21:33.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.392+0000 7fc7e961e640 1 -- 172.21.15.77:0/765835099 shutdown_connections 2024-09-18T21:21:33.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.392+0000 7fc7e961e640 1 --2- 172.21.15.77:0/765835099 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7e40fe4f0 0x7fc7e40fa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:33.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.392+0000 7fc7e961e640 1 --2- 172.21.15.77:0/765835099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7e40fdba0 0x7fc7e40fdfb0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:33.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.392+0000 7fc7e961e640 1 -- 172.21.15.77:0/765835099 >> 172.21.15.77:0/765835099 conn(0x7fc7e40f6380 msgr2=0x7fc7e40f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:21:33.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.392+0000 7fc7e961e640 1 -- 172.21.15.77:0/765835099 shutdown_connections 2024-09-18T21:21:33.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.392+0000 7fc7e961e640 1 -- 172.21.15.77:0/765835099 wait complete. 2024-09-18T21:21:33.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.393+0000 7fc7e961e640 1 Processor -- start 2024-09-18T21:21:33.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.393+0000 7fc7e961e640 1 -- start start 2024-09-18T21:21:33.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.393+0000 7fc7e961e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7e40fdba0 0x7fc7e410f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:21:33.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.393+0000 7fc7e961e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7e40fe4f0 0x7fc7e410f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:21:33.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.393+0000 7fc7e961e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e410fe80 con 0x7fc7e40fdba0 2024-09-18T21:21:33.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.393+0000 7fc7e961e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e41106a0 con 0x7fc7e40fe4f0 2024-09-18T21:21:33.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.393+0000 7fc7e2ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7e40fdba0 0x7fc7e410f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:21:33.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.393+0000 7fc7e27fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7e40fe4f0 0x7fc7e410f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:21:33.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.393+0000 7fc7e2ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7e40fdba0 0x7fc7e410f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35546/0 (socket says 172.21.15.77:35546) 2024-09-18T21:21:33.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.394+0000 7fc7e2ffd640 1 -- 172.21.15.77:0/2613379205 learned_addr learned my addr 172.21.15.77:0/2613379205 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:21:33.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.394+0000 7fc7e2ffd640 1 -- 172.21.15.77:0/2613379205 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7e40fe4f0 msgr2=0x7fc7e410f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:33.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.394+0000 7fc7e2ffd640 1 --2- 172.21.15.77:0/2613379205 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7e40fe4f0 0x7fc7e410f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:33.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.394+0000 7fc7e2ffd640 1 -- 172.21.15.77:0/2613379205 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d4005040 con 0x7fc7e40fdba0 2024-09-18T21:21:33.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.394+0000 7fc7e2ffd640 1 --2- 172.21.15.77:0/2613379205 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7e40fdba0 0x7fc7e410f2f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc7d40043d0 tx=0x7fc7d4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:21:33.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.394+0000 7fc7cb7fe640 1 -- 172.21.15.77:0/2613379205 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7d4038070 con 0x7fc7e40fdba0 2024-09-18T21:21:33.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.394+0000 7fc7e961e640 1 -- 172.21.15.77:0/2613379205 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7e41108d0 con 0x7fc7e40fdba0 2024-09-18T21:21:33.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.394+0000 7fc7cb7fe640 1 -- 172.21.15.77:0/2613379205 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc7d402ae90 con 0x7fc7e40fdba0 2024-09-18T21:21:33.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.394+0000 7fc7e961e640 1 -- 172.21.15.77:0/2613379205 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7e4110e70 con 0x7fc7e40fdba0 2024-09-18T21:21:33.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.394+0000 7fc7cb7fe640 1 -- 172.21.15.77:0/2613379205 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7d403e670 con 0x7fc7e40fdba0 2024-09-18T21:21:33.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.396+0000 7fc7e961e640 1 -- 172.21.15.77:0/2613379205 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7e40fa040 con 0x7fc7e40fdba0 2024-09-18T21:21:33.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.396+0000 7fc7cb7fe640 1 -- 172.21.15.77:0/2613379205 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fc7d4030020 con 0x7fc7e40fdba0 2024-09-18T21:21:33.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.397+0000 7fc7cb7fe640 1 --2- 172.21.15.77:0/2613379205 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fc7cc06e0b0 0x7fc7cc070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:21:33.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.397+0000 7fc7cb7fe640 1 -- 172.21.15.77:0/2613379205 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fc7d40addb0 con 0x7fc7e40fdba0 2024-09-18T21:21:33.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.397+0000 7fc7e27fc640 1 --2- 172.21.15.77:0/2613379205 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fc7cc06e0b0 0x7fc7cc070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:21:33.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.398+0000 7fc7e27fc640 1 --2- 172.21.15.77:0/2613379205 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fc7cc06e0b0 0x7fc7cc070560 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc7e410f0a0 tx=0x7fc7d800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:21:33.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.402+0000 7fc7cb7fe640 1 -- 172.21.15.77:0/2613379205 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fc7d4077100 con 0x7fc7e40fdba0 2024-09-18T21:21:33.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.641+0000 7fc7e961e640 1 -- 172.21.15.77:0/2613379205 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc7e41111a0 con 0x7fc7cc06e0b0 2024-09-18T21:21:33.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.642+0000 7fc7cb7fe640 1 -- 172.21.15.77:0/2613379205 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7fc7e41111a0 con 0x7fc7cc06e0b0 2024-09-18T21:21:33.643 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-18T21:21:33.643 INFO:teuthology.orchestra.run.smithi077.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a", 2024-09-18T21:21:33.643 INFO:teuthology.orchestra.run.smithi077.stdout: "in_progress": true, 2024-09-18T21:21:33.643 INFO:teuthology.orchestra.run.smithi077.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-18T21:21:33.643 INFO:teuthology.orchestra.run.smithi077.stdout: "services_complete": [ 2024-09-18T21:21:33.643 INFO:teuthology.orchestra.run.smithi077.stdout: "mon", 2024-09-18T21:21:33.643 INFO:teuthology.orchestra.run.smithi077.stdout: "crash", 2024-09-18T21:21:33.643 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr", 2024-09-18T21:21:33.643 INFO:teuthology.orchestra.run.smithi077.stdout: "osd", 2024-09-18T21:21:33.644 INFO:teuthology.orchestra.run.smithi077.stdout: "mds" 2024-09-18T21:21:33.644 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-18T21:21:33.644 INFO:teuthology.orchestra.run.smithi077.stdout: "progress": "16/21 daemons upgraded", 2024-09-18T21:21:33.644 INFO:teuthology.orchestra.run.smithi077.stdout: "message": "Currently upgrading grafana daemons", 2024-09-18T21:21:33.644 INFO:teuthology.orchestra.run.smithi077.stdout: "is_paused": false 2024-09-18T21:21:33.644 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-18T21:21:33.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.644+0000 7fc7e961e640 1 -- 172.21.15.77:0/2613379205 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fc7cc06e0b0 msgr2=0x7fc7cc070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:33.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.644+0000 7fc7e961e640 1 --2- 172.21.15.77:0/2613379205 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fc7cc06e0b0 0x7fc7cc070560 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc7e410f0a0 tx=0x7fc7d800b040 comp rx=0 tx=0).stop 2024-09-18T21:21:33.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.644+0000 7fc7e961e640 1 -- 172.21.15.77:0/2613379205 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7e40fdba0 msgr2=0x7fc7e410f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:33.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.644+0000 7fc7e961e640 1 --2- 172.21.15.77:0/2613379205 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7e40fdba0 0x7fc7e410f2f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc7d40043d0 tx=0x7fc7d4009da0 comp rx=0 tx=0).stop 2024-09-18T21:21:33.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.644+0000 7fc7e961e640 1 -- 172.21.15.77:0/2613379205 shutdown_connections 2024-09-18T21:21:33.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.644+0000 7fc7e961e640 1 --2- 172.21.15.77:0/2613379205 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fc7cc06e0b0 0x7fc7cc070560 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:33.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.644+0000 7fc7e961e640 1 --2- 172.21.15.77:0/2613379205 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7e40fe4f0 0x7fc7e410f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:33.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.644+0000 7fc7e961e640 1 --2- 172.21.15.77:0/2613379205 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7e40fdba0 0x7fc7e410f2f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:33.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.644+0000 7fc7e961e640 1 -- 172.21.15.77:0/2613379205 >> 172.21.15.77:0/2613379205 conn(0x7fc7e40f6380 msgr2=0x7fc7e40f7aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:21:33.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.644+0000 7fc7e961e640 1 -- 172.21.15.77:0/2613379205 shutdown_connections 2024-09-18T21:21:33.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.644+0000 7fc7e961e640 1 -- 172.21.15.77:0/2613379205 wait complete. 2024-09-18T21:21:33.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.722+0000 7f4154026640 1 -- 172.21.15.77:0/3432157732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f414c0fc710 msgr2=0x7f414c0fcb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:33.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.722+0000 7f4154026640 1 --2- 172.21.15.77:0/3432157732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f414c0fc710 0x7f414c0fcb80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f413c0048d0 tx=0x7f413c009da0 comp rx=0 tx=0).stop 2024-09-18T21:21:33.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.722+0000 7f4154026640 1 -- 172.21.15.77:0/3432157732 shutdown_connections 2024-09-18T21:21:33.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.722+0000 7f4154026640 1 --2- 172.21.15.77:0/3432157732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f414c0fc710 0x7f414c0fcb80 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:33.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.722+0000 7f4154026640 1 --2- 172.21.15.77:0/3432157732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f414c0fb440 0x7f414c0fb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:33.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.722+0000 7f4154026640 1 -- 172.21.15.77:0/3432157732 >> 172.21.15.77:0/3432157732 conn(0x7f414c0f6c20 msgr2=0x7f414c0f9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:21:33.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.722+0000 7f4154026640 1 -- 172.21.15.77:0/3432157732 shutdown_connections 2024-09-18T21:21:33.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.722+0000 7f4154026640 1 -- 172.21.15.77:0/3432157732 wait complete. 2024-09-18T21:21:33.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.723+0000 7f4154026640 1 Processor -- start 2024-09-18T21:21:33.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.723+0000 7f4154026640 1 -- start start 2024-09-18T21:21:33.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.723+0000 7f4154026640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f414c0fb440 0x7f414c10bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:21:33.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.723+0000 7f4154026640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f414c0fc710 0x7f414c10c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:21:33.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.723+0000 7f4154026640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414c10cb60 con 0x7f414c0fc710 2024-09-18T21:21:33.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.723+0000 7f4154026640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414c10d380 con 0x7f414c0fb440 2024-09-18T21:21:33.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.723+0000 7f41515c1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f414c0fc710 0x7f414c10c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:21:33.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.723+0000 7f41515c1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f414c0fc710 0x7f414c10c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35558/0 (socket says 172.21.15.77:35558) 2024-09-18T21:21:33.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.723+0000 7f41515c1640 1 -- 172.21.15.77:0/2863798289 learned_addr learned my addr 172.21.15.77:0/2863798289 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:21:33.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.723+0000 7f4151dc2640 1 --2- 172.21.15.77:0/2863798289 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f414c0fb440 0x7f414c10bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:21:33.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.723+0000 7f41515c1640 1 -- 172.21.15.77:0/2863798289 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f414c0fb440 msgr2=0x7f414c10bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:33.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.723+0000 7f41515c1640 1 --2- 172.21.15.77:0/2863798289 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f414c0fb440 0x7f414c10bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:33.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.723+0000 7f41515c1640 1 -- 172.21.15.77:0/2863798289 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f413c005040 con 0x7f414c0fc710 2024-09-18T21:21:33.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.723+0000 7f41515c1640 1 --2- 172.21.15.77:0/2863798289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f414c0fc710 0x7f414c10c510 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f413c0043d0 tx=0x7f413c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:21:33.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.724+0000 7f41427fc640 1 -- 172.21.15.77:0/2863798289 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f413c038070 con 0x7f414c0fc710 2024-09-18T21:21:33.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.724+0000 7f41427fc640 1 -- 172.21.15.77:0/2863798289 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f413c02ae90 con 0x7f414c0fc710 2024-09-18T21:21:33.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.724+0000 7f4154026640 1 -- 172.21.15.77:0/2863798289 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f414c10d5b0 con 0x7f414c0fc710 2024-09-18T21:21:33.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.724+0000 7f41427fc640 1 -- 172.21.15.77:0/2863798289 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f413c03e670 con 0x7f414c0fc710 2024-09-18T21:21:33.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.724+0000 7f4154026640 1 -- 172.21.15.77:0/2863798289 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f414c10db50 con 0x7f414c0fc710 2024-09-18T21:21:33.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.725+0000 7f4154026640 1 -- 172.21.15.77:0/2863798289 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f414c0fa8a0 con 0x7f414c0fc710 2024-09-18T21:21:33.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.725+0000 7f41427fc640 1 -- 172.21.15.77:0/2863798289 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f413c030020 con 0x7f414c0fc710 2024-09-18T21:21:33.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.726+0000 7f41427fc640 1 --2- 172.21.15.77:0/2863798289 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f413806e0b0 0x7f4138070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:21:33.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.726+0000 7f41427fc640 1 -- 172.21.15.77:0/2863798289 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f413c0add30 con 0x7f414c0fc710 2024-09-18T21:21:33.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.726+0000 7f4151dc2640 1 --2- 172.21.15.77:0/2863798289 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f413806e0b0 0x7f4138070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:21:33.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.726+0000 7f4151dc2640 1 --2- 172.21.15.77:0/2863798289 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f413806e0b0 0x7f4138070560 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4148004ed0 tx=0x7f414800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:21:33.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.730+0000 7f41427fc640 1 -- 172.21.15.77:0/2863798289 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f413c077080 con 0x7f414c0fc710 2024-09-18T21:21:33.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.972+0000 7f4154026640 1 -- 172.21.15.77:0/2863798289 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f414c04b720 con 0x7f414c0fc710 2024-09-18T21:21:33.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.973+0000 7f41427fc640 1 -- 172.21.15.77:0/2863798289 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f413c07a740 con 0x7f414c0fc710 2024-09-18T21:21:33.974 INFO:teuthology.orchestra.run.smithi077.stdout:HEALTH_OK 2024-09-18T21:21:33.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.975+0000 7f4154026640 1 -- 172.21.15.77:0/2863798289 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f413806e0b0 msgr2=0x7f4138070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:33.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.975+0000 7f4154026640 1 --2- 172.21.15.77:0/2863798289 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f413806e0b0 0x7f4138070560 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4148004ed0 tx=0x7f414800b040 comp rx=0 tx=0).stop 2024-09-18T21:21:33.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.975+0000 7f4154026640 1 -- 172.21.15.77:0/2863798289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f414c0fc710 msgr2=0x7f414c10c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:21:33.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.975+0000 7f4154026640 1 --2- 172.21.15.77:0/2863798289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f414c0fc710 0x7f414c10c510 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f413c0043d0 tx=0x7f413c009da0 comp rx=0 tx=0).stop 2024-09-18T21:21:33.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.975+0000 7f4154026640 1 -- 172.21.15.77:0/2863798289 shutdown_connections 2024-09-18T21:21:33.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.975+0000 7f4154026640 1 --2- 172.21.15.77:0/2863798289 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f414c0fc710 0x7f414c10c510 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:33.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.975+0000 7f4154026640 1 --2- 172.21.15.77:0/2863798289 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f413806e0b0 0x7f4138070560 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:33.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.975+0000 7f4154026640 1 --2- 172.21.15.77:0/2863798289 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f414c0fb440 0x7f414c10bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:21:33.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.975+0000 7f4154026640 1 -- 172.21.15.77:0/2863798289 >> 172.21.15.77:0/2863798289 conn(0x7f414c0f6c20 msgr2=0x7f414c0f8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:21:33.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.975+0000 7f4154026640 1 -- 172.21.15.77:0/2863798289 shutdown_connections 2024-09-18T21:21:33.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:21:33.975+0000 7f4154026640 1 -- 172.21.15.77:0/2863798289 wait complete. 2024-09-18T21:21:34.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:33 smithi077 ceph-mon[92672]: from='client.34498 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:21:34.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:33 smithi077 ceph-mon[92672]: from='client.34502 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:21:34.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:33 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/1565044123' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T21:21:34.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:33 smithi103 ceph-mon[80307]: from='client.34498 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:21:34.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:33 smithi103 ceph-mon[80307]: from='client.34502 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:21:34.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:33 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/1565044123' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T21:21:35.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:34 smithi077 ceph-mon[92672]: from='client.34514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:21:35.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:34 smithi077 ceph-mon[92672]: pgmap v231: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:35.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:34 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/2863798289' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T21:21:35.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:34 smithi103 ceph-mon[80307]: from='client.34514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:21:35.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:34 smithi103 ceph-mon[80307]: pgmap v231: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:35.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:34 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/2863798289' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T21:21:36.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:35 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:21:36.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:35 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:21:37.057 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:36 smithi077 ceph-mon[92672]: pgmap v232: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:37.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:36 smithi103 ceph-mon[80307]: pgmap v232: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:39.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:38 smithi077 ceph-mon[92672]: pgmap v233: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:39.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:38 smithi103 ceph-mon[80307]: pgmap v233: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:40.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:39 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:40.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:39 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:40.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:39 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:21:40.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:39 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:40.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:39 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:40.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:39 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:21:41.202 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:40 smithi077 ceph-mon[92672]: pgmap v234: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:41.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:40 smithi103 ceph-mon[80307]: pgmap v234: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:43.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:42 smithi077 ceph-mon[92672]: pgmap v235: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:43.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:42 smithi103 ceph-mon[80307]: pgmap v235: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:44.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:44 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:44.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:44 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:44.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:44 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:44.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:44 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:44.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:44 smithi077 ceph-mon[92672]: pgmap v236: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:44.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:44 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:44.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:44 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:44.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:44 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:44.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:44 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:44.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:44 smithi103 ceph-mon[80307]: pgmap v236: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:47.140 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:46 smithi077 ceph-mon[92672]: pgmap v237: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:47.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:46 smithi103 ceph-mon[80307]: pgmap v237: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:48.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:48.464 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:48.464 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:21:48.464 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:21:48.464 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:48.464 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-18T21:21:48.464 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-18T21:21:48.464 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:21:48.464 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:48.464 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:48.464 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:48.464 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:48.464 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:48.465 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:48.465 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:48.465 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:48.465 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:48.465 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:48.465 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:48.465 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:48.465 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:48.465 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:48.465 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:48.465 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:48.465 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:48.465 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:48.465 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: Upgrade: Finalizing container_image settings 2024-09-18T21:21:48.466 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:48.466 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-18T21:21:48.466 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-18T21:21:48.466 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-18T21:21:48.466 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-18T21:21:48.466 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-18T21:21:48.466 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-18T21:21:48.466 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-18T21:21:48.466 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-18T21:21:48.466 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-18T21:21:48.466 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-18T21:21:48.466 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-18T21:21:48.466 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-18T21:21:48.466 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-18T21:21:48.466 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-18T21:21:48.467 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-18T21:21:48.467 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-18T21:21:48.467 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-18T21:21:48.467 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-18T21:21:48.467 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-18T21:21:48.467 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-18T21:21:48.467 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-18T21:21:48.467 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-18T21:21:48.467 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-18T21:21:48.467 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-18T21:21:48.467 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-18T21:21:48.467 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-18T21:21:48.467 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-18T21:21:48.467 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-18T21:21:48.467 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-18T21:21:48.468 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: Upgrade: Complete! 2024-09-18T21:21:48.468 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-18T21:21:48.468 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-18T21:21:48.468 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:21:48.468 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:21:48.468 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:21:48.468 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:48.468 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:21:48.468 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:21:48.468 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:21:48.468 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:48.468 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:48 smithi077 ceph-mon[92672]: pgmap v238: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:48.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:48.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:48.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:21:48.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:21:48.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:48.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-18T21:21:48.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-18T21:21:48.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:21:48.515 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:48.515 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:48.515 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:48.515 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:48.515 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:48.515 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:48.515 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:48.515 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:48.515 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:48.515 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:48.515 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:48.515 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:48.515 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:48.515 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:48.515 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:48.516 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:48.516 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:48.516 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:21:48.516 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: Upgrade: Finalizing container_image settings 2024-09-18T21:21:48.516 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:48.516 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-18T21:21:48.516 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-18T21:21:48.516 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-18T21:21:48.516 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-18T21:21:48.516 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-18T21:21:48.516 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-18T21:21:48.516 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-18T21:21:48.516 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-18T21:21:48.516 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-18T21:21:48.517 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-18T21:21:48.517 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-18T21:21:48.517 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-18T21:21:48.517 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-18T21:21:48.517 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-18T21:21:48.517 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-18T21:21:48.517 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-18T21:21:48.517 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-18T21:21:48.517 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-18T21:21:48.517 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-18T21:21:48.517 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-18T21:21:48.518 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-18T21:21:48.518 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-18T21:21:48.518 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-18T21:21:48.518 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-18T21:21:48.518 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-18T21:21:48.518 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-18T21:21:48.518 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-18T21:21:48.518 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-18T21:21:48.518 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-18T21:21:48.518 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: Upgrade: Complete! 2024-09-18T21:21:48.518 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-18T21:21:48.518 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-18T21:21:48.519 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:21:48.519 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:21:48.519 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:21:48.519 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:48.519 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:21:48.519 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:21:48.519 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:21:48.519 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:48.519 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:48 smithi103 ceph-mon[80307]: pgmap v238: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:51.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:50 smithi077 ceph-mon[92672]: pgmap v239: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:51.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:50 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:21:51.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:50 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:51.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:50 smithi103 ceph-mon[80307]: pgmap v239: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:51.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:50 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:21:51.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:50 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:21:53.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:52 smithi077 ceph-mon[92672]: pgmap v240: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:53.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:52 smithi103 ceph-mon[80307]: pgmap v240: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:55.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:54 smithi077 ceph-mon[92672]: pgmap v241: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:55.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:54 smithi103 ceph-mon[80307]: pgmap v241: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:57.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:56 smithi077 ceph-mon[92672]: pgmap v242: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:57.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:56 smithi103 ceph-mon[80307]: pgmap v242: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:59.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:21:58 smithi077 ceph-mon[92672]: pgmap v243: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:21:59.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:21:58 smithi103 ceph-mon[80307]: pgmap v243: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:01.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:22:00 smithi077 ceph-mon[92672]: pgmap v244: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:01.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:22:00 smithi103 ceph-mon[80307]: pgmap v244: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:03.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:22:02 smithi077 ceph-mon[92672]: pgmap v245: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:03.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:22:02 smithi103 ceph-mon[80307]: pgmap v245: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:04.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:04.063+0000 7f1e9b32f640 1 -- 172.21.15.77:0/1707215472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e940fd820 msgr2=0x7f1e940fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:22:04.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:04.063+0000 7f1e9b32f640 1 --2- 172.21.15.77:0/1707215472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e940fd820 0x7f1e940fdc90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1e900048d0 tx=0x7f1e90009da0 comp rx=0 tx=0).stop 2024-09-18T21:22:04.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:04.064+0000 7f1e9b32f640 1 -- 172.21.15.77:0/1707215472 shutdown_connections 2024-09-18T21:22:04.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:04.064+0000 7f1e9b32f640 1 --2- 172.21.15.77:0/1707215472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e940fd820 0x7f1e940fdc90 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:22:04.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:04.064+0000 7f1e9b32f640 1 --2- 172.21.15.77:0/1707215472 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e940fc550 0x7f1e940fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:22:04.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:04.064+0000 7f1e9b32f640 1 -- 172.21.15.77:0/1707215472 >> 172.21.15.77:0/1707215472 conn(0x7f1e940f7d30 msgr2=0x7f1e940fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:22:04.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:04.064+0000 7f1e9b32f640 1 -- 172.21.15.77:0/1707215472 shutdown_connections 2024-09-18T21:22:04.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:04.064+0000 7f1e9b32f640 1 -- 172.21.15.77:0/1707215472 wait complete. 2024-09-18T21:22:04.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:04.064+0000 7f1e9b32f640 1 Processor -- start 2024-09-18T21:22:04.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:04.064+0000 7f1e9b32f640 1 -- start start 2024-09-18T21:22:04.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:04.064+0000 7f1e9b32f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e940fc550 0x7f1e94071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:22:04.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:04.064+0000 7f1e9b32f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e940fd820 0x7f1e9406fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:22:04.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:04.064+0000 7f1e9b32f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9406fff0 con 0x7f1e940fc550 2024-09-18T21:22:04.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:04.064+0000 7f1e9b32f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e94070130 con 0x7f1e940fd820 2024-09-18T21:22:04.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:04.065+0000 7f1e990cb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e940fc550 0x7f1e94071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:22:04.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:04.065+0000 7f1e990cb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e940fc550 0x7f1e94071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45810/0 (socket says 172.21.15.77:45810) 2024-09-18T21:22:04.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:04.065+0000 7f1e990cb640 1 -- 172.21.15.77:0/999110722 learned_addr learned my addr 172.21.15.77:0/999110722 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:22:04.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:04.065+0000 7f1e988ca640 1 --2- 172.21.15.77:0/999110722 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e940fd820 0x7f1e9406fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:22:04.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:04.065+0000 7f1e990cb640 1 -- 172.21.15.77:0/999110722 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e940fd820 msgr2=0x7f1e9406fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:22:04.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:04.065+0000 7f1e990cb640 1 --2- 172.21.15.77:0/999110722 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e940fd820 0x7f1e9406fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:22:04.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:04.065+0000 7f1e990cb640 1 -- 172.21.15.77:0/999110722 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e90005040 con 0x7f1e940fc550 2024-09-18T21:22:04.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:04.065+0000 7f1e988ca640 1 --2- 172.21.15.77:0/999110722 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e940fd820 0x7f1e9406fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T21:22:04.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:04.065+0000 7f1e990cb640 1 --2- 172.21.15.77:0/999110722 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e940fc550 0x7f1e94071570 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1e8400eb70 tx=0x7f1e8400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:22:04.069 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:04.065+0000 7f1e89ffb640 1 -- 172.21.15.77:0/999110722 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e84007c30 con 0x7f1e940fc550 2024-09-18T21:22:04.069 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:04.065+0000 7f1e89ffb640 1 -- 172.21.15.77:0/999110722 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1e8400f040 con 0x7f1e940fc550 2024-09-18T21:22:04.069 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:04.065+0000 7f1e9b32f640 1 -- 172.21.15.77:0/999110722 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e940703b0 con 0x7f1e940fc550 2024-09-18T21:22:04.069 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:04.065+0000 7f1e89ffb640 1 -- 172.21.15.77:0/999110722 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e840094e0 con 0x7f1e940fc550 2024-09-18T21:22:04.069 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:04.066+0000 7f1e9b32f640 1 -- 172.21.15.77:0/999110722 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e94115100 con 0x7f1e940fc550 2024-09-18T21:22:04.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:04.067+0000 7f1e9b32f640 1 -- 172.21.15.77:0/999110722 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e940fb9b0 con 0x7f1e940fc550 2024-09-18T21:22:04.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:04.067+0000 7f1e89ffb640 1 -- 172.21.15.77:0/999110722 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f1e84009640 con 0x7f1e940fc550 2024-09-18T21:22:04.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:04.067+0000 7f1e89ffb640 1 --2- 172.21.15.77:0/999110722 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f1e8006e0b0 0x7f1e80070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:22:04.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:04.067+0000 7f1e89ffb640 1 -- 172.21.15.77:0/999110722 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f1e8408d8e0 con 0x7f1e940fc550 2024-09-18T21:22:04.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:04.067+0000 7f1e988ca640 1 --2- 172.21.15.77:0/999110722 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f1e8006e0b0 0x7f1e80070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:22:04.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:04.068+0000 7f1e988ca640 1 --2- 172.21.15.77:0/999110722 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f1e8006e0b0 0x7f1e80070560 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1e90007ac0 tx=0x7f1e90035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:22:04.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:04.072+0000 7f1e89ffb640 1 -- 172.21.15.77:0/999110722 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f1e84056be0 con 0x7f1e940fc550 2024-09-18T21:22:04.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:04.253+0000 7f1e9b32f640 1 -- 172.21.15.77:0/999110722 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e94101c40 con 0x7f1e8006e0b0 2024-09-18T21:22:04.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:04.255+0000 7f1e89ffb640 1 -- 172.21.15.77:0/999110722 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f1e94101c40 con 0x7f1e8006e0b0 2024-09-18T21:22:04.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:04.257+0000 7f1e9b32f640 1 -- 172.21.15.77:0/999110722 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f1e8006e0b0 msgr2=0x7f1e80070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:22:04.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:04.257+0000 7f1e9b32f640 1 --2- 172.21.15.77:0/999110722 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f1e8006e0b0 0x7f1e80070560 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1e90007ac0 tx=0x7f1e90035040 comp rx=0 tx=0).stop 2024-09-18T21:22:04.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:04.257+0000 7f1e9b32f640 1 -- 172.21.15.77:0/999110722 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e940fc550 msgr2=0x7f1e94071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:22:04.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:04.257+0000 7f1e9b32f640 1 --2- 172.21.15.77:0/999110722 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e940fc550 0x7f1e94071570 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1e8400eb70 tx=0x7f1e8400b040 comp rx=0 tx=0).stop 2024-09-18T21:22:04.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:04.257+0000 7f1e9b32f640 1 -- 172.21.15.77:0/999110722 shutdown_connections 2024-09-18T21:22:04.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:04.257+0000 7f1e9b32f640 1 --2- 172.21.15.77:0/999110722 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f1e8006e0b0 0x7f1e80070560 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:22:04.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:04.257+0000 7f1e9b32f640 1 --2- 172.21.15.77:0/999110722 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e940fd820 0x7f1e9406fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:22:04.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:04.257+0000 7f1e9b32f640 1 --2- 172.21.15.77:0/999110722 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e940fc550 0x7f1e94071570 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:22:04.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:04.257+0000 7f1e9b32f640 1 -- 172.21.15.77:0/999110722 >> 172.21.15.77:0/999110722 conn(0x7f1e940f7d30 msgr2=0x7f1e940f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:22:04.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:04.257+0000 7f1e9b32f640 1 -- 172.21.15.77:0/999110722 shutdown_connections 2024-09-18T21:22:04.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:04.257+0000 7f1e9b32f640 1 -- 172.21.15.77:0/999110722 wait complete. 2024-09-18T21:22:04.934 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -e sha1=06b1b1de896d25f0645e4a306558ab0b4d4fc56f -- bash -c 'ceph orch ps' 2024-09-18T21:22:05.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:22:04 smithi077 ceph-mon[92672]: pgmap v246: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:05.222 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:22:05.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:22:04 smithi103 ceph-mon[80307]: pgmap v246: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:06.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:22:05 smithi077 ceph-mon[92672]: from='client.34522 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:22:06.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:22:05 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:22:06.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:22:05 smithi103 ceph-mon[80307]: from='client.34522 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:22:06.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:22:05 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:22:06.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:06.786+0000 7f4993090640 1 -- 172.21.15.77:0/4252778382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f498c1047e0 msgr2=0x7f498c104bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:22:06.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:06.786+0000 7f4993090640 1 --2- 172.21.15.77:0/4252778382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f498c1047e0 0x7f498c104bb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f49800048d0 tx=0x7f4980009da0 comp rx=0 tx=0).stop 2024-09-18T21:22:06.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:06.787+0000 7f4993090640 1 -- 172.21.15.77:0/4252778382 shutdown_connections 2024-09-18T21:22:06.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:06.787+0000 7f4993090640 1 --2- 172.21.15.77:0/4252778382 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f498c0fe7c0 0x7f498c0fec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:22:06.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:06.787+0000 7f4993090640 1 --2- 172.21.15.77:0/4252778382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f498c1047e0 0x7f498c104bb0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:22:06.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:06.787+0000 7f4993090640 1 -- 172.21.15.77:0/4252778382 >> 172.21.15.77:0/4252778382 conn(0x7f498c0fa340 msgr2=0x7f498c0fc750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:22:06.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:06.787+0000 7f4993090640 1 -- 172.21.15.77:0/4252778382 shutdown_connections 2024-09-18T21:22:06.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:06.787+0000 7f4993090640 1 -- 172.21.15.77:0/4252778382 wait complete. 2024-09-18T21:22:06.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:06.787+0000 7f4993090640 1 Processor -- start 2024-09-18T21:22:06.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:06.787+0000 7f4993090640 1 -- start start 2024-09-18T21:22:06.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:06.788+0000 7f4993090640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f498c0fe7c0 0x7f498c115390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:22:06.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:06.788+0000 7f4993090640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f498c1047e0 0x7f498c1158d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:22:06.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:06.788+0000 7f4993090640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498c115ed0 con 0x7f498c0fe7c0 2024-09-18T21:22:06.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:06.788+0000 7f4993090640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498c10f310 con 0x7f498c1047e0 2024-09-18T21:22:06.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:06.788+0000 7f4990e2c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f498c0fe7c0 0x7f498c115390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:22:06.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:06.788+0000 7f4990e2c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f498c0fe7c0 0x7f498c115390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45830/0 (socket says 172.21.15.77:45830) 2024-09-18T21:22:06.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:06.788+0000 7f4990e2c640 1 -- 172.21.15.77:0/3243429432 learned_addr learned my addr 172.21.15.77:0/3243429432 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:22:06.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:06.788+0000 7f498bfff640 1 --2- 172.21.15.77:0/3243429432 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f498c1047e0 0x7f498c1158d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:22:06.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:06.788+0000 7f4990e2c640 1 -- 172.21.15.77:0/3243429432 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f498c1047e0 msgr2=0x7f498c1158d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:22:06.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:06.788+0000 7f4990e2c640 1 --2- 172.21.15.77:0/3243429432 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f498c1047e0 0x7f498c1158d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:22:06.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:06.788+0000 7f4990e2c640 1 -- 172.21.15.77:0/3243429432 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4980005040 con 0x7f498c0fe7c0 2024-09-18T21:22:06.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:06.788+0000 7f4990e2c640 1 --2- 172.21.15.77:0/3243429432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f498c0fe7c0 0x7f498c115390 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4980000c00 tx=0x7f4980009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:22:06.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:06.789+0000 7f49897fa640 1 -- 172.21.15.77:0/3243429432 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4980038070 con 0x7f498c0fe7c0 2024-09-18T21:22:06.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:06.789+0000 7f4993090640 1 -- 172.21.15.77:0/3243429432 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f498c10f590 con 0x7f498c0fe7c0 2024-09-18T21:22:06.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:06.789+0000 7f49897fa640 1 -- 172.21.15.77:0/3243429432 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f498002ade0 con 0x7f498c0fe7c0 2024-09-18T21:22:06.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:06.789+0000 7f49897fa640 1 -- 172.21.15.77:0/3243429432 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f498002c7e0 con 0x7f498c0fe7c0 2024-09-18T21:22:06.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:06.789+0000 7f4993090640 1 -- 172.21.15.77:0/3243429432 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f498c10fad0 con 0x7f498c0fe7c0 2024-09-18T21:22:06.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:06.790+0000 7f4993090640 1 -- 172.21.15.77:0/3243429432 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f498c0fff00 con 0x7f498c0fe7c0 2024-09-18T21:22:06.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:06.790+0000 7f49897fa640 1 -- 172.21.15.77:0/3243429432 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f4980030020 con 0x7f498c0fe7c0 2024-09-18T21:22:06.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:06.791+0000 7f49897fa640 1 --2- 172.21.15.77:0/3243429432 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f497c06e0b0 0x7f497c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:22:06.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:06.791+0000 7f49897fa640 1 -- 172.21.15.77:0/3243429432 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f49800ad8c0 con 0x7f498c0fe7c0 2024-09-18T21:22:06.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:06.791+0000 7f498bfff640 1 --2- 172.21.15.77:0/3243429432 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f497c06e0b0 0x7f497c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:22:06.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:06.791+0000 7f498bfff640 1 --2- 172.21.15.77:0/3243429432 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f497c06e0b0 0x7f497c070560 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f498c110c50 tx=0x7f497800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:22:06.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:06.795+0000 7f49897fa640 1 -- 172.21.15.77:0/3243429432 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f4980076bf0 con 0x7f498c0fe7c0 2024-09-18T21:22:06.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:06.971+0000 7f4993090640 1 -- 172.21.15.77:0/3243429432 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f498c04b720 con 0x7f497c06e0b0 2024-09-18T21:22:06.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:06.979+0000 7f49897fa640 1 -- 172.21.15.77:0/3243429432 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f498c04b720 con 0x7f497c06e0b0 2024-09-18T21:22:06.984 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T21:22:06.984 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager.smithi077 smithi077 *:9093,9094 running (49s) 23s ago 16m 15.5M - 0.25.0 c8568f914cd2 d3072897529c 2024-09-18T21:22:06.984 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi077 smithi077 running (6m) 23s ago 17m 6891k - 19.1.1-17-g06b1b1de f79f744f586d 5872fa24b792 2024-09-18T21:22:06.984 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi103 smithi103 running (6m) 77s ago 16m 6887k - 19.1.1-17-g06b1b1de f79f744f586d cd1604469f34 2024-09-18T21:22:06.984 INFO:teuthology.orchestra.run.smithi077.stdout:grafana.smithi077 smithi077 *:3000 running (28s) 23s ago 16m 47.8M - 9.4.12 2bacad6d85d8 8fbd93e066f3 2024-09-18T21:22:06.985 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.cqfhlw smithi077 running (2m) 23s ago 11m 13.6M - 19.1.1-17-g06b1b1de f79f744f586d c74ffc2ebb80 2024-09-18T21:22:06.985 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.vruydi smithi077 running (2m) 23s ago 11m 84.8M - 19.1.1-17-g06b1b1de f79f744f586d ce474ff0a948 2024-09-18T21:22:06.985 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi103.opftmf smithi103 running (93s) 77s ago 11m 13.1M - 19.1.1-17-g06b1b1de f79f744f586d 02c8e0b7ba0a 2024-09-18T21:22:06.985 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi103.zhdmdg smithi103 running (115s) 77s ago 11m 12.4M - 19.1.1-17-g06b1b1de f79f744f586d 84d9d5a98395 2024-09-18T21:22:06.985 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi077.utkpjg smithi077 *:8443,9283,8765 running (8m) 23s ago 18m 518M - 19.1.1-17-g06b1b1de f79f744f586d 99d4b0fd70f6 2024-09-18T21:22:06.985 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi103.zjztqc smithi103 *:8443,9283,8765 running (7m) 77s ago 16m 442M - 19.1.1-17-g06b1b1de f79f744f586d 54589547c4d7 2024-09-18T21:22:06.985 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi077 smithi077 running (7m) 23s ago 18m 53.0M 2048M 19.1.1-17-g06b1b1de f79f744f586d 2d0fbbea1264 2024-09-18T21:22:06.985 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi103 smithi103 running (6m) 77s ago 15m 39.5M 2048M 19.1.1-17-g06b1b1de f79f744f586d dc79edbd9602 2024-09-18T21:22:06.985 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi077 smithi077 *:9100 running (83s) 23s ago 16m 9995k - 1.5.0 0da6a335fe13 f880828c375d 2024-09-18T21:22:06.985 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi103 smithi103 *:9100 running (79s) 77s ago 16m 5473k - 1.5.0 0da6a335fe13 33e42737d4e1 2024-09-18T21:22:06.985 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (5m) 23s ago 15m 101M 1557M 19.1.1-17-g06b1b1de f79f744f586d 8855b4b16e00 2024-09-18T21:22:06.985 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi077 running (5m) 23s ago 14m 115M 1557M 19.1.1-17-g06b1b1de f79f744f586d 2d8bc9cac96c 2024-09-18T21:22:06.985 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi077 running (4m) 23s ago 14m 103M 1557M 19.1.1-17-g06b1b1de f79f744f586d 93876f1d398d 2024-09-18T21:22:06.986 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi103 running (4m) 77s ago 14m 121M 2581M 19.1.1-17-g06b1b1de f79f744f586d 2556b257bf1c 2024-09-18T21:22:06.986 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi103 running (3m) 77s ago 13m 99.2M 2581M 19.1.1-17-g06b1b1de f79f744f586d 2cde7eaf88d8 2024-09-18T21:22:06.986 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi103 running (3m) 77s ago 13m 100M 2581M 19.1.1-17-g06b1b1de f79f744f586d e6912ab63ecc 2024-09-18T21:22:06.986 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus.smithi077 smithi077 *:9095 running (64s) 23s ago 16m 46.9M - 2.43.0 a07b618ecd1d d877a4113362 2024-09-18T21:22:06.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:06.981+0000 7f4993090640 1 -- 172.21.15.77:0/3243429432 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f497c06e0b0 msgr2=0x7f497c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:22:06.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:06.981+0000 7f4993090640 1 --2- 172.21.15.77:0/3243429432 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f497c06e0b0 0x7f497c070560 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f498c110c50 tx=0x7f497800b040 comp rx=0 tx=0).stop 2024-09-18T21:22:06.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:06.982+0000 7f4993090640 1 -- 172.21.15.77:0/3243429432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f498c0fe7c0 msgr2=0x7f498c115390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:22:06.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:06.982+0000 7f4993090640 1 --2- 172.21.15.77:0/3243429432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f498c0fe7c0 0x7f498c115390 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4980000c00 tx=0x7f4980009da0 comp rx=0 tx=0).stop 2024-09-18T21:22:06.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:06.982+0000 7f4993090640 1 -- 172.21.15.77:0/3243429432 shutdown_connections 2024-09-18T21:22:06.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:06.982+0000 7f4993090640 1 --2- 172.21.15.77:0/3243429432 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f497c06e0b0 0x7f497c070560 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:22:06.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:06.982+0000 7f4993090640 1 --2- 172.21.15.77:0/3243429432 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f498c1047e0 0x7f498c1158d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:22:06.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:06.982+0000 7f4993090640 1 --2- 172.21.15.77:0/3243429432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f498c0fe7c0 0x7f498c115390 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:22:06.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:06.982+0000 7f4993090640 1 -- 172.21.15.77:0/3243429432 >> 172.21.15.77:0/3243429432 conn(0x7f498c0fa340 msgr2=0x7f498c0fb340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:22:06.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:06.982+0000 7f4993090640 1 -- 172.21.15.77:0/3243429432 shutdown_connections 2024-09-18T21:22:06.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:06.982+0000 7f4993090640 1 -- 172.21.15.77:0/3243429432 wait complete. 2024-09-18T21:22:07.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:22:06 smithi077 ceph-mon[92672]: pgmap v247: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:07.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:22:06 smithi103 ceph-mon[80307]: pgmap v247: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:07.622 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -e sha1=06b1b1de896d25f0645e4a306558ab0b4d4fc56f -- bash -c 'ceph orch upgrade status' 2024-09-18T21:22:07.881 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:22:08.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:22:07 smithi077 ceph-mon[92672]: from='client.34526 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:22:08.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:22:07 smithi103 ceph-mon[80307]: from='client.34526 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:22:09.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:22:09 smithi077 ceph-mon[92672]: pgmap v248: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:09.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:22:09 smithi103 ceph-mon[80307]: pgmap v248: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:09.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:09.454+0000 7f3bb94f8640 1 -- 172.21.15.77:0/3122575099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3bb41014d0 msgr2=0x7f3bb41018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:22:09.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:09.454+0000 7f3bb94f8640 1 --2- 172.21.15.77:0/3122575099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3bb41014d0 0x7f3bb41018a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3ba40048d0 tx=0x7f3ba4009da0 comp rx=0 tx=0).stop 2024-09-18T21:22:09.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:09.454+0000 7f3bb94f8640 1 -- 172.21.15.77:0/3122575099 shutdown_connections 2024-09-18T21:22:09.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:09.454+0000 7f3bb94f8640 1 --2- 172.21.15.77:0/3122575099 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bb40fb490 0x7f3bb40fb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:22:09.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:09.454+0000 7f3bb94f8640 1 --2- 172.21.15.77:0/3122575099 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3bb41014d0 0x7f3bb41018a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:22:09.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:09.454+0000 7f3bb94f8640 1 -- 172.21.15.77:0/3122575099 >> 172.21.15.77:0/3122575099 conn(0x7f3bb40f7010 msgr2=0x7f3bb40f9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:22:09.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:09.454+0000 7f3bb94f8640 1 -- 172.21.15.77:0/3122575099 shutdown_connections 2024-09-18T21:22:09.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:09.454+0000 7f3bb94f8640 1 -- 172.21.15.77:0/3122575099 wait complete. 2024-09-18T21:22:09.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:09.455+0000 7f3bb94f8640 1 Processor -- start 2024-09-18T21:22:09.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:09.455+0000 7f3bb94f8640 1 -- start start 2024-09-18T21:22:09.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:09.455+0000 7f3bb94f8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bb40fb490 0x7f3bb41132a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:22:09.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:09.455+0000 7f3bb94f8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3bb41014d0 0x7f3bb41137e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:22:09.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:09.455+0000 7f3bb94f8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb4113e70 con 0x7f3bb41014d0 2024-09-18T21:22:09.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:09.455+0000 7f3bb94f8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb410d220 con 0x7f3bb40fb490 2024-09-18T21:22:09.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:09.455+0000 7f3bb27fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3bb41014d0 0x7f3bb41137e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:22:09.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:09.455+0000 7f3bb27fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3bb41014d0 0x7f3bb41137e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38178/0 (socket says 172.21.15.77:38178) 2024-09-18T21:22:09.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:09.455+0000 7f3bb27fc640 1 -- 172.21.15.77:0/2533189468 learned_addr learned my addr 172.21.15.77:0/2533189468 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:22:09.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:09.455+0000 7f3bb2ffd640 1 --2- 172.21.15.77:0/2533189468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bb40fb490 0x7f3bb41132a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:22:09.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:09.455+0000 7f3bb27fc640 1 -- 172.21.15.77:0/2533189468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bb40fb490 msgr2=0x7f3bb41132a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:22:09.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:09.455+0000 7f3bb27fc640 1 --2- 172.21.15.77:0/2533189468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bb40fb490 0x7f3bb41132a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:22:09.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:09.455+0000 7f3bb27fc640 1 -- 172.21.15.77:0/2533189468 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba4005040 con 0x7f3bb41014d0 2024-09-18T21:22:09.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:09.456+0000 7f3bb27fc640 1 --2- 172.21.15.77:0/2533189468 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3bb41014d0 0x7f3bb41137e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3ba800b790 tx=0x7f3ba80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:22:09.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:09.456+0000 7f3b9b7fe640 1 -- 172.21.15.77:0/2533189468 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ba800c700 con 0x7f3bb41014d0 2024-09-18T21:22:09.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:09.456+0000 7f3bb94f8640 1 -- 172.21.15.77:0/2533189468 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bb410d500 con 0x7f3bb41014d0 2024-09-18T21:22:09.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:09.456+0000 7f3b9b7fe640 1 -- 172.21.15.77:0/2533189468 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3ba800cd00 con 0x7f3bb41014d0 2024-09-18T21:22:09.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:09.456+0000 7f3b9b7fe640 1 -- 172.21.15.77:0/2533189468 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ba8015e70 con 0x7f3bb41014d0 2024-09-18T21:22:09.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:09.456+0000 7f3bb94f8640 1 -- 172.21.15.77:0/2533189468 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb410da20 con 0x7f3bb41014d0 2024-09-18T21:22:09.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:09.457+0000 7f3bb94f8640 1 -- 172.21.15.77:0/2533189468 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bb40fcbd0 con 0x7f3bb41014d0 2024-09-18T21:22:09.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:09.457+0000 7f3b9b7fe640 1 -- 172.21.15.77:0/2533189468 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f3ba8012070 con 0x7f3bb41014d0 2024-09-18T21:22:09.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:09.458+0000 7f3b9b7fe640 1 --2- 172.21.15.77:0/2533189468 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f3b9c06e0b0 0x7f3b9c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:22:09.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:09.458+0000 7f3b9b7fe640 1 -- 172.21.15.77:0/2533189468 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f3ba808d7d0 con 0x7f3bb41014d0 2024-09-18T21:22:09.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:09.458+0000 7f3bb2ffd640 1 --2- 172.21.15.77:0/2533189468 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f3b9c06e0b0 0x7f3b9c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:22:09.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:09.458+0000 7f3bb2ffd640 1 --2- 172.21.15.77:0/2533189468 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f3b9c06e0b0 0x7f3b9c070560 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3ba4009ac0 tx=0x7f3ba4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:22:09.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:09.462+0000 7f3b9b7fe640 1 -- 172.21.15.77:0/2533189468 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f3ba8056ac0 con 0x7f3bb41014d0 2024-09-18T21:22:09.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:09.644+0000 7f3bb94f8640 1 -- 172.21.15.77:0/2533189468 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3bb4108530 con 0x7f3b9c06e0b0 2024-09-18T21:22:09.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:09.645+0000 7f3b9b7fe640 1 -- 172.21.15.77:0/2533189468 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f3bb4108530 con 0x7f3b9c06e0b0 2024-09-18T21:22:09.647 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-18T21:22:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: "target_image": null, 2024-09-18T21:22:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: "in_progress": false, 2024-09-18T21:22:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: "which": "", 2024-09-18T21:22:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: "services_complete": [], 2024-09-18T21:22:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: "progress": null, 2024-09-18T21:22:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: "message": "", 2024-09-18T21:22:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: "is_paused": false 2024-09-18T21:22:09.648 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-18T21:22:09.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:09.648+0000 7f3bb94f8640 1 -- 172.21.15.77:0/2533189468 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f3b9c06e0b0 msgr2=0x7f3b9c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:22:09.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:09.648+0000 7f3bb94f8640 1 --2- 172.21.15.77:0/2533189468 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f3b9c06e0b0 0x7f3b9c070560 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3ba4009ac0 tx=0x7f3ba4035040 comp rx=0 tx=0).stop 2024-09-18T21:22:09.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:09.648+0000 7f3bb94f8640 1 -- 172.21.15.77:0/2533189468 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3bb41014d0 msgr2=0x7f3bb41137e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:22:09.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:09.648+0000 7f3bb94f8640 1 --2- 172.21.15.77:0/2533189468 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3bb41014d0 0x7f3bb41137e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3ba800b790 tx=0x7f3ba80091d0 comp rx=0 tx=0).stop 2024-09-18T21:22:09.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:09.648+0000 7f3bb94f8640 1 -- 172.21.15.77:0/2533189468 shutdown_connections 2024-09-18T21:22:09.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:09.648+0000 7f3bb94f8640 1 --2- 172.21.15.77:0/2533189468 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3bb41014d0 0x7f3bb41137e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:22:09.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:09.648+0000 7f3bb94f8640 1 --2- 172.21.15.77:0/2533189468 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f3b9c06e0b0 0x7f3b9c070560 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:22:09.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:09.648+0000 7f3bb94f8640 1 --2- 172.21.15.77:0/2533189468 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3bb40fb490 0x7f3bb41132a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:22:09.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:09.648+0000 7f3bb94f8640 1 -- 172.21.15.77:0/2533189468 >> 172.21.15.77:0/2533189468 conn(0x7f3bb40f7010 msgr2=0x7f3bb41052c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:22:09.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:09.648+0000 7f3bb94f8640 1 -- 172.21.15.77:0/2533189468 shutdown_connections 2024-09-18T21:22:09.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:09.648+0000 7f3bb94f8640 1 -- 172.21.15.77:0/2533189468 wait complete. 2024-09-18T21:22:10.248 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -e sha1=06b1b1de896d25f0645e4a306558ab0b4d4fc56f -- bash -c 'ceph health detail' 2024-09-18T21:22:10.497 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:22:11.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:22:11 smithi077 ceph-mon[92672]: from='client.34530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:22:11.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:22:11 smithi077 ceph-mon[92672]: pgmap v249: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:11.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:22:11 smithi103 ceph-mon[80307]: from='client.34530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:22:11.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:22:11 smithi103 ceph-mon[80307]: pgmap v249: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:12.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:12.084+0000 7f9c12cc5640 1 -- 172.21.15.77:0/3706835672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c0c102550 msgr2=0x7f9c0c102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:22:12.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:12.084+0000 7f9c12cc5640 1 --2- 172.21.15.77:0/3706835672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c0c102550 0x7f9c0c102920 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9c000048d0 tx=0x7f9c00009da0 comp rx=0 tx=0).stop 2024-09-18T21:22:12.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:12.084+0000 7f9c12cc5640 1 -- 172.21.15.77:0/3706835672 shutdown_connections 2024-09-18T21:22:12.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:12.084+0000 7f9c12cc5640 1 --2- 172.21.15.77:0/3706835672 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c0c102ef0 0x7f9c0c0fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:22:12.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:12.084+0000 7f9c12cc5640 1 --2- 172.21.15.77:0/3706835672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c0c102550 0x7f9c0c102920 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:22:12.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:12.084+0000 7f9c12cc5640 1 -- 172.21.15.77:0/3706835672 >> 172.21.15.77:0/3706835672 conn(0x7f9c0c0f80f0 msgr2=0x7f9c0c0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:22:12.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:12.084+0000 7f9c12cc5640 1 -- 172.21.15.77:0/3706835672 shutdown_connections 2024-09-18T21:22:12.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:12.084+0000 7f9c12cc5640 1 -- 172.21.15.77:0/3706835672 wait complete. 2024-09-18T21:22:12.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:12.085+0000 7f9c12cc5640 1 Processor -- start 2024-09-18T21:22:12.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:12.085+0000 7f9c12cc5640 1 -- start start 2024-09-18T21:22:12.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:12.085+0000 7f9c12cc5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c0c102550 0x7f9c0c1135b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:22:12.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:12.085+0000 7f9c12cc5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c0c102ef0 0x7f9c0c113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:22:12.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:12.085+0000 7f9c12cc5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0c1141d0 con 0x7f9c0c102ef0 2024-09-18T21:22:12.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:12.085+0000 7f9c12cc5640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0c10d550 con 0x7f9c0c102550 2024-09-18T21:22:12.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:12.085+0000 7f9c0bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c0c102ef0 0x7f9c0c113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:22:12.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:12.085+0000 7f9c0bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c0c102ef0 0x7f9c0c113af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38198/0 (socket says 172.21.15.77:38198) 2024-09-18T21:22:12.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:12.086+0000 7f9c0bfff640 1 -- 172.21.15.77:0/90013923 learned_addr learned my addr 172.21.15.77:0/90013923 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:22:12.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:12.086+0000 7f9c10a61640 1 --2- 172.21.15.77:0/90013923 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c0c102550 0x7f9c0c1135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:22:12.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:12.086+0000 7f9c0bfff640 1 -- 172.21.15.77:0/90013923 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c0c102550 msgr2=0x7f9c0c1135b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:22:12.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:12.086+0000 7f9c0bfff640 1 --2- 172.21.15.77:0/90013923 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c0c102550 0x7f9c0c1135b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:22:12.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:12.086+0000 7f9c0bfff640 1 -- 172.21.15.77:0/90013923 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c00005040 con 0x7f9c0c102ef0 2024-09-18T21:22:12.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:12.086+0000 7f9c0bfff640 1 --2- 172.21.15.77:0/90013923 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c0c102ef0 0x7f9c0c113af0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9bf800b540 tx=0x7f9bf80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:22:12.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:12.086+0000 7f9c097fa640 1 -- 172.21.15.77:0/90013923 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bf800f6f0 con 0x7f9c0c102ef0 2024-09-18T21:22:12.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:12.086+0000 7f9c097fa640 1 -- 172.21.15.77:0/90013923 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9bf800fcf0 con 0x7f9c0c102ef0 2024-09-18T21:22:12.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:12.086+0000 7f9c12cc5640 1 -- 172.21.15.77:0/90013923 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c0c10d7e0 con 0x7f9c0c102ef0 2024-09-18T21:22:12.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:12.086+0000 7f9c097fa640 1 -- 172.21.15.77:0/90013923 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bf8011e80 con 0x7f9c0c102ef0 2024-09-18T21:22:12.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:12.086+0000 7f9c12cc5640 1 -- 172.21.15.77:0/90013923 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c0c10dd00 con 0x7f9c0c102ef0 2024-09-18T21:22:12.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:12.087+0000 7f9c12cc5640 1 -- 172.21.15.77:0/90013923 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c0c0fdcd0 con 0x7f9c0c102ef0 2024-09-18T21:22:12.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:12.088+0000 7f9c097fa640 1 -- 172.21.15.77:0/90013923 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9bf80116b0 con 0x7f9c0c102ef0 2024-09-18T21:22:12.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:12.088+0000 7f9c097fa640 1 --2- 172.21.15.77:0/90013923 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f9bfc06e0b0 0x7f9bfc070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:22:12.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:12.088+0000 7f9c10a61640 1 --2- 172.21.15.77:0/90013923 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f9bfc06e0b0 0x7f9bfc070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:22:12.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:12.088+0000 7f9c097fa640 1 -- 172.21.15.77:0/90013923 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f9bf808db50 con 0x7f9c0c102ef0 2024-09-18T21:22:12.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:12.089+0000 7f9c10a61640 1 --2- 172.21.15.77:0/90013923 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f9bfc06e0b0 0x7f9bfc070560 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9c00000c00 tx=0x7f9c00035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:22:12.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:12.093+0000 7f9c097fa640 1 -- 172.21.15.77:0/90013923 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f9bf8056e50 con 0x7f9c0c102ef0 2024-09-18T21:22:12.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:12.326+0000 7f9c12cc5640 1 -- 172.21.15.77:0/90013923 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f9c0c0fbd50 con 0x7f9c0c102ef0 2024-09-18T21:22:12.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:12.326+0000 7f9c097fa640 1 -- 172.21.15.77:0/90013923 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f9bf805a510 con 0x7f9c0c102ef0 2024-09-18T21:22:12.328 INFO:teuthology.orchestra.run.smithi077.stdout:HEALTH_OK 2024-09-18T21:22:12.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:12.328+0000 7f9c12cc5640 1 -- 172.21.15.77:0/90013923 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f9bfc06e0b0 msgr2=0x7f9bfc070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:22:12.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:12.328+0000 7f9c12cc5640 1 --2- 172.21.15.77:0/90013923 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f9bfc06e0b0 0x7f9bfc070560 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9c00000c00 tx=0x7f9c00035040 comp rx=0 tx=0).stop 2024-09-18T21:22:12.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:12.328+0000 7f9c12cc5640 1 -- 172.21.15.77:0/90013923 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c0c102ef0 msgr2=0x7f9c0c113af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:22:12.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:12.328+0000 7f9c12cc5640 1 --2- 172.21.15.77:0/90013923 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c0c102ef0 0x7f9c0c113af0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9bf800b540 tx=0x7f9bf80091a0 comp rx=0 tx=0).stop 2024-09-18T21:22:12.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:12.328+0000 7f9c12cc5640 1 -- 172.21.15.77:0/90013923 shutdown_connections 2024-09-18T21:22:12.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:12.328+0000 7f9c12cc5640 1 --2- 172.21.15.77:0/90013923 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c0c102ef0 0x7f9c0c113af0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:22:12.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:12.328+0000 7f9c12cc5640 1 --2- 172.21.15.77:0/90013923 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f9bfc06e0b0 0x7f9bfc070560 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:22:12.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:12.328+0000 7f9c12cc5640 1 --2- 172.21.15.77:0/90013923 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c0c102550 0x7f9c0c1135b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:22:12.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:12.328+0000 7f9c12cc5640 1 -- 172.21.15.77:0/90013923 >> 172.21.15.77:0/90013923 conn(0x7f9c0c0f80f0 msgr2=0x7f9c0c0f9180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:22:12.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:12.328+0000 7f9c12cc5640 1 -- 172.21.15.77:0/90013923 shutdown_connections 2024-09-18T21:22:12.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:12.328+0000 7f9c12cc5640 1 -- 172.21.15.77:0/90013923 wait complete. 2024-09-18T21:22:12.962 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -e sha1=06b1b1de896d25f0645e4a306558ab0b4d4fc56f -- bash -c 'ceph versions' 2024-09-18T21:22:13.209 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:22:13.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:22:13 smithi077 ceph-mon[92672]: pgmap v250: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:13.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:22:13 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/90013923' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T21:22:13.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:22:13 smithi103 ceph-mon[80307]: pgmap v250: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:13.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:22:13 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/90013923' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-18T21:22:14.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:14.798+0000 7f98e5d77640 1 -- 172.21.15.77:0/3218203036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98e00716e0 msgr2=0x7f98e006fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:22:14.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:14.798+0000 7f98e5d77640 1 --2- 172.21.15.77:0/3218203036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98e00716e0 0x7f98e006fab0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f98d00048d0 tx=0x7f98d0009da0 comp rx=0 tx=0).stop 2024-09-18T21:22:14.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:14.798+0000 7f98e5d77640 1 -- 172.21.15.77:0/3218203036 shutdown_connections 2024-09-18T21:22:14.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:14.798+0000 7f98e5d77640 1 --2- 172.21.15.77:0/3218203036 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98e006fff0 0x7f98e0070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:22:14.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:14.798+0000 7f98e5d77640 1 --2- 172.21.15.77:0/3218203036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98e00716e0 0x7f98e006fab0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:22:14.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:14.798+0000 7f98e5d77640 1 -- 172.21.15.77:0/3218203036 >> 172.21.15.77:0/3218203036 conn(0x7f98e00f8120 msgr2=0x7f98e00fa530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:22:14.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:14.798+0000 7f98e5d77640 1 -- 172.21.15.77:0/3218203036 shutdown_connections 2024-09-18T21:22:14.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:14.798+0000 7f98e5d77640 1 -- 172.21.15.77:0/3218203036 wait complete. 2024-09-18T21:22:14.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:14.799+0000 7f98e5d77640 1 Processor -- start 2024-09-18T21:22:14.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:14.799+0000 7f98e5d77640 1 -- start start 2024-09-18T21:22:14.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:14.799+0000 7f98e5d77640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98e006fff0 0x7f98e0119880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:22:14.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:14.799+0000 7f98e5d77640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98e00716e0 0x7f98e0119dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:22:14.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:14.799+0000 7f98e5d77640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e011a4a0 con 0x7f98e00716e0 2024-09-18T21:22:14.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:14.799+0000 7f98e5d77640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e0113820 con 0x7f98e006fff0 2024-09-18T21:22:14.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:14.799+0000 7f98deffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98e00716e0 0x7f98e0119dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:22:14.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:14.799+0000 7f98deffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98e00716e0 0x7f98e0119dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38218/0 (socket says 172.21.15.77:38218) 2024-09-18T21:22:14.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:14.799+0000 7f98deffd640 1 -- 172.21.15.77:0/1227790032 learned_addr learned my addr 172.21.15.77:0/1227790032 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:22:14.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:14.799+0000 7f98df7fe640 1 --2- 172.21.15.77:0/1227790032 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98e006fff0 0x7f98e0119880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:22:14.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:14.800+0000 7f98deffd640 1 -- 172.21.15.77:0/1227790032 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98e006fff0 msgr2=0x7f98e0119880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:22:14.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:14.800+0000 7f98deffd640 1 --2- 172.21.15.77:0/1227790032 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98e006fff0 0x7f98e0119880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:22:14.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:14.800+0000 7f98deffd640 1 -- 172.21.15.77:0/1227790032 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d0005040 con 0x7f98e00716e0 2024-09-18T21:22:14.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:14.800+0000 7f98deffd640 1 --2- 172.21.15.77:0/1227790032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98e00716e0 0x7f98e0119dc0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f98d400b790 tx=0x7f98d40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:22:14.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:14.800+0000 7f98c7fff640 1 -- 172.21.15.77:0/1227790032 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98d400c700 con 0x7f98e00716e0 2024-09-18T21:22:14.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:14.800+0000 7f98c7fff640 1 -- 172.21.15.77:0/1227790032 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f98d400cd00 con 0x7f98e00716e0 2024-09-18T21:22:14.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:14.800+0000 7f98c7fff640 1 -- 172.21.15.77:0/1227790032 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98d4015e80 con 0x7f98e00716e0 2024-09-18T21:22:14.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:14.800+0000 7f98e5d77640 1 -- 172.21.15.77:0/1227790032 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98e0113ab0 con 0x7f98e00716e0 2024-09-18T21:22:14.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:14.800+0000 7f98e5d77640 1 -- 172.21.15.77:0/1227790032 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98e0113f80 con 0x7f98e00716e0 2024-09-18T21:22:14.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:14.801+0000 7f98e5d77640 1 -- 172.21.15.77:0/1227790032 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98e00711f0 con 0x7f98e00716e0 2024-09-18T21:22:14.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:14.802+0000 7f98c7fff640 1 -- 172.21.15.77:0/1227790032 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f98d4012070 con 0x7f98e00716e0 2024-09-18T21:22:14.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:14.802+0000 7f98c7fff640 1 --2- 172.21.15.77:0/1227790032 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f98c806e0b0 0x7f98c8070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:22:14.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:14.802+0000 7f98c7fff640 1 -- 172.21.15.77:0/1227790032 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f98d408d560 con 0x7f98e00716e0 2024-09-18T21:22:14.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:14.802+0000 7f98df7fe640 1 --2- 172.21.15.77:0/1227790032 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f98c806e0b0 0x7f98c8070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:22:14.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:14.803+0000 7f98df7fe640 1 --2- 172.21.15.77:0/1227790032 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f98c806e0b0 0x7f98c8070560 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f98d00048a0 tx=0x7f98d0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:22:14.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:14.807+0000 7f98c7fff640 1 -- 172.21.15.77:0/1227790032 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f98d40567e0 con 0x7f98e00716e0 2024-09-18T21:22:15.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:15.039+0000 7f98e5d77640 1 -- 172.21.15.77:0/1227790032 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f98e00fbd60 con 0x7f98e00716e0 2024-09-18T21:22:15.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:15.040+0000 7f98c7fff640 1 -- 172.21.15.77:0/1227790032 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f98d4059ea0 con 0x7f98e00716e0 2024-09-18T21:22:15.042 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-18T21:22:15.042 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": { 2024-09-18T21:22:15.042 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 2 2024-09-18T21:22:15.042 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:22:15.042 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": { 2024-09-18T21:22:15.042 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 2 2024-09-18T21:22:15.042 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:22:15.042 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": { 2024-09-18T21:22:15.042 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 6 2024-09-18T21:22:15.042 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:22:15.042 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-09-18T21:22:15.042 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 4 2024-09-18T21:22:15.042 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:22:15.043 INFO:teuthology.orchestra.run.smithi077.stdout: "overall": { 2024-09-18T21:22:15.043 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 14 2024-09-18T21:22:15.043 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-18T21:22:15.043 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-18T21:22:15.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:15.042+0000 7f98e5d77640 1 -- 172.21.15.77:0/1227790032 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f98c806e0b0 msgr2=0x7f98c8070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:22:15.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:15.042+0000 7f98e5d77640 1 --2- 172.21.15.77:0/1227790032 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f98c806e0b0 0x7f98c8070560 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f98d00048a0 tx=0x7f98d0035040 comp rx=0 tx=0).stop 2024-09-18T21:22:15.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:15.042+0000 7f98e5d77640 1 -- 172.21.15.77:0/1227790032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98e00716e0 msgr2=0x7f98e0119dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:22:15.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:15.042+0000 7f98e5d77640 1 --2- 172.21.15.77:0/1227790032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98e00716e0 0x7f98e0119dc0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f98d400b790 tx=0x7f98d40091d0 comp rx=0 tx=0).stop 2024-09-18T21:22:15.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:15.042+0000 7f98e5d77640 1 -- 172.21.15.77:0/1227790032 shutdown_connections 2024-09-18T21:22:15.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:15.042+0000 7f98e5d77640 1 --2- 172.21.15.77:0/1227790032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98e00716e0 0x7f98e0119dc0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:22:15.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:15.042+0000 7f98e5d77640 1 --2- 172.21.15.77:0/1227790032 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f98c806e0b0 0x7f98c8070560 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:22:15.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:15.042+0000 7f98e5d77640 1 --2- 172.21.15.77:0/1227790032 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98e006fff0 0x7f98e0119880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:22:15.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:15.042+0000 7f98e5d77640 1 -- 172.21.15.77:0/1227790032 >> 172.21.15.77:0/1227790032 conn(0x7f98e00f8120 msgr2=0x7f98e00f9360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:22:15.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:15.042+0000 7f98e5d77640 1 -- 172.21.15.77:0/1227790032 shutdown_connections 2024-09-18T21:22:15.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:22:15.042+0000 7f98e5d77640 1 -- 172.21.15.77:0/1227790032 wait complete. 2024-09-18T21:22:15.366 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:22:15 smithi077 ceph-mon[92672]: pgmap v251: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:15.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:22:15 smithi103 ceph-mon[80307]: pgmap v251: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:15.678 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -e sha1=06b1b1de896d25f0645e4a306558ab0b4d4fc56f -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-09-18T21:22:15.927 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:22:16.330 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:22:16 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/1227790032' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:22:16.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:22:16 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/1227790032' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:22:17.176 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:22:17 smithi077 ceph-mon[92672]: pgmap v252: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:17.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:22:17 smithi103 ceph-mon[80307]: pgmap v252: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:17.746 INFO:teuthology.orchestra.run.smithi077.stdout:wait for servicemap items w/ changing names to refresh 2024-09-18T21:22:18.493 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -e sha1=06b1b1de896d25f0645e4a306558ab0b4d4fc56f -- bash -c 'sleep 60' 2024-09-18T21:22:18.739 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:22:19.121 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:22:19 smithi077 ceph-mon[92672]: pgmap v253: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:19.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:22:19 smithi103 ceph-mon[80307]: pgmap v253: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:21.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:22:21 smithi077 ceph-mon[92672]: pgmap v254: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:21.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:22:21 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:22:21.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:22:21 smithi103 ceph-mon[80307]: pgmap v254: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:21.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:22:21 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:22:23.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:22:23 smithi077 ceph-mon[92672]: pgmap v255: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:23.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:22:23 smithi103 ceph-mon[80307]: pgmap v255: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:25.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:22:25 smithi077 ceph-mon[92672]: pgmap v256: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:25.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:22:25 smithi103 ceph-mon[80307]: pgmap v256: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:27.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:22:27 smithi077 ceph-mon[92672]: pgmap v257: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:27.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:22:27 smithi103 ceph-mon[80307]: pgmap v257: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:29.316 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:22:29 smithi103 ceph-mon[80307]: pgmap v258: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:29.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:22:29 smithi077 ceph-mon[92672]: pgmap v258: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:31.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:22:31 smithi077 ceph-mon[92672]: pgmap v259: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:31.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:22:31 smithi103 ceph-mon[80307]: pgmap v259: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:33.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:22:33 smithi077 ceph-mon[92672]: pgmap v260: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:33.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:22:33 smithi103 ceph-mon[80307]: pgmap v260: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:35.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:22:35 smithi077 ceph-mon[92672]: pgmap v261: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:35.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:22:35 smithi103 ceph-mon[80307]: pgmap v261: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:36.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:22:36 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:22:36.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:22:36 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:22:37.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:22:37 smithi077 ceph-mon[92672]: pgmap v262: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:37.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:22:37 smithi103 ceph-mon[80307]: pgmap v262: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:39.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:22:39 smithi077 ceph-mon[92672]: pgmap v263: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:39.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:22:39 smithi103 ceph-mon[80307]: pgmap v263: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:41.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:22:41 smithi077 ceph-mon[92672]: pgmap v264: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:41.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:22:41 smithi103 ceph-mon[80307]: pgmap v264: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:43.380 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:22:43 smithi077 ceph-mon[92672]: pgmap v265: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:43.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:22:43 smithi103 ceph-mon[80307]: pgmap v265: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:45.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:22:45 smithi077 ceph-mon[92672]: pgmap v266: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:45.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:22:45 smithi103 ceph-mon[80307]: pgmap v266: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:47.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:22:47 smithi077 ceph-mon[92672]: pgmap v267: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:47.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:22:47 smithi103 ceph-mon[80307]: pgmap v267: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:48.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:22:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:22:48.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:22:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:22:48.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:22:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:22:48.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:22:48 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:22:48.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:22:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:22:48.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:22:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:22:48.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:22:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:22:48.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:22:48 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:22:49.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:22:49 smithi077 ceph-mon[92672]: pgmap v268: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:49.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:22:49 smithi103 ceph-mon[80307]: pgmap v268: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:51.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:22:51 smithi077 ceph-mon[92672]: pgmap v269: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:51.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:22:51 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:22:51.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:22:51 smithi103 ceph-mon[80307]: pgmap v269: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:51.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:22:51 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:22:52.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:22:52 smithi077 ceph-mon[92672]: pgmap v270: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:52.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:22:52 smithi103 ceph-mon[80307]: pgmap v270: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:55.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:22:54 smithi077 ceph-mon[92672]: pgmap v271: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:55.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:22:54 smithi103 ceph-mon[80307]: pgmap v271: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:57.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:22:56 smithi077 ceph-mon[92672]: pgmap v272: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:57.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:22:56 smithi103 ceph-mon[80307]: pgmap v272: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:59.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:22:58 smithi077 ceph-mon[92672]: pgmap v273: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:22:59.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:22:58 smithi103 ceph-mon[80307]: pgmap v273: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:01.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:00 smithi077 ceph-mon[92672]: pgmap v274: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:01.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:00 smithi103 ceph-mon[80307]: pgmap v274: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:03.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:02 smithi077 ceph-mon[92672]: pgmap v275: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:03.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:02 smithi103 ceph-mon[80307]: pgmap v275: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:05.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:04 smithi077 ceph-mon[92672]: pgmap v276: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:05.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:04 smithi103 ceph-mon[80307]: pgmap v276: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:06.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:05 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:23:06.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:05 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:23:07.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:06 smithi077 ceph-mon[92672]: pgmap v277: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:07.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:06 smithi103 ceph-mon[80307]: pgmap v277: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:09.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:08 smithi103 ceph-mon[80307]: pgmap v278: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:09.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:08 smithi077 ceph-mon[92672]: pgmap v278: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:11.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:10 smithi103 ceph-mon[80307]: pgmap v279: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:11.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:10 smithi077 ceph-mon[92672]: pgmap v279: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:13.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:12 smithi103 ceph-mon[80307]: pgmap v280: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:13.376 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:12 smithi077 ceph-mon[92672]: pgmap v280: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:15.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:14 smithi103 ceph-mon[80307]: pgmap v281: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:15.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:14 smithi077 ceph-mon[92672]: pgmap v281: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:17.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:16 smithi103 ceph-mon[80307]: pgmap v282: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:17.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:16 smithi077 ceph-mon[92672]: pgmap v282: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:19.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:18 smithi103 ceph-mon[80307]: pgmap v283: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:19.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:18 smithi077 ceph-mon[92672]: pgmap v283: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:21.012 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -e sha1=06b1b1de896d25f0645e4a306558ab0b4d4fc56f -- bash -c 'ceph orch ps' 2024-09-18T21:23:21.263 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:23:21.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:20 smithi103 ceph-mon[80307]: pgmap v284: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:21.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:20 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:23:21.385 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:20 smithi077 ceph-mon[92672]: pgmap v284: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:21.385 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:20 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:23:23.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:22.973+0000 7f5bbcc9b640 1 -- 172.21.15.77:0/3038332333 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bb80fdf20 msgr2=0x7f5bb81065f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:23.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:22.973+0000 7f5bbcc9b640 1 --2- 172.21.15.77:0/3038332333 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bb80fdf20 0x7f5bb81065f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5bac004900 tx=0x7f5bac009da0 comp rx=0 tx=0).stop 2024-09-18T21:23:23.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:22.973+0000 7f5bbcc9b640 1 -- 172.21.15.77:0/3038332333 shutdown_connections 2024-09-18T21:23:23.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:22.973+0000 7f5bbcc9b640 1 --2- 172.21.15.77:0/3038332333 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bb80fdf20 0x7f5bb81065f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:23.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:22.973+0000 7f5bbcc9b640 1 --2- 172.21.15.77:0/3038332333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5bb80fd580 0x7f5bb80fd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:23.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:22.973+0000 7f5bbcc9b640 1 -- 172.21.15.77:0/3038332333 >> 172.21.15.77:0/3038332333 conn(0x7f5bb80f7020 msgr2=0x7f5bb80f9430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:23:23.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:22.973+0000 7f5bbcc9b640 1 -- 172.21.15.77:0/3038332333 shutdown_connections 2024-09-18T21:23:23.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:22.973+0000 7f5bbcc9b640 1 -- 172.21.15.77:0/3038332333 wait complete. 2024-09-18T21:23:23.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:22.974+0000 7f5bbcc9b640 1 Processor -- start 2024-09-18T21:23:23.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:22.974+0000 7f5bbcc9b640 1 -- start start 2024-09-18T21:23:23.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:22.974+0000 7f5bbcc9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bb80fd580 0x7f5bb8113330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:23:23.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:22.974+0000 7f5bbcc9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5bb80fdf20 0x7f5bb8113870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:23:23.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:22.974+0000 7f5bbcc9b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb8113e70 con 0x7f5bb80fd580 2024-09-18T21:23:23.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:22.974+0000 7f5bbcc9b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb810d2b0 con 0x7f5bb80fdf20 2024-09-18T21:23:23.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:22.974+0000 7f5bb659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bb80fd580 0x7f5bb8113330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:23:23.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:22.974+0000 7f5bb659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bb80fd580 0x7f5bb8113330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42770/0 (socket says 172.21.15.77:42770) 2024-09-18T21:23:23.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:22.974+0000 7f5bb659c640 1 -- 172.21.15.77:0/311891979 learned_addr learned my addr 172.21.15.77:0/311891979 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:23:23.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:22.974+0000 7f5bb5d9b640 1 --2- 172.21.15.77:0/311891979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5bb80fdf20 0x7f5bb8113870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:23:23.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:22.975+0000 7f5bb659c640 1 -- 172.21.15.77:0/311891979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5bb80fdf20 msgr2=0x7f5bb8113870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:23.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:22.975+0000 7f5bb659c640 1 --2- 172.21.15.77:0/311891979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5bb80fdf20 0x7f5bb8113870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:23.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:22.975+0000 7f5bb659c640 1 -- 172.21.15.77:0/311891979 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bac005040 con 0x7f5bb80fd580 2024-09-18T21:23:23.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:22.975+0000 7f5bb659c640 1 --2- 172.21.15.77:0/311891979 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bb80fd580 0x7f5bb8113330 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0002a50 tx=0x7f5bb0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:23:23.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:22.975+0000 7f5ba6ffd640 1 -- 172.21.15.77:0/311891979 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bb0007c30 con 0x7f5bb80fd580 2024-09-18T21:23:23.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:22.975+0000 7f5bbcc9b640 1 -- 172.21.15.77:0/311891979 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bb810d590 con 0x7f5bb80fd580 2024-09-18T21:23:23.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:22.975+0000 7f5ba6ffd640 1 -- 172.21.15.77:0/311891979 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5bb000f040 con 0x7f5bb80fd580 2024-09-18T21:23:23.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:22.975+0000 7f5ba6ffd640 1 -- 172.21.15.77:0/311891979 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bb000da10 con 0x7f5bb80fd580 2024-09-18T21:23:23.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:22.975+0000 7f5bbcc9b640 1 -- 172.21.15.77:0/311891979 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bb810dab0 con 0x7f5bb80fd580 2024-09-18T21:23:23.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:22.976+0000 7f5bbcc9b640 1 -- 172.21.15.77:0/311891979 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bb80662d0 con 0x7f5bb80fd580 2024-09-18T21:23:23.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:22.976+0000 7f5ba6ffd640 1 -- 172.21.15.77:0/311891979 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5bb000dbb0 con 0x7f5bb80fd580 2024-09-18T21:23:23.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:22.977+0000 7f5ba6ffd640 1 --2- 172.21.15.77:0/311891979 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f5ba006e0b0 0x7f5ba0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:23:23.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:22.977+0000 7f5ba6ffd640 1 -- 172.21.15.77:0/311891979 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f5bb008d390 con 0x7f5bb80fd580 2024-09-18T21:23:23.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:22.977+0000 7f5bb5d9b640 1 --2- 172.21.15.77:0/311891979 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f5ba006e0b0 0x7f5ba0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:23:23.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:22.977+0000 7f5bb5d9b640 1 --2- 172.21.15.77:0/311891979 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f5ba006e0b0 0x7f5ba0070560 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5bac004540 tx=0x7f5bac035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:23:23.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:22.981+0000 7f5ba6ffd640 1 -- 172.21.15.77:0/311891979 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f5bb0056740 con 0x7f5bb80fd580 2024-09-18T21:23:23.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:23.155+0000 7f5bbcc9b640 1 -- 172.21.15.77:0/311891979 --> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5bb804b720 con 0x7f5ba006e0b0 2024-09-18T21:23:23.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:23.164+0000 7f5ba6ffd640 1 -- 172.21.15.77:0/311891979 <== mgr.34104 v2:172.21.15.77:6800/1855084565 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f5bb804b720 con 0x7f5ba006e0b0 2024-09-18T21:23:23.166 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-18T21:23:23.166 INFO:teuthology.orchestra.run.smithi077.stdout:alertmanager.smithi077 smithi077 *:9093,9094 running (2m) 99s ago 18m 15.5M - 0.25.0 c8568f914cd2 d3072897529c 2024-09-18T21:23:23.166 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi077 smithi077 running (7m) 99s ago 18m 6891k - 19.1.1-17-g06b1b1de f79f744f586d 5872fa24b792 2024-09-18T21:23:23.166 INFO:teuthology.orchestra.run.smithi077.stdout:crash.smithi103 smithi103 running (7m) 2m ago 17m 6887k - 19.1.1-17-g06b1b1de f79f744f586d cd1604469f34 2024-09-18T21:23:23.166 INFO:teuthology.orchestra.run.smithi077.stdout:grafana.smithi077 smithi077 *:3000 running (104s) 99s ago 17m 47.8M - 9.4.12 2bacad6d85d8 8fbd93e066f3 2024-09-18T21:23:23.166 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.cqfhlw smithi077 running (3m) 99s ago 12m 13.6M - 19.1.1-17-g06b1b1de f79f744f586d c74ffc2ebb80 2024-09-18T21:23:23.166 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi077.vruydi smithi077 running (3m) 99s ago 13m 84.8M - 19.1.1-17-g06b1b1de f79f744f586d ce474ff0a948 2024-09-18T21:23:23.166 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi103.opftmf smithi103 running (2m) 2m ago 12m 13.1M - 19.1.1-17-g06b1b1de f79f744f586d 02c8e0b7ba0a 2024-09-18T21:23:23.166 INFO:teuthology.orchestra.run.smithi077.stdout:mds.cephfs.smithi103.zhdmdg smithi103 running (3m) 2m ago 12m 12.4M - 19.1.1-17-g06b1b1de f79f744f586d 84d9d5a98395 2024-09-18T21:23:23.166 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi077.utkpjg smithi077 *:8443,9283,8765 running (9m) 99s ago 19m 518M - 19.1.1-17-g06b1b1de f79f744f586d 99d4b0fd70f6 2024-09-18T21:23:23.166 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.smithi103.zjztqc smithi103 *:8443,9283,8765 running (8m) 2m ago 17m 442M - 19.1.1-17-g06b1b1de f79f744f586d 54589547c4d7 2024-09-18T21:23:23.166 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi077 smithi077 running (8m) 99s ago 19m 53.0M 2048M 19.1.1-17-g06b1b1de f79f744f586d 2d0fbbea1264 2024-09-18T21:23:23.166 INFO:teuthology.orchestra.run.smithi077.stdout:mon.smithi103 smithi103 running (8m) 2m ago 17m 39.5M 2048M 19.1.1-17-g06b1b1de f79f744f586d dc79edbd9602 2024-09-18T21:23:23.166 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi077 smithi077 *:9100 running (2m) 99s ago 18m 9995k - 1.5.0 0da6a335fe13 f880828c375d 2024-09-18T21:23:23.167 INFO:teuthology.orchestra.run.smithi077.stdout:node-exporter.smithi103 smithi103 *:9100 running (2m) 2m ago 17m 5473k - 1.5.0 0da6a335fe13 33e42737d4e1 2024-09-18T21:23:23.167 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (7m) 99s ago 16m 101M 1557M 19.1.1-17-g06b1b1de f79f744f586d 8855b4b16e00 2024-09-18T21:23:23.167 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi077 running (6m) 99s ago 16m 115M 1557M 19.1.1-17-g06b1b1de f79f744f586d 2d8bc9cac96c 2024-09-18T21:23:23.167 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi077 running (5m) 99s ago 15m 103M 1557M 19.1.1-17-g06b1b1de f79f744f586d 93876f1d398d 2024-09-18T21:23:23.167 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi103 running (5m) 2m ago 15m 121M 2581M 19.1.1-17-g06b1b1de f79f744f586d 2556b257bf1c 2024-09-18T21:23:23.167 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi103 running (4m) 2m ago 14m 99.2M 2581M 19.1.1-17-g06b1b1de f79f744f586d 2cde7eaf88d8 2024-09-18T21:23:23.167 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi103 running (4m) 2m ago 14m 100M 2581M 19.1.1-17-g06b1b1de f79f744f586d e6912ab63ecc 2024-09-18T21:23:23.167 INFO:teuthology.orchestra.run.smithi077.stdout:prometheus.smithi077 smithi077 *:9095 running (2m) 99s ago 17m 46.9M - 2.43.0 a07b618ecd1d d877a4113362 2024-09-18T21:23:23.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:23.166+0000 7f5bbcc9b640 1 -- 172.21.15.77:0/311891979 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f5ba006e0b0 msgr2=0x7f5ba0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:23.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:23.166+0000 7f5bbcc9b640 1 --2- 172.21.15.77:0/311891979 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f5ba006e0b0 0x7f5ba0070560 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5bac004540 tx=0x7f5bac035040 comp rx=0 tx=0).stop 2024-09-18T21:23:23.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:23.166+0000 7f5bbcc9b640 1 -- 172.21.15.77:0/311891979 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bb80fd580 msgr2=0x7f5bb8113330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:23.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:23.166+0000 7f5bbcc9b640 1 --2- 172.21.15.77:0/311891979 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bb80fd580 0x7f5bb8113330 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0002a50 tx=0x7f5bb0004600 comp rx=0 tx=0).stop 2024-09-18T21:23:23.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:23.167+0000 7f5bbcc9b640 1 -- 172.21.15.77:0/311891979 shutdown_connections 2024-09-18T21:23:23.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:23.167+0000 7f5bbcc9b640 1 --2- 172.21.15.77:0/311891979 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f5ba006e0b0 0x7f5ba0070560 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:23.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:23.167+0000 7f5bbcc9b640 1 --2- 172.21.15.77:0/311891979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5bb80fdf20 0x7f5bb8113870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:23.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:23.167+0000 7f5bbcc9b640 1 --2- 172.21.15.77:0/311891979 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bb80fd580 0x7f5bb8113330 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:23.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:23.167+0000 7f5bbcc9b640 1 -- 172.21.15.77:0/311891979 >> 172.21.15.77:0/311891979 conn(0x7f5bb80f7020 msgr2=0x7f5bb80f8540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:23:23.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:23.167+0000 7f5bbcc9b640 1 -- 172.21.15.77:0/311891979 shutdown_connections 2024-09-18T21:23:23.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:23.167+0000 7f5bbcc9b640 1 -- 172.21.15.77:0/311891979 wait complete. 2024-09-18T21:23:23.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:22 smithi103 ceph-mon[80307]: pgmap v285: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:23.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:22 smithi077 ceph-mon[92672]: pgmap v285: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:23.840 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -e sha1=06b1b1de896d25f0645e4a306558ab0b4d4fc56f -- bash -c 'ceph versions' 2024-09-18T21:23:24.090 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:23:25.251 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:24 smithi077 ceph-mon[92672]: from='client.34542 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:23:25.251 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:24 smithi077 ceph-mon[92672]: pgmap v286: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:25.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:24 smithi103 ceph-mon[80307]: from='client.34542 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-18T21:23:25.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:24 smithi103 ceph-mon[80307]: pgmap v286: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:25.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:25.616+0000 7f0afdde8640 1 -- 172.21.15.77:0/497836683 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0af8070360 msgr2=0x7f0af81088f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:25.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:25.616+0000 7f0afdde8640 1 --2- 172.21.15.77:0/497836683 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0af8070360 0x7f0af81088f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0aec0048d0 tx=0x7f0aec009da0 comp rx=0 tx=0).stop 2024-09-18T21:23:25.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:25.616+0000 7f0afdde8640 1 -- 172.21.15.77:0/497836683 shutdown_connections 2024-09-18T21:23:25.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:25.616+0000 7f0afdde8640 1 --2- 172.21.15.77:0/497836683 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0af8070360 0x7f0af81088f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:25.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:25.616+0000 7f0afdde8640 1 --2- 172.21.15.77:0/497836683 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0af806fa50 0x7f0af806fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:25.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:25.616+0000 7f0afdde8640 1 -- 172.21.15.77:0/497836683 >> 172.21.15.77:0/497836683 conn(0x7f0af80f80f0 msgr2=0x7f0af80fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:23:25.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:25.616+0000 7f0afdde8640 1 -- 172.21.15.77:0/497836683 shutdown_connections 2024-09-18T21:23:25.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:25.616+0000 7f0afdde8640 1 -- 172.21.15.77:0/497836683 wait complete. 2024-09-18T21:23:25.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:25.617+0000 7f0afdde8640 1 Processor -- start 2024-09-18T21:23:25.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:25.617+0000 7f0afdde8640 1 -- start start 2024-09-18T21:23:25.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:25.617+0000 7f0afdde8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0af806fa50 0x7f0af8115760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:23:25.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:25.617+0000 7f0afdde8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0af8070360 0x7f0af8115ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:23:25.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:25.617+0000 7f0afdde8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af81162f0 con 0x7f0af806fa50 2024-09-18T21:23:25.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:25.617+0000 7f0afdde8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af810f700 con 0x7f0af8070360 2024-09-18T21:23:25.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:25.617+0000 7f0af77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0af806fa50 0x7f0af8115760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:23:25.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:25.617+0000 7f0af77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0af806fa50 0x7f0af8115760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42792/0 (socket says 172.21.15.77:42792) 2024-09-18T21:23:25.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:25.617+0000 7f0af77fe640 1 -- 172.21.15.77:0/3608303195 learned_addr learned my addr 172.21.15.77:0/3608303195 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:23:25.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:25.617+0000 7f0af6ffd640 1 --2- 172.21.15.77:0/3608303195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0af8070360 0x7f0af8115ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:23:25.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:25.617+0000 7f0af77fe640 1 -- 172.21.15.77:0/3608303195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0af8070360 msgr2=0x7f0af8115ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:25.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:25.617+0000 7f0af77fe640 1 --2- 172.21.15.77:0/3608303195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0af8070360 0x7f0af8115ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:25.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:25.617+0000 7f0af77fe640 1 -- 172.21.15.77:0/3608303195 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aec005040 con 0x7f0af806fa50 2024-09-18T21:23:25.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:25.617+0000 7f0af6ffd640 1 --2- 172.21.15.77:0/3608303195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0af8070360 0x7f0af8115ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T21:23:25.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:25.618+0000 7f0af77fe640 1 --2- 172.21.15.77:0/3608303195 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0af806fa50 0x7f0af8115760 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8002a50 tx=0x7f0ae8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:23:25.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:25.618+0000 7f0adffff640 1 -- 172.21.15.77:0/3608303195 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ae8007c30 con 0x7f0af806fa50 2024-09-18T21:23:25.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:25.618+0000 7f0afdde8640 1 -- 172.21.15.77:0/3608303195 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0af810f9e0 con 0x7f0af806fa50 2024-09-18T21:23:25.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:25.618+0000 7f0adffff640 1 -- 172.21.15.77:0/3608303195 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0ae800f040 con 0x7f0af806fa50 2024-09-18T21:23:25.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:25.618+0000 7f0adffff640 1 -- 172.21.15.77:0/3608303195 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ae800da90 con 0x7f0af806fa50 2024-09-18T21:23:25.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:25.618+0000 7f0afdde8640 1 -- 172.21.15.77:0/3608303195 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0af810fed0 con 0x7f0af806fa50 2024-09-18T21:23:25.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:25.619+0000 7f0afdde8640 1 -- 172.21.15.77:0/3608303195 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0af8071190 con 0x7f0af806fa50 2024-09-18T21:23:25.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:25.619+0000 7f0adffff640 1 -- 172.21.15.77:0/3608303195 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f0ae800dd00 con 0x7f0af806fa50 2024-09-18T21:23:25.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:25.620+0000 7f0adffff640 1 --2- 172.21.15.77:0/3608303195 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f0ae006e0b0 0x7f0ae0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:23:25.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:25.620+0000 7f0adffff640 1 -- 172.21.15.77:0/3608303195 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f0ae808d540 con 0x7f0af806fa50 2024-09-18T21:23:25.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:25.620+0000 7f0af6ffd640 1 --2- 172.21.15.77:0/3608303195 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f0ae006e0b0 0x7f0ae0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:23:25.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:25.620+0000 7f0af6ffd640 1 --2- 172.21.15.77:0/3608303195 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f0ae006e0b0 0x7f0ae0070560 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0af8110b20 tx=0x7f0aec035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:23:25.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:25.624+0000 7f0adffff640 1 -- 172.21.15.77:0/3608303195 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f0ae80567c0 con 0x7f0af806fa50 2024-09-18T21:23:25.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:25.854+0000 7f0afdde8640 1 -- 172.21.15.77:0/3608303195 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0af810b7b0 con 0x7f0af806fa50 2024-09-18T21:23:25.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:25.855+0000 7f0adffff640 1 -- 172.21.15.77:0/3608303195 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f0ae8059e80 con 0x7f0af806fa50 2024-09-18T21:23:25.856 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-18T21:23:25.856 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": { 2024-09-18T21:23:25.856 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 2 2024-09-18T21:23:25.856 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:23:25.856 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": { 2024-09-18T21:23:25.856 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 2 2024-09-18T21:23:25.856 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:23:25.856 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": { 2024-09-18T21:23:25.857 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 6 2024-09-18T21:23:25.857 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:23:25.857 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": { 2024-09-18T21:23:25.857 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 4 2024-09-18T21:23:25.857 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-18T21:23:25.857 INFO:teuthology.orchestra.run.smithi077.stdout: "overall": { 2024-09-18T21:23:25.857 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)": 14 2024-09-18T21:23:25.857 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-18T21:23:25.860 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-18T21:23:25.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:25.857+0000 7f0afdde8640 1 -- 172.21.15.77:0/3608303195 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f0ae006e0b0 msgr2=0x7f0ae0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:25.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:25.857+0000 7f0afdde8640 1 --2- 172.21.15.77:0/3608303195 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f0ae006e0b0 0x7f0ae0070560 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0af8110b20 tx=0x7f0aec035040 comp rx=0 tx=0).stop 2024-09-18T21:23:25.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:25.857+0000 7f0afdde8640 1 -- 172.21.15.77:0/3608303195 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0af806fa50 msgr2=0x7f0af8115760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:25.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:25.857+0000 7f0afdde8640 1 --2- 172.21.15.77:0/3608303195 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0af806fa50 0x7f0af8115760 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8002a50 tx=0x7f0ae8004600 comp rx=0 tx=0).stop 2024-09-18T21:23:25.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:25.857+0000 7f0afdde8640 1 -- 172.21.15.77:0/3608303195 shutdown_connections 2024-09-18T21:23:25.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:25.857+0000 7f0afdde8640 1 --2- 172.21.15.77:0/3608303195 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f0ae006e0b0 0x7f0ae0070560 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:25.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:25.857+0000 7f0afdde8640 1 --2- 172.21.15.77:0/3608303195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0af8070360 0x7f0af8115ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:25.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:25.857+0000 7f0afdde8640 1 --2- 172.21.15.77:0/3608303195 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0af806fa50 0x7f0af8115760 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:25.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:25.857+0000 7f0afdde8640 1 -- 172.21.15.77:0/3608303195 >> 172.21.15.77:0/3608303195 conn(0x7f0af80f80f0 msgr2=0x7f0af80f9670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:23:25.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:25.857+0000 7f0afdde8640 1 -- 172.21.15.77:0/3608303195 shutdown_connections 2024-09-18T21:23:25.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:25.857+0000 7f0afdde8640 1 -- 172.21.15.77:0/3608303195 wait complete. 2024-09-18T21:23:26.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:25 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/3608303195' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:23:26.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:25 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/3608303195' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:23:26.537 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -e sha1=06b1b1de896d25f0645e4a306558ab0b4d4fc56f -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-09-18T21:23:26.782 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:23:27.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:26 smithi077 ceph-mon[92672]: pgmap v287: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:27.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:26 smithi103 ceph-mon[80307]: pgmap v287: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:28.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:28.401+0000 7f97808ba640 1 -- 172.21.15.77:0/2976001634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f977c1014b0 msgr2=0x7f977c101880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:28.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:28.401+0000 7f97808ba640 1 --2- 172.21.15.77:0/2976001634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f977c1014b0 0x7f977c101880 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f976c0048d0 tx=0x7f976c009da0 comp rx=0 tx=0).stop 2024-09-18T21:23:28.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:28.401+0000 7f97808ba640 1 -- 172.21.15.77:0/2976001634 shutdown_connections 2024-09-18T21:23:28.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:28.401+0000 7f97808ba640 1 --2- 172.21.15.77:0/2976001634 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f977c0fb470 0x7f977c0fb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:28.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:28.401+0000 7f97808ba640 1 --2- 172.21.15.77:0/2976001634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f977c1014b0 0x7f977c101880 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:28.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:28.401+0000 7f97808ba640 1 -- 172.21.15.77:0/2976001634 >> 172.21.15.77:0/2976001634 conn(0x7f977c0f7030 msgr2=0x7f977c0f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:23:28.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:28.401+0000 7f97808ba640 1 -- 172.21.15.77:0/2976001634 shutdown_connections 2024-09-18T21:23:28.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:28.401+0000 7f97808ba640 1 -- 172.21.15.77:0/2976001634 wait complete. 2024-09-18T21:23:28.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:28.402+0000 7f97808ba640 1 Processor -- start 2024-09-18T21:23:28.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:28.402+0000 7f97808ba640 1 -- start start 2024-09-18T21:23:28.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:28.402+0000 7f97808ba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f977c0fb470 0x7f977c10e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:23:28.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:28.402+0000 7f97808ba640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f977c1014b0 0x7f977c10e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:23:28.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:28.402+0000 7f97808ba640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c10ec80 con 0x7f977c0fb470 2024-09-18T21:23:28.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:28.402+0000 7f97808ba640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c10edf0 con 0x7f977c1014b0 2024-09-18T21:23:28.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:28.402+0000 7f977a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f977c0fb470 0x7f977c10e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:23:28.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:28.402+0000 7f977a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f977c0fb470 0x7f977c10e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42822/0 (socket says 172.21.15.77:42822) 2024-09-18T21:23:28.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:28.402+0000 7f977a59c640 1 -- 172.21.15.77:0/1050321506 learned_addr learned my addr 172.21.15.77:0/1050321506 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:23:28.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:28.402+0000 7f9779d9b640 1 --2- 172.21.15.77:0/1050321506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f977c1014b0 0x7f977c10e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:23:28.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:28.402+0000 7f977a59c640 1 -- 172.21.15.77:0/1050321506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f977c1014b0 msgr2=0x7f977c10e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:28.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:28.402+0000 7f977a59c640 1 --2- 172.21.15.77:0/1050321506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f977c1014b0 0x7f977c10e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:28.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:28.402+0000 7f977a59c640 1 -- 172.21.15.77:0/1050321506 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f976c005040 con 0x7f977c0fb470 2024-09-18T21:23:28.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:28.402+0000 7f977a59c640 1 --2- 172.21.15.77:0/1050321506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f977c0fb470 0x7f977c10e140 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f976c003080 tx=0x7f976c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:23:28.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:28.403+0000 7f976affd640 1 -- 172.21.15.77:0/1050321506 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f976c038070 con 0x7f977c0fb470 2024-09-18T21:23:28.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:28.403+0000 7f976affd640 1 -- 172.21.15.77:0/1050321506 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f976c0097e0 con 0x7f977c0fb470 2024-09-18T21:23:28.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:28.403+0000 7f97808ba640 1 -- 172.21.15.77:0/1050321506 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f977c1171b0 con 0x7f977c0fb470 2024-09-18T21:23:28.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:28.403+0000 7f976affd640 1 -- 172.21.15.77:0/1050321506 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f976c03d420 con 0x7f977c0fb470 2024-09-18T21:23:28.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:28.403+0000 7f97808ba640 1 -- 172.21.15.77:0/1050321506 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f977c117610 con 0x7f977c0fb470 2024-09-18T21:23:28.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:28.404+0000 7f97808ba640 1 -- 172.21.15.77:0/1050321506 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f977c0fcbb0 con 0x7f977c0fb470 2024-09-18T21:23:28.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:28.404+0000 7f976affd640 1 -- 172.21.15.77:0/1050321506 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f976c030020 con 0x7f977c0fb470 2024-09-18T21:23:28.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:28.405+0000 7f976affd640 1 --2- 172.21.15.77:0/1050321506 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f976406e0b0 0x7f9764070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:23:28.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:28.405+0000 7f9779d9b640 1 --2- 172.21.15.77:0/1050321506 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f976406e0b0 0x7f9764070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:23:28.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:28.405+0000 7f976affd640 1 -- 172.21.15.77:0/1050321506 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f976c0ae110 con 0x7f977c0fb470 2024-09-18T21:23:28.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:28.405+0000 7f9779d9b640 1 --2- 172.21.15.77:0/1050321506 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f976406e0b0 0x7f9764070560 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f977c066230 tx=0x7f9770009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:23:28.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:28.409+0000 7f976affd640 1 -- 172.21.15.77:0/1050321506 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f976c077410 con 0x7f977c0fb470 2024-09-18T21:23:28.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:28.639+0000 7f97808ba640 1 -- 172.21.15.77:0/1050321506 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f977c0fac30 con 0x7f977c0fb470 2024-09-18T21:23:28.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:28.639+0000 7f976affd640 1 -- 172.21.15.77:0/1050321506 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f976c07aad0 con 0x7f977c0fb470 2024-09-18T21:23:28.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:28.641+0000 7f97808ba640 1 -- 172.21.15.77:0/1050321506 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f976406e0b0 msgr2=0x7f9764070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:28.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:28.641+0000 7f97808ba640 1 --2- 172.21.15.77:0/1050321506 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f976406e0b0 0x7f9764070560 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f977c066230 tx=0x7f9770009040 comp rx=0 tx=0).stop 2024-09-18T21:23:28.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:28.641+0000 7f97808ba640 1 -- 172.21.15.77:0/1050321506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f977c0fb470 msgr2=0x7f977c10e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:28.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:28.641+0000 7f97808ba640 1 --2- 172.21.15.77:0/1050321506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f977c0fb470 0x7f977c10e140 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f976c003080 tx=0x7f976c009da0 comp rx=0 tx=0).stop 2024-09-18T21:23:28.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:28.641+0000 7f97808ba640 1 -- 172.21.15.77:0/1050321506 shutdown_connections 2024-09-18T21:23:28.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:28.641+0000 7f97808ba640 1 --2- 172.21.15.77:0/1050321506 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f976406e0b0 0x7f9764070560 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:28.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:28.641+0000 7f97808ba640 1 --2- 172.21.15.77:0/1050321506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f977c1014b0 0x7f977c10e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:28.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:28.641+0000 7f97808ba640 1 --2- 172.21.15.77:0/1050321506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f977c0fb470 0x7f977c10e140 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:28.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:28.641+0000 7f97808ba640 1 -- 172.21.15.77:0/1050321506 >> 172.21.15.77:0/1050321506 conn(0x7f977c0f7030 msgr2=0x7f977c0f88e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:23:28.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:28.642+0000 7f97808ba640 1 -- 172.21.15.77:0/1050321506 shutdown_connections 2024-09-18T21:23:28.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:28.642+0000 7f97808ba640 1 -- 172.21.15.77:0/1050321506 wait complete. 2024-09-18T21:23:28.651 INFO:teuthology.orchestra.run.smithi077.stdout:true 2024-09-18T21:23:29.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:28 smithi103 ceph-mon[80307]: pgmap v288: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:29.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:28 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/1050321506' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:23:29.326 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:28 smithi077 ceph-mon[92672]: pgmap v288: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:29.326 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:28 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/1050321506' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:23:29.350 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -e sha1=06b1b1de896d25f0645e4a306558ab0b4d4fc56f -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-09-18T21:23:29.593 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:23:31.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:31.137+0000 7fbabd2fd640 1 -- 172.21.15.77:0/3465530090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbab80fdf00 msgr2=0x7fbab81065d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:31.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:31.137+0000 7fbabd2fd640 1 --2- 172.21.15.77:0/3465530090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbab80fdf00 0x7fbab81065d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbaac004900 tx=0x7fbaac009da0 comp rx=0 tx=0).stop 2024-09-18T21:23:31.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:31.137+0000 7fbabd2fd640 1 -- 172.21.15.77:0/3465530090 shutdown_connections 2024-09-18T21:23:31.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:31.137+0000 7fbabd2fd640 1 --2- 172.21.15.77:0/3465530090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbab80fdf00 0x7fbab81065d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:31.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:31.137+0000 7fbabd2fd640 1 --2- 172.21.15.77:0/3465530090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbab80fd560 0x7fbab80fd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:31.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:31.137+0000 7fbabd2fd640 1 -- 172.21.15.77:0/3465530090 >> 172.21.15.77:0/3465530090 conn(0x7fbab80f7060 msgr2=0x7fbab80f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:23:31.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:31.137+0000 7fbabd2fd640 1 -- 172.21.15.77:0/3465530090 shutdown_connections 2024-09-18T21:23:31.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:31.137+0000 7fbabd2fd640 1 -- 172.21.15.77:0/3465530090 wait complete. 2024-09-18T21:23:31.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:31.138+0000 7fbabd2fd640 1 Processor -- start 2024-09-18T21:23:31.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:31.138+0000 7fbabd2fd640 1 -- start start 2024-09-18T21:23:31.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:31.138+0000 7fbabd2fd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbab80fd560 0x7fbab81132b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:23:31.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:31.138+0000 7fbabd2fd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbab80fdf00 0x7fbab81137f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:23:31.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:31.138+0000 7fbabd2fd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab8113df0 con 0x7fbab80fd560 2024-09-18T21:23:31.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:31.138+0000 7fbabd2fd640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab810d230 con 0x7fbab80fdf00 2024-09-18T21:23:31.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:31.138+0000 7fbab6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbab80fd560 0x7fbab81132b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:23:31.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:31.138+0000 7fbab6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbab80fd560 0x7fbab81132b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60706/0 (socket says 172.21.15.77:60706) 2024-09-18T21:23:31.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:31.138+0000 7fbab6ffd640 1 -- 172.21.15.77:0/3693289312 learned_addr learned my addr 172.21.15.77:0/3693289312 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:23:31.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:31.138+0000 7fbab67fc640 1 --2- 172.21.15.77:0/3693289312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbab80fdf00 0x7fbab81137f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:23:31.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:31.138+0000 7fbab6ffd640 1 -- 172.21.15.77:0/3693289312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbab80fdf00 msgr2=0x7fbab81137f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:31.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:31.138+0000 7fbab6ffd640 1 --2- 172.21.15.77:0/3693289312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbab80fdf00 0x7fbab81137f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:31.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:31.138+0000 7fbab6ffd640 1 -- 172.21.15.77:0/3693289312 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaac005040 con 0x7fbab80fd560 2024-09-18T21:23:31.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:31.138+0000 7fbab6ffd640 1 --2- 172.21.15.77:0/3693289312 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbab80fd560 0x7fbab81132b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fbaa800c790 tx=0x7fbaa80043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:23:31.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:31.139+0000 7fba9f7fe640 1 -- 172.21.15.77:0/3693289312 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbaa800a820 con 0x7fbab80fd560 2024-09-18T21:23:31.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:31.139+0000 7fba9f7fe640 1 -- 172.21.15.77:0/3693289312 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbaa800ae20 con 0x7fbab80fd560 2024-09-18T21:23:31.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:31.139+0000 7fbabd2fd640 1 -- 172.21.15.77:0/3693289312 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbab810d510 con 0x7fbab80fd560 2024-09-18T21:23:31.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:31.139+0000 7fba9f7fe640 1 -- 172.21.15.77:0/3693289312 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbaa80113a0 con 0x7fbab80fd560 2024-09-18T21:23:31.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:31.139+0000 7fbabd2fd640 1 -- 172.21.15.77:0/3693289312 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbab810da30 con 0x7fbab80fd560 2024-09-18T21:23:31.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:31.140+0000 7fbabd2fd640 1 -- 172.21.15.77:0/3693289312 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbab80662f0 con 0x7fbab80fd560 2024-09-18T21:23:31.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:31.140+0000 7fba9f7fe640 1 -- 172.21.15.77:0/3693289312 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fbaa8012400 con 0x7fbab80fd560 2024-09-18T21:23:31.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:31.141+0000 7fba9f7fe640 1 --2- 172.21.15.77:0/3693289312 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fbaa006e0b0 0x7fbaa0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:23:31.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:31.141+0000 7fba9f7fe640 1 -- 172.21.15.77:0/3693289312 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fbaa808ddf0 con 0x7fbab80fd560 2024-09-18T21:23:31.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:31.141+0000 7fbab67fc640 1 --2- 172.21.15.77:0/3693289312 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fbaa006e0b0 0x7fbaa0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:23:31.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:31.141+0000 7fbab67fc640 1 --2- 172.21.15.77:0/3693289312 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fbaa006e0b0 0x7fbaa0070560 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbaac007ac0 tx=0x7fbaac035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:23:31.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:31.145+0000 7fba9f7fe640 1 -- 172.21.15.77:0/3693289312 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fbaa80570f0 con 0x7fbab80fd560 2024-09-18T21:23:31.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:30 smithi077 ceph-mon[92672]: pgmap v289: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:31.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:30 smithi103 ceph-mon[80307]: pgmap v289: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:31.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:31.374+0000 7fbabd2fd640 1 -- 172.21.15.77:0/3693289312 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbab804b720 con 0x7fbab80fd560 2024-09-18T21:23:31.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:31.375+0000 7fba9f7fe640 1 -- 172.21.15.77:0/3693289312 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7fbaa800a980 con 0x7fbab80fd560 2024-09-18T21:23:31.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:31.377+0000 7fbabd2fd640 1 -- 172.21.15.77:0/3693289312 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fbaa006e0b0 msgr2=0x7fbaa0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:31.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:31.377+0000 7fbabd2fd640 1 --2- 172.21.15.77:0/3693289312 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fbaa006e0b0 0x7fbaa0070560 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbaac007ac0 tx=0x7fbaac035040 comp rx=0 tx=0).stop 2024-09-18T21:23:31.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:31.377+0000 7fbabd2fd640 1 -- 172.21.15.77:0/3693289312 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbab80fd560 msgr2=0x7fbab81132b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:31.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:31.377+0000 7fbabd2fd640 1 --2- 172.21.15.77:0/3693289312 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbab80fd560 0x7fbab81132b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fbaa800c790 tx=0x7fbaa80043c0 comp rx=0 tx=0).stop 2024-09-18T21:23:31.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:31.377+0000 7fbabd2fd640 1 -- 172.21.15.77:0/3693289312 shutdown_connections 2024-09-18T21:23:31.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:31.377+0000 7fbabd2fd640 1 --2- 172.21.15.77:0/3693289312 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fbaa006e0b0 0x7fbaa0070560 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:31.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:31.377+0000 7fbabd2fd640 1 --2- 172.21.15.77:0/3693289312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbab80fdf00 0x7fbab81137f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:31.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:31.377+0000 7fbabd2fd640 1 --2- 172.21.15.77:0/3693289312 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbab80fd560 0x7fbab81132b0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:31.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:31.377+0000 7fbabd2fd640 1 -- 172.21.15.77:0/3693289312 >> 172.21.15.77:0/3693289312 conn(0x7fbab80f7060 msgr2=0x7fbab80f85a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:23:31.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:31.377+0000 7fbabd2fd640 1 -- 172.21.15.77:0/3693289312 shutdown_connections 2024-09-18T21:23:31.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:31.377+0000 7fbabd2fd640 1 -- 172.21.15.77:0/3693289312 wait complete. 2024-09-18T21:23:31.386 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph version 19.1.1-17-g06b1b1de (06b1b1de896d25f0645e4a306558ab0b4d4fc56f) squid (stable)" 2024-09-18T21:23:32.091 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:32 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/3693289312' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:23:32.117 DEBUG:teuthology.parallel:result is None 2024-09-18T21:23:32.118 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-18T21:23:32.131 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi077.front.sepia.ceph.com 2024-09-18T21:23:32.131 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-18T21:23:32.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:32 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/3693289312' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-18T21:23:32.379 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:23:33.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:33 smithi077 ceph-mon[92672]: pgmap v290: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:33.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:33 smithi103 ceph-mon[80307]: pgmap v290: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:34.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:34.030+0000 7f9c7b374640 1 -- 172.21.15.77:0/438147262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c740fb4a0 msgr2=0x7f9c740fb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:34.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:34.030+0000 7f9c7b374640 1 --2- 172.21.15.77:0/438147262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c740fb4a0 0x7f9c740fb910 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9c680048d0 tx=0x7f9c68009da0 comp rx=0 tx=0).stop 2024-09-18T21:23:34.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:34.030+0000 7f9c7b374640 1 -- 172.21.15.77:0/438147262 shutdown_connections 2024-09-18T21:23:34.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:34.030+0000 7f9c7b374640 1 --2- 172.21.15.77:0/438147262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c740fb4a0 0x7f9c740fb910 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:34.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:34.030+0000 7f9c7b374640 1 --2- 172.21.15.77:0/438147262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c741014e0 0x7f9c741018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:34.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:34.030+0000 7f9c7b374640 1 -- 172.21.15.77:0/438147262 >> 172.21.15.77:0/438147262 conn(0x7f9c740f7060 msgr2=0x7f9c740f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:23:34.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:34.030+0000 7f9c7b374640 1 -- 172.21.15.77:0/438147262 shutdown_connections 2024-09-18T21:23:34.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:34.030+0000 7f9c7b374640 1 -- 172.21.15.77:0/438147262 wait complete. 2024-09-18T21:23:34.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:34.030+0000 7f9c7b374640 1 Processor -- start 2024-09-18T21:23:34.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:34.031+0000 7f9c7b374640 1 -- start start 2024-09-18T21:23:34.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:34.031+0000 7f9c7b374640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c740fb4a0 0x7f9c740fd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:23:34.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:34.031+0000 7f9c7b374640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c741014e0 0x7f9c740fd600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:23:34.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:34.031+0000 7f9c7b374640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c740fdb40 con 0x7f9c741014e0 2024-09-18T21:23:34.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:34.031+0000 7f9c7b374640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c740fdcb0 con 0x7f9c740fb4a0 2024-09-18T21:23:34.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:34.031+0000 7f9c7890f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c741014e0 0x7f9c740fd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:23:34.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:34.031+0000 7f9c7890f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c741014e0 0x7f9c740fd600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60714/0 (socket says 172.21.15.77:60714) 2024-09-18T21:23:34.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:34.031+0000 7f9c7890f640 1 -- 172.21.15.77:0/3351235793 learned_addr learned my addr 172.21.15.77:0/3351235793 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:23:34.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:34.031+0000 7f9c79110640 1 --2- 172.21.15.77:0/3351235793 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c740fb4a0 0x7f9c740fd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:23:34.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:34.031+0000 7f9c7890f640 1 -- 172.21.15.77:0/3351235793 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c740fb4a0 msgr2=0x7f9c740fd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:34.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:34.031+0000 7f9c7890f640 1 --2- 172.21.15.77:0/3351235793 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c740fb4a0 0x7f9c740fd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:34.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:34.031+0000 7f9c7890f640 1 -- 172.21.15.77:0/3351235793 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c68005040 con 0x7f9c741014e0 2024-09-18T21:23:34.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:34.031+0000 7f9c79110640 1 --2- 172.21.15.77:0/3351235793 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c740fb4a0 0x7f9c740fd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T21:23:34.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:34.031+0000 7f9c7890f640 1 --2- 172.21.15.77:0/3351235793 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c741014e0 0x7f9c740fd600 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9c68003080 tx=0x7f9c68009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:23:34.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:34.032+0000 7f9c65ffb640 1 -- 172.21.15.77:0/3351235793 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c68038070 con 0x7f9c741014e0 2024-09-18T21:23:34.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:34.032+0000 7f9c7b374640 1 -- 172.21.15.77:0/3351235793 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c740fdee0 con 0x7f9c741014e0 2024-09-18T21:23:34.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:34.032+0000 7f9c65ffb640 1 -- 172.21.15.77:0/3351235793 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9c6802ade0 con 0x7f9c741014e0 2024-09-18T21:23:34.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:34.032+0000 7f9c65ffb640 1 -- 172.21.15.77:0/3351235793 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c6802c880 con 0x7f9c741014e0 2024-09-18T21:23:34.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:34.032+0000 7f9c7b374640 1 -- 172.21.15.77:0/3351235793 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c74119800 con 0x7f9c741014e0 2024-09-18T21:23:34.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:34.033+0000 7f9c7b374640 1 -- 172.21.15.77:0/3351235793 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c740fcbe0 con 0x7f9c741014e0 2024-09-18T21:23:34.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:34.033+0000 7f9c65ffb640 1 -- 172.21.15.77:0/3351235793 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9c68030020 con 0x7f9c741014e0 2024-09-18T21:23:34.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:34.034+0000 7f9c65ffb640 1 --2- 172.21.15.77:0/3351235793 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f9c6006e0b0 0x7f9c60070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:23:34.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:34.034+0000 7f9c65ffb640 1 -- 172.21.15.77:0/3351235793 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f9c680add10 con 0x7f9c741014e0 2024-09-18T21:23:34.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:34.034+0000 7f9c79110640 1 --2- 172.21.15.77:0/3351235793 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f9c6006e0b0 0x7f9c60070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:23:34.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:34.034+0000 7f9c79110640 1 --2- 172.21.15.77:0/3351235793 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f9c6006e0b0 0x7f9c60070560 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9c700041d0 tx=0x7f9c70009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:23:34.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:34.038+0000 7f9c65ffb640 1 -- 172.21.15.77:0/3351235793 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f9c68076f90 con 0x7f9c741014e0 2024-09-18T21:23:34.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:34.240+0000 7f9c7b374640 1 -- 172.21.15.77:0/3351235793 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9c740fac60 con 0x7f9c741014e0 2024-09-18T21:23:34.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:34.240+0000 7f9c65ffb640 1 -- 172.21.15.77:0/3351235793 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 36 v36) v1 ==== 76+0+1978 (secure 0 0 0) 0x7f9c6807a650 con 0x7f9c741014e0 2024-09-18T21:23:34.241 INFO:teuthology.orchestra.run.smithi077.stdout:e36 2024-09-18T21:23:34.241 INFO:teuthology.orchestra.run.smithi077.stdout:btime 2024-09-18T21:20:34:069185+0000 2024-09-18T21:23:34.242 INFO:teuthology.orchestra.run.smithi077.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-18T21:23:34.242 INFO:teuthology.orchestra.run.smithi077.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-18T21:23:34.242 INFO:teuthology.orchestra.run.smithi077.stdout:legacy client fscid: 1 2024-09-18T21:23:34.242 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:23:34.242 INFO:teuthology.orchestra.run.smithi077.stdout:Filesystem 'cephfs' (1) 2024-09-18T21:23:34.242 INFO:teuthology.orchestra.run.smithi077.stdout:fs_name cephfs 2024-09-18T21:23:34.242 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 35 2024-09-18T21:23:34.242 INFO:teuthology.orchestra.run.smithi077.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-18T21:23:34.242 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-09-18T21:10:17.230179+0000 2024-09-18T21:23:34.242 INFO:teuthology.orchestra.run.smithi077.stdout:modified 2024-09-18T21:20:33.060016+0000 2024-09-18T21:23:34.242 INFO:teuthology.orchestra.run.smithi077.stdout:tableserver 0 2024-09-18T21:23:34.242 INFO:teuthology.orchestra.run.smithi077.stdout:root 0 2024-09-18T21:23:34.242 INFO:teuthology.orchestra.run.smithi077.stdout:session_timeout 60 2024-09-18T21:23:34.242 INFO:teuthology.orchestra.run.smithi077.stdout:session_autoclose 300 2024-09-18T21:23:34.242 INFO:teuthology.orchestra.run.smithi077.stdout:max_file_size 1099511627776 2024-09-18T21:23:34.243 INFO:teuthology.orchestra.run.smithi077.stdout:max_xattr_size 65536 2024-09-18T21:23:34.243 INFO:teuthology.orchestra.run.smithi077.stdout:required_client_features {} 2024-09-18T21:23:34.243 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure 0 2024-09-18T21:23:34.243 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure_osd_epoch 80 2024-09-18T21:23:34.243 INFO:teuthology.orchestra.run.smithi077.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-18T21:23:34.243 INFO:teuthology.orchestra.run.smithi077.stdout:max_mds 1 2024-09-18T21:23:34.243 INFO:teuthology.orchestra.run.smithi077.stdout:in 0 2024-09-18T21:23:34.243 INFO:teuthology.orchestra.run.smithi077.stdout:up {0=34400} 2024-09-18T21:23:34.243 INFO:teuthology.orchestra.run.smithi077.stdout:failed 2024-09-18T21:23:34.243 INFO:teuthology.orchestra.run.smithi077.stdout:damaged 2024-09-18T21:23:34.243 INFO:teuthology.orchestra.run.smithi077.stdout:stopped 2024-09-18T21:23:34.243 INFO:teuthology.orchestra.run.smithi077.stdout:data_pools [3] 2024-09-18T21:23:34.243 INFO:teuthology.orchestra.run.smithi077.stdout:metadata_pool 2 2024-09-18T21:23:34.243 INFO:teuthology.orchestra.run.smithi077.stdout:inline_data disabled 2024-09-18T21:23:34.243 INFO:teuthology.orchestra.run.smithi077.stdout:balancer 2024-09-18T21:23:34.244 INFO:teuthology.orchestra.run.smithi077.stdout:bal_rank_mask -1 2024-09-18T21:23:34.244 INFO:teuthology.orchestra.run.smithi077.stdout:standby_count_wanted 1 2024-09-18T21:23:34.244 INFO:teuthology.orchestra.run.smithi077.stdout:qdb_cluster leader: 34400 members: 34400 2024-09-18T21:23:34.244 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.vruydi{0:34400} state up:active seq 19 join_fscid=1 addr [v2:172.21.15.77:6826/1087320436,v1:172.21.15.77:6827/1087320436] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T21:23:34.244 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:23:34.244 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:23:34.244 INFO:teuthology.orchestra.run.smithi077.stdout:Standby daemons: 2024-09-18T21:23:34.244 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:23:34.244 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi077.cqfhlw{-1:34404} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.77:6828/1489733233,v1:172.21.15.77:6829/1489733233] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T21:23:34.244 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi103.zhdmdg{-1:44287} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.103:6824/3296796313,v1:172.21.15.103:6825/3296796313] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T21:23:34.244 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.cephfs.smithi103.opftmf{-1:44307} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.103:6826/3688450345,v1:172.21.15.103:6827/3688450345] compat {c=[1],r=[1],i=[1fff]}] 2024-09-18T21:23:34.245 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 36 2024-09-18T21:23:34.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:34.243+0000 7f9c7b374640 1 -- 172.21.15.77:0/3351235793 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f9c6006e0b0 msgr2=0x7f9c60070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:34.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:34.243+0000 7f9c7b374640 1 --2- 172.21.15.77:0/3351235793 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f9c6006e0b0 0x7f9c60070560 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9c700041d0 tx=0x7f9c70009040 comp rx=0 tx=0).stop 2024-09-18T21:23:34.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:34.243+0000 7f9c7b374640 1 -- 172.21.15.77:0/3351235793 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c741014e0 msgr2=0x7f9c740fd600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:34.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:34.243+0000 7f9c7b374640 1 --2- 172.21.15.77:0/3351235793 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c741014e0 0x7f9c740fd600 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9c68003080 tx=0x7f9c68009da0 comp rx=0 tx=0).stop 2024-09-18T21:23:34.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:34.243+0000 7f9c7b374640 1 -- 172.21.15.77:0/3351235793 shutdown_connections 2024-09-18T21:23:34.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:34.243+0000 7f9c7b374640 1 --2- 172.21.15.77:0/3351235793 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c741014e0 0x7f9c740fd600 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:34.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:34.243+0000 7f9c7b374640 1 --2- 172.21.15.77:0/3351235793 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f9c6006e0b0 0x7f9c60070560 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:34.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:34.243+0000 7f9c7b374640 1 --2- 172.21.15.77:0/3351235793 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9c740fb4a0 0x7f9c740fd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:34.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:34.243+0000 7f9c7b374640 1 -- 172.21.15.77:0/3351235793 >> 172.21.15.77:0/3351235793 conn(0x7f9c740f7060 msgr2=0x7f9c74065a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:23:34.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:34.243+0000 7f9c7b374640 1 -- 172.21.15.77:0/3351235793 shutdown_connections 2024-09-18T21:23:34.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:34.243+0000 7f9c7b374640 1 -- 172.21.15.77:0/3351235793 wait complete. 2024-09-18T21:23:34.896 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-09-18T21:23:34.906 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-18T21:23:35.153 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:23:35.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:35 smithi077 ceph-mon[92672]: pgmap v291: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:35.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:35 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/3351235793' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T21:23:35.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:35 smithi103 ceph-mon[80307]: pgmap v291: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:35.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:35 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/3351235793' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-18T21:23:36.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:36 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:23:36.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:36 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:23:36.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:36.717+0000 7fbfe31dc640 1 -- 172.21.15.77:0/237869540 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfdc102ef0 msgr2=0x7fbfdc0fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:36.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:36.717+0000 7fbfe31dc640 1 --2- 172.21.15.77:0/237869540 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfdc102ef0 0x7fbfdc0fc5b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbfc80048d0 tx=0x7fbfc8009da0 comp rx=0 tx=0).stop 2024-09-18T21:23:36.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:36.717+0000 7fbfe31dc640 1 -- 172.21.15.77:0/237869540 shutdown_connections 2024-09-18T21:23:36.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:36.717+0000 7fbfe31dc640 1 --2- 172.21.15.77:0/237869540 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfdc102ef0 0x7fbfdc0fc5b0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:36.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:36.717+0000 7fbfe31dc640 1 --2- 172.21.15.77:0/237869540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfdc102550 0x7fbfdc102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:36.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:36.717+0000 7fbfe31dc640 1 -- 172.21.15.77:0/237869540 >> 172.21.15.77:0/237869540 conn(0x7fbfdc0f80f0 msgr2=0x7fbfdc0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:23:36.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:36.717+0000 7fbfe31dc640 1 -- 172.21.15.77:0/237869540 shutdown_connections 2024-09-18T21:23:36.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:36.717+0000 7fbfe31dc640 1 -- 172.21.15.77:0/237869540 wait complete. 2024-09-18T21:23:36.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:36.718+0000 7fbfe31dc640 1 Processor -- start 2024-09-18T21:23:36.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:36.718+0000 7fbfe31dc640 1 -- start start 2024-09-18T21:23:36.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:36.718+0000 7fbfe31dc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfdc102550 0x7fbfdc06fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:23:36.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:36.718+0000 7fbfe31dc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfdc102ef0 0x7fbfdc06ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:23:36.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:36.718+0000 7fbfe31dc640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc070520 con 0x7fbfdc102ef0 2024-09-18T21:23:36.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:36.718+0000 7fbfe31dc640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc070690 con 0x7fbfdc102550 2024-09-18T21:23:36.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:36.718+0000 7fbfdbfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfdc102ef0 0x7fbfdc06ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:23:36.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:36.718+0000 7fbfdbfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfdc102ef0 0x7fbfdc06ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60730/0 (socket says 172.21.15.77:60730) 2024-09-18T21:23:36.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:36.718+0000 7fbfdbfff640 1 -- 172.21.15.77:0/3349627233 learned_addr learned my addr 172.21.15.77:0/3349627233 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:23:36.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:36.718+0000 7fbfe0f78640 1 --2- 172.21.15.77:0/3349627233 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfdc102550 0x7fbfdc06fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:23:36.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:36.718+0000 7fbfdbfff640 1 -- 172.21.15.77:0/3349627233 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfdc102550 msgr2=0x7fbfdc06fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:36.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:36.718+0000 7fbfdbfff640 1 --2- 172.21.15.77:0/3349627233 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfdc102550 0x7fbfdc06fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:36.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:36.718+0000 7fbfdbfff640 1 -- 172.21.15.77:0/3349627233 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc8005040 con 0x7fbfdc102ef0 2024-09-18T21:23:36.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:36.719+0000 7fbfe0f78640 1 --2- 172.21.15.77:0/3349627233 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfdc102550 0x7fbfdc06fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T21:23:36.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:36.719+0000 7fbfdbfff640 1 --2- 172.21.15.77:0/3349627233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfdc102ef0 0x7fbfdc06ff50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8003080 tx=0x7fbfc8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:23:36.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:36.719+0000 7fbfd97fa640 1 -- 172.21.15.77:0/3349627233 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfc8038070 con 0x7fbfdc102ef0 2024-09-18T21:23:36.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:36.719+0000 7fbfd97fa640 1 -- 172.21.15.77:0/3349627233 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbfc8009760 con 0x7fbfdc102ef0 2024-09-18T21:23:36.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:36.719+0000 7fbfe31dc640 1 -- 172.21.15.77:0/3349627233 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfdc1198d0 con 0x7fbfdc102ef0 2024-09-18T21:23:36.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:36.719+0000 7fbfd97fa640 1 -- 172.21.15.77:0/3349627233 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfc803d420 con 0x7fbfdc102ef0 2024-09-18T21:23:36.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:36.719+0000 7fbfe31dc640 1 -- 172.21.15.77:0/3349627233 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfdc119c50 con 0x7fbfdc102ef0 2024-09-18T21:23:36.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:36.720+0000 7fbfe31dc640 1 -- 172.21.15.77:0/3349627233 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfdc0fdcd0 con 0x7fbfdc102ef0 2024-09-18T21:23:36.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:36.720+0000 7fbfd97fa640 1 -- 172.21.15.77:0/3349627233 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fbfc8030020 con 0x7fbfdc102ef0 2024-09-18T21:23:36.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:36.721+0000 7fbfd97fa640 1 --2- 172.21.15.77:0/3349627233 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fbfcc06e0b0 0x7fbfcc070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:23:36.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:36.721+0000 7fbfe0f78640 1 --2- 172.21.15.77:0/3349627233 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fbfcc06e0b0 0x7fbfcc070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:23:36.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:36.721+0000 7fbfd97fa640 1 -- 172.21.15.77:0/3349627233 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fbfc80ae040 con 0x7fbfdc102ef0 2024-09-18T21:23:36.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:36.721+0000 7fbfe0f78640 1 --2- 172.21.15.77:0/3349627233 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fbfcc06e0b0 0x7fbfcc070560 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbfd0006fd0 tx=0x7fbfd0008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:23:36.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:36.725+0000 7fbfd97fa640 1 -- 172.21.15.77:0/3349627233 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fbfc8077340 con 0x7fbfdc102ef0 2024-09-18T21:23:36.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:36.931+0000 7fbfe31dc640 1 -- 172.21.15.77:0/3349627233 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbfdc109640 con 0x7fbfdc102ef0 2024-09-18T21:23:36.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:36.931+0000 7fbfd97fa640 1 -- 172.21.15.77:0/3349627233 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+5255 (secure 0 0 0) 0x7fbfc807aa00 con 0x7fbfdc102ef0 2024-09-18T21:23:36.932 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:23:36.932 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":36,"btime":"2024-09-18T21:20:34:069185+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi077.cqfhlw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6829/1489733233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1489733233},{"type":"v1","addr":"172.21.15.77:6829","nonce":1489733233}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44287,"name":"cephfs.smithi103.zhdmdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6825/3296796313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3296796313},{"type":"v1","addr":"172.21.15.103:6825","nonce":3296796313}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":44307,"name":"cephfs.smithi103.opftmf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6827/3688450345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":3688450345},{"type":"v1","addr":"172.21.15.103:6827","nonce":3688450345}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T21:10:17.230179+0000","modified":"2024-09-18T21:20:33.060016+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34400},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34400":{"gid":34400,"name":"cephfs.smithi077.vruydi","rank":0,"incarnation":32,"state":"up:active","state_seq":19,"addr":"172.21.15.77:6827/1087320436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1087320436},{"type":"v1","addr":"172.21.15.77:6827","nonce":1087320436}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34400,"qdb_cluster":[34400]},"id":1}]} 2024-09-18T21:23:36.933 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 36 2024-09-18T21:23:36.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:36.933+0000 7fbfe31dc640 1 -- 172.21.15.77:0/3349627233 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fbfcc06e0b0 msgr2=0x7fbfcc070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:36.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:36.933+0000 7fbfe31dc640 1 --2- 172.21.15.77:0/3349627233 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fbfcc06e0b0 0x7fbfcc070560 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbfd0006fd0 tx=0x7fbfd0008040 comp rx=0 tx=0).stop 2024-09-18T21:23:36.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:36.933+0000 7fbfe31dc640 1 -- 172.21.15.77:0/3349627233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfdc102ef0 msgr2=0x7fbfdc06ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:36.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:36.933+0000 7fbfe31dc640 1 --2- 172.21.15.77:0/3349627233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfdc102ef0 0x7fbfdc06ff50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8003080 tx=0x7fbfc8009da0 comp rx=0 tx=0).stop 2024-09-18T21:23:36.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:36.933+0000 7fbfe31dc640 1 -- 172.21.15.77:0/3349627233 shutdown_connections 2024-09-18T21:23:36.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:36.933+0000 7fbfe31dc640 1 --2- 172.21.15.77:0/3349627233 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfdc102ef0 0x7fbfdc06ff50 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:36.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:36.933+0000 7fbfe31dc640 1 --2- 172.21.15.77:0/3349627233 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fbfcc06e0b0 0x7fbfcc070560 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:36.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:36.933+0000 7fbfe31dc640 1 --2- 172.21.15.77:0/3349627233 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfdc102550 0x7fbfdc06fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:36.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:36.933+0000 7fbfe31dc640 1 -- 172.21.15.77:0/3349627233 >> 172.21.15.77:0/3349627233 conn(0x7fbfdc0f80f0 msgr2=0x7fbfdc0f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:23:36.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:36.933+0000 7fbfe31dc640 1 -- 172.21.15.77:0/3349627233 shutdown_connections 2024-09-18T21:23:36.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:36.933+0000 7fbfe31dc640 1 -- 172.21.15.77:0/3349627233 wait complete. 2024-09-18T21:23:37.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:37 smithi077 ceph-mon[92672]: pgmap v292: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:37.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:37 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/3349627233' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-18T21:23:37.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:37 smithi103 ceph-mon[80307]: pgmap v292: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:37.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:37 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/3349627233' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-18T21:23:37.589 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 13, 'max_mds': 1, 'flags': 18} 2024-09-18T21:23:37.589 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 14 2024-09-18T21:23:37.837 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:23:39.205 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:39 smithi077 ceph-mon[92672]: pgmap v293: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:39.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:39.457+0000 7f9711206640 1 -- 172.21.15.77:0/1700583589 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f970c0fdf10 msgr2=0x7f970c106550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:39.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:39.457+0000 7f9711206640 1 --2- 172.21.15.77:0/1700583589 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f970c0fdf10 0x7f970c106550 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f97000048d0 tx=0x7f9700009da0 comp rx=0 tx=0).stop 2024-09-18T21:23:39.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:39.457+0000 7f9711206640 1 -- 172.21.15.77:0/1700583589 shutdown_connections 2024-09-18T21:23:39.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:39.457+0000 7f9711206640 1 --2- 172.21.15.77:0/1700583589 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f970c0fdf10 0x7f970c106550 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:39.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:39.457+0000 7f9711206640 1 --2- 172.21.15.77:0/1700583589 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f970c0fd570 0x7f970c0fd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:39.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:39.457+0000 7f9711206640 1 -- 172.21.15.77:0/1700583589 >> 172.21.15.77:0/1700583589 conn(0x7f970c0f7000 msgr2=0x7f970c0f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:23:39.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:39.457+0000 7f9711206640 1 -- 172.21.15.77:0/1700583589 shutdown_connections 2024-09-18T21:23:39.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:39.457+0000 7f9711206640 1 -- 172.21.15.77:0/1700583589 wait complete. 2024-09-18T21:23:39.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:39.458+0000 7f9711206640 1 Processor -- start 2024-09-18T21:23:39.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:39.458+0000 7f9711206640 1 -- start start 2024-09-18T21:23:39.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:39.458+0000 7f9711206640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f970c0fd570 0x7f970c113280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:23:39.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:39.458+0000 7f9711206640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f970c0fdf10 0x7f970c1137c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:23:39.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:39.458+0000 7f9711206640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970c113dc0 con 0x7f970c0fdf10 2024-09-18T21:23:39.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:39.458+0000 7f9711206640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970c10d200 con 0x7f970c0fd570 2024-09-18T21:23:39.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:39.458+0000 7f970a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f970c0fdf10 0x7f970c1137c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:23:39.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:39.458+0000 7f970a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f970c0fdf10 0x7f970c1137c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38280/0 (socket says 172.21.15.77:38280) 2024-09-18T21:23:39.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:39.458+0000 7f970a59c640 1 -- 172.21.15.77:0/230760976 learned_addr learned my addr 172.21.15.77:0/230760976 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:23:39.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:39.459+0000 7f970ad9d640 1 --2- 172.21.15.77:0/230760976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f970c0fd570 0x7f970c113280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:23:39.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:39.459+0000 7f970a59c640 1 -- 172.21.15.77:0/230760976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f970c0fd570 msgr2=0x7f970c113280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:39.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:39.459+0000 7f970a59c640 1 --2- 172.21.15.77:0/230760976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f970c0fd570 0x7f970c113280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:39.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:39.459+0000 7f970a59c640 1 -- 172.21.15.77:0/230760976 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9700005040 con 0x7f970c0fdf10 2024-09-18T21:23:39.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:39.459+0000 7f970ad9d640 1 --2- 172.21.15.77:0/230760976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f970c0fd570 0x7f970c113280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T21:23:39.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:39.459+0000 7f970a59c640 1 --2- 172.21.15.77:0/230760976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f970c0fdf10 0x7f970c1137c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9700003080 tx=0x7f9700009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:23:39.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:39.459+0000 7f96f37fe640 1 -- 172.21.15.77:0/230760976 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9700038070 con 0x7f970c0fdf10 2024-09-18T21:23:39.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:39.459+0000 7f9711206640 1 -- 172.21.15.77:0/230760976 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f970c10d480 con 0x7f970c0fdf10 2024-09-18T21:23:39.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:39.459+0000 7f96f37fe640 1 -- 172.21.15.77:0/230760976 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f97000097e0 con 0x7f970c0fdf10 2024-09-18T21:23:39.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:39.459+0000 7f96f37fe640 1 -- 172.21.15.77:0/230760976 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f970003d420 con 0x7f970c0fdf10 2024-09-18T21:23:39.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:39.459+0000 7f9711206640 1 -- 172.21.15.77:0/230760976 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f970c10d940 con 0x7f970c0fdf10 2024-09-18T21:23:39.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:39.460+0000 7f9711206640 1 -- 172.21.15.77:0/230760976 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f970c066330 con 0x7f970c0fdf10 2024-09-18T21:23:39.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:39.460+0000 7f96f37fe640 1 -- 172.21.15.77:0/230760976 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9700030020 con 0x7f970c0fdf10 2024-09-18T21:23:39.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:39.461+0000 7f96f37fe640 1 --2- 172.21.15.77:0/230760976 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f96f406e0b0 0x7f96f4070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:23:39.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:39.461+0000 7f96f37fe640 1 -- 172.21.15.77:0/230760976 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f97000ae1f0 con 0x7f970c0fdf10 2024-09-18T21:23:39.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:39.461+0000 7f970ad9d640 1 --2- 172.21.15.77:0/230760976 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f96f406e0b0 0x7f96f4070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:23:39.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:39.461+0000 7f970ad9d640 1 --2- 172.21.15.77:0/230760976 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f96f406e0b0 0x7f96f4070560 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f96fc0041d0 tx=0x7f96fc009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:23:39.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:39.465+0000 7f96f37fe640 1 -- 172.21.15.77:0/230760976 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f9700077470 con 0x7f970c0fdf10 2024-09-18T21:23:39.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:39 smithi103 ceph-mon[80307]: pgmap v293: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:39.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:39.666+0000 7f9711206640 1 -- 172.21.15.77:0/230760976 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 14, "format": "json"} v 0) v1 -- 0x7f970c109570 con 0x7f970c0fdf10 2024-09-18T21:23:39.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:39.667+0000 7f96f37fe640 1 -- 172.21.15.77:0/230760976 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 14, "format": "json"}]=0 dumped fsmap epoch 14 v36) v1 ==== 107+0+4112 (secure 0 0 0) 0x7f970007ab30 con 0x7f970c0fdf10 2024-09-18T21:23:39.669 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:23:39.669 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":14,"btime":"2024-09-18T21:19:14:342222+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14458,"name":"cephfs.smithi077.cqfhlw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.77:6829/862540650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":862540650},{"type":"v1","addr":"172.21.15.77:6829","nonce":862540650}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24255,"name":"cephfs.smithi103.zhdmdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.103:6825/2170237078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2170237078},{"type":"v1","addr":"172.21.15.103:6825","nonce":2170237078}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24267,"name":"cephfs.smithi103.opftmf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.103:6827/4241818403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":4241818403},{"type":"v1","addr":"172.21.15.103:6827","nonce":4241818403}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T21:10:17.230179+0000","modified":"2024-09-18T21:19:14.342006+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T21:23:39.670 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 14 2024-09-18T21:23:39.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:39.669+0000 7f9711206640 1 -- 172.21.15.77:0/230760976 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f96f406e0b0 msgr2=0x7f96f4070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:39.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:39.669+0000 7f9711206640 1 --2- 172.21.15.77:0/230760976 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f96f406e0b0 0x7f96f4070560 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f96fc0041d0 tx=0x7f96fc009040 comp rx=0 tx=0).stop 2024-09-18T21:23:39.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:39.669+0000 7f9711206640 1 -- 172.21.15.77:0/230760976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f970c0fdf10 msgr2=0x7f970c1137c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:39.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:39.669+0000 7f9711206640 1 --2- 172.21.15.77:0/230760976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f970c0fdf10 0x7f970c1137c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9700003080 tx=0x7f9700009da0 comp rx=0 tx=0).stop 2024-09-18T21:23:39.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:39.669+0000 7f9711206640 1 -- 172.21.15.77:0/230760976 shutdown_connections 2024-09-18T21:23:39.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:39.669+0000 7f9711206640 1 --2- 172.21.15.77:0/230760976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f970c0fdf10 0x7f970c1137c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:39.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:39.669+0000 7f9711206640 1 --2- 172.21.15.77:0/230760976 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f96f406e0b0 0x7f96f4070560 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:39.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:39.669+0000 7f9711206640 1 --2- 172.21.15.77:0/230760976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f970c0fd570 0x7f970c113280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:39.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:39.669+0000 7f9711206640 1 -- 172.21.15.77:0/230760976 >> 172.21.15.77:0/230760976 conn(0x7f970c0f7000 msgr2=0x7f970c0f8550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:23:39.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:39.669+0000 7f9711206640 1 -- 172.21.15.77:0/230760976 shutdown_connections 2024-09-18T21:23:39.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:39.669+0000 7f9711206640 1 -- 172.21.15.77:0/230760976 wait complete. 2024-09-18T21:23:40.302 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:40 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/230760976' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 14, "format": "json"}]: dispatch 2024-09-18T21:23:40.327 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 15 2024-09-18T21:23:40.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:40 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/230760976' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 14, "format": "json"}]: dispatch 2024-09-18T21:23:40.571 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:23:41.375 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:41 smithi077 ceph-mon[92672]: pgmap v294: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:41.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:41 smithi103 ceph-mon[80307]: pgmap v294: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:42.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:42.300+0000 7f5a0ff42640 1 -- 172.21.15.77:0/3063381635 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a08102560 msgr2=0x7f5a08102930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:42.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:42.300+0000 7f5a0ff42640 1 --2- 172.21.15.77:0/3063381635 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a08102560 0x7f5a08102930 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5a040048d0 tx=0x7f5a04009da0 comp rx=0 tx=0).stop 2024-09-18T21:23:42.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:42.300+0000 7f5a0ff42640 1 -- 172.21.15.77:0/3063381635 shutdown_connections 2024-09-18T21:23:42.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:42.300+0000 7f5a0ff42640 1 --2- 172.21.15.77:0/3063381635 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a08102f00 0x7f5a080fc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:42.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:42.300+0000 7f5a0ff42640 1 --2- 172.21.15.77:0/3063381635 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a08102560 0x7f5a08102930 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:42.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:42.300+0000 7f5a0ff42640 1 -- 172.21.15.77:0/3063381635 >> 172.21.15.77:0/3063381635 conn(0x7f5a080f8100 msgr2=0x7f5a080fa510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:23:42.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:42.300+0000 7f5a0ff42640 1 -- 172.21.15.77:0/3063381635 shutdown_connections 2024-09-18T21:23:42.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:42.300+0000 7f5a0ff42640 1 -- 172.21.15.77:0/3063381635 wait complete. 2024-09-18T21:23:42.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:42.301+0000 7f5a0ff42640 1 Processor -- start 2024-09-18T21:23:42.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:42.301+0000 7f5a0ff42640 1 -- start start 2024-09-18T21:23:42.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:42.301+0000 7f5a0ff42640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a08102560 0x7f5a081131e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:23:42.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:42.301+0000 7f5a0ff42640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a08102f00 0x7f5a08113720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:23:42.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:42.301+0000 7f5a0ff42640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a08113d20 con 0x7f5a08102f00 2024-09-18T21:23:42.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:42.301+0000 7f5a0ff42640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0810d160 con 0x7f5a08102560 2024-09-18T21:23:42.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:42.302+0000 7f5a0d4dd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a08102f00 0x7f5a08113720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:23:42.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:42.302+0000 7f5a0d4dd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a08102f00 0x7f5a08113720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38292/0 (socket says 172.21.15.77:38292) 2024-09-18T21:23:42.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:42.302+0000 7f5a0d4dd640 1 -- 172.21.15.77:0/19035593 learned_addr learned my addr 172.21.15.77:0/19035593 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:23:42.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:42.302+0000 7f5a0dcde640 1 --2- 172.21.15.77:0/19035593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a08102560 0x7f5a081131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:23:42.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:42.302+0000 7f5a0d4dd640 1 -- 172.21.15.77:0/19035593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a08102560 msgr2=0x7f5a081131e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:42.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:42.302+0000 7f5a0d4dd640 1 --2- 172.21.15.77:0/19035593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a08102560 0x7f5a081131e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:42.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:42.302+0000 7f5a0d4dd640 1 -- 172.21.15.77:0/19035593 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a04005040 con 0x7f5a08102f00 2024-09-18T21:23:42.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:42.302+0000 7f5a0d4dd640 1 --2- 172.21.15.77:0/19035593 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a08102f00 0x7f5a08113720 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f59f800c760 tx=0x7f59f800cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:23:42.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:42.302+0000 7f59fe7fc640 1 -- 172.21.15.77:0/19035593 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59f800a7a0 con 0x7f5a08102f00 2024-09-18T21:23:42.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:42.302+0000 7f5a0ff42640 1 -- 172.21.15.77:0/19035593 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a0810d440 con 0x7f5a08102f00 2024-09-18T21:23:42.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:42.302+0000 7f59fe7fc640 1 -- 172.21.15.77:0/19035593 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f59f800ada0 con 0x7f5a08102f00 2024-09-18T21:23:42.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:42.302+0000 7f59fe7fc640 1 -- 172.21.15.77:0/19035593 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59f80113a0 con 0x7f5a08102f00 2024-09-18T21:23:42.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:42.302+0000 7f5a0ff42640 1 -- 172.21.15.77:0/19035593 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a0810d9e0 con 0x7f5a08102f00 2024-09-18T21:23:42.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:42.304+0000 7f5a0ff42640 1 -- 172.21.15.77:0/19035593 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a080fdce0 con 0x7f5a08102f00 2024-09-18T21:23:42.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:42.305+0000 7f59fe7fc640 1 -- 172.21.15.77:0/19035593 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f59f8012400 con 0x7f5a08102f00 2024-09-18T21:23:42.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:42.305+0000 7f59fe7fc640 1 --2- 172.21.15.77:0/19035593 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f59f406e0b0 0x7f59f4070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:23:42.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:42.305+0000 7f59fe7fc640 1 -- 172.21.15.77:0/19035593 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f59f808dd70 con 0x7f5a08102f00 2024-09-18T21:23:42.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:42.305+0000 7f5a0dcde640 1 --2- 172.21.15.77:0/19035593 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f59f406e0b0 0x7f59f4070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:23:42.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:42.306+0000 7f5a0dcde640 1 --2- 172.21.15.77:0/19035593 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f59f406e0b0 0x7f59f4070560 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5a04009ac0 tx=0x7f5a04035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:23:42.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:42.314+0000 7f59fe7fc640 1 -- 172.21.15.77:0/19035593 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f59f8057070 con 0x7f5a08102f00 2024-09-18T21:23:42.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:42.522+0000 7f5a0ff42640 1 -- 172.21.15.77:0/19035593 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 15, "format": "json"} v 0) v1 -- 0x7f5a080fbd60 con 0x7f5a08102f00 2024-09-18T21:23:42.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:42.523+0000 7f59fe7fc640 1 -- 172.21.15.77:0/19035593 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 15, "format": "json"}]=0 dumped fsmap epoch 15 v36) v1 ==== 107+0+4123 (secure 0 0 0) 0x7f59f805a730 con 0x7f5a08102f00 2024-09-18T21:23:42.525 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:23:42.525 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":15,"btime":"2024-09-18T21:19:14:346536+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24255,"name":"cephfs.smithi103.zhdmdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.103:6825/2170237078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2170237078},{"type":"v1","addr":"172.21.15.103:6825","nonce":2170237078}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24267,"name":"cephfs.smithi103.opftmf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.103:6827/4241818403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":4241818403},{"type":"v1","addr":"172.21.15.103:6827","nonce":4241818403}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T21:10:17.230179+0000","modified":"2024-09-18T21:19:14.346527+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14458":{"gid":14458,"name":"cephfs.smithi077.cqfhlw","rank":0,"incarnation":15,"state":"up:replay","state_seq":2,"addr":"172.21.15.77:6829/862540650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":862540650},{"type":"v1","addr":"172.21.15.77:6829","nonce":862540650}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T21:23:42.526 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 15 2024-09-18T21:23:42.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:42.525+0000 7f5a0ff42640 1 -- 172.21.15.77:0/19035593 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f59f406e0b0 msgr2=0x7f59f4070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:42.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:42.525+0000 7f5a0ff42640 1 --2- 172.21.15.77:0/19035593 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f59f406e0b0 0x7f59f4070560 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5a04009ac0 tx=0x7f5a04035040 comp rx=0 tx=0).stop 2024-09-18T21:23:42.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:42.525+0000 7f5a0ff42640 1 -- 172.21.15.77:0/19035593 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a08102f00 msgr2=0x7f5a08113720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:42.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:42.525+0000 7f5a0ff42640 1 --2- 172.21.15.77:0/19035593 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a08102f00 0x7f5a08113720 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f59f800c760 tx=0x7f59f800cb60 comp rx=0 tx=0).stop 2024-09-18T21:23:42.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:42.525+0000 7f5a0ff42640 1 -- 172.21.15.77:0/19035593 shutdown_connections 2024-09-18T21:23:42.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:42.525+0000 7f5a0ff42640 1 --2- 172.21.15.77:0/19035593 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a08102f00 0x7f5a08113720 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:42.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:42.525+0000 7f5a0ff42640 1 --2- 172.21.15.77:0/19035593 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f59f406e0b0 0x7f59f4070560 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:42.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:42.525+0000 7f5a0ff42640 1 --2- 172.21.15.77:0/19035593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a08102560 0x7f5a081131e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:42.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:42.525+0000 7f5a0ff42640 1 -- 172.21.15.77:0/19035593 >> 172.21.15.77:0/19035593 conn(0x7f5a080f8100 msgr2=0x7f5a080f9120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:23:42.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:42.525+0000 7f5a0ff42640 1 -- 172.21.15.77:0/19035593 shutdown_connections 2024-09-18T21:23:42.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:42.525+0000 7f5a0ff42640 1 -- 172.21.15.77:0/19035593 wait complete. 2024-09-18T21:23:43.134 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:43 smithi077 ceph-mon[92672]: pgmap v295: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:43.134 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:43 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/19035593' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 15, "format": "json"}]: dispatch 2024-09-18T21:23:43.160 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 16 2024-09-18T21:23:43.411 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:23:43.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:43 smithi103 ceph-mon[80307]: pgmap v295: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:43.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:43 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/19035593' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 15, "format": "json"}]: dispatch 2024-09-18T21:23:45.137 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:45 smithi077 ceph-mon[92672]: pgmap v296: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:45.095+0000 7f9552919640 1 -- 172.21.15.77:0/1516676698 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f954c102530 msgr2=0x7f954c102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:45.095+0000 7f9552919640 1 --2- 172.21.15.77:0/1516676698 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f954c102530 0x7f954c102900 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f953c0048d0 tx=0x7f953c009da0 comp rx=0 tx=0).stop 2024-09-18T21:23:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:45.095+0000 7f9552919640 1 -- 172.21.15.77:0/1516676698 shutdown_connections 2024-09-18T21:23:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:45.095+0000 7f9552919640 1 --2- 172.21.15.77:0/1516676698 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f954c102ed0 0x7f954c0fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:45.095+0000 7f9552919640 1 --2- 172.21.15.77:0/1516676698 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f954c102530 0x7f954c102900 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:45.095+0000 7f9552919640 1 -- 172.21.15.77:0/1516676698 >> 172.21.15.77:0/1516676698 conn(0x7f954c0f8110 msgr2=0x7f954c0fa520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:23:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:45.095+0000 7f9552919640 1 -- 172.21.15.77:0/1516676698 shutdown_connections 2024-09-18T21:23:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:45.095+0000 7f9552919640 1 -- 172.21.15.77:0/1516676698 wait complete. 2024-09-18T21:23:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:45.096+0000 7f9552919640 1 Processor -- start 2024-09-18T21:23:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:45.096+0000 7f9552919640 1 -- start start 2024-09-18T21:23:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:45.096+0000 7f9552919640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f954c102530 0x7f954c1131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:23:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:45.096+0000 7f9552919640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f954c102ed0 0x7f954c113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:23:45.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:45.096+0000 7f9552919640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954c113d30 con 0x7f954c102ed0 2024-09-18T21:23:45.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:45.096+0000 7f9552919640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954c10d170 con 0x7f954c102530 2024-09-18T21:23:45.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:45.096+0000 7f954b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f954c102ed0 0x7f954c113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:23:45.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:45.096+0000 7f954bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f954c102530 0x7f954c1131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:23:45.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:45.096+0000 7f954b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f954c102ed0 0x7f954c113730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38298/0 (socket says 172.21.15.77:38298) 2024-09-18T21:23:45.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:45.096+0000 7f954b7fe640 1 -- 172.21.15.77:0/1174197820 learned_addr learned my addr 172.21.15.77:0/1174197820 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:23:45.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:45.097+0000 7f954b7fe640 1 -- 172.21.15.77:0/1174197820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f954c102530 msgr2=0x7f954c1131f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:45.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:45.097+0000 7f954b7fe640 1 --2- 172.21.15.77:0/1174197820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f954c102530 0x7f954c1131f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:45.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:45.097+0000 7f954b7fe640 1 -- 172.21.15.77:0/1174197820 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f953c005040 con 0x7f954c102ed0 2024-09-18T21:23:45.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:45.097+0000 7f954b7fe640 1 --2- 172.21.15.77:0/1174197820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f954c102ed0 0x7f954c113730 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f954000c790 tx=0x7f95400043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:23:45.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:45.097+0000 7f9548ff9640 1 -- 172.21.15.77:0/1174197820 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f954000a7a0 con 0x7f954c102ed0 2024-09-18T21:23:45.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:45.097+0000 7f9552919640 1 -- 172.21.15.77:0/1174197820 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f954c10d450 con 0x7f954c102ed0 2024-09-18T21:23:45.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:45.097+0000 7f9548ff9640 1 -- 172.21.15.77:0/1174197820 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f954000ada0 con 0x7f954c102ed0 2024-09-18T21:23:45.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:45.097+0000 7f9548ff9640 1 -- 172.21.15.77:0/1174197820 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9540011380 con 0x7f954c102ed0 2024-09-18T21:23:45.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:45.097+0000 7f9552919640 1 -- 172.21.15.77:0/1174197820 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f954c10d9f0 con 0x7f954c102ed0 2024-09-18T21:23:45.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:45.098+0000 7f9552919640 1 -- 172.21.15.77:0/1174197820 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f954c0fdcb0 con 0x7f954c102ed0 2024-09-18T21:23:45.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:45.099+0000 7f9548ff9640 1 -- 172.21.15.77:0/1174197820 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9540012420 con 0x7f954c102ed0 2024-09-18T21:23:45.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:45.099+0000 7f9548ff9640 1 --2- 172.21.15.77:0/1174197820 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f953406e0b0 0x7f9534070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:23:45.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:45.099+0000 7f9548ff9640 1 -- 172.21.15.77:0/1174197820 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f954008e0f0 con 0x7f954c102ed0 2024-09-18T21:23:45.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:45.099+0000 7f954bfff640 1 --2- 172.21.15.77:0/1174197820 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f953406e0b0 0x7f9534070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:23:45.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:45.100+0000 7f954bfff640 1 --2- 172.21.15.77:0/1174197820 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f953406e0b0 0x7f9534070560 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f953c009ac0 tx=0x7f953c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:23:45.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:45.104+0000 7f9548ff9640 1 -- 172.21.15.77:0/1174197820 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f9540057370 con 0x7f954c102ed0 2024-09-18T21:23:45.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:45.304+0000 7f9552919640 1 -- 172.21.15.77:0/1174197820 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 16, "format": "json"} v 0) v1 -- 0x7f954c1095a0 con 0x7f954c102ed0 2024-09-18T21:23:45.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:45.305+0000 7f9548ff9640 1 -- 172.21.15.77:0/1174197820 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 16, "format": "json"}]=0 dumped fsmap epoch 16 v36) v1 ==== 107+0+4128 (secure 0 0 0) 0x7f954005aa30 con 0x7f954c102ed0 2024-09-18T21:23:45.307 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:23:45.307 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":16,"btime":"2024-09-18T21:19:22:040563+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24255,"name":"cephfs.smithi103.zhdmdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.103:6825/2170237078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2170237078},{"type":"v1","addr":"172.21.15.103:6825","nonce":2170237078}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24267,"name":"cephfs.smithi103.opftmf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.103:6827/4241818403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":4241818403},{"type":"v1","addr":"172.21.15.103:6827","nonce":4241818403}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T21:10:17.230179+0000","modified":"2024-09-18T21:19:21.586759+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14458":{"gid":14458,"name":"cephfs.smithi077.cqfhlw","rank":0,"incarnation":15,"state":"up:reconnect","state_seq":135,"addr":"172.21.15.77:6829/862540650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":862540650},{"type":"v1","addr":"172.21.15.77:6829","nonce":862540650}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T21:23:45.307 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 16 2024-09-18T21:23:45.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:45.307+0000 7f9552919640 1 -- 172.21.15.77:0/1174197820 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f953406e0b0 msgr2=0x7f9534070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:45.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:45.307+0000 7f9552919640 1 --2- 172.21.15.77:0/1174197820 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f953406e0b0 0x7f9534070560 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f953c009ac0 tx=0x7f953c035040 comp rx=0 tx=0).stop 2024-09-18T21:23:45.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:45.307+0000 7f9552919640 1 -- 172.21.15.77:0/1174197820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f954c102ed0 msgr2=0x7f954c113730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:45.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:45.307+0000 7f9552919640 1 --2- 172.21.15.77:0/1174197820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f954c102ed0 0x7f954c113730 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f954000c790 tx=0x7f95400043c0 comp rx=0 tx=0).stop 2024-09-18T21:23:45.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:45.307+0000 7f9552919640 1 -- 172.21.15.77:0/1174197820 shutdown_connections 2024-09-18T21:23:45.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:45.307+0000 7f9552919640 1 --2- 172.21.15.77:0/1174197820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f954c102ed0 0x7f954c113730 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:45.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:45.307+0000 7f9552919640 1 --2- 172.21.15.77:0/1174197820 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f953406e0b0 0x7f9534070560 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:45.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:45.307+0000 7f9552919640 1 --2- 172.21.15.77:0/1174197820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f954c102530 0x7f954c1131f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:45.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:45.307+0000 7f9552919640 1 -- 172.21.15.77:0/1174197820 >> 172.21.15.77:0/1174197820 conn(0x7f954c0f8110 msgr2=0x7f954c0f9190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:23:45.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:45.307+0000 7f9552919640 1 -- 172.21.15.77:0/1174197820 shutdown_connections 2024-09-18T21:23:45.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:45.307+0000 7f9552919640 1 -- 172.21.15.77:0/1174197820 wait complete. 2024-09-18T21:23:45.516 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:45 smithi103 ceph-mon[80307]: pgmap v296: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:45.916 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 17 2024-09-18T21:23:46.166 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:23:46.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:46 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/1174197820' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-09-18T21:23:46.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:46 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/1174197820' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-09-18T21:23:47.279 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:47 smithi077 ceph-mon[92672]: pgmap v297: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:47.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:47 smithi103 ceph-mon[80307]: pgmap v297: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:47.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:47.778+0000 7f5119d91640 1 -- 172.21.15.77:0/17487498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51140fd560 msgr2=0x7f51140fd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:47.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:47.778+0000 7f5119d91640 1 --2- 172.21.15.77:0/17487498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51140fd560 0x7f51140fd930 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f51040048d0 tx=0x7f5104009da0 comp rx=0 tx=0).stop 2024-09-18T21:23:47.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:47.778+0000 7f5119d91640 1 -- 172.21.15.77:0/17487498 shutdown_connections 2024-09-18T21:23:47.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:47.778+0000 7f5119d91640 1 --2- 172.21.15.77:0/17487498 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51140fdf00 0x7f5114106540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:47.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:47.778+0000 7f5119d91640 1 --2- 172.21.15.77:0/17487498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51140fd560 0x7f51140fd930 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:47.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:47.778+0000 7f5119d91640 1 -- 172.21.15.77:0/17487498 >> 172.21.15.77:0/17487498 conn(0x7f51140f7030 msgr2=0x7f51140f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:23:47.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:47.778+0000 7f5119d91640 1 -- 172.21.15.77:0/17487498 shutdown_connections 2024-09-18T21:23:47.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:47.778+0000 7f5119d91640 1 -- 172.21.15.77:0/17487498 wait complete. 2024-09-18T21:23:47.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:47.779+0000 7f5119d91640 1 Processor -- start 2024-09-18T21:23:47.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:47.779+0000 7f5119d91640 1 -- start start 2024-09-18T21:23:47.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:47.779+0000 7f5119d91640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51140fd560 0x7f5114113270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:23:47.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:47.779+0000 7f5119d91640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51140fdf00 0x7f51141137b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:23:47.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:47.779+0000 7f5119d91640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5114113e40 con 0x7f51140fd560 2024-09-18T21:23:47.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:47.779+0000 7f5119d91640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511410d1f0 con 0x7f51140fdf00 2024-09-18T21:23:47.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:47.779+0000 7f51137fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51140fd560 0x7f5114113270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:23:47.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:47.779+0000 7f51137fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51140fd560 0x7f5114113270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38314/0 (socket says 172.21.15.77:38314) 2024-09-18T21:23:47.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:47.779+0000 7f51137fe640 1 -- 172.21.15.77:0/2109259501 learned_addr learned my addr 172.21.15.77:0/2109259501 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:23:47.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:47.779+0000 7f5112ffd640 1 --2- 172.21.15.77:0/2109259501 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51140fdf00 0x7f51141137b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:23:47.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:47.780+0000 7f51137fe640 1 -- 172.21.15.77:0/2109259501 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51140fdf00 msgr2=0x7f51141137b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:47.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:47.780+0000 7f51137fe640 1 --2- 172.21.15.77:0/2109259501 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51140fdf00 0x7f51141137b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:47.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:47.780+0000 7f51137fe640 1 -- 172.21.15.77:0/2109259501 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5104005040 con 0x7f51140fd560 2024-09-18T21:23:47.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:47.780+0000 7f51137fe640 1 --2- 172.21.15.77:0/2109259501 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51140fd560 0x7f5114113270 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5104003080 tx=0x7f5104009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:23:47.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:47.780+0000 7f50fbfff640 1 -- 172.21.15.77:0/2109259501 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5104038070 con 0x7f51140fd560 2024-09-18T21:23:47.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:47.780+0000 7f50fbfff640 1 -- 172.21.15.77:0/2109259501 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f51040097e0 con 0x7f51140fd560 2024-09-18T21:23:47.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:47.780+0000 7f5119d91640 1 -- 172.21.15.77:0/2109259501 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f511410d470 con 0x7f51140fd560 2024-09-18T21:23:47.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:47.780+0000 7f50fbfff640 1 -- 172.21.15.77:0/2109259501 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f510403d420 con 0x7f51140fd560 2024-09-18T21:23:47.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:47.780+0000 7f5119d91640 1 -- 172.21.15.77:0/2109259501 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f511410d930 con 0x7f51140fd560 2024-09-18T21:23:47.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:47.781+0000 7f5119d91640 1 -- 172.21.15.77:0/2109259501 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5114066390 con 0x7f51140fd560 2024-09-18T21:23:47.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:47.781+0000 7f50fbfff640 1 -- 172.21.15.77:0/2109259501 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5104030020 con 0x7f51140fd560 2024-09-18T21:23:47.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:47.782+0000 7f50fbfff640 1 --2- 172.21.15.77:0/2109259501 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f50fc06e0b0 0x7f50fc070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:23:47.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:47.782+0000 7f50fbfff640 1 -- 172.21.15.77:0/2109259501 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f51040ae180 con 0x7f51140fd560 2024-09-18T21:23:47.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:47.782+0000 7f5112ffd640 1 --2- 172.21.15.77:0/2109259501 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f50fc06e0b0 0x7f50fc070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:23:47.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:47.782+0000 7f5112ffd640 1 --2- 172.21.15.77:0/2109259501 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f50fc06e0b0 0x7f50fc070560 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5108006fd0 tx=0x7f5108008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:23:47.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:47.786+0000 7f50fbfff640 1 -- 172.21.15.77:0/2109259501 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f5104077400 con 0x7f51140fd560 2024-09-18T21:23:47.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:47.988+0000 7f5119d91640 1 -- 172.21.15.77:0/2109259501 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) v1 -- 0x7f511404b750 con 0x7f51140fd560 2024-09-18T21:23:47.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:47.989+0000 7f50fbfff640 1 -- 172.21.15.77:0/2109259501 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v36) v1 ==== 107+0+4125 (secure 0 0 0) 0x7f510407aac0 con 0x7f51140fd560 2024-09-18T21:23:47.991 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:23:47.991 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":17,"btime":"2024-09-18T21:19:23:048083+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24255,"name":"cephfs.smithi103.zhdmdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.103:6825/2170237078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2170237078},{"type":"v1","addr":"172.21.15.103:6825","nonce":2170237078}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24267,"name":"cephfs.smithi103.opftmf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.103:6827/4241818403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":4241818403},{"type":"v1","addr":"172.21.15.103:6827","nonce":4241818403}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T21:10:17.230179+0000","modified":"2024-09-18T21:19:22.050173+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14458":{"gid":14458,"name":"cephfs.smithi077.cqfhlw","rank":0,"incarnation":15,"state":"up:rejoin","state_seq":136,"addr":"172.21.15.77:6829/862540650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":862540650},{"type":"v1","addr":"172.21.15.77:6829","nonce":862540650}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T21:23:47.991 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 17 2024-09-18T21:23:47.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:47.991+0000 7f5119d91640 1 -- 172.21.15.77:0/2109259501 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f50fc06e0b0 msgr2=0x7f50fc070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:47.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:47.991+0000 7f5119d91640 1 --2- 172.21.15.77:0/2109259501 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f50fc06e0b0 0x7f50fc070560 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5108006fd0 tx=0x7f5108008040 comp rx=0 tx=0).stop 2024-09-18T21:23:47.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:47.991+0000 7f5119d91640 1 -- 172.21.15.77:0/2109259501 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51140fd560 msgr2=0x7f5114113270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:47.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:47.991+0000 7f5119d91640 1 --2- 172.21.15.77:0/2109259501 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51140fd560 0x7f5114113270 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5104003080 tx=0x7f5104009da0 comp rx=0 tx=0).stop 2024-09-18T21:23:47.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:47.991+0000 7f5119d91640 1 -- 172.21.15.77:0/2109259501 shutdown_connections 2024-09-18T21:23:47.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:47.991+0000 7f5119d91640 1 --2- 172.21.15.77:0/2109259501 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f50fc06e0b0 0x7f50fc070560 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:47.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:47.991+0000 7f5119d91640 1 --2- 172.21.15.77:0/2109259501 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51140fdf00 0x7f51141137b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:47.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:47.991+0000 7f5119d91640 1 --2- 172.21.15.77:0/2109259501 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f51140fd560 0x7f5114113270 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:47.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:47.991+0000 7f5119d91640 1 -- 172.21.15.77:0/2109259501 >> 172.21.15.77:0/2109259501 conn(0x7f51140f7030 msgr2=0x7f51140f8560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:23:47.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:47.992+0000 7f5119d91640 1 -- 172.21.15.77:0/2109259501 shutdown_connections 2024-09-18T21:23:47.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:47.992+0000 7f5119d91640 1 -- 172.21.15.77:0/2109259501 wait complete. 2024-09-18T21:23:48.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:48 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/2109259501' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-09-18T21:23:48.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:48 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/2109259501' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-09-18T21:23:48.688 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 18 2024-09-18T21:23:48.966 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:23:49.310 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:49 smithi077 ceph-mon[92672]: pgmap v298: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:49.310 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:49 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:23:49.310 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:49 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:23:49.310 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:49 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:23:49.310 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:49 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:23:49.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:49 smithi103 ceph-mon[80307]: pgmap v298: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:49.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:49 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:23:49.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:49 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:23:49.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:49 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:23:49.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:49 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:23:50.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:50.584+0000 7f685ae90640 1 -- 172.21.15.77:0/2298621694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68540fbcf0 msgr2=0x7f68540fc140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:50.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:50.584+0000 7f685ae90640 1 --2- 172.21.15.77:0/2298621694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68540fbcf0 0x7f68540fc140 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6844009c50 tx=0x7f6844004d10 comp rx=0 tx=0).stop 2024-09-18T21:23:50.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:50.584+0000 7f685ae90640 1 -- 172.21.15.77:0/2298621694 shutdown_connections 2024-09-18T21:23:50.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:50.584+0000 7f685ae90640 1 --2- 172.21.15.77:0/2298621694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68540fbcf0 0x7f68540fc140 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:50.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:50.584+0000 7f685ae90640 1 --2- 172.21.15.77:0/2298621694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68540fd340 0x7f68540fd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:50.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:50.584+0000 7f685ae90640 1 -- 172.21.15.77:0/2298621694 >> 172.21.15.77:0/2298621694 conn(0x7f6854071b00 msgr2=0x7f6854071f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:23:50.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:50.584+0000 7f685ae90640 1 -- 172.21.15.77:0/2298621694 shutdown_connections 2024-09-18T21:23:50.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:50.584+0000 7f685ae90640 1 -- 172.21.15.77:0/2298621694 wait complete. 2024-09-18T21:23:50.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:50.585+0000 7f685ae90640 1 Processor -- start 2024-09-18T21:23:50.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:50.585+0000 7f685ae90640 1 -- start start 2024-09-18T21:23:50.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:50.585+0000 7f685ae90640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68540fbcf0 0x7f6854112040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:23:50.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:50.585+0000 7f685ae90640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68540fd340 0x7f6854112580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:23:50.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:50.585+0000 7f685ae90640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6854112b80 con 0x7f68540fbcf0 2024-09-18T21:23:50.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:50.585+0000 7f685ae90640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f685410bfc0 con 0x7f68540fd340 2024-09-18T21:23:50.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:50.585+0000 7f6858c2c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68540fbcf0 0x7f6854112040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:23:50.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:50.585+0000 7f6858c2c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68540fbcf0 0x7f6854112040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42198/0 (socket says 172.21.15.77:42198) 2024-09-18T21:23:50.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:50.585+0000 7f6858c2c640 1 -- 172.21.15.77:0/928887844 learned_addr learned my addr 172.21.15.77:0/928887844 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:23:50.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:50.585+0000 7f6853fff640 1 --2- 172.21.15.77:0/928887844 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68540fd340 0x7f6854112580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:23:50.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:50.585+0000 7f6858c2c640 1 -- 172.21.15.77:0/928887844 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68540fd340 msgr2=0x7f6854112580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:50.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:50.585+0000 7f6858c2c640 1 --2- 172.21.15.77:0/928887844 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68540fd340 0x7f6854112580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:50.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:50.585+0000 7f6858c2c640 1 -- 172.21.15.77:0/928887844 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68440098b0 con 0x7f68540fbcf0 2024-09-18T21:23:50.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:50.586+0000 7f6858c2c640 1 --2- 172.21.15.77:0/928887844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68540fbcf0 0x7f6854112040 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f683c00ea40 tx=0x7f683c004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:23:50.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:50.586+0000 7f68517fa640 1 -- 172.21.15.77:0/928887844 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f683c00cd10 con 0x7f68540fbcf0 2024-09-18T21:23:50.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:50.586+0000 7f68517fa640 1 -- 172.21.15.77:0/928887844 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f683c00ce70 con 0x7f68540fbcf0 2024-09-18T21:23:50.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:50.586+0000 7f685ae90640 1 -- 172.21.15.77:0/928887844 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f685410c240 con 0x7f68540fbcf0 2024-09-18T21:23:50.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:50.586+0000 7f68517fa640 1 -- 172.21.15.77:0/928887844 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f683c0108c0 con 0x7f68540fbcf0 2024-09-18T21:23:50.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:50.586+0000 7f685ae90640 1 -- 172.21.15.77:0/928887844 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f685410c7b0 con 0x7f68540fbcf0 2024-09-18T21:23:50.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:50.587+0000 7f685ae90640 1 -- 172.21.15.77:0/928887844 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68540fcd00 con 0x7f68540fbcf0 2024-09-18T21:23:50.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:50.587+0000 7f68517fa640 1 -- 172.21.15.77:0/928887844 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f683c010a40 con 0x7f68540fbcf0 2024-09-18T21:23:50.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:50.588+0000 7f68517fa640 1 --2- 172.21.15.77:0/928887844 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f684006e0b0 0x7f6840070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:23:50.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:50.588+0000 7f68517fa640 1 -- 172.21.15.77:0/928887844 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f683c090650 con 0x7f68540fbcf0 2024-09-18T21:23:50.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:50.588+0000 7f6853fff640 1 --2- 172.21.15.77:0/928887844 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f684006e0b0 0x7f6840070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:23:50.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:50.588+0000 7f6853fff640 1 --2- 172.21.15.77:0/928887844 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f684006e0b0 0x7f6840070560 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f68540fa6f0 tx=0x7f6844004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:23:50.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:50.592+0000 7f68517fa640 1 -- 172.21.15.77:0/928887844 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f683c059950 con 0x7f68540fbcf0 2024-09-18T21:23:50.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:50.793+0000 7f685ae90640 1 -- 172.21.15.77:0/928887844 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) v1 -- 0x7f685404b780 con 0x7f68540fbcf0 2024-09-18T21:23:50.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:50.793+0000 7f68517fa640 1 -- 172.21.15.77:0/928887844 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v36) v1 ==== 107+0+4134 (secure 0 0 0) 0x7f683c05d010 con 0x7f68540fbcf0 2024-09-18T21:23:50.795 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:23:50.796 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":18,"btime":"2024-09-18T21:19:24:054005+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24255,"name":"cephfs.smithi103.zhdmdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.103:6825/2170237078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2170237078},{"type":"v1","addr":"172.21.15.103:6825","nonce":2170237078}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24267,"name":"cephfs.smithi103.opftmf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.103:6827/4241818403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":4241818403},{"type":"v1","addr":"172.21.15.103:6827","nonce":4241818403}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T21:10:17.230179+0000","modified":"2024-09-18T21:19:24.054002+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14458":{"gid":14458,"name":"cephfs.smithi077.cqfhlw","rank":0,"incarnation":15,"state":"up:active","state_seq":137,"addr":"172.21.15.77:6829/862540650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":862540650},{"type":"v1","addr":"172.21.15.77:6829","nonce":862540650}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14458,"qdb_cluster":[14458]},"id":1}]} 2024-09-18T21:23:50.796 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 18 2024-09-18T21:23:50.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:50.795+0000 7f685ae90640 1 -- 172.21.15.77:0/928887844 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f684006e0b0 msgr2=0x7f6840070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:50.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:50.795+0000 7f685ae90640 1 --2- 172.21.15.77:0/928887844 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f684006e0b0 0x7f6840070560 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f68540fa6f0 tx=0x7f6844004d10 comp rx=0 tx=0).stop 2024-09-18T21:23:50.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:50.795+0000 7f685ae90640 1 -- 172.21.15.77:0/928887844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68540fbcf0 msgr2=0x7f6854112040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:50.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:50.795+0000 7f685ae90640 1 --2- 172.21.15.77:0/928887844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68540fbcf0 0x7f6854112040 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f683c00ea40 tx=0x7f683c004470 comp rx=0 tx=0).stop 2024-09-18T21:23:50.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:50.795+0000 7f685ae90640 1 -- 172.21.15.77:0/928887844 shutdown_connections 2024-09-18T21:23:50.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:50.795+0000 7f685ae90640 1 --2- 172.21.15.77:0/928887844 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f684006e0b0 0x7f6840070560 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:50.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:50.795+0000 7f685ae90640 1 --2- 172.21.15.77:0/928887844 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68540fd340 0x7f6854112580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:50.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:50.795+0000 7f685ae90640 1 --2- 172.21.15.77:0/928887844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68540fbcf0 0x7f6854112040 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:50.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:50.795+0000 7f685ae90640 1 -- 172.21.15.77:0/928887844 >> 172.21.15.77:0/928887844 conn(0x7f6854071b00 msgr2=0x7f68541008b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:23:50.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:50.795+0000 7f685ae90640 1 -- 172.21.15.77:0/928887844 shutdown_connections 2024-09-18T21:23:50.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:50.795+0000 7f685ae90640 1 -- 172.21.15.77:0/928887844 wait complete. 2024-09-18T21:23:51.430 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:51 smithi077 ceph-mon[92672]: pgmap v299: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:51.430 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:51 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/928887844' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-09-18T21:23:51.430 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:51 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:23:51.455 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 19 2024-09-18T21:23:51.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:51 smithi103 ceph-mon[80307]: pgmap v299: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:51.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:51 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/928887844' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-09-18T21:23:51.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:51 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:23:51.700 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:23:53.301 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:53 smithi077 ceph-mon[92672]: pgmap v300: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:53.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:53.292+0000 7f3024a9b640 1 -- 172.21.15.77:0/1788521409 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30200fcf80 msgr2=0x7f30200fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:53.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:53.292+0000 7f3024a9b640 1 --2- 172.21.15.77:0/1788521409 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30200fcf80 0x7f30200fd3d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f30140048d0 tx=0x7f3014009da0 comp rx=0 tx=0).stop 2024-09-18T21:23:53.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:53.292+0000 7f3024a9b640 1 -- 172.21.15.77:0/1788521409 shutdown_connections 2024-09-18T21:23:53.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:53.292+0000 7f3024a9b640 1 --2- 172.21.15.77:0/1788521409 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30200fcf80 0x7f30200fd3d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:53.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:53.292+0000 7f3024a9b640 1 --2- 172.21.15.77:0/1788521409 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30200fb810 0x7f30200fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:53.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:53.292+0000 7f3024a9b640 1 -- 172.21.15.77:0/1788521409 >> 172.21.15.77:0/1788521409 conn(0x7f30200723b0 msgr2=0x7f30200727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:23:53.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:53.292+0000 7f3024a9b640 1 -- 172.21.15.77:0/1788521409 shutdown_connections 2024-09-18T21:23:53.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:53.292+0000 7f3024a9b640 1 -- 172.21.15.77:0/1788521409 wait complete. 2024-09-18T21:23:53.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:53.292+0000 7f3024a9b640 1 Processor -- start 2024-09-18T21:23:53.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:53.292+0000 7f3024a9b640 1 -- start start 2024-09-18T21:23:53.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:53.293+0000 7f3024a9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30200fb810 0x7f3020113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:23:53.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:53.293+0000 7f3024a9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30200fcf80 0x7f3020113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:23:53.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:53.293+0000 7f3024a9b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3020113d50 con 0x7f30200fb810 2024-09-18T21:23:53.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:53.293+0000 7f3024a9b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f302010d190 con 0x7f30200fcf80 2024-09-18T21:23:53.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:53.293+0000 7f301e59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30200fb810 0x7f3020113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:23:53.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:53.293+0000 7f301e59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30200fb810 0x7f3020113210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42222/0 (socket says 172.21.15.77:42222) 2024-09-18T21:23:53.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:53.293+0000 7f301e59c640 1 -- 172.21.15.77:0/4271235791 learned_addr learned my addr 172.21.15.77:0/4271235791 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:23:53.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:53.293+0000 7f301dd9b640 1 --2- 172.21.15.77:0/4271235791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30200fcf80 0x7f3020113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:23:53.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:53.293+0000 7f301e59c640 1 -- 172.21.15.77:0/4271235791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30200fcf80 msgr2=0x7f3020113750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:53.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:53.293+0000 7f301e59c640 1 --2- 172.21.15.77:0/4271235791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30200fcf80 0x7f3020113750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:53.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:53.293+0000 7f301e59c640 1 -- 172.21.15.77:0/4271235791 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3014005040 con 0x7f30200fb810 2024-09-18T21:23:53.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:53.293+0000 7f301e59c640 1 --2- 172.21.15.77:0/4271235791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30200fb810 0x7f3020113210 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3010002a50 tx=0x7f3010004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:23:53.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:53.293+0000 7f300effd640 1 -- 172.21.15.77:0/4271235791 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3010007c30 con 0x7f30200fb810 2024-09-18T21:23:53.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:53.293+0000 7f300effd640 1 -- 172.21.15.77:0/4271235791 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f301000f040 con 0x7f30200fb810 2024-09-18T21:23:53.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:53.293+0000 7f3024a9b640 1 -- 172.21.15.77:0/4271235791 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f302010d470 con 0x7f30200fb810 2024-09-18T21:23:53.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:53.293+0000 7f300effd640 1 -- 172.21.15.77:0/4271235791 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f301000dad0 con 0x7f30200fb810 2024-09-18T21:23:53.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:53.293+0000 7f3024a9b640 1 -- 172.21.15.77:0/4271235791 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f302010d960 con 0x7f30200fb810 2024-09-18T21:23:53.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:53.294+0000 7f3024a9b640 1 -- 172.21.15.77:0/4271235791 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30200fcbc0 con 0x7f30200fb810 2024-09-18T21:23:53.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:53.295+0000 7f300effd640 1 -- 172.21.15.77:0/4271235791 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f301000dc30 con 0x7f30200fb810 2024-09-18T21:23:53.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:53.295+0000 7f300effd640 1 --2- 172.21.15.77:0/4271235791 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f300806e0b0 0x7f3008070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:23:53.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:53.295+0000 7f301dd9b640 1 --2- 172.21.15.77:0/4271235791 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f300806e0b0 0x7f3008070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:23:53.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:53.296+0000 7f300effd640 1 -- 172.21.15.77:0/4271235791 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f301008dae0 con 0x7f30200fb810 2024-09-18T21:23:53.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:53.296+0000 7f301dd9b640 1 --2- 172.21.15.77:0/4271235791 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f300806e0b0 0x7f3008070560 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3014009ac0 tx=0x7f3014035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:23:53.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:53.300+0000 7f300effd640 1 -- 172.21.15.77:0/4271235791 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f3010056d60 con 0x7f30200fb810 2024-09-18T21:23:53.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:53.505+0000 7f3024a9b640 1 -- 172.21.15.77:0/4271235791 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7f3020072ec0 con 0x7f30200fb810 2024-09-18T21:23:53.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:53.506+0000 7f300effd640 1 -- 172.21.15.77:0/4271235791 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v36) v1 ==== 107+0+4981 (secure 0 0 0) 0x7f301005a420 con 0x7f30200fb810 2024-09-18T21:23:53.507 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:23:53.507 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":19,"btime":"2024-09-18T21:19:27:873132+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24255,"name":"cephfs.smithi103.zhdmdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.103:6825/2170237078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2170237078},{"type":"v1","addr":"172.21.15.103:6825","nonce":2170237078}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24267,"name":"cephfs.smithi103.opftmf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.103:6827/4241818403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":4241818403},{"type":"v1","addr":"172.21.15.103:6827","nonce":4241818403}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34400,"name":"cephfs.smithi077.vruydi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6827/1087320436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1087320436},{"type":"v1","addr":"172.21.15.77:6827","nonce":1087320436}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T21:10:17.230179+0000","modified":"2024-09-18T21:19:24.054002+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14458":{"gid":14458,"name":"cephfs.smithi077.cqfhlw","rank":0,"incarnation":15,"state":"up:active","state_seq":137,"addr":"172.21.15.77:6829/862540650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":862540650},{"type":"v1","addr":"172.21.15.77:6829","nonce":862540650}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14458,"qdb_cluster":[14458]},"id":1}]} 2024-09-18T21:23:53.508 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 19 2024-09-18T21:23:53.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:53.508+0000 7f3024a9b640 1 -- 172.21.15.77:0/4271235791 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f300806e0b0 msgr2=0x7f3008070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:53.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:53.508+0000 7f3024a9b640 1 --2- 172.21.15.77:0/4271235791 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f300806e0b0 0x7f3008070560 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3014009ac0 tx=0x7f3014035040 comp rx=0 tx=0).stop 2024-09-18T21:23:53.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:53.508+0000 7f3024a9b640 1 -- 172.21.15.77:0/4271235791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30200fb810 msgr2=0x7f3020113210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:53.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:53.508+0000 7f3024a9b640 1 --2- 172.21.15.77:0/4271235791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30200fb810 0x7f3020113210 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3010002a50 tx=0x7f3010004600 comp rx=0 tx=0).stop 2024-09-18T21:23:53.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:53.508+0000 7f3024a9b640 1 -- 172.21.15.77:0/4271235791 shutdown_connections 2024-09-18T21:23:53.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:53.508+0000 7f3024a9b640 1 --2- 172.21.15.77:0/4271235791 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f300806e0b0 0x7f3008070560 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:53.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:53.508+0000 7f3024a9b640 1 --2- 172.21.15.77:0/4271235791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30200fcf80 0x7f3020113750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:53.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:53.508+0000 7f3024a9b640 1 --2- 172.21.15.77:0/4271235791 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30200fb810 0x7f3020113210 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:53.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:53.508+0000 7f3024a9b640 1 -- 172.21.15.77:0/4271235791 >> 172.21.15.77:0/4271235791 conn(0x7f30200723b0 msgr2=0x7f30200fa680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:23:53.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:53.508+0000 7f3024a9b640 1 -- 172.21.15.77:0/4271235791 shutdown_connections 2024-09-18T21:23:53.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:53.508+0000 7f3024a9b640 1 -- 172.21.15.77:0/4271235791 wait complete. 2024-09-18T21:23:53.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:53 smithi103 ceph-mon[80307]: pgmap v300: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:54.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:54 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/4271235791' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-09-18T21:23:54.374 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 20 2024-09-18T21:23:54.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:54 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/4271235791' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-09-18T21:23:54.637 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:23:55.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:55 smithi077 ceph-mon[92672]: pgmap v301: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:55.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:55 smithi103 ceph-mon[80307]: pgmap v301: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:56.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:56.201+0000 7f6082f3d640 1 -- 172.21.15.77:0/603377195 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f607c1014e0 msgr2=0x7f607c1018b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:56.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:56.201+0000 7f6082f3d640 1 --2- 172.21.15.77:0/603377195 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f607c1014e0 0x7f607c1018b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f60700048d0 tx=0x7f6070009da0 comp rx=0 tx=0).stop 2024-09-18T21:23:56.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:56.201+0000 7f6082f3d640 1 -- 172.21.15.77:0/603377195 shutdown_connections 2024-09-18T21:23:56.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:56.201+0000 7f6082f3d640 1 --2- 172.21.15.77:0/603377195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f607c0fb4a0 0x7f607c0fb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:56.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:56.201+0000 7f6082f3d640 1 --2- 172.21.15.77:0/603377195 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f607c1014e0 0x7f607c1018b0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:56.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:56.201+0000 7f6082f3d640 1 -- 172.21.15.77:0/603377195 >> 172.21.15.77:0/603377195 conn(0x7f607c0f7020 msgr2=0x7f607c0f9430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:23:56.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:56.201+0000 7f6082f3d640 1 -- 172.21.15.77:0/603377195 shutdown_connections 2024-09-18T21:23:56.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:56.201+0000 7f6082f3d640 1 -- 172.21.15.77:0/603377195 wait complete. 2024-09-18T21:23:56.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:56.201+0000 7f6082f3d640 1 Processor -- start 2024-09-18T21:23:56.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:56.202+0000 7f6082f3d640 1 -- start start 2024-09-18T21:23:56.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:56.202+0000 7f6082f3d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f607c0fb4a0 0x7f607c10e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:23:56.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:56.202+0000 7f6082f3d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f607c1014e0 0x7f607c10e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:23:56.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:56.202+0000 7f6082f3d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607c10ed20 con 0x7f607c1014e0 2024-09-18T21:23:56.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:56.202+0000 7f6082f3d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607c10ee90 con 0x7f607c0fb4a0 2024-09-18T21:23:56.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:56.202+0000 7f607bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f607c1014e0 0x7f607c10e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:23:56.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:56.202+0000 7f607bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f607c1014e0 0x7f607c10e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42234/0 (socket says 172.21.15.77:42234) 2024-09-18T21:23:56.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:56.202+0000 7f607bfff640 1 -- 172.21.15.77:0/3267292973 learned_addr learned my addr 172.21.15.77:0/3267292973 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:23:56.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:56.202+0000 7f607bfff640 1 -- 172.21.15.77:0/3267292973 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f607c0fb4a0 msgr2=0x7f607c10e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:56.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:56.202+0000 7f607bfff640 1 --2- 172.21.15.77:0/3267292973 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f607c0fb4a0 0x7f607c10e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:56.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:56.202+0000 7f607bfff640 1 -- 172.21.15.77:0/3267292973 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6070005040 con 0x7f607c1014e0 2024-09-18T21:23:56.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:56.202+0000 7f607bfff640 1 --2- 172.21.15.77:0/3267292973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f607c1014e0 0x7f607c10e6d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6068002a50 tx=0x7f6068004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:23:56.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:56.203+0000 7f60797fa640 1 -- 172.21.15.77:0/3267292973 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6068007c30 con 0x7f607c1014e0 2024-09-18T21:23:56.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:56.203+0000 7f60797fa640 1 -- 172.21.15.77:0/3267292973 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f606800f040 con 0x7f607c1014e0 2024-09-18T21:23:56.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:56.203+0000 7f6082f3d640 1 -- 172.21.15.77:0/3267292973 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f607c117200 con 0x7f607c1014e0 2024-09-18T21:23:56.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:56.203+0000 7f60797fa640 1 -- 172.21.15.77:0/3267292973 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f606800da90 con 0x7f607c1014e0 2024-09-18T21:23:56.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:56.203+0000 7f6082f3d640 1 -- 172.21.15.77:0/3267292973 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f607c117710 con 0x7f607c1014e0 2024-09-18T21:23:56.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:56.204+0000 7f6082f3d640 1 -- 172.21.15.77:0/3267292973 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f607c0fcbe0 con 0x7f607c1014e0 2024-09-18T21:23:56.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:56.204+0000 7f60797fa640 1 -- 172.21.15.77:0/3267292973 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f606800dd00 con 0x7f607c1014e0 2024-09-18T21:23:56.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:56.205+0000 7f60797fa640 1 --2- 172.21.15.77:0/3267292973 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f606c06e0b0 0x7f606c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:23:56.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:56.205+0000 7f60797fa640 1 -- 172.21.15.77:0/3267292973 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f606808d4b0 con 0x7f607c1014e0 2024-09-18T21:23:56.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:56.205+0000 7f6080cd9640 1 --2- 172.21.15.77:0/3267292973 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f606c06e0b0 0x7f606c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:23:56.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:56.205+0000 7f6080cd9640 1 --2- 172.21.15.77:0/3267292973 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f606c06e0b0 0x7f606c070560 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f60700043d0 tx=0x7f6070009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:23:56.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:56.209+0000 7f60797fa640 1 -- 172.21.15.77:0/3267292973 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f6068056730 con 0x7f607c1014e0 2024-09-18T21:23:56.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:56.407+0000 7f6082f3d640 1 -- 172.21.15.77:0/3267292973 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7f607c0fac60 con 0x7f607c1014e0 2024-09-18T21:23:56.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:56.408+0000 7f60797fa640 1 -- 172.21.15.77:0/3267292973 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v36) v1 ==== 107+0+4183 (secure 0 0 0) 0x7f6068059df0 con 0x7f607c1014e0 2024-09-18T21:23:56.409 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:23:56.409 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":20,"btime":"2024-09-18T21:19:40:247867+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24255,"name":"cephfs.smithi103.zhdmdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.103:6825/2170237078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2170237078},{"type":"v1","addr":"172.21.15.103:6825","nonce":2170237078}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24267,"name":"cephfs.smithi103.opftmf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.103:6827/4241818403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":4241818403},{"type":"v1","addr":"172.21.15.103:6827","nonce":4241818403}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34400,"name":"cephfs.smithi077.vruydi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6827/1087320436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1087320436},{"type":"v1","addr":"172.21.15.77:6827","nonce":1087320436}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T21:10:17.230179+0000","modified":"2024-09-18T21:19:40.247865+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T21:23:56.410 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 20 2024-09-18T21:23:56.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:56.410+0000 7f6082f3d640 1 -- 172.21.15.77:0/3267292973 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f606c06e0b0 msgr2=0x7f606c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:56.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:56.410+0000 7f6082f3d640 1 --2- 172.21.15.77:0/3267292973 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f606c06e0b0 0x7f606c070560 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f60700043d0 tx=0x7f6070009da0 comp rx=0 tx=0).stop 2024-09-18T21:23:56.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:56.410+0000 7f6082f3d640 1 -- 172.21.15.77:0/3267292973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f607c1014e0 msgr2=0x7f607c10e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:56.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:56.410+0000 7f6082f3d640 1 --2- 172.21.15.77:0/3267292973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f607c1014e0 0x7f607c10e6d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6068002a50 tx=0x7f6068004600 comp rx=0 tx=0).stop 2024-09-18T21:23:56.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:56.411+0000 7f6082f3d640 1 -- 172.21.15.77:0/3267292973 shutdown_connections 2024-09-18T21:23:56.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:56.411+0000 7f6082f3d640 1 --2- 172.21.15.77:0/3267292973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f607c1014e0 0x7f607c10e6d0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:56.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:56.411+0000 7f6082f3d640 1 --2- 172.21.15.77:0/3267292973 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f606c06e0b0 0x7f606c070560 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:56.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:56.411+0000 7f6082f3d640 1 --2- 172.21.15.77:0/3267292973 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f607c0fb4a0 0x7f607c10e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:56.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:56.411+0000 7f6082f3d640 1 -- 172.21.15.77:0/3267292973 >> 172.21.15.77:0/3267292973 conn(0x7f607c0f7020 msgr2=0x7f607c0f88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:23:56.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:56.411+0000 7f6082f3d640 1 -- 172.21.15.77:0/3267292973 shutdown_connections 2024-09-18T21:23:56.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:56.411+0000 7f6082f3d640 1 -- 172.21.15.77:0/3267292973 wait complete. 2024-09-18T21:23:57.035 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 21 2024-09-18T21:23:57.284 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:23:57.405 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:57 smithi077 ceph-mon[92672]: pgmap v302: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:57.405 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:57 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/3267292973' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-09-18T21:23:57.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:57 smithi103 ceph-mon[80307]: pgmap v302: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:57.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:57 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/3267292973' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-09-18T21:23:59.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:58.990+0000 7f41f05db640 1 -- 172.21.15.77:0/429053395 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41e81014c0 msgr2=0x7f41e8101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:59.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:58.990+0000 7f41f05db640 1 --2- 172.21.15.77:0/429053395 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41e81014c0 0x7f41e8101890 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f41e40048d0 tx=0x7f41e4009da0 comp rx=0 tx=0).stop 2024-09-18T21:23:59.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:58.990+0000 7f41f05db640 1 -- 172.21.15.77:0/429053395 shutdown_connections 2024-09-18T21:23:59.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:58.990+0000 7f41f05db640 1 --2- 172.21.15.77:0/429053395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41e80fb480 0x7f41e80fb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:59.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:58.990+0000 7f41f05db640 1 --2- 172.21.15.77:0/429053395 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41e81014c0 0x7f41e8101890 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:59.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:58.990+0000 7f41f05db640 1 -- 172.21.15.77:0/429053395 >> 172.21.15.77:0/429053395 conn(0x7f41e80f7020 msgr2=0x7f41e80f9430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:23:59.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:58.990+0000 7f41f05db640 1 -- 172.21.15.77:0/429053395 shutdown_connections 2024-09-18T21:23:59.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:58.990+0000 7f41f05db640 1 -- 172.21.15.77:0/429053395 wait complete. 2024-09-18T21:23:59.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:58.991+0000 7f41f05db640 1 Processor -- start 2024-09-18T21:23:59.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:58.991+0000 7f41f05db640 1 -- start start 2024-09-18T21:23:59.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:58.991+0000 7f41f05db640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41e80fb480 0x7f41e81131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:23:59.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:58.991+0000 7f41f05db640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41e81014c0 0x7f41e8113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:23:59.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:58.991+0000 7f41f05db640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e8113d10 con 0x7f41e81014c0 2024-09-18T21:23:59.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:58.991+0000 7f41f05db640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e810d150 con 0x7f41e80fb480 2024-09-18T21:23:59.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:58.991+0000 7f41edb76640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41e81014c0 0x7f41e8113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:23:59.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:58.991+0000 7f41edb76640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41e81014c0 0x7f41e8113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42260/0 (socket says 172.21.15.77:42260) 2024-09-18T21:23:59.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:58.991+0000 7f41edb76640 1 -- 172.21.15.77:0/2650458527 learned_addr learned my addr 172.21.15.77:0/2650458527 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:23:59.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:58.991+0000 7f41ee377640 1 --2- 172.21.15.77:0/2650458527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41e80fb480 0x7f41e81131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:23:59.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:58.991+0000 7f41edb76640 1 -- 172.21.15.77:0/2650458527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41e80fb480 msgr2=0x7f41e81131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:59.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:58.991+0000 7f41edb76640 1 --2- 172.21.15.77:0/2650458527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41e80fb480 0x7f41e81131d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:59.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:58.992+0000 7f41edb76640 1 -- 172.21.15.77:0/2650458527 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e4005040 con 0x7f41e81014c0 2024-09-18T21:23:59.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:58.992+0000 7f41edb76640 1 --2- 172.21.15.77:0/2650458527 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41e81014c0 0x7f41e8113710 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f41d8002a50 tx=0x7f41d8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:23:59.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:58.992+0000 7f41deffd640 1 -- 172.21.15.77:0/2650458527 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41d8007c30 con 0x7f41e81014c0 2024-09-18T21:23:59.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:58.992+0000 7f41deffd640 1 -- 172.21.15.77:0/2650458527 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f41d800f040 con 0x7f41e81014c0 2024-09-18T21:23:59.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:58.992+0000 7f41f05db640 1 -- 172.21.15.77:0/2650458527 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41e810d430 con 0x7f41e81014c0 2024-09-18T21:23:59.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:58.992+0000 7f41deffd640 1 -- 172.21.15.77:0/2650458527 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41d800da90 con 0x7f41e81014c0 2024-09-18T21:23:59.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:58.992+0000 7f41f05db640 1 -- 172.21.15.77:0/2650458527 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41e810d9d0 con 0x7f41e81014c0 2024-09-18T21:23:59.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:58.993+0000 7f41f05db640 1 -- 172.21.15.77:0/2650458527 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41e80fcbc0 con 0x7f41e81014c0 2024-09-18T21:23:59.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:58.993+0000 7f41deffd640 1 -- 172.21.15.77:0/2650458527 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f41d800dd00 con 0x7f41e81014c0 2024-09-18T21:23:59.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:58.994+0000 7f41deffd640 1 --2- 172.21.15.77:0/2650458527 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f41d406e0b0 0x7f41d4070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:23:59.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:58.994+0000 7f41ee377640 1 --2- 172.21.15.77:0/2650458527 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f41d406e0b0 0x7f41d4070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:23:59.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:58.994+0000 7f41deffd640 1 -- 172.21.15.77:0/2650458527 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f41d808d540 con 0x7f41e81014c0 2024-09-18T21:23:59.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:58.994+0000 7f41ee377640 1 --2- 172.21.15.77:0/2650458527 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f41d406e0b0 0x7f41d4070560 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f41e4004540 tx=0x7f41e4009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:23:59.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:58.998+0000 7f41deffd640 1 -- 172.21.15.77:0/2650458527 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f41d80567c0 con 0x7f41e81014c0 2024-09-18T21:23:59.200 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:59.199+0000 7f41f05db640 1 -- 172.21.15.77:0/2650458527 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7f41e81084c0 con 0x7f41e81014c0 2024-09-18T21:23:59.200 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:59.199+0000 7f41deffd640 1 -- 172.21.15.77:0/2650458527 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v36) v1 ==== 107+0+4194 (secure 0 0 0) 0x7f41d8059e80 con 0x7f41e81014c0 2024-09-18T21:23:59.200 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:23:59.201 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"btime":"2024-09-18T21:19:40:254312+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24267,"name":"cephfs.smithi103.opftmf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.103:6827/4241818403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":4241818403},{"type":"v1","addr":"172.21.15.103:6827","nonce":4241818403}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34400,"name":"cephfs.smithi077.vruydi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6827/1087320436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1087320436},{"type":"v1","addr":"172.21.15.77:6827","nonce":1087320436}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T21:10:17.230179+0000","modified":"2024-09-18T21:19:40.254304+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24255":{"gid":24255,"name":"cephfs.smithi103.zhdmdg","rank":0,"incarnation":21,"state":"up:replay","state_seq":3,"addr":"172.21.15.103:6825/2170237078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2170237078},{"type":"v1","addr":"172.21.15.103:6825","nonce":2170237078}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T21:23:59.201 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 21 2024-09-18T21:23:59.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:59.201+0000 7f41f05db640 1 -- 172.21.15.77:0/2650458527 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f41d406e0b0 msgr2=0x7f41d4070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:59.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:59.201+0000 7f41f05db640 1 --2- 172.21.15.77:0/2650458527 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f41d406e0b0 0x7f41d4070560 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f41e4004540 tx=0x7f41e4009da0 comp rx=0 tx=0).stop 2024-09-18T21:23:59.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:59.201+0000 7f41f05db640 1 -- 172.21.15.77:0/2650458527 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41e81014c0 msgr2=0x7f41e8113710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:23:59.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:59.201+0000 7f41f05db640 1 --2- 172.21.15.77:0/2650458527 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41e81014c0 0x7f41e8113710 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f41d8002a50 tx=0x7f41d8004600 comp rx=0 tx=0).stop 2024-09-18T21:23:59.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:59.201+0000 7f41f05db640 1 -- 172.21.15.77:0/2650458527 shutdown_connections 2024-09-18T21:23:59.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:59.201+0000 7f41f05db640 1 --2- 172.21.15.77:0/2650458527 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41e81014c0 0x7f41e8113710 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:59.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:59.201+0000 7f41f05db640 1 --2- 172.21.15.77:0/2650458527 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f41d406e0b0 0x7f41d4070560 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:59.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:59.201+0000 7f41f05db640 1 --2- 172.21.15.77:0/2650458527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41e80fb480 0x7f41e81131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:23:59.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:59.201+0000 7f41f05db640 1 -- 172.21.15.77:0/2650458527 >> 172.21.15.77:0/2650458527 conn(0x7f41e80f7020 msgr2=0x7f41e8065a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:23:59.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:59.201+0000 7f41f05db640 1 -- 172.21.15.77:0/2650458527 shutdown_connections 2024-09-18T21:23:59.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:23:59.201+0000 7f41f05db640 1 -- 172.21.15.77:0/2650458527 wait complete. 2024-09-18T21:23:59.316 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:23:59 smithi103 ceph-mon[80307]: pgmap v303: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:59.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:23:59 smithi077 ceph-mon[92672]: pgmap v303: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:23:59.784 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 22 2024-09-18T21:24:00.032 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:24:00.413 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:00 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/2650458527' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-09-18T21:24:00.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:00 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/2650458527' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-09-18T21:24:01.117 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:01 smithi077 ceph-mon[92672]: pgmap v304: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:01.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:01 smithi103 ceph-mon[80307]: pgmap v304: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:01.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:01.631+0000 7f7759579640 1 -- 172.21.15.77:0/196312253 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77540fe450 msgr2=0x7f77540fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:01.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:01.631+0000 7f7759579640 1 --2- 172.21.15.77:0/196312253 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77540fe450 0x7f77540fe820 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f77440048d0 tx=0x7f7744009da0 comp rx=0 tx=0).stop 2024-09-18T21:24:01.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:01.631+0000 7f7759579640 1 -- 172.21.15.77:0/196312253 shutdown_connections 2024-09-18T21:24:01.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:01.631+0000 7f7759579640 1 --2- 172.21.15.77:0/196312253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7754064fe0 0x7f7754065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:01.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:01.631+0000 7f7759579640 1 --2- 172.21.15.77:0/196312253 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77540fe450 0x7f77540fe820 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:01.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:01.631+0000 7f7759579640 1 -- 172.21.15.77:0/196312253 >> 172.21.15.77:0/196312253 conn(0x7f77540723b0 msgr2=0x7f77540727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:24:01.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:01.631+0000 7f7759579640 1 -- 172.21.15.77:0/196312253 shutdown_connections 2024-09-18T21:24:01.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:01.631+0000 7f7759579640 1 -- 172.21.15.77:0/196312253 wait complete. 2024-09-18T21:24:01.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:01.631+0000 7f7759579640 1 Processor -- start 2024-09-18T21:24:01.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:01.631+0000 7f7759579640 1 -- start start 2024-09-18T21:24:01.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:01.632+0000 7f7759579640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7754064fe0 0x7f77540fb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:24:01.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:01.632+0000 7f7759579640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77540fe450 0x7f77540fbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:24:01.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:01.632+0000 7f7759579640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77540fbfe0 con 0x7f77540fe450 2024-09-18T21:24:01.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:01.632+0000 7f7759579640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77540fc150 con 0x7f7754064fe0 2024-09-18T21:24:01.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:01.632+0000 7f774bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77540fe450 0x7f77540fbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:24:01.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:01.632+0000 7f774bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77540fe450 0x7f77540fbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55312/0 (socket says 172.21.15.77:55312) 2024-09-18T21:24:01.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:01.632+0000 7f774bfff640 1 -- 172.21.15.77:0/2960198795 learned_addr learned my addr 172.21.15.77:0/2960198795 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:24:01.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:01.632+0000 7f7752ffd640 1 --2- 172.21.15.77:0/2960198795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7754064fe0 0x7f77540fb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:24:01.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:01.632+0000 7f774bfff640 1 -- 172.21.15.77:0/2960198795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7754064fe0 msgr2=0x7f77540fb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:01.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:01.632+0000 7f774bfff640 1 --2- 172.21.15.77:0/2960198795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7754064fe0 0x7f77540fb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:01.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:01.632+0000 7f774bfff640 1 -- 172.21.15.77:0/2960198795 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7744005040 con 0x7f77540fe450 2024-09-18T21:24:01.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:01.632+0000 7f774bfff640 1 --2- 172.21.15.77:0/2960198795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77540fe450 0x7f77540fbaa0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f773c002a50 tx=0x7f773c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:24:01.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:01.632+0000 7f774b7fe640 1 -- 172.21.15.77:0/2960198795 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f773c007c30 con 0x7f77540fe450 2024-09-18T21:24:01.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:01.632+0000 7f774b7fe640 1 -- 172.21.15.77:0/2960198795 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f773c00f040 con 0x7f77540fe450 2024-09-18T21:24:01.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:01.632+0000 7f7759579640 1 -- 172.21.15.77:0/2960198795 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77540fc3e0 con 0x7f77540fe450 2024-09-18T21:24:01.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:01.632+0000 7f774b7fe640 1 -- 172.21.15.77:0/2960198795 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f773c00da10 con 0x7f77540fe450 2024-09-18T21:24:01.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:01.632+0000 7f7759579640 1 -- 172.21.15.77:0/2960198795 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77541198c0 con 0x7f77540fe450 2024-09-18T21:24:01.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:01.633+0000 7f7759579640 1 -- 172.21.15.77:0/2960198795 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77540fdce0 con 0x7f77540fe450 2024-09-18T21:24:01.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:01.634+0000 7f774b7fe640 1 -- 172.21.15.77:0/2960198795 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f773c00dc80 con 0x7f77540fe450 2024-09-18T21:24:01.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:01.634+0000 7f774b7fe640 1 --2- 172.21.15.77:0/2960198795 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f774006e0b0 0x7f7740070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:24:01.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:01.634+0000 7f774b7fe640 1 -- 172.21.15.77:0/2960198795 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f773c08d440 con 0x7f77540fe450 2024-09-18T21:24:01.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:01.634+0000 7f7752ffd640 1 --2- 172.21.15.77:0/2960198795 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f774006e0b0 0x7f7740070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:24:01.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:01.635+0000 7f7752ffd640 1 --2- 172.21.15.77:0/2960198795 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f774006e0b0 0x7f7740070560 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7744009ac0 tx=0x7f7744035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:24:01.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:01.639+0000 7f774b7fe640 1 -- 172.21.15.77:0/2960198795 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f773c056770 con 0x7f77540fe450 2024-09-18T21:24:01.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:01.841+0000 7f7759579640 1 -- 172.21.15.77:0/2960198795 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7f7754072ec0 con 0x7f77540fe450 2024-09-18T21:24:01.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:01.842+0000 7f774b7fe640 1 -- 172.21.15.77:0/2960198795 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v36) v1 ==== 107+0+4199 (secure 0 0 0) 0x7f773c059e30 con 0x7f77540fe450 2024-09-18T21:24:01.843 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:24:01.843 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":22,"btime":"2024-09-18T21:19:47:866201+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24267,"name":"cephfs.smithi103.opftmf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.103:6827/4241818403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":4241818403},{"type":"v1","addr":"172.21.15.103:6827","nonce":4241818403}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34400,"name":"cephfs.smithi077.vruydi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6827/1087320436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1087320436},{"type":"v1","addr":"172.21.15.77:6827","nonce":1087320436}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T21:10:17.230179+0000","modified":"2024-09-18T21:19:47.651733+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24255":{"gid":24255,"name":"cephfs.smithi103.zhdmdg","rank":0,"incarnation":21,"state":"up:reconnect","state_seq":142,"addr":"172.21.15.103:6825/2170237078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2170237078},{"type":"v1","addr":"172.21.15.103:6825","nonce":2170237078}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T21:24:01.844 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 22 2024-09-18T21:24:01.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:01.844+0000 7f7759579640 1 -- 172.21.15.77:0/2960198795 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f774006e0b0 msgr2=0x7f7740070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:01.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:01.844+0000 7f7759579640 1 --2- 172.21.15.77:0/2960198795 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f774006e0b0 0x7f7740070560 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7744009ac0 tx=0x7f7744035040 comp rx=0 tx=0).stop 2024-09-18T21:24:01.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:01.844+0000 7f7759579640 1 -- 172.21.15.77:0/2960198795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77540fe450 msgr2=0x7f77540fbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:01.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:01.844+0000 7f7759579640 1 --2- 172.21.15.77:0/2960198795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77540fe450 0x7f77540fbaa0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f773c002a50 tx=0x7f773c004600 comp rx=0 tx=0).stop 2024-09-18T21:24:01.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:01.844+0000 7f7759579640 1 -- 172.21.15.77:0/2960198795 shutdown_connections 2024-09-18T21:24:01.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:01.844+0000 7f7759579640 1 --2- 172.21.15.77:0/2960198795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77540fe450 0x7f77540fbaa0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:01.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:01.844+0000 7f7759579640 1 --2- 172.21.15.77:0/2960198795 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f774006e0b0 0x7f7740070560 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:01.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:01.844+0000 7f7759579640 1 --2- 172.21.15.77:0/2960198795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7754064fe0 0x7f77540fb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:01.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:01.844+0000 7f7759579640 1 -- 172.21.15.77:0/2960198795 >> 172.21.15.77:0/2960198795 conn(0x7f77540723b0 msgr2=0x7f77540fa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:24:01.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:01.844+0000 7f7759579640 1 -- 172.21.15.77:0/2960198795 shutdown_connections 2024-09-18T21:24:01.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:01.844+0000 7f7759579640 1 -- 172.21.15.77:0/2960198795 wait complete. 2024-09-18T21:24:02.166 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:02 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/2960198795' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-09-18T21:24:02.475 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 23 2024-09-18T21:24:02.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:02 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/2960198795' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-09-18T21:24:02.719 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:24:03.103 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:03 smithi077 ceph-mon[92672]: pgmap v305: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:03.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:03 smithi103 ceph-mon[80307]: pgmap v305: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:04.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:04.379+0000 7fb76228b640 1 -- 172.21.15.77:0/1254659367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb75c102530 msgr2=0x7fb75c102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:04.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:04.379+0000 7fb76228b640 1 --2- 172.21.15.77:0/1254659367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb75c102530 0x7fb75c102900 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb74c0048d0 tx=0x7fb74c009da0 comp rx=0 tx=0).stop 2024-09-18T21:24:04.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:04.379+0000 7fb76228b640 1 -- 172.21.15.77:0/1254659367 shutdown_connections 2024-09-18T21:24:04.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:04.379+0000 7fb76228b640 1 --2- 172.21.15.77:0/1254659367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb75c102ed0 0x7fb75c0fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:04.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:04.379+0000 7fb76228b640 1 --2- 172.21.15.77:0/1254659367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb75c102530 0x7fb75c102900 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:04.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:04.379+0000 7fb76228b640 1 -- 172.21.15.77:0/1254659367 >> 172.21.15.77:0/1254659367 conn(0x7fb75c0f80f0 msgr2=0x7fb75c0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:24:04.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:04.379+0000 7fb76228b640 1 -- 172.21.15.77:0/1254659367 shutdown_connections 2024-09-18T21:24:04.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:04.379+0000 7fb76228b640 1 -- 172.21.15.77:0/1254659367 wait complete. 2024-09-18T21:24:04.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:04.379+0000 7fb76228b640 1 Processor -- start 2024-09-18T21:24:04.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:04.380+0000 7fb76228b640 1 -- start start 2024-09-18T21:24:04.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:04.380+0000 7fb76228b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb75c102530 0x7fb75c06fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:24:04.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:04.380+0000 7fb76228b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb75c102ed0 0x7fb75c06ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:24:04.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:04.380+0000 7fb76228b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c070520 con 0x7fb75c102ed0 2024-09-18T21:24:04.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:04.380+0000 7fb76228b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c070690 con 0x7fb75c102530 2024-09-18T21:24:04.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:04.380+0000 7fb753fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb75c102ed0 0x7fb75c06ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:24:04.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:04.380+0000 7fb753fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb75c102ed0 0x7fb75c06ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55332/0 (socket says 172.21.15.77:55332) 2024-09-18T21:24:04.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:04.380+0000 7fb753fff640 1 -- 172.21.15.77:0/2828501641 learned_addr learned my addr 172.21.15.77:0/2828501641 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:24:04.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:04.380+0000 7fb753fff640 1 -- 172.21.15.77:0/2828501641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb75c102530 msgr2=0x7fb75c06fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:04.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:04.380+0000 7fb753fff640 1 --2- 172.21.15.77:0/2828501641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb75c102530 0x7fb75c06fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:04.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:04.380+0000 7fb753fff640 1 -- 172.21.15.77:0/2828501641 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb74c005040 con 0x7fb75c102ed0 2024-09-18T21:24:04.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:04.380+0000 7fb753fff640 1 --2- 172.21.15.77:0/2828501641 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb75c102ed0 0x7fb75c06ff50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb74400b540 tx=0x7fb7440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:24:04.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:04.380+0000 7fb7597fa640 1 -- 172.21.15.77:0/2828501641 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb74400f6f0 con 0x7fb75c102ed0 2024-09-18T21:24:04.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:04.380+0000 7fb7597fa640 1 -- 172.21.15.77:0/2828501641 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb74400fcf0 con 0x7fb75c102ed0 2024-09-18T21:24:04.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:04.380+0000 7fb76228b640 1 -- 172.21.15.77:0/2828501641 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb75c119570 con 0x7fb75c102ed0 2024-09-18T21:24:04.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:04.380+0000 7fb7597fa640 1 -- 172.21.15.77:0/2828501641 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7440103a0 con 0x7fb75c102ed0 2024-09-18T21:24:04.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:04.380+0000 7fb76228b640 1 -- 172.21.15.77:0/2828501641 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb75c1199b0 con 0x7fb75c102ed0 2024-09-18T21:24:04.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:04.381+0000 7fb76228b640 1 -- 172.21.15.77:0/2828501641 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb75c0fdcb0 con 0x7fb75c102ed0 2024-09-18T21:24:04.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:04.382+0000 7fb7597fa640 1 -- 172.21.15.77:0/2828501641 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fb74400f850 con 0x7fb75c102ed0 2024-09-18T21:24:04.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:04.382+0000 7fb7597fa640 1 --2- 172.21.15.77:0/2828501641 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fb74806e0b0 0x7fb748070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:24:04.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:04.383+0000 7fb7597fa640 1 -- 172.21.15.77:0/2828501641 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fb74408dc10 con 0x7fb75c102ed0 2024-09-18T21:24:04.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:04.383+0000 7fb75bfff640 1 --2- 172.21.15.77:0/2828501641 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fb74806e0b0 0x7fb748070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:24:04.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:04.383+0000 7fb75bfff640 1 --2- 172.21.15.77:0/2828501641 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fb74806e0b0 0x7fb748070560 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb74c009fa0 tx=0x7fb74c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:24:04.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:04.387+0000 7fb7597fa640 1 -- 172.21.15.77:0/2828501641 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fb744056f10 con 0x7fb75c102ed0 2024-09-18T21:24:04.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:04.594+0000 7fb76228b640 1 -- 172.21.15.77:0/2828501641 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7fb75c109670 con 0x7fb75c102ed0 2024-09-18T21:24:04.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:04.594+0000 7fb7597fa640 1 -- 172.21.15.77:0/2828501641 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v36) v1 ==== 107+0+4196 (secure 0 0 0) 0x7fb74405a5d0 con 0x7fb75c102ed0 2024-09-18T21:24:04.595 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:24:04.596 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":23,"btime":"2024-09-18T21:19:48:871063+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24267,"name":"cephfs.smithi103.opftmf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.103:6827/4241818403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":4241818403},{"type":"v1","addr":"172.21.15.103:6827","nonce":4241818403}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34400,"name":"cephfs.smithi077.vruydi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6827/1087320436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1087320436},{"type":"v1","addr":"172.21.15.77:6827","nonce":1087320436}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T21:10:17.230179+0000","modified":"2024-09-18T21:19:47.872952+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24255":{"gid":24255,"name":"cephfs.smithi103.zhdmdg","rank":0,"incarnation":21,"state":"up:rejoin","state_seq":143,"addr":"172.21.15.103:6825/2170237078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2170237078},{"type":"v1","addr":"172.21.15.103:6825","nonce":2170237078}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T21:24:04.596 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 23 2024-09-18T21:24:04.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:04.597+0000 7fb76228b640 1 -- 172.21.15.77:0/2828501641 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fb74806e0b0 msgr2=0x7fb748070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:04.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:04.597+0000 7fb76228b640 1 --2- 172.21.15.77:0/2828501641 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fb74806e0b0 0x7fb748070560 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb74c009fa0 tx=0x7fb74c009da0 comp rx=0 tx=0).stop 2024-09-18T21:24:04.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:04.597+0000 7fb76228b640 1 -- 172.21.15.77:0/2828501641 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb75c102ed0 msgr2=0x7fb75c06ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:04.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:04.597+0000 7fb76228b640 1 --2- 172.21.15.77:0/2828501641 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb75c102ed0 0x7fb75c06ff50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb74400b540 tx=0x7fb7440091a0 comp rx=0 tx=0).stop 2024-09-18T21:24:04.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:04.597+0000 7fb76228b640 1 -- 172.21.15.77:0/2828501641 shutdown_connections 2024-09-18T21:24:04.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:04.597+0000 7fb76228b640 1 --2- 172.21.15.77:0/2828501641 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb75c102ed0 0x7fb75c06ff50 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:04.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:04.597+0000 7fb76228b640 1 --2- 172.21.15.77:0/2828501641 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fb74806e0b0 0x7fb748070560 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:04.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:04.597+0000 7fb76228b640 1 --2- 172.21.15.77:0/2828501641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb75c102530 0x7fb75c06fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:04.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:04.597+0000 7fb76228b640 1 -- 172.21.15.77:0/2828501641 >> 172.21.15.77:0/2828501641 conn(0x7fb75c0f80f0 msgr2=0x7fb75c0f9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:24:04.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:04.597+0000 7fb76228b640 1 -- 172.21.15.77:0/2828501641 shutdown_connections 2024-09-18T21:24:04.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:04.597+0000 7fb76228b640 1 -- 172.21.15.77:0/2828501641 wait complete. 2024-09-18T21:24:05.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:05 smithi077 ceph-mon[92672]: pgmap v306: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:05.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:05 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/2828501641' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-09-18T21:24:05.314 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 24 2024-09-18T21:24:05.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:05 smithi103 ceph-mon[80307]: pgmap v306: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:05.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:05 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/2828501641' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-09-18T21:24:05.561 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:24:06.406 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:06 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:24:06.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:06 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:24:07.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:07.268+0000 7f87f05cd640 1 -- 172.21.15.77:0/1874264951 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87e81025f0 msgr2=0x7f87e81029c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:07.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:07.268+0000 7f87f05cd640 1 --2- 172.21.15.77:0/1874264951 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87e81025f0 0x7f87e81029c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f87e40048d0 tx=0x7f87e4009da0 comp rx=0 tx=0).stop 2024-09-18T21:24:07.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:07.268+0000 7f87f05cd640 1 -- 172.21.15.77:0/1874264951 shutdown_connections 2024-09-18T21:24:07.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:07.268+0000 7f87f05cd640 1 --2- 172.21.15.77:0/1874264951 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87e80fac60 0x7f87e80fb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:07.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:07.268+0000 7f87f05cd640 1 --2- 172.21.15.77:0/1874264951 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87e81025f0 0x7f87e81029c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:07.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:07.268+0000 7f87f05cd640 1 -- 172.21.15.77:0/1874264951 >> 172.21.15.77:0/1874264951 conn(0x7f87e8070c80 msgr2=0x7f87e8071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:24:07.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:07.268+0000 7f87f05cd640 1 -- 172.21.15.77:0/1874264951 shutdown_connections 2024-09-18T21:24:07.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:07.268+0000 7f87f05cd640 1 -- 172.21.15.77:0/1874264951 wait complete. 2024-09-18T21:24:07.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:07.268+0000 7f87f05cd640 1 Processor -- start 2024-09-18T21:24:07.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:07.268+0000 7f87f05cd640 1 -- start start 2024-09-18T21:24:07.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:07.269+0000 7f87f05cd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87e80fac60 0x7f87e8113250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:24:07.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:07.269+0000 7f87f05cd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87e81025f0 0x7f87e8113790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:24:07.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:07.269+0000 7f87f05cd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e8113e20 con 0x7f87e81025f0 2024-09-18T21:24:07.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:07.269+0000 7f87f05cd640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e810d1d0 con 0x7f87e80fac60 2024-09-18T21:24:07.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:07.269+0000 7f87edb68640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87e81025f0 0x7f87e8113790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:24:07.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:07.269+0000 7f87edb68640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87e81025f0 0x7f87e8113790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55340/0 (socket says 172.21.15.77:55340) 2024-09-18T21:24:07.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:07.269+0000 7f87edb68640 1 -- 172.21.15.77:0/3937650684 learned_addr learned my addr 172.21.15.77:0/3937650684 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:24:07.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:07.269+0000 7f87ee369640 1 --2- 172.21.15.77:0/3937650684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87e80fac60 0x7f87e8113250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:24:07.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:07.269+0000 7f87edb68640 1 -- 172.21.15.77:0/3937650684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87e80fac60 msgr2=0x7f87e8113250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:07.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:07.269+0000 7f87edb68640 1 --2- 172.21.15.77:0/3937650684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87e80fac60 0x7f87e8113250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:07.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:07.269+0000 7f87edb68640 1 -- 172.21.15.77:0/3937650684 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e4005040 con 0x7f87e81025f0 2024-09-18T21:24:07.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:07.269+0000 7f87ee369640 1 --2- 172.21.15.77:0/3937650684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87e80fac60 0x7f87e8113250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T21:24:07.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:07.269+0000 7f87edb68640 1 --2- 172.21.15.77:0/3937650684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87e81025f0 0x7f87e8113790 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f87d800b790 tx=0x7f87d80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:24:07.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:07.269+0000 7f87deffd640 1 -- 172.21.15.77:0/3937650684 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87d800c700 con 0x7f87e81025f0 2024-09-18T21:24:07.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:07.269+0000 7f87deffd640 1 -- 172.21.15.77:0/3937650684 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f87d800cd00 con 0x7f87e81025f0 2024-09-18T21:24:07.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:07.270+0000 7f87f05cd640 1 -- 172.21.15.77:0/3937650684 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87e810d4b0 con 0x7f87e81025f0 2024-09-18T21:24:07.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:07.270+0000 7f87deffd640 1 -- 172.21.15.77:0/3937650684 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87d8015e70 con 0x7f87e81025f0 2024-09-18T21:24:07.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:07.270+0000 7f87f05cd640 1 -- 172.21.15.77:0/3937650684 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e810d9d0 con 0x7f87e81025f0 2024-09-18T21:24:07.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:07.271+0000 7f87f05cd640 1 -- 172.21.15.77:0/3937650684 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87e8065810 con 0x7f87e81025f0 2024-09-18T21:24:07.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:07.271+0000 7f87deffd640 1 -- 172.21.15.77:0/3937650684 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f87d8012070 con 0x7f87e81025f0 2024-09-18T21:24:07.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:07.271+0000 7f87deffd640 1 --2- 172.21.15.77:0/3937650684 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f87d406e0b0 0x7f87d4070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:24:07.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:07.272+0000 7f87deffd640 1 -- 172.21.15.77:0/3937650684 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f87d808d850 con 0x7f87e81025f0 2024-09-18T21:24:07.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:07.272+0000 7f87ee369640 1 --2- 172.21.15.77:0/3937650684 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f87d406e0b0 0x7f87d4070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:24:07.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:07.272+0000 7f87ee369640 1 --2- 172.21.15.77:0/3937650684 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f87d406e0b0 0x7f87d4070560 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f87e4007ac0 tx=0x7f87e4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:24:07.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:07.276+0000 7f87deffd640 1 -- 172.21.15.77:0/3937650684 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f87d8056ad0 con 0x7f87e81025f0 2024-09-18T21:24:07.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:07 smithi077 ceph-mon[92672]: pgmap v307: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:07.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:07.478+0000 7f87f05cd640 1 -- 172.21.15.77:0/3937650684 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7f87e81096e0 con 0x7f87e81025f0 2024-09-18T21:24:07.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:07.479+0000 7f87deffd640 1 -- 172.21.15.77:0/3937650684 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v36) v1 ==== 107+0+4205 (secure 0 0 0) 0x7f87d805a190 con 0x7f87e81025f0 2024-09-18T21:24:07.480 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:24:07.480 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":24,"btime":"2024-09-18T21:19:49:876382+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24267,"name":"cephfs.smithi103.opftmf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.103:6827/4241818403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":4241818403},{"type":"v1","addr":"172.21.15.103:6827","nonce":4241818403}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34400,"name":"cephfs.smithi077.vruydi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6827/1087320436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1087320436},{"type":"v1","addr":"172.21.15.77:6827","nonce":1087320436}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T21:10:17.230179+0000","modified":"2024-09-18T21:19:49.876380+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24255":{"gid":24255,"name":"cephfs.smithi103.zhdmdg","rank":0,"incarnation":21,"state":"up:active","state_seq":144,"addr":"172.21.15.103:6825/2170237078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2170237078},{"type":"v1","addr":"172.21.15.103:6825","nonce":2170237078}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24255,"qdb_cluster":[24255]},"id":1}]} 2024-09-18T21:24:07.480 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 24 2024-09-18T21:24:07.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:07.481+0000 7f87f05cd640 1 -- 172.21.15.77:0/3937650684 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f87d406e0b0 msgr2=0x7f87d4070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:07.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:07.481+0000 7f87f05cd640 1 --2- 172.21.15.77:0/3937650684 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f87d406e0b0 0x7f87d4070560 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f87e4007ac0 tx=0x7f87e4035040 comp rx=0 tx=0).stop 2024-09-18T21:24:07.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:07.481+0000 7f87f05cd640 1 -- 172.21.15.77:0/3937650684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87e81025f0 msgr2=0x7f87e8113790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:07.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:07.481+0000 7f87f05cd640 1 --2- 172.21.15.77:0/3937650684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87e81025f0 0x7f87e8113790 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f87d800b790 tx=0x7f87d80091d0 comp rx=0 tx=0).stop 2024-09-18T21:24:07.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:07.481+0000 7f87f05cd640 1 -- 172.21.15.77:0/3937650684 shutdown_connections 2024-09-18T21:24:07.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:07.481+0000 7f87f05cd640 1 --2- 172.21.15.77:0/3937650684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87e81025f0 0x7f87e8113790 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:07.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:07.481+0000 7f87f05cd640 1 --2- 172.21.15.77:0/3937650684 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f87d406e0b0 0x7f87d4070560 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:07.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:07.481+0000 7f87f05cd640 1 --2- 172.21.15.77:0/3937650684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87e80fac60 0x7f87e8113250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:07.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:07.481+0000 7f87f05cd640 1 -- 172.21.15.77:0/3937650684 >> 172.21.15.77:0/3937650684 conn(0x7f87e8070c80 msgr2=0x7f87e80f9f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:24:07.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:07.481+0000 7f87f05cd640 1 -- 172.21.15.77:0/3937650684 shutdown_connections 2024-09-18T21:24:07.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:07.481+0000 7f87f05cd640 1 -- 172.21.15.77:0/3937650684 wait complete. 2024-09-18T21:24:07.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:07 smithi103 ceph-mon[80307]: pgmap v307: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:08.138 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 25 2024-09-18T21:24:08.383 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:24:08.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:08 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/3937650684' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-09-18T21:24:08.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:08 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/3937650684' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-09-18T21:24:09.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:09 smithi077 ceph-mon[92672]: pgmap v308: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:09.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:09 smithi103 ceph-mon[80307]: pgmap v308: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:10.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:10.102+0000 7f5aee3d4640 1 -- 172.21.15.77:0/1016438661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ae80fe450 msgr2=0x7f5ae80fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:10.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:10.102+0000 7f5aee3d4640 1 --2- 172.21.15.77:0/1016438661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ae80fe450 0x7f5ae80fe820 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5ad80048d0 tx=0x7f5ad8009da0 comp rx=0 tx=0).stop 2024-09-18T21:24:10.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:10.102+0000 7f5aee3d4640 1 -- 172.21.15.77:0/1016438661 shutdown_connections 2024-09-18T21:24:10.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:10.102+0000 7f5aee3d4640 1 --2- 172.21.15.77:0/1016438661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ae8064fe0 0x7f5ae8065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:10.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:10.102+0000 7f5aee3d4640 1 --2- 172.21.15.77:0/1016438661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ae80fe450 0x7f5ae80fe820 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:10.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:10.102+0000 7f5aee3d4640 1 -- 172.21.15.77:0/1016438661 >> 172.21.15.77:0/1016438661 conn(0x7f5ae80723b0 msgr2=0x7f5ae80727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:24:10.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:10.102+0000 7f5aee3d4640 1 -- 172.21.15.77:0/1016438661 shutdown_connections 2024-09-18T21:24:10.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:10.102+0000 7f5aee3d4640 1 -- 172.21.15.77:0/1016438661 wait complete. 2024-09-18T21:24:10.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:10.103+0000 7f5aee3d4640 1 Processor -- start 2024-09-18T21:24:10.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:10.103+0000 7f5aee3d4640 1 -- start start 2024-09-18T21:24:10.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:10.103+0000 7f5aee3d4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ae8064fe0 0x7f5ae81131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:24:10.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:10.103+0000 7f5aee3d4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ae80fe450 0x7f5ae8113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:24:10.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:10.103+0000 7f5aee3d4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae8113d10 con 0x7f5ae80fe450 2024-09-18T21:24:10.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:10.103+0000 7f5aee3d4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae810d150 con 0x7f5ae8064fe0 2024-09-18T21:24:10.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:10.104+0000 7f5ae77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ae80fe450 0x7f5ae8113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:24:10.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:10.104+0000 7f5ae77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ae80fe450 0x7f5ae8113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49374/0 (socket says 172.21.15.77:49374) 2024-09-18T21:24:10.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:10.104+0000 7f5ae77fe640 1 -- 172.21.15.77:0/3060556149 learned_addr learned my addr 172.21.15.77:0/3060556149 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:24:10.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:10.104+0000 7f5ae7fff640 1 --2- 172.21.15.77:0/3060556149 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ae8064fe0 0x7f5ae81131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:24:10.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:10.104+0000 7f5ae77fe640 1 -- 172.21.15.77:0/3060556149 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ae8064fe0 msgr2=0x7f5ae81131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:10.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:10.104+0000 7f5ae77fe640 1 --2- 172.21.15.77:0/3060556149 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ae8064fe0 0x7f5ae81131d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:10.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:10.104+0000 7f5ae77fe640 1 -- 172.21.15.77:0/3060556149 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad8005040 con 0x7f5ae80fe450 2024-09-18T21:24:10.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:10.104+0000 7f5ae77fe640 1 --2- 172.21.15.77:0/3060556149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ae80fe450 0x7f5ae8113710 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5adc002a50 tx=0x7f5adc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:24:10.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:10.104+0000 7f5ae4ff9640 1 -- 172.21.15.77:0/3060556149 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5adc007c30 con 0x7f5ae80fe450 2024-09-18T21:24:10.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:10.104+0000 7f5aee3d4640 1 -- 172.21.15.77:0/3060556149 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ae810d430 con 0x7f5ae80fe450 2024-09-18T21:24:10.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:10.104+0000 7f5ae4ff9640 1 -- 172.21.15.77:0/3060556149 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5adc00f040 con 0x7f5ae80fe450 2024-09-18T21:24:10.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:10.104+0000 7f5ae4ff9640 1 -- 172.21.15.77:0/3060556149 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5adc00dad0 con 0x7f5ae80fe450 2024-09-18T21:24:10.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:10.104+0000 7f5aee3d4640 1 -- 172.21.15.77:0/3060556149 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ae810d9d0 con 0x7f5ae80fe450 2024-09-18T21:24:10.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:10.106+0000 7f5aee3d4640 1 -- 172.21.15.77:0/3060556149 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ae80fdce0 con 0x7f5ae80fe450 2024-09-18T21:24:10.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:10.106+0000 7f5ae4ff9640 1 -- 172.21.15.77:0/3060556149 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5adc00dc30 con 0x7f5ae80fe450 2024-09-18T21:24:10.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:10.106+0000 7f5ae4ff9640 1 --2- 172.21.15.77:0/3060556149 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f5ad006e0b0 0x7f5ad0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:24:10.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:10.106+0000 7f5ae4ff9640 1 -- 172.21.15.77:0/3060556149 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f5adc08dac0 con 0x7f5ae80fe450 2024-09-18T21:24:10.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:10.106+0000 7f5ae7fff640 1 --2- 172.21.15.77:0/3060556149 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f5ad006e0b0 0x7f5ad0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:24:10.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:10.107+0000 7f5ae7fff640 1 --2- 172.21.15.77:0/3060556149 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f5ad006e0b0 0x7f5ad0070560 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8009ac0 tx=0x7f5ad8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:24:10.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:10.111+0000 7f5ae4ff9640 1 -- 172.21.15.77:0/3060556149 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f5adc056e20 con 0x7f5ae80fe450 2024-09-18T21:24:10.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:10.311+0000 7f5aee3d4640 1 -- 172.21.15.77:0/3060556149 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7f5ae8072ec0 con 0x7f5ae80fe450 2024-09-18T21:24:10.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:10.311+0000 7f5ae4ff9640 1 -- 172.21.15.77:0/3060556149 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v36) v1 ==== 107+0+5052 (secure 0 0 0) 0x7f5adc05a4e0 con 0x7f5ae80fe450 2024-09-18T21:24:10.313 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:24:10.313 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":25,"btime":"2024-09-18T21:19:50:882837+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24267,"name":"cephfs.smithi103.opftmf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.103:6827/4241818403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":4241818403},{"type":"v1","addr":"172.21.15.103:6827","nonce":4241818403}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34400,"name":"cephfs.smithi077.vruydi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6827/1087320436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1087320436},{"type":"v1","addr":"172.21.15.77:6827","nonce":1087320436}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":34404,"name":"cephfs.smithi077.cqfhlw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6829/1489733233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1489733233},{"type":"v1","addr":"172.21.15.77:6829","nonce":1489733233}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T21:10:17.230179+0000","modified":"2024-09-18T21:19:49.876380+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24255},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24255":{"gid":24255,"name":"cephfs.smithi103.zhdmdg","rank":0,"incarnation":21,"state":"up:active","state_seq":144,"addr":"172.21.15.103:6825/2170237078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2170237078},{"type":"v1","addr":"172.21.15.103:6825","nonce":2170237078}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24255,"qdb_cluster":[24255]},"id":1}]} 2024-09-18T21:24:10.313 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 25 2024-09-18T21:24:10.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:10.313+0000 7f5aee3d4640 1 -- 172.21.15.77:0/3060556149 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f5ad006e0b0 msgr2=0x7f5ad0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:10.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:10.313+0000 7f5aee3d4640 1 --2- 172.21.15.77:0/3060556149 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f5ad006e0b0 0x7f5ad0070560 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8009ac0 tx=0x7f5ad8035040 comp rx=0 tx=0).stop 2024-09-18T21:24:10.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:10.314+0000 7f5aee3d4640 1 -- 172.21.15.77:0/3060556149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ae80fe450 msgr2=0x7f5ae8113710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:10.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:10.314+0000 7f5aee3d4640 1 --2- 172.21.15.77:0/3060556149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ae80fe450 0x7f5ae8113710 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5adc002a50 tx=0x7f5adc004600 comp rx=0 tx=0).stop 2024-09-18T21:24:10.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:10.314+0000 7f5aee3d4640 1 -- 172.21.15.77:0/3060556149 shutdown_connections 2024-09-18T21:24:10.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:10.314+0000 7f5aee3d4640 1 --2- 172.21.15.77:0/3060556149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ae80fe450 0x7f5ae8113710 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:10.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:10.314+0000 7f5aee3d4640 1 --2- 172.21.15.77:0/3060556149 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f5ad006e0b0 0x7f5ad0070560 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:10.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:10.314+0000 7f5aee3d4640 1 --2- 172.21.15.77:0/3060556149 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ae8064fe0 0x7f5ae81131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:10.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:10.314+0000 7f5aee3d4640 1 -- 172.21.15.77:0/3060556149 >> 172.21.15.77:0/3060556149 conn(0x7f5ae80723b0 msgr2=0x7f5ae80fa290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:24:10.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:10.314+0000 7f5aee3d4640 1 -- 172.21.15.77:0/3060556149 shutdown_connections 2024-09-18T21:24:10.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:10.314+0000 7f5aee3d4640 1 -- 172.21.15.77:0/3060556149 wait complete. 2024-09-18T21:24:11.012 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 26 2024-09-18T21:24:11.258 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:24:11.379 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:11 smithi077 ceph-mon[92672]: pgmap v309: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:11.379 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:11 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/3060556149' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-09-18T21:24:11.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:11 smithi103 ceph-mon[80307]: pgmap v309: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:11.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:11 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/3060556149' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-09-18T21:24:13.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:13.000+0000 7f692a3d6640 1 -- 172.21.15.77:0/3843674554 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6924065c10 msgr2=0x7f69240fe0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:13.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:13.000+0000 7f692a3d6640 1 --2- 172.21.15.77:0/3843674554 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6924065c10 0x7f69240fe0d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f69180048d0 tx=0x7f6918009da0 comp rx=0 tx=0).stop 2024-09-18T21:24:13.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:13.000+0000 7f692a3d6640 1 -- 172.21.15.77:0/3843674554 shutdown_connections 2024-09-18T21:24:13.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:13.000+0000 7f692a3d6640 1 --2- 172.21.15.77:0/3843674554 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6924065c10 0x7f69240fe0d0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:13.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:13.000+0000 7f692a3d6640 1 --2- 172.21.15.77:0/3843674554 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6924065300 0x7f69240656d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:13.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:13.000+0000 7f692a3d6640 1 -- 172.21.15.77:0/3843674554 >> 172.21.15.77:0/3843674554 conn(0x7f69240723b0 msgr2=0x7f69240727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:24:13.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:13.000+0000 7f692a3d6640 1 -- 172.21.15.77:0/3843674554 shutdown_connections 2024-09-18T21:24:13.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:13.000+0000 7f692a3d6640 1 -- 172.21.15.77:0/3843674554 wait complete. 2024-09-18T21:24:13.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:13.000+0000 7f692a3d6640 1 Processor -- start 2024-09-18T21:24:13.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:13.001+0000 7f692a3d6640 1 -- start start 2024-09-18T21:24:13.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:13.001+0000 7f692a3d6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6924065300 0x7f69241131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:24:13.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:13.001+0000 7f692a3d6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6924065c10 0x7f69241136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:24:13.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:13.001+0000 7f692a3d6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6924113cf0 con 0x7f6924065300 2024-09-18T21:24:13.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:13.001+0000 7f692a3d6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692410d130 con 0x7f6924065c10 2024-09-18T21:24:13.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:13.001+0000 7f6923fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6924065300 0x7f69241131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:24:13.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:13.001+0000 7f6923fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6924065300 0x7f69241131b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49404/0 (socket says 172.21.15.77:49404) 2024-09-18T21:24:13.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:13.001+0000 7f6923fff640 1 -- 172.21.15.77:0/3122314123 learned_addr learned my addr 172.21.15.77:0/3122314123 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:24:13.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:13.001+0000 7f69237fe640 1 --2- 172.21.15.77:0/3122314123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6924065c10 0x7f69241136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:24:13.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:13.001+0000 7f6923fff640 1 -- 172.21.15.77:0/3122314123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6924065c10 msgr2=0x7f69241136f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:13.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:13.001+0000 7f6923fff640 1 --2- 172.21.15.77:0/3122314123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6924065c10 0x7f69241136f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:13.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:13.001+0000 7f6923fff640 1 -- 172.21.15.77:0/3122314123 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6918005040 con 0x7f6924065300 2024-09-18T21:24:13.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:13.002+0000 7f6923fff640 1 --2- 172.21.15.77:0/3122314123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6924065300 0x7f69241131b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6914002a50 tx=0x7f6914004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:24:13.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:13.002+0000 7f6920ff9640 1 -- 172.21.15.77:0/3122314123 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6914007c30 con 0x7f6924065300 2024-09-18T21:24:13.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:13.002+0000 7f6920ff9640 1 -- 172.21.15.77:0/3122314123 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f691400f040 con 0x7f6924065300 2024-09-18T21:24:13.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:13.002+0000 7f692a3d6640 1 -- 172.21.15.77:0/3122314123 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f692410d410 con 0x7f6924065300 2024-09-18T21:24:13.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:13.002+0000 7f6920ff9640 1 -- 172.21.15.77:0/3122314123 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f691400da10 con 0x7f6924065300 2024-09-18T21:24:13.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:13.002+0000 7f692a3d6640 1 -- 172.21.15.77:0/3122314123 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f692410d980 con 0x7f6924065300 2024-09-18T21:24:13.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:13.003+0000 7f692a3d6640 1 -- 172.21.15.77:0/3122314123 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69240fdce0 con 0x7f6924065300 2024-09-18T21:24:13.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:13.003+0000 7f6920ff9640 1 -- 172.21.15.77:0/3122314123 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f691400dbb0 con 0x7f6924065300 2024-09-18T21:24:13.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:13.004+0000 7f6920ff9640 1 --2- 172.21.15.77:0/3122314123 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f690c06e0b0 0x7f690c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:24:13.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:13.004+0000 7f6920ff9640 1 -- 172.21.15.77:0/3122314123 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f691408d390 con 0x7f6924065300 2024-09-18T21:24:13.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:13.004+0000 7f69237fe640 1 --2- 172.21.15.77:0/3122314123 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f690c06e0b0 0x7f690c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:24:13.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:13.004+0000 7f69237fe640 1 --2- 172.21.15.77:0/3122314123 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f690c06e0b0 0x7f690c070560 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6918009ac0 tx=0x7f6918035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:24:13.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:13.008+0000 7f6920ff9640 1 -- 172.21.15.77:0/3122314123 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f6914056740 con 0x7f6924065300 2024-09-18T21:24:13.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:13.213+0000 7f692a3d6640 1 -- 172.21.15.77:0/3122314123 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7f692404b780 con 0x7f6924065300 2024-09-18T21:24:13.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:13.214+0000 7f6920ff9640 1 -- 172.21.15.77:0/3122314123 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v36) v1 ==== 107+0+4248 (secure 0 0 0) 0x7f691400de60 con 0x7f6924065300 2024-09-18T21:24:13.215 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:24:13.215 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":26,"btime":"2024-09-18T21:20:02:083581+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24267,"name":"cephfs.smithi103.opftmf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.103:6827/4241818403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":4241818403},{"type":"v1","addr":"172.21.15.103:6827","nonce":4241818403}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34400,"name":"cephfs.smithi077.vruydi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6827/1087320436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1087320436},{"type":"v1","addr":"172.21.15.77:6827","nonce":1087320436}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":34404,"name":"cephfs.smithi077.cqfhlw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6829/1489733233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1489733233},{"type":"v1","addr":"172.21.15.77:6829","nonce":1489733233}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T21:10:17.230179+0000","modified":"2024-09-18T21:20:02.083578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T21:24:13.215 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 26 2024-09-18T21:24:13.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:13.216+0000 7f692a3d6640 1 -- 172.21.15.77:0/3122314123 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f690c06e0b0 msgr2=0x7f690c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:13.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:13.216+0000 7f692a3d6640 1 --2- 172.21.15.77:0/3122314123 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f690c06e0b0 0x7f690c070560 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6918009ac0 tx=0x7f6918035040 comp rx=0 tx=0).stop 2024-09-18T21:24:13.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:13.216+0000 7f692a3d6640 1 -- 172.21.15.77:0/3122314123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6924065300 msgr2=0x7f69241131b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:13.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:13.216+0000 7f692a3d6640 1 --2- 172.21.15.77:0/3122314123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6924065300 0x7f69241131b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6914002a50 tx=0x7f6914004600 comp rx=0 tx=0).stop 2024-09-18T21:24:13.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:13.216+0000 7f692a3d6640 1 -- 172.21.15.77:0/3122314123 shutdown_connections 2024-09-18T21:24:13.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:13.216+0000 7f692a3d6640 1 --2- 172.21.15.77:0/3122314123 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f690c06e0b0 0x7f690c070560 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:13.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:13.216+0000 7f692a3d6640 1 --2- 172.21.15.77:0/3122314123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6924065c10 0x7f69241136f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:13.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:13.216+0000 7f692a3d6640 1 --2- 172.21.15.77:0/3122314123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6924065300 0x7f69241131b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:13.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:13.216+0000 7f692a3d6640 1 -- 172.21.15.77:0/3122314123 >> 172.21.15.77:0/3122314123 conn(0x7f69240723b0 msgr2=0x7f69240fa2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:24:13.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:13.216+0000 7f692a3d6640 1 -- 172.21.15.77:0/3122314123 shutdown_connections 2024-09-18T21:24:13.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:13.216+0000 7f692a3d6640 1 -- 172.21.15.77:0/3122314123 wait complete. 2024-09-18T21:24:13.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:13 smithi077 ceph-mon[92672]: pgmap v310: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:13.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:13 smithi103 ceph-mon[80307]: pgmap v310: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:14.023 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 27 2024-09-18T21:24:14.276 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:24:14.397 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:14 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/3122314123' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-09-18T21:24:14.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:14 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/3122314123' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-09-18T21:24:15.445 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:15 smithi077 ceph-mon[92672]: pgmap v311: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:15.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:15 smithi103 ceph-mon[80307]: pgmap v311: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:16.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:16.017+0000 7fa681f46640 1 -- 172.21.15.77:0/242322139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa67c0fcf80 msgr2=0x7fa67c0fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:16.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:16.017+0000 7fa681f46640 1 --2- 172.21.15.77:0/242322139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa67c0fcf80 0x7fa67c0fd3d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa6640048d0 tx=0x7fa664009da0 comp rx=0 tx=0).stop 2024-09-18T21:24:16.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:16.017+0000 7fa681f46640 1 -- 172.21.15.77:0/242322139 shutdown_connections 2024-09-18T21:24:16.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:16.017+0000 7fa681f46640 1 --2- 172.21.15.77:0/242322139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa67c0fcf80 0x7fa67c0fd3d0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:16.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:16.017+0000 7fa681f46640 1 --2- 172.21.15.77:0/242322139 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa67c0fb810 0x7fa67c0fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:16.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:16.017+0000 7fa681f46640 1 -- 172.21.15.77:0/242322139 >> 172.21.15.77:0/242322139 conn(0x7fa67c0723b0 msgr2=0x7fa67c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:24:16.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:16.017+0000 7fa681f46640 1 -- 172.21.15.77:0/242322139 shutdown_connections 2024-09-18T21:24:16.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:16.017+0000 7fa681f46640 1 -- 172.21.15.77:0/242322139 wait complete. 2024-09-18T21:24:16.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:16.017+0000 7fa681f46640 1 Processor -- start 2024-09-18T21:24:16.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:16.017+0000 7fa681f46640 1 -- start start 2024-09-18T21:24:16.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:16.018+0000 7fa681f46640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa67c0fb810 0x7fa67c10e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:24:16.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:16.018+0000 7fa681f46640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa67c0fcf80 0x7fa67c10e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:24:16.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:16.018+0000 7fa681f46640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67c10ed20 con 0x7fa67c0fb810 2024-09-18T21:24:16.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:16.018+0000 7fa681f46640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67c10ee90 con 0x7fa67c0fcf80 2024-09-18T21:24:16.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:16.018+0000 7fa67b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa67c0fb810 0x7fa67c10e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:24:16.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:16.018+0000 7fa67b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa67c0fb810 0x7fa67c10e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49428/0 (socket says 172.21.15.77:49428) 2024-09-18T21:24:16.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:16.018+0000 7fa67b7fe640 1 -- 172.21.15.77:0/768866600 learned_addr learned my addr 172.21.15.77:0/768866600 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:24:16.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:16.018+0000 7fa67b7fe640 1 -- 172.21.15.77:0/768866600 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa67c0fcf80 msgr2=0x7fa67c10e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:16.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:16.018+0000 7fa673fff640 1 --2- 172.21.15.77:0/768866600 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa67c0fcf80 0x7fa67c10e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:24:16.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:16.018+0000 7fa67b7fe640 1 --2- 172.21.15.77:0/768866600 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa67c0fcf80 0x7fa67c10e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:16.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:16.018+0000 7fa67b7fe640 1 -- 172.21.15.77:0/768866600 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa664005040 con 0x7fa67c0fb810 2024-09-18T21:24:16.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:16.018+0000 7fa673fff640 1 --2- 172.21.15.77:0/768866600 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa67c0fcf80 0x7fa67c10e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-18T21:24:16.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:16.018+0000 7fa67b7fe640 1 --2- 172.21.15.77:0/768866600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa67c0fb810 0x7fa67c10e190 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa66c002a50 tx=0x7fa66c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:24:16.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:16.018+0000 7fa678ff9640 1 -- 172.21.15.77:0/768866600 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa66c007c30 con 0x7fa67c0fb810 2024-09-18T21:24:16.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:16.018+0000 7fa678ff9640 1 -- 172.21.15.77:0/768866600 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa66c00f040 con 0x7fa67c0fb810 2024-09-18T21:24:16.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:16.018+0000 7fa681f46640 1 -- 172.21.15.77:0/768866600 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa67c117200 con 0x7fa67c0fb810 2024-09-18T21:24:16.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:16.018+0000 7fa678ff9640 1 -- 172.21.15.77:0/768866600 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa66c00da90 con 0x7fa67c0fb810 2024-09-18T21:24:16.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:16.018+0000 7fa681f46640 1 -- 172.21.15.77:0/768866600 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa67c117710 con 0x7fa67c0fb810 2024-09-18T21:24:16.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:16.019+0000 7fa681f46640 1 -- 172.21.15.77:0/768866600 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa67c0fcbc0 con 0x7fa67c0fb810 2024-09-18T21:24:16.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:16.020+0000 7fa678ff9640 1 -- 172.21.15.77:0/768866600 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fa66c00dc30 con 0x7fa67c0fb810 2024-09-18T21:24:16.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:16.020+0000 7fa678ff9640 1 --2- 172.21.15.77:0/768866600 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fa66806e0b0 0x7fa668070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:24:16.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:16.020+0000 7fa678ff9640 1 -- 172.21.15.77:0/768866600 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fa66c08d400 con 0x7fa67c0fb810 2024-09-18T21:24:16.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:16.020+0000 7fa673fff640 1 --2- 172.21.15.77:0/768866600 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fa66806e0b0 0x7fa668070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:24:16.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:16.021+0000 7fa673fff640 1 --2- 172.21.15.77:0/768866600 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fa66806e0b0 0x7fa668070560 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa66400b020 tx=0x7fa664009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:24:16.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:16.025+0000 7fa678ff9640 1 -- 172.21.15.77:0/768866600 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fa66c056700 con 0x7fa67c0fb810 2024-09-18T21:24:16.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:16.225+0000 7fa681f46640 1 -- 172.21.15.77:0/768866600 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7fa67c065730 con 0x7fa67c0fb810 2024-09-18T21:24:16.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:16.226+0000 7fa678ff9640 1 -- 172.21.15.77:0/768866600 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v36) v1 ==== 107+0+4259 (secure 0 0 0) 0x7fa66c059dc0 con 0x7fa67c0fb810 2024-09-18T21:24:16.227 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:24:16.227 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":27,"btime":"2024-09-18T21:20:02:088810+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34400,"name":"cephfs.smithi077.vruydi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6827/1087320436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1087320436},{"type":"v1","addr":"172.21.15.77:6827","nonce":1087320436}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":34404,"name":"cephfs.smithi077.cqfhlw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6829/1489733233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1489733233},{"type":"v1","addr":"172.21.15.77:6829","nonce":1489733233}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T21:10:17.230179+0000","modified":"2024-09-18T21:20:02.088795+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24267":{"gid":24267,"name":"cephfs.smithi103.opftmf","rank":0,"incarnation":27,"state":"up:replay","state_seq":2,"addr":"172.21.15.103:6827/4241818403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":4241818403},{"type":"v1","addr":"172.21.15.103:6827","nonce":4241818403}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T21:24:16.227 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 27 2024-09-18T21:24:16.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:16.228+0000 7fa681f46640 1 -- 172.21.15.77:0/768866600 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fa66806e0b0 msgr2=0x7fa668070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:16.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:16.228+0000 7fa681f46640 1 --2- 172.21.15.77:0/768866600 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fa66806e0b0 0x7fa668070560 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa66400b020 tx=0x7fa664009da0 comp rx=0 tx=0).stop 2024-09-18T21:24:16.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:16.228+0000 7fa681f46640 1 -- 172.21.15.77:0/768866600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa67c0fb810 msgr2=0x7fa67c10e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:16.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:16.228+0000 7fa681f46640 1 --2- 172.21.15.77:0/768866600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa67c0fb810 0x7fa67c10e190 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa66c002a50 tx=0x7fa66c004600 comp rx=0 tx=0).stop 2024-09-18T21:24:16.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:16.228+0000 7fa681f46640 1 -- 172.21.15.77:0/768866600 shutdown_connections 2024-09-18T21:24:16.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:16.228+0000 7fa681f46640 1 --2- 172.21.15.77:0/768866600 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fa66806e0b0 0x7fa668070560 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:16.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:16.228+0000 7fa681f46640 1 --2- 172.21.15.77:0/768866600 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa67c0fcf80 0x7fa67c10e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:16.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:16.228+0000 7fa681f46640 1 --2- 172.21.15.77:0/768866600 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa67c0fb810 0x7fa67c10e190 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:16.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:16.228+0000 7fa681f46640 1 -- 172.21.15.77:0/768866600 >> 172.21.15.77:0/768866600 conn(0x7fa67c0723b0 msgr2=0x7fa67c0fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:24:16.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:16.228+0000 7fa681f46640 1 -- 172.21.15.77:0/768866600 shutdown_connections 2024-09-18T21:24:16.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:16.228+0000 7fa681f46640 1 -- 172.21.15.77:0/768866600 wait complete. 2024-09-18T21:24:16.860 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 28 2024-09-18T21:24:17.108 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:24:17.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:17 smithi077 ceph-mon[92672]: pgmap v312: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:17.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:17 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/768866600' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-09-18T21:24:17.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:17 smithi103 ceph-mon[80307]: pgmap v312: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:17.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:17 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/768866600' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-09-18T21:24:18.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:18.681+0000 7f2548f03640 1 -- 172.21.15.77:0/2262761943 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25440fcf80 msgr2=0x7f25440fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:18.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:18.681+0000 7f2548f03640 1 --2- 172.21.15.77:0/2262761943 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25440fcf80 0x7f25440fd3d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f252c0048d0 tx=0x7f252c009da0 comp rx=0 tx=0).stop 2024-09-18T21:24:18.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:18.681+0000 7f2548f03640 1 -- 172.21.15.77:0/2262761943 shutdown_connections 2024-09-18T21:24:18.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:18.681+0000 7f2548f03640 1 --2- 172.21.15.77:0/2262761943 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25440fcf80 0x7f25440fd3d0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:18.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:18.681+0000 7f2548f03640 1 --2- 172.21.15.77:0/2262761943 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25440fb810 0x7f25440fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:18.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:18.681+0000 7f2548f03640 1 -- 172.21.15.77:0/2262761943 >> 172.21.15.77:0/2262761943 conn(0x7f25440723b0 msgr2=0x7f25440727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:24:18.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:18.681+0000 7f2548f03640 1 -- 172.21.15.77:0/2262761943 shutdown_connections 2024-09-18T21:24:18.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:18.681+0000 7f2548f03640 1 -- 172.21.15.77:0/2262761943 wait complete. 2024-09-18T21:24:18.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:18.682+0000 7f2548f03640 1 Processor -- start 2024-09-18T21:24:18.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:18.682+0000 7f2548f03640 1 -- start start 2024-09-18T21:24:18.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:18.682+0000 7f2548f03640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25440fb810 0x7f25441131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:24:18.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:18.682+0000 7f2548f03640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25440fcf80 0x7f25441136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:24:18.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:18.682+0000 7f2548f03640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2544113cf0 con 0x7f25440fcf80 2024-09-18T21:24:18.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:18.682+0000 7f2548f03640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f254410d130 con 0x7f25440fb810 2024-09-18T21:24:18.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:18.682+0000 7f2541d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25440fcf80 0x7f25441136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:24:18.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:18.682+0000 7f2541d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25440fcf80 0x7f25441136f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49440/0 (socket says 172.21.15.77:49440) 2024-09-18T21:24:18.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:18.682+0000 7f2541d9b640 1 -- 172.21.15.77:0/3558583513 learned_addr learned my addr 172.21.15.77:0/3558583513 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:24:18.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:18.682+0000 7f254259c640 1 --2- 172.21.15.77:0/3558583513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25440fb810 0x7f25441131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:24:18.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:18.682+0000 7f2541d9b640 1 -- 172.21.15.77:0/3558583513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25440fb810 msgr2=0x7f25441131b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:18.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:18.682+0000 7f2541d9b640 1 --2- 172.21.15.77:0/3558583513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25440fb810 0x7f25441131b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:18.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:18.682+0000 7f2541d9b640 1 -- 172.21.15.77:0/3558583513 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f252c005040 con 0x7f25440fcf80 2024-09-18T21:24:18.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:18.682+0000 7f2541d9b640 1 --2- 172.21.15.77:0/3558583513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25440fcf80 0x7f25441136f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f252c0043d0 tx=0x7f252c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:24:18.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:18.683+0000 7f253affd640 1 -- 172.21.15.77:0/3558583513 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f252c038070 con 0x7f25440fcf80 2024-09-18T21:24:18.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:18.683+0000 7f253affd640 1 -- 172.21.15.77:0/3558583513 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f252c0096e0 con 0x7f25440fcf80 2024-09-18T21:24:18.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:18.683+0000 7f2548f03640 1 -- 172.21.15.77:0/3558583513 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f254410d3b0 con 0x7f25440fcf80 2024-09-18T21:24:18.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:18.683+0000 7f253affd640 1 -- 172.21.15.77:0/3558583513 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f252c03d420 con 0x7f25440fcf80 2024-09-18T21:24:18.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:18.683+0000 7f2548f03640 1 -- 172.21.15.77:0/3558583513 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f254410d950 con 0x7f25440fcf80 2024-09-18T21:24:18.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:18.684+0000 7f2548f03640 1 -- 172.21.15.77:0/3558583513 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25440fcbc0 con 0x7f25440fcf80 2024-09-18T21:24:18.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:18.684+0000 7f253affd640 1 -- 172.21.15.77:0/3558583513 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f252c030020 con 0x7f25440fcf80 2024-09-18T21:24:18.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:18.685+0000 7f253affd640 1 --2- 172.21.15.77:0/3558583513 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f253006e0b0 0x7f2530070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:24:18.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:18.685+0000 7f253affd640 1 -- 172.21.15.77:0/3558583513 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f252c0ae200 con 0x7f25440fcf80 2024-09-18T21:24:18.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:18.685+0000 7f254259c640 1 --2- 172.21.15.77:0/3558583513 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f253006e0b0 0x7f2530070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:24:18.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:18.686+0000 7f254259c640 1 --2- 172.21.15.77:0/3558583513 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f253006e0b0 0x7f2530070560 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2534007fd0 tx=0x7f2534009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:24:18.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:18.690+0000 7f253affd640 1 -- 172.21.15.77:0/3558583513 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f252c077480 con 0x7f25440fcf80 2024-09-18T21:24:18.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:18.889+0000 7f2548f03640 1 -- 172.21.15.77:0/3558583513 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7f254410e820 con 0x7f25440fcf80 2024-09-18T21:24:18.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:18.890+0000 7f253affd640 1 -- 172.21.15.77:0/3558583513 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v36) v1 ==== 107+0+4264 (secure 0 0 0) 0x7f252c07ab40 con 0x7f25440fcf80 2024-09-18T21:24:18.893 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:24:18.893 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":28,"btime":"2024-09-18T21:20:09:901653+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34400,"name":"cephfs.smithi077.vruydi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6827/1087320436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1087320436},{"type":"v1","addr":"172.21.15.77:6827","nonce":1087320436}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":34404,"name":"cephfs.smithi077.cqfhlw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6829/1489733233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1489733233},{"type":"v1","addr":"172.21.15.77:6829","nonce":1489733233}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T21:10:17.230179+0000","modified":"2024-09-18T21:20:09.648342+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24267":{"gid":24267,"name":"cephfs.smithi103.opftmf","rank":0,"incarnation":27,"state":"up:reconnect","state_seq":147,"addr":"172.21.15.103:6827/4241818403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":4241818403},{"type":"v1","addr":"172.21.15.103:6827","nonce":4241818403}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T21:24:18.894 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 28 2024-09-18T21:24:18.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:18.892+0000 7f2548f03640 1 -- 172.21.15.77:0/3558583513 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f253006e0b0 msgr2=0x7f2530070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:18.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:18.892+0000 7f2548f03640 1 --2- 172.21.15.77:0/3558583513 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f253006e0b0 0x7f2530070560 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2534007fd0 tx=0x7f2534009e90 comp rx=0 tx=0).stop 2024-09-18T21:24:18.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:18.892+0000 7f2548f03640 1 -- 172.21.15.77:0/3558583513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25440fcf80 msgr2=0x7f25441136f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:18.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:18.892+0000 7f2548f03640 1 --2- 172.21.15.77:0/3558583513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25440fcf80 0x7f25441136f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f252c0043d0 tx=0x7f252c009da0 comp rx=0 tx=0).stop 2024-09-18T21:24:18.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:18.892+0000 7f2548f03640 1 -- 172.21.15.77:0/3558583513 shutdown_connections 2024-09-18T21:24:18.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:18.892+0000 7f2548f03640 1 --2- 172.21.15.77:0/3558583513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f25440fcf80 0x7f25441136f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:18.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:18.892+0000 7f2548f03640 1 --2- 172.21.15.77:0/3558583513 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f253006e0b0 0x7f2530070560 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:18.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:18.892+0000 7f2548f03640 1 --2- 172.21.15.77:0/3558583513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25440fb810 0x7f25441131b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:18.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:18.892+0000 7f2548f03640 1 -- 172.21.15.77:0/3558583513 >> 172.21.15.77:0/3558583513 conn(0x7f25440723b0 msgr2=0x7f2544065810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:24:18.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:18.892+0000 7f2548f03640 1 -- 172.21.15.77:0/3558583513 shutdown_connections 2024-09-18T21:24:18.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:18.892+0000 7f2548f03640 1 -- 172.21.15.77:0/3558583513 wait complete. 2024-09-18T21:24:19.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:19 smithi077 ceph-mon[92672]: pgmap v313: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:19.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:19 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/3558583513' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-09-18T21:24:19.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:19 smithi103 ceph-mon[80307]: pgmap v313: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:19.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:19 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/3558583513' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-09-18T21:24:19.528 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 29 2024-09-18T21:24:19.770 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:24:20.162 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:20 smithi077 ceph-mon[92672]: pgmap v314: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:20.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:20 smithi103 ceph-mon[80307]: pgmap v314: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:21.206 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:21 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:24:21.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:21.420+0000 7f60f758d640 1 -- 172.21.15.77:0/1285615732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60f0102680 msgr2=0x7f60f0102a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:21.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:21.420+0000 7f60f758d640 1 --2- 172.21.15.77:0/1285615732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60f0102680 0x7f60f0102a50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f60ec0048d0 tx=0x7f60ec009da0 comp rx=0 tx=0).stop 2024-09-18T21:24:21.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:21.420+0000 7f60f758d640 1 -- 172.21.15.77:0/1285615732 shutdown_connections 2024-09-18T21:24:21.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:21.420+0000 7f60f758d640 1 --2- 172.21.15.77:0/1285615732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60f00fabd0 0x7f60f00fb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:21.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:21.420+0000 7f60f758d640 1 --2- 172.21.15.77:0/1285615732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60f0102680 0x7f60f0102a50 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:21.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:21.420+0000 7f60f758d640 1 -- 172.21.15.77:0/1285615732 >> 172.21.15.77:0/1285615732 conn(0x7f60f0071ac0 msgr2=0x7f60f0071ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:24:21.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:21.420+0000 7f60f758d640 1 -- 172.21.15.77:0/1285615732 shutdown_connections 2024-09-18T21:24:21.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:21.420+0000 7f60f758d640 1 -- 172.21.15.77:0/1285615732 wait complete. 2024-09-18T21:24:21.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:21.421+0000 7f60f758d640 1 Processor -- start 2024-09-18T21:24:21.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:21.421+0000 7f60f758d640 1 -- start start 2024-09-18T21:24:21.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:21.421+0000 7f60f758d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60f00fabd0 0x7f60f0113290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:24:21.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:21.421+0000 7f60f758d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60f0102680 0x7f60f01137d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:24:21.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:21.421+0000 7f60f758d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f0113dd0 con 0x7f60f0102680 2024-09-18T21:24:21.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:21.421+0000 7f60f758d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f010d210 con 0x7f60f00fabd0 2024-09-18T21:24:21.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:21.421+0000 7f60f4b28640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60f0102680 0x7f60f01137d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:24:21.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:21.421+0000 7f60f4b28640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60f0102680 0x7f60f01137d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42950/0 (socket says 172.21.15.77:42950) 2024-09-18T21:24:21.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:21.421+0000 7f60f4b28640 1 -- 172.21.15.77:0/4001259304 learned_addr learned my addr 172.21.15.77:0/4001259304 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:24:21.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:21.421+0000 7f60f5329640 1 --2- 172.21.15.77:0/4001259304 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60f00fabd0 0x7f60f0113290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:24:21.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:21.422+0000 7f60f4b28640 1 -- 172.21.15.77:0/4001259304 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60f00fabd0 msgr2=0x7f60f0113290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:21.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:21.422+0000 7f60f4b28640 1 --2- 172.21.15.77:0/4001259304 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60f00fabd0 0x7f60f0113290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:21.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:21.422+0000 7f60f4b28640 1 -- 172.21.15.77:0/4001259304 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ec005040 con 0x7f60f0102680 2024-09-18T21:24:21.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:21.422+0000 7f60f4b28640 1 --2- 172.21.15.77:0/4001259304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60f0102680 0x7f60f01137d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f60e0002a80 tx=0x7f60e0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:24:21.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:21.422+0000 7f60e5ffb640 1 -- 172.21.15.77:0/4001259304 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60e0007c30 con 0x7f60f0102680 2024-09-18T21:24:21.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:21.422+0000 7f60e5ffb640 1 -- 172.21.15.77:0/4001259304 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f60e000f040 con 0x7f60f0102680 2024-09-18T21:24:21.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:21.422+0000 7f60f758d640 1 -- 172.21.15.77:0/4001259304 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60f010d4f0 con 0x7f60f0102680 2024-09-18T21:24:21.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:21.422+0000 7f60e5ffb640 1 -- 172.21.15.77:0/4001259304 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60e000dab0 con 0x7f60f0102680 2024-09-18T21:24:21.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:21.422+0000 7f60f758d640 1 -- 172.21.15.77:0/4001259304 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f010da10 con 0x7f60f0102680 2024-09-18T21:24:21.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:21.423+0000 7f60f758d640 1 -- 172.21.15.77:0/4001259304 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60f00725d0 con 0x7f60f0102680 2024-09-18T21:24:21.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:21.424+0000 7f60e5ffb640 1 -- 172.21.15.77:0/4001259304 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f60e000dc10 con 0x7f60f0102680 2024-09-18T21:24:21.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:21.424+0000 7f60e5ffb640 1 --2- 172.21.15.77:0/4001259304 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f60dc06e0b0 0x7f60dc070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:24:21.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:21.424+0000 7f60e5ffb640 1 -- 172.21.15.77:0/4001259304 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f60e008d4c0 con 0x7f60f0102680 2024-09-18T21:24:21.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:21.424+0000 7f60f5329640 1 --2- 172.21.15.77:0/4001259304 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f60dc06e0b0 0x7f60dc070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:24:21.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:21.424+0000 7f60f5329640 1 --2- 172.21.15.77:0/4001259304 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f60dc06e0b0 0x7f60dc070560 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f60ec009ac0 tx=0x7f60ec035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:24:21.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:21.428+0000 7f60e5ffb640 1 -- 172.21.15.77:0/4001259304 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f60e00567f0 con 0x7f60f0102680 2024-09-18T21:24:21.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:21 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:24:21.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:21.631+0000 7f60f758d640 1 -- 172.21.15.77:0/4001259304 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7f60f0109610 con 0x7f60f0102680 2024-09-18T21:24:21.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:21.632+0000 7f60e5ffb640 1 -- 172.21.15.77:0/4001259304 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v36) v1 ==== 107+0+4261 (secure 0 0 0) 0x7f60e0059eb0 con 0x7f60f0102680 2024-09-18T21:24:21.633 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:24:21.633 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":29,"btime":"2024-09-18T21:20:10:908595+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34400,"name":"cephfs.smithi077.vruydi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6827/1087320436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1087320436},{"type":"v1","addr":"172.21.15.77:6827","nonce":1087320436}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":34404,"name":"cephfs.smithi077.cqfhlw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6829/1489733233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1489733233},{"type":"v1","addr":"172.21.15.77:6829","nonce":1489733233}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T21:10:17.230179+0000","modified":"2024-09-18T21:20:09.911052+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24267":{"gid":24267,"name":"cephfs.smithi103.opftmf","rank":0,"incarnation":27,"state":"up:rejoin","state_seq":148,"addr":"172.21.15.103:6827/4241818403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":4241818403},{"type":"v1","addr":"172.21.15.103:6827","nonce":4241818403}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T21:24:21.634 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 29 2024-09-18T21:24:21.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:21.634+0000 7f60f758d640 1 -- 172.21.15.77:0/4001259304 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f60dc06e0b0 msgr2=0x7f60dc070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:21.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:21.634+0000 7f60f758d640 1 --2- 172.21.15.77:0/4001259304 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f60dc06e0b0 0x7f60dc070560 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f60ec009ac0 tx=0x7f60ec035040 comp rx=0 tx=0).stop 2024-09-18T21:24:21.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:21.634+0000 7f60f758d640 1 -- 172.21.15.77:0/4001259304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60f0102680 msgr2=0x7f60f01137d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:21.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:21.634+0000 7f60f758d640 1 --2- 172.21.15.77:0/4001259304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60f0102680 0x7f60f01137d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f60e0002a80 tx=0x7f60e0004600 comp rx=0 tx=0).stop 2024-09-18T21:24:21.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:21.634+0000 7f60f758d640 1 -- 172.21.15.77:0/4001259304 shutdown_connections 2024-09-18T21:24:21.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:21.634+0000 7f60f758d640 1 --2- 172.21.15.77:0/4001259304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60f0102680 0x7f60f01137d0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:21.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:21.634+0000 7f60f758d640 1 --2- 172.21.15.77:0/4001259304 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f60dc06e0b0 0x7f60dc070560 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:21.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:21.634+0000 7f60f758d640 1 --2- 172.21.15.77:0/4001259304 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60f00fabd0 0x7f60f0113290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:21.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:21.634+0000 7f60f758d640 1 -- 172.21.15.77:0/4001259304 >> 172.21.15.77:0/4001259304 conn(0x7f60f0071ac0 msgr2=0x7f60f0105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:24:21.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:21.634+0000 7f60f758d640 1 -- 172.21.15.77:0/4001259304 shutdown_connections 2024-09-18T21:24:21.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:21.634+0000 7f60f758d640 1 -- 172.21.15.77:0/4001259304 wait complete. 2024-09-18T21:24:22.316 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:22 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/4001259304' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-09-18T21:24:22.316 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:22 smithi077 ceph-mon[92672]: pgmap v315: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:22.434 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 30 2024-09-18T21:24:22.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:22 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/4001259304' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-09-18T21:24:22.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:22 smithi103 ceph-mon[80307]: pgmap v315: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:22.680 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:24:24.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:24.211+0000 7fdeca0f8640 1 -- 172.21.15.77:0/1581637046 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdec41014e0 msgr2=0x7fdec41018b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:24.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:24.211+0000 7fdeca0f8640 1 --2- 172.21.15.77:0/1581637046 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdec41014e0 0x7fdec41018b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fdeb40048d0 tx=0x7fdeb4009da0 comp rx=0 tx=0).stop 2024-09-18T21:24:24.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:24.211+0000 7fdeca0f8640 1 -- 172.21.15.77:0/1581637046 shutdown_connections 2024-09-18T21:24:24.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:24.211+0000 7fdeca0f8640 1 --2- 172.21.15.77:0/1581637046 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdec40fb4a0 0x7fdec40fb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:24.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:24.211+0000 7fdeca0f8640 1 --2- 172.21.15.77:0/1581637046 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdec41014e0 0x7fdec41018b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:24.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:24.211+0000 7fdeca0f8640 1 -- 172.21.15.77:0/1581637046 >> 172.21.15.77:0/1581637046 conn(0x7fdec40f7060 msgr2=0x7fdec40f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:24:24.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:24.211+0000 7fdeca0f8640 1 -- 172.21.15.77:0/1581637046 shutdown_connections 2024-09-18T21:24:24.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:24.212+0000 7fdeca0f8640 1 -- 172.21.15.77:0/1581637046 wait complete. 2024-09-18T21:24:24.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:24.212+0000 7fdeca0f8640 1 Processor -- start 2024-09-18T21:24:24.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:24.212+0000 7fdeca0f8640 1 -- start start 2024-09-18T21:24:24.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:24.213+0000 7fdeca0f8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdec40fb4a0 0x7fdec40fd070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:24:24.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:24.213+0000 7fdeca0f8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdec41014e0 0x7fdec40fd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:24:24.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:24.213+0000 7fdeca0f8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec40fdaf0 con 0x7fdec41014e0 2024-09-18T21:24:24.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:24.213+0000 7fdeca0f8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec40fdc60 con 0x7fdec40fb4a0 2024-09-18T21:24:24.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:24.213+0000 7fdec2ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdec41014e0 0x7fdec40fd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:24:24.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:24.213+0000 7fdec2ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdec41014e0 0x7fdec40fd5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42968/0 (socket says 172.21.15.77:42968) 2024-09-18T21:24:24.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:24.213+0000 7fdec2ffd640 1 -- 172.21.15.77:0/2490986721 learned_addr learned my addr 172.21.15.77:0/2490986721 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:24:24.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:24.213+0000 7fdec37fe640 1 --2- 172.21.15.77:0/2490986721 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdec40fb4a0 0x7fdec40fd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:24:24.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:24.213+0000 7fdec2ffd640 1 -- 172.21.15.77:0/2490986721 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdec40fb4a0 msgr2=0x7fdec40fd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:24.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:24.213+0000 7fdec2ffd640 1 --2- 172.21.15.77:0/2490986721 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdec40fb4a0 0x7fdec40fd070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:24.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:24.213+0000 7fdec2ffd640 1 -- 172.21.15.77:0/2490986721 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb4005040 con 0x7fdec41014e0 2024-09-18T21:24:24.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:24.213+0000 7fdec2ffd640 1 --2- 172.21.15.77:0/2490986721 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdec41014e0 0x7fdec40fd5b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8002a50 tx=0x7fdeb8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:24:24.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:24.213+0000 7fdeabfff640 1 -- 172.21.15.77:0/2490986721 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdeb8007c30 con 0x7fdec41014e0 2024-09-18T21:24:24.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:24.213+0000 7fdeca0f8640 1 -- 172.21.15.77:0/2490986721 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdec40fdef0 con 0x7fdec41014e0 2024-09-18T21:24:24.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:24.213+0000 7fdeabfff640 1 -- 172.21.15.77:0/2490986721 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdeb800f040 con 0x7fdec41014e0 2024-09-18T21:24:24.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:24.213+0000 7fdeabfff640 1 -- 172.21.15.77:0/2490986721 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdeb800db50 con 0x7fdec41014e0 2024-09-18T21:24:24.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:24.213+0000 7fdeca0f8640 1 -- 172.21.15.77:0/2490986721 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdec41198c0 con 0x7fdec41014e0 2024-09-18T21:24:24.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:24.215+0000 7fdeca0f8640 1 -- 172.21.15.77:0/2490986721 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdec40fcbe0 con 0x7fdec41014e0 2024-09-18T21:24:24.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:24.215+0000 7fdeabfff640 1 -- 172.21.15.77:0/2490986721 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fdeb800dcb0 con 0x7fdec41014e0 2024-09-18T21:24:24.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:24.215+0000 7fdeabfff640 1 --2- 172.21.15.77:0/2490986721 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fdeac06e0b0 0x7fdeac070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:24:24.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:24.215+0000 7fdeabfff640 1 -- 172.21.15.77:0/2490986721 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fdeb808dbe0 con 0x7fdec41014e0 2024-09-18T21:24:24.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:24.215+0000 7fdec37fe640 1 --2- 172.21.15.77:0/2490986721 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fdeac06e0b0 0x7fdeac070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:24:24.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:24.216+0000 7fdec37fe640 1 --2- 172.21.15.77:0/2490986721 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fdeac06e0b0 0x7fdeac070560 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdeb4009ac0 tx=0x7fdeb4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:24:24.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:24.220+0000 7fdeabfff640 1 -- 172.21.15.77:0/2490986721 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fdeb8056e60 con 0x7fdec41014e0 2024-09-18T21:24:24.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:24.419+0000 7fdeca0f8640 1 -- 172.21.15.77:0/2490986721 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7fdec40fac60 con 0x7fdec41014e0 2024-09-18T21:24:24.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:24.419+0000 7fdeabfff640 1 -- 172.21.15.77:0/2490986721 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v36) v1 ==== 107+0+5120 (secure 0 0 0) 0x7fdeb805a520 con 0x7fdec41014e0 2024-09-18T21:24:24.421 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:24:24.421 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":30,"btime":"2024-09-18T21:20:11:918526+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34400,"name":"cephfs.smithi077.vruydi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6827/1087320436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1087320436},{"type":"v1","addr":"172.21.15.77:6827","nonce":1087320436}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":34404,"name":"cephfs.smithi077.cqfhlw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6829/1489733233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1489733233},{"type":"v1","addr":"172.21.15.77:6829","nonce":1489733233}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44287,"name":"cephfs.smithi103.zhdmdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6825/3296796313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3296796313},{"type":"v1","addr":"172.21.15.103:6825","nonce":3296796313}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T21:10:17.230179+0000","modified":"2024-09-18T21:20:11.918521+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24267":{"gid":24267,"name":"cephfs.smithi103.opftmf","rank":0,"incarnation":27,"state":"up:active","state_seq":149,"addr":"172.21.15.103:6827/4241818403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":4241818403},{"type":"v1","addr":"172.21.15.103:6827","nonce":4241818403}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24267,"qdb_cluster":[24267]},"id":1}]} 2024-09-18T21:24:24.421 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 30 2024-09-18T21:24:24.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:24.421+0000 7fdeca0f8640 1 -- 172.21.15.77:0/2490986721 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fdeac06e0b0 msgr2=0x7fdeac070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:24.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:24.421+0000 7fdeca0f8640 1 --2- 172.21.15.77:0/2490986721 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fdeac06e0b0 0x7fdeac070560 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdeb4009ac0 tx=0x7fdeb4035040 comp rx=0 tx=0).stop 2024-09-18T21:24:24.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:24.421+0000 7fdeca0f8640 1 -- 172.21.15.77:0/2490986721 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdec41014e0 msgr2=0x7fdec40fd5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:24.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:24.421+0000 7fdeca0f8640 1 --2- 172.21.15.77:0/2490986721 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdec41014e0 0x7fdec40fd5b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8002a50 tx=0x7fdeb8004600 comp rx=0 tx=0).stop 2024-09-18T21:24:24.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:24.422+0000 7fdeca0f8640 1 -- 172.21.15.77:0/2490986721 shutdown_connections 2024-09-18T21:24:24.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:24.422+0000 7fdeca0f8640 1 --2- 172.21.15.77:0/2490986721 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdec41014e0 0x7fdec40fd5b0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:24.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:24.422+0000 7fdeca0f8640 1 --2- 172.21.15.77:0/2490986721 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fdeac06e0b0 0x7fdeac070560 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:24.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:24.422+0000 7fdeca0f8640 1 --2- 172.21.15.77:0/2490986721 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdec40fb4a0 0x7fdec40fd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:24.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:24.422+0000 7fdeca0f8640 1 -- 172.21.15.77:0/2490986721 >> 172.21.15.77:0/2490986721 conn(0x7fdec40f7060 msgr2=0x7fdec4065a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:24:24.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:24.422+0000 7fdeca0f8640 1 -- 172.21.15.77:0/2490986721 shutdown_connections 2024-09-18T21:24:24.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:24.422+0000 7fdeca0f8640 1 -- 172.21.15.77:0/2490986721 wait complete. 2024-09-18T21:24:25.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:24 smithi077 ceph-mon[92672]: pgmap v316: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:25.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:24 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/2490986721' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-09-18T21:24:25.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:24 smithi103 ceph-mon[80307]: pgmap v316: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:25.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:24 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/2490986721' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-09-18T21:24:25.341 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 31 2024-09-18T21:24:25.602 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:24:27.079 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:26 smithi077 ceph-mon[92672]: pgmap v317: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:27.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:26 smithi103 ceph-mon[80307]: pgmap v317: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:27.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:27.325+0000 7fb86acbf640 1 -- 172.21.15.77:0/1066775967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb864102f00 msgr2=0x7fb8640fc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:27.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:27.325+0000 7fb86acbf640 1 --2- 172.21.15.77:0/1066775967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb864102f00 0x7fb8640fc5c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb8500048d0 tx=0x7fb850009da0 comp rx=0 tx=0).stop 2024-09-18T21:24:27.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:27.325+0000 7fb86acbf640 1 -- 172.21.15.77:0/1066775967 shutdown_connections 2024-09-18T21:24:27.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:27.325+0000 7fb86acbf640 1 --2- 172.21.15.77:0/1066775967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb864102f00 0x7fb8640fc5c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:27.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:27.325+0000 7fb86acbf640 1 --2- 172.21.15.77:0/1066775967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb864102560 0x7fb864102930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:27.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:27.325+0000 7fb86acbf640 1 -- 172.21.15.77:0/1066775967 >> 172.21.15.77:0/1066775967 conn(0x7fb8640f8120 msgr2=0x7fb8640fa530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:24:27.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:27.326+0000 7fb86acbf640 1 -- 172.21.15.77:0/1066775967 shutdown_connections 2024-09-18T21:24:27.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:27.326+0000 7fb86acbf640 1 -- 172.21.15.77:0/1066775967 wait complete. 2024-09-18T21:24:27.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:27.326+0000 7fb86acbf640 1 Processor -- start 2024-09-18T21:24:27.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:27.326+0000 7fb86acbf640 1 -- start start 2024-09-18T21:24:27.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:27.326+0000 7fb86acbf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb864102560 0x7fb8641131e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:24:27.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:27.326+0000 7fb86acbf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb864102f00 0x7fb864113720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:24:27.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:27.326+0000 7fb86acbf640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb864113d20 con 0x7fb864102560 2024-09-18T21:24:27.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:27.326+0000 7fb86acbf640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86410d160 con 0x7fb864102f00 2024-09-18T21:24:27.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:27.327+0000 7fb868a5b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb864102560 0x7fb8641131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:24:27.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:27.327+0000 7fb868a5b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb864102560 0x7fb8641131e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42986/0 (socket says 172.21.15.77:42986) 2024-09-18T21:24:27.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:27.327+0000 7fb868a5b640 1 -- 172.21.15.77:0/1452726795 learned_addr learned my addr 172.21.15.77:0/1452726795 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:24:27.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:27.327+0000 7fb868a5b640 1 -- 172.21.15.77:0/1452726795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb864102f00 msgr2=0x7fb864113720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:27.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:27.327+0000 7fb863fff640 1 --2- 172.21.15.77:0/1452726795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb864102f00 0x7fb864113720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:24:27.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:27.327+0000 7fb868a5b640 1 --2- 172.21.15.77:0/1452726795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb864102f00 0x7fb864113720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:27.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:27.327+0000 7fb868a5b640 1 -- 172.21.15.77:0/1452726795 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb850005040 con 0x7fb864102560 2024-09-18T21:24:27.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:27.327+0000 7fb868a5b640 1 --2- 172.21.15.77:0/1452726795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb864102560 0x7fb8641131e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb85800c810 tx=0x7fb8580043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:24:27.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:27.327+0000 7fb8617fa640 1 -- 172.21.15.77:0/1452726795 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb85800a820 con 0x7fb864102560 2024-09-18T21:24:27.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:27.327+0000 7fb8617fa640 1 -- 172.21.15.77:0/1452726795 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb85800ae20 con 0x7fb864102560 2024-09-18T21:24:27.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:27.327+0000 7fb86acbf640 1 -- 172.21.15.77:0/1452726795 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb86410d440 con 0x7fb864102560 2024-09-18T21:24:27.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:27.327+0000 7fb8617fa640 1 -- 172.21.15.77:0/1452726795 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8580115c0 con 0x7fb864102560 2024-09-18T21:24:27.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:27.327+0000 7fb86acbf640 1 -- 172.21.15.77:0/1452726795 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb86410d9e0 con 0x7fb864102560 2024-09-18T21:24:27.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:27.328+0000 7fb86acbf640 1 -- 172.21.15.77:0/1452726795 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8640fdce0 con 0x7fb864102560 2024-09-18T21:24:27.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:27.329+0000 7fb8617fa640 1 -- 172.21.15.77:0/1452726795 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fb858012840 con 0x7fb864102560 2024-09-18T21:24:27.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:27.329+0000 7fb8617fa640 1 --2- 172.21.15.77:0/1452726795 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fb85406e0b0 0x7fb854070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:24:27.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:27.329+0000 7fb8617fa640 1 -- 172.21.15.77:0/1452726795 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fb85808e180 con 0x7fb864102560 2024-09-18T21:24:27.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:27.329+0000 7fb863fff640 1 --2- 172.21.15.77:0/1452726795 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fb85406e0b0 0x7fb854070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:24:27.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:27.330+0000 7fb863fff640 1 --2- 172.21.15.77:0/1452726795 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fb85406e0b0 0x7fb854070560 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb86410eaa0 tx=0x7fb850009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:24:27.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:27.335+0000 7fb8617fa640 1 -- 172.21.15.77:0/1452726795 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fb85805afb0 con 0x7fb864102560 2024-09-18T21:24:27.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:27.531+0000 7fb86acbf640 1 -- 172.21.15.77:0/1452726795 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7fb86404b720 con 0x7fb864102560 2024-09-18T21:24:27.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:27.532+0000 7fb8617fa640 1 -- 172.21.15.77:0/1452726795 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v36) v1 ==== 107+0+4316 (secure 0 0 0) 0x7fb85805ab40 con 0x7fb864102560 2024-09-18T21:24:27.534 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:24:27.535 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":31,"btime":"2024-09-18T21:20:23:252807+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34400,"name":"cephfs.smithi077.vruydi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6827/1087320436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1087320436},{"type":"v1","addr":"172.21.15.77:6827","nonce":1087320436}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":34404,"name":"cephfs.smithi077.cqfhlw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6829/1489733233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1489733233},{"type":"v1","addr":"172.21.15.77:6829","nonce":1489733233}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44287,"name":"cephfs.smithi103.zhdmdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6825/3296796313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3296796313},{"type":"v1","addr":"172.21.15.103:6825","nonce":3296796313}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T21:10:17.230179+0000","modified":"2024-09-18T21:20:23.252804+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T21:24:27.535 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 31 2024-09-18T21:24:27.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:27.534+0000 7fb86acbf640 1 -- 172.21.15.77:0/1452726795 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fb85406e0b0 msgr2=0x7fb854070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:27.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:27.534+0000 7fb86acbf640 1 --2- 172.21.15.77:0/1452726795 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fb85406e0b0 0x7fb854070560 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb86410eaa0 tx=0x7fb850009da0 comp rx=0 tx=0).stop 2024-09-18T21:24:27.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:27.534+0000 7fb86acbf640 1 -- 172.21.15.77:0/1452726795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb864102560 msgr2=0x7fb8641131e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:27.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:27.534+0000 7fb86acbf640 1 --2- 172.21.15.77:0/1452726795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb864102560 0x7fb8641131e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb85800c810 tx=0x7fb8580043c0 comp rx=0 tx=0).stop 2024-09-18T21:24:27.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:27.534+0000 7fb86acbf640 1 -- 172.21.15.77:0/1452726795 shutdown_connections 2024-09-18T21:24:27.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:27.534+0000 7fb86acbf640 1 --2- 172.21.15.77:0/1452726795 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fb85406e0b0 0x7fb854070560 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:27.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:27.534+0000 7fb86acbf640 1 --2- 172.21.15.77:0/1452726795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb864102f00 0x7fb864113720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:27.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:27.534+0000 7fb86acbf640 1 --2- 172.21.15.77:0/1452726795 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb864102560 0x7fb8641131e0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:27.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:27.534+0000 7fb86acbf640 1 -- 172.21.15.77:0/1452726795 >> 172.21.15.77:0/1452726795 conn(0x7fb8640f8120 msgr2=0x7fb8640f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:24:27.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:27.534+0000 7fb86acbf640 1 -- 172.21.15.77:0/1452726795 shutdown_connections 2024-09-18T21:24:27.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:27.534+0000 7fb86acbf640 1 -- 172.21.15.77:0/1452726795 wait complete. 2024-09-18T21:24:28.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:27 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/1452726795' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-09-18T21:24:28.232 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 32 2024-09-18T21:24:28.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:27 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/1452726795' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-09-18T21:24:28.483 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:24:29.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:28 smithi077 ceph-mon[92672]: pgmap v318: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:29.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:28 smithi103 ceph-mon[80307]: pgmap v318: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:30.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:30.216+0000 7fd058aa9640 1 -- 172.21.15.77:0/2956282177 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0540fb810 msgr2=0x7fd0540fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:30.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:30.216+0000 7fd058aa9640 1 --2- 172.21.15.77:0/2956282177 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0540fb810 0x7fd0540fbbe0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd044009c50 tx=0x7fd044004d10 comp rx=0 tx=0).stop 2024-09-18T21:24:30.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:30.216+0000 7fd058aa9640 1 -- 172.21.15.77:0/2956282177 shutdown_connections 2024-09-18T21:24:30.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:30.216+0000 7fd058aa9640 1 --2- 172.21.15.77:0/2956282177 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0540fcf80 0x7fd0540fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:30.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:30.216+0000 7fd058aa9640 1 --2- 172.21.15.77:0/2956282177 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0540fb810 0x7fd0540fbbe0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:30.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:30.216+0000 7fd058aa9640 1 -- 172.21.15.77:0/2956282177 >> 172.21.15.77:0/2956282177 conn(0x7fd0540723b0 msgr2=0x7fd0540727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:24:30.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:30.216+0000 7fd058aa9640 1 -- 172.21.15.77:0/2956282177 shutdown_connections 2024-09-18T21:24:30.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:30.216+0000 7fd058aa9640 1 -- 172.21.15.77:0/2956282177 wait complete. 2024-09-18T21:24:30.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:30.216+0000 7fd058aa9640 1 Processor -- start 2024-09-18T21:24:30.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:30.216+0000 7fd058aa9640 1 -- start start 2024-09-18T21:24:30.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:30.216+0000 7fd058aa9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0540fb810 0x7fd0541120f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:24:30.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:30.216+0000 7fd058aa9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0540fcf80 0x7fd054112630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:24:30.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:30.216+0000 7fd058aa9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd054112c30 con 0x7fd0540fb810 2024-09-18T21:24:30.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:30.216+0000 7fd058aa9640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd05410c070 con 0x7fd0540fcf80 2024-09-18T21:24:30.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:30.217+0000 7fd05259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0540fb810 0x7fd0541120f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:24:30.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:30.217+0000 7fd05259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0540fb810 0x7fd0541120f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39330/0 (socket says 172.21.15.77:39330) 2024-09-18T21:24:30.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:30.217+0000 7fd05259c640 1 -- 172.21.15.77:0/1159342042 learned_addr learned my addr 172.21.15.77:0/1159342042 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:24:30.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:30.217+0000 7fd051d9b640 1 --2- 172.21.15.77:0/1159342042 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0540fcf80 0x7fd054112630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:24:30.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:30.217+0000 7fd05259c640 1 -- 172.21.15.77:0/1159342042 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0540fcf80 msgr2=0x7fd054112630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:30.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:30.217+0000 7fd05259c640 1 --2- 172.21.15.77:0/1159342042 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0540fcf80 0x7fd054112630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:30.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:30.217+0000 7fd05259c640 1 -- 172.21.15.77:0/1159342042 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0440098b0 con 0x7fd0540fb810 2024-09-18T21:24:30.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:30.217+0000 7fd05259c640 1 --2- 172.21.15.77:0/1159342042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0540fb810 0x7fd0541120f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd044004750 tx=0x7fd044004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:24:30.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:30.217+0000 7fd04affd640 1 -- 172.21.15.77:0/1159342042 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd044009610 con 0x7fd0540fb810 2024-09-18T21:24:30.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:30.217+0000 7fd04affd640 1 -- 172.21.15.77:0/1159342042 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd044032b10 con 0x7fd0540fb810 2024-09-18T21:24:30.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:30.217+0000 7fd058aa9640 1 -- 172.21.15.77:0/1159342042 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd05410c2f0 con 0x7fd0540fb810 2024-09-18T21:24:30.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:30.217+0000 7fd04affd640 1 -- 172.21.15.77:0/1159342042 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd04403d990 con 0x7fd0540fb810 2024-09-18T21:24:30.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:30.217+0000 7fd058aa9640 1 -- 172.21.15.77:0/1159342042 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd05410c890 con 0x7fd0540fb810 2024-09-18T21:24:30.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:30.218+0000 7fd058aa9640 1 -- 172.21.15.77:0/1159342042 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0540fcbc0 con 0x7fd0540fb810 2024-09-18T21:24:30.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:30.219+0000 7fd04affd640 1 -- 172.21.15.77:0/1159342042 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd04402f030 con 0x7fd0540fb810 2024-09-18T21:24:30.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:30.219+0000 7fd04affd640 1 --2- 172.21.15.77:0/1159342042 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fd04006e0b0 0x7fd040070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:24:30.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:30.220+0000 7fd04affd640 1 -- 172.21.15.77:0/1159342042 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7fd0440aecf0 con 0x7fd0540fb810 2024-09-18T21:24:30.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:30.219+0000 7fd051d9b640 1 --2- 172.21.15.77:0/1159342042 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fd04006e0b0 0x7fd040070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:24:30.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:30.220+0000 7fd051d9b640 1 --2- 172.21.15.77:0/1159342042 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fd04006e0b0 0x7fd040070560 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd03c007fd0 tx=0x7fd03c009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:24:30.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:30.224+0000 7fd04affd640 1 -- 172.21.15.77:0/1159342042 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fd044077ff0 con 0x7fd0540fb810 2024-09-18T21:24:30.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:30.425+0000 7fd058aa9640 1 -- 172.21.15.77:0/1159342042 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7fd05404b720 con 0x7fd0540fb810 2024-09-18T21:24:30.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:30.425+0000 7fd04affd640 1 -- 172.21.15.77:0/1159342042 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v36) v1 ==== 107+0+4395 (secure 0 0 0) 0x7fd04407b6b0 con 0x7fd0540fb810 2024-09-18T21:24:30.427 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:24:30.427 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":32,"btime":"2024-09-18T21:20:23:257856+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi077.cqfhlw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6829/1489733233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1489733233},{"type":"v1","addr":"172.21.15.77:6829","nonce":1489733233}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44287,"name":"cephfs.smithi103.zhdmdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6825/3296796313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3296796313},{"type":"v1","addr":"172.21.15.103:6825","nonce":3296796313}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T21:10:17.230179+0000","modified":"2024-09-18T21:20:23.257845+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34400},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34400":{"gid":34400,"name":"cephfs.smithi077.vruydi","rank":0,"incarnation":32,"state":"up:replay","state_seq":1,"addr":"172.21.15.77:6827/1087320436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1087320436},{"type":"v1","addr":"172.21.15.77:6827","nonce":1087320436}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T21:24:30.428 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 32 2024-09-18T21:24:30.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:30.427+0000 7fd058aa9640 1 -- 172.21.15.77:0/1159342042 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fd04006e0b0 msgr2=0x7fd040070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:30.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:30.427+0000 7fd058aa9640 1 --2- 172.21.15.77:0/1159342042 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fd04006e0b0 0x7fd040070560 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd03c007fd0 tx=0x7fd03c009e90 comp rx=0 tx=0).stop 2024-09-18T21:24:30.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:30.427+0000 7fd058aa9640 1 -- 172.21.15.77:0/1159342042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0540fb810 msgr2=0x7fd0541120f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:30.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:30.427+0000 7fd058aa9640 1 --2- 172.21.15.77:0/1159342042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0540fb810 0x7fd0541120f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd044004750 tx=0x7fd044004d10 comp rx=0 tx=0).stop 2024-09-18T21:24:30.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:30.427+0000 7fd058aa9640 1 -- 172.21.15.77:0/1159342042 shutdown_connections 2024-09-18T21:24:30.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:30.427+0000 7fd058aa9640 1 --2- 172.21.15.77:0/1159342042 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7fd04006e0b0 0x7fd040070560 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:30.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:30.427+0000 7fd058aa9640 1 --2- 172.21.15.77:0/1159342042 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0540fcf80 0x7fd054112630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:30.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:30.427+0000 7fd058aa9640 1 --2- 172.21.15.77:0/1159342042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0540fb810 0x7fd0541120f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:30.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:30.427+0000 7fd058aa9640 1 -- 172.21.15.77:0/1159342042 >> 172.21.15.77:0/1159342042 conn(0x7fd0540723b0 msgr2=0x7fd0540fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:24:30.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:30.428+0000 7fd058aa9640 1 -- 172.21.15.77:0/1159342042 shutdown_connections 2024-09-18T21:24:30.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:30.428+0000 7fd058aa9640 1 -- 172.21.15.77:0/1159342042 wait complete. 2024-09-18T21:24:31.036 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:30 smithi077 ceph-mon[92672]: pgmap v319: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:31.036 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:30 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/1159342042' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-09-18T21:24:31.059 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 33 2024-09-18T21:24:31.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:30 smithi103 ceph-mon[80307]: pgmap v319: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:31.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:30 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/1159342042' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-09-18T21:24:31.304 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:24:33.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:32.990+0000 7f3d70153640 1 -- 172.21.15.77:0/1325320505 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d680fb810 msgr2=0x7f3d680fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:33.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:32.990+0000 7f3d70153640 1 --2- 172.21.15.77:0/1325320505 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d680fb810 0x7f3d680fbbe0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3d640048d0 tx=0x7f3d64009da0 comp rx=0 tx=0).stop 2024-09-18T21:24:33.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:32.990+0000 7f3d70153640 1 -- 172.21.15.77:0/1325320505 shutdown_connections 2024-09-18T21:24:33.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:32.990+0000 7f3d70153640 1 --2- 172.21.15.77:0/1325320505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d680fcf80 0x7f3d680fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:33.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:32.990+0000 7f3d70153640 1 --2- 172.21.15.77:0/1325320505 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d680fb810 0x7f3d680fbbe0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:33.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:32.990+0000 7f3d70153640 1 -- 172.21.15.77:0/1325320505 >> 172.21.15.77:0/1325320505 conn(0x7f3d680723b0 msgr2=0x7f3d680727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:24:33.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:32.990+0000 7f3d70153640 1 -- 172.21.15.77:0/1325320505 shutdown_connections 2024-09-18T21:24:33.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:32.990+0000 7f3d70153640 1 -- 172.21.15.77:0/1325320505 wait complete. 2024-09-18T21:24:33.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:32.990+0000 7f3d70153640 1 Processor -- start 2024-09-18T21:24:33.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:32.990+0000 7f3d70153640 1 -- start start 2024-09-18T21:24:33.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:32.991+0000 7f3d70153640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d680fb810 0x7f3d681120f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:24:33.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:32.991+0000 7f3d70153640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d680fcf80 0x7f3d68112630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:24:33.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:32.991+0000 7f3d70153640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d68112c30 con 0x7f3d680fcf80 2024-09-18T21:24:33.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:32.991+0000 7f3d70153640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6810c070 con 0x7f3d680fb810 2024-09-18T21:24:33.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:32.991+0000 7f3d6d6ee640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d680fcf80 0x7f3d68112630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:24:33.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:32.991+0000 7f3d6d6ee640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d680fcf80 0x7f3d68112630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39350/0 (socket says 172.21.15.77:39350) 2024-09-18T21:24:33.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:32.991+0000 7f3d6d6ee640 1 -- 172.21.15.77:0/841300873 learned_addr learned my addr 172.21.15.77:0/841300873 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:24:33.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:32.991+0000 7f3d6deef640 1 --2- 172.21.15.77:0/841300873 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d680fb810 0x7f3d681120f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:24:33.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:32.991+0000 7f3d6d6ee640 1 -- 172.21.15.77:0/841300873 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d680fb810 msgr2=0x7f3d681120f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:33.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:32.991+0000 7f3d6d6ee640 1 --2- 172.21.15.77:0/841300873 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d680fb810 0x7f3d681120f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:33.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:32.991+0000 7f3d6d6ee640 1 -- 172.21.15.77:0/841300873 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d64005040 con 0x7f3d680fcf80 2024-09-18T21:24:33.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:32.991+0000 7f3d6d6ee640 1 --2- 172.21.15.77:0/841300873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d680fcf80 0x7f3d68112630 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3d58002a50 tx=0x7f3d58004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:24:33.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:32.991+0000 7f3d5e7fc640 1 -- 172.21.15.77:0/841300873 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d58007c30 con 0x7f3d680fcf80 2024-09-18T21:24:33.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:32.991+0000 7f3d5e7fc640 1 -- 172.21.15.77:0/841300873 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3d5800f040 con 0x7f3d680fcf80 2024-09-18T21:24:33.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:32.991+0000 7f3d70153640 1 -- 172.21.15.77:0/841300873 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d6810c350 con 0x7f3d680fcf80 2024-09-18T21:24:33.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:32.991+0000 7f3d5e7fc640 1 -- 172.21.15.77:0/841300873 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d5800da90 con 0x7f3d680fcf80 2024-09-18T21:24:33.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:32.991+0000 7f3d70153640 1 -- 172.21.15.77:0/841300873 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d6810c8f0 con 0x7f3d680fcf80 2024-09-18T21:24:33.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:32.992+0000 7f3d70153640 1 -- 172.21.15.77:0/841300873 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d680fcbc0 con 0x7f3d680fcf80 2024-09-18T21:24:33.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:32.993+0000 7f3d5e7fc640 1 -- 172.21.15.77:0/841300873 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f3d5800dd00 con 0x7f3d680fcf80 2024-09-18T21:24:33.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:32.993+0000 7f3d5e7fc640 1 --2- 172.21.15.77:0/841300873 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f3d5406e0b0 0x7f3d54070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:24:33.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:32.994+0000 7f3d5e7fc640 1 -- 172.21.15.77:0/841300873 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f3d5808d540 con 0x7f3d680fcf80 2024-09-18T21:24:33.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:32.994+0000 7f3d6deef640 1 --2- 172.21.15.77:0/841300873 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f3d5406e0b0 0x7f3d54070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:24:33.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:32.994+0000 7f3d6deef640 1 --2- 172.21.15.77:0/841300873 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f3d5406e0b0 0x7f3d54070560 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3d64009ac0 tx=0x7f3d64035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:24:33.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:32.998+0000 7f3d5e7fc640 1 -- 172.21.15.77:0/841300873 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f3d580567c0 con 0x7f3d680fcf80 2024-09-18T21:24:33.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:33.201+0000 7f3d70153640 1 -- 172.21.15.77:0/841300873 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7f3d6810d790 con 0x7f3d680fcf80 2024-09-18T21:24:33.204 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:32 smithi077 ceph-mon[92672]: pgmap v320: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:33.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:33.202+0000 7f3d5e7fc640 1 -- 172.21.15.77:0/841300873 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v36) v1 ==== 107+0+4399 (secure 0 0 0) 0x7f3d58059e80 con 0x7f3d680fcf80 2024-09-18T21:24:33.204 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:24:33.205 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":33,"btime":"2024-09-18T21:20:31:047708+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi077.cqfhlw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6829/1489733233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1489733233},{"type":"v1","addr":"172.21.15.77:6829","nonce":1489733233}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44287,"name":"cephfs.smithi103.zhdmdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6825/3296796313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3296796313},{"type":"v1","addr":"172.21.15.103:6825","nonce":3296796313}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T21:10:17.230179+0000","modified":"2024-09-18T21:20:30.552070+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34400},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34400":{"gid":34400,"name":"cephfs.smithi077.vruydi","rank":0,"incarnation":32,"state":"up:reconnect","state_seq":17,"addr":"172.21.15.77:6827/1087320436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1087320436},{"type":"v1","addr":"172.21.15.77:6827","nonce":1087320436}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T21:24:33.205 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 33 2024-09-18T21:24:33.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:33.204+0000 7f3d70153640 1 -- 172.21.15.77:0/841300873 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f3d5406e0b0 msgr2=0x7f3d54070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:33.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:33.204+0000 7f3d70153640 1 --2- 172.21.15.77:0/841300873 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f3d5406e0b0 0x7f3d54070560 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3d64009ac0 tx=0x7f3d64035040 comp rx=0 tx=0).stop 2024-09-18T21:24:33.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:33.204+0000 7f3d70153640 1 -- 172.21.15.77:0/841300873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d680fcf80 msgr2=0x7f3d68112630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:33.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:33.204+0000 7f3d70153640 1 --2- 172.21.15.77:0/841300873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d680fcf80 0x7f3d68112630 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3d58002a50 tx=0x7f3d58004600 comp rx=0 tx=0).stop 2024-09-18T21:24:33.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:33.204+0000 7f3d70153640 1 -- 172.21.15.77:0/841300873 shutdown_connections 2024-09-18T21:24:33.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:33.204+0000 7f3d70153640 1 --2- 172.21.15.77:0/841300873 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d680fcf80 0x7f3d68112630 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:33.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:33.204+0000 7f3d70153640 1 --2- 172.21.15.77:0/841300873 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f3d5406e0b0 0x7f3d54070560 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:33.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:33.204+0000 7f3d70153640 1 --2- 172.21.15.77:0/841300873 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3d680fb810 0x7f3d681120f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:33.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:33.204+0000 7f3d70153640 1 -- 172.21.15.77:0/841300873 >> 172.21.15.77:0/841300873 conn(0x7f3d680723b0 msgr2=0x7f3d680fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:24:33.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:33.204+0000 7f3d70153640 1 -- 172.21.15.77:0/841300873 shutdown_connections 2024-09-18T21:24:33.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:33.204+0000 7f3d70153640 1 -- 172.21.15.77:0/841300873 wait complete. 2024-09-18T21:24:33.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:32 smithi103 ceph-mon[80307]: pgmap v320: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:33.867 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 34 2024-09-18T21:24:34.114 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:24:34.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:33 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/841300873' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-09-18T21:24:34.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:33 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/841300873' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-09-18T21:24:35.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:34 smithi077 ceph-mon[92672]: pgmap v321: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:35.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:34 smithi103 ceph-mon[80307]: pgmap v321: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:35.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:35.896+0000 7f9a17468640 1 -- 172.21.15.77:0/135437772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a10102ed0 msgr2=0x7f9a100fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:35.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:35.896+0000 7f9a17468640 1 --2- 172.21.15.77:0/135437772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a10102ed0 0x7f9a100fc590 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9a000048d0 tx=0x7f9a00009da0 comp rx=0 tx=0).stop 2024-09-18T21:24:35.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:35.896+0000 7f9a17468640 1 -- 172.21.15.77:0/135437772 shutdown_connections 2024-09-18T21:24:35.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:35.896+0000 7f9a17468640 1 --2- 172.21.15.77:0/135437772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a10102ed0 0x7f9a100fc590 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:35.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:35.896+0000 7f9a17468640 1 --2- 172.21.15.77:0/135437772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a10102530 0x7f9a10102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:35.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:35.896+0000 7f9a17468640 1 -- 172.21.15.77:0/135437772 >> 172.21.15.77:0/135437772 conn(0x7f9a100f80f0 msgr2=0x7f9a100fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:24:35.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:35.896+0000 7f9a17468640 1 -- 172.21.15.77:0/135437772 shutdown_connections 2024-09-18T21:24:35.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:35.896+0000 7f9a17468640 1 -- 172.21.15.77:0/135437772 wait complete. 2024-09-18T21:24:35.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:35.897+0000 7f9a17468640 1 Processor -- start 2024-09-18T21:24:35.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:35.897+0000 7f9a17468640 1 -- start start 2024-09-18T21:24:35.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:35.897+0000 7f9a17468640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a10102530 0x7f9a101131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:24:35.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:35.897+0000 7f9a17468640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a10102ed0 0x7f9a10113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:24:35.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:35.897+0000 7f9a17468640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a10113d10 con 0x7f9a10102ed0 2024-09-18T21:24:35.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:35.897+0000 7f9a17468640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1010d150 con 0x7f9a10102530 2024-09-18T21:24:35.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:35.897+0000 7f9a14a03640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a10102ed0 0x7f9a10113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:24:35.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:35.897+0000 7f9a14a03640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a10102ed0 0x7f9a10113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39376/0 (socket says 172.21.15.77:39376) 2024-09-18T21:24:35.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:35.897+0000 7f9a14a03640 1 -- 172.21.15.77:0/3899412661 learned_addr learned my addr 172.21.15.77:0/3899412661 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:24:35.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:35.897+0000 7f9a15204640 1 --2- 172.21.15.77:0/3899412661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a10102530 0x7f9a101131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:24:35.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:35.897+0000 7f9a14a03640 1 -- 172.21.15.77:0/3899412661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a10102530 msgr2=0x7f9a101131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:35.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:35.897+0000 7f9a14a03640 1 --2- 172.21.15.77:0/3899412661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a10102530 0x7f9a101131d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:35.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:35.897+0000 7f9a14a03640 1 -- 172.21.15.77:0/3899412661 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a00005040 con 0x7f9a10102ed0 2024-09-18T21:24:35.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:35.898+0000 7f9a14a03640 1 --2- 172.21.15.77:0/3899412661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a10102ed0 0x7f9a10113710 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9a000043d0 tx=0x7f9a00009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:24:35.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:35.898+0000 7f9a05ffb640 1 -- 172.21.15.77:0/3899412661 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a00038070 con 0x7f9a10102ed0 2024-09-18T21:24:35.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:35.898+0000 7f9a05ffb640 1 -- 172.21.15.77:0/3899412661 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9a000096e0 con 0x7f9a10102ed0 2024-09-18T21:24:35.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:35.898+0000 7f9a05ffb640 1 -- 172.21.15.77:0/3899412661 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a0002c8a0 con 0x7f9a10102ed0 2024-09-18T21:24:35.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:35.898+0000 7f9a17468640 1 -- 172.21.15.77:0/3899412661 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a1010d3d0 con 0x7f9a10102ed0 2024-09-18T21:24:35.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:35.898+0000 7f9a17468640 1 -- 172.21.15.77:0/3899412661 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a1010d910 con 0x7f9a10102ed0 2024-09-18T21:24:35.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:35.899+0000 7f9a17468640 1 -- 172.21.15.77:0/3899412661 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a100fdcb0 con 0x7f9a10102ed0 2024-09-18T21:24:35.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:35.899+0000 7f9a05ffb640 1 -- 172.21.15.77:0/3899412661 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9a00030020 con 0x7f9a10102ed0 2024-09-18T21:24:35.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:35.900+0000 7f9a05ffb640 1 --2- 172.21.15.77:0/3899412661 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f99fc06e0b0 0x7f99fc070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:24:35.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:35.900+0000 7f9a05ffb640 1 -- 172.21.15.77:0/3899412661 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f9a000ad9e0 con 0x7f9a10102ed0 2024-09-18T21:24:35.923 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:35.900+0000 7f9a15204640 1 --2- 172.21.15.77:0/3899412661 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f99fc06e0b0 0x7f99fc070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:24:35.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:35.900+0000 7f9a15204640 1 --2- 172.21.15.77:0/3899412661 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f99fc06e0b0 0x7f99fc070560 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c009fd0 tx=0x7f9a0c009e50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:24:35.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:35.904+0000 7f9a05ffb640 1 -- 172.21.15.77:0/3899412661 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f9a00076c60 con 0x7f9a10102ed0 2024-09-18T21:24:36.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:36.111+0000 7f9a17468640 1 -- 172.21.15.77:0/3899412661 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7f9a10109540 con 0x7f9a10102ed0 2024-09-18T21:24:36.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:36.111+0000 7f9a05ffb640 1 -- 172.21.15.77:0/3899412661 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v36) v1 ==== 107+0+4396 (secure 0 0 0) 0x7f9a0007a320 con 0x7f9a10102ed0 2024-09-18T21:24:36.113 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-18T21:24:36.113 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":34,"btime":"2024-09-18T21:20:32:054937+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34404,"name":"cephfs.smithi077.cqfhlw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6829/1489733233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1489733233},{"type":"v1","addr":"172.21.15.77:6829","nonce":1489733233}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44287,"name":"cephfs.smithi103.zhdmdg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6825/3296796313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3296796313},{"type":"v1","addr":"172.21.15.103:6825","nonce":3296796313}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-18T21:10:17.230179+0000","modified":"2024-09-18T21:20:31.056676+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34400},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34400":{"gid":34400,"name":"cephfs.smithi077.vruydi","rank":0,"incarnation":32,"state":"up:rejoin","state_seq":18,"addr":"172.21.15.77:6827/1087320436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1087320436},{"type":"v1","addr":"172.21.15.77:6827","nonce":1087320436}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-18T21:24:36.114 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 34 2024-09-18T21:24:36.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:36.113+0000 7f9a17468640 1 -- 172.21.15.77:0/3899412661 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f99fc06e0b0 msgr2=0x7f99fc070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:36.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:36.113+0000 7f9a17468640 1 --2- 172.21.15.77:0/3899412661 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f99fc06e0b0 0x7f99fc070560 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c009fd0 tx=0x7f9a0c009e50 comp rx=0 tx=0).stop 2024-09-18T21:24:36.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:36.113+0000 7f9a17468640 1 -- 172.21.15.77:0/3899412661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a10102ed0 msgr2=0x7f9a10113710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:36.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:36.113+0000 7f9a17468640 1 --2- 172.21.15.77:0/3899412661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a10102ed0 0x7f9a10113710 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9a000043d0 tx=0x7f9a00009da0 comp rx=0 tx=0).stop 2024-09-18T21:24:36.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:36.113+0000 7f9a17468640 1 -- 172.21.15.77:0/3899412661 shutdown_connections 2024-09-18T21:24:36.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:36.113+0000 7f9a17468640 1 --2- 172.21.15.77:0/3899412661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a10102ed0 0x7f9a10113710 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:36.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:36.113+0000 7f9a17468640 1 --2- 172.21.15.77:0/3899412661 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f99fc06e0b0 0x7f99fc070560 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:36.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:36.113+0000 7f9a17468640 1 --2- 172.21.15.77:0/3899412661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a10102530 0x7f9a101131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:36.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:36.113+0000 7f9a17468640 1 -- 172.21.15.77:0/3899412661 >> 172.21.15.77:0/3899412661 conn(0x7f9a100f80f0 msgr2=0x7f9a100f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:24:36.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:36.113+0000 7f9a17468640 1 -- 172.21.15.77:0/3899412661 shutdown_connections 2024-09-18T21:24:36.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:36.113+0000 7f9a17468640 1 -- 172.21.15.77:0/3899412661 wait complete. 2024-09-18T21:24:36.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:35 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:24:36.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:35 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:24:36.950 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-18T21:24:36.960 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-18T21:24:36.961 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-18T21:24:36.961 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-18T21:24:36.978 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-18T21:24:36.978 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-18T21:24:37.036 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-18T21:24:37.212 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:36 smithi077 ceph-mon[92672]: pgmap v322: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:37.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:36 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/3899412661' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-09-18T21:24:37.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:36 smithi103 ceph-mon[80307]: pgmap v322: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:37.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:36 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/3899412661' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-09-18T21:24:37.319 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:24:39.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:39.004+0000 7f477a6bf640 1 -- 172.21.15.77:0/2061750665 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4774102570 msgr2=0x7f4774102940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:39.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:39.004+0000 7f477a6bf640 1 --2- 172.21.15.77:0/2061750665 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4774102570 0x7f4774102940 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f47640048d0 tx=0x7f4764009da0 comp rx=0 tx=0).stop 2024-09-18T21:24:39.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:39.004+0000 7f477a6bf640 1 -- 172.21.15.77:0/2061750665 shutdown_connections 2024-09-18T21:24:39.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:39.004+0000 7f477a6bf640 1 --2- 172.21.15.77:0/2061750665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4774102f10 0x7f47740fac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:39.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:39.004+0000 7f477a6bf640 1 --2- 172.21.15.77:0/2061750665 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4774102570 0x7f4774102940 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:39.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:39.004+0000 7f477a6bf640 1 -- 172.21.15.77:0/2061750665 >> 172.21.15.77:0/2061750665 conn(0x7f4774070c80 msgr2=0x7f4774071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:24:39.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:39.004+0000 7f477a6bf640 1 -- 172.21.15.77:0/2061750665 shutdown_connections 2024-09-18T21:24:39.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:39.004+0000 7f477a6bf640 1 -- 172.21.15.77:0/2061750665 wait complete. 2024-09-18T21:24:39.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:39.005+0000 7f477a6bf640 1 Processor -- start 2024-09-18T21:24:39.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:39.005+0000 7f477a6bf640 1 -- start start 2024-09-18T21:24:39.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:39.005+0000 7f477a6bf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4774102570 0x7f47741131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:24:39.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:39.005+0000 7f477a6bf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4774102f10 0x7f4774113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:24:39.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:39.005+0000 7f477a6bf640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4774113d10 con 0x7f4774102570 2024-09-18T21:24:39.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:39.005+0000 7f477a6bf640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477410d150 con 0x7f4774102f10 2024-09-18T21:24:39.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:39.005+0000 7f4773fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4774102570 0x7f47741131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:24:39.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:39.005+0000 7f4773fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4774102570 0x7f47741131d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39392/0 (socket says 172.21.15.77:39392) 2024-09-18T21:24:39.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:39.005+0000 7f4773fff640 1 -- 172.21.15.77:0/2059905605 learned_addr learned my addr 172.21.15.77:0/2059905605 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:24:39.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:39.006+0000 7f47737fe640 1 --2- 172.21.15.77:0/2059905605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4774102f10 0x7f4774113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:24:39.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:39.006+0000 7f4773fff640 1 -- 172.21.15.77:0/2059905605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4774102f10 msgr2=0x7f4774113710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:39.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:39.006+0000 7f4773fff640 1 --2- 172.21.15.77:0/2059905605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4774102f10 0x7f4774113710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:39.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:39.006+0000 7f4773fff640 1 -- 172.21.15.77:0/2059905605 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4764005040 con 0x7f4774102570 2024-09-18T21:24:39.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:39.006+0000 7f47737fe640 1 --2- 172.21.15.77:0/2059905605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4774102f10 0x7f4774113710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-18T21:24:39.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:39.006+0000 7f4773fff640 1 --2- 172.21.15.77:0/2059905605 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4774102570 0x7f47741131d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4764003080 tx=0x7f4764009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:24:39.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:39.006+0000 7f4770ff9640 1 -- 172.21.15.77:0/2059905605 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4764038070 con 0x7f4774102570 2024-09-18T21:24:39.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:39.006+0000 7f477a6bf640 1 -- 172.21.15.77:0/2059905605 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f477410d3d0 con 0x7f4774102570 2024-09-18T21:24:39.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:39.006+0000 7f4770ff9640 1 -- 172.21.15.77:0/2059905605 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f47640097e0 con 0x7f4774102570 2024-09-18T21:24:39.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:39.006+0000 7f4770ff9640 1 -- 172.21.15.77:0/2059905605 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f476403d420 con 0x7f4774102570 2024-09-18T21:24:39.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:39.006+0000 7f477a6bf640 1 -- 172.21.15.77:0/2059905605 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f477410d910 con 0x7f4774102570 2024-09-18T21:24:39.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:39.007+0000 7f477a6bf640 1 -- 172.21.15.77:0/2059905605 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4774065800 con 0x7f4774102570 2024-09-18T21:24:39.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:39.008+0000 7f4770ff9640 1 -- 172.21.15.77:0/2059905605 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f4764030020 con 0x7f4774102570 2024-09-18T21:24:39.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:39.008+0000 7f4770ff9640 1 --2- 172.21.15.77:0/2059905605 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f475c06e0b0 0x7f475c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:24:39.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:39.008+0000 7f4770ff9640 1 -- 172.21.15.77:0/2059905605 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f47640ae1f0 con 0x7f4774102570 2024-09-18T21:24:39.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:39.008+0000 7f47737fe640 1 --2- 172.21.15.77:0/2059905605 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f475c06e0b0 0x7f475c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:24:39.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:39.008+0000 7f47737fe640 1 --2- 172.21.15.77:0/2059905605 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f475c06e0b0 0x7f475c070560 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f477410ea90 tx=0x7f4768009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:24:39.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:39.012+0000 7f4770ff9640 1 -- 172.21.15.77:0/2059905605 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f4764077470 con 0x7f4774102570 2024-09-18T21:24:39.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:39.190+0000 7f477a6bf640 1 -- 172.21.15.77:0/2059905605 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f477404b720 con 0x7f4774102570 2024-09-18T21:24:39.192 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:38 smithi077 ceph-mon[92672]: pgmap v323: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:39.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:39.191+0000 7f4770ff9640 1 -- 172.21.15.77:0/2059905605 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 43 entries v80) v1 ==== 81+0+2550 (secure 0 0 0) 0x7f476407ab30 con 0x7f4774102570 2024-09-18T21:24:39.193 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.103:6827/4241818403 2024-09-19T21:20:23.252501+0000 2024-09-18T21:24:39.193 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.103:6825/2170237078 2024-09-19T21:20:02.083333+0000 2024-09-18T21:24:39.193 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.103:6824/2170237078 2024-09-19T21:20:02.083333+0000 2024-09-18T21:24:39.193 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6829/862540650 2024-09-19T21:19:40.247630+0000 2024-09-18T21:24:39.193 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/3233925630 2024-09-19T21:15:05.764293+0000 2024-09-18T21:24:39.193 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/3174697722 2024-09-19T21:15:05.764293+0000 2024-09-18T21:24:39.193 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/2337032095 2024-09-19T21:15:05.764293+0000 2024-09-18T21:24:39.193 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/124127053 2024-09-19T21:15:05.764293+0000 2024-09-18T21:24:39.193 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6801/3842438735 2024-09-19T21:15:05.764293+0000 2024-09-18T21:24:39.193 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/268486755 2024-09-19T21:04:44.916890+0000 2024-09-18T21:24:39.193 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/3396145514 2024-09-19T21:05:43.984681+0000 2024-09-18T21:24:39.193 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/1737764691 2024-09-19T21:05:43.984681+0000 2024-09-18T21:24:39.193 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.103:0/3881592384 2024-09-19T21:14:22.754001+0000 2024-09-18T21:24:39.194 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/1675041738 2024-09-19T21:12:23.321360+0000 2024-09-18T21:24:39.194 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/1925894390 2024-09-19T21:12:23.321360+0000 2024-09-18T21:24:39.194 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6801/2654225509 2024-09-19T21:04:44.916890+0000 2024-09-18T21:24:39.194 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/42563880 2024-09-19T21:04:44.916890+0000 2024-09-18T21:24:39.194 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6800/2654225509 2024-09-19T21:04:44.916890+0000 2024-09-18T21:24:39.194 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/2000509866 2024-09-19T21:12:23.321360+0000 2024-09-18T21:24:39.194 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6800/517401638 2024-09-19T21:05:43.984681+0000 2024-09-18T21:24:39.194 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6827/334039954 2024-09-19T21:19:14.341994+0000 2024-09-18T21:24:39.194 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.103:0/2075394132 2024-09-19T21:14:22.754001+0000 2024-09-18T21:24:39.194 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6801/950747822 2024-09-19T21:12:23.321360+0000 2024-09-18T21:24:39.194 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/2651561696 2024-09-19T21:04:16.080867+0000 2024-09-18T21:24:39.194 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6828/862540650 2024-09-19T21:19:40.247630+0000 2024-09-18T21:24:39.194 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/2389819393 2024-09-19T21:05:43.984681+0000 2024-09-18T21:24:39.195 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6801/517401638 2024-09-19T21:05:43.984681+0000 2024-09-18T21:24:39.195 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/3346293395 2024-09-19T21:04:44.916890+0000 2024-09-18T21:24:39.195 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.103:6826/4241818403 2024-09-19T21:20:23.252501+0000 2024-09-18T21:24:39.195 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.103:0/1170793533 2024-09-19T21:14:22.754001+0000 2024-09-18T21:24:39.195 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.103:6829/1199124716 2024-09-19T21:14:22.754001+0000 2024-09-18T21:24:39.195 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.103:0/1546125413 2024-09-19T21:14:22.754001+0000 2024-09-18T21:24:39.195 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6800/3162219942 2024-09-19T21:04:16.080867+0000 2024-09-18T21:24:39.195 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6801/3162219942 2024-09-19T21:04:16.080867+0000 2024-09-18T21:24:39.195 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6800/3842438735 2024-09-19T21:15:05.764293+0000 2024-09-18T21:24:39.195 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6800/950747822 2024-09-19T21:12:23.321360+0000 2024-09-18T21:24:39.195 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/366153409 2024-09-19T21:04:16.080867+0000 2024-09-18T21:24:39.195 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/1416108819 2024-09-19T21:04:16.080867+0000 2024-09-18T21:24:39.195 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/2441256396 2024-09-19T21:12:23.321360+0000 2024-09-18T21:24:39.195 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.103:6828/1199124716 2024-09-19T21:14:22.754001+0000 2024-09-18T21:24:39.196 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/2438353948 2024-09-19T21:15:05.764293+0000 2024-09-18T21:24:39.196 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6826/334039954 2024-09-19T21:19:14.341994+0000 2024-09-18T21:24:39.196 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/742335545 2024-09-19T21:15:05.764293+0000 2024-09-18T21:24:39.196 INFO:teuthology.orchestra.run.smithi077.stderr:listed 43 entries 2024-09-18T21:24:39.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:39.193+0000 7f477a6bf640 1 -- 172.21.15.77:0/2059905605 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f475c06e0b0 msgr2=0x7f475c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:39.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:39.193+0000 7f477a6bf640 1 --2- 172.21.15.77:0/2059905605 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f475c06e0b0 0x7f475c070560 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f477410ea90 tx=0x7f4768009040 comp rx=0 tx=0).stop 2024-09-18T21:24:39.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:39.193+0000 7f477a6bf640 1 -- 172.21.15.77:0/2059905605 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4774102570 msgr2=0x7f47741131d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:39.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:39.193+0000 7f477a6bf640 1 --2- 172.21.15.77:0/2059905605 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4774102570 0x7f47741131d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4764003080 tx=0x7f4764009da0 comp rx=0 tx=0).stop 2024-09-18T21:24:39.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:39.193+0000 7f477a6bf640 1 -- 172.21.15.77:0/2059905605 shutdown_connections 2024-09-18T21:24:39.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:39.193+0000 7f477a6bf640 1 --2- 172.21.15.77:0/2059905605 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f475c06e0b0 0x7f475c070560 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:39.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:39.193+0000 7f477a6bf640 1 --2- 172.21.15.77:0/2059905605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4774102f10 0x7f4774113710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:39.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:39.193+0000 7f477a6bf640 1 --2- 172.21.15.77:0/2059905605 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4774102570 0x7f47741131d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:39.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:39.193+0000 7f477a6bf640 1 -- 172.21.15.77:0/2059905605 >> 172.21.15.77:0/2059905605 conn(0x7f4774070c80 msgr2=0x7f4774105330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:24:39.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:39.193+0000 7f477a6bf640 1 -- 172.21.15.77:0/2059905605 shutdown_connections 2024-09-18T21:24:39.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:39.194+0000 7f477a6bf640 1 -- 172.21.15.77:0/2059905605 wait complete. 2024-09-18T21:24:39.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:38 smithi103 ceph-mon[80307]: pgmap v323: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:40.011 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-18T21:24:40.011 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-18T21:24:40.028 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-18T21:24:40.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:39 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/2059905605' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-18T21:24:40.314 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/mon.smithi077/config 2024-09-18T21:24:40.435 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:39 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/2059905605' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-18T21:24:41.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:40 smithi077 ceph-mon[92672]: pgmap v324: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:41.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:40 smithi103 ceph-mon[80307]: pgmap v324: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:42.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:42.004+0000 7f57b6f35640 1 -- 172.21.15.77:0/2697065279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57b0102f00 msgr2=0x7f57b00fc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:42.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:42.004+0000 7f57b6f35640 1 --2- 172.21.15.77:0/2697065279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57b0102f00 0x7f57b00fc5c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f579c0048d0 tx=0x7f579c009da0 comp rx=0 tx=0).stop 2024-09-18T21:24:42.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:42.004+0000 7f57b6f35640 1 -- 172.21.15.77:0/2697065279 shutdown_connections 2024-09-18T21:24:42.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:42.004+0000 7f57b6f35640 1 --2- 172.21.15.77:0/2697065279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57b0102f00 0x7f57b00fc5c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:42.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:42.004+0000 7f57b6f35640 1 --2- 172.21.15.77:0/2697065279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57b0102560 0x7f57b0102930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:42.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:42.004+0000 7f57b6f35640 1 -- 172.21.15.77:0/2697065279 >> 172.21.15.77:0/2697065279 conn(0x7f57b00f8120 msgr2=0x7f57b00fa530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:24:42.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:42.004+0000 7f57b6f35640 1 -- 172.21.15.77:0/2697065279 shutdown_connections 2024-09-18T21:24:42.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:42.004+0000 7f57b6f35640 1 -- 172.21.15.77:0/2697065279 wait complete. 2024-09-18T21:24:42.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:42.004+0000 7f57b6f35640 1 Processor -- start 2024-09-18T21:24:42.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:42.004+0000 7f57b6f35640 1 -- start start 2024-09-18T21:24:42.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:42.005+0000 7f57b6f35640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57b0102560 0x7f57b0113200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:24:42.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:42.005+0000 7f57b6f35640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57b0102f00 0x7f57b0113740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:24:42.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:42.005+0000 7f57b6f35640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b0113d40 con 0x7f57b0102560 2024-09-18T21:24:42.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:42.005+0000 7f57b6f35640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b010d180 con 0x7f57b0102f00 2024-09-18T21:24:42.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:42.005+0000 7f57b4cd1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57b0102560 0x7f57b0113200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:24:42.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:42.005+0000 7f57b4cd1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57b0102560 0x7f57b0113200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50046/0 (socket says 172.21.15.77:50046) 2024-09-18T21:24:42.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:42.005+0000 7f57b4cd1640 1 -- 172.21.15.77:0/3911862347 learned_addr learned my addr 172.21.15.77:0/3911862347 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-18T21:24:42.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:42.005+0000 7f57affff640 1 --2- 172.21.15.77:0/3911862347 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57b0102f00 0x7f57b0113740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:24:42.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:42.005+0000 7f57b4cd1640 1 -- 172.21.15.77:0/3911862347 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57b0102f00 msgr2=0x7f57b0113740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:42.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:42.005+0000 7f57b4cd1640 1 --2- 172.21.15.77:0/3911862347 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57b0102f00 0x7f57b0113740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:42.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:42.005+0000 7f57b4cd1640 1 -- 172.21.15.77:0/3911862347 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579c005040 con 0x7f57b0102560 2024-09-18T21:24:42.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:42.005+0000 7f57b4cd1640 1 --2- 172.21.15.77:0/3911862347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57b0102560 0x7f57b0113200 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f57a4002a50 tx=0x7f57a4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:24:42.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:42.005+0000 7f57ad7fa640 1 -- 172.21.15.77:0/3911862347 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57a4007c30 con 0x7f57b0102560 2024-09-18T21:24:42.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:42.005+0000 7f57ad7fa640 1 -- 172.21.15.77:0/3911862347 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f57a400f040 con 0x7f57b0102560 2024-09-18T21:24:42.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:42.005+0000 7f57ad7fa640 1 -- 172.21.15.77:0/3911862347 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57a400da90 con 0x7f57b0102560 2024-09-18T21:24:42.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:42.005+0000 7f57b6f35640 1 -- 172.21.15.77:0/3911862347 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57b010d460 con 0x7f57b0102560 2024-09-18T21:24:42.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:42.006+0000 7f57b6f35640 1 -- 172.21.15.77:0/3911862347 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57b010da00 con 0x7f57b0102560 2024-09-18T21:24:42.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:42.007+0000 7f57b6f35640 1 -- 172.21.15.77:0/3911862347 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57b00fdce0 con 0x7f57b0102560 2024-09-18T21:24:42.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:42.007+0000 7f57ad7fa640 1 -- 172.21.15.77:0/3911862347 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 37) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f57a400dd00 con 0x7f57b0102560 2024-09-18T21:24:42.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:42.007+0000 7f57ad7fa640 1 --2- 172.21.15.77:0/3911862347 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f57a006e0b0 0x7f57a0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-18T21:24:42.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:42.007+0000 7f57ad7fa640 1 -- 172.21.15.77:0/3911862347 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6668+0+0 (secure 0 0 0) 0x7f57a408d550 con 0x7f57b0102560 2024-09-18T21:24:42.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:42.007+0000 7f57affff640 1 --2- 172.21.15.77:0/3911862347 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f57a006e0b0 0x7f57a0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-18T21:24:42.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:42.008+0000 7f57affff640 1 --2- 172.21.15.77:0/3911862347 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f57a006e0b0 0x7f57a0070560 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f57b010eac0 tx=0x7f579c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-18T21:24:42.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:42.012+0000 7f57ad7fa640 1 -- 172.21.15.77:0/3911862347 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f57a40567d0 con 0x7f57b0102560 2024-09-18T21:24:42.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:42.188+0000 7f57b6f35640 1 -- 172.21.15.77:0/3911862347 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f57b004b780 con 0x7f57b0102560 2024-09-18T21:24:42.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:42.188+0000 7f57ad7fa640 1 -- 172.21.15.77:0/3911862347 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 43 entries v80) v1 ==== 81+0+2550 (secure 0 0 0) 0x7f57a4059e90 con 0x7f57b0102560 2024-09-18T21:24:42.189 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.103:6827/4241818403 2024-09-19T21:20:23.252501+0000 2024-09-18T21:24:42.190 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.103:6825/2170237078 2024-09-19T21:20:02.083333+0000 2024-09-18T21:24:42.190 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.103:6824/2170237078 2024-09-19T21:20:02.083333+0000 2024-09-18T21:24:42.190 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6829/862540650 2024-09-19T21:19:40.247630+0000 2024-09-18T21:24:42.190 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/3233925630 2024-09-19T21:15:05.764293+0000 2024-09-18T21:24:42.190 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/3174697722 2024-09-19T21:15:05.764293+0000 2024-09-18T21:24:42.190 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/2337032095 2024-09-19T21:15:05.764293+0000 2024-09-18T21:24:42.190 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/124127053 2024-09-19T21:15:05.764293+0000 2024-09-18T21:24:42.190 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6801/3842438735 2024-09-19T21:15:05.764293+0000 2024-09-18T21:24:42.190 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/268486755 2024-09-19T21:04:44.916890+0000 2024-09-18T21:24:42.190 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/3396145514 2024-09-19T21:05:43.984681+0000 2024-09-18T21:24:42.190 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/1737764691 2024-09-19T21:05:43.984681+0000 2024-09-18T21:24:42.191 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.103:0/3881592384 2024-09-19T21:14:22.754001+0000 2024-09-18T21:24:42.191 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/1675041738 2024-09-19T21:12:23.321360+0000 2024-09-18T21:24:42.191 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/1925894390 2024-09-19T21:12:23.321360+0000 2024-09-18T21:24:42.191 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6801/2654225509 2024-09-19T21:04:44.916890+0000 2024-09-18T21:24:42.191 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/42563880 2024-09-19T21:04:44.916890+0000 2024-09-18T21:24:42.191 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6800/2654225509 2024-09-19T21:04:44.916890+0000 2024-09-18T21:24:42.191 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/2000509866 2024-09-19T21:12:23.321360+0000 2024-09-18T21:24:42.191 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6800/517401638 2024-09-19T21:05:43.984681+0000 2024-09-18T21:24:42.191 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6827/334039954 2024-09-19T21:19:14.341994+0000 2024-09-18T21:24:42.191 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.103:0/2075394132 2024-09-19T21:14:22.754001+0000 2024-09-18T21:24:42.191 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6801/950747822 2024-09-19T21:12:23.321360+0000 2024-09-18T21:24:42.191 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/2651561696 2024-09-19T21:04:16.080867+0000 2024-09-18T21:24:42.191 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6828/862540650 2024-09-19T21:19:40.247630+0000 2024-09-18T21:24:42.191 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/2389819393 2024-09-19T21:05:43.984681+0000 2024-09-18T21:24:42.192 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6801/517401638 2024-09-19T21:05:43.984681+0000 2024-09-18T21:24:42.192 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/3346293395 2024-09-19T21:04:44.916890+0000 2024-09-18T21:24:42.192 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.103:6826/4241818403 2024-09-19T21:20:23.252501+0000 2024-09-18T21:24:42.192 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.103:0/1170793533 2024-09-19T21:14:22.754001+0000 2024-09-18T21:24:42.192 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.103:6829/1199124716 2024-09-19T21:14:22.754001+0000 2024-09-18T21:24:42.192 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.103:0/1546125413 2024-09-19T21:14:22.754001+0000 2024-09-18T21:24:42.192 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6800/3162219942 2024-09-19T21:04:16.080867+0000 2024-09-18T21:24:42.192 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6801/3162219942 2024-09-19T21:04:16.080867+0000 2024-09-18T21:24:42.192 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6800/3842438735 2024-09-19T21:15:05.764293+0000 2024-09-18T21:24:42.192 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6800/950747822 2024-09-19T21:12:23.321360+0000 2024-09-18T21:24:42.192 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/366153409 2024-09-19T21:04:16.080867+0000 2024-09-18T21:24:42.192 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/1416108819 2024-09-19T21:04:16.080867+0000 2024-09-18T21:24:42.193 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/2441256396 2024-09-19T21:12:23.321360+0000 2024-09-18T21:24:42.193 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.103:6828/1199124716 2024-09-19T21:14:22.754001+0000 2024-09-18T21:24:42.193 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/2438353948 2024-09-19T21:15:05.764293+0000 2024-09-18T21:24:42.193 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6826/334039954 2024-09-19T21:19:14.341994+0000 2024-09-18T21:24:42.193 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/742335545 2024-09-19T21:15:05.764293+0000 2024-09-18T21:24:42.194 INFO:teuthology.orchestra.run.smithi077.stderr:listed 43 entries 2024-09-18T21:24:42.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:42.190+0000 7f57b6f35640 1 -- 172.21.15.77:0/3911862347 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f57a006e0b0 msgr2=0x7f57a0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:42.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:42.190+0000 7f57b6f35640 1 --2- 172.21.15.77:0/3911862347 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f57a006e0b0 0x7f57a0070560 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f57b010eac0 tx=0x7f579c009da0 comp rx=0 tx=0).stop 2024-09-18T21:24:42.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:42.190+0000 7f57b6f35640 1 -- 172.21.15.77:0/3911862347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57b0102560 msgr2=0x7f57b0113200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-18T21:24:42.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:42.190+0000 7f57b6f35640 1 --2- 172.21.15.77:0/3911862347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57b0102560 0x7f57b0113200 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f57a4002a50 tx=0x7f57a4004600 comp rx=0 tx=0).stop 2024-09-18T21:24:42.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:42.191+0000 7f57b6f35640 1 -- 172.21.15.77:0/3911862347 shutdown_connections 2024-09-18T21:24:42.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:42.191+0000 7f57b6f35640 1 --2- 172.21.15.77:0/3911862347 >> [v2:172.21.15.77:6800/1855084565,v1:172.21.15.77:6801/1855084565] conn(0x7f57a006e0b0 0x7f57a0070560 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:42.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:42.191+0000 7f57b6f35640 1 --2- 172.21.15.77:0/3911862347 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57b0102f00 0x7f57b0113740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:42.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:42.191+0000 7f57b6f35640 1 --2- 172.21.15.77:0/3911862347 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57b0102560 0x7f57b0113200 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-18T21:24:42.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:42.191+0000 7f57b6f35640 1 -- 172.21.15.77:0/3911862347 >> 172.21.15.77:0/3911862347 conn(0x7f57b00f8120 msgr2=0x7f57b00f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-18T21:24:42.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:42.191+0000 7f57b6f35640 1 -- 172.21.15.77:0/3911862347 shutdown_connections 2024-09-18T21:24:42.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-18T21:24:42.191+0000 7f57b6f35640 1 -- 172.21.15.77:0/3911862347 wait complete. 2024-09-18T21:24:42.824 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi077.front.sepia.ceph.com... 2024-09-18T21:24:42.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-18T21:24:42.825 DEBUG:teuthology.orchestra.run.smithi077:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-18T21:24:42.853 INFO:teuthology.orchestra.run:waiting for 300 2024-09-18T21:24:43.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:42 smithi077 ceph-mon[92672]: pgmap v325: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:43.213 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:42 smithi077 ceph-mon[92672]: from='client.? 172.21.15.77:0/3911862347' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-18T21:24:43.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:42 smithi103 ceph-mon[80307]: pgmap v325: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:43.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:42 smithi103 ceph-mon[80307]: from='client.? 172.21.15.77:0/3911862347' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-18T21:24:45.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:45 smithi103 ceph-mon[80307]: pgmap v326: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:45.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:45 smithi077 ceph-mon[92672]: pgmap v326: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:47.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:47 smithi103 ceph-mon[80307]: pgmap v327: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:47.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:47 smithi077 ceph-mon[92672]: pgmap v327: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:49.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:49 smithi103 ceph-mon[80307]: pgmap v328: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:49.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:49 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:24:49.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:49 smithi077 ceph-mon[92672]: pgmap v328: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:49.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:49 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:24:50.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:50 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:24:50.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:50 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:24:50.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:50 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:24:50.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:50 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:24:50.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:50 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:24:50.713 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:50 smithi077 ceph-mon[92672]: pgmap v329: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:50.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:50 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:24:50.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:50 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:24:50.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:50 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:24:50.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:50 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:24:50.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:50 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:24:50.764 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:50 smithi103 ceph-mon[80307]: pgmap v329: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:51.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:51 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:24:52.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:51 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:24:52.963 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:52 smithi077 ceph-mon[92672]: pgmap v330: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:53.013 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:52 smithi103 ceph-mon[80307]: pgmap v330: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:55.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:54 smithi103 ceph-mon[80307]: pgmap v331: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:55.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:54 smithi077 ceph-mon[92672]: pgmap v331: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:57.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:56 smithi103 ceph-mon[80307]: pgmap v332: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:57.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:56 smithi077 ceph-mon[92672]: pgmap v332: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:59.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:24:58 smithi103 ceph-mon[80307]: pgmap v333: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:24:59.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:24:58 smithi077 ceph-mon[92672]: pgmap v333: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:01.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:25:00 smithi103 ceph-mon[80307]: pgmap v334: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:01.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:25:00 smithi077 ceph-mon[92672]: pgmap v334: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:03.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:25:02 smithi103 ceph-mon[80307]: pgmap v335: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:03.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:25:02 smithi077 ceph-mon[92672]: pgmap v335: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:05.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:25:04 smithi103 ceph-mon[80307]: pgmap v336: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:05.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:25:04 smithi077 ceph-mon[92672]: pgmap v336: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:06.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:25:05 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:25:06.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:25:05 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:25:07.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:25:06 smithi103 ceph-mon[80307]: pgmap v337: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:07.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:25:06 smithi077 ceph-mon[92672]: pgmap v337: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:09.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:25:08 smithi103 ceph-mon[80307]: pgmap v338: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:09.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:25:08 smithi077 ceph-mon[92672]: pgmap v338: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:11.263 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:25:10 smithi103 ceph-mon[80307]: pgmap v339: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:11.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:25:10 smithi077 ceph-mon[92672]: pgmap v339: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:13.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:25:12 smithi103 ceph-mon[80307]: pgmap v340: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:13.377 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:25:12 smithi077 ceph-mon[92672]: pgmap v340: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:15.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:25:14 smithi103 ceph-mon[80307]: pgmap v341: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:15.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:25:14 smithi077 ceph-mon[92672]: pgmap v341: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:17.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:25:17 smithi103 ceph-mon[80307]: pgmap v342: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:17.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:25:17 smithi077 ceph-mon[92672]: pgmap v342: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:19.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:25:19 smithi103 ceph-mon[80307]: pgmap v343: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:19.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:25:19 smithi077 ceph-mon[92672]: pgmap v343: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:21.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:25:21 smithi103 ceph-mon[80307]: pgmap v344: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:21.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:25:21 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:25:21.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:25:21 smithi077 ceph-mon[92672]: pgmap v344: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:21.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:25:21 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:25:23.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:25:23 smithi103 ceph-mon[80307]: pgmap v345: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:23.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:25:23 smithi077 ceph-mon[92672]: pgmap v345: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:25.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:25:25 smithi077 ceph-mon[92672]: pgmap v346: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:25.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:25:25 smithi103 ceph-mon[80307]: pgmap v346: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:27.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:25:27 smithi077 ceph-mon[92672]: pgmap v347: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:27.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:25:27 smithi103 ceph-mon[80307]: pgmap v347: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:29.316 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:25:29 smithi103 ceph-mon[80307]: pgmap v348: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:29.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:25:29 smithi077 ceph-mon[92672]: pgmap v348: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:31.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:25:31 smithi077 ceph-mon[92672]: pgmap v349: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:31.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:25:31 smithi103 ceph-mon[80307]: pgmap v349: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:33.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:25:33 smithi077 ceph-mon[92672]: pgmap v350: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:33.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:25:33 smithi103 ceph-mon[80307]: pgmap v350: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:35.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:25:35 smithi077 ceph-mon[92672]: pgmap v351: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:35.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:25:35 smithi103 ceph-mon[80307]: pgmap v351: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:36.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:25:36 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:25:36.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:25:36 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:25:37.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:25:37 smithi077 ceph-mon[92672]: pgmap v352: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:37.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:25:37 smithi103 ceph-mon[80307]: pgmap v352: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:39.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:25:39 smithi077 ceph-mon[92672]: pgmap v353: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:39.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:25:39 smithi103 ceph-mon[80307]: pgmap v353: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:41.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:25:41 smithi077 ceph-mon[92672]: pgmap v354: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:41.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:25:41 smithi103 ceph-mon[80307]: pgmap v354: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:43.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:25:43 smithi077 ceph-mon[92672]: pgmap v355: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:43.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:25:43 smithi103 ceph-mon[80307]: pgmap v355: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:45.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:25:45 smithi077 ceph-mon[92672]: pgmap v356: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:45.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:25:45 smithi103 ceph-mon[80307]: pgmap v356: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:47.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:25:47 smithi077 ceph-mon[92672]: pgmap v357: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:47.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:25:47 smithi103 ceph-mon[80307]: pgmap v357: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:49.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:25:49 smithi077 ceph-mon[92672]: pgmap v358: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:49.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:25:49 smithi103 ceph-mon[80307]: pgmap v358: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:50.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:25:50 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:25:50.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:25:50 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:25:51.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:25:51 smithi077 ceph-mon[92672]: pgmap v359: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:51.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:25:51 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:25:51.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:25:51 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:25:51.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:25:51 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:25:51.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:25:51 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:25:51.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:25:51 smithi103 ceph-mon[80307]: pgmap v359: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:51.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:25:51 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:25:51.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:25:51 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:25:51.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:25:51 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:25:51.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:25:51 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:25:53.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:25:53 smithi077 ceph-mon[92672]: pgmap v360: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:53.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:25:53 smithi103 ceph-mon[80307]: pgmap v360: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:55.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:25:55 smithi077 ceph-mon[92672]: pgmap v361: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:55.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:25:55 smithi103 ceph-mon[80307]: pgmap v361: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:57.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:25:57 smithi077 ceph-mon[92672]: pgmap v362: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:57.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:25:57 smithi103 ceph-mon[80307]: pgmap v362: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:59.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:25:59 smithi077 ceph-mon[92672]: pgmap v363: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:25:59.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:25:59 smithi103 ceph-mon[80307]: pgmap v363: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:01.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:26:01 smithi077 ceph-mon[92672]: pgmap v364: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:01.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:26:01 smithi103 ceph-mon[80307]: pgmap v364: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:03.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:26:03 smithi077 ceph-mon[92672]: pgmap v365: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:03.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:26:03 smithi103 ceph-mon[80307]: pgmap v365: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:05.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:26:05 smithi077 ceph-mon[92672]: pgmap v366: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:05.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:26:05 smithi103 ceph-mon[80307]: pgmap v366: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:06.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:26:06 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:26:06.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:26:06 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:26:07.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:26:07 smithi077 ceph-mon[92672]: pgmap v367: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:07.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:26:07 smithi103 ceph-mon[80307]: pgmap v367: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:09.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:26:09 smithi077 ceph-mon[92672]: pgmap v368: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:09.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:26:09 smithi103 ceph-mon[80307]: pgmap v368: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:11.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:26:11 smithi077 ceph-mon[92672]: pgmap v369: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:11.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:26:11 smithi103 ceph-mon[80307]: pgmap v369: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:13.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:26:13 smithi077 ceph-mon[92672]: pgmap v370: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:13.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:26:13 smithi103 ceph-mon[80307]: pgmap v370: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:15.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:26:15 smithi077 ceph-mon[92672]: pgmap v371: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:15.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:26:15 smithi103 ceph-mon[80307]: pgmap v371: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:17.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:26:17 smithi077 ceph-mon[92672]: pgmap v372: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:17.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:26:17 smithi103 ceph-mon[80307]: pgmap v372: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:19.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:26:19 smithi077 ceph-mon[92672]: pgmap v373: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:19.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:26:19 smithi103 ceph-mon[80307]: pgmap v373: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:21.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:26:21 smithi077 ceph-mon[92672]: pgmap v374: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:21.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:26:21 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:26:21.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:26:21 smithi103 ceph-mon[80307]: pgmap v374: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:21.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:26:21 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:26:22.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:26:22 smithi077 ceph-mon[92672]: pgmap v375: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:22.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:26:22 smithi103 ceph-mon[80307]: pgmap v375: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:25.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:26:24 smithi103 ceph-mon[80307]: pgmap v376: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:25.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:26:24 smithi077 ceph-mon[92672]: pgmap v376: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:27.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:26:26 smithi103 ceph-mon[80307]: pgmap v377: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:27.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:26:26 smithi077 ceph-mon[92672]: pgmap v377: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:29.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:26:28 smithi103 ceph-mon[80307]: pgmap v378: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:29.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:26:28 smithi077 ceph-mon[92672]: pgmap v378: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:31.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:26:30 smithi103 ceph-mon[80307]: pgmap v379: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:31.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:26:30 smithi077 ceph-mon[92672]: pgmap v379: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:33.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:26:33 smithi103 ceph-mon[80307]: pgmap v380: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:33.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:26:33 smithi077 ceph-mon[92672]: pgmap v380: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:35.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:26:35 smithi103 ceph-mon[80307]: pgmap v381: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:35.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:26:35 smithi077 ceph-mon[92672]: pgmap v381: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:36.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:26:36 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:26:36.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:26:36 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:26:37.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:26:37 smithi103 ceph-mon[80307]: pgmap v382: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:37.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:26:37 smithi077 ceph-mon[92672]: pgmap v382: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:39.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:26:39 smithi077 ceph-mon[92672]: pgmap v383: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:39.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:26:39 smithi103 ceph-mon[80307]: pgmap v383: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:41.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:26:41 smithi077 ceph-mon[92672]: pgmap v384: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:41.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:26:41 smithi103 ceph-mon[80307]: pgmap v384: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:43.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:26:43 smithi077 ceph-mon[92672]: pgmap v385: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:43.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:26:43 smithi103 ceph-mon[80307]: pgmap v385: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:45.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:26:45 smithi077 ceph-mon[92672]: pgmap v386: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:45.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:26:45 smithi103 ceph-mon[80307]: pgmap v386: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:47.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:26:47 smithi077 ceph-mon[92672]: pgmap v387: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:47.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:26:47 smithi103 ceph-mon[80307]: pgmap v387: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:49.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:26:49 smithi077 ceph-mon[92672]: pgmap v388: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:49.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:26:49 smithi103 ceph-mon[80307]: pgmap v388: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:51.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:26:51 smithi077 ceph-mon[92672]: pgmap v389: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:51.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:26:51 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:26:51.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:26:51 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:26:51.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:26:51 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:26:51.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:26:51 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:26:51.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:26:51 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:26:51.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:26:51 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:26:51.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:26:51 smithi103 ceph-mon[80307]: pgmap v389: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:51.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:26:51 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:26:51.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:26:51 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:26:51.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:26:51 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:26:51.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:26:51 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:26:51.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:26:51 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:26:51.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:26:51 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:26:52.315 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:26:52 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:26:52.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:26:52 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:26:53.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:26:53 smithi077 ceph-mon[92672]: pgmap v390: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:53.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:26:53 smithi103 ceph-mon[80307]: pgmap v390: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:55.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:26:55 smithi077 ceph-mon[92672]: pgmap v391: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:55.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:26:55 smithi103 ceph-mon[80307]: pgmap v391: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:57.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:26:57 smithi077 ceph-mon[92672]: pgmap v392: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:57.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:26:57 smithi103 ceph-mon[80307]: pgmap v392: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:59.316 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:26:59 smithi103 ceph-mon[80307]: pgmap v393: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:26:59.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:26:59 smithi077 ceph-mon[92672]: pgmap v393: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:01.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:27:01 smithi077 ceph-mon[92672]: pgmap v394: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:01.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:27:01 smithi103 ceph-mon[80307]: pgmap v394: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:03.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:27:03 smithi077 ceph-mon[92672]: pgmap v395: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:03.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:27:03 smithi103 ceph-mon[80307]: pgmap v395: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:05.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:27:05 smithi077 ceph-mon[92672]: pgmap v396: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:05.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:27:05 smithi103 ceph-mon[80307]: pgmap v396: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:06.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:27:06 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:27:06.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:27:06 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:27:07.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:27:07 smithi077 ceph-mon[92672]: pgmap v397: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:07.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:27:07 smithi103 ceph-mon[80307]: pgmap v397: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:09.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:27:09 smithi077 ceph-mon[92672]: pgmap v398: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:09.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:27:09 smithi103 ceph-mon[80307]: pgmap v398: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:11.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:27:11 smithi077 ceph-mon[92672]: pgmap v399: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:11.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:27:11 smithi103 ceph-mon[80307]: pgmap v399: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:13.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:27:13 smithi077 ceph-mon[92672]: pgmap v400: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:13.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:27:13 smithi103 ceph-mon[80307]: pgmap v400: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:15.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:27:15 smithi077 ceph-mon[92672]: pgmap v401: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:15.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:27:15 smithi103 ceph-mon[80307]: pgmap v401: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:17.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:27:17 smithi077 ceph-mon[92672]: pgmap v402: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:17.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:27:17 smithi103 ceph-mon[80307]: pgmap v402: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:19.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:27:19 smithi077 ceph-mon[92672]: pgmap v403: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:19.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:27:19 smithi103 ceph-mon[80307]: pgmap v403: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:21.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:27:21 smithi077 ceph-mon[92672]: pgmap v404: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:21.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:27:21 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:27:21.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:27:21 smithi103 ceph-mon[80307]: pgmap v404: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:21.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:27:21 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:27:23.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:27:23 smithi077 ceph-mon[92672]: pgmap v405: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:23.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:27:23 smithi103 ceph-mon[80307]: pgmap v405: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:25.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:27:25 smithi077 ceph-mon[92672]: pgmap v406: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:25.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:27:25 smithi103 ceph-mon[80307]: pgmap v406: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:27.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:27:27 smithi077 ceph-mon[92672]: pgmap v407: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:27.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:27:27 smithi103 ceph-mon[80307]: pgmap v407: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:29.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:27:29 smithi077 ceph-mon[92672]: pgmap v408: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:29.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:27:29 smithi103 ceph-mon[80307]: pgmap v408: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:31.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:27:31 smithi077 ceph-mon[92672]: pgmap v409: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:31.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:27:31 smithi103 ceph-mon[80307]: pgmap v409: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:33.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:27:33 smithi077 ceph-mon[92672]: pgmap v410: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:33.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:27:33 smithi103 ceph-mon[80307]: pgmap v410: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:35.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:27:35 smithi077 ceph-mon[92672]: pgmap v411: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:35.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:27:35 smithi103 ceph-mon[80307]: pgmap v411: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:36.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:27:36 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:27:36.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:27:36 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:27:37.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:27:37 smithi077 ceph-mon[92672]: pgmap v412: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:37.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:27:37 smithi103 ceph-mon[80307]: pgmap v412: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:39.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:27:39 smithi077 ceph-mon[92672]: pgmap v413: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:39.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:27:39 smithi103 ceph-mon[80307]: pgmap v413: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:41.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:27:41 smithi077 ceph-mon[92672]: pgmap v414: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:41.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:27:41 smithi103 ceph-mon[80307]: pgmap v414: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:43.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:27:43 smithi077 ceph-mon[92672]: pgmap v415: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:43.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:27:43 smithi103 ceph-mon[80307]: pgmap v415: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:44.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:27:44 smithi077 ceph-mon[92672]: pgmap v416: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:44.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:27:44 smithi103 ceph-mon[80307]: pgmap v416: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:47.264 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:27:47 smithi103 ceph-mon[80307]: pgmap v417: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:47.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:27:47 smithi077 ceph-mon[92672]: pgmap v417: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:49.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:27:49 smithi077 ceph-mon[92672]: pgmap v418: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:49.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:27:49 smithi103 ceph-mon[80307]: pgmap v418: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:51.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:27:51 smithi077 ceph-mon[92672]: pgmap v419: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:51.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:27:51 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:27:51.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:27:51 smithi103 ceph-mon[80307]: pgmap v419: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:51.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:27:51 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:27:52.315 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:27:52 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:27:52.315 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:27:52 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:27:52.315 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:27:52 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:27:52.315 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:27:52 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:27:52.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:27:52 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:27:52.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:27:52 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:27:52.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:27:52 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:27:52.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:27:52 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:27:53.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:27:53 smithi077 ceph-mon[92672]: pgmap v420: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:53.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:27:53 smithi103 ceph-mon[80307]: pgmap v420: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:55.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:27:55 smithi077 ceph-mon[92672]: pgmap v421: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:55.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:27:55 smithi103 ceph-mon[80307]: pgmap v421: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:57.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:27:57 smithi077 ceph-mon[92672]: pgmap v422: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:57.516 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:27:57 smithi103 ceph-mon[80307]: pgmap v422: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:59.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:27:59 smithi077 ceph-mon[92672]: pgmap v423: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:27:59.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:27:59 smithi103 ceph-mon[80307]: pgmap v423: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:01.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:28:01 smithi077 ceph-mon[92672]: pgmap v424: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:01.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:28:01 smithi103 ceph-mon[80307]: pgmap v424: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:03.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:28:03 smithi077 ceph-mon[92672]: pgmap v425: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:03.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:28:03 smithi103 ceph-mon[80307]: pgmap v425: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:05.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:28:05 smithi077 ceph-mon[92672]: pgmap v426: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:05.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:28:05 smithi103 ceph-mon[80307]: pgmap v426: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:06.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:28:06 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:28:06.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:28:06 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:28:07.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:28:07 smithi077 ceph-mon[92672]: pgmap v427: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:07.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:28:07 smithi103 ceph-mon[80307]: pgmap v427: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:09.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:28:09 smithi077 ceph-mon[92672]: pgmap v428: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:09.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:28:09 smithi103 ceph-mon[80307]: pgmap v428: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:11.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:28:11 smithi077 ceph-mon[92672]: pgmap v429: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:11.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:28:11 smithi103 ceph-mon[80307]: pgmap v429: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:13.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:28:13 smithi077 ceph-mon[92672]: pgmap v430: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:13.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:28:13 smithi103 ceph-mon[80307]: pgmap v430: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:15.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:28:15 smithi077 ceph-mon[92672]: pgmap v431: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:15.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:28:15 smithi103 ceph-mon[80307]: pgmap v431: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:17.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:28:17 smithi077 ceph-mon[92672]: pgmap v432: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:17.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:28:17 smithi103 ceph-mon[80307]: pgmap v432: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:19.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:28:19 smithi077 ceph-mon[92672]: pgmap v433: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:19.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:28:19 smithi103 ceph-mon[80307]: pgmap v433: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:21.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:28:21 smithi077 ceph-mon[92672]: pgmap v434: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:21.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:28:21 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:28:21.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:28:21 smithi103 ceph-mon[80307]: pgmap v434: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:21.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:28:21 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:28:23.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:28:23 smithi077 ceph-mon[92672]: pgmap v435: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:23.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:28:23 smithi103 ceph-mon[80307]: pgmap v435: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:25.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:28:25 smithi077 ceph-mon[92672]: pgmap v436: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:25.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:28:25 smithi103 ceph-mon[80307]: pgmap v436: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:26.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:28:26 smithi077 ceph-mon[92672]: pgmap v437: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:26.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:28:26 smithi103 ceph-mon[80307]: pgmap v437: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:29.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:28:29 smithi077 ceph-mon[92672]: pgmap v438: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:29.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:28:29 smithi103 ceph-mon[80307]: pgmap v438: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:31.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:28:31 smithi077 ceph-mon[92672]: pgmap v439: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:31.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:28:31 smithi103 ceph-mon[80307]: pgmap v439: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:33.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:28:33 smithi077 ceph-mon[92672]: pgmap v440: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:33.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:28:33 smithi103 ceph-mon[80307]: pgmap v440: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:35.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:28:35 smithi077 ceph-mon[92672]: pgmap v441: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:35.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:28:35 smithi103 ceph-mon[80307]: pgmap v441: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:36.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:28:36 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:28:36.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:28:36 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:28:37.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:28:37 smithi077 ceph-mon[92672]: pgmap v442: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:37.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:28:37 smithi103 ceph-mon[80307]: pgmap v442: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:39.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:28:39 smithi077 ceph-mon[92672]: pgmap v443: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:39.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:28:39 smithi103 ceph-mon[80307]: pgmap v443: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:41.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:28:41 smithi077 ceph-mon[92672]: pgmap v444: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:41.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:28:41 smithi103 ceph-mon[80307]: pgmap v444: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:43.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:28:43 smithi077 ceph-mon[92672]: pgmap v445: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:43.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:28:43 smithi103 ceph-mon[80307]: pgmap v445: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:45.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:28:45 smithi077 ceph-mon[92672]: pgmap v446: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:45.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:28:45 smithi103 ceph-mon[80307]: pgmap v446: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:47.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:28:47 smithi077 ceph-mon[92672]: pgmap v447: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:47.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:28:47 smithi103 ceph-mon[80307]: pgmap v447: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:49.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:28:49 smithi077 ceph-mon[92672]: pgmap v448: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:49.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:28:49 smithi103 ceph-mon[80307]: pgmap v448: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:51.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:28:51 smithi077 ceph-mon[92672]: pgmap v449: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:51.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:28:51 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:28:51.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:28:51 smithi103 ceph-mon[80307]: pgmap v449: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:51.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:28:51 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:28:52.315 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:28:52 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:28:52.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:28:52 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-18T21:28:53.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:28:53 smithi077 ceph-mon[92672]: pgmap v450: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:53.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:28:53 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:28:53.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:28:53 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:28:53.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:28:53 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:28:53.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:28:53 smithi103 ceph-mon[80307]: pgmap v450: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:53.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:28:53 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-18T21:28:53.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:28:53 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-18T21:28:53.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:28:53 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' 2024-09-18T21:28:55.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:28:55 smithi077 ceph-mon[92672]: pgmap v451: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:55.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:28:55 smithi103 ceph-mon[80307]: pgmap v451: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:57.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:28:57 smithi077 ceph-mon[92672]: pgmap v452: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:57.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:28:57 smithi103 ceph-mon[80307]: pgmap v452: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:59.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:28:59 smithi077 ceph-mon[92672]: pgmap v453: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:28:59.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:28:59 smithi103 ceph-mon[80307]: pgmap v453: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:29:01.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:29:01 smithi077 ceph-mon[92672]: pgmap v454: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:29:01.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:29:01 smithi103 ceph-mon[80307]: pgmap v454: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:29:03.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:29:03 smithi077 ceph-mon[92672]: pgmap v455: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:29:03.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:29:03 smithi103 ceph-mon[80307]: pgmap v455: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:29:05.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:29:05 smithi077 ceph-mon[92672]: pgmap v456: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:29:05.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:29:05 smithi103 ceph-mon[80307]: pgmap v456: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:29:06.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:29:06 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:29:06.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:29:06 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:29:07.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:29:07 smithi077 ceph-mon[92672]: pgmap v457: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:29:07.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:29:07 smithi103 ceph-mon[80307]: pgmap v457: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:29:09.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:29:09 smithi077 ceph-mon[92672]: pgmap v458: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:29:09.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:29:09 smithi103 ceph-mon[80307]: pgmap v458: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:29:11.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:29:11 smithi077 ceph-mon[92672]: pgmap v459: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:29:11.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:29:11 smithi103 ceph-mon[80307]: pgmap v459: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:29:13.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:29:13 smithi077 ceph-mon[92672]: pgmap v460: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:29:13.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:29:13 smithi103 ceph-mon[80307]: pgmap v460: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:29:15.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:29:15 smithi077 ceph-mon[92672]: pgmap v461: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:29:15.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:29:15 smithi103 ceph-mon[80307]: pgmap v461: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:29:17.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:29:17 smithi077 ceph-mon[92672]: pgmap v462: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:29:17.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:29:17 smithi103 ceph-mon[80307]: pgmap v462: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:29:19.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:29:19 smithi077 ceph-mon[92672]: pgmap v463: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:29:19.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:29:19 smithi103 ceph-mon[80307]: pgmap v463: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:29:21.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:29:21 smithi077 ceph-mon[92672]: pgmap v464: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:29:21.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:29:21 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:29:21.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:29:21 smithi103 ceph-mon[80307]: pgmap v464: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:29:21.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:29:21 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:29:23.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:29:23 smithi077 ceph-mon[92672]: pgmap v465: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:29:23.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:29:23 smithi103 ceph-mon[80307]: pgmap v465: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:29:25.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:29:25 smithi077 ceph-mon[92672]: pgmap v466: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:29:25.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:29:25 smithi103 ceph-mon[80307]: pgmap v466: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:29:27.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:29:27 smithi077 ceph-mon[92672]: pgmap v467: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:29:27.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:29:27 smithi103 ceph-mon[80307]: pgmap v467: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:29:29.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:29:29 smithi077 ceph-mon[92672]: pgmap v468: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:29:29.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:29:29 smithi103 ceph-mon[80307]: pgmap v468: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:29:31.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:29:31 smithi077 ceph-mon[92672]: pgmap v469: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:29:31.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:29:31 smithi103 ceph-mon[80307]: pgmap v469: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:29:33.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:29:33 smithi077 ceph-mon[92672]: pgmap v470: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:29:33.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:29:33 smithi103 ceph-mon[80307]: pgmap v470: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:29:35.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:29:35 smithi077 ceph-mon[92672]: pgmap v471: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:29:35.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:29:35 smithi103 ceph-mon[80307]: pgmap v471: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:29:36.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:29:36 smithi077 ceph-mon[92672]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:29:36.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:29:36 smithi103 ceph-mon[80307]: from='mgr.34104 172.21.15.77:0/2083448018' entity='mgr.smithi077.utkpjg' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-18T21:29:37.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:29:37 smithi077 ceph-mon[92672]: pgmap v472: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:29:37.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:29:37 smithi103 ceph-mon[80307]: pgmap v472: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:29:39.462 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:29:39 smithi077 ceph-mon[92672]: pgmap v473: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:29:39.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:29:39 smithi103 ceph-mon[80307]: pgmap v473: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:29:40.463 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:29:40 smithi077 ceph-mon[92672]: pgmap v474: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:29:40.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:29:40 smithi103 ceph-mon[80307]: pgmap v474: 65 pgs: 65 active+clean; 203 MiB data, 837 MiB used, 536 GiB / 536 GiB avail 2024-09-18T21:29:41.926 ERROR:tasks.cephfs.fuse_mount:process failed to terminate after unmount. This probably indicates a bug within ceph-fuse. 2024-09-18T21:29:41.927 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_kamoltat_ceph_c27976df948bf97893b1a7826e51bfff94e4f88c/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/github.com_kamoltat_ceph_c27976df948bf97893b1a7826e51bfff94e4f88c/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-18T21:29:41.929 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-18T21:29:41.941 INFO:tasks.cephadm:Teardown begin 2024-09-18T21:29:41.941 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_kamoltat_ceph_c27976df948bf97893b1a7826e51bfff94e4f88c/qa/tasks/cephadm.py", line 2236, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_kamoltat_ceph_c27976df948bf97893b1a7826e51bfff94e4f88c/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/github.com_kamoltat_ceph_c27976df948bf97893b1a7826e51bfff94e4f88c/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-18T21:29:41.942 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-18T21:29:41.976 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-18T21:29:42.009 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-18T21:29:42.010 DEBUG:teuthology.orchestra.run.smithi077:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-18T21:29:42.035 DEBUG:teuthology.orchestra.run.smithi103:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-18T21:29:42.067 INFO:tasks.cephadm:Stopping all daemons... 2024-09-18T21:29:42.068 INFO:tasks.cephadm.mon.smithi077:Stopping mon.smithi077... 2024-09-18T21:29:42.068 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ceph-5a76ec16-7601-11ef-bceb-c7b262605968@mon.smithi077 2024-09-18T21:29:42.265 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:29:42 smithi077 systemd[1]: Stopping Ceph mon.smithi077 for 5a76ec16-7601-11ef-bceb-c7b262605968... 2024-09-18T21:29:42.562 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:29:42 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-mon-smithi077[92668]: 2024-09-18T21:29:42.359+0000 7fa82c06a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi077 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T21:29:42.562 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:29:42 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-mon-smithi077[92668]: 2024-09-18T21:29:42.359+0000 7fa82c06a640 -1 mon.smithi077@0(leader) e3 *** Got Signal Terminated *** 2024-09-18T21:29:42.562 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:29:42 smithi077 podman[150112]: 2024-09-18 21:29:42.441366498 +0000 UTC m=+0.173612011 container died 2d0fbbea1264b983fc1a033032c62fd1cd68167e731f24dd8dfacf93a50be2b4 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-mon-smithi077, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-release-06b1b1d, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-18T21:29:43.187 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:29:42 smithi077 podman[150112]: 2024-09-18 21:29:42.962171478 +0000 UTC m=+0.694416994 container cleanup 2d0fbbea1264b983fc1a033032c62fd1cd68167e731f24dd8dfacf93a50be2b4 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-mon-smithi077, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-release-06b1b1d, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-18T21:29:43.187 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:29:42 smithi077 bash[150112]: ceph-5a76ec16-7601-11ef-bceb-c7b262605968-mon-smithi077 2024-09-18T21:29:43.438 INFO:journalctl@ceph.mon.smithi077.smithi077.stdout:Sep 18 21:29:43 smithi077 podman[150125]: 2024-09-18 21:29:43.186433082 +0000 UTC m=+0.741797551 container remove 2d0fbbea1264b983fc1a033032c62fd1cd68167e731f24dd8dfacf93a50be2b4 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-mon-smithi077, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-release-06b1b1d) 2024-09-18T21:29:43.450 DEBUG:teuthology.orchestra.run.smithi077:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a76ec16-7601-11ef-bceb-c7b262605968@mon.smithi077.service' 2024-09-18T21:29:43.494 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-18T21:29:43.494 INFO:tasks.cephadm.mon.smithi077:Stopped mon.smithi077 2024-09-18T21:29:43.494 INFO:tasks.cephadm.mon.smithi103:Stopping mon.smithi103... 2024-09-18T21:29:43.494 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-5a76ec16-7601-11ef-bceb-c7b262605968@mon.smithi103 2024-09-18T21:29:43.818 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:29:43 smithi103 systemd[1]: Stopping Ceph mon.smithi103 for 5a76ec16-7601-11ef-bceb-c7b262605968... 2024-09-18T21:29:44.201 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:29:43 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-mon-smithi103[80303]: 2024-09-18T21:29:43.816+0000 7f74e544f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi103 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T21:29:44.202 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:29:43 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-mon-smithi103[80303]: 2024-09-18T21:29:43.816+0000 7f74e544f640 -1 mon.smithi103@1(peon) e3 *** Got Signal Terminated *** 2024-09-18T21:29:44.202 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:29:43 smithi103 podman[116365]: 2024-09-18 21:29:43.940650065 +0000 UTC m=+0.247550316 container died dc79edbd960279b741f3006551bc63ca6d3106d4b765ad9eb589290502db3680 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-mon-smithi103, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-release-06b1b1d, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-18T21:29:44.513 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:29:44 smithi103 podman[116365]: 2024-09-18 21:29:44.392840373 +0000 UTC m=+0.699740623 container cleanup dc79edbd960279b741f3006551bc63ca6d3106d4b765ad9eb589290502db3680 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-mon-smithi103, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-release-06b1b1d, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-18T21:29:44.514 INFO:journalctl@ceph.mon.smithi103.smithi103.stdout:Sep 18 21:29:44 smithi103 bash[116365]: ceph-5a76ec16-7601-11ef-bceb-c7b262605968-mon-smithi103 2024-09-18T21:29:44.837 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a76ec16-7601-11ef-bceb-c7b262605968@mon.smithi103.service' 2024-09-18T21:29:44.883 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-18T21:29:44.883 INFO:tasks.cephadm.mon.smithi103:Stopped mon.smithi103 2024-09-18T21:29:44.884 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-18T21:29:44.884 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ceph-5a76ec16-7601-11ef-bceb-c7b262605968@osd.0 2024-09-18T21:29:45.213 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:29:44 smithi077 systemd[1]: Stopping Ceph osd.0 for 5a76ec16-7601-11ef-bceb-c7b262605968... 2024-09-18T21:29:45.553 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:29:45 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-0[100925]: 2024-09-18T21:29:45.272+0000 7f8403307640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T21:29:45.553 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:29:45 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-0[100925]: 2024-09-18T21:29:45.272+0000 7f8403307640 -1 osd.0 80 *** Got signal Terminated *** 2024-09-18T21:29:45.553 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:29:45 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-0[100925]: 2024-09-18T21:29:45.272+0000 7f8403307640 -1 osd.0 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-18T21:29:51.116 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:29:50 smithi077 podman[150258]: 2024-09-18 21:29:50.80783354 +0000 UTC m=+5.736286873 container died 8855b4b16e008efcd8b03f80da828493f081533ed5eeaa8f0bbe68ccce98f519 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-release-06b1b1d, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-18T21:29:51.433 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:29:51 smithi077 podman[150258]: 2024-09-18 21:29:51.214710689 +0000 UTC m=+6.143164023 container cleanup 8855b4b16e008efcd8b03f80da828493f081533ed5eeaa8f0bbe68ccce98f519 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-release-06b1b1d) 2024-09-18T21:29:51.433 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:29:51 smithi077 bash[150258]: ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-0 2024-09-18T21:29:51.712 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:29:51 smithi077 podman[150274]: 2024-09-18 21:29:51.432924563 +0000 UTC m=+0.619449977 container remove 8855b4b16e008efcd8b03f80da828493f081533ed5eeaa8f0bbe68ccce98f519 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-release-06b1b1d, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-18T21:29:52.137 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:29:51 smithi077 podman[150361]: 2024-09-18 21:29:51.78227978 +0000 UTC m=+0.018907178 image pull f79f744f586d6ce8ddb4b06b7cf36a0f23174bbe29ea68264d2be49d8c6d9acd quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a 2024-09-18T21:29:52.137 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:29:51 smithi077 podman[150361]: 2024-09-18 21:29:51.900540408 +0000 UTC m=+0.137167782 container create 597cc459ce75e607ae768f65ecca4d1bfce4546080bcc5495bcf27d7ee847cf3 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, RELEASE=squid-release-06b1b1d, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-18T21:29:52.137 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:29:52 smithi077 podman[150361]: 2024-09-18 21:29:52.136556728 +0000 UTC m=+0.373184121 container init 597cc459ce75e607ae768f65ecca4d1bfce4546080bcc5495bcf27d7ee847cf3 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-release-06b1b1d, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-18T21:29:52.463 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:29:52 smithi077 podman[150361]: 2024-09-18 21:29:52.140145858 +0000 UTC m=+0.376773240 container start 597cc459ce75e607ae768f65ecca4d1bfce4546080bcc5495bcf27d7ee847cf3 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-release-06b1b1d, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-18T21:29:52.463 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:29:52 smithi077 podman[150361]: 2024-09-18 21:29:52.228136508 +0000 UTC m=+0.464763910 container attach 597cc459ce75e607ae768f65ecca4d1bfce4546080bcc5495bcf27d7ee847cf3 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-release-06b1b1d, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-18T21:29:52.463 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 18 21:29:52 smithi077 podman[150361]: 2024-09-18 21:29:52.32971759 +0000 UTC m=+0.566344973 container died 597cc459ce75e607ae768f65ecca4d1bfce4546080bcc5495bcf27d7ee847cf3 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-release-06b1b1d, org.label-schema.build-date=20240731) 2024-09-18T21:29:52.991 DEBUG:teuthology.orchestra.run.smithi077:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a76ec16-7601-11ef-bceb-c7b262605968@osd.0.service' 2024-09-18T21:29:53.037 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-18T21:29:53.037 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-18T21:29:53.037 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-18T21:29:53.037 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ceph-5a76ec16-7601-11ef-bceb-c7b262605968@osd.1 2024-09-18T21:29:53.378 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:29:53 smithi077 systemd[1]: Stopping Ceph osd.1 for 5a76ec16-7601-11ef-bceb-c7b262605968... 2024-09-18T21:29:53.713 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:29:53 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1[106653]: 2024-09-18T21:29:53.376+0000 7ffac82da640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T21:29:53.713 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:29:53 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1[106653]: 2024-09-18T21:29:53.376+0000 7ffac82da640 -1 osd.1 80 *** Got signal Terminated *** 2024-09-18T21:29:53.713 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:29:53 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1[106653]: 2024-09-18T21:29:53.376+0000 7ffac82da640 -1 osd.1 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-18T21:29:59.188 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:29:58 smithi077 podman[150465]: 2024-09-18 21:29:58.900145692 +0000 UTC m=+5.635723257 container died 2d8bc9cac96c2b6362d1983b6f6f8d79faaeb6b0200a8258aa5c3bfe16476437 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-release-06b1b1d, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-18T21:29:59.463 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:29:59 smithi077 podman[150465]: 2024-09-18 21:29:59.285432199 +0000 UTC m=+6.021009752 container cleanup 2d8bc9cac96c2b6362d1983b6f6f8d79faaeb6b0200a8258aa5c3bfe16476437 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-release-06b1b1d, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-18T21:29:59.463 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:29:59 smithi077 bash[150465]: ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1 2024-09-18T21:29:59.857 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:29:59 smithi077 podman[150481]: 2024-09-18 21:29:59.528466675 +0000 UTC m=+0.629806796 container remove 2d8bc9cac96c2b6362d1983b6f6f8d79faaeb6b0200a8258aa5c3bfe16476437 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-release-06b1b1d, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-18T21:30:00.124 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:29:59 smithi077 podman[150571]: 2024-09-18 21:29:59.759295911 +0000 UTC m=+0.015859807 image pull f79f744f586d6ce8ddb4b06b7cf36a0f23174bbe29ea68264d2be49d8c6d9acd quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a 2024-09-18T21:30:00.124 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:29:59 smithi077 podman[150571]: 2024-09-18 21:29:59.871178781 +0000 UTC m=+0.127742666 container create 505960bdecc6392eaefa74aa4a5833b1e8628efeb56345fcd49cf39d9465bf19 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1-deactivate, RELEASE=squid-release-06b1b1d, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-18T21:30:00.124 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:30:00 smithi077 podman[150571]: 2024-09-18 21:30:00.123810204 +0000 UTC m=+0.380374093 container init 505960bdecc6392eaefa74aa4a5833b1e8628efeb56345fcd49cf39d9465bf19 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1-deactivate, RELEASE=squid-release-06b1b1d, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-18T21:30:00.463 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:30:00 smithi077 podman[150571]: 2024-09-18 21:30:00.127469045 +0000 UTC m=+0.384032934 container start 505960bdecc6392eaefa74aa4a5833b1e8628efeb56345fcd49cf39d9465bf19 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-release-06b1b1d, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-18T21:30:00.463 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:30:00 smithi077 podman[150571]: 2024-09-18 21:30:00.215440233 +0000 UTC m=+0.472004128 container attach 505960bdecc6392eaefa74aa4a5833b1e8628efeb56345fcd49cf39d9465bf19 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-release-06b1b1d, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-18T21:30:00.463 INFO:journalctl@ceph.osd.1.smithi077.stdout:Sep 18 21:30:00 smithi077 podman[150571]: 2024-09-18 21:30:00.317822301 +0000 UTC m=+0.574386182 container died 505960bdecc6392eaefa74aa4a5833b1e8628efeb56345fcd49cf39d9465bf19 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-release-06b1b1d, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-18T21:30:00.900 DEBUG:teuthology.orchestra.run.smithi077:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a76ec16-7601-11ef-bceb-c7b262605968@osd.1.service' 2024-09-18T21:30:00.943 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-18T21:30:00.943 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-18T21:30:00.943 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-18T21:30:00.943 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ceph-5a76ec16-7601-11ef-bceb-c7b262605968@osd.2 2024-09-18T21:30:01.213 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:30:01 smithi077 systemd[1]: Stopping Ceph osd.2 for 5a76ec16-7601-11ef-bceb-c7b262605968... 2024-09-18T21:30:01.713 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:30:01 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-2[112392]: 2024-09-18T21:30:01.296+0000 7fee4130d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T21:30:01.713 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:30:01 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-2[112392]: 2024-09-18T21:30:01.296+0000 7fee4130d640 -1 osd.2 80 *** Got signal Terminated *** 2024-09-18T21:30:01.713 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:30:01 smithi077 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-2[112392]: 2024-09-18T21:30:01.296+0000 7fee4130d640 -1 osd.2 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-18T21:30:06.941 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:30:06 smithi077 podman[150678]: 2024-09-18 21:30:06.667384096 +0000 UTC m=+5.499483708 container died 93876f1d398d07f10e477c3b8be0a61f99f7c78239e9d443873098711092b1e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-release-06b1b1d, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-18T21:30:07.212 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:30:07 smithi077 podman[150678]: 2024-09-18 21:30:07.047542794 +0000 UTC m=+5.879642451 container cleanup 93876f1d398d07f10e477c3b8be0a61f99f7c78239e9d443873098711092b1e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-release-06b1b1d, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-18T21:30:07.213 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:30:07 smithi077 bash[150678]: ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-2 2024-09-18T21:30:07.644 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:30:07 smithi077 podman[150698]: 2024-09-18 21:30:07.323876682 +0000 UTC m=+0.655204334 container remove 93876f1d398d07f10e477c3b8be0a61f99f7c78239e9d443873098711092b1e7 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-2, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-release-06b1b1d, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True) 2024-09-18T21:30:07.948 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:30:07 smithi077 podman[150787]: 2024-09-18 21:30:07.546785041 +0000 UTC m=+0.015956189 image pull f79f744f586d6ce8ddb4b06b7cf36a0f23174bbe29ea68264d2be49d8c6d9acd quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a 2024-09-18T21:30:07.948 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:30:07 smithi077 podman[150787]: 2024-09-18 21:30:07.64968275 +0000 UTC m=+0.118853892 container create e608804268eaf7c3f15dddded6e0ef2ebe08d9080406d65b52fede330a1edb57 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-release-06b1b1d, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-18T21:30:08.213 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:30:08 smithi077 podman[150787]: 2024-09-18 21:30:08.085551645 +0000 UTC m=+0.554722784 container init e608804268eaf7c3f15dddded6e0ef2ebe08d9080406d65b52fede330a1edb57 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-release-06b1b1d) 2024-09-18T21:30:08.213 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:30:08 smithi077 podman[150787]: 2024-09-18 21:30:08.088913229 +0000 UTC m=+0.558084369 container start e608804268eaf7c3f15dddded6e0ef2ebe08d9080406d65b52fede330a1edb57 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-release-06b1b1d, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True) 2024-09-18T21:30:08.572 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:30:08 smithi077 podman[150787]: 2024-09-18 21:30:08.231975837 +0000 UTC m=+0.701146979 container attach e608804268eaf7c3f15dddded6e0ef2ebe08d9080406d65b52fede330a1edb57 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-release-06b1b1d, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True) 2024-09-18T21:30:08.572 INFO:journalctl@ceph.osd.2.smithi077.stdout:Sep 18 21:30:08 smithi077 podman[150787]: 2024-09-18 21:30:08.284368836 +0000 UTC m=+0.753539976 container died e608804268eaf7c3f15dddded6e0ef2ebe08d9080406d65b52fede330a1edb57 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, RELEASE=squid-release-06b1b1d, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-18T21:30:08.865 DEBUG:teuthology.orchestra.run.smithi077:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a76ec16-7601-11ef-bceb-c7b262605968@osd.2.service' 2024-09-18T21:30:08.904 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-18T21:30:08.904 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-18T21:30:08.905 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-18T21:30:08.905 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-5a76ec16-7601-11ef-bceb-c7b262605968@osd.3 2024-09-18T21:30:09.264 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:30:08 smithi103 systemd[1]: Stopping Ceph osd.3 for 5a76ec16-7601-11ef-bceb-c7b262605968... 2024-09-18T21:30:09.521 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:30:09 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3[89649]: 2024-09-18T21:30:09.300+0000 7fb58b33e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T21:30:09.521 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:30:09 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3[89649]: 2024-09-18T21:30:09.300+0000 7fb58b33e640 -1 osd.3 80 *** Got signal Terminated *** 2024-09-18T21:30:09.521 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:30:09 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3[89649]: 2024-09-18T21:30:09.300+0000 7fb58b33e640 -1 osd.3 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-18T21:30:11.764 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:30:11 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5[99676]: 2024-09-18T21:30:11.330+0000 7f6ef3c28640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-18T21:29:46.607789+0000 front 2024-09-18T21:29:46.607646+0000 (oldest deadline 2024-09-18T21:30:11.307622+0000) 2024-09-18T21:30:12.764 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:30:12 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5[99676]: 2024-09-18T21:30:12.331+0000 7f6ef3c28640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-18T21:29:46.607789+0000 front 2024-09-18T21:29:46.607646+0000 (oldest deadline 2024-09-18T21:30:11.307622+0000) 2024-09-18T21:30:13.264 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:30:12 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3[89649]: 2024-09-18T21:30:12.872+0000 7fb58413c640 -1 osd.3 80 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-18T21:29:46.561993+0000 front 2024-09-18T21:29:46.562032+0000 (oldest deadline 2024-09-18T21:30:11.861834+0000) 2024-09-18T21:30:13.628 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:30:13 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5[99676]: 2024-09-18T21:30:13.374+0000 7f6ef3c28640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-18T21:29:46.607789+0000 front 2024-09-18T21:29:46.607646+0000 (oldest deadline 2024-09-18T21:30:11.307622+0000) 2024-09-18T21:30:14.014 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:30:13 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3[89649]: 2024-09-18T21:30:13.835+0000 7fb58413c640 -1 osd.3 80 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-18T21:29:46.561993+0000 front 2024-09-18T21:29:46.562032+0000 (oldest deadline 2024-09-18T21:30:11.861834+0000) 2024-09-18T21:30:14.014 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:30:13 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4[94885]: 2024-09-18T21:30:13.627+0000 7f8872ec7640 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-18T21:29:46.875109+0000 front 2024-09-18T21:29:46.875208+0000 (oldest deadline 2024-09-18T21:30:12.775135+0000) 2024-09-18T21:30:14.703 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:30:14 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4[94885]: 2024-09-18T21:30:14.622+0000 7f8872ec7640 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-18T21:29:46.875109+0000 front 2024-09-18T21:29:46.875208+0000 (oldest deadline 2024-09-18T21:30:12.775135+0000) 2024-09-18T21:30:14.703 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:30:14 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5[99676]: 2024-09-18T21:30:14.410+0000 7f6ef3c28640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-18T21:29:46.607789+0000 front 2024-09-18T21:29:46.607646+0000 (oldest deadline 2024-09-18T21:30:11.307622+0000) 2024-09-18T21:30:14.974 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:30:14 smithi103 podman[116489]: 2024-09-18 21:30:14.702334707 +0000 UTC m=+5.609815497 container died 2556b257bf1c82dc7742e5adaab6d55d2475f14a4afe2e5f7b9d17020ff0b10f (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-release-06b1b1d, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-18T21:30:15.264 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:30:15 smithi103 podman[116489]: 2024-09-18 21:30:15.062889138 +0000 UTC m=+5.970369921 container cleanup 2556b257bf1c82dc7742e5adaab6d55d2475f14a4afe2e5f7b9d17020ff0b10f (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-release-06b1b1d, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-18T21:30:15.264 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:30:15 smithi103 bash[116489]: ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3 2024-09-18T21:30:15.618 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:30:15 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5[99676]: 2024-09-18T21:30:15.432+0000 7f6ef3c28640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-18T21:29:46.607789+0000 front 2024-09-18T21:29:46.607646+0000 (oldest deadline 2024-09-18T21:30:11.307622+0000) 2024-09-18T21:30:15.618 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:30:15 smithi103 podman[116518]: 2024-09-18 21:30:15.322755951 +0000 UTC m=+0.617621437 container remove 2556b257bf1c82dc7742e5adaab6d55d2475f14a4afe2e5f7b9d17020ff0b10f (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-release-06b1b1d, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-18T21:30:15.885 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:30:15 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4[94885]: 2024-09-18T21:30:15.617+0000 7f8872ec7640 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-18T21:29:46.875109+0000 front 2024-09-18T21:29:46.875208+0000 (oldest deadline 2024-09-18T21:30:12.775135+0000) 2024-09-18T21:30:15.885 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:30:15 smithi103 podman[116608]: 2024-09-18 21:30:15.673783167 +0000 UTC m=+0.112411875 container create 68308721bedf85078c68178c0bfc0ba00117a20faef0ae657f35591e01f12ae9 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3-deactivate, RELEASE=squid-release-06b1b1d, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-18T21:30:15.885 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:30:15 smithi103 podman[116608]: 2024-09-18 21:30:15.577092554 +0000 UTC m=+0.015721230 image pull f79f744f586d6ce8ddb4b06b7cf36a0f23174bbe29ea68264d2be49d8c6d9acd quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a 2024-09-18T21:30:15.885 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:30:15 smithi103 podman[116608]: 2024-09-18 21:30:15.884599652 +0000 UTC m=+0.323228326 container init 68308721bedf85078c68178c0bfc0ba00117a20faef0ae657f35591e01f12ae9 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-release-06b1b1d) 2024-09-18T21:30:16.264 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:30:15 smithi103 podman[116608]: 2024-09-18 21:30:15.888052625 +0000 UTC m=+0.326681291 container start 68308721bedf85078c68178c0bfc0ba00117a20faef0ae657f35591e01f12ae9 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=squid-release-06b1b1d, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-18T21:30:16.264 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:30:15 smithi103 podman[116608]: 2024-09-18 21:30:15.993185138 +0000 UTC m=+0.431813819 container attach 68308721bedf85078c68178c0bfc0ba00117a20faef0ae657f35591e01f12ae9 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3-deactivate, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-release-06b1b1d, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-18T21:30:16.264 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 18 21:30:16 smithi103 podman[116608]: 2024-09-18 21:30:16.071556777 +0000 UTC m=+0.510185451 container died 68308721bedf85078c68178c0bfc0ba00117a20faef0ae657f35591e01f12ae9 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-release-06b1b1d, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-18T21:30:16.681 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:30:16 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4[94885]: 2024-09-18T21:30:16.648+0000 7f8872ec7640 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-18T21:29:46.875109+0000 front 2024-09-18T21:29:46.875208+0000 (oldest deadline 2024-09-18T21:30:12.775135+0000) 2024-09-18T21:30:16.681 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:30:16 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5[99676]: 2024-09-18T21:30:16.403+0000 7f6ef3c28640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-18T21:29:46.607789+0000 front 2024-09-18T21:29:46.607646+0000 (oldest deadline 2024-09-18T21:30:11.307622+0000) 2024-09-18T21:30:16.701 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a76ec16-7601-11ef-bceb-c7b262605968@osd.3.service' 2024-09-18T21:30:16.742 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-18T21:30:16.742 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-18T21:30:16.742 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-18T21:30:16.743 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-5a76ec16-7601-11ef-bceb-c7b262605968@osd.4 2024-09-18T21:30:17.014 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:30:16 smithi103 systemd[1]: Stopping Ceph osd.4 for 5a76ec16-7601-11ef-bceb-c7b262605968... 2024-09-18T21:30:17.418 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:30:17 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4[94885]: 2024-09-18T21:30:17.092+0000 7f88760c1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T21:30:17.418 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:30:17 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4[94885]: 2024-09-18T21:30:17.092+0000 7f88760c1640 -1 osd.4 80 *** Got signal Terminated *** 2024-09-18T21:30:17.418 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:30:17 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4[94885]: 2024-09-18T21:30:17.092+0000 7f88760c1640 -1 osd.4 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-18T21:30:17.681 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:30:17 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5[99676]: 2024-09-18T21:30:17.417+0000 7f6ef3c28640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-18T21:29:46.607789+0000 front 2024-09-18T21:29:46.607646+0000 (oldest deadline 2024-09-18T21:30:11.307622+0000) 2024-09-18T21:30:18.014 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:30:17 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4[94885]: 2024-09-18T21:30:17.680+0000 7f8872ec7640 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-18T21:29:46.875109+0000 front 2024-09-18T21:29:46.875208+0000 (oldest deadline 2024-09-18T21:30:12.775135+0000) 2024-09-18T21:30:18.764 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:30:18 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4[94885]: 2024-09-18T21:30:18.652+0000 7f8872ec7640 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-18T21:29:46.875109+0000 front 2024-09-18T21:29:46.875208+0000 (oldest deadline 2024-09-18T21:30:12.775135+0000) 2024-09-18T21:30:18.764 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:30:18 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5[99676]: 2024-09-18T21:30:18.462+0000 7f6ef3c28640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-18T21:29:46.607789+0000 front 2024-09-18T21:29:46.607646+0000 (oldest deadline 2024-09-18T21:30:11.307622+0000) 2024-09-18T21:30:19.764 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:30:19 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4[94885]: 2024-09-18T21:30:19.643+0000 7f8872ec7640 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-18T21:29:46.875109+0000 front 2024-09-18T21:29:46.875208+0000 (oldest deadline 2024-09-18T21:30:12.775135+0000) 2024-09-18T21:30:19.764 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:30:19 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5[99676]: 2024-09-18T21:30:19.426+0000 7f6ef3c28640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-18T21:29:46.607789+0000 front 2024-09-18T21:29:46.607646+0000 (oldest deadline 2024-09-18T21:30:11.307622+0000) 2024-09-18T21:30:20.644 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:30:20 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5[99676]: 2024-09-18T21:30:20.390+0000 7f6ef3c28640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-18T21:29:46.607789+0000 front 2024-09-18T21:29:46.607646+0000 (oldest deadline 2024-09-18T21:30:11.307622+0000) 2024-09-18T21:30:20.645 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:30:20 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5[99676]: 2024-09-18T21:30:20.390+0000 7f6ef3c28640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.77:6814 osd.1 since back 2024-09-18T21:29:57.609221+0000 front 2024-09-18T21:29:57.609147+0000 (oldest deadline 2024-09-18T21:30:19.908967+0000) 2024-09-18T21:30:21.014 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:30:20 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4[94885]: 2024-09-18T21:30:20.640+0000 7f8872ec7640 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-18T21:29:46.875109+0000 front 2024-09-18T21:29:46.875208+0000 (oldest deadline 2024-09-18T21:30:12.775135+0000) 2024-09-18T21:30:21.014 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:30:20 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4[94885]: 2024-09-18T21:30:20.640+0000 7f8872ec7640 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.77:6814 osd.1 since back 2024-09-18T21:29:52.775698+0000 front 2024-09-18T21:29:52.775679+0000 (oldest deadline 2024-09-18T21:30:20.375939+0000) 2024-09-18T21:30:21.661 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:30:21 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5[99676]: 2024-09-18T21:30:21.376+0000 7f6ef3c28640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-18T21:29:46.607789+0000 front 2024-09-18T21:29:46.607646+0000 (oldest deadline 2024-09-18T21:30:11.307622+0000) 2024-09-18T21:30:21.661 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:30:21 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5[99676]: 2024-09-18T21:30:21.376+0000 7f6ef3c28640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.77:6814 osd.1 since back 2024-09-18T21:29:57.609221+0000 front 2024-09-18T21:29:57.609147+0000 (oldest deadline 2024-09-18T21:30:19.908967+0000) 2024-09-18T21:30:22.014 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:30:21 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4[94885]: 2024-09-18T21:30:21.660+0000 7f8872ec7640 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-18T21:29:46.875109+0000 front 2024-09-18T21:29:46.875208+0000 (oldest deadline 2024-09-18T21:30:12.775135+0000) 2024-09-18T21:30:22.014 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:30:21 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4[94885]: 2024-09-18T21:30:21.660+0000 7f8872ec7640 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.77:6814 osd.1 since back 2024-09-18T21:29:52.775698+0000 front 2024-09-18T21:29:52.775679+0000 (oldest deadline 2024-09-18T21:30:20.375939+0000) 2024-09-18T21:30:22.764 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:30:22 smithi103 podman[116712]: 2024-09-18 21:30:22.559915878 +0000 UTC m=+5.591676531 container died 2cde7eaf88d8bf2fecdfbb45d5669861c74657b6ab9dfdbbdd0856acbcdca93e (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-release-06b1b1d, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-18T21:30:22.764 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:30:22 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5[99676]: 2024-09-18T21:30:22.361+0000 7f6ef3c28640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-18T21:29:46.607789+0000 front 2024-09-18T21:29:46.607646+0000 (oldest deadline 2024-09-18T21:30:11.307622+0000) 2024-09-18T21:30:22.764 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:30:22 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5[99676]: 2024-09-18T21:30:22.361+0000 7f6ef3c28640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.77:6814 osd.1 since back 2024-09-18T21:29:57.609221+0000 front 2024-09-18T21:29:57.609147+0000 (oldest deadline 2024-09-18T21:30:19.908967+0000) 2024-09-18T21:30:23.085 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:30:22 smithi103 podman[116712]: 2024-09-18 21:30:22.875465467 +0000 UTC m=+5.907226120 container cleanup 2cde7eaf88d8bf2fecdfbb45d5669861c74657b6ab9dfdbbdd0856acbcdca93e (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-release-06b1b1d, CEPH_POINT_RELEASE=) 2024-09-18T21:30:23.085 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:30:22 smithi103 bash[116712]: ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4 2024-09-18T21:30:23.359 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:30:23 smithi103 podman[116728]: 2024-09-18 21:30:23.084860091 +0000 UTC m=+0.517333735 container remove 2cde7eaf88d8bf2fecdfbb45d5669861c74657b6ab9dfdbbdd0856acbcdca93e (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-release-06b1b1d) 2024-09-18T21:30:23.655 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:30:23 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5[99676]: 2024-09-18T21:30:23.358+0000 7f6ef3c28640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-18T21:29:46.607789+0000 front 2024-09-18T21:29:46.607646+0000 (oldest deadline 2024-09-18T21:30:11.307622+0000) 2024-09-18T21:30:23.656 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:30:23 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5[99676]: 2024-09-18T21:30:23.358+0000 7f6ef3c28640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.77:6814 osd.1 since back 2024-09-18T21:29:57.609221+0000 front 2024-09-18T21:29:57.609147+0000 (oldest deadline 2024-09-18T21:30:19.908967+0000) 2024-09-18T21:30:23.656 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:30:23 smithi103 podman[116814]: 2024-09-18 21:30:23.31824624 +0000 UTC m=+0.016073388 image pull f79f744f586d6ce8ddb4b06b7cf36a0f23174bbe29ea68264d2be49d8c6d9acd quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a 2024-09-18T21:30:23.656 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:30:23 smithi103 podman[116814]: 2024-09-18 21:30:23.419365894 +0000 UTC m=+0.117193084 container create 621146d7b8ab542fb04d8aabcff4aba043e2db7e3df84dbc6b616794bf9a96f4 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-release-06b1b1d, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-18T21:30:23.656 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:30:23 smithi103 podman[116814]: 2024-09-18 21:30:23.655432727 +0000 UTC m=+0.353259869 container init 621146d7b8ab542fb04d8aabcff4aba043e2db7e3df84dbc6b616794bf9a96f4 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-release-06b1b1d, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-18T21:30:24.014 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:30:23 smithi103 podman[116814]: 2024-09-18 21:30:23.65891036 +0000 UTC m=+0.356737496 container start 621146d7b8ab542fb04d8aabcff4aba043e2db7e3df84dbc6b616794bf9a96f4 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-release-06b1b1d, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True) 2024-09-18T21:30:24.014 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:30:23 smithi103 podman[116814]: 2024-09-18 21:30:23.730458888 +0000 UTC m=+0.428286040 container attach 621146d7b8ab542fb04d8aabcff4aba043e2db7e3df84dbc6b616794bf9a96f4 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-release-06b1b1d) 2024-09-18T21:30:24.014 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:30:23 smithi103 podman[116814]: 2024-09-18 21:30:23.844826736 +0000 UTC m=+0.542653879 container died 621146d7b8ab542fb04d8aabcff4aba043e2db7e3df84dbc6b616794bf9a96f4 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-release-06b1b1d, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-18T21:30:24.397 INFO:journalctl@ceph.osd.4.smithi103.stdout:Sep 18 21:30:24 smithi103 podman[116837]: 2024-09-18 21:30:24.367238115 +0000 UTC m=+0.512820712 container remove 621146d7b8ab542fb04d8aabcff4aba043e2db7e3df84dbc6b616794bf9a96f4 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-4-deactivate, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-release-06b1b1d, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T21:30:24.397 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:30:24 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5[99676]: 2024-09-18T21:30:24.328+0000 7f6ef3c28640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-18T21:29:46.607789+0000 front 2024-09-18T21:29:46.607646+0000 (oldest deadline 2024-09-18T21:30:11.307622+0000) 2024-09-18T21:30:24.397 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:30:24 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5[99676]: 2024-09-18T21:30:24.328+0000 7f6ef3c28640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.77:6814 osd.1 since back 2024-09-18T21:29:57.609221+0000 front 2024-09-18T21:29:57.609147+0000 (oldest deadline 2024-09-18T21:30:19.908967+0000) 2024-09-18T21:30:24.402 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a76ec16-7601-11ef-bceb-c7b262605968@osd.4.service' 2024-09-18T21:30:24.440 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-18T21:30:24.440 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-18T21:30:24.440 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-18T21:30:24.440 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-5a76ec16-7601-11ef-bceb-c7b262605968@osd.5 2024-09-18T21:30:24.763 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:30:24 smithi103 systemd[1]: Stopping Ceph osd.5 for 5a76ec16-7601-11ef-bceb-c7b262605968... 2024-09-18T21:30:25.014 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:30:24 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5[99676]: 2024-09-18T21:30:24.761+0000 7f6efae2a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-18T21:30:25.014 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:30:24 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5[99676]: 2024-09-18T21:30:24.761+0000 7f6efae2a640 -1 osd.5 80 *** Got signal Terminated *** 2024-09-18T21:30:25.014 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:30:24 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5[99676]: 2024-09-18T21:30:24.761+0000 7f6efae2a640 -1 osd.5 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-18T21:30:25.764 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:30:25 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5[99676]: 2024-09-18T21:30:25.316+0000 7f6ef3c28640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-18T21:29:46.607789+0000 front 2024-09-18T21:29:46.607646+0000 (oldest deadline 2024-09-18T21:30:11.307622+0000) 2024-09-18T21:30:25.764 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:30:25 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5[99676]: 2024-09-18T21:30:25.316+0000 7f6ef3c28640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.77:6814 osd.1 since back 2024-09-18T21:29:57.609221+0000 front 2024-09-18T21:29:57.609147+0000 (oldest deadline 2024-09-18T21:30:19.908967+0000) 2024-09-18T21:30:26.514 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:30:26 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5[99676]: 2024-09-18T21:30:26.306+0000 7f6ef3c28640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-18T21:29:46.607789+0000 front 2024-09-18T21:29:46.607646+0000 (oldest deadline 2024-09-18T21:30:11.307622+0000) 2024-09-18T21:30:26.514 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:30:26 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5[99676]: 2024-09-18T21:30:26.306+0000 7f6ef3c28640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.77:6814 osd.1 since back 2024-09-18T21:29:57.609221+0000 front 2024-09-18T21:29:57.609147+0000 (oldest deadline 2024-09-18T21:30:19.908967+0000) 2024-09-18T21:30:27.764 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:30:27 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5[99676]: 2024-09-18T21:30:27.318+0000 7f6ef3c28640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-18T21:29:46.607789+0000 front 2024-09-18T21:29:46.607646+0000 (oldest deadline 2024-09-18T21:30:11.307622+0000) 2024-09-18T21:30:27.764 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:30:27 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5[99676]: 2024-09-18T21:30:27.318+0000 7f6ef3c28640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.77:6814 osd.1 since back 2024-09-18T21:29:57.609221+0000 front 2024-09-18T21:29:57.609147+0000 (oldest deadline 2024-09-18T21:30:19.908967+0000) 2024-09-18T21:30:28.764 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:30:28 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5[99676]: 2024-09-18T21:30:28.354+0000 7f6ef3c28640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-18T21:29:46.607789+0000 front 2024-09-18T21:29:46.607646+0000 (oldest deadline 2024-09-18T21:30:11.307622+0000) 2024-09-18T21:30:28.764 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:30:28 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5[99676]: 2024-09-18T21:30:28.354+0000 7f6ef3c28640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.77:6814 osd.1 since back 2024-09-18T21:29:57.609221+0000 front 2024-09-18T21:29:57.609147+0000 (oldest deadline 2024-09-18T21:30:19.908967+0000) 2024-09-18T21:30:28.764 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:30:28 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5[99676]: 2024-09-18T21:30:28.354+0000 7f6ef3c28640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.77:6822 osd.2 since back 2024-09-18T21:30:04.609804+0000 front 2024-09-18T21:30:04.609818+0000 (oldest deadline 2024-09-18T21:30:28.109672+0000) 2024-09-18T21:30:29.764 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:30:29 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5[99676]: 2024-09-18T21:30:29.373+0000 7f6ef3c28640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-18T21:29:46.607789+0000 front 2024-09-18T21:29:46.607646+0000 (oldest deadline 2024-09-18T21:30:11.307622+0000) 2024-09-18T21:30:29.764 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:30:29 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5[99676]: 2024-09-18T21:30:29.373+0000 7f6ef3c28640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.77:6814 osd.1 since back 2024-09-18T21:29:57.609221+0000 front 2024-09-18T21:29:57.609147+0000 (oldest deadline 2024-09-18T21:30:19.908967+0000) 2024-09-18T21:30:29.764 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:30:29 smithi103 ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5[99676]: 2024-09-18T21:30:29.373+0000 7f6ef3c28640 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.77:6822 osd.2 since back 2024-09-18T21:30:04.609804+0000 front 2024-09-18T21:30:04.609818+0000 (oldest deadline 2024-09-18T21:30:28.109672+0000) 2024-09-18T21:30:30.412 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:30:30 smithi103 podman[116916]: 2024-09-18 21:30:30.088418413 +0000 UTC m=+5.432128830 container died e6912ab63ecca23fac6f8983821da4ba1461f8b03c4b33a610d3078f46831e22 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-release-06b1b1d) 2024-09-18T21:30:30.412 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:30:30 smithi103 podman[116916]: 2024-09-18 21:30:30.411607682 +0000 UTC m=+5.755318095 container cleanup e6912ab63ecca23fac6f8983821da4ba1461f8b03c4b33a610d3078f46831e22 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-release-06b1b1d, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-18T21:30:30.764 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:30:30 smithi103 bash[116916]: ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5 2024-09-18T21:30:30.764 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:30:30 smithi103 podman[116931]: 2024-09-18 21:30:30.596606233 +0000 UTC m=+0.503443406 container remove e6912ab63ecca23fac6f8983821da4ba1461f8b03c4b33a610d3078f46831e22 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5, maintainer=Guillaume Abrioux , RELEASE=squid-release-06b1b1d, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-18T21:30:31.300 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:30:31 smithi103 podman[117024]: 2024-09-18 21:30:31.014075034 +0000 UTC m=+0.104738943 container create 6535332a3ac76bcae0be05116d0107342f3d22de558ebc54e4ec96d064c88f36 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-release-06b1b1d, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-18T21:30:31.300 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:30:31 smithi103 podman[117024]: 2024-09-18 21:30:30.925084057 +0000 UTC m=+0.015747976 image pull f79f744f586d6ce8ddb4b06b7cf36a0f23174bbe29ea68264d2be49d8c6d9acd quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a 2024-09-18T21:30:31.300 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:30:31 smithi103 podman[117024]: 2024-09-18 21:30:31.225091393 +0000 UTC m=+0.315755309 container init 6535332a3ac76bcae0be05116d0107342f3d22de558ebc54e4ec96d064c88f36 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=squid-release-06b1b1d, CEPH_POINT_RELEASE=, ceph=True) 2024-09-18T21:30:31.300 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:30:31 smithi103 podman[117024]: 2024-09-18 21:30:31.228500838 +0000 UTC m=+0.319164748 container start 6535332a3ac76bcae0be05116d0107342f3d22de558ebc54e4ec96d064c88f36 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-release-06b1b1d, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-18T21:30:31.301 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:30:31 smithi103 podman[117024]: 2024-09-18 21:30:31.299856485 +0000 UTC m=+0.390520408 container attach 6535332a3ac76bcae0be05116d0107342f3d22de558ebc54e4ec96d064c88f36 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5-deactivate, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-release-06b1b1d, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-18T21:30:31.728 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:30:31 smithi103 podman[117024]: 2024-09-18 21:30:31.416964985 +0000 UTC m=+0.507628903 container died 6535332a3ac76bcae0be05116d0107342f3d22de558ebc54e4ec96d064c88f36 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-release-06b1b1d, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-18T21:30:31.986 INFO:journalctl@ceph.osd.5.smithi103.stdout:Sep 18 21:30:31 smithi103 podman[117047]: 2024-09-18 21:30:31.970161884 +0000 UTC m=+0.547640215 container remove 6535332a3ac76bcae0be05116d0107342f3d22de558ebc54e4ec96d064c88f36 (image=quay.ceph.io/ceph-ci/ceph@sha256:31a64012c9232d0d7ee438ca1184d4ebaee64e2cc31d8b2804ed5e81dc0b053a, name=ceph-5a76ec16-7601-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=squid-release-06b1b1d, GIT_BRANCH=HEAD) 2024-09-18T21:30:31.992 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5a76ec16-7601-11ef-bceb-c7b262605968@osd.5.service' 2024-09-18T21:30:32.031 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-18T21:30:32.031 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-18T21:30:32.031 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-18T21:30:35.394 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:ceph-fuse[75559]: fuse finished with error 0 and tester_r 0 2024-09-18T21:30:52.185 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-18T21:31:06.379 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-18T21:31:06.412 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-18T21:31:06.440 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-18T21:31:06.441 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/ksirivad-2024-09-18_20:45:49-upgrade-squid-release-distro-default-smithi/7911588/remote/smithi077/crash 2024-09-18T21:31:06.442 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/crash -- . 2024-09-18T21:31:06.481 INFO:teuthology.orchestra.run.smithi077.stderr:tar: /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-18T21:31:06.481 INFO:teuthology.orchestra.run.smithi077.stderr:tar: Error is not recoverable: exiting now 2024-09-18T21:31:06.483 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/ksirivad-2024-09-18_20:45:49-upgrade-squid-release-distro-default-smithi/7911588/remote/smithi103/crash 2024-09-18T21:31:06.483 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/crash -- . 2024-09-18T21:31:06.507 INFO:teuthology.orchestra.run.smithi103.stderr:tar: /var/lib/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-18T21:31:06.507 INFO:teuthology.orchestra.run.smithi103.stderr:tar: Error is not recoverable: exiting now 2024-09-18T21:31:06.508 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-18T21:31:06.509 DEBUG:teuthology.orchestra.run.smithi077:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'osds down' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-18T21:31:06.568 INFO:tasks.cephadm:Compressing logs... 2024-09-18T21:31:06.568 DEBUG:teuthology.orchestra.run.smithi077:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-18T21:31:06.570 DEBUG:teuthology.orchestra.run.smithi103:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-18T21:31:06.593 INFO:teuthology.orchestra.run.smithi077.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-09-18T21:31:06.593 INFO:teuthology.orchestra.run.smithi077.stderr:: No such file or directory 2024-09-18T21:31:06.594 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-18T21:31:06.594 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-18T21:31:06.595 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi077.cqfhlw.log 2024-09-18T21:31:06.595 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph-osd.0.log: /var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-18T21:31:06.598 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi077.cqfhlw.log: gzip -5 --verbose -- /var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-18T21:31:06.598 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph-mon.smithi077.log 2024-09-18T21:31:06.598 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph-volume.log: /var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi077.vruydi.log 2024-09-18T21:31:06.598 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph-mon.smithi077.log: gzip -5 --verbose -- /var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-18T21:31:06.599 INFO:teuthology.orchestra.run.smithi103.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ceph-client.1.log 2024-09-18T21:31:06.600 INFO:teuthology.orchestra.run.smithi103.stderr:: No such file or directory 2024-09-18T21:31:06.600 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi103.zhdmdg.log 2024-09-18T21:31:06.600 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.1.log: gzip -5 --verbose -- /var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-18T21:31:06.600 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi103.zhdmdg.log: gzip -5 --verbose -- /var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-18T21:31:06.600 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-18T21:31:06.600 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph-mgr.smithi103.zjztqc.log 2024-09-18T21:31:06.600 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi103.opftmf.log 2024-09-18T21:31:06.600 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph-mgr.smithi103.zjztqc.log: gzip -5 --verbose -- /var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-18T21:31:06.600 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi103.opftmf.log: /var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph.cephadm.log: 85.4% -- replaced with /var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-18T21:31:06.600 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph-mon.smithi103.log 2024-09-18T21:31:06.600 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-18T21:31:06.601 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph-mon.smithi103.log: 91.4% -- replaced with /var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-18T21:31:06.602 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi077.vruydi.log: 91.2% -- replaced with /var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-18T21:31:06.602 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-18T21:31:06.603 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph.cephadm.log: 86.5% -- replaced with /var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-18T21:31:06.603 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph.log 2024-09-18T21:31:06.607 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph.log 2024-09-18T21:31:06.617 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph-osd.5.log: 91.0% -- replaced with /var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-18T21:31:06.618 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-18T21:31:06.619 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph-osd.2.log: 91.0% -- replaced with /var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-18T21:31:06.619 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph-mgr.smithi077.utkpjg.log 2024-09-18T21:31:06.621 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph.log: 88.3% -- replaced with /var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-18T21:31:06.621 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-18T21:31:06.623 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph.log: 88.2% -- replaced with /var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-18T21:31:06.623 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-18T21:31:06.645 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-18T21:31:06.668 INFO:teuthology.orchestra.run.smithi103.stderr: 89.8% -- replaced with /var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph-mgr.smithi103.zjztqc.log.gz 2024-09-18T21:31:06.706 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph-mgr.smithi077.utkpjg.log: /var/log/ceph/cephadm.log: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-18T21:31:06.997 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph-mgr.smithi077.utkpjg.log.gz 2024-09-18T21:31:07.044 INFO:teuthology.orchestra.run.smithi103.stderr: 92.5% -- replaced with /var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph-mon.smithi103.log.gz 2024-09-18T21:31:07.773 INFO:teuthology.orchestra.run.smithi077.stderr: 90.4% -- replaced with /var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph-mon.smithi077.log.gz 2024-09-18T21:31:10.764 INFO:teuthology.orchestra.run.smithi103.stderr: 93.3% -- replaced with /var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-18T21:31:11.973 INFO:teuthology.orchestra.run.smithi077.stderr: 93.4% -- replaced with /var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-18T21:31:12.732 INFO:teuthology.orchestra.run.smithi077.stderr: 93.4% -- replaced with /var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-18T21:31:13.319 INFO:teuthology.orchestra.run.smithi103.stderr: 93.5% -- replaced with /var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-18T21:31:13.338 INFO:teuthology.orchestra.run.smithi077.stderr: 93.4% -- replaced with /var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-18T21:31:13.710 INFO:teuthology.orchestra.run.smithi103.stderr: 94.8% -- replaced with /var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi103.zhdmdg.log.gz 2024-09-18T21:31:14.103 INFO:teuthology.orchestra.run.smithi077.stderr: 94.8% -- replaced with /var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi077.cqfhlw.log.gz 2024-09-18T21:31:14.642 INFO:teuthology.orchestra.run.smithi103.stderr: 94.8% -- replaced with /var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi103.opftmf.log.gz 2024-09-18T21:31:15.072 INFO:teuthology.orchestra.run.smithi103.stderr: 93.5% -- replaced with /var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-18T21:31:20.384 INFO:teuthology.orchestra.run.smithi103.stderr:gzip: /var/log/ceph/ceph-client.1.log: file size changed while zipping 2024-09-18T21:31:20.384 INFO:teuthology.orchestra.run.smithi103.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.1.log.gz 2024-09-18T21:31:20.386 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-18T21:31:20.386 INFO:teuthology.orchestra.run.smithi103.stderr:real 0m13.802s 2024-09-18T21:31:20.386 INFO:teuthology.orchestra.run.smithi103.stderr:user 0m47.346s 2024-09-18T21:31:20.386 INFO:teuthology.orchestra.run.smithi103.stderr:sys 0m1.401s 2024-09-18T21:31:20.974 INFO:teuthology.orchestra.run.smithi077.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-09-18T21:32:38.949 INFO:teuthology.orchestra.run.smithi077.stderr: 92.9% -- replaced with /var/log/ceph/5a76ec16-7601-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi077.vruydi.log.gz 2024-09-18T21:32:38.951 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-09-18T21:32:38.951 INFO:teuthology.orchestra.run.smithi077.stderr:real 1m32.367s 2024-09-18T21:32:38.951 INFO:teuthology.orchestra.run.smithi077.stderr:user 2m9.630s 2024-09-18T21:32:38.951 INFO:teuthology.orchestra.run.smithi077.stderr:sys 0m4.214s 2024-09-18T21:32:38.952 INFO:tasks.cephadm:Archiving logs... 2024-09-18T21:32:38.952 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/log/ceph to /home/teuthworker/archive/ksirivad-2024-09-18_20:45:49-upgrade-squid-release-distro-default-smithi/7911588/remote/smithi077/log 2024-09-18T21:32:38.954 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-18T21:32:57.492 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/log/ceph to /home/teuthworker/archive/ksirivad-2024-09-18_20:45:49-upgrade-squid-release-distro-default-smithi/7911588/remote/smithi103/log 2024-09-18T21:32:57.493 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-18T21:33:03.189 INFO:tasks.cephadm:Removing cluster... 2024-09-18T21:33:03.190 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 --force 2024-09-18T21:33:03.801 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5a76ec16-7601-11ef-bceb-c7b262605968 --force 2024-09-18T21:33:04.303 INFO:tasks.cephadm:Removing cephadm ... 2024-09-18T21:33:04.304 DEBUG:teuthology.orchestra.run.smithi077:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-18T21:33:04.320 DEBUG:teuthology.orchestra.run.smithi103:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-18T21:33:04.335 INFO:tasks.cephadm:Teardown complete 2024-09-18T21:33:04.335 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-18T21:33:04.348 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/install/__init__.py", line 641, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_kamoltat_ceph_c27976df948bf97893b1a7826e51bfff94e4f88c/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/github.com_kamoltat_ceph_c27976df948bf97893b1a7826e51bfff94e4f88c/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-18T21:33:04.349 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-18T21:33:04.349 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-18T21:33:04.362 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-18T21:33:04.448 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-18T21:33:04.457 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-18T21:33:04.458 DEBUG:teuthology.orchestra.run.smithi077:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T21:33:04.461 DEBUG:teuthology.orchestra.run.smithi103:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-18T21:33:04.472 INFO:teuthology.orchestra.run.smithi077.stderr:bash: line 1: ntpq: command not found 2024-09-18T21:33:04.475 INFO:teuthology.orchestra.run.smithi103.stderr:bash: line 1: ntpq: command not found 2024-09-18T21:33:04.477 INFO:teuthology.orchestra.run.smithi077.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-18T21:33:04.477 INFO:teuthology.orchestra.run.smithi077.stdout:=============================================================================== 2024-09-18T21:33:04.477 INFO:teuthology.orchestra.run.smithi077.stdout:^* hv01.front.sepia.ceph.com 3 6 377 2 -226us[ -220us] +/- 46ms 2024-09-18T21:33:04.477 INFO:teuthology.orchestra.run.smithi077.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 4 +525us[ +531us] +/- 56ms 2024-09-18T21:33:04.477 INFO:teuthology.orchestra.run.smithi077.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 1 -360us[ -360us] +/- 80ms 2024-09-18T21:33:04.477 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T21:33:04.480 INFO:teuthology.orchestra.run.smithi103.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-18T21:33:04.480 INFO:teuthology.orchestra.run.smithi103.stdout:=============================================================================== 2024-09-18T21:33:04.480 INFO:teuthology.orchestra.run.smithi103.stdout:^* hv01.front.sepia.ceph.com 3 6 377 1 -232us[ -224us] +/- 46ms 2024-09-18T21:33:04.480 INFO:teuthology.orchestra.run.smithi103.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 5 +524us[ +532us] +/- 56ms 2024-09-18T21:33:04.480 INFO:teuthology.orchestra.run.smithi103.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 1 -372us[ -364us] +/- 80ms 2024-09-18T21:33:04.480 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-18T21:33:04.480 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-18T21:33:04.499 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-18T21:33:04.500 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-18T21:33:04.512 DEBUG:teuthology.orchestra.run.smithi077:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-18T21:33:04.599 DEBUG:teuthology.orchestra.run.smithi103:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-18T21:33:04.672 DEBUG:teuthology.orchestra.run.smithi077:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-18T21:33:04.701 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T21:33:04.701 DEBUG:teuthology.orchestra.run.smithi103:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-18T21:33:04.730 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T21:33:04.730 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-18T21:33:04.743 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-18T21:33:04.756 INFO:teuthology.task.internal:Duration was 2181.573470 seconds 2024-09-18T21:33:04.756 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-18T21:33:04.768 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-18T21:33:04.768 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-18T21:33:04.771 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-18T21:33:04.807 INFO:teuthology.orchestra.run.smithi077.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-18T21:33:04.809 INFO:teuthology.orchestra.run.smithi103.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-18T21:33:05.053 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-18T21:33:05.053 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi077.front.sepia.ceph.com 2024-09-18T21:33:05.053 DEBUG:teuthology.orchestra.run.smithi077:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-18T21:33:05.074 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi103.front.sepia.ceph.com 2024-09-18T21:33:05.074 DEBUG:teuthology.orchestra.run.smithi103:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-18T21:33:05.120 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-18T21:33:05.120 DEBUG:teuthology.orchestra.run.smithi077:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-18T21:33:05.123 DEBUG:teuthology.orchestra.run.smithi103:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-18T21:33:05.186 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-18T21:33:05.187 DEBUG:teuthology.orchestra.run.smithi077:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-18T21:33:05.189 DEBUG:teuthology.orchestra.run.smithi103:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-18T21:33:05.885 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-18T21:33:05.896 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-18T21:33:05.896 DEBUG:teuthology.orchestra.run.smithi077:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-18T21:33:05.921 DEBUG:teuthology.orchestra.run.smithi103:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-18T21:33:05.947 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-18T21:33:05.960 DEBUG:teuthology.orchestra.run.smithi077:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-18T21:33:05.963 DEBUG:teuthology.orchestra.run.smithi103:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-18T21:33:05.984 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern = core 2024-09-18T21:33:06.012 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern = core 2024-09-18T21:33:06.036 DEBUG:teuthology.orchestra.run.smithi077:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-18T21:33:06.055 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T21:33:06.055 DEBUG:teuthology.orchestra.run.smithi103:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-18T21:33:06.091 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T21:33:06.092 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-18T21:33:06.103 INFO:teuthology.task.internal:Transferring archived files... 2024-09-18T21:33:06.104 DEBUG:teuthology.misc:Transferring archived files from smithi077:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/ksirivad-2024-09-18_20:45:49-upgrade-squid-release-distro-default-smithi/7911588/remote/smithi077 2024-09-18T21:33:06.104 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-18T21:33:06.152 DEBUG:teuthology.misc:Transferring archived files from smithi103:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/ksirivad-2024-09-18_20:45:49-upgrade-squid-release-distro-default-smithi/7911588/remote/smithi103 2024-09-18T21:33:06.152 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-18T21:33:06.190 INFO:teuthology.task.internal:Removing archive directory... 2024-09-18T21:33:06.190 DEBUG:teuthology.orchestra.run.smithi077:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-18T21:33:06.192 DEBUG:teuthology.orchestra.run.smithi103:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-18T21:33:06.239 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-18T21:33:06.251 INFO:teuthology.task.internal:Not uploading archives. 2024-09-18T21:33:06.252 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-18T21:33:06.262 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-18T21:33:06.262 DEBUG:teuthology.orchestra.run.smithi077:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-18T21:33:06.265 DEBUG:teuthology.orchestra.run.smithi103:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-18T21:33:06.278 INFO:teuthology.orchestra.run.smithi077.stdout: 265852 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 18 21:33 /home/ubuntu/cephtest 2024-09-18T21:33:06.278 INFO:teuthology.orchestra.run.smithi077.stdout: 655898 4 d--------- 2 ubuntu ubuntu 4096 Sep 18 21:10 /home/ubuntu/cephtest/mnt.0 2024-09-18T21:33:06.279 INFO:teuthology.orchestra.run.smithi077.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-09-18T21:33:06.279 INFO:teuthology.orchestra.run.smithi077.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-09-18T21:33:06.281 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-18T21:33:06.281 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_kamoltat_ceph_c27976df948bf97893b1a7826e51bfff94e4f88c/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/github.com_kamoltat_ceph_c27976df948bf97893b1a7826e51bfff94e4f88c/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 153, in __exit__ self.gen.throw(typ, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi077 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-09-18T21:33:06.281 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-18T21:33:06.293 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-18T21:33:06.305 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-18T21:33:06.308 INFO:teuthology.run:Summary data: description: upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2181.5734701156616 failure_reason: reached maximum tries (50) after waiting for 300 seconds flavor: default owner: scheduled_ksirivad@teuthology status: fail success: false 2024-09-18T21:33:06.308 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-18T21:33:06.413 INFO:teuthology.run:FAIL